Picture safety monitoring and early warning system for night vision observation equipment

By monitoring and superimposing the image of visible light and infrared cameras in the night vision monitoring system, fill lights are controlled to improve picture clarity and monitoring accuracy, the problems of insufficient illumination and energy waste are solved, and more efficient energy use and Environmental protection.

CN119277023AActive Publication Date: 2025-01-07GUANGZHOU SPARKLE TECH CO LTD
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202411393210.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-08
Publication Date
2025-01-07
Estimated Expiration
2044-10-08

AI Technical Summary

Technical Problem

The existing night vision safety monitoring and early warning system affects the camera's face capture effect when the illumination is insufficient, and high-illumination fill lights lead to energy waste and environmental impact.

Method used

By monitoring the visible light camera and infrared camera separately, we can obtain whether the two sets of pictures have changed, and superimpose the process after the changes, and control the fill light to improve the picture clarity and monitoring accuracy to avoid continuous light.

Benefits of technology

Improve the accuracy and safety of picture change monitoring, save energy, avoid environmental impact, and reduce the working time of fill lights.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119277023A_ABST
    Figure CN119277023A_ABST
Patent Text Reader

Abstract

The invention relates to the field of night vision monitoring, is used for solving the problems of energy waste and influence on the environment caused by continuous light supplement of a high-illumination light supplement lamp of a night vision camera, and particularly relates to a picture safety monitoring and early warning system for night vision observation equipment. Comprising a camera shooting monitoring unit, an infrared monitoring unit, a region picture monitoring unit, a low-light control unit and a picture alarm generation unit, in the invention, the visible light camera and the infrared camera are respectively subjected to picture monitoring, whether the positions where the pictures change coincide or not is confirmed, and when the two groups of pictures change, the light supplementing lamp is controlled to work, so that the shooting definition of the visible light picture is improved, the face information in the picture is conveniently captured, and the picture monitoring safety is improved; when one group of pictures changes, the light supplementing lamp is controlled to work, the scene brightness is improved, the two groups of pictures are overlapped and compared again, whether the two groups of pictures change at the same time or not is determined, and therefore the picture monitoring accuracy is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the field of night vision monitoring, and in particular to a picture safety monitoring and early warning system for night vision observation equipment. Background Art

[0002] The monitoring system is the physical basis for real-time monitoring of key departments or important places in various industries. Management departments can obtain effective data, image video digital video monitoring system schematics or sound information through it, and timely monitor and memorize the process of sudden abnormal events to provide efficient and timely command and height, deploy police force, handle cases, etc. The working modes of monitoring cameras at night generally include black and white night vision and full-color night vision. In the black and white night vision mode, the camera turns on the infrared light for fill light; in the full-color night vision mode, the camera turns on the fill light for fill light, which can be a white light or other visible light fill light;

[0003] At present, the night vision picture safety monitoring and early warning system in the prior art still has shortcomings. The existing patent CN101959058A discloses a technical solution, in which an LED lamp is used as a camera light source for supplementary lighting. The low-power LED lamp is used to continuously supplement the camera with light to solve the problem of insufficient camera picture clarity. However, in actual use, when the illumination of the LED lamp is insufficient, it will affect the effect of the camera capturing the face. When the illumination of the LED lamp is sufficient, the continuous working LED lamp will not only cause energy waste, but the continuous lighting will also affect the environment, thereby affecting the rest of personnel or affecting the ecology of phototactic insects.

[0004] In view of the above technical problems, this application proposes a solution. Summary of the invention

[0005] In the present invention, the visible light camera and the infrared camera are respectively monitored to obtain whether the two groups of pictures have changed, and the two groups of pictures are superimposed after the change occurs, so as to compare whether the positions where the pictures have changed overlap, thereby improving the accuracy of picture change monitoring, and when it is confirmed that the picture has changed, the fill light is controlled to work, thereby improving the shooting clarity of the visible light picture, facilitating the capture of facial information in the picture, and improving the safety of picture monitoring, while avoiding the fill light from working continuously at night, saving energy and not affecting the environment due to continuous illumination, solving the problem of energy waste and environmental impact caused by continuous fill light of high-illuminance fill light of night vision camera, and proposing a picture safety monitoring and early warning system for night vision observation equipment.

[0006] The purpose of the present invention can be achieved through the following technical solutions:

[0007] A picture safety monitoring and early warning system for night vision observation equipment includes a camera monitoring unit, wherein the camera monitoring unit is used to collect pictures, obtain low-light pictures and picture brightness, and perform change analysis on the low-light pictures to generate image early warning signals;

[0008] An infrared monitoring unit, which collects images through an infrared camera, obtains infrared images, performs change analysis on the infrared images, and generates infrared warning signals;

[0009] A regional image monitoring unit, wherein the regional image monitoring unit obtains an infrared warning image and an image warning image, and compares and analyzes the infrared warning image and the image warning image to generate an image change alarm or a suspected image alarm signal;

[0010] A low light control unit, which obtains a picture change alarm or a picture suspected alarm signal through the regional picture monitoring unit and controls the fill light source;

[0011] The picture alarm generating unit obtains the picture change alarm through the regional picture monitoring unit, uploads the picture change alarm and stores the picture.

[0012] As a preferred embodiment of the present invention, the camera monitoring unit collects camera data through a camera callback function, converts the collected camera data into RGB format, and performs algorithm extraction on the RGB format to obtain brightness parameters, which are recorded as picture brightness.

[0013] As a preferred embodiment of the present invention, the process of analyzing the change of the low-light image by the camera monitoring unit is as follows:

[0014] S1: The camera monitoring unit overlaps two adjacent frames and compares the overlapped pixels. If the color and saturation of the pixels at the same position are the same, they are recorded as static pixels. If the color and saturation of the pixels at the same position are different, they are recorded as changing pixels.

[0015] S2: The camera monitoring unit counts all the changed pixels and calculates the proportion of the changed pixels in all the pixels. If the proportion of the changed pixels is less than the preset proportion, a no-change signal is generated and the change analysis ends. If the proportion of the changed pixels is greater than or equal to the preset proportion, step S3 is performed.

[0016] S3: The camera monitoring unit performs discrete analysis on the distribution position of the changed pixel points in the picture to obtain discrete feature values ​​of the changed pixel points, and compares the discrete feature values ​​with a preset feature threshold. If the discrete feature value is less than the preset threshold, an image warning signal is generated.

[0017] As a preferred embodiment of the present invention, the process of the infrared monitoring unit performing picture change analysis on the infrared picture is as follows:

[0018] A1: The infrared monitoring unit takes each frame of the infrared image as a picture and obtains the temperature of the pixel points in the picture;

[0019] A2: Continuously monitor the temperature of the pixel at the same position. If the temperature change of the pixel at the same position in two consecutive frames exceeds the preset threshold, it is recorded as a changing pixel. If the temperature change of the pixel at the same position in two consecutive frames does not exceed the preset threshold, it is recorded as a static pixel.

[0020] A3: The infrared monitoring unit counts the proportion of changed pixels in all pixels. When the proportion of changed pixels is greater than a preset proportion, step A4 is performed. When the proportion of changed pixels is less than or equal to the preset proportion, a still image signal is generated and the change analysis ends.

[0021] A4: The infrared monitoring unit performs discrete analysis on the distribution position of the changed pixel points in the picture to obtain a discrete characteristic value. If the discrete characteristic value is less than a preset threshold, an infrared warning signal is generated.

[0022] As a preferred implementation manner of the present invention, the camera monitoring unit sends the picture brightness and the image warning signal to the regional picture monitoring unit, and the infrared monitoring unit sends the infrared warning signal to the regional picture monitoring unit.

[0023] As a preferred embodiment of the present invention, the process of discrete analysis performed by the infrared monitoring unit and the camera monitoring unit is as follows:

[0024] A group of changing pixels are selected as the starting point, and the shortest path passing through all the changing pixels is found through the path calculation algorithm. The proportion of static pixels passed in the shortest path to the total number of pixels is calculated and recorded as discrete eigenvalues.

[0025] As a preferred embodiment of the present invention, the regional image monitoring unit records the image when the infrared monitoring unit generates an infrared warning signal as an infrared warning image, and records the image when the camera monitoring unit generates an image warning signal as an image warning image. If the position overlap of the changed pixel points in the infrared warning image and the image warning image is greater than or equal to a preset overlap value, a picture change alarm is generated; if the position overlap of the changed pixel points in the infrared warning image and the image warning image is less than a preset overlap value, a picture suspected alarm signal is generated.

[0026] The regional image monitoring unit generates an image suspected alarm signal after acquiring only the infrared warning signal;

[0027] The regional image monitoring unit does not respond when only the image warning signal is obtained.

[0028] As a preferred embodiment of the present invention, after the low-light control unit obtains the picture change alarm, it performs a threshold analysis on the picture brightness. If the picture brightness reaches the set threshold, it does not respond. If the picture brightness does not reach the set threshold, it generates a fill light signal to control the brightness of the fill light source to increase linearly until the obtained picture brightness reaches the set threshold.

[0029] As a preferred embodiment of the present invention, after the low-light control unit obtains the suspected alarm signal of the picture, it performs a threshold analysis on the brightness of the picture. If the brightness of the picture reaches the set threshold, the suspected alarm signal of the picture is canceled. If the brightness of the picture does not reach the set threshold, the brightness of the fill light source is linearly increased so that the brightness of the picture reaches the set threshold. If a picture change alarm is generated, it is sent to the picture alarm generation unit. If a suspected alarm signal of the picture is still generated, the suspected alarm signal of the picture is canceled.

[0030] Compared with the prior art, the present invention has the following beneficial effects:

[0031] 1. In the present invention, when monitoring the picture, the visible light camera and the infrared camera are monitored separately to monitor whether the current visible light picture and the infrared picture have changed, and the two sets of pictures are superimposed after the change occurs, so as to compare whether the positions where the pictures have changed overlap, thereby improving the accuracy of picture change monitoring.

[0032] 2. In the present invention, when the picture changes, the fill light is controlled to work through the alarm signal, thereby improving the shooting clarity of the visible light picture, facilitating the capture of facial information in the picture, ensuring the clarity of the saved changing picture, and improving the safety of picture monitoring. At the same time, it avoids the fill light from working continuously at night, saving energy while not affecting the environment due to continuous illumination.

[0033] 3. In the present invention, when one of the groups of images changes, the fill light is controlled to work, thereby increasing the scene brightness and improving the shooting clarity of the visible light image. The two groups of images are overlapped and compared again to confirm whether the two groups of images change at the same time, thereby improving the accuracy of image monitoring and reducing the working time of the fill light. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0035] Figure 1 is a system block diagram of the present invention;

[0036] Figure 2It is a system flow chart of the present invention. DETAILED DESCRIPTION

[0037] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] Embodiment 1:

[0039] See also Figure 1 - Figure 2 As shown, a screen safety monitoring and early warning system for night vision observation equipment includes a video monitoring unit, an infrared monitoring unit, a regional screen monitoring unit, a low-light control unit, and a screen alarm generating unit. The video monitoring unit collects screens through a camera and records them as low-light screens. At the same time, the camera data is collected through a camera callback function, and the collected camera data is converted into RGB format. The RGB format is extracted by an algorithm to obtain brightness parameters, which are recorded as screen brightness.

[0040] The camera monitoring unit analyzes the changes in low-light images. The process is as follows:

[0041] S1: The camera monitoring unit disassembles the low-light image frame by frame, records each frame as a picture, and overlaps two adjacent frames, and compares the overlapped pixels. If the grayscale, color and saturation of the pixels at the same position are the same, they are recorded as static pixels. If any one of the grayscale, color and saturation of the pixels at the same position is different, they are recorded as changing pixels.

[0042] S2: The camera monitoring unit counts all the changed pixels and calculates the proportion of the changed pixels in all the pixels. If the proportion of the changed pixels is less than the preset proportion, a no-change signal is generated and the change analysis ends. If the proportion of the changed pixels is greater than or equal to the preset proportion, step S3 is performed.

[0043] S3: The camera monitoring unit performs a discrete analysis on the distribution position of the changed pixel points in the picture to obtain a discrete characteristic value of the changed pixel points, and compares the discrete characteristic value with a preset characteristic threshold. If the discrete characteristic value is greater than the preset threshold, a picture discrete signal is generated; if the discrete characteristic value is less than the preset threshold, an image warning signal is generated;

[0044] The camera monitoring unit sends the picture brightness and image warning signal to the regional picture monitoring unit.

[0045] The infrared monitoring unit collects images of the monitoring area through an infrared camera and records them as infrared images. The infrared monitoring unit analyzes the image changes of the infrared images. The process is as follows:

[0046] A1: The infrared monitoring unit obtains the infrared image, and takes each frame of the infrared image as a picture to obtain the temperature of the pixel points in the picture;

[0047] A2: Continuously monitor the temperature of the pixel at the same position. If the temperature change of the pixel at the same position in two consecutive frames exceeds the preset threshold, it is recorded as a changing pixel. If the temperature change of the pixel at the same position in two consecutive frames does not exceed the preset threshold, it is recorded as a static pixel.

[0048] A3: The infrared monitoring unit counts the proportion of changed pixels in all pixels. When the proportion of changed pixels is greater than a preset proportion, step A4 is performed. When the proportion of changed pixels is less than or equal to the preset proportion, a still image signal is generated and the change analysis ends.

[0049] A4: The infrared monitoring unit performs discrete analysis on the distribution position of the changed pixel points in the picture to obtain a discrete characteristic value. If the discrete characteristic value is greater than a preset threshold, a picture discrete signal is generated. If the discrete characteristic value is less than the preset threshold, an infrared warning signal is generated.

[0050] The infrared monitoring unit sends an infrared warning signal to the regional picture monitoring unit.

[0051] The process of discrete analysis by the video monitoring unit and the infrared monitoring unit is as follows:

[0052] A group of changing pixels are selected as the starting point, and the shortest path passing through all the changing pixels is found through the path calculation algorithm. The proportion of static pixels passed in the shortest path to the total number of pixels is calculated and recorded as discrete eigenvalues.

[0053] Embodiment 2:

[0054] See also Figure 1 - Figure 2 As shown, after the regional picture monitoring unit simultaneously obtains the infrared warning signal and the image warning signal, the picture when the infrared warning signal is generated is obtained through the infrared monitoring unit and recorded as the infrared warning picture, and the picture when the image warning signal is generated is obtained through the camera monitoring unit and recorded as the image warning picture, and the infrared warning picture and the image warning picture are compared. If the position overlap of the changed pixel points in the infrared warning picture and the image warning picture is greater than or equal to the preset overlap value, a picture change alarm is generated; if the position overlap of the changed pixel points in the infrared warning picture and the image warning picture is less than the preset overlap value, a picture suspected alarm signal is generated;

[0055] After acquiring only the infrared warning signal, the regional image monitoring unit generates an image suspected alarm signal;

[0056] The regional image monitoring unit does not respond when it only obtains the image warning signal;

[0057] After generating the screen change alarm, the regional screen monitoring unit sends the screen change alarm to the screen alarm unit. The screen alarm unit uploads the screen change alarm through the network, sends out an audible and visual alarm through the display device, and saves the infrared warning screen and the image warning screen at the same time.

[0058] Embodiment three:

[0059] See also Figure 1 - Figure 2 As shown, the regional picture monitoring unit sends the picture change alarm and picture brightness to the twilight control unit, which performs a threshold analysis on the picture brightness. If the picture brightness reaches the set threshold, it does not respond. If the picture brightness does not reach the set threshold, it generates a fill light signal to control the fill light source to work and linearly increase the brightness of the fill light source until the acquired picture brightness reaches the set threshold. After the picture change alarm disappears, the fill light source is controlled to be turned off with a delay.

[0060] The regional picture monitoring unit sends the picture suspected alarm signal and picture brightness to the low-light control unit, which performs a threshold analysis on the picture brightness. If the picture brightness reaches the set threshold, the picture suspected alarm signal is canceled. If the picture brightness does not reach the set threshold, a fill light signal is generated. After linearly increasing the brightness of the fill light source so that the picture brightness reaches the set threshold, if a picture change alarm is generated and sent to the picture alarm generation unit, the low-light control unit controls the fill light source to continue working until the picture change alarm disappears and then delays shutting down. If a picture suspected alarm signal is still generated, the picture suspected alarm signal is canceled.

[0061] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. A picture safety monitoring and early warning system for night vision observation equipment, characterized in that: It includes a camera monitoring unit, which is used to collect images, obtain low-light images and image brightness, and perform change analysis on the low-light images to generate image warning signals; An infrared monitoring unit, which collects images through an infrared camera, obtains infrared images, performs change analysis on the infrared images, and generates infrared warning signals; A regional image monitoring unit, wherein the regional image monitoring unit obtains an infrared warning image and an image warning image, and compares and analyzes the infrared warning image and the image warning image to generate an image change alarm or a suspected image alarm signal; A low light control unit, which obtains a picture change alarm or a picture suspected alarm signal through the regional picture monitoring unit and controls the fill light source; The picture alarm generating unit obtains the picture change alarm through the regional picture monitoring unit, uploads the picture change alarm and stores the picture.

2. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The camera monitoring unit collects camera data through a camera callback function, converts the collected camera data into RGB format, and performs algorithm extraction on the RGB format to obtain brightness parameters, which are recorded as picture brightness.

3. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The process of analyzing the change of the low-light image by the camera monitoring unit is as follows: S1: The camera monitoring unit overlaps two adjacent frames and compares the overlapped pixels. If the color and saturation of the pixels at the same position are the same, they are recorded as static pixels. If the color and saturation of the pixels at the same position are different, they are recorded as changing pixels. S2: The camera monitoring unit counts all the changed pixels and calculates the proportion of the changed pixels in all the pixels. If the proportion of the changed pixels is less than the preset proportion, a no-change signal is generated and the change analysis ends. If the proportion of the changed pixels is greater than or equal to the preset proportion, step S3 is performed. S3: The camera monitoring unit performs discrete analysis on the distribution position of the changed pixel points in the picture to obtain discrete feature values ​​of the changed pixel points, and compares the discrete feature values ​​with a preset feature threshold. If the discrete feature value is less than the preset threshold, an image warning signal is generated.

4. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The process of the infrared monitoring unit performing picture change analysis on the infrared picture is as follows: A1: The infrared monitoring unit takes each frame of the infrared image as a picture and obtains the temperature of the pixel points in the picture; A2: Continuously monitor the temperature of the pixel at the same position. If the temperature change of the pixel at the same position in two consecutive frames exceeds the preset threshold, it is recorded as a changing pixel. If the temperature change of the pixel at the same position in two consecutive frames does not exceed the preset threshold, it is recorded as a static pixel. A3: The infrared monitoring unit counts the proportion of changed pixels in all pixels. When the proportion of changed pixels is greater than a preset proportion, step A4 is performed. When the proportion of changed pixels is less than or equal to the preset proportion, a still image signal is generated and the change analysis ends. A4: The infrared monitoring unit performs discrete analysis on the distribution position of the changed pixel points in the picture to obtain a discrete characteristic value. If the discrete characteristic value is less than a preset threshold, an infrared warning signal is generated.

5. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The camera monitoring unit sends the picture brightness and the image warning signal to the regional picture monitoring unit, and the infrared monitoring unit sends the infrared warning signal to the regional picture monitoring unit.

6. The image safety monitoring and early warning system for night vision observation equipment according to claim 4, characterized in that: The process of discrete analysis performed by the infrared monitoring unit and the camera monitoring unit is as follows: A set of changing pixel points is selected as the starting point, and the shortest path passing through all the changing pixel points is found through the path calculation algorithm. The proportion of static pixel points passed in the shortest path to the number of all pixel points is calculated and recorded as discrete eigenvalues.

7. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The regional image monitoring unit records the image when the infrared monitoring unit generates an infrared warning signal as an infrared warning image, and records the image when the camera monitoring unit generates an image warning signal as an image warning image. If the position overlap of the changed pixel points in the infrared warning image and the image warning image is greater than or equal to a preset overlap value, a picture change alarm is generated; if the position overlap of the changed pixel points in the infrared warning image and the image warning image is less than a preset overlap value, a suspected picture alarm signal is generated; The regional image monitoring unit generates an image suspected alarm signal after acquiring only the infrared warning signal; The regional image monitoring unit does not respond when only the image warning signal is obtained.

8. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: After the low light control unit obtains the picture change alarm, it performs a threshold analysis on the picture brightness. If the picture brightness reaches the set threshold, it does not respond. If the picture brightness does not reach the set threshold, it generates a fill light signal to control the brightness of the fill light source to increase linearly until the obtained picture brightness reaches the set threshold.

9. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: After the low-light control unit obtains the suspected alarm signal of the screen, it performs a threshold analysis on the screen brightness. If the screen brightness reaches the set threshold, the suspected alarm signal of the screen is cancelled. If the screen brightness does not reach the set threshold, the brightness of the fill light source is linearly increased so that the screen brightness reaches the set threshold. If a screen change alarm is generated, it is sent to the screen alarm generation unit. If a suspected alarm signal of the screen is still generated, the suspected alarm signal of the screen is cancelled.

Citation Information

Patent Citations

  • Laser night vision shooting and monitoring system

    CN101959058A

  • Human body target feature detection algorithm for power substations by using infrared thermal imaging and visible light imaging technology fusion

    CN107133592A

  • Snapshot method and device, electronic equipment and storage medium

    CN110213501A

  • Flame detection analysis early warning system

    CN111275918A

  • Light supplement lamp control method, monitoring equipment, electronic device and storage medium

    CN112399075A