A method and system for realizing high-resolution black light night vision based on dual cameras

Abstract

The present application belongs to the field of black-light night vision technology, and in particular, relates to a method and system for realizing high-resolution black-light night vision based on dual cameras. The method comprises: acquiring RGB information and brightness information of a first image through a first image acquisition module, and acquiring brightness information of a second image through a second image acquisition module; superimposing the brightness information of the second image on the first image to generate a night color image. The method for realizing high-resolution black-light night vision based on dual cameras of the present application acquires the key dimensions of the image through dual cameras, superimposes the brightness through conversion logic and correction rules, and combines the RGB color information to generate a night color image that meets the brightness and clarity requirements, thereby achieving a better color black-light night vision effect at a lower cost.

Description

Background Art

[0002] Night vision has always been a pain point for security monitoring users and an area they want to improve. In recent years, with the continuous development and advancement of technology, black light night vision technology has gradually been applied to electronic devices, providing users with a better night shooting experience, especially in extremely low light environments. It can effectively improve the visibility and clarity of images and meet the monitoring and shooting needs in special occasions.

[0003] At present, blacklight cameras are generally used for shooting to achieve blacklight night vision effects. However, low-resolution blacklight cameras have poor blacklight night vision effects. The unit price of blacklight sensors, lenses and other hardware of high-resolution blacklight cameras is very high. Taking an 8MP blacklight camera as an example, the cost of blacklight sensors and lenses is about 12-13USD. Due to the high cost, there are few monitoring devices on the market that can truly achieve this effect, especially home monitoring. Generally, it is not considered.

[0004] Therefore, it is desired to have a technical solution to overcome or at least alleviate at least one of the above-mentioned defects of the prior art. Summary of the invention

[0005] The purpose of this application is to provide a method and system for achieving high-resolution black-light night vision based on dual cameras, so as to solve the problem of high cost in the prior art for achieving black-light night vision effects.

[0006] The technical solution of this application is:

[0007] The first aspect of the present application provides a method for achieving high-resolution black light night vision based on dual cameras, comprising:

[0008] The RGB information and brightness information of the first image are collected by the first image collection module, and the brightness information of the second image is collected by the second image collection module;

[0009] The brightness information of the second image is superimposed on the first image to generate a nighttime color image.

[0010] Preferably, the first image acquisition module adopts an 8MP ordinary sensor and an 8MP ordinary lens.

[0011] Preferably, the second image acquisition module adopts a 2MP black light sensor and a 2MP black light lens.

[0012] Preferably, superimposing the brightness information of the second image onto the first image to generate a nighttime color image comprises:

[0013] Determine pixel points in an overlapping area and pixel points in a non-overlapping area of ​​the first image and the second image;

[0014] Superimposing the brightness information of the second image of the pixel points in the overlapping area onto the first image to obtain first brightness information of the first image;

[0015] Superimposing the first brightness information of the first image onto the first image of the pixels in the non-overlapping area to obtain the second brightness information of the first image;

[0016] A nighttime color image is generated according to the RGB information, the first brightness information, and the second brightness information of the first image.

[0017] Preferably, determining pixel points in an overlapping area and pixel points in a non-overlapping area of ​​the first image and the second image includes:

[0018] Perform pixel matching on the first image and the second image;

[0019] According to A(x, y) = B(p, q), all pixel points in the overlapping area of ​​the first image and the second image are found in turn, where A(x, y) is the coordinate of the pixel point of the first image, and B(p, q) is the coordinate of the pixel point of the second image.

[0020] Preferably, superimposing the brightness information of the second image of the pixel points in the overlapping area onto the first image to obtain the first brightness information of the first image includes:

[0021] ;

[0022] Among them, a1 A(x，y) is the original brightness value of the pixel point A(x, y) in the overlapping area of ​​the first image, b1 B(p，q) is the brightness value of the pixel point coordinate B(p, q) in the overlapping area of ​​the second image, c1 A(x，y) is the updated brightness value at the pixel coordinate A (x, y) in the overlapping area of ​​the first image, and n is the pixel ratio of the first image acquisition module to the second image acquisition module.

[0023] Preferably, superimposing the first brightness information of the first image onto the first image of the pixels in the non-overlapping area to obtain the second brightness information of the first image includes:

[0024] ;

[0025] Among them, a2 A(x，y) is the original brightness value of the pixel point coordinate A(x, y) in the non-overlapping area of ​​the first image, is the updated average brightness of all pixels in the overlapping area of ​​the first image, is the brightness superposition coefficient, c2 A(x，y)is the updated brightness value of the pixel point at coordinate A(x, y) in the non-overlapping area of ​​the first image.

[0026] A second aspect of the present application provides a system for realizing high-resolution black light night vision based on dual cameras, and a method for realizing high-resolution black light night vision based on dual cameras as described above, comprising:

[0027] Image information acquisition module, including:

[0028] A first image acquisition module, used for acquiring RGB information and brightness information of a first image;

[0029] A second image acquisition module, used for acquiring brightness information of a second image;

[0030] The image information superposition module is used to superimpose the brightness information of the second image on the first image to generate a night color image.

[0031] A third aspect of the present application provides a computer-readable medium storing computer-executable instructions for executing the method for achieving high-resolution black-light night vision based on dual cameras as described above.

[0032] A fourth aspect of the present application provides a computing device, comprising:

[0033] at least one processor; and

[0034] a memory communicatively connected to the at least one processor; wherein,

[0035] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for achieving high-resolution black light night vision based on dual cameras as described above.

[0036] The invention has at least the following beneficial technical effects:

[0037] The method of realizing high-resolution black-light night vision based on dual cameras in the present application collects the key dimensions of the image through the dual cameras, superimposes the brightness through conversion logic and correction rules, and combines its own RGB color information to generate a night color image that meets the brightness and clarity requirements, thereby achieving better color black-light night vision effects at a lower cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 This is a flow chart of a method for achieving high-resolution black light night vision based on dual cameras according to an embodiment of the present application;

[0039] Figure 2is a schematic diagram of a brightness superposition algorithm according to an embodiment of the present application;

[0040] Figure 3 This is a schematic diagram of a system for achieving high-resolution black light night vision based on dual cameras according to an embodiment of the present application;

[0041] Figure 4 This is a schematic diagram of the hardware structure of a computing device for implementing a method for achieving high-resolution black-light night vision based on dual cameras according to an embodiment of the present application. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical scheme and advantages of the implementation of this application clearer, the technical scheme in the embodiment of this application will be described in more detail below in conjunction with the drawings in the embodiment of this application. In the drawings, the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The described embodiments are part of the embodiments of this application, not all of them. The embodiments described below with reference to the drawings are exemplary and are intended to be used to explain this application, and should not be construed as limitations on this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application. The embodiments of this application are described in detail below in conjunction with the drawings.

[0043] The following is combined with Figures 1 to 4 This application is described in further detail.

[0044] The first aspect of the present application provides a method for achieving high-resolution black light night vision based on dual cameras, comprising the following steps:

[0045] The RGB information and brightness information of the first image are collected by the first image collection module, and the brightness information of the second image is collected by the second image collection module;

[0046] The brightness information of the second image is superimposed on the first image to generate a night color image.

[0047] The method of realizing high-resolution black-light night vision based on dual cameras of the present application realizes image information acquisition through dual cameras, wherein the first image acquisition module adopts an 8MP ordinary sensor and an 8MP ordinary lens. The first image acquisition module serves as a main camera and is mainly responsible for acquiring RGB information of the image at night. The second image acquisition module adopts a 2MP black-light sensor and a 2MP black-light lens. The second image acquisition module serves as a secondary camera and is mainly responsible for acquiring brightness information of the image at night.

[0048] The method of realizing high-resolution black light night vision based on dual cameras in the present application superimposes the brightness information of the second image on the first image to generate a night color image, specifically including:

[0049] Determine pixel points in an overlapping area and pixel points in a non-overlapping area of ​​the first image and the second image;

[0050] Superimposing the brightness information of the second image of the pixels in the overlapping area onto the first image to obtain first brightness information of the first image;

[0051] Superimposing the first brightness information of the first image onto the first image of the pixels in the non-overlapping area to obtain the second brightness information of the first image;

[0052] A nighttime color image is generated according to the RGB information of the first image, the first brightness information, and the second brightness information.

[0053] The method of realizing high-resolution black-light night vision based on dual cameras of the present application will produce differences in structural perspectives due to the product adopting a dual-camera architecture. According to the stacking and arrangement method of the dual-camera structure, there are horizontal or vertical differences in the image target surface between the first image and the second image collected. Therefore, it is necessary to perform pixel matching on the first image collected by the main camera and the second image collected by the auxiliary camera. According to A(x, y) = B(p, q), all pixel points of the overlapping areas of the first image and the second image are found in turn, where A(x, y) is the pixel coordinate of the first image, and B(p, q) is the pixel coordinate of the second image.

[0054] In a preferred embodiment of the present application, Figure 2 As shown, the superposition calculation method for the brightness information of the pixels in the overlapping area is to superimpose the brightness information of the second image of the pixels in the overlapping area on the first image to obtain the first brightness information of the first image:

[0055] ;

[0056] Among them, a1 A(x，y) is the original brightness value of the pixel point A(x, y) in the overlapping area of ​​the first image, b1 B(p，q) is the brightness value of the pixel point coordinate B(p, q) in the overlapping area of ​​the second image, c1 A(x，y) is the updated brightness value at the pixel coordinate A (x, y) in the overlapping area of ​​the first image, and n is the pixel ratio of the first image acquisition module to the second image acquisition module.

[0057] Because the main camera is 8MP and the secondary camera is 2MP, there is a four-fold difference in pixels, so n is equal to 4. The brightness information of one pixel of the second image is evenly distributed to the four pixels of the corresponding first image to obtain the first brightness information of the pixels in the overlapping area of ​​the first image.

[0058] In this embodiment, the superposition calculation method for the brightness information of the pixels in the non-overlapping area is to superimpose the first brightness information of the first image on the first image of the pixels in the non-overlapping area to obtain the second brightness information of the first image:

[0059] ;

[0060] Among them, a2 A(x，y) is the original brightness value of the pixel point coordinate A(x, y) in the non-overlapping area of ​​the first image, is the updated average brightness of all pixels in the overlapping area of ​​the first image, is the brightness superposition coefficient, c2 A(x，y) is the updated brightness value of the pixel point at coordinate A(x, y) in the non-overlapping area of ​​the first image.

[0061] The method of realizing high-resolution black-light night vision based on dual cameras of the present application superimposes the brightness of the pixels in the overlapping area of ​​the first image with the brightness of the pixels in the overlapping area of ​​the second image to obtain the first brightness information of the first image, superimposes the brightness of the pixels in the non-overlapping area of ​​the first image with the average brightness of the pixels in the overlapping area of ​​the first image, and then increases the brightness by a uniform multiple to obtain the second brightness information of the pixels in the non-overlapping area of ​​the first image, and finally obtains the first image after superimposing the brightness information, the first image having its own RGB information, and having the first brightness information and the second brightness information, and uniformly outputs a brighter night color image.

[0062] The method of realizing high-resolution black-light night vision based on dual cameras of the present application collects the key dimensions of the image through the dual cameras, namely, collects RGB color information and brightness information through the main camera with an 8MP ordinary sensor and an 8MP ordinary lens, and collects brightness information through the secondary camera with a 2MP black-light sensor and a 2MP black-light lens. The brightness information is superimposed and combined with its own RGB color information through conversion logic and correction rules to generate a night color image that meets the brightness and clarity requirements.

[0063] The method of realizing high-resolution black-light night vision based on dual cameras in the present application has an 8MP ordinary sensor and an 8MP ordinary lens of the main camera, which cost about 6USD, and a 2MP black-light sensor and a 2MP black-light lens of the secondary camera, which cost no more than 3USD, which is 3-4USD lower than the cost of using an 8MP black-light camera, thereby achieving better color black-light night vision effect at a lower cost.

[0064] The second aspect of the present application provides a system for achieving high-resolution black light night vision based on dual cameras, such as Figure 3 As shown, including:

[0065] The image information acquisition module 10 includes:

[0066] A first image acquisition module, used for acquiring RGB information and brightness information of a first image;

[0067] A second image acquisition module, used for acquiring brightness information of a second image;

[0068] The image information superposition module 20 is used to superimpose the brightness information of the second image on the first image to generate a nighttime color image.

[0069] The third aspect of the present application provides a computer-readable medium storing computer-executable instructions for executing the above-mentioned method for achieving high-resolution black-light night vision based on dual cameras.

[0070] For the convenience of description, the above parts are divided into modules (or units) according to their functions and described separately. Of course, when implementing the present invention, the functions of each module (or unit) can be implemented in the same or multiple software or hardware.

[0071] After introducing the method, system and readable medium for implementing high-resolution black light night vision based on dual cameras according to an exemplary embodiment of the present invention, next, a computing device according to another exemplary embodiment of the present invention is introduced.

[0072] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0073] In some possible implementations, the computing device according to the present invention may include at least one processing unit and at least one storage unit. The storage unit stores program codes, and when the program codes are executed by the processing unit, the processing unit executes the steps of the method for realizing high-resolution black light night vision based on dual cameras according to various exemplary implementations of the present invention described above in this specification.

[0074] Refer to the following Figure 4 The computing device 30 according to this embodiment of the present invention is described below. Figure 4 The computing device 30 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0075] like Figure 4 As shown, the computing device 30 is in the form of a general computing device. The components of the computing device 30 may include but are not limited to: at least one processing unit 31, at least one storage unit 32, and a bus 33 connecting different system components (including the storage unit 32 and the processing unit 31).

[0076] Bus 33 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor or local bus using any of a variety of bus architectures.

[0077] The storage unit 32 may include a readable medium in the form of a volatile memory, such as a random access memory (RAM) 321 and / or a cache memory 322 , and may further include a read-only memory (ROM) 323 .

[0078] The storage unit 32 may also include a program / utility 325 having a set (at least one) of program modules 324, such program modules 324 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0079] The computing device 30 may also communicate with one or more external devices 34 (e.g., keyboards, pointing devices, etc.), one or more devices that enable a user to interact with the computing device 30, and / or any device that enables the computing device 30 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 35. In addition, the computing device 30 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 36. As shown, the network adapter 36 communicates with other modules for the computing device 30 via a bus 33. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the computing device 30, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0080] In some possible implementations, various aspects of the method for achieving high-resolution black-light night vision based on dual cameras provided by the present invention can also be implemented in the form of a program product, which includes program code. When the program product is run on a computer device, the program code is used to enable the computer device to execute the steps of the method for achieving high-resolution black-light night vision based on dual cameras according to various exemplary embodiments of the present invention described above in this specification.

[0081] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0082] The program product of the method for realizing high-resolution black light night vision based on dual cameras of the embodiment of the present invention can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a computing device. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0083] A readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, wherein readable program code is carried. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium other than a readable storage medium, which may transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0084] The program code contained on the readable medium can be transmitted with any appropriate medium, including, but not limited to, wireless, wired, optical cable, RF, etc., or any suitable combination of the above. The program code for performing the operation of the present invention can be written in any combination of one or more programming languages, including object-oriented programming languages, such as Java, C++, etc., and also including conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed completely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device, partially on the remote computing device, or completely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0085] It should be noted that, although several units or subunits of the device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more units described above can be embodied in one unit. Conversely, the features and functions of one unit described above can be further divided into multiple units to be embodied.

[0086] In addition, although the operations of the method of the present invention are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0087] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0088] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0089] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0090] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0091] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for achieving high-resolution black light night vision based on dual cameras, characterized in that: include: The RGB information and brightness information of the first image are collected by the first image collection module, and the brightness information of the second image is collected by the second image collection module; superimposing the brightness information of the second image onto the first image to generate a nighttime color image; The first image acquisition module uses an 8MP ordinary sensor and an 8MP ordinary lens; The second image acquisition module uses a 2MP black light sensor and a 2MP black light lens; The method of superimposing the brightness information of the second image onto the first image to generate a nighttime color image comprises: Determine pixel points in an overlapping area and pixel points in a non-overlapping area of ​​the first image and the second image; Superimposing the brightness information of the second image of the pixel points in the overlapping area onto the first image to obtain first brightness information of the first image; superimposing the first brightness information of the first image onto the first image of the pixels in the non-overlapping area to obtain the second brightness information of the first image; Generate a nighttime color image according to the RGB information, the first brightness information, and the second brightness information of the first image; The method of superimposing the brightness information of the second image of the pixels in the overlapping area onto the first image to obtain the first brightness information of the first image includes: a1 A(x，y) +b1 B(p，q) / n=c1 A(x，y) Among them, a1 A(x，y) is the original brightness value of the pixel point A(x, y) in the overlapping area of ​​the first image, b1 B(p，q) is the brightness value of the pixel point coordinate B(p, q) in the overlapping area of ​​the second image, c1 A(x，y) is the updated brightness value at the pixel coordinate A (x, y) in the overlapping area of ​​the first image, and n is the pixel ratio of the first image acquisition module to the second image acquisition module; Superimposing the first brightness information of the first image onto the first image of the pixels in the non-overlapping area to obtain the second brightness information of the first image includes: ； Among them, a2 A(x，y) is the original brightness value of the pixel point coordinate A(x, y) in the non-overlapping area of ​​the first image, is the updated average brightness of all pixels in the overlapping area of ​​the first image, is the brightness superposition coefficient, c2 A(x，y) is the updated brightness value of the pixel point at coordinate A(x, y) in the non-overlapping area of ​​the first image.

2. The method for achieving high-resolution black light night vision based on dual cameras according to claim 1, characterized in that: Determining pixel points in an overlapping area and pixel points in a non-overlapping area of ​​the first image and the second image includes: Perform pixel matching on the first image and the second image; According to A(x, y) = B(p, q), all pixel points in the overlapping area of ​​the first image and the second image are found in turn, where A(x, y) is the coordinate of the pixel point of the first image, and B(p, q) is the coordinate of the pixel point of the second image.

3. A system for achieving high-resolution black light night vision based on dual cameras, used to implement the method for achieving high-resolution black light night vision based on dual cameras as described in any one of claims 1 to 2, characterized in that: include: Image information acquisition module, including: A first image acquisition module, used for acquiring RGB information and brightness information of a first image; A second image acquisition module, used for acquiring brightness information of a second image; The image information superposition module is used to superimpose the brightness information of the second image on the first image to generate a night color image.

4. A computer-readable medium storing computer-executable instructions, characterized in that: The computer executable instructions are used to execute the method for achieving high-resolution black light night vision based on dual cameras as described in any one of claims 1 to 2.

5. A computing device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for achieving high-resolution black light night vision based on dual cameras as described in any one of claims 1 to 2.

Images