An auto-exposure adjustment non-homologous binocular camera and payment device

Abstract

The application discloses a non-homologous binocular camera for automatically adjusting exposure, which comprises a first camera for shooting a first image of a target object, a second camera for shooting a second image of the target object, wherein the first camera and the second camera are non-homologous cameras, and the first camera and the second camera shoot at the same time; and a processor for respectively correcting and aligning the first image and the second image, respectively detecting target objects on the first image and the second image by using a target detection model, and adjusting exposure according to a target object area with poor image quality. ir The application detects target objects on the first image I rgb and the second image I rgb respectively, and performs evaluation, adjusts camera exposure according to image quality, combines the characteristics of non-homologous binocular images, utilizes target object features, is suitable for different target objects, reduces image processing amount, and greatly improves the accuracy of automatic exposure.

Description

Technical Field

[0001] This invention relates to the field of depth cameras, and more specifically, to a non-isomorphic binocular camera with automatic exposure adjustment and a payment device. Background Technology

[0002] Binocular vision is one of the mainstream technologies for obtaining depth data. Utilizing the principle of parallax, it calculates depth information from two images, combining the intrinsic and extrinsic parameters of the depth camera. The depth data obtained through binocular vision can be used for 3D reconstruction, making depth cameras valuable in fields such as biometrics.

[0003] In existing technologies, binocular imaging is typically used to obtain better target object information and perform matching. Non-binocular imaging, on the other hand, produces two different images, resulting in differences in clarity, feature extraction, and other aspects. When automatically adjusting the exposure of non-binocular cameras, a generic automatic exposure adjustment strategy is used without considering the specific characteristics of the non-binocular imaging and the target object, leading to unclear target objects or inefficient automatic exposure. Summary of the Invention

[0004] Therefore, the present invention addresses the first image I. ir Second image I rgb The system detects and evaluates target objects separately, adjusts camera exposure based on image quality, and combines the characteristics of non-homogeneous binocular images. It utilizes target object features, is applicable to different target objects, reduces image processing load, and greatly improves the accuracy of automatic exposure.

[0005] In a first aspect, the present invention provides a non-isomorphic binocular camera with automatic exposure adjustment, characterized in that it comprises:

[0006] The first camera is used to capture the first image of the target object;

[0007] The second camera is used to capture a second image of the target object; wherein the first camera and the second camera are not from the same source, and the first camera and the second camera capture images simultaneously;

[0008] The processor is configured to perform correction and alignment on the first image and the second image respectively, and to perform target detection on the first image and the second image respectively using a target detection model, and to adjust the exposure based on the target object area with poor image quality.

[0009] Optionally, the aforementioned non-isomorphic binocular camera with automatic exposure adjustment is characterized in that the processor comprises:

[0010] The correction module is used to perform distortion correction on the original first image and the original second image respectively, and then perform epipolar correction to obtain the corrected first image I. ir and the corrected second image I rgb ;

[0011] The detection module is used to detect the first image I. ir and the second image I rgb Detect the target object separately; if in the first image I ir and the second image I rgb If the target object is detected in both images, then the first image I is obtained respectively. ir Target Object Region ROI ir and the second image I rgb Target Object Region ROI rgb Execute the third processing module; if only in the first image I ir and the second image I rgb If a target object is detected in one of the images, the first processing module is executed; if no target object is detected, the second processing module is executed; wherein, the first image I ir and the second image I rgb These are non-homologous images;

[0012] The first processing module is used to determine the target object region ROI1 on the image where the target object has been detected, and to determine the target object region ROI1 based on the first image I. ir and the second image I rgb Based on the correspondence, the target object region ROI2 on the image where no target object was detected is determined, and then the exposure is adjusted according to the target object region ROI2 on the image where no target object was detected.

[0013] The second processing module is used to process the first image I. ir and the second image I rgb The brightness is evaluated; if the brightness is abnormal, the exposure gain needs to be reset; if the brightness is normal, no action is taken.

[0014] The third processing module is used to calculate the ROI of the target object region. ir and the target object region ROI rgb Image quality;

[0015] The exposure adjustment module is used to adjust the camera's exposure.

[0016] Optionally, the aforementioned non-isomorphic binocular camera with automatic exposure adjustment is characterized in that the third processing module includes:

[0017] A brightness calculation unit is used to calculate the ROI of the target object region. ir and the target object region ROI rgb Average brightness;

[0018] A sharpness calculation unit is used to calculate the ROI of the target object region. ir and the target object region ROI rgb Image clarity;

[0019] The output unit is configured to output an image if both the average brightness and the image sharpness are within a reasonable range; otherwise, it executes the exposure adjustment module.

[0020] Optionally, the non-isomorphic binocular camera with automatic exposure adjustment is characterized in that the second processing module processes the first image I ir and the second image I rgb When evaluating brightness, only a preset range including the image center is evaluated.

[0021] Optionally, the non-same-source binocular camera with automatic exposure adjustment is characterized in that, in the detection module, if a target object is detected, the area of ​​the target object is judged; if the area of ​​the target object is less than a threshold, it is judged that no target object has been detected.

[0022] Optionally, the non-homogeneous binocular camera with automatic exposure adjustment is characterized in that the second processing is applied to the first image I. ir and the second image I rgb When evaluating brightness, the first image I ir and the second image I rgb Subtract the two images and use the resulting new image for evaluation.

[0023] Optionally, the aforementioned non-isomorphic binocular camera with automatic exposure adjustment is characterized in that the exposure adjustment module includes:

[0024] The brightness adjustment unit is used to increase the exposure time, current value, or gain value if the average brightness of the target area is too low, and to decrease the exposure time, current value, or gain value if the average brightness of the target area is too high.

[0025] The sharpness adjustment unit is used to increase the exposure time, increase the current value, or decrease the gain value if the sharpness of the target object is too low.

[0026] Optionally, the aforementioned non-isomorphic binocular camera with automatic exposure adjustment is characterized in that, in the brightness adjustment unit:

[0027] If the target object region ROI irand the target object region ROI rgb If the average brightness is too low, the order of adjustment is exposure time, gain value, and current value.

[0028] If the target object region ROI ir and the target object region ROI rgb If the average brightness is too high, the order of adjustment is current value, gain value, and exposure time.

[0029] Optionally, the aforementioned non-homogeneous binocular camera with automatic exposure adjustment is characterized in that, before any module processes the image, the first image I is... ir and the second image I rgb Compress or trim.

[0030] In a second aspect, the present invention provides a payment device, characterized in that it includes a non-isomorphic binocular camera with automatic exposure adjustment as described in any of the preceding claims.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] This invention employs non-homogeneous binocular technology, which, compared to homogeneous binoculars, can acquire more types of data information, obtaining more data in a single acquisition, thus improving data acquisition efficiency and reducing the number of acquisitions. Furthermore, cross-verification of multiple data sources can enhance the accuracy of biometric identification.

[0033] This invention performs separate detections on the first and second images and classifies the different detection results, thus adapting to more situations and improving its adaptability to different target objects. Furthermore, it allows for targeted processing schemes for different target objects, enhancing the processing effect.

[0034] This invention identifies target areas with high efficiency, enabling rapid autofocus and automatic exposure, meeting the fast response requirements of practical applications. Furthermore, the rapid automatic exposure makes it easier to achieve accurate focus and exposure, improving image quality and satisfying the demands of commercial applications.

[0035] This invention evaluates both the first and second images, resulting in accurate focusing, clearer final images, guaranteed image quality, better acquisition of image information, and accurate processing results. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort. Other features, objects, and advantages of the present invention will become more apparent by reading the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0037] Figure 1 This is a schematic diagram of the structure of a non-isomorphic binocular camera with automatic exposure adjustment according to an embodiment of the present invention;

[0038] Figure 2 This is a schematic diagram of the structure of a processor according to an embodiment of the present invention;

[0039] Figure 3 This is a schematic diagram of the structure of a third processing module in an embodiment of the present invention;

[0040] Figure 4 This is a schematic diagram of the structure of an exposure adjustment module in an embodiment of the present invention;

[0041] Figure 5 This is a schematic diagram of the structure of a payment device according to an embodiment of the present invention. Detailed Implementation

[0042] The present invention will now be described in detail with reference to specific embodiments. These embodiments will help those skilled in the art to further understand the present invention, but do not limit the invention in any way. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention. These all fall within the scope of protection of the present invention.

[0043] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0044] The technical solution of the present invention will be described in detail below with reference to specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0045] The present invention provides a non-isomorphic binocular camera with automatic exposure adjustment, which aims to solve the problems existing in the prior art.

[0046] The technical solutions of the present invention and how they solve the above-mentioned technical problems will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will now be described with reference to the accompanying drawings.

[0047] Figure 1 This is a schematic diagram of the structure of a non-isomorphic binocular camera with automatic exposure adjustment according to an embodiment of the present invention. Figure 1 As shown, an embodiment of the present invention provides a non-isomorphic binocular camera with automatic exposure adjustment, comprising:

[0048] The first camera 100 is used to capture the first image of the target object;

[0049] The second camera 200 is used to capture a second image of the target object; wherein the first camera and the second camera are non-co-located cameras, and the first camera and the second camera capture images simultaneously;

[0050] The processor 300 is used to correct and align the first image and the second image respectively, and to perform target detection on the first image and the second image respectively using a target detection model, and to adjust the exposure based on the target object area with poor image quality.

[0051] Specifically, a non-similar binocular camera refers to a binocular system composed of two cameras using different technical principles. It can simultaneously acquire two types of images and obtain depth data using the parallax principle. For example, a binocular system composed of an RGB camera and an infrared camera is a non-similar binocular system. The two images acquired by a non-similar binocular camera are non-similar images. In this embodiment, the first camera and the second camera constitute a non-similar binocular system. The acquired first and second images are non-similar images, such as a color image and an infrared image.

[0052] The processor processes the first and second images simultaneously. First, it aligns and corrects the first and second images, then it uses a target detection model to perform detection on each. In this embodiment, the target detection model detects objects of the same type, such as faces, hands, and human poses. Because the first and second images are not from the same source, the detection results on the first and second images will result in three scenarios: both images detect the target object, only one image detects the target object, and neither image detects the target object. The images are then quality-assessed to identify target object regions with lower quality. Exposure is then adjusted based on these target object regions, enabling rapid exposure adjustment.

[0053] Figure 2 This is a schematic diagram of the structure of a processor according to an embodiment of the present invention. Figure 2 As shown in the embodiments of the present invention Figure 2 The schematic diagram of a processor in an embodiment of the present invention includes the following modules.

[0054] The correction module 310 is used to perform distortion correction on the original first image and the original second image respectively, and then perform epipolar correction to obtain the corrected first image I. ir and the corrected second image I rgb .

[0055] Specifically, the original first image and the original second image are non-originating images, meaning they were obtained using different techniques. Distortion correction is performed on the original first image, followed by epipolar correction, to obtain the corrected first image I. ir The original second image is distorted and then epipolarized to obtain the corrected second image I. rgbSince distortion is caused by the lens imaging principle, distortion correction for the original first and second images needs to be performed according to the parameters of each acquisition device. Epipolar correction is a correction for binocular systems. It involves rotating the two cameras and redefining a new image plane so that the epipolar pairs are collinear and parallel to a coordinate axis (usually the horizontal axis) of the image plane. This operation simultaneously establishes a new stereo image pair. After correction, the same matching point pair is located in the same row in both views, meaning they only differ in horizontal coordinates (or column coordinates), a difference called parallax. However, since the images used are the first and second images, the content they capture differs, making it impossible to directly solve for parallax using existing techniques. This module corrects both types of images to make the data more accurate, thereby making subsequent matching more accurate. It should be noted that the original first and second images used in this embodiment are usually acquired by a calibrated binocular system, where one camera is the first camera and the other is the second camera. The first camera is used to acquire the first image, and the second camera is used to acquire the second image, with both cameras simultaneously acquiring the target image. For example, the first camera is a near-infrared camera, and the first image is a near-infrared image; the second camera is a color camera, and the second image is a color image.

[0056] Detection module 320 is used to detect the first image I ir and the second image I rgb Detect the target objects separately.

[0057] Specifically, the same object detection model is used for detection in both the first and second images, meaning the detected target object is the same object, such as simultaneously recognizing a human body, face, or hand. If the target object is detected in both the first and second images, then the first image I is obtained. ir Target Object Region ROI ir and the second image I rgb Target Object Region ROI rgb The third processing module is executed; if a target object is detected in only one of the first image and the second image, the first processing module is executed; if no target object is detected, the second processing module is executed; wherein, the first image I ir and the second image I rgb These are non-homogeneous images.

[0058] In some embodiments, if a target object is detected, the area of ​​the target object is determined. If the area of ​​the target object is less than a threshold, it is determined that no target object has been detected.

[0059] The first processing module 330 is used to determine the target object region ROI1 on the image where the target object has been detected, and to determine the target object region ROI1 based on the first image I. ir and the second image I rgb Based on the correspondence, the target object region ROI2 on the image where no target object was detected is determined, and the exposure is adjusted according to the target object region ROI2 on the image where no target object was detected.

[0060] Specifically, since only one target object is detected in the first and second images, the exposure needs to be adjusted based on the other image. Let's take the detection of the target object in the first image as an example. The target object region in the first image is ROI1. Since the first and second images are aligned, the corresponding target object region ROI2 in the second image can be obtained from ROI1 in the first image. Due to abnormal brightness in the second image, the target object cannot be detected, but ROI2 in the second image can be used to evaluate the exposure effect, thereby adjusting the exposure. This module uses data from a clear image to determine the target object region in a blurry image, allowing for more precise exposure adjustments.

[0061] The second processing module 340 is used to process the first image I. ir and the second image I rgb The brightness is evaluated. If the brightness is abnormal, the exposure gain needs to be reset; if the brightness is normal, no action is taken.

[0062] Specifically, the brightness of the first and second images is evaluated to address situations where no image can be detected in either image. This module evaluates the overall brightness of the first and second images; if the brightness is too high, the gain is reduced; if the brightness is too low, the gain is increased. If the brightness is normal, it indicates that there is no target object or the target object is too far away to be effectively identified, in which case no action is taken, and the current state is maintained.

[0063] In some embodiments, the first image I ir and the second image I rgb When evaluating brightness, only a preset range, including the image center, is assessed. In specific application scenarios, such as facial recognition authentication, the target is usually located in the center of the image. Therefore, evaluating only the image center and its surrounding area can achieve very good results and save computational resources.

[0064] In some embodiments, the first image I ir and the second image I rgbWhen evaluating brightness, only a preset number of points are considered. Multiple points, typically no fewer than five, are preset in the central region of the image, and the image brightness is evaluated by averaging the brightness of these points. For example, if six points are preset, denoted as a1, a2, a3, a4, a5, and a6, then the average brightness value a0 of these six points is used to evaluate the image brightness. If a0 is greater than a preset range, the brightness is considered too high; if a0 is less than the preset range, the brightness is considered too low.

[0065] In some embodiments, the first image I ir and the second image I rgb When evaluating brightness, the first image I ir and the second image I rgb The two images are subtracted, and the resulting new image is used for evaluation. Since the first and second images are not from the same source and acquire different signals, in some applications, a new image can be obtained by subtracting the first and second images. This new image is more sensitive to certain information, improving accuracy. For example, when photographing a hand, the infrared image captures the veins, while the color image captures the combined effect of the palm lines and veins. Subtracting the two makes the palm lines clearer and easier to distinguish. Alternatively, the color image can be converted to grayscale before subtracting from the infrared image, resulting in stronger data comparison.

[0066] The third processing module 350 is used to calculate the ROI of the target object region. ir and the target object region ROI rgb Image quality.

[0067] Specifically, since both the first and second images contain target object data, but the target object may still have issues such as blurriness, leading to problems in subsequent depth processing, image quality evaluation is necessary. This module only evaluates the image quality of the target object region to reduce data processing volume, improve the targeting of subsequent modules, and obtain higher quality images. This module evaluates the image quality of the first image I... ir Target Object Region ROI ir Second image I rgb Target Object Region ROI rgb An assessment will be conducted.

[0068] The 360° exposure adjustment module is used to adjust the camera's exposure.

[0069] Specifically, according to the first image I ir Target Object Region ROI ir Image quality and the second image I rgb Target Object Region ROIrgb The camera exposure is adjusted to improve image quality. During adjustment, one or more of the exposure time, current value, or gain value are adjusted. If both the first and second images are overexposed, the exposure is reduced. If both the first and second images are underexposed, the exposure is increased. If the exposure states of the first and second images are inconsistent, the exposure is adjusted using the image with the abnormal state.

[0070] Before any module processes the image, the first image I is... ir and the second image I rgb Compress or trim the data to reduce the amount of data processed and improve efficiency.

[0071] This embodiment employs non-homogeneous binocular technology, which can improve performance in various biometric scenarios. For example, in facial recognition, eye information can be obtained simultaneously with face recognition for liveness detection; in palm recognition, palm vein features can be obtained simultaneously with palm print recognition for liveness detection. This embodiment utilizes the characteristics of non-homogeneous images to perform targeted processing on different types of images, adjusting exposure based on the image quality of the target area, ensuring that both the first and second images quickly reach optimal exposure, thereby obtaining clearer, higher-quality images.

[0072] Figure 3 This is a schematic diagram of the structure of a third processing module in an embodiment of the present invention. Figure 3 As shown, unlike the previous embodiments, the third processing module in this embodiment of the invention includes the following units.

[0073] Brightness calculation unit 351 is used to calculate the ROI of the target object region. ir and the target object region ROI rgb The average brightness.

[0074] Specifically, the average brightness of the target object region is calculated. When calculating the average brightness, the target object region (ROI) can be... ir and target object region ROI rgb All pixel values ​​can be obtained using a sampling method, focusing only on the target object region (ROI). ir and target object region ROI rgb Values ​​are taken from a subset of pixels. When calculating average brightness, the ROI (Region of Interest) of the target object is considered. ir and target object region ROI rgb Calculate the average brightness of each separately.

[0075] Sharpness calculation unit 352 is used to calculate the ROI of the target object region. ir and the target object region ROI rgbImage clarity.

[0076] Specifically, image sharpness is represented using the mean gradient. The mean gradient refers to the significant difference in gray levels near the boundaries or shadows of an image, i.e., a large rate of gray level change. The mean gradient reflects the rate of change in the contrast of minute details in the image, that is, the rate of density change in multiple dimensions of the image, characterizing the relative sharpness of the image. When calculating image sharpness, the sharpness is calculated separately for the first and second images to obtain their respective image sharpness.

[0077] The output unit 353 is used to output an image if both the average brightness and the image sharpness are within a reasonable range; otherwise, it executes the exposure adjustment module.

[0078] Specifically, the average brightness and image sharpness are judged. If the values ​​of the target object area in both the first and second images are within a reasonable range, the image is output; otherwise, it is judged as an exposure abnormality and needs to be adjusted, and the exposure adjustment module is executed.

[0079] This embodiment evaluates image quality from two dimensions: average brightness and image sharpness. This allows for a better assessment of whether the image is in optimal exposure. By adjusting the exposure, optimal exposure can be quickly achieved, resulting in a clear and usable image and ensuring image quality.

[0080] Figure 4 This is a schematic diagram of the structure of an exposure adjustment module according to an embodiment of the present invention. Figure 4 As shown, unlike the previous embodiments, an exposure adjustment module in this embodiment of the invention includes the following units.

[0081] The brightness adjustment unit 361 is used to increase the exposure time, current value, or gain value if the average brightness of the target area is too low, and to decrease the exposure time, current value, or gain value if the average brightness of the target area is too high.

[0082] Specifically, if the target object region ROI ir and the target object region ROI rgb If the average brightness is too low, the order of adjustment is exposure time, gain value, and current value. If the target object region (ROI) is... ir and the target object region ROI rgb If the average brightness is too high, the adjustment order is: current value, gain value, and exposure time. The adjustment order is different when the average brightness is too low compared to when it is too high, ensuring both sensitivity and equipment stability.

[0083] During adjustment, if adjusting the first-order parameters to their maximum or minimum still fails to achieve the expected average brightness of the target area, then the second-order parameters are adjusted. If adjusting the second-order parameters to their maximum or minimum still fails to achieve the expected average brightness of the target area, then the third-order parameters are adjusted. For example, if the average brightness is too low, the exposure time is increased first. If increasing the exposure time to its maximum still fails to achieve the expected average brightness of the target area, the gain value is increased. If increasing the gain value to its maximum still fails to achieve the expected average brightness of the target area, the current value is increased.

[0084] The sharpness adjustment unit 362 is used to increase the exposure time, increase the current value, or decrease the gain value if the sharpness of the target object is too low.

[0085] Specifically, the adjustment method is the same as that in the brightness adjustment unit 361, and will not be described again here.

[0086] This embodiment refines the adjustment method, considers the impact of different parameter adjustments, and adopts different sequences in different situations, making the parameter adjustment more effective and stable. While ensuring smooth adjustment, it is also easier to ensure image quality.

[0087] Figure 5 This is a schematic diagram of the structure of a payment device according to an embodiment of the present invention. Figure 5 As shown, in an embodiment of the present invention, a payment device includes a main body 700, a display area 710, a thermal printer 720, a non-isomorphic binocular camera 730 with automatic exposure adjustment, and a scanning area 740.

[0088] The main body 700 is used to fix the components of the device and integrate functions; it serves as a bracket for the payment device. The main body 700 can be configured in different sizes and shapes to suit different application scenarios and needs.

[0089] Display area 710 is used for user interaction. When a user makes a payment using facial recognition or palm recognition, it provides the camera's view so the user can adjust their position and posture for better recognition. Display area 710 can also assist with password input and verification. In standby mode, display area 710 typically displays advertisements, such as promotional videos for shopping malls or stores, featured products, or other advertisements retrieved from the internet.

[0090] The thermal printer 720 is used for printing receipts. In this embodiment, the thermal printer uses a fixed printhead with a heated dot matrix. The printhead has 320 square dots, each 0.25mm × 0.25mm. Using this dot matrix, the printer can place the print dots at any position on the thermal paper. The printing paper can be blank or pre-printed. When using blank paper, the thermal printer prints the entire receipt content one by one, suitable for scenarios requiring detailed printing. When using pre-printed paper, it is suitable for situations with a defined scenario; only the blank areas on the pre-printed paper need to be filled, improving the thermal printer's ticket printing efficiency.

[0091] The auto-adjusting exposure non-similar binocular camera 730 is any of the auto-adjusting exposure non-similar binocular cameras described in the foregoing embodiments. The auto-adjusting exposure non-similar binocular camera 730 includes a first camera 731 and a second camera 732. The auto-adjusting exposure non-similar binocular camera 730 also includes a processor, which can be housed within the auto-adjusting exposure non-similar binocular camera 730 or shared with the payment device. However, to improve data processing capabilities, preferably, the processor is housed separately within the auto-adjusting exposure non-similar binocular camera 730.

[0092] The scanning area 740 is used to scan QR codes. The scanning area 740 is typically used to scan product barcodes and obtain the product's price and quantity, which are then displayed in the display area 710 for user confirmation of the settlement amount. Once the settlement amount is confirmed, the user can either use the automatically adjustable exposure non-isomorphic binocular camera 730 for facial recognition or palm scanning payment, or use the scanning area 740 for QR code payment.

[0093] This embodiment provides a payment device that is user-friendly, offers multiple payment methods, and employs non-homogeneous binocular technology, naturally possessing liveness detection capabilities. It can obtain more information in a shorter time, processing and verifying biometric payments from multiple dimensions, thereby improving the security and convenience of payments.

[0094] The various embodiments described in this specification are presented in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0095] The specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art can make various modifications or variations within the scope of the claims, which do not affect the essence of the present invention.

Claims

1. A non-isomorphic binocular camera with automatic exposure adjustment, characterized in that, include: The first camera is used to capture the first image of the target object; A second camera is used to capture a second image of the target object; wherein the first camera and the second camera are non-co-source cameras, and the first camera and the second camera capture images simultaneously, the target object is a hand, the first image is an infrared image, and the second image is a color image; The processor is configured to perform correction and alignment on the first image and the second image respectively, and to perform target detection on the first image and the second image respectively using a target detection model, and to adjust the exposure based on the target object area with poor image quality; The processor includes: The correction module is used to perform distortion correction on the original first image and the original second image respectively, and then perform epipolar correction to obtain the corrected first image. and the corrected second image ; The detection module is used to detect the first image. and the second image Detect the target object separately; if in the first image and the second image If the target object is detected in both images, then the first image is obtained respectively. target object area and the second image target object area Execute the third processing module; if only in the first image and the second image If a target object is detected in one of the images, the first processing module is executed; if no target object is detected, the second processing module is executed; wherein, the first image and the second image These are non-homologous images; The first processing module is used to determine the target object region on the image where the target object has been detected. And according to the first image and the second image The correspondence is used to determine the target object region on the image where the target object was not detected. Then, based on the target object region in the image where no target object was detected... Adjust the exposure; The second processing module is used to process the first image. and the second image The brightness is evaluated; if the brightness is abnormal, the exposure gain needs to be reset; if the brightness is normal, no action is taken. The third processing module is used to calculate the target object region. and the target object region Image quality; The exposure adjustment module is used to adjust the camera's exposure. Specifically, when evaluating brightness, the first image and the second image are subtracted to generate a new image used to enhance the evaluation of palm vein texture.

2. The non-isomorphic binocular camera with automatic exposure adjustment according to claim 1, characterized in that, The third processing module includes: A brightness calculation unit is used to calculate the target object area. and the target object region Average brightness; A resolution calculation unit is used to calculate the target object region. and the target object region Image clarity; The output unit is configured to output an image if both the average brightness and the image sharpness are within a reasonable range; otherwise, it executes the exposure adjustment module.

3. A non-isomorphic binocular camera with automatic exposure adjustment according to claim 1, characterized in that, The second processing module processes the first image. and the second image When evaluating brightness, only a preset range including the image center is evaluated.

4. A non-isomorphic binocular camera with automatic exposure adjustment according to claim 1, characterized in that, In the detection module, if a target object is detected, the area of ​​the target object is judged. If the area of ​​the target object is less than a threshold, it is judged that no target object has been detected.

5. A non-isomorphic binocular camera with automatic exposure adjustment according to claim 1, characterized in that, The exposure adjustment module includes: The brightness adjustment unit is used to increase the exposure time, current value, or gain value if the average brightness of the target area is too low, and to decrease the exposure time, current value, or gain value if the average brightness of the target area is too high. The sharpness adjustment unit is used to increase the exposure time, increase the current value, or decrease the gain value if the sharpness of the target object is too low.

6. A non-isomorphic binocular camera with automatic exposure adjustment according to claim 5, characterized in that, In the brightness adjustment unit: If the target object area and the target object region If the average brightness is too low, the order of adjustment is exposure time, gain value, and current value. If the target object area and the target object region If the average brightness is too high, the order of adjustment is current value, gain value, and exposure time.

7. A non-isomorphic binocular camera with automatic exposure adjustment according to claim 1, characterized in that, Before any module processes the image, the first image is... and the second image Compress or trim.

8. A payment device, characterized in that, Including a non-homogeneous binocular camera with automatic exposure adjustment as described in any one of claims 1 to 7.

Images