Photographing control method and related apparatus

Abstract

The present application provides a photographing control method and a related apparatus. The embodiments of the present application can be applied to the technical field of computers. The method is applied to an image acquisition device, and the image acquisition device comprises a camera and a lamp. The method comprises: in response to an image acquisition instruction, setting an operating mode of the lamp to be an illumination mode; adjusting a photographing mode to be an automatic exposure mode; controlling the camera to carry out image acquisition on the basis of the automatic exposure mode to obtain M captured images; and determining a target captured image from the M captured images, wherein the target captured image is a captured image of which the image quality satisfies a preset image quality requirement. According to the method provided by the present application, when the image acquisition instruction is responded, the lamp is set to be in the illumination mode so as to illuminate a target object, so that a clear image of the target object can be formed under sufficient light, and when the target object is illuminated, the camera is adjusted to be in the automatic exposure mode so as to carry out photographing, so that the clear image of the target object can be acquired, thereby improving the success rate of target object verification.

Description

Shooting control method and related device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on July 17, 2023, with application number 2023108841555 and application name “A Shooting Control Method and Related Devices”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of Internet technology, and in particular to shooting control technology. Background Art

[0003] In payment scenarios, the currently commonly used payment methods include face-scanning payment and code scanning payment, that is, facial features are collected by a face-scanning device for facial recognition verification, or the payment code is verified by a code scanning device.

[0004] Like faces, fingerprints, and irises, palm veins and their texture are unique biometric features, providing theoretical support for palm-to-palm payment. Unlike fingerprint recognition, which reads the skin texture of the fingertips, palmprint recognition reads the vascular texture of the palm, which is more difficult to forge and can better ensure payment security. As a good balance between personal privacy protection and convenient payment, palm-to-palm payment has a promising development prospect.

[0005] In the palm-swipe payment scenario, in order to clearly image the palm, the camera's focal plane needs to be controlled to be basically located on the palm. At the same time, for the convenience of palm swiping, the camera's focal plane of the palm-swiping device is usually set to be parallel to the ceiling. However, when the palm is extended for swiping, it will block the original light. Due to the large changes in ambient light, it is easy to make it impossible to collect a clear palm print image, which in turn causes palm swiping failure.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a shooting control method and related devices, which solve the problem of low image clarity caused by ambient light in the related art.

[0008] One aspect of the present application provides a shooting control method, which is performed by an image acquisition device, the image acquisition device including a camera and a lamp. The shooting control method includes:

[0009] In response to the image acquisition instruction, the lighting mode is turned on, wherein the lighting mode is used to indicate that the lamp is in a high-brightness state. In the high-brightness state, the fill light intensity of the lamp exceeds a preset intensity threshold;

[0010] Adjust the shooting mode to automatic exposure mode;

[0011] Control the camera to perform image acquisition based on the automatic exposure mode to obtain M captured images, where M is an integer greater than or equal to 1;

[0012] A target captured image is determined from the M captured images, wherein the target captured image is a captured image whose image quality meets a preset image quality requirement.

[0013] Another aspect of the present application provides a shooting control device, comprising: an image acquisition instruction response module, an automatic exposure mode adjustment module, a shooting module, and a target shooting image determination module; specifically:

[0014] An image acquisition instruction response module is used to respond to the image acquisition instruction and turn on the lighting mode, wherein the lighting mode is used to indicate that the lamp is in a high-brightness state. In the high-brightness state, the fill light intensity of the lamp exceeds a preset intensity threshold;

[0015] Automatic exposure mode adjustment module, used to adjust the shooting mode to automatic exposure mode;

[0016] A shooting module, configured to control the camera to capture images based on an automatic exposure mode to obtain M captured images, where M is an integer greater than or equal to 1;

[0017] The target captured image determination module is configured to determine a target captured image from the M captured images, wherein the target captured image is a captured image whose image quality meets a preset image quality requirement.

[0018] Another aspect of the present application provides a computer device, comprising:

[0019] memories, transceivers, processors, and bus systems;

[0020] Wherein, the memory is used to store programs;

[0021] The processor is used to execute the program in the memory, including executing the above-mentioned methods;

[0022] The bus system is used to connect the memory and the processor so that the memory and the processor can communicate with each other.

[0023] Another aspect of the present application provides a computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium. When the computer-readable storage medium is run on a computer, the computer is enabled to execute the above-mentioned methods.

[0024] Another aspect of the present application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the methods provided by the above aspects.

[0025] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0026] The present application provides a shooting control method and related devices, the method being applied to an image acquisition device, the image acquisition device including a camera and a lamp, the method comprising: responding to an image acquisition instruction, setting the operating mode of the lamp to a lighting mode, wherein the lighting mode is used to indicate that the lamp is in a high-brightness state, and in the high-brightness state, the fill light intensity of the lamp exceeds a preset intensity threshold; adjusting the shooting mode to an automatic exposure mode; controlling the camera to perform image acquisition based on the automatic exposure mode to obtain M captured images, wherein M is an integer greater than or equal to 1; determining a target captured image from the M captured images, wherein the target captured image is a captured image whose image quality meets a preset image quality requirement. The present application provides a shooting control method, which, when responding to an image acquisition instruction, sets the lamp to a lighting mode to illuminate a target object so that the target object can be clearly imaged under sufficient light; after illuminating the target object, adjusts the fixed exposure mode to an automatic exposure mode to capture the target object, so that the captured image of the target object can be clearly imaged, thereby improving the success rate of target object verification. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] FIG1 is a schematic diagram of the architecture of a shooting control system provided by an embodiment of the present application;

[0028] FIG2 is a diagram illustrating an application environment of a method for controlling a photograph in a palm-swipe payment scenario provided by an embodiment of the present application;

[0029] FIG3 is a flow chart of a shooting control method provided by an embodiment of the present application;

[0030] FIG4 is a flow chart of a shooting control method provided by another embodiment of the present application;

[0031] FIG5 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0032] FIG6 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0033] FIG7 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0034] FIG8 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0035] FIG9 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0036] FIG10 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0037] FIG11 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0038] FIG12 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0039] FIG13 is a flowchart of a shooting control method provided by another embodiment of the present application;

[0040] FIG14 is a flowchart of a shooting control method applied to a palm-swiping scenario provided by an embodiment of the present application;

[0041] FIG15 is an exposure timing diagram in shooting control provided by an embodiment of the present application;

[0042] FIG16 is a schematic structural diagram of a shooting control device provided in one embodiment of the present application;

[0043] FIG17 is a schematic structural diagram of a shooting control device provided by another embodiment of the present application;

[0044] FIG18 is a schematic structural diagram of a shooting control device provided by another embodiment of the present application;

[0045] FIG19 is a schematic structural diagram of a shooting control device provided by another embodiment of the present application;

[0046] FIG20 is a schematic structural diagram of a shooting control device provided in yet another embodiment of the present application;

[0047] Figure 21 is a schematic diagram of the server structure provided by an embodiment of the present application. DETAILED DESCRIPTION

[0048] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the numbers used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can, for example, be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "corresponding to" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0049] To facilitate understanding of the technical solutions provided in the embodiments of the present application, some key terms used in the embodiments of the present application are explained here:

[0050] Palm area detection: Use target detection technology to locate the finger gaps in the image and extract the palm area image from the image.

[0051] Palmprint recognition: Identify the user's identity information based on the image of the palm area.

[0052] Cross-device registration and identification: Register and identify on two very different devices separately, such as registering on a mobile phone and identifying through an IoT device.

[0053] Color image: A color image captured by a color sensor using natural light. It is typically used for face / palm selection and comparative recognition in face / palm payment.

[0054] Infrared image: An infrared image captured by an infrared sensor, which is generally used for liveness detection in face / palm payment.

[0055] Optimization: Select a set of color, depth, and infrared images that meet the preconditions for liveness detection and comparative recognition algorithms (face payment requires color, depth, and infrared images, while palm payment requires both). Optimization can be based on the angle, size, centering, and clarity of the face / palm, color images; infrared images based on brightness; and depth images based on the completeness of the depth image (face payment).

[0056] Preferred payment frame: A set of color images, depth images, and infrared images (face payment requires color images, depth images, and infrared images, and palm payment requires color images and infrared images) that are preferably passed, which can be used for liveness detection and comparative identification.

[0057] Automatic Exposure (AE): Automatically adjusts the exposure according to the intensity of light to prevent overexposure or underexposure.

[0058] Compared with facial recognition, palm-swipe payment can significantly reduce the psychological pressure on sensitive facial areas by collecting palm prints, reducing privacy concerns and making it more stable. Compared with QR code scanning, palm-swipe payment can significantly simplify the payment process, providing users with a seamless payment experience while also facilitating quick and easy payment. Palm-swipe payment allows for a natural, seamless, and ergonomic interaction. The collection of non-sensitive biometric information reduces user psychological burden and privacy concerns, making it more readily accepted. It can replace QR code payment in the retail sector, providing an extremely fast payment experience for small-value payments, support rapid passage through smart gates in public transportation, and offer a more convenient user experience in private office scenarios such as access control and clock-in.

[0059] In the palm scanning scenario, in order to make the palm image clear, the camera's focal plane needs to be controlled to be basically located on the palm. At the same time, for the convenience of palm scanning, the camera's focal plane of the palm scanning device is usually set to be parallel to the ceiling. However, when the palm is extended for palm scanning, it will block the original light. Due to the large fluctuations in ambient light, it is easy to make it impossible to collect a clear palm print image, which in turn leads to palm scanning failure.

[0060] In related technologies, there are two main exposure methods: one is automatic exposure, which takes a long time, generally 200-400ms. If automatic exposure is relied upon during the palm-swiping process, the long exposure time will prevent users from providing a good palm-swiping experience. The other is fixed exposure. Compared with automatic exposure, fixed exposure saves exposure adjustment time and increases exposure speed, but its adaptability range and lighting scenarios are limited. For indoor scenes, the palm-swiping experience can be achieved when the distance between the palm and the palm-swiping terminal is within 6-9CM, but it cannot adapt to the full range of 3-12CM defined by the palm-swiping terminal, nor can it adapt to outdoor scenes with changing lighting.

[0061] The present application provides a shooting control method, which responds to an image acquisition instruction, sets the lamp to a lighting mode to illuminate the palm so that the palm can be clearly imaged under sufficient light. After illuminating the palm, the fixed exposure is adjusted to automatic exposure for shooting, so as to capture a clear palm image and improve the success rate of palm swiping.

[0062] For ease of understanding, please refer to Figure 1, which is a shooting control system in an embodiment of the present application. As shown in Figure 1, the shooting control system in the embodiment of the present application includes: a server and a terminal device; wherein the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The terminal can be a smartphone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, etc., but is not limited to this. The server is used to verify the target object in the target captured image. The terminal device is an image acquisition device, which is used to acquire images of the target object. The terminal and the server can be directly or indirectly connected via wired or wireless communication, and the embodiment of the present application is not limited here.

[0063] The image acquisition device first responds to the image acquisition instruction and sets the operating mode of the lamp to the lighting mode, wherein the lighting mode is used to indicate that the lamp is in a high-brightness state, and in the high-brightness state, the brightness of the lamp exceeds a preset brightness threshold; then, the image acquisition device adjusts the shooting mode of the camera to an automatic exposure mode; then, the image acquisition device performs image acquisition based on the automatic exposure mode to obtain M captured images, wherein M is an integer greater than or equal to 1; finally, the image acquisition device determines a target captured image from the M captured images, wherein the target captured image is a captured image whose image quality meets the preset image quality requirements.

[0064] For ease of understanding, please refer to Figure 2, which illustrates the application environment of the shooting control method in the embodiment of the present application. As shown in Figure 2, the shooting control method in the embodiment of the present application is applied to a shooting control system, and Figure 2 takes the shooting control method as an example in a palm payment scenario. The shooting control system includes: a payment system 100 and a merchant acquiring system 200.

[0065] The merchant acquiring system 200 may include an image acquisition device 200-1 and an acquiring device 200-2, wherein the image acquisition device 200-1 includes a camera, a lamp, and a distance sensor. First, when the distance sensor (such as a PSensor sensor) on the image acquisition device 200-1 determines that a palm is approaching, the lamp is turned on to the lighting mode to turn on the white light / infrared light to illuminate the palm. Then, the exposure mode is adjusted from the fixed exposure mode to the automatic exposure mode, and the palm is photographed in the automatic exposure mode. Finally, a target image that can be used for identity recognition and verification is selected from the photographed image to obtain payment information, and the payment information is sent to the acquiring device 200-2. The acquiring device 200-2 generates order information based on the payment information, and then sends the order information to the payment system 100. The payment system 100 can be considered as the merchant's settlement center. After receiving the order information, the acquiring device 200-2 verifies the user's identity information and the target captured image based on the user identifier in the order information, and deducts the payment after the verification is passed.

[0066] The following will introduce the shooting control method in this application from the perspective of the image acquisition device. Please refer to Figure 3. The shooting control method provided in the embodiment of this application is executed by the image acquisition device, which includes a camera and a lamp. The shooting control method includes: steps S110 to S140. Specifically:

[0067] S110 , responding to the image acquisition instruction, setting the operating mode of the lamp to the lighting mode.

[0068] The lighting mode is used to indicate that the lamp is in a high-brightness state. In the high-brightness state, the fill light intensity of the lamp exceeds a preset intensity threshold.

[0069] It is understood that when the image acquisition conditions are not met, the lamp operates in breathing light mode and the exposure mode is fixed exposure mode. Breathing light mode means the lamp emits a flashing green light, gradually changing from bright to dim, mimicking breathing. In breathing light mode, the lamp brightness is low, for example, below a preset brightness threshold. Fixed exposure mode refers to an exposure mode based on pre-set fixed exposure parameters (including a fixed exposure time and a fixed exposure gain (GAIN) value). The fixed exposure parameters can be determined based on the exposure parameters corresponding to high-quality target images captured in historical automatic exposure mode.

[0070] When the image acquisition conditions are met, an image acquisition instruction is generated. In response to the image acquisition instruction, the image acquisition device adjusts the operating mode of the lamp to the lighting mode, so that the lamp on the image acquisition device is in a high-brightness state of the white light lamp / infrared lamp to illuminate the palm, that is, the lamp can illuminate the palm with light of higher brightness.

[0071] Image acquisition conditions refer to the conditions used to trigger an image acquisition device to acquire images. For example, whether the image acquisition conditions are met can be determined based on the relationship between the distance value between the target object and the camera, as captured by a distance sensor (e.g., a P-Sensor) on the image acquisition device, and a distance threshold. For example, if the distance threshold is 15CM, when the distance value between the target object and the camera, as captured by the P-Sensor, is less than 15CM, indicating that a hand is currently approaching or there is a possibility of a hand approaching, the image acquisition condition is considered met.

[0072] S120: Adjust the shooting mode to the automatic exposure mode.

[0073] It is understood that when the image acquisition conditions are not met, the exposure mode is the fixed exposure mode. When the image acquisition conditions are met, the fixed exposure mode needs to be adjusted to the automatic exposure mode. The fixed exposure parameters of the fixed exposure mode can be determined based on historical exposure parameters.

[0074] The fixed exposure parameters can be obtained by processing M groups of exposure parameters (each group of exposure parameters includes exposure time and exposure gain) through a fixed exposure parameter adjustment model; M is an integer greater than 1. Specifically:

[0075] If, prior to executing the embodiments of the present application, more than M capture controls have been performed according to the method provided in the embodiments of the present application, and the M capture controls are performed in the same region as the current capture control, or are performed by the same image acquisition device, then M sets of historical exposure parameters corresponding to the target captured images of the recent M times are obtained (one-to-one correspondence with the target captured images obtained M times). Subsequently, the M sets of historical exposure parameters are used as input to a fixed exposure parameter adjustment model, and the M sets of historical exposure parameters are processed by the fixed exposure parameter adjustment model to obtain fixed exposure parameters (including fixed exposure time and fixed exposure gain). The fixed exposure parameter adjustment model is used to generate fixed exposure parameters based on the M sets of historical exposure parameters and the recognition time of the target captured images corresponding to the M sets of historical exposure parameters. The difference range between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode is less than a preset difference range threshold, thereby reducing the exposure parameter adjustment time during the adjustment from the fixed exposure mode to the automatic exposure mode and improving the accuracy of the exposure parameters.

[0076] If, before executing the embodiment of the present application, less than M shooting controls have been performed according to the method provided in the embodiment of the present application, M training reference images are obtained, and the regional or environmental big data of the M training reference images is the same as or similar to the regional or environmental big data of the current shooting control. Then, the M training reference images are used as inputs to the image exposure parameter analysis model, and the M training reference images are analyzed by the image exposure parameter analysis model to obtain M groups of reference exposure parameters corresponding to the M training reference images; then, the M groups of reference exposure parameters are used as inputs to the fixed exposure parameter adjustment model, and the M groups of reference exposure parameters are processed by the fixed exposure parameter adjustment model to obtain fixed exposure parameters (including fixed exposure time and fixed exposure gain). The fixed exposure parameter adjustment model is used to generate fixed exposure parameters based on the M groups of reference exposure parameters, and the difference range between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode is less than a preset difference range threshold, thereby reducing the exposure parameter adjustment time in the process of adjusting from the fixed exposure mode to the automatic exposure mode and improving the accuracy of the exposure parameters.

[0077] It is understood that when the difference between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode is less than the preset difference range threshold, the exposure parameter adjustment time can be reduced. This is because when the difference between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode is less than the preset difference range threshold, the convergence time required to adjust from the fixed exposure mode to the automatic exposure mode is short. For example, to adjust the fixed exposure mode to the automatic exposure mode, first, based on the exposure parameters corresponding to the high-quality target image captured in the historical automatic exposure mode, the brightness of the fixed exposure mode is determined to be 800. According to the calculation formula exposure time = target brightness / light intensity, the exposure time = 1000 / 800 = 1.25 (ms). If a user swipes their palm and the image acquisition conditions are met, and the palm is 9 cm away from the image acquisition device, the operating mode of the lighting fixture is set to illumination mode, white light fill light is turned on, and image acquisition is performed. According to the calculation formula image brightness = exposure time × fill light intensity, the brightness of this frame image = 1.25 (ms) × 750 (white light fill light intensity when the palm is 9 cm away from the image acquisition device) = 937.5. In this case, the exposure process needs to be adjusted from 937.5 to a target brightness of 1000. The exposure adjustment value is 1000-937.5=62.5. It can be seen that the exposure adjustment value is small. Accordingly, the exposure time required to capture an image that meets the target brightness is short, and the convergence speed is fast.

[0078] S130 : Control the camera to capture images based on the automatic exposure mode to obtain M captured images.

[0079] Wherein, M is an integer greater than or equal to 1.

[0080] It is understandable that by performing continuous shooting based on the automatic exposure mode, M images can be obtained by continuous shooting.

[0081] S140: Determine a target captured image from the M captured images.

[0082] The target captured image has an image quality that meets a preset image quality requirement, for example, it may be an image with a resolution greater than a preset resolution among the M captured images.

[0083] For example, the shooting control method provided in the embodiment of the present application is used in two situations, one is that the image acquisition conditions are not met, and the other is that the image acquisition conditions are met.

[0084] First, the scenario that does not meet the image acquisition conditions is explained: the automatic exposure parameters corresponding to the target captured images when the palm swipe is successful nearly 1000 times are obtained. The automatic exposure parameters corresponding to the target captured images when the palm swipe is successful nearly 1000 times are historical exposure parameters, which are stored in a historical exposure parameter database, and the fixed exposure parameters are determined based on the historical exposure parameters of the past 1000 times; specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value. The average of the exposure time of nearly 1000 times can be used as the fixed exposure time of the fixed exposure parameter, and the average of the exposure gain (GAIN) values ​​of nearly 1000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter; or, the median value of the exposure time of nearly 1000 times can be used as the fixed exposure time of the fixed exposure parameter, and the median value of the exposure gain (GAIN) values ​​of nearly 1000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter.

[0085] When the image acquisition conditions are not met, the lamp operates in breathing light mode, that is, the lamp emits green light, and the light is in a flashing state. The green light gradually changes from bright to dark, imitating the breathing state of a human face.

[0086] Next, the scenarios that meet the image acquisition conditions are explained: Based on experience, it is known that the distance between the palm and the image acquisition device is usually 5cm to 12cm when swiping the palm, and the distance threshold is set to 15cm based on experience. Based on the detection results of the distance sensor, the distance between the palm and the image acquisition device is determined. If the distance between the palm and the image acquisition device is less than the distance threshold of 15cm, the image acquisition instruction is responded to; if the distance between the palm and the image acquisition device is greater than the distance threshold of 15cm, the image acquisition instruction is not responded to. Preferably, four P-Sensors are provided on the image acquisition device. When one of the P-Sensors detects that the distance between the palm and the image acquisition device is less than the distance threshold of 15cm, the image acquisition instruction is responded to.

[0087] When the distance between the palm and the image acquisition device is less than a distance threshold of 15cm, the system responds to the image acquisition instruction by switching the operating mode of the lighting fixture from breathing light mode to illumination mode. This means that the lighting on the image acquisition device is set to high brightness, such as white light or infrared light, to illuminate the palm. After illuminating the palm, the camera mode is adjusted from fixed exposure mode to automatic exposure mode. The palm is continuously photographed in automatic exposure mode, generating M images. From these M images, an image that meets preset image quality requirements is selected as the target image. Finally, palmprint recognition verification is performed on the target image.

[0088] The present application provides a shooting control method, which, in response to an image acquisition instruction, sets the lamp to a lighting mode to illuminate the target object so that the target object can be clearly imaged under sufficient light, and adjusts the exposure mode of the camera from fixed exposure to automatic exposure for shooting, so that the image of the target object captured can be clear, thereby improving the success rate of target object verification.

[0089] In related technologies, there are two exposure methods: one is automatic exposure, which takes a long time, generally 200-400ms. If automatic exposure is relied upon during the palm-swiping process, the exposure time will be long, and the user experience will not be optimized. The other is fixed exposure. Compared with automatic exposure, fixed exposure saves exposure adjustment time and increases exposure speed, but its adaptability range and lighting scenarios are smaller. For indoor scenes, when the distance between the palm and the palm-swiping terminal is within 6-9cm, it can provide a good palm-swiping experience, but it cannot adapt to the full range of 3-12cm defined by the palm-swiping terminal, nor can it adapt to outdoor scenes with changing lighting.

[0090] In order to enable exposure within the full range of 3-12CM defined by the palm-swiping terminal and shorten the exposure time to provide users with a better palm-swiping experience, in an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG3 of this application, please refer to FIG4, step S120 further includes sub-step S121. Specifically:

[0091] S121. Adjust the fixed exposure mode to the automatic exposure mode.

[0092] The fixed exposure parameter value corresponding to the fixed exposure mode is determined based on the historical exposure parameters.

[0093] It is understood that when the difference between the fixed exposure parameters of the fixed exposure mode and the target exposure parameters of the automatic exposure mode is small, the exposure time can be greatly shortened. Therefore, setting a reasonable fixed exposure parameter plays an important role in shortening the exposure time. The fixed exposure parameter is determined based on the exposure parameters corresponding to the high-quality target images obtained in the past in the automatic exposure mode.

[0094] For example, in an indoor scene, assuming the average indoor light intensity is 100, the lamp on the image acquisition device operates in lighting mode, the intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target brightness is 1000.

[0095] If the automatic exposure mode is used directly, the exposure time can be calculated based on the formula: exposure time = target brightness / average indoor light intensity, and the exposure time = 1000 / 100 = 10 (ms). If a user swipes their palm and the image acquisition conditions are met, and the palm is 7 cm away from the image acquisition device, image acquisition is performed directly. The image brightness can be calculated based on the formula: image brightness = exposure time × fill light intensity, and the brightness of this frame of image = 10 (ms) × 800 = 8000. In this case, the exposure process needs to be adjusted from a brightness of 8000 to a target brightness of 1000, and the exposure adjustment value is 8000-1000 = 7000. Since the exposure adjustment value is large, the exposure time required to capture an image that meets the target brightness is longer, and the convergence speed is slower.

[0096] If the method of step S121 of the embodiment of the present application is adopted, that is, the exposure mode of the camera is adjusted from the fixed exposure mode to the automatic exposure mode, first, based on the exposure parameters corresponding to the high-quality target shooting image obtained in the historical automatic exposure mode, the brightness of the fixed exposure mode is determined to be 800, and according to the exposure time = target brightness / light brightness, the exposure time = 1000 / 800 = 1.25 (ms). If a user swipes his palm and meets the image acquisition conditions, and the palm is 9 cm away from the image acquisition device, the operating mode of the lamp is set to the lighting mode, the white light fill light is turned on, and the image is captured. According to the image brightness = exposure time × fill light intensity, it can be calculated that the brightness of this frame image = 1.25 (ms) × 750 (white light fill light intensity when the palm is 9 cm away from the image acquisition device) = 937.5. In this case, the exposure process needs to be adjusted from 937.5 to the target brightness of 1000. The exposure adjustment value is 1000-937.5=62.5. Since the exposure adjustment value is small, the exposure time required to capture an image that meets the target brightness is short, and the convergence speed is fast.

[0097] The present application provides a shooting control method, which sets a fixed exposure mode based on fixed exposure parameters determined according to exposure parameters corresponding to a high-quality target shooting image obtained in a historical automatic exposure mode. When the image acquisition conditions are met, the fixed exposure mode is adjusted to the automatic exposure mode, which can reduce the exposure adjustment value, achieve a shorter exposure time, and a faster convergence speed.

[0098] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG4 of the present application, please refer to FIG5 , step S140 is followed by steps S150 to S160. Specifically:

[0099] S150: Obtain exposure parameter values ​​corresponding to the target captured image.

[0100] S160: Store the exposure parameter value corresponding to the target captured image in a historical exposure parameter database.

[0101] The historical exposure parameters in the historical exposure parameter database are used to adjust the fixed exposure parameter values.

[0102] It can be understood that when the difference between the fixed exposure parameters of the fixed exposure mode and the target exposure parameters of the automatic exposure mode is small, the exposure time can be greatly shortened. Therefore, setting a reasonable fixed exposure parameter is crucial to shortening the exposure time. The fixed exposure parameter is determined based on the exposure parameters corresponding to high-quality target images obtained in the past in the automatic exposure mode. Therefore, the exposure parameter values ​​corresponding to the target images need to be stored for subsequent adjustment of the fixed exposure parameter values.

[0103] For example, the automatic exposure parameters corresponding to the target captured images based on nearly 1,000 successful palm swiping attempts can be obtained. The automatic exposure parameters corresponding to the target captured images based on the nearly 1,000 successful palm swiping attempts are historical exposure parameters, which are stored in a historical exposure parameter database. The fixed exposure parameters are determined based on the historical exposure parameters of nearly 1,000 times. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value. The average of the exposure times of nearly 1,000 times can be used as the fixed exposure time of the fixed exposure parameter, and the average of the exposure gain (GAIN) values ​​of nearly 1,000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter. Alternatively, the median value of the exposure time of nearly 1,000 times can be used as the fixed exposure time of the fixed exposure parameter, and the median value of the exposure gain (GAIN) values ​​of nearly 1,000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter.

[0104] The present application provides a shooting control method, which stores the exposure parameter values ​​corresponding to the target shooting images with higher quality for subsequent adjustment of the fixed exposure parameter values, so as to reduce the exposure adjustment value of the target exposure parameter corresponding to the fixed exposure parameter value and the automatic exposure mode, thereby shortening the exposure time and laying the foundation for improving the convergence speed of the exposure parameters.

[0105] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG3 of the present application, the image acquisition device further includes a distance sensor. Referring to FIG6 , step S110 further includes sub-steps S111 to S112. Specifically:

[0106] S111 . Determine the distance between the target object and the camera based on the detection result of the distance sensor.

[0107] It can be understood that the distance sensor in the embodiment of the present application can be a P-Sensor sensor, which can sense the distance between the image acquisition device and the palm, thereby determining whether to respond to the image acquisition instruction.

[0108] S112: If the distance between the target object and the camera is less than the distance threshold, respond to the image acquisition instruction.

[0109] It is understandable that the distance threshold is set based on experience, and when the distance between the target object and the camera is less than the distance threshold, the image acquisition instruction is responded to.

[0110] For example, based on experience, the distance between the palm and the image acquisition device during palm swiping is typically between 5cm and 12cm. Based on this experience, a distance threshold of 15cm is set. Based on the detection results of the distance sensor, the distance between the palm and the image acquisition device is obtained. If the distance between the palm and the image acquisition device is less than the distance threshold of 15cm, the image acquisition instruction is responded to. Preferably, the image acquisition device is provided with four P-Sensors. When one of the P-Sensors detects that the distance between the palm and the image acquisition device is less than the distance threshold of 15cm, the image acquisition instruction is responded to.

[0111] When the distance between the palm and the image acquisition device is less than a distance threshold of 15cm, the system responds to the image acquisition instruction by switching the operating mode of the lighting fixture from breathing light mode to illumination mode. This means that the lighting fixture on the image acquisition device is set to high brightness, illuminating the palm. After illuminating the palm, the exposure mode is adjusted from fixed exposure mode to automatic exposure mode. The palm is continuously photographed in automatic exposure mode, generating M images. From these M images, an image that meets preset image quality requirements is selected as the target image. Finally, palmprint recognition verification is performed on the target image.

[0112] The present application provides a shooting control method, which compares the distance value between the target object and the camera obtained based on the detection result of the distance sensor with the distance threshold to determine whether to respond to the image acquisition instruction, laying the foundation for reducing the exposure adjustment value, achieving a shorter exposure time and a faster convergence speed.

[0113] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG6 of the present application, please refer to FIG7 , sub-step S112 further includes sub-step S113. Specifically:

[0114] S113: If the distance between the target object and the camera is greater than or equal to the distance threshold, control the shooting mode to a fixed exposure mode.

[0115] It is understood that the distance threshold is set based on experience, and when the distance between the target object and the camera is greater than or equal to the distance threshold, the shooting mode is set to fixed exposure mode. When the distance between the target object and the camera is greater than or equal to the distance threshold, it can be understood that no palm swiping has been performed.

[0116] Based on experience, the distance between the palm and the image capture device during palm swiping is typically between 5cm and 12cm. Based on this experience, a distance threshold of 15cm is set. Based on the detection results of the distance sensor, the distance between the palm and the image capture device is obtained. If the distance between the palm and the image capture device is greater than or equal to the distance threshold of 15cm, the image capture instruction is not responded to. Preferably, the image capture device is provided with four P-Sensors. If none of the four P-Sensors detects that the distance between the palm and the image capture device is less than the distance threshold of 15cm, the image capture instruction is not responded to and the shooting mode remains in fixed exposure mode.

[0117] The present application provides a shooting control method, which compares the distance value between the target object and the camera obtained based on the detection result of the distance sensor with the distance threshold to determine whether to respond to the image acquisition instruction, laying the foundation for reducing the exposure adjustment value, achieving a shorter exposure time and a faster convergence speed.

[0118] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG. 7 of the present application, please refer to FIG. 8 , step S113 further includes sub-steps S1131 and S1132. Specifically:

[0119] S1131. Obtain fixed exposure parameter values.

[0120] It can be understood that the fixed exposure parameter value is pre-calculated, and the fixed exposure parameter value can be calculated based on the automatic exposure parameter corresponding to the target captured image based on the nearly 1000 successful palm swiping times. Specifically: the automatic exposure parameter corresponding to the target captured image based on the nearly 1000 successful palm swiping times is obtained, and the automatic exposure parameter corresponding to the target captured image based on the nearly 1000 successful palm swiping times is the historical exposure parameter, which is stored in the historical exposure parameter database, and the fixed exposure parameter is determined based on the historical exposure parameters of the nearly 1000 times; specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value, and the average of the exposure time of nearly 1000 times can be used as the fixed exposure time of the fixed exposure parameter, and the average of the exposure gain (GAIN) values ​​of nearly 1000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter; or, the median value of the exposure time of nearly 1000 times can be used as the fixed exposure time of the fixed exposure parameter, and the median value of the exposure gain (GAIN) values ​​of nearly 1000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter. The difference between the fixed exposure parameter value and the target exposure parameter value is small.

[0121] S1132: Control the shooting mode to a fixed exposure mode according to the fixed exposure parameter value.

[0122] It is understood that the shooting mode is controlled to be fixed exposure mode based on the fixed exposure parameter value. In scenes that do not meet the image acquisition conditions, the shooting mode is set to fixed exposure mode by default. Scenes that do not meet the image acquisition conditions refer to scenes where, based on experience, the distance between the palm and the image acquisition device is usually between 5cm and 12cm when swiping the palm, and the distance threshold is set to 15cm based on experience. Based on the detection results of the distance sensor, the distance between the palm and the image acquisition device is obtained. If the distance between the palm and the image acquisition device is greater than or equal to the distance threshold of 15cm, the scene does not meet the image acquisition conditions.

[0123] The present application provides a shooting control method. In a scenario where image acquisition conditions are not met, the shooting mode is controlled to be a fixed exposure mode according to a fixed exposure parameter value. The fixed exposure parameter value corresponding to the fixed exposure mode can be determined based on a historical exposure parameter value, and the difference with the target exposure parameter value is small, which is conducive to shortening the exposure time and making the convergence speed faster.

[0124] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG8 of the present application, please refer to FIG9 , sub-step S1131 further includes sub-steps S11311 to S11312. Specifically:

[0125] S11311. Obtain N historical exposure parameters.

[0126] Among them, the historical exposure parameters can be the exposure parameters corresponding to the captured images whose image quality meets the preset image quality requirements, for example, they can be the exposure parameters corresponding to the captured images whose resolution meets the preset resolution, and N is an integer greater than or equal to 1, for example, N can be equal to 1000.

[0127] S11312. Calculate a fixed exposure parameter value based on N historical exposure parameters.

[0128] It can be understood that the automatic exposure parameters corresponding to the target captured images based on nearly 1,000 successful palm swiping attempts can be obtained. The automatic exposure parameters corresponding to the target captured images based on nearly 1,000 successful palm swiping attempts are historical exposure parameters, which are stored in a historical exposure parameter database. The fixed exposure parameters are determined based on the historical exposure parameters of nearly 1,000 times. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value. The average of the exposure time of nearly 1,000 times can be used as the fixed exposure time of the fixed exposure parameter, and the average of the exposure gain (GAIN) values ​​of nearly 1,000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter. Alternatively, the median value of the exposure time of nearly 1,000 times can be used as the fixed exposure time of the fixed exposure parameter, and the median value of the exposure gain (GAIN) values ​​of nearly 1,000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter.

[0129] The present application provides a shooting control method, which calculates a fixed exposure parameter value based on the automatic exposure parameters corresponding to the target shooting image based on nearly 1,000 successful palm swipes. The difference between the fixed exposure parameter value and the target fixed exposure parameter value corresponding to the automatic exposure mode is small, that is, the exposure adjustment value is small, achieving a shorter exposure time and a faster convergence speed.

[0130] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG9 of the present application, please refer to FIG10 , sub-step S11311 further includes sub-step S113110, and sub-step S11312 further includes S113120. Specifically:

[0131] S113110. Obtain N exposure times and N exposure gain values ​​corresponding to N captured images.

[0132] S113120. Calculate a fixed exposure time based on the N exposure times, and calculate a fixed exposure gain value based on the N exposure gain values.

[0133] It can be understood that the automatic exposure parameters corresponding to the target captured images based on the nearly 1,000 successful palm swiping attempts are obtained. The automatic exposure parameters corresponding to the target captured images based on the nearly 1,000 successful palm swiping attempts are historical exposure parameters, which are stored in a historical exposure parameter database. The fixed exposure parameters are determined based on the nearly 1,000 historical exposure parameters. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value. The average of the exposure time of nearly 1,000 times can be used as the fixed exposure time of the fixed exposure parameter, and the average of the exposure gain (GAIN) values ​​of nearly 1,000 times can be used as the fixed exposure gain (GAIN) value of the fixed exposure parameter. Alternatively, the median value of the exposure time of nearly 1,000 times can be used as the fixed exposure time of the fixed exposure parameter, and the median value of the exposure gain (GAIN) values ​​of nearly 1,000 times can be used as the fixed exposure gain (GAIN) value of the fixed exposure parameter.

[0134] The present application provides a shooting control method, which determines the fixed exposure time and fixed exposure gain value in the fixed exposure parameter value based on the exposure time and exposure gain value corresponding to the target shooting image when the palm is successfully swiped nearly 1,000 times, thereby making the difference between the fixed exposure parameter value and the target fixed exposure parameter value smaller, that is, the exposure adjustment value is smaller, achieving a shorter exposure time and a faster convergence speed.

[0135] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG7 of the present application, please refer to FIG11 , step S1132 further includes step S1133. Specifically:

[0136] S1133. Set the operating mode of the lamp to breathing light mode.

[0137] It is understandable that in scenarios where the image acquisition conditions are not met, the operating mode of the lamp is the breathing light mode, that is, the lamp emits green light, and the light is flashing, and the green light gradually changes from bright to dark, imitating human breathing.

[0138] When the image acquisition conditions are met, the operating mode of the lamp is changed from the breathing light mode to the lighting mode, that is, the lamp on the image acquisition device is in the high-brightness state of the white light / infrared light to illuminate the palm for taking pictures.

[0139] The present application provides a shooting control method, which sets the operating mode of the lamp to a breathing light mode in a scene that does not meet the image acquisition conditions. By setting the breathing light, it is indicated that the image acquisition device is in an operating state, and it is distinguished from the luminous effect when the lamp is operating in the lighting mode.

[0140] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG3 of the present application, please refer to FIG12 , step S130 includes sub-steps S131 to S135. Specifically:

[0141] S131. Obtain the current exposure and current ambient brightness.

[0142] S132: Determine a target exposure value according to the current exposure value and the current ambient brightness.

[0143] S133: Determine an exposure adjustment value according to the current exposure and the target exposure.

[0144] S134: Adjust the current exposure to the target exposure according to the exposure adjustment value.

[0145] S135: Capture images based on the target exposure.

[0146] It can be understood that after the target exposure is determined based on the current exposure and the current ambient brightness, when performing automatic exposure adjustment, the difference between the target exposure and the current exposure is determined as the adjustment step value, and the current exposure is directly adjusted to the target exposure, thereby achieving breakthrough exposure and shortening the exposure time.

[0147] For example, in an indoor scene, assuming the average indoor light intensity is 100, the lamp on the image acquisition device is in operating lighting mode, the intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target brightness is 1000.

[0148] If the automatic exposure mode is used directly, the exposure time can be calculated based on the formula: exposure time = target brightness / average indoor light intensity, and exposure time = 1000 / 100 = 10 (ms). If a user swipes their palm and the image acquisition conditions are met, and the palm is 7 cm away from the image acquisition device, image acquisition is performed directly. The image brightness can be calculated based on the formula: image brightness = exposure time × fill light intensity, and the brightness of this frame of image = 10 (ms) × 800 = 8000. In this case, the exposure process needs to be adjusted from a brightness of 8000 to a target brightness of 1000, and the exposure adjustment value is 8000-1000 = 7000. Since the exposure adjustment value is large, the exposure time required to capture an image that meets the target brightness is longer, and the convergence speed is slower.

[0149] If the method of the embodiment of the present application is adopted, that is, in a scenario where the image acquisition conditions are met, the fixed exposure mode is adjusted to the automatic exposure mode. First, based on the exposure parameters corresponding to the high-quality target shot image obtained in the historical automatic exposure mode, the brightness of the fixed exposure mode is determined to be 800. According to the exposure time = target brightness / light brightness, the exposure time = 1000 / 800 = 1.25 (ms). If a user swipes their palm and the image acquisition conditions are met, and the palm is 9 cm away from the image acquisition device, the operating mode of the lamp is set to the lighting mode, the white light fill light is turned on, and image acquisition is performed. According to the image brightness = exposure time × fill light intensity, it can be calculated that the brightness of this frame image = 1.25 (ms) × 750 (white light fill light intensity when the palm is 9 cm away from the image acquisition device) = 937.5. In this case, the exposure process needs to be adjusted from 937.5 to the target brightness of 1000. The exposure adjustment value is 1000-937.5=62.5. Since the exposure adjustment value is small, the exposure time required to capture an image that meets the target brightness is short, and the convergence speed is fast.

[0150] In an outdoor scene, assuming the average outdoor light intensity is 1000, the lamp on the image acquisition device is in operating lighting mode, the intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target brightness is 1000.

[0151] The method of the embodiment of the present application is adopted, that is, in a scenario where the image acquisition conditions are met, the fixed exposure mode is adjusted to the automatic exposure mode. First, based on the exposure parameters corresponding to the high-quality target shooting image obtained in the historical automatic exposure mode, the brightness of the fixed exposure mode is determined to be 800. According to the exposure time = target brightness / light brightness, the exposure time is calculated to be 1000 / 800 = 1.25 (ms). If a user swipes his palm and meets the image acquisition conditions, and the palm distance for image acquisition is set to 9 cm, the operating mode of the lamp is set to lighting mode, white light fill light is turned on, and image acquisition is performed. According to the image brightness = exposure time × fill light intensity, it can be calculated that the brightness of this frame image = 1.25 (ms) × 1000 (the average outdoor light intensity is 1000) = 1250. For this case, the exposure process needs to be adjusted from 1250 to a target brightness of 1000, and the exposure adjustment value is 1250-1000 = 250. Since the exposure adjustment value is small, the exposure time required to capture an image that meets the target brightness is short, and the convergence speed is fast.

[0152] The present application provides a shooting control method, which determines the target exposure according to the current ambient brightness and the current exposure, calculates the exposure adjustment value according to the target exposure, and achieves a shorter exposure time and a faster convergence speed by reducing the exposure adjustment value.

[0153] In an optional embodiment of the shooting control method provided in the embodiment corresponding to FIG3 of the present application, please refer to FIG13 , step S140 includes sub-steps S141 to S142. Specifically:

[0154] S141. Obtain M resolution values ​​corresponding to M captured images.

[0155] S142 . Determine, according to the M resolution values, from the M captured images, an image having a resolution value greater than a preset resolution as a target captured image.

[0156] It can be understood that, based on the resolution of continuously captured images, a captured image with a resolution value greater than a preset resolution can be selected as the target captured image. If there are multiple captured images with a resolution value greater than the preset resolution, the captured image with the largest resolution is selected as the target captured image. If there is no captured image with a resolution value greater than the preset resolution, the shooting failure is returned and a request is made to reshoot.

[0157] The present application provides a shooting control method, which selects a target shooting image according to the shooting resolution of the image, improves the accuracy of determining the target shooting image, and then adjusts the fixed exposure parameter value corresponding to the fixed exposure mode through the exposure parameter value of the target shooting image, laying the foundation for shortening the exposure time and improving the convergence speed.

[0158] For ease of understanding, a shooting control method applied to a palm-swiping scenario will be described below with reference to FIG. 14 . The shooting control method applied to a palm-swiping scenario includes four steps, specifically:

[0159] Step 1: Use the P-Sensor to determine whether a palm is approaching.

[0160] Based on experience, it is known that the distance between the palm and the image acquisition device is usually between 5cm and 12cm when swiping the palm, and the distance threshold is set to 15cm based on experience. Based on the detection result of the distance sensor, the distance between the palm and the image acquisition device is obtained. If the distance between the palm and the image acquisition device is less than the distance threshold of 15cm, the image acquisition instruction is responded to; if the distance between the palm and the image acquisition device is greater than or equal to the distance threshold of 15cm, the image acquisition instruction is not responded to. Preferably, 4 P-Sensor sensors are provided on the image acquisition device. When one of the P-Sensor sensors detects that the distance between the palm and the image acquisition device is less than the distance threshold of 15cm, the image acquisition instruction is responded to. Preferably, if the distance between the palm and the image acquisition device is equal to 12cm, the success rate of palm swiping can be improved, and 12cm is used as the optimal distance value for palm swiping to provide a better palm swiping experience.

[0161] Step 2: When there is no palm close to the image acquisition device, the shooting mode is fixed exposure mode.

[0162] That is, in the scenario where the image acquisition command is not responded, the shooting mode can be kept in fixed exposure mode. The fixed exposure parameter value corresponding to the fixed exposure mode can be determined by the following method:

[0163] Obtain automatic exposure parameters corresponding to target captured images based on nearly 1000 successful palm swiping attempts. The automatic exposure parameters corresponding to target captured images based on nearly 1000 successful palm swiping attempts are historical exposure parameters, which are stored in a historical exposure parameter database. Determine fixed exposure parameters based on the historical exposure parameters of nearly 1000 attempts. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value. The average of the exposure times of nearly 1000 times can be used as the fixed exposure time of the fixed exposure parameter, and the average of the exposure gain (GAIN) values ​​of nearly 1000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter. Alternatively, the median value of the exposure time of nearly 1000 times can be used as the fixed exposure time of the fixed exposure parameter, and the median value of the exposure gain (GAIN) values ​​of nearly 1000 times can be used as the exposure gain (GAIN) value of the fixed exposure parameter.

[0164] In addition, when the image acquisition conditions are not met, the operating mode of the lamp is the breathing light mode, that is, the lamp emits green light, and the light is in a flashing state. The green light gradually changes from bright to dark, imitating the human breathing state.

[0165] Step 3: When a palm approaches the image acquisition device, the shooting mode is the automatic exposure mode.

[0166] That is, in the scenario of responding to the image acquisition instruction, the shooting mode can be adjusted from the fixed exposure mode to the automatic exposure mode.

[0167] When the distance between the palm and the image acquisition device is less than a distance threshold of 15cm, the system responds to the image acquisition instruction by switching the operating mode of the lighting fixture from breathing light mode to illumination mode. This means that the lighting on the image acquisition device is set to high brightness, such as white light or infrared light, to illuminate the palm. After illuminating the palm, the camera mode is adjusted from fixed exposure mode to automatic exposure mode. The palm is continuously photographed in automatic exposure mode, generating M images. From these M images, an image with a resolution greater than a preset resolution is selected as the target image. Finally, palmprint recognition verification is performed on the target image.

[0168] It should be noted that, please refer to Figure 15, which is an exposure timing diagram. To ensure the success rate, it is necessary to illuminate the palm first and then adjust the shooting mode to automatic exposure mode, so that the first frame obtained by the image acquisition device is an image with lighting + fixed AE based on experience. Only in this way can the palm-swiping fast AE take effect. If the first frame obtained by the image acquisition device does not match the lighting: the first frame of automatic AE given to the image acquisition device has not yet been illuminated, the image acquisition device's first frame AE will fail, and there will be a very long AE convergence process, which will result in a slow palm-swiping speed.

[0169] Step 4: Store the exposure parameter value corresponding to the target image successfully identified this time into the historical exposure parameter database.

[0170] When the difference between the fixed exposure parameters of the fixed exposure mode and the target exposure parameters of the automatic exposure mode is small, the exposure time can be greatly shortened. Therefore, setting a reasonable fixed exposure parameter is crucial to shortening the exposure time. The fixed exposure parameter is determined based on the exposure parameters of the target image captured in the past with high quality obtained in the automatic exposure mode. Therefore, the exposure parameter value corresponding to the target image needs to be stored for subsequent adjustment of the fixed exposure parameter value.

[0171] For example, in an indoor scene, assuming the average indoor light intensity is 100, the lamp on the image acquisition device is in operating lighting mode, the intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target brightness is 1000.

[0172] If the automatic exposure mode is used directly, the exposure time can be calculated based on the formula: exposure time = target brightness / average indoor light intensity, and exposure time = 1000 / 100 = 10 (ms). If a user swipes their palm and the image acquisition conditions are met, and the palm is 7 cm away from the image acquisition device, image acquisition is performed directly. The image brightness can be calculated based on the formula: image brightness = exposure time × fill light intensity, and the brightness of this frame of image = 10 (ms) × 800 = 8000. In this case, the exposure process needs to be adjusted from a brightness of 8000 to a target brightness of 1000, and the exposure adjustment value is 8000-1000 = 7000. Since the exposure adjustment value is large, the exposure time required to capture an image that meets the target brightness is longer, and the convergence speed is slower.

[0173] If the method of the embodiment of the present application is adopted, that is, the fixed exposure mode is adjusted to the automatic exposure mode, first, the brightness of the fixed exposure mode is determined to be 800 based on the exposure parameters corresponding to the successful target shooting image in the historical automatic exposure mode, and the exposure time is calculated according to exposure time = target brightness / light brightness, and the exposure time = 1000 / 800 = 1.25 (ms). If a user swipes his palm and meets the image acquisition conditions, and the palm is 9 cm away from the image acquisition device, the operating mode of the lamp is set to lighting mode, the white light fill light is turned on, and image acquisition is performed. According to image brightness = exposure time × fill light intensity, it can be calculated that the brightness of this frame image = 1.25 (ms) × 750 (white light fill light intensity when the palm is 9 cm away from the image acquisition device) = 937.5. For this case, the exposure process needs to be adjusted from 937.5 to a target brightness of 1000, and the exposure adjustment value is 1000-937.5 = 62.5. Since the exposure adjustment value is small, the exposure time required to shoot an image that meets the target brightness is short, and the convergence speed is fast.

[0174] In an outdoor scene, assuming the average outdoor light intensity is 1000, the lamp on the image acquisition device is in operating lighting mode, the intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target brightness is 1000.

[0175] Adopt the method of the embodiment of the present application, that is, adjust the fixed exposure mode to the automatic exposure mode, first determine the brightness of the fixed exposure mode to 800 according to the exposure parameters corresponding to the successful target shooting image in the historical automatic exposure mode, and calculate according to exposure time = target brightness / light brightness, exposure time = 1000 / 800 = 1.25 (ms). If a user swipes his palm and meets the image acquisition conditions, and the palm is 9 cm away from the image acquisition device, set the operating mode of the lamp to lighting mode, turn on white light fill light, and perform image acquisition. According to image brightness = exposure time × fill light intensity, it can be calculated that the brightness of this frame image = 1.25 (ms) × 1000 (the average outdoor light intensity is 1000) = 1250. For this case, the exposure process needs to be adjusted from 1250 to a target brightness of 1000, and the exposure adjustment value is 1250-1000 = 250. Since the exposure adjustment value is small, the exposure time required to shoot an image that meets the target brightness is short, and the convergence speed is fast.

[0176] The present application provides a shooting control method, which, in response to an image acquisition instruction, sets the lamp to a lighting mode to illuminate the target object so that the target object can be clearly imaged under sufficient light; after illuminating the target object, adjusts the fixed exposure to automatic exposure for shooting, so that the captured image of the target object can be clearly imaged, thereby improving the success rate of target object verification; sets a fixed exposure mode based on fixed exposure parameters determined according to exposure parameters corresponding to high-quality target captured images obtained in historical automatic exposure modes; and adjusts the fixed exposure mode to automatic exposure mode when image acquisition conditions are met, thereby reducing the exposure adjustment value, achieving a shorter exposure time, and a faster convergence speed.

[0177] The following is a detailed description of the shooting control device in the present application, with reference to FIG16. FIG16 is a schematic diagram of an embodiment of the shooting control device 10 in the present application. The shooting control device 10 includes: an image acquisition instruction response module 110, an automatic exposure mode adjustment module 120, a shooting module 130, and a target shooting image determination module 140. Specifically:

[0178] The image acquisition instruction response module 110 is used to respond to the image acquisition instruction and start the lighting mode.

[0179] The lighting mode is used to indicate that the lamp is in a high-brightness state. In the high-brightness state, the fill light intensity of the lamp exceeds a preset intensity threshold;

[0180] The automatic exposure mode adjustment module 120 is configured to adjust the shooting mode to the automatic exposure mode.

[0181] The shooting module 130 is used to control the camera to capture images based on the automatic exposure mode to obtain M captured images.

[0182] Wherein, M is an integer greater than or equal to 1;

[0183] The target shot image determination module 140 is configured to determine a target shot image from the M shot images.

[0184] The target captured image is a captured image whose image quality meets the preset image quality requirements.

[0185] The present application provides a shooting control device, which, when responding to an image acquisition instruction, sets the lamp to a lighting mode to illuminate the target object so that the target object can be clearly imaged under sufficient light. After illuminating the target object, the fixed exposure mode is adjusted to an automatic exposure mode for shooting, so that the image of the target object captured can be clearly imaged, thereby improving the success rate of target object verification.

[0186] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 16 of the present application, the automatic exposure mode adjustment module 120 is specifically configured to:

[0187] The fixed exposure mode is adjusted to the automatic exposure mode, wherein the fixed exposure parameter value corresponding to the fixed exposure mode is determined according to the historical exposure parameter.

[0188] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 16 of the present application, referring to FIG. 17 , the shooting control device 10 further includes an exposure parameter value storage module 150 for:

[0189] Get the exposure parameter value corresponding to the target captured image.

[0190] The exposure parameter values ​​corresponding to the target captured image are stored in the historical exposure parameter database.

[0191] The historical exposure parameters in the historical exposure parameter database are used to adjust the fixed exposure parameter values.

[0192] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 16 of the present application, referring to FIG. 18 , the shooting control device 10 further includes: a distance detection module 160 and an image acquisition instruction generation module 170 ; specifically:

[0193] The distance detection module 160 is configured to determine the distance between the target object and the camera based on the detection result of the distance sensor.

[0194] The image acquisition instruction generating module 170 is configured to generate an image acquisition instruction if the distance between the target object and the camera is less than a distance threshold.

[0195] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 16 of the present application, please refer to FIG. 19 , the shooting control device 10 further includes: a fixed exposure mode adjustment module 180. Specifically:

[0196] The fixed exposure mode adjustment module 180 is configured to control the shooting mode to be the fixed exposure mode if the distance between the target object and the camera is greater than or equal to a distance threshold.

[0197] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 19 of the present application, the fixed exposure mode adjustment module 180 is further configured to:

[0198] Gets the fixed exposure parameter value.

[0199] According to the fixed exposure parameter value, the shooting mode is controlled to be the fixed exposure mode.

[0200] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 19 of the present application, the fixed exposure mode adjustment module 180 is further configured to:

[0201] Get N historical exposure parameters.

[0202] The historical exposure parameters are exposure parameters corresponding to captured images that meet preset image quality requirements.

[0203] A fixed exposure parameter value is calculated based on N historical exposure parameters.

[0204] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 19 of the present application, the fixed exposure mode adjustment module 180 is further configured to:

[0205] Obtain N exposure times and N exposure gain values ​​corresponding to N captured images, where N is an integer greater than 1;

[0206] The fixed exposure parameter value is calculated based on N historical exposure parameters, including:

[0207] A fixed exposure time is calculated based on the N exposure times, and a fixed exposure gain value is calculated based on the N exposure gain values.

[0208] In an optional embodiment of the shooting control device provided in the embodiment corresponding to Figure 19 of the present application, please refer to Figure 20, the shooting control device 10 also includes: a breathing light mode adjustment module 190, which is used to set the operating mode of the lamp to the breathing light mode.

[0209] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 16 of the present application, the shooting module 110 is further configured to:

[0210] Get the current exposure and current ambient brightness.

[0211] The target exposure is determined based on the current exposure and the current ambient brightness.

[0212] The exposure adjustment value is determined based on the current exposure and the target exposure.

[0213] Adjust the current exposure to the target exposure based on the exposure adjustment value.

[0214] Image acquisition is performed based on the target exposure.

[0215] In an optional embodiment of the shooting control device provided in the embodiment corresponding to FIG. 16 of the present application, the target shot image determination module 140 is further configured to:

[0216] Get M resolution values ​​corresponding to M captured images.

[0217] According to the M resolution values, a captured image having a corresponding resolution value greater than a preset resolution is determined from the M captured images as a target captured image.

[0218] FIG21 is a schematic diagram of a server structure provided in an embodiment of the present application. The server 300 can be used to execute the shooting control method provided in an embodiment of the present application. The server 300 may vary greatly due to different configurations or performances, and may include one or more central processing units (CPUs) 322 (e.g., one or more processors) and a memory 332, and one or more storage media 330 (e.g., one or more mass storage devices) storing application programs 342 or data 344. The memory 332 and the storage medium 330 may be temporary storage or permanent storage. The program stored in the storage medium 330 may include one or more modules (not shown), each module of which may include a series of instruction operations on the server. Furthermore, the central processing unit 322 may be configured to communicate with the storage medium 330 to execute a series of instruction operations in the storage medium 330 on the server 300.

[0219] The server 300 may also include one or more power supplies 326, one or more wired or wireless network interfaces 350, one or more input and output interfaces 358, and / or one or more operating systems 341, such as Windows Server 2003 or Windows Server 2003R. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0220] The steps executed by the server in the above embodiment can be based on the server structure shown in Figure 21.

[0221] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0222] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0223] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0224] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0225] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0226] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A shooting control method, performed by an image acquisition device, wherein the image acquisition device includes a camera and a lamp, and the method includes: In response to the image acquisition instruction, the operation mode of the lamp is set to the lighting mode, wherein the lighting mode is used to indicate that the lamp is in a high-brightness state, and in the high-brightness state, the fill light intensity of the lamp exceeds a preset intensity threshold; Adjust the shooting mode to automatic exposure mode; Controlling the camera to perform image acquisition based on the automatic exposure mode to obtain M captured images, where M is an integer greater than or equal to 1; A target captured image is determined from the M captured images, wherein the target captured image is a captured image whose image quality meets a preset image quality requirement.

2. The shooting control method according to claim 1, wherein the adjusting shooting mode is an automatic exposure mode, comprising: The fixed exposure mode is adjusted to the automatic exposure mode, wherein the fixed exposure parameter value corresponding to the fixed exposure mode is determined according to the historical exposure parameter.

3. The shooting control method according to claim 2, further comprising: after determining the target shot image from the M shot images: Obtaining an exposure parameter value corresponding to the target captured image; The exposure parameter value corresponding to the target captured image is stored in a historical exposure parameter database, wherein the historical exposure parameters in the historical exposure parameter database are used to adjust the fixed exposure parameter value.

4. The shooting control method according to any one of claims 1 to 3, wherein the image acquisition device further comprises a distance sensor; and the responding image acquisition instruction comprises: Determine the distance value between the target object and the camera based on the detection result of the distance sensor; If the distance between the target object and the camera is less than the distance threshold, the image acquisition instruction is responded to.

5. The shooting control method according to claim 4, after determining the distance value between the target object and the camera, further comprising: If the distance value between the target object and the camera is greater than or equal to the distance threshold, the shooting mode is controlled to be a fixed exposure mode.

6. The shooting control method according to claim 5, wherein the step of controlling the shooting mode to be a fixed exposure mode comprises: Get fixed exposure parameter value; According to the fixed exposure parameter value, the shooting mode is controlled to be the fixed exposure mode.

7. The shooting control method according to claim 6, wherein obtaining a fixed exposure parameter value comprises: Obtaining N historical exposure parameters, wherein the historical exposure parameters are exposure parameters corresponding to the captured images that meet the preset image quality requirements, and N is an integer greater than or equal to 1; The fixed exposure parameter value is calculated according to the N historical exposure parameters.

8. The shooting control method according to claim 7, wherein the acquiring N historical exposure parameters comprises: Obtain N exposure times and N exposure gain values ​​corresponding to N captured images; The step of calculating the fixed exposure parameter value according to the N historical exposure parameters includes: A fixed exposure time is calculated based on the N exposure times, and a fixed exposure time is calculated based on the N exposure gain values. to a fixed exposure gain value.

9. The shooting control method according to any one of claims 5 to 8, wherein if the distance between the target object and the camera is greater than or equal to the distance threshold, after controlling the shooting mode to a fixed exposure mode, the method further comprises: The operating mode of the lamp is set to breathing light mode.

10. The shooting control method according to any one of claims 1 to 9, wherein the image acquisition based on the automatic exposure mode comprises: Get the current exposure and current ambient brightness; Determine a target exposure according to the current exposure and the current ambient brightness; Determining an exposure adjustment value according to the current exposure and the target exposure; According to the exposure adjustment value, adjusting the current exposure to the target exposure; Image acquisition is performed based on the target exposure.

11. The shooting control method according to any one of claims 1 to 10, wherein determining a target shot image from the M shot images comprises: Obtaining M resolution values ​​corresponding to the M captured images; According to the M resolution values, a photographed image having a corresponding resolution value greater than a preset resolution is determined from the M photographed images as the target photographed image.

12. A shooting control device, comprising: An image acquisition instruction response module, used to respond to the image acquisition instruction and turn on the lighting mode, wherein the lighting mode is used to indicate that the lamp is in a high-brightness state, and in the high-brightness state, the fill light intensity of the lamp exceeds a preset intensity threshold; An automatic exposure mode adjustment module, used to adjust the shooting mode to the automatic exposure mode; A shooting module, used for controlling the camera to collect images based on the automatic exposure mode to obtain M captured images, where M is an integer greater than or equal to 1; The target shot image determination module is used to determine a target shot image from the M shot images, wherein the target shot image is a shot image whose image quality meets a preset image quality requirement.

13. A computer device comprising: memories, transceivers, processors, and bus systems; Wherein, the memory is used to store programs; The processor is used to execute the program in the memory, including executing the shooting control method according to any one of claims 1 to 11; The bus system is used to connect the memory and the processor so that the memory and the processor can communicate with each other. 14 . A computer-readable storage medium comprising instructions, which, when executed on a computer, enables the computer to execute the shooting control method according to claim 1 . 15 . A computer program product, comprising a computer program, wherein a processor executes the shooting control method according to claim 1 .

Images