Shooting control method and related device

Abstract

The present application provides a photographing control method and a related device. Embodiments of the present application are applicable to the computer technology field. The method is applied to an image collection device, which includes a camera and a lighting device. The method includes the steps of: in response to an image collection command, setting the operation mode of the lighting device to an illumination mode and adjusting the photographing mode to an auto-exposure mode; controlling the camera to perform image collection based on the auto-exposure mode, obtaining M photographs, and determining a target photographed image from the M photographed images, where the image quality of the target photographed image is a photographed image whose image quality meets a predetermined image quality requirement. In response to an image collection command, the method provides: setting the lighting device to an illumination mode and illuminating the target object, thereby ensuring that the target object is clearly imaged under sufficient light; and adjusting the auto-exposure mode after illuminating the target object, so that the collected image of the target object is clearly imaged, thereby improving the success rate of target object detection.

Description

[Technical Field]

[0001] This application claims priority to a Chinese patent application filed with the China Patent Office on July 17, 2023, bearing application number 2023108841555 and entitled "Photography control method and related device," the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the field of Internet technology, and more particularly to photography control technology. [Background technology]

[0003] In the payment scene, currently, commonly used payment methods include facial recognition payment and code scanning payment, that is, facial recognition verification is performed after collecting facial features by a facial recognition device, or payment code verification is performed by a code scanning device.

[0004] The texture of the palm and its veins are unique biometric features, just like faces, fingerprints, and irises, which provides the theoretical basis for palm recognition payment. Unlike fingerprint recognition, which reads the skin patterns on the pads of the fingers, palm print recognition reads the blood vessel patterns in the palm, which are more difficult to forge and can better guarantee the security of payments. Palm recognition payment, as a well-balanced method between privacy protection and convenient payments, has good prospects for future development.

[0005] In palm authentication payment scenarios, in order to clearly image the palm, the focal plane of the camera needs to be controlled to be basically positioned on the palm. At the same time, to facilitate palm authentication, the focal plane of the camera in the palm authentication device is usually set parallel to the ceiling panel. However, when the palm is extended for palm authentication, the original light beam is blocked and the ambient light changes significantly, making it difficult to collect a clear palm print image and resulting in palm authentication failure. Summary of the Invention [Problem to be solved by the invention]

[0006] The embodiments of the present application provide a shooting control method and related devices, which solve the problem of low image clarity caused by ambient light in the related art. [Means for solving the problem]

[0007] One aspect of the present application provides a photography control method, the photography control method being executed by an image collection device, the image collection device including a camera and a lighting device, the photography control method comprising: turning on an illumination mode in response to an image capture command, wherein the illumination mode is used to indicate that the lighting fixture is in a highlight state, and under the highlight state, the fill light intensity of the lighting fixture exceeds a predetermined intensity threshold; adjusting the photographing mode to an auto exposure mode; controlling the camera to perform image acquisition based on an auto-exposure mode to obtain M captured images, where M is an integer greater than or equal to 1; determining a target captured image from among the M captured images, where the target captured image is a captured image whose image quality satisfies a predetermined image quality requirement.

[0008] Another aspect of the present application provides a photographing control device, which includes an image acquisition command response module, an automatic exposure mode adjustment module, a photographing module, and a target photographing image determination module, specifically: The image collection command response module is used to turn on a lighting mode in response to an image collection command, where the lighting mode is used to indicate that the lighting device is in a highlight state, and under the highlight state, the fill light intensity of the lighting device exceeds a predetermined intensity threshold; the automatic exposure mode adjusting module is used for adjusting the photographing mode to the automatic exposure mode; The photographing module is used to control the camera to perform image acquisition according to an automatic exposure mode, and obtain M photographed images, where M is an integer greater than or equal to 1; The target photographed image determining module is used for determining a target photographed image from among the M photographed images, where the target photographed image is a photographed image whose image quality meets a predetermined image quality requirement.

[0009] Another aspect of the present application provides a computer device, comprising: a memory, a transceiver, a processor, and a bus system; Here, the memory is used to store the program, The processor is adapted to execute a program in the memory, including performing the method of each of the above aspects; The bus system is used to connect the memory and the processor, thereby allowing the memory and the processor to communicate with each other.

[0010] Another aspect of the present application provides a computer-readable storage medium having stored thereon instructions that, when executed on a computer, cause the computer to perform the methods of the previous aspects.

[0011] Another aspect of the present application provides a computer program product or a computer program, the computer program product or the computer program including computer instructions stored in a computer-readable storage medium, wherein a processor of a computing device reads the computer instructions from the computer-readable storage medium and executes the computer instructions to cause the computing device to perform the method provided in each of the above aspects. [Effects of the Invention]

[0012] As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:

[0013] The present application provides a photography control method and related apparatus, the method being applied to an image collection device, the image collection device including a camera and a lighting device. The method includes the steps of: setting the operating mode of the lighting device to a lighting mode in response to an image collection command, where the lighting mode is used to indicate that the lighting device is in a highlight state, and under the highlight state, the fill light intensity of the lighting device exceeds a predetermined intensity threshold; adjusting the photography mode to an auto-exposure mode; controlling the camera to perform image collection based on the auto-exposure mode to obtain M photographed images, where M is an integer greater than or equal to 1; and determining a target photographed image from the M photographed images, where the target photographed image is a photographed image whose image quality meets a predetermined image quality requirement. The present application provides a photography control method, which, when responding to an image collection command, sets a lighting device to a lighting mode to illuminate a target object, so that the target object can be clearly imaged under sufficient light, and after illuminating the target object, adjusts the fixed exposure mode to an automatic exposure mode to photograph the target object, so that the collected image of the target object can be clearly imaged, thereby improving the success rate of checking the target object. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a schematic diagram of one architecture of a shooting control system provided by an embodiment of the present application. [Figure 2] 1 is a diagram illustrating an application environment of a photographing control method in a palm authentication payment scenario provided by an embodiment of the present application. [Figure 3] 1 is a flowchart of a shooting control method provided by an embodiment of the present application. [Figure 4] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 5] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 6] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 7] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 8] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 9] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 10] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 11] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 12] 4 is a flowchart of a shooting control method provided by another embodiment of the present application. [Figure 13] 1 is a flowchart of a shooting control method provided by a further embodiment of the present application; [Figure 14] 1 is a flowchart of a photographing control method applied to a palm recognition scene provided by an embodiment of the present application; [Figure 15] FIG. 2 is a timing diagram of exposure in the photographing control provided by an embodiment of the present application. [Figure 16] 1 is a structural schematic diagram of an imaging control device provided by an embodiment of the present application; [Figure 17] FIG. 2 is a structural schematic diagram of an imaging control device provided by another embodiment of the present application; [Figure 18] FIG. 2 is a structural schematic diagram of an imaging control device provided by another embodiment of the present application; [Figure 19] FIG. 2 is a structural schematic diagram of an imaging control device provided by another embodiment of the present application; [Figure 20] FIG. 2 is a structural schematic diagram of an imaging control device provided by a further embodiment of the present application; [Figure 21] FIG. 2 is a structural schematic diagram of a server provided by an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0015] Terms such as "first," "second," "third," and "fourth," if present, in the present specification, claims, and drawings are used to distinguish between similar objects and not to describe a particular order or chronology. It should be understood that such terms may be interchanged under appropriate circumstances, such that the embodiments of the present invention described herein can be practiced, for example, outside the order shown or described herein. Also, the terms "comprises," "corresponding," and any variations thereof are intended to cover non-exclusive inclusions; for example, a process, method, system, product, or apparatus containing a series of steps or units need not be limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent in the process, method, product, or apparatus.

[0016] In order to facilitate understanding of the technical solutions provided by the embodiments of the present application, some important nouns used in the embodiments of the present application will be first interpreted herein.

[0017] Palm region detection: A target detection technique is used to locate the inter-finger points in the picture and extract a picture of the palm region from the picture.

[0018] Palmprint Recognition: Recognizes the identity of a user based on a picture of the palm area.

[0019] Inter-device registration and recognition: Registration and recognition are performed on two types of devices that are significantly different from each other, for example, registration is performed on a mobile phone and recognition is performed on an Internet of Things device.

[0020] Color image: A color image formed by collecting natural light using a color sensor. In face / palm authentication payment, it is generally used for face / palm sorting and comparison recognition.

[0021] Infrared image: An infrared image formed by collecting infrared light using an infrared sensor. It is commonly used for liveness detection in face / palm recognition payments.

[0022] Selection: Select a set of color images, depth images, and infrared images that meet the prerequisites of the liveness detection and comparison recognition algorithm (color images, depth images, and infrared images are required for face recognition payment, and color images and infrared images are required for palm recognition payment). Specifically, when selecting, color images can be selected based on the angle, size, centering accuracy of the face / palm, and the clarity of the color images; infrared images can be selected based on the brightness of the infrared images; and depth images can be selected based on the completeness of the depth images (face recognition).

[0023] Payment frame selection: A set of accepted color, depth, and infrared images (face recognition payment requires color, depth, and infrared images, while palm recognition payment requires color and infrared images) can be selected and used for liveness detection and comparison recognition.

[0024] Automatic Exposure (AE): A process that automatically adjusts the exposure based on the intensity of light to prevent over- or under-exposure.

[0025] Compared with facial recognition payments, palm recognition payments significantly reduce the psychological stress placed on sensitive areas of the face by collecting palmprints, reducing privacy concerns and providing a more stable payment experience. Compared with code scanning payments, palm recognition payments significantly simplify the payment process, providing a seamless payment experience for users and facilitating faster payments. Palm recognition payments offer a natural, unobtrusive, and ergonomic interaction. The collection of non-sensitive biometric information reduces users' psychological burden and privacy concerns, making them more readily accepted. In retail, palm recognition payments can replace 2D barcode payments, providing a faster payment experience for small payments. They can also support faster smart ticket gates in public transportation, and provide a convenient user experience for office use, such as custom domain entry recognition and time-stamping / check-in.

[0026] In palm authentication scenes, in order to form a clear image of the palm, it is necessary to control the focal plane of the camera so that it is basically positioned on the palm. At the same time, to facilitate palm authentication, the focal plane of the camera of the palm authentication device is usually set parallel to the ceiling panel. However, when the palm is extended to perform palm authentication, the original light beam is blocked and the ambient light changes significantly, making it difficult to collect a clear palmprint image and resulting in palm authentication failure.

[0027] In the related art, there are mainly two types of exposure methods. One is automatic exposure, which has a relatively long automatic exposure time, typically 200 to 400 ms. If automatic exposure is fully relied on in the palm recognition process, the relatively long exposure time will prevent users from experiencing a relatively good palm recognition experience. The other is fixed exposure, which eliminates the exposure adjustment time and improves the exposure speed compared to automatic exposure. However, its adaptability range and lighting scenarios are limited. For indoor scenarios, fixed exposure can achieve a good palm recognition experience when the distance between the palm and the palm recognition terminal is within 6 to 9 cm. However, it cannot adapt to the full range of 3 to 12 cm defined by the palm recognition terminal, and cannot adapt to outdoor scenarios with varying lighting.

[0028] The present application provides a photography control method, which, in response to an image collection command, sets a lighting device to a lighting mode and illuminates the palm, so that the palm can be clearly imaged under sufficient light, and after illuminating the palm, adjusts the fixed exposure to automatic exposure and photographs the palm, thereby collecting and obtaining a clear palm image and improving the success rate of palm authentication.

[0029] For ease of understanding, please refer to FIG. 1, which illustrates an embodiment of the present application. As shown in FIG. 1, the photographing control system of the present application includes a server and a terminal device. The server may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, a content delivery network (CDN), and big data and artificial intelligence platforms. The terminal may be, but is not limited to, a smartphone, a tablet PC, a laptop, a desktop computer, a smart speaker, a smart watch, etc. The server is used to verify a target object in a target photographed image. The terminal device is an image collection device used to collect images of the target object. The terminal and the server can be directly or indirectly connected via wired or wireless communication, and the present application is not limited thereto.

[0030] The image collection device first sets the operating mode of the lighting device to a lighting mode in response to an image collection command, where the lighting mode is used to indicate that the lighting device is in a highlight state, and under the highlight state, the brightness of the lighting device exceeds a predetermined brightness threshold; then, the image collection device adjusts the shooting mode of the camera to an auto-exposure mode; then, the image collection device performs image collection based on the auto-exposure mode to obtain M captured images, where M is an integer greater than or equal to 1; finally, the image collection device determines a target captured image from the M captured images, where the target captured image is a captured image whose image quality meets a predetermined image quality requirement.

[0031] For ease of understanding, please refer to Figure 2, which is an application environment diagram of the photography control method in the embodiment of the present application. As shown in Figure 2, the photography control method in the embodiment of the present application is applied to a photography control system. Figure 2 takes as an example the photography control method applied to a palm authentication payment scenario. The photography control system includes a payment system 100 and a store order receiving system 200.

[0032] The store order-taking system 200 may include an image collection device 200-1 and an order-taking device 200-2, where the image collection device 200-1 includes a camera, a lighting device, and a distance sensor. First, when the distance sensor (e.g., a PSensor sensor) in the image collection device 200-1 determines that a palm is approaching, it turns on the lighting mode of the lighting device to turn on a white light / infrared light to illuminate the palm, then adjusts the exposure mode from a fixed exposure mode to an automatic exposure mode, and photographs the palm under the automatic exposure mode. Finally, it selects a target image from the photographed images that can be used for identity recognition verification, thereby obtaining payment information and sending the payment information to the order-taking device 200-2. The order-taking device 200-2 generates order information based on the payment information and further sends the order information to the payment system 100. The payment system 100 can be regarded as the store's payment center. After receiving the order information, the order receiving device 200-2 checks the user's identification information and the target photographed image based on the user identifier in the order information, and withdraws the money if the check passes.

[0033] The following will introduce the photographing control method of the present application from the perspective of an image collection device. Referring to Fig. 3, the photographing control method provided by the embodiment of the present application is executed by an image collection device, where the image collection device includes a camera and a lighting device, and the photographing control method includes steps S110 to S140. Specifically, the steps are as follows:

[0034] S110: In response to an image acquisition command, the operation mode of the lighting fixture is set to a lighting mode.

[0035] Here, the lighting mode is used to indicate that the lighting device is in a highlight state, and under the highlight state, the fill light intensity of the lighting device exceeds a predetermined intensity threshold.

[0036] As can be understood, when the image collection conditions are not met, the operating mode of the lighting device is the breathing light mode, and the exposure mode is the fixed exposure mode. Here, the breathing light mode refers to the lighting device emitting green light and flashing brightness, with the green light gradually changing from bright to dark, imitating a breathing state. Under the breathing light mode, the brightness of the lighting device is relatively low, for example, below a predetermined brightness threshold. The fixed exposure mode refers to an exposure mode based on predetermined fixed exposure parameters (including a fixed exposure time and a fixed exposure gain (GAIN) value). The fixed exposure parameters can be determined based on exposure parameters corresponding to target images with relatively high quality acquired under the historical automatic exposure mode.

[0037] When the image collection conditions are met, an image collection command is generated, and in response to the image collection command, the image collection device adjusts the operating mode of the lighting device to an illumination mode, and illuminates the palm by setting the lighting device in the image collection device to a white light / infrared light highlight state, i.e., the lighting device can illuminate the palm with light rays having a relatively high brightness.

[0038] The image collection condition refers to a condition used to trigger image collection by an image collection device. For example, whether the image collection condition is met can be determined based on the relationship between the distance value between the target object and the camera collected by a distance sensor (e.g., a P-Sensor) in the image collection device and a distance threshold. For example, the distance threshold is 15 cm. When the distance value between the target object and the camera collected by the P-Sensor is less than 15 cm, it means that a palm is currently approaching or there is a possibility that a palm will approach, and in this case, it can be considered that the image collection condition is met.

[0039] S120: The photographing mode is adjusted to the automatic exposure mode.

[0040] As can be understood, when the image acquisition condition is not met, the exposure mode is the fixed exposure mode, and when the image acquisition condition is met, the fixed exposure mode needs to be adjusted to the automatic exposure mode. The fixed exposure parameters of the fixed exposure mode can be determined based on the historical exposure parameters.

[0041] The fixed exposure parameters can be obtained by a fixed exposure parameter adjustment model processing M sets of exposure parameters (each set of exposure parameters includes an exposure time and an exposure gain), where M is an integer greater than 1. Specifically, it is as follows:

[0042] If more than M photographing controls have been performed according to the method provided by the embodiment of the present application before performing the embodiment of the present application, and the M photographing controls are in the same region as the current photographing control or are performed using the same image acquisition device, obtain M sets of historical exposure parameters corresponding to the most recent M historical target photographing images (which correspond one-to-one to the M captured target photographing images), and then use the M sets of historical exposure parameters as inputs to a fixed exposure parameter adjustment model, which processes the M sets of historical exposure parameters to obtain fixed exposure parameters (including fixed exposure time and fixed exposure gain). The fixed exposure parameter adjustment model is used to generate fixed exposure parameters based on the M sets of historical exposure parameters and the recognition time of the target photographing images corresponding to the M sets of historical exposure parameters, and the difference value range between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode is smaller than a predetermined difference value range threshold, thereby reducing the adjustment time of the exposure parameters in the process of adjusting from the fixed exposure mode to the automatic exposure mode and improving the accuracy of the exposure parameters.

[0043] If, before performing the embodiment of the present application, M shooting control times or less have been performed based on the method provided by the embodiment of the present application, M training reference images are obtained, and the regional or environmental big data of the M training reference images are the same as or similar to the regional or environmental big data of the current shooting control. Then, the M training reference images are input to a picture exposure parameter analysis model, and the picture exposure parameter analysis model analyzes the M training reference images to obtain M sets of reference exposure parameters corresponding to the M training reference images. Then, the M sets of reference exposure parameters are input to a fixed exposure parameter adjustment model, and the fixed exposure parameter adjustment model processes the M sets of reference exposure parameters to obtain fixed exposure parameters (including fixed exposure time and fixed exposure gain). The fixed exposure parameter adjustment model is used to generate fixed exposure parameters based on the M sets of reference exposure parameters, and the difference value range between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode is smaller than a predetermined difference value range threshold, thereby reducing the exposure parameter adjustment time during the process of adjusting from the fixed exposure mode to the automatic exposure mode and improving the accuracy of the exposure parameters.

[0044] It can be understood that the exposure parameter adjustment time can be reduced by the difference value range between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode being smaller than the predetermined difference value range threshold, because when the difference value range between the fixed exposure parameters and the automatic exposure parameters corresponding to the automatic exposure mode is smaller than the predetermined difference value range threshold, the convergence time required to adjust from the fixed exposure mode to the automatic exposure mode is short. To explain by taking an example, to adjust from the fixed exposure mode to the automatic exposure mode, first determine the brightness of the fixed exposure mode to be 800 based on the exposure parameters corresponding to the target photographed image of relatively high quality acquired under the automatic exposure mode in the history, and then calculate the exposure time based on the target brightness / light illumination brightness to obtain the exposure time=1000 / 800=1.25 (ms). If a user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 9 cm, set the operating mode of the lighting device to illumination mode, turn on white light supplementary lighting, and collect images. Based on the calculation of image brightness = exposure time × supplementary lighting intensity, the image brightness of this frame = 1.25 (ms) × 750 (white light supplementary lighting intensity when the distance between the palm and the image collection device is 9 cm) = 937.5 can be obtained. In this situation, the exposure process needs to adjust from 937.5 to the target brightness of 1000, and the exposure adjustment value is 1000 - 937.5 = 62.5. As can be seen, the exposure adjustment value is relatively small, and accordingly, the exposure time required to capture an image that meets the target brightness is relatively short, and the convergence speed is relatively fast.

[0045] S130: The camera is controlled to collect images based on the automatic exposure mode, and M captured images are obtained.

[0046] where M is an integer greater than or equal to 1.

[0047] As can be seen, by taking continuous photographs based on the automatic exposure mode, M photographed images can be obtained by taking continuous photographs.

[0048] S140: A target photographed image is determined from among the M photographed images.

[0049] Here, the target captured image is an image whose image quality satisfies a predetermined image quality requirement, and may be, for example, an image of the M captured images whose resolution is higher than a predetermined resolution.

[0050] For example, the photographing control method provided in the embodiments of the present application can be used in two situations: one is when the image acquisition conditions are not met, and the other is when the image acquisition conditions are met.

[0051] First, a scene that does not satisfy the image collection conditions will be described. Automatic exposure parameters corresponding to target captured images when palm authentication was successful for the most recent 1,000 attempts are acquired. The automatic exposure parameters corresponding to target captured images when palm authentication was successful for the most recent 1,000 attempts are historical exposure parameters that are stored in a historical exposure parameter database. Fixed exposure parameters are determined based on the historical exposure parameters for the most recent 1,000 attempts. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value. The average value of the exposure times for the most recent 1,000 attempts may be used as the fixed exposure time of the fixed exposure parameters, or the average value of the exposure gain (GAIN) values ​​for the most recent 1,000 attempts may be used as the exposure gain (GAIN) value of the fixed exposure parameters. Alternatively, the median value of the exposure times for the most recent 1,000 attempts may be used as the fixed exposure time of the fixed exposure parameters, or the median value of the exposure gain (GAIN) values ​​for the most recent 1,000 attempts may be used as the exposure gain (GAIN) value of the fixed exposure parameters.

[0052] When the image collection conditions are not met, the operating mode of the lighting fixture is the breathing light mode, i.e., the lighting fixture emits green light and the brightness is in a flashing state, and the green light gradually changes from bright to dark, imitating the facial breathing state.

[0053] Next, a scenario that satisfies the image collection condition will be described. Experience has shown that the distance between the palm and the image collection device is typically 5 cm to 12 cm during palm authentication, and the distance threshold is set to 15 cm based on experience. The distance between the palm and the image collection device is determined based on the detection result of the distance sensor. If the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the device responds to an image collection command. If the distance between the palm and the image collection device is greater than or equal to the distance threshold of 15 cm, the device does not respond to the image collection command. Preferably, four P-Sensor sensors are installed in the image collection device, and if one of the P-Sensor sensors detects that the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the device responds to an image collection command.

[0054] If the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the operation mode of the lighting device is converted from breathing light mode to lighting mode in response to an image collection command, that is, the lighting device in the image collection device is turned to a white light / infrared light highlight state to illuminate the palm, and after illuminating the palm, the photography mode is adjusted from fixed exposure mode to automatic exposure mode. Continuously photographing the palm based on the automatic exposure mode to obtain M photographed images, and from the M photographed images, a photographed image whose image quality meets a predetermined image quality requirement is selected as a target photographed image, and finally, palmprint recognition and checking are performed on the target photographed image.

[0055] The present application provides a photography control method, which, when responding to an image collection command, sets a lighting device to a lighting mode to illuminate a target object, so that the target object can be clearly imaged under sufficient light, and adjusts the exposure mode of a camera from fixed exposure to automatic exposure to make the captured image of the target object clearer, thereby improving the success rate of checking the target object.

[0056] In the related art, there are two types of exposure methods. One is automatic exposure, which requires a relatively long automatic exposure time, typically 200 to 400 ms. Relying entirely on automatic exposure in the palm recognition process requires a relatively long exposure time, which fails to provide users with a relatively good palm recognition experience. The other is fixed exposure, which eliminates the exposure adjustment time and improves exposure speed compared to automatic exposure. However, its adaptable range and lighting scene are relatively narrow. For indoor scenes, it can provide a relatively good palm recognition experience when the distance between the palm and the palm recognition terminal is within 6 to 9 cm, but it cannot adapt to the full range of 3 to 12 cm defined by the palm recognition terminal, and it cannot adapt to outdoor scenes with changing lighting.

[0057] In order to enable the palm recognition terminal to expose within the entire range of 3-12 cm defined, and shorten the exposure time, and provide users with a better palm recognition experience, in one alternative embodiment of the photographing control method provided by the embodiment corresponding to Fig. 3 of the present application, referring to Fig. 4, step S120 further includes sub-step S121, which is specifically as follows:

[0058] S121: The fixed exposure mode is adjusted to the automatic exposure mode.

[0059] Here, the fixed exposure parameter values ​​corresponding to the fixed exposure mode are determined based on the historical exposure parameters.

[0060] As can be seen, when the difference between the fixed exposure parameters in the fixed exposure mode and the target exposure parameters in the automatic exposure mode is relatively small, the exposure time can be significantly reduced, and therefore, setting a reasonable fixed exposure parameter plays an important role in reducing the exposure time, which is determined based on the exposure parameters corresponding to the target photographed images of relatively high quality acquired under the automatic exposure mode in the past.

[0061] To illustrate, in an indoor scene, assume that the average light intensity in the room is 100, the lighting fixture in the image acquisition device is operating under illumination mode, the light intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target luminance is 1000.

[0062] When the automatic exposure mode is used directly, the calculation is based on the exposure time = target brightness / average light intensity in the room, resulting in an exposure time = 1000 / 100 = 10 (ms). When a user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 7 cm, image collection is performed directly, and the calculation is based on the image brightness = exposure time × supplementary lighting intensity, resulting in the image brightness of this frame = 10 (ms) × 800 = 8000. In this situation, the exposure process needs to adjust the brightness from 8000 to the target brightness of 1000, and the exposure adjustment value is 8000 - 1000 = 7000. Because the exposure adjustment value is relatively large, the exposure time required to capture an image that meets the target brightness is relatively long, and the convergence speed is relatively slow.

[0063] Using the method of step S121 in the embodiment of the present application, i.e., adjusting the exposure mode of the camera from fixed exposure mode to automatic exposure mode, first determine the brightness of fixed exposure mode to be 800 based on the exposure parameters corresponding to the target image of relatively high quality acquired under automatic exposure mode in the history, and calculate the exposure time based on target brightness / light illumination brightness, resulting in exposure time = 1000 / 800 = 1.25 (ms). If the user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 9 cm, set the operating mode of the lighting device to illumination mode, turn on white light supplementary lighting, and perform image collection. Then, calculate the image brightness based on exposure time × supplementary lighting intensity, resulting in image brightness of this frame = 1.25 (ms) × 750 (white light supplementary lighting intensity when the distance between the palm and the image collection device is 9 cm) = 937.5. In this situation, the exposure process needs to adjust from 937.5 to the target brightness of 1000, and the exposure adjustment value is 1000-937.5=62.5. Because the exposure adjustment value is relatively small, the exposure time required to capture an image that meets the target brightness is relatively short, and the convergence speed is relatively fast.

[0064] The present application provides a photography control method, which sets a fixed exposure mode based on fixed exposure parameters determined by exposure parameters corresponding to target photography images of relatively high quality acquired under the historical automatic exposure mode, and adjusts the fixed exposure mode to the automatic exposure mode when the image collection conditions are met, reducing the exposure adjustment value, thereby achieving a relatively short exposure time and a relatively fast convergence speed.

[0065] In one alternative embodiment of the shooting control method provided by the embodiment corresponding to Fig. 4 of the present application, referring to Fig. 5, steps S150 to S160 are further included after step S140. Specifically, the steps are as follows:

[0066] S150: Obtain exposure parameter values ​​corresponding to the target photographed image.

[0067] S160: The exposure parameter values ​​corresponding to the target captured image are stored in a historical exposure parameter database.

[0068] Here, the historical exposure parameters in the historical exposure parameter database are used to adjust the fixed exposure parameter values.

[0069] It can be understood that when the difference between the fixed exposure parameters in the fixed exposure mode and the target exposure parameters in the automatic exposure mode is relatively small, the exposure time can be significantly reduced, and therefore, setting a reasonable fixed exposure parameter is extremely important for reducing the exposure time. Since the fixed exposure parameter is determined based on the exposure parameters corresponding to the target photographed image of relatively high quality acquired under the automatic exposure mode in the past, it is necessary to store the exposure parameter value corresponding to the target photographed image for subsequent use in adjusting the fixed exposure parameter value.

[0070] To explain using an example, it is possible to obtain automatic exposure parameters corresponding to target captured images that were dependent on when the most recent 1,000 palm authentications were successful, and the automatic exposure parameters corresponding to target captured images that were dependent on when the most recent 1,000 palm authentications were successful are historical exposure parameters that are stored in a historical exposure parameter database, and fixed exposure parameters are determined based on the most recent 1,000 historical exposure parameters. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value, and the average value of the most recent 1,000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the average value of the most recent 1,000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters, or the median value of the most recent 1,000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the median value of the most recent 1,000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters.

[0071] The present application provides a photography control method, which stores exposure parameter values ​​corresponding to target photography images with relatively high quality, and then adjusts the fixed exposure parameter values, thereby reducing the exposure adjustment value between the fixed exposure parameter values ​​and the target exposure parameters corresponding to the automatic exposure mode, thereby shortening the exposure time and laying the foundation for improving the convergence speed of the exposure parameters.

[0072] In one alternative embodiment of the photographing control method provided by the embodiment corresponding to Fig. 3 of the present application, the image collection device further includes a distance sensor. Referring to Fig. 6, step S110 further includes sub-steps S111 to S112. Specifically, the steps are as follows.

[0073] S111: Based on the detection result of the distance sensor, the distance value between the target object and the camera is determined.

[0074] As can be understood, the distance sensor in the embodiment of the present application may be a P-Sensor sensor, which senses the distance between the image collection device and the palm of the hand, thereby enabling the determination of whether to respond to an image collection command.

[0075] S112: If the distance value between the target object and the camera is less than the distance threshold, respond to an image capture command.

[0076] As can be appreciated, a distance threshold is empirically set and an image capture command is responded to when the distance value between the target object and the camera is less than the distance threshold.

[0077] To explain this by way of example, it is known from experience that the distance between the palm and the image collection device during palm authentication is usually 5 cm to 12 cm, and the distance threshold is set to 15 cm based on experience. The distance between the palm and the image collection device is obtained based on the detection result of the distance sensor, and if the distance between the palm and the image collection device is less than the distance threshold of 15 cm, an image collection command is responded to. Preferably, four P-Sensor sensors are installed in the image collection device, and if one of the P-Sensor sensors detects that the distance between the palm and the image collection device is less than the distance threshold of 15 cm, an image collection command is responded to.

[0078] If the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the operation mode of the lighting device is converted from breathing light mode to lighting mode in response to an image collection command, that is, the lighting device in the image collection device is turned on to a white light / infrared light highlight state to illuminate the palm, and after illuminating the palm, the exposure mode is adjusted from fixed exposure mode to automatic exposure mode. Continuously photographing the palm in the automatic exposure mode to obtain M photographed images, and from the M photographed images, a photographed image whose image quality meets a predetermined image quality requirement is selected as a target photographed image, and finally, palmprint recognition and checking are performed on the target photographed image.

[0079] The present application provides a photography control method, which determines whether to respond to an image collection command by comparing the distance value between the target object and the camera obtained based on the detection result of the distance sensor with a distance threshold, and reduces the exposure adjustment value, laying the foundation for achieving a relatively short exposure time and a relatively fast convergence speed.

[0080] In one alternative embodiment of the shooting control method provided by the embodiment corresponding to Fig. 6 of the present application, referring to Fig. 7, sub-step S112 is followed by sub-step S113, which is specifically as follows:

[0081] S113: If the distance value between the target object and the camera is greater than or equal to the distance threshold, control the photographing mode to a fixed exposure mode.

[0082] As can be understood, a distance threshold is set based on experience, and when the distance value between the target object and the camera is greater than or equal to the distance threshold, the shooting mode is set to fixed exposure mode. When the distance value between the target object and the camera is greater than or equal to the distance threshold, it can be understood that palm authentication is not performed.

[0083] Experience has shown that the distance between the palm and the image collection device during palm authentication is typically 5 cm to 12 cm, and the distance threshold is empirically set to 15 cm. The distance between the palm and the image collection device is obtained based on the detection result of the distance sensor, and if the distance between the palm and the image collection device is greater than or equal to the distance threshold of 15 cm, the image collection device does not respond to the image collection command. Preferably, four P-Sensors are installed in the image collection device, and if none of the four P-Sensors detects that the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the image collection command is not responded to and the shooting mode continues to be fixed exposure mode.

[0084] The present application provides a photography control method, which determines whether to respond to an image collection command by comparing the distance value between the target object and the camera obtained based on the detection result of the distance sensor with a distance threshold, and reduces the exposure adjustment value, laying the foundation for achieving a relatively short exposure time and a relatively fast convergence speed.

[0085] In one alternative embodiment of the shooting control method provided by the embodiment corresponding to Fig. 7 of the present application, with reference to Fig. 8, step S113 further includes sub-steps S1131 to S1132. Specifically, the steps are as follows:

[0086] S1131: Fixed exposure parameter values ​​are obtained.

[0087] As can be understood, the fixed exposure parameter value is calculated in advance, and the fixed exposure parameter value can be calculated based on the auto-exposure parameters corresponding to the target captured images that were dependent on the last 1000 successful palm authentication attempts. Specifically, the auto-exposure parameters corresponding to the target captured images that were dependent on the last 1000 successful palm authentication attempts are obtained, and the auto-exposure parameters corresponding to the target captured images that were dependent on the last 1000 successful palm authentication attempts are historical exposure parameters, which are stored in the historical exposure parameter database and are used to calculate the fixed exposure parameter value. The fixed exposure parameters are determined based on 1000 historical exposure parameters, specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value, and the average value of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the average value of the most recent 1000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters, or the median value of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the median value of the most recent 1000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters. The difference between the fixed exposure parameter value and the target exposure parameter value is relatively small.

[0088] S1132: The photographing mode is controlled to the fixed exposure mode based on the fixed exposure parameter value.

[0089] As can be understood, the shooting mode is controlled to the fixed exposure mode based on the fixed exposure parameter value, and in a scene that does not satisfy the image collection conditions, the shooting mode is set to the fixed exposure mode by default. A scene that does not satisfy the image collection conditions refers to a scene where, as can be seen from experience, the distance between the palm and the image collection device during palm authentication is usually between 5 cm and 12 cm, and the distance threshold is set to 15 cm based on experience. The distance between the palm and the image collection device is obtained based on the detection result of the distance sensor. If the distance between the palm and the image collection device is greater than or equal to the distance threshold of 15 cm, the scene does not satisfy the image collection conditions.

[0090] The present application provides an imaging control method, in which, in a scene that does not satisfy image collection conditions, the imaging mode is controlled to a fixed exposure mode based on a fixed exposure parameter value, and the fixed exposure parameter value corresponding to the fixed exposure mode can be determined based on a historical exposure parameter value, and the difference value between the fixed exposure parameter value and the target exposure parameter value is relatively small, which is advantageous for shortening the exposure time and relatively accelerating the convergence speed.

[0091] In one alternative embodiment of the shooting control method provided by the embodiment corresponding to Fig. 8 of the present application, with reference to Fig. 9, sub-step S1131 further includes sub-steps S11311 to S11312. Specifically, the steps are as follows:

[0092] S11311: N historical exposure parameters are obtained.

[0093] Here, the historical exposure parameters may be exposure parameters corresponding to a captured image whose image quality satisfies a predetermined image quality requirement, for example, exposure parameters corresponding to a captured image whose resolution satisfies a predetermined resolution, and N is an integer greater than or equal to 1, and N may be equal to 1000, for example.

[0094] S11312: Calculate and obtain a fixed exposure parameter value based on the N historical exposure parameters.

[0095] As can be understood, it is possible to obtain automatic exposure parameters corresponding to the target captured image dependent on when the most recent 1000 palm authentications were successful, and the automatic exposure parameters corresponding to the target captured image dependent on when the most recent 1000 palm authentications were successful are historical exposure parameters that are stored in a historical exposure parameter database, and fixed exposure parameters are determined based on the most recent 1000 historical exposure parameters. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value, and the average value of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the average value of the most recent 1000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters, or the median of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the median of the most recent 1000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters.

[0096] The present application provides a photography control method, which calculates and obtains fixed exposure parameter values ​​based on automatic exposure parameters corresponding to target photographed images that depend on the most recent 1,000 successful palm authentication attempts, and achieves a relatively small difference between the fixed exposure parameter values ​​and the target exposure parameter values ​​corresponding to the automatic exposure mode, i.e., a relatively small exposure adjustment value, a relatively short exposure time, and a relatively fast convergence speed.

[0097] In one optional embodiment of the shooting control method provided by the embodiment corresponding to Fig. 9 of the present application, referring to Fig. 10, substep S11311 further includes substep S113110, and substep S11312 further includes S113120. Specifically, it is as follows:

[0098] S113110: N exposure times and N exposure gain values ​​corresponding to N captured images are obtained.

[0099] S113120: A fixed exposure time is calculated based on the N exposure times, and a fixed exposure gain value is calculated based on the N exposure gain values.

[0100] As can be understood, automatic exposure parameters corresponding to the target captured image on which the most recent 1000 successful palm authentications were relied upon are obtained, and the automatic exposure parameters corresponding to the target captured image on which the most recent 1000 successful palm authentications were relied upon are historical exposure parameters that are stored in a historical exposure parameter database. Fixed exposure parameters are determined based on the most recent 1000 historical exposure parameters. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value, and the average value of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the average value of the most recent 1000 exposure gain (GAIN) values ​​may be used as the fixed exposure gain (GAIN) value of the fixed exposure parameters. Alternatively, the median of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the median of the most recent 1000 exposure gain (GAIN) values ​​may be used as the fixed exposure gain (GAIN) value of the fixed exposure parameters.

[0101] The present application provides a photography control method, which determines a fixed exposure time and a fixed exposure gain value for a fixed exposure parameter value according to the exposure time and exposure gain value corresponding to the target photographed image depending on the most recent 1,000 successful palm authentications, thereby making the difference between the fixed exposure parameter value and the target exposure parameter value relatively small, i.e., realizing a relatively small exposure adjustment value, a relatively short exposure time, and a relatively fast convergence speed.

[0102] In one alternative embodiment of the shooting control method provided by the embodiment corresponding to Fig. 7 of the present application, referring to Fig. 11, step S1132 is followed by step S1133. Specifically, the method is as follows:

[0103] S1133: Set the operation mode of the lighting fixture to breathing light mode.

[0104] As can be seen, under a scene that does not meet the image collection conditions, the operating mode of the lighting fixture is a breathing light mode, i.e., the lighting fixture emits green light and the brightness is in a flashing state, and the green light gradually changes from bright to dark, imitating human breathing.

[0105] When the image collection conditions are met, the operating mode of the lighting device is converted from breathing light mode to lighting mode, i.e., the lighting device in the image collection device is set to a white light / infrared light highlight state to illuminate the palm and then take a photo.

[0106] This application provides a photography control method for setting the operating mode of a lighting device to a breathing light mode when the scene does not meet the image capture conditions, and the breathing light setting indicates that the image capture device is in an operating state, and is distinguished from the lighting effect when the lighting device operates in lighting mode.

[0107] In one alternative embodiment of the shooting control method provided by the embodiment corresponding to Fig. 3 of the present application, with reference to Fig. 12, step S130 includes sub-steps S131 to S135. Specifically, the steps are as follows:

[0108] S131: The current exposure amount and the current ambient brightness are acquired.

[0109] S132: A target exposure is determined based on the current exposure and the current ambient brightness.

[0110] S133: Determine an exposure adjustment value based on the current exposure amount and the target exposure amount.

[0111] S134: Based on the exposure adjustment value, the current exposure amount is adjusted to the target exposure amount.

[0112] S135: Images are collected based on the target exposure.

[0113] As can be understood, after determining the target exposure amount based on the current exposure amount and the current environmental brightness, when performing automatic exposure adjustment, the difference value between the target exposure amount and the current exposure amount is determined as the adjustment step value, thereby directly adjusting the current exposure amount to the target exposure amount, thereby realizing one-step exposure and thereby shortening the exposure time.

[0114] To illustrate, in an indoor scene, assume that the average light intensity in the room is 100, the lighting fixture in the image acquisition device is operating under illumination mode, the light intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target luminance is 1000.

[0115] When the automatic exposure mode is used directly, the calculation is based on the exposure time = target brightness / average light intensity in the room, resulting in an exposure time = 1000 / 100 = 10 (ms). When a user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 7 cm, image collection is performed directly, and the calculation is based on the image brightness = exposure time × supplementary lighting intensity, resulting in the image brightness of this frame = 10 (ms) × 800 = 8000. In this situation, the exposure process needs to adjust the brightness from 8000 to the target brightness of 1000, and the exposure adjustment value is 8000 - 1000 = 7000. Because the exposure adjustment value is relatively large, the exposure time required to capture an image that meets the target brightness is relatively long, and the convergence speed is relatively slow.

[0116] Using the method of the present embodiment, that is, when adjusting from fixed exposure mode to automatic exposure mode under a scene that meets the image collection conditions, first, based on the exposure parameters corresponding to the target image of relatively high quality acquired under automatic exposure mode in the history, the brightness of the fixed exposure mode is determined to be 800, and the exposure time is calculated based on target brightness / light illumination brightness, resulting in exposure time = 1000 / 800 = 1.25 (ms). When the user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 9 cm, the operating mode of the lighting device is set to illumination mode, white light supplemental lighting is turned on, and image collection is performed. The image brightness is calculated based on exposure time × supplemental lighting intensity, resulting in image brightness of this frame = 1.25 (ms) × 750 (white light supplemental lighting intensity when the distance between the palm and the image collection device is 9 cm) = 937.5. In this situation, the exposure process needs to adjust from 937.5 to the target brightness of 1000, and the exposure adjustment value is 1000-937.5=62.5. Because the exposure adjustment value is relatively small, the exposure time required to capture an image that meets the target brightness is relatively short, and the convergence speed is relatively fast.

[0117] In an outdoor scene, assuming that the average light intensity outdoors is 1000, the lighting fixture in the image acquisition device operates under illumination mode, the light intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target luminance is 1000.

[0118] Using the method of the embodiment of the present application, that is, under a scene that meets the image collection conditions, the fixed exposure mode is adjusted to the automatic exposure mode. First, based on the exposure parameters corresponding to the target image of relatively high quality acquired under the automatic exposure mode in the history, the brightness of the fixed exposure mode is determined to be 800. The exposure time is calculated based on the target brightness / light illumination brightness, resulting in the exposure time = 1000 / 800 = 1.25 (ms). When the user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 9 cm, the operating mode of the lighting device is set to the illumination mode, white light supplementary lighting is turned on, and image collection is performed. The image brightness is calculated based on the exposure time × supplementary lighting intensity, resulting in the brightness of the image of this frame = 1.25 (ms) × 1000 (the average outdoor light intensity is 1000) = 1250. In this situation, the exposure process needs to be adjusted from 1250 to the target brightness of 1000, and the exposure adjustment value is 1250-1000=250. Because the exposure adjustment value is relatively small, the exposure time required to capture an image that meets the target brightness is relatively short, and the convergence speed is relatively fast.

[0119] The present application provides a shooting control method, which determines a target exposure amount based on the current ambient brightness and the current exposure amount, calculates an exposure adjustment value based on the target exposure amount, and reduces the exposure adjustment value, thereby achieving a relatively short exposure time and a relatively fast convergence speed.

[0120] In one alternative embodiment of the shooting control method provided by the embodiment corresponding to Fig. 3 of the present application, with reference to Fig. 13, step S140 includes sub-steps S141 to S142. Specifically, the steps are as follows:

[0121] S141: M resolution values ​​corresponding to M captured images are obtained.

[0122] S142: Based on the M resolution values, a photographed image having a resolution value higher than a predetermined resolution is determined as a target photographed image from among the M photographed images.

[0123] As can be understood, based on the resolution of continuously captured images, a captured image having a resolution value greater than a predetermined resolution can be selected as a target captured image; if there are multiple captured images having a resolution value greater than the predetermined resolution, the captured image with the highest resolution is selected as the target captured image; if there are no captured images having a resolution value greater than the predetermined resolution, a capture failure is returned and a request is made to recapture.

[0124] The present application provides a shooting control method for selecting a target shooting image based on the shooting resolution of the image, improving the accuracy of determining the target shooting image, and adjusting the fixed exposure parameter values ​​corresponding to the fixed exposure mode according to the exposure parameter values ​​of the target shooting image, laying the foundation for shortening the exposure time and improving the convergence speed.

[0125] For ease of understanding, the following will introduce the photography control method applied to the palm authentication scene in combination with Figure 14. The photography control method applied to the palm authentication scene includes four steps, specifically as follows:

[0126] Step 1: The P-Sensor determines whether a palm is approaching.

[0127] Experience has shown that the distance between the palm and the image collection device during palm authentication is typically between 5 cm and 12 cm, and the distance threshold is set to 15 cm based on experience. The distance between the palm and the image collection device is obtained based on the detection result of the distance sensor. If the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the image collection command is responded to. If the distance between the palm and the image collection device is greater than or equal to the distance threshold of 15 cm, the image collection command is not responded to. Preferably, the image collection device is equipped with four P-Sensor sensors, and if one of the P-Sensor sensors detects that the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the image collection command is responded to. Preferably, when the distance between the palm and the image collection device is equal to 12 cm, the success rate of palm authentication can be improved. Therefore, setting 12 cm as the optimal distance value for palm authentication provides a better palm authentication experience.

[0128] Step 2: When the palm is not close to the image acquisition device, the photographing mode is the fixed exposure mode.

[0129] That is, under the scene that does not respond to the image acquisition command, the photographing mode can be maintained in the fixed exposure mode. The fixed exposure parameter value corresponding to the fixed exposure mode can be determined in the following manner.

[0130] Automatic exposure parameters corresponding to the target captured image on which the most recent 1000 successful palm authentication attempts were based are obtained, and the automatic exposure parameters corresponding to the target captured image on which the most recent 1000 successful palm authentication attempts were based are historical exposure parameters that are stored in a historical exposure parameter database. Fixed exposure parameters are determined based on the most recent 1000 historical exposure parameters. Specifically, the historical exposure parameters include exposure time and exposure gain (GAIN) value. The average value of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the average value of the most recent 1000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters. Alternatively, the median of the most recent 1000 exposure times may be used as the fixed exposure time of the fixed exposure parameters, or the median of the most recent 1000 exposure gain (GAIN) values ​​may be used as the exposure gain (GAIN) value of the fixed exposure parameters.

[0131] In addition, when the image collection conditions are not met, the operating mode of the lighting device is the breathing light mode, i.e., the lighting device emits green light and the brightness is in a flashing state, and the green light gradually changes from bright to dark, imitating the human breathing state.

[0132] Step 3: When the palm of the hand approaches the image acquisition device, the photographing mode is the auto-exposure mode.

[0133] That is, the photographing mode can be adjusted from a fixed exposure mode to an automatic exposure mode under the scene in response to an image acquisition command.

[0134] If the distance between the palm and the image collection device is less than the distance threshold of 15 cm, the operation mode of the lighting device is converted from breathing light mode to lighting mode in response to an image collection command, that is, the lighting device in the image collection device is turned to a white light / infrared light highlight state to illuminate the palm, and after illuminating the palm, the photography mode is adjusted from fixed exposure mode to automatic exposure mode. Based on the automatic exposure mode, continuous photography of the palm is performed to obtain M photographs, and from the M photographs, a photograph with a resolution higher than a predetermined resolution is selected as a target photograph, and finally, palmprint recognition and checking are performed on the target photograph.

[0135] Please refer to Figure 15, which is an exposure timing diagram. To ensure a high success rate, the first frame captured by the image capture device must be an image with lighting and a fixed AE based on experience by adjusting the capture mode to automatic exposure mode after illuminating the palm. This enables rapid AE for palm recognition. If the first frame captured by the image capture device does not match the lighting, the lack of lighting for the first frame provided to the automatic AE of the image capture device will invalidate the first frame AE of the image capture device, resulting in a long AE convergence process and slowing down the speed of palm recognition.

[0136] Step 4: The exposure parameter values ​​corresponding to the target photographed image that has been successfully recognized this time are stored in the historical exposure parameter database.

[0137] When the difference between the fixed exposure parameters in the fixed exposure mode and the target exposure parameters in the automatic exposure mode is relatively small, the exposure time can be significantly reduced. Therefore, setting a reasonable fixed exposure parameter is extremely important for reducing the exposure time. The fixed exposure parameter is determined based on the exposure parameters corresponding to the target photographed image of relatively high quality acquired under the automatic exposure mode in the past, so that the exposure parameter value corresponding to the target photographed image needs to be stored for subsequent use in adjusting the fixed exposure parameter value.

[0138] To illustrate, in an indoor scene, assume that the average light intensity in the room is 100, the lighting fixture in the image acquisition device is operating under illumination mode, the light intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target luminance is 1000.

[0139] When the automatic exposure mode is used directly, the calculation is based on the exposure time = target brightness / average light intensity in the room, resulting in an exposure time = 1000 / 100 = 10 (ms). When a user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 7 cm, image collection is performed directly, and the calculation is based on the image brightness = exposure time × supplementary lighting intensity, resulting in the image brightness of this frame = 10 (ms) × 800 = 8000. In this situation, the exposure process needs to adjust the brightness from 8000 to the target brightness of 1000, and the exposure adjustment value is 8000 - 1000 = 7000. Because the exposure adjustment value is relatively large, the exposure time required to capture an image that meets the target brightness is relatively long, and the convergence speed is relatively slow.

[0140] When the method of the present embodiment is used, that is, when adjusting from the fixed exposure mode to the automatic exposure mode, the brightness of the fixed exposure mode is first determined to be 800 based on the exposure parameters corresponding to the target image successfully captured under the automatic exposure mode in the history, and the exposure time is calculated based on the target brightness / light illumination brightness, resulting in the exposure time = 1000 / 800 = 1.25 (ms). When the user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 9 cm, the operating mode of the lighting device is set to the illumination mode, white light supplemental lighting is turned on, and image collection is performed. The image brightness is calculated based on the exposure time × supplemental lighting intensity, resulting in the brightness of the image of this frame = 1.25 (ms) × 750 (white light supplemental lighting intensity when the distance between the palm and the image collection device is 9 cm) = 937.5. In this situation, the exposure process needs to adjust from 937.5 to the target brightness of 1000, and the exposure adjustment value is 1000-937.5=62.5. Because the exposure adjustment value is relatively small, the exposure time required to capture an image that meets the target brightness is relatively short, and the convergence speed is relatively fast.

[0141] In an outdoor scene, assuming that the average light intensity outdoors is 1000, the lighting fixture in the image acquisition device operates under illumination mode, the light intensity of the white light fill light at a distance of 7 cm from the image acquisition device is 800, and the target luminance is 1000.

[0142] Using the method of the present embodiment, that is, adjusting the fixed exposure mode to the automatic exposure mode, first determine the brightness of the fixed exposure mode to be 800 based on the exposure parameters corresponding to the target image successfully captured under the automatic exposure mode in the history, and calculate the exposure time based on the target brightness / light illumination brightness, resulting in the exposure time = 1000 / 800 = 1.25 (ms). When the user performs palm authentication, meets the image collection conditions, and the distance between the palm and the image collection device is 9 cm, set the operating mode of the lighting device to the illumination mode, turn on the white light supplement, and collect images. Then, calculate the image brightness based on the exposure time × supplemental lighting intensity, resulting in the image brightness of this frame = 1.25 (ms) × 1000 (the average outdoor light intensity is 1000) = 1250. In this situation, the exposure process needs to be adjusted from 1250 to the target brightness of 1000, and the exposure adjustment value is 1250-1000=250. Because the exposure adjustment value is relatively small, the exposure time required to capture an image that meets the target brightness is relatively short, and the convergence speed is relatively fast.

[0143] The present application provides a photography control method, which, when responding to an image collection command, sets a lighting device to a lighting mode to illuminate a target object, thereby allowing the target object to be clearly imaged under sufficient light; after illuminating the target object, adjusts the fixed exposure to automatic exposure for photography, allowing the collected image of the target object to be clearly imaged, thereby improving the success rate of target object detection; sets the fixed exposure mode based on fixed exposure parameters determined by exposure parameters corresponding to relatively high-quality target photography images acquired under the automatic exposure mode in history; and, when image collection conditions are met, adjusts the fixed exposure mode to the automatic exposure mode and reduces the exposure adjustment value, thereby achieving a relatively short exposure time and a relatively fast convergence speed.

[0144] The photographing control device of the present application will be described in detail below with reference to Fig. 16. Fig. 16 is a schematic diagram of one embodiment of the photographing control device 10 of the present application, which includes an image acquisition command response module 110, an automatic exposure mode adjustment module 120, a photographing module 130, and a target photographing image determination module 140. Specifically, the photographing control device 10 is as follows.

[0145] The image capture command response module 110 is used to turn on the illumination mode in response to an image capture command.

[0146] Here, the lighting mode is used to indicate that the lighting device is in a highlight state, and under the highlight state, the fill light intensity of the lighting device exceeds a predetermined intensity threshold.

[0147] The automatic exposure mode adjustment module 120 is used to adjust the photographing mode to the automatic exposure mode.

[0148] The photographing module 130 is used to control the camera to collect images based on the automatic exposure mode, and obtain M photographed images.

[0149] where M is an integer greater than or equal to 1.

[0150] The target photographed image determination module 140 is used to determine a target photographed image from among the M photographed images.

[0151] Here, the target captured image is a captured image whose image quality satisfies a predetermined image quality requirement.

[0152] The present application provides a photography control device, which, when responding to an image collection command, sets a lighting device to a lighting mode and illuminates a target object, so that the target object can be clearly imaged under sufficient light, and after illuminating the target object, adjusts the fixed exposure mode to an automatic exposure mode for photography, so that the collected image of the target object can be clearly imaged, thereby improving the success rate of checking the target object.

[0153] In one alternative embodiment of the photographing control device provided by the embodiment corresponding to FIG. 16 of the present application, the automatic exposure mode adjustment module 120 specifically: It is used to adjust the fixed exposure mode to the automatic exposure mode, where the fixed exposure parameter values ​​corresponding to the fixed exposure mode are determined based on the historical exposure parameters.

[0154] In one alternative embodiment of the shooting control device provided by the embodiment corresponding to Figure 16 of the present application, referring to Figure 17, the shooting control device 10 further includes an exposure parameter value storage module 150, which is used for the following:

[0155] The exposure parameter values ​​corresponding to the target captured image are obtained.

[0156] Exposure parameter values ​​corresponding to the target captured images are stored in a historical exposure parameter database.

[0157] Here, the historical exposure parameters in the historical exposure parameter database are used to adjust the fixed exposure parameter values.

[0158] In one optional embodiment of the shooting control device provided by the embodiment corresponding to Figure 16 of the present application, referring to Figure 18, the shooting control device 10 further includes a distance detection module 160 and an image collection command generation module 170, and specifically, is as follows.

[0159] The distance detection module 160 is used to determine the distance value between the target object and the camera based on the detection result of the distance sensor.

[0160] The image capture command generation module 170 is used to generate an image capture command if the distance value between the target object and the camera is less than the distance threshold.

[0161] In one alternative embodiment of the shooting control device provided by the embodiment corresponding to Fig. 16 of the present application, referring to Fig. 19, the shooting control device 10 further includes a fixed exposure mode adjustment module 180. Specifically, it is as follows:

[0162] The fixed exposure mode adjustment module 180 is used to control the shooting mode to the fixed exposure mode if the distance value between the target object and the camera is greater than or equal to the distance threshold.

[0163] In one alternative embodiment of the shooting control device provided by the embodiment corresponding to FIG. 19 of the present application, the fixed exposure mode adjustment module 180 is further used for:

[0164] Obtain fixed exposure parameter values.

[0165] The photographing mode is controlled to the fixed exposure mode based on the fixed exposure parameter value.

[0166] In one alternative embodiment of the shooting control device provided by the embodiment corresponding to FIG. 19 of the present application, the fixed exposure mode adjustment module 180 is further used for:

[0167] N historical exposure parameters are obtained.

[0168] Here, the historical exposure parameters are exposure parameters that correspond to captured images that satisfy predetermined image quality requirements.

[0169] A fixed exposure parameter value is calculated based on the N historical exposure parameters.

[0170] In one alternative embodiment of the shooting control device provided by the embodiment corresponding to FIG. 19 of the present application, the fixed exposure mode adjustment module 180 is further used for:

[0171] Obtaining N exposure times and N exposure gain values ​​corresponding to the N captured images, where N is an integer greater than 1; Calculating a fixed exposure parameter value based on the N historical exposure parameters, which is Calculating a fixed exposure time based on the N exposure times, and calculating a fixed exposure gain value based on the N exposure gain values.

[0172] In one optional embodiment of the photography control device provided by the embodiment corresponding to Figure 19 of the present application, referring to Figure 20, the photography control device 10 further includes a breathing light mode adjustment module 190 used to set the operating mode of the lighting device to a breathing light mode.

[0173] In one alternative embodiment of the imaging control device provided by the embodiment corresponding to FIG. 16 of the present application, the imaging module 110 is further used for:

[0174] Get the current exposure and the current ambient brightness.

[0175] A target exposure is determined based on the current exposure and the current ambient luminance.

[0176] An exposure adjustment value is determined based on the current exposure amount and the target exposure amount.

[0177] The current exposure is adjusted to the target exposure based on the exposure adjustment value.

[0178] Image collection is performed based on a target exposure.

[0179] In one alternative embodiment of the shooting control device provided by the embodiment corresponding to FIG. 16 of the present application, the target shooting image determination module 140 is further used for:

[0180] M resolution values ​​corresponding to M captured images are obtained.

[0181] Based on the M resolution values, a photographed image having a corresponding resolution value greater than a predetermined resolution is determined as a target photographed image from among the M photographed images.

[0182] FIG. 21 is a structural diagram of a server 300 according to an embodiment of the present disclosure. The server 300 can be used to implement the imaging control method according to an embodiment of the present disclosure. The server 300 may vary significantly due to different configurations or performance. The server 300 may include one or more central processing units (CPUs) 322 (e.g., one or more processors), memory 332, and one or more storage media 330 (e.g., one or more mass storage devices) for storing application programs 342 or data 344. The memory 332 and storage media 330 may be temporary or permanent. The program stored in the storage media 330 may include one or more modules (not shown), each of which may include a series of instruction operations for the server. Furthermore, the central processing unit 322 may be configured to communicate with the storage media 330 and execute the series of instruction operations in the storage media 330 on the server 300.

[0183] The server 300 may include one or more power sources 326, one or more wired or wireless network interfaces 350, one or more input / output interfaces 358, and / or one or more operating systems 341, such as Windows Server 2008 R2. TM , Mac OS XTM , Unix TM , Linux TM , and FreeBSD TM It may further include the following.

[0184] In the above embodiment, the steps performed by the server may be based on the server structure shown in FIG.

[0185] As can be clearly understood by those skilled in the art, for convenience and brevity of description, the specific operating processes of the above-described systems, devices, and units may refer to the corresponding processes in the above-described method embodiments, and will not be described in detail again here.

[0186] In some embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be realized in other ways. For example, the device embodiments described above are merely exemplary. For example, the division of units is merely a division of logical functions. In actual implementation, other division methods may be used. For example, multiple units or components may be combined or integrated into another system, and some features may be omitted or not implemented. In other respects, the couplings, direct couplings, or communication connections shown or discussed may be indirect couplings or communication connections via some interfaces, devices, or units, and may be electrical, mechanical, or other types of couplings.

[0187] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place or distributed across multiple network units. Some or all of the units can be selected based on actual needs to achieve the objective of the solution of this embodiment.

[0188] Furthermore, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The integrated units may be realized in the form of hardware or in the form of software functional units.

[0189] The integrated unit can be realized in the form of a software functional unit and stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application, essentially, or a part that contributes to the prior art, or all or a part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium and includes a plurality of instructions used to cause a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or a part of the steps of the method of each embodiment of the present application. The aforementioned storage medium includes various media that can store program code, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0190] As mentioned above, the above embodiments are only used to explain the technical solutions of the present application, and are not limited thereto. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments may still be modified or equivalent substitutions may be made to some of the technical features thereof, and these modifications or equivalent substitutions will not deviate from the essence of the corresponding technical solutions and the spirit and scope of the technical solutions of the embodiments of the present application. [Explanation of symbols]

[0191] 10. Shooting control device 15 Distance Threshold 100 systems 110 Image acquisition command response module 120 Automatic exposure mode adjustment module 130 Photography Module 140 Target Shooting Image Determination Module 150 Exposure parameter value storage module 160 Distance Detection Module 170 Image acquisition command generation module 180 Fixed Exposure Mode Adjustment Module 190 Breathing Light Mode Adjustment Module 200 store order system 200-1 Image acquisition equipment 200-2 Ordered Equipment 300 servers 322 Central Processing Unit 326 Power supply 330 Storage medium 332 memory 341 Operating Systems 342 Application Programs 344 Data 350 Wireless Network Interface 358 Input / Output Interface

Claims

1. 1. A method for controlling photography, the method being performed by an image capture device, the image capture device including a camera and a lighting fixture, the method comprising: setting an operational mode of the lighting fixture to an illumination mode in response to an image capture command, the illumination mode being used to indicate that the lighting fixture is in a highlight state, and under the highlight state, a fill light intensity of the lighting fixture exceeds a predetermined intensity threshold; adjusting the photographing mode to an auto exposure mode; controlling the camera to collect images based on the auto exposure mode to obtain M captured images, where M is an integer greater than or equal to 1; a step of determining a target photographed image from among the M photographed images, the target photographed image being a photographed image whose image quality satisfies a predetermined image quality requirement.

2. The step of adjusting the photographing mode to an automatic exposure mode includes:

2. The photographing control method according to claim 1, further comprising a step of adjusting a fixed exposure mode to the automatic exposure mode, wherein a fixed exposure parameter value corresponding to the fixed exposure mode is determined based on a historical exposure parameter.

3. After the step of determining a target photographed image from among the M photographed images, obtaining exposure parameter values ​​corresponding to the target captured image; 3. The photographing control method according to claim 2, further comprising: a step of storing exposure parameter values ​​corresponding to the target photographed image in a historical exposure parameter database, wherein the historical exposure parameters in the historical exposure parameter database are used to adjust the fixed exposure parameter values.

4. The image acquisition device includes: further comprising a distance sensor; The step of responding to an image acquisition command comprises: determining a distance value between a target object and the camera based on the detection result of the distance sensor; 4. The photographing control method according to claim 1, further comprising the step of: responding to the image capture command if the distance value between the target object and the camera is less than a distance threshold.

5. After the step of determining a distance value between a target object and the camera, The photographing control method according to claim 4 , further comprising the step of controlling the photographing mode to a fixed exposure mode if the distance value between the target object and the camera is greater than or equal to the distance threshold.

6. The step of controlling the photographing mode to a fixed exposure mode includes: obtaining fixed exposure parameter values; 6. The photographing control method according to claim 5, further comprising the step of controlling the photographing mode to the fixed exposure mode based on the fixed exposure parameter value.

7. The step of obtaining fixed exposure parameter values ​​comprises: acquiring N historical exposure parameters, the historical exposure parameters being exposure parameters corresponding to captured images that satisfy the predetermined image quality requirements, where N is an integer greater than or equal to 1; 7. The photographing control method according to claim 6, further comprising the step of calculating and obtaining the fixed exposure parameter value based on the N historical exposure parameters.

8. The step of obtaining N historical exposure parameters comprises: acquiring N exposure times and N exposure gain values ​​corresponding to N captured images; The step of calculating the fixed exposure parameter value based on the N historical exposure parameters comprises:

8. The photographing control method according to claim 7, further comprising the steps of: calculating and obtaining a fixed exposure time based on the N exposure times; and calculating and obtaining a fixed exposure gain value based on the N exposure gain values.

9. If the distance value between the target object and the camera is greater than or equal to the distance threshold, after the step of controlling the photographing mode to a fixed exposure mode, 9. The photography control method according to claim 5, further comprising the step of setting the operation mode of the lighting device to a breathing light mode.

10. The step of acquiring images based on the auto exposure mode includes: obtaining a current exposure and a current ambient luminance; determining a target exposure based on the current exposure and the current ambient luminance; determining an exposure adjustment value based on the current exposure and the target exposure; adjusting the current exposure dose to the target exposure dose based on the exposure adjustment value; 10. The photography control method according to claim 1, further comprising: collecting images based on the target exposure amount.

11. The step of determining a target photographed image from among the M photographed images includes: obtaining M resolution values ​​corresponding to the M captured images; The photographing control method according to any one of claims 1 to 10, further comprising a step of determining, as the target photographed image, a photographed image from among the M photographed images whose corresponding resolution value is greater than a predetermined resolution based on the M resolution values.

12. An imaging control device, an image capture command response module adapted to turn on a lighting mode in response to an image capture command, the lighting mode adapted to indicate that the lighting device is in a highlight state, and under the highlight state, a fill light intensity of the lighting device exceeds a predetermined intensity threshold; an automatic exposure mode adjusting module used for adjusting the photographing mode to an automatic exposure mode; a photographing module used to control the camera to collect images based on the automatic exposure mode and obtain M photographed images, where M is an integer greater than or equal to 1; A photographing control device including: a target photographing image determination module used to determine a target photographing image from among the M photographing images, wherein the target photographing image is a photographing image whose image quality satisfies predetermined image quality requirements.

13. A computer device comprising: a memory; a transceiver; a processor; and a bus system; The memory is used to store a program, The processor is used to execute a program in the memory, and includes executing the imaging control method according to any one of claims 1 to 11, The bus system is used to connect the memory and the processor, thereby allowing the memory and the processor to communicate with each other.

14. A computer-readable storage medium containing instructions that, when executed on a computer, cause the computer to carry out the imaging control method of any one of claims 1 to 11.

15. A computer program product, comprising a computer program, which, when executed by a processor, performs the imaging control method according to any one of claims 1 to 11.

Images