Signal processing method and device

By dynamically adjusting the gain value to process the image acquisition signal, the problem of image abnormalities, especially overexposure phenomena is solved, the effectiveness and recognition accuracy of the image are improved, and the image quality is improved.

CN112800981BActive Publication Date: 2024-11-26LENOVO (BEIJING) LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202110136294.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-02-01
Publication Date
2024-11-26
Estimated Expiration
2041-02-01

AI Technical Summary

Technical Problem

The prior art is difficult to effectively deal with image abnormalities caused by shooting environment and equipment parameters, especially overexposure phenomena, which affects image quality and leads to the inability to correctly identify and verify images.

Method used

By acquiring the acquisition signal used to characterize image information, the adjustment gain value is determined based on the degree of abnormality, and the initial gain value is replaced to improve image quality and improve image repair effect. The method includes obtaining the acquisition signal, determining the degree of abnormality, adjusting the relationship between the gain value and the initial gain value to a proportional relationship, and restoring the initial gain value if necessary.

Benefits of technology

By dynamically adjusting the gain value, we can improve the image repair effect, enhance the effectiveness and recognition accuracy of the image, adapt to different environments and abnormalities, and improve the image's repair ability under overexposure.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112800981B_ABST
    Figure CN112800981B_ABST
Patent Text Reader

Abstract

The present application provides a signal processing method and device, which obtain a collection signal for representing image information, process the collection signal according to a processing mode to generate a collection image, wherein the processing mode includes at least an initial gain value, and the collection signal is obtained by an optical sensor; an adjustment gain value is determined based on the degree of abnormality of the collection image; based on the adjustment gain value, the initial gain value of the processing mode is replaced with the adjustment gain value, wherein the effective image in the collection image generated by processing the collection signal in the same environment again according to the post-adjustment processing mode is greater than the effective image in the collection image generated by processing the collection signal in the same environment according to the pre-adjustment processing mode, thereby improving the image restoration effect by adjusting the initial gain value, and enabling different environments to use an adaptive adjustment gain value to replace the initial gain value based on the degree of abnormality of the abnormality of the collection image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of data processing technology, and in particular, relates to a signal processing method and device. Background Art

[0002] The image may be abnormal due to shooting environment and equipment parameters, for example, the image may be overexposed due to the light intensity of the shooting environment. If the image is abnormal, the electronic device used to obtain the image may adjust the device parameters. For example, the light intensity may be reduced to solve the overexposure phenomenon of the image, such as adjusting the intensity of the light beam emitted by the electronic device or adding a sunshade to the electronic device. Summary of the invention

[0003] The present application provides a signal processing method and device.

[0004] On the one hand, the present application provides a signal processing method, comprising:

[0005] Acquire a collection signal for representing image information, process the collection signal according to a processing mode to generate a collection image, the processing mode at least includes an initial gain value, and the collection signal is obtained by an optical sensor;

[0006] Determining the adjustment gain value based on the degree of abnormality of the acquired image;

[0007] Based on the adjusted gain value, the initial gain value of the processing mode is replaced with the adjusted gain value; wherein, the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again by processing according to the adjusted processing mode is greater than the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment by processing according to the pre-adjustment processing mode.

[0008] Optionally, determining the adjustment gain value based on the degree of abnormality of the acquired image includes:

[0009] If the collected image has a first abnormality degree, determining the adjustment gain value to be a first adjustment gain value;

[0010] If the collected image has a second abnormality degree, determining the adjustment gain value to a second adjustment gain value;

[0011] If the first abnormality degree is greater than the second abnormality degree, the difference between the first adjusted gain value and the initial gain value is greater than the difference between the second adjusted gain value and the initial gain value.

[0012] Optionally, the adjusted gain value is smaller than the initial gain value, and the relationship between the difference between the adjusted gain value and the initial gain value and the abnormality degree is that the difference is directly proportional to the abnormality degree.

[0013] Optionally, the method further includes: if the acquired image generated based on the adjusted initial gain value is a normal image, restoring the initial gain value of the processing mode.

[0014] Optionally, the acquiring of a collection signal for representing image information includes:

[0015] If fingerprint input is detected, an acquisition signal for representing fingerprint image information is obtained using the under-screen optical sensor, wherein the fingerprint image in the acquisition image generated by processing the acquisition signal according to the processing mode is the valid image.

[0016] Optionally, the method for obtaining the degree of abnormality of the acquired image includes:

[0017] Determine an abnormal region in the acquired image where an abnormality exists; obtain an area occupied by the abnormal region in the acquired image; and determine the degree of abnormality according to the area;

[0018] or

[0019] Acquire the brightness value of each pixel in the collected image; and determine the abnormality degree according to the brightness value of each pixel and the brightness value of the screen displaying the collected image.

[0020] On the other hand, the present application provides a signal processing device, comprising:

[0021] An acquisition unit, used for acquiring an acquisition signal for representing image information, and processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least includes an initial gain value, and the acquisition signal is obtained by an optical sensor;

[0022] A determination unit, configured to determine an adjustment gain value based on the degree of abnormality of the acquired image;

[0023] An adjustment unit is used to replace the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value; wherein, a valid image in a captured image generated by re-obtaining the captured signal under the same environment by processing in accordance with the adjusted processing mode is greater than a valid image in a captured image generated by obtaining the captured signal under the same environment by processing in accordance with the adjusted processing mode.

[0024] Optionally, the adjusted gain value is smaller than the initial gain value, and the relationship between the difference between the adjusted gain value and the initial gain value and the abnormality degree is that the difference is directly proportional to the abnormality degree.

[0025] Optionally, the device further includes: a restoring unit, configured to restore the initial gain value of the processing mode if the acquired image generated based on the adjusted initial gain value is a normal image.

[0026] Optionally, the acquisition unit is used to obtain a collection signal for representing fingerprint image information using the under-screen optical sensor if finger fingerprint input is detected, wherein the fingerprint image in the collection image generated by processing the collection signal according to the processing mode is the valid image.

[0027] In another aspect, the present application provides an electronic device, comprising: a processor;

[0028] a memory for storing instructions executable by the processor;

[0029] The processor is configured to execute the instructions to implement the above signal processing method.

[0030] On the other hand, the present application provides a storage medium, in which instructions are stored, and when the instructions in the storage medium are executed, the above-mentioned signal processing method is implemented.

[0031] The signal processing method and device described above obtain a collection signal for representing image information, process the collection signal according to a processing mode to generate a collection image, the processing mode includes at least an initial gain value, the collection signal is obtained by an optical sensor; the adjustment gain value is determined based on the abnormality degree of the abnormality in the collection image; based on the adjustment gain value, the initial gain value of the processing mode is replaced by the adjustment gain value, wherein the effective image in the collection image generated by processing the collection signal in the same environment again according to the post-adjustment processing mode is greater than the effective image in the collection image generated by processing the collection signal in the same environment before the adjustment processing mode, so that the abnormality of the collection image obtained in the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by adjusting the initial gain value. And the adjustment gain value that replaces the initial gain value is determined based on the abnormality degree of the abnormality in the collection image, indicating that the adjustment gain value may be different for different abnormality degrees, and the adjustment gain value is dynamically adjusted based on the abnormality degree of the abnormality in the collection image, so that different environments can use the adapted adjustment gain value to replace the initial gain value based on the abnormality degree of the abnormality in the collection image, and the collection image obtained again in the same environment is restored, thereby improving the image restoration effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0033] Figure 1 is a flow chart of a signal processing method provided by an embodiment of the present application;

[0034] Figure 2 It is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0035] Figure 3 This is a flow chart of a signal processing method provided in an embodiment of the present application for application in fingerprint collection;

[0036] Figure 4 is a schematic diagram of a collected image restoration provided by an embodiment of the present application;

[0037] Figure 5 is a schematic diagram of another method for collecting and repairing an image provided by an embodiment of the present application;

[0038] Figure 6 is a flowchart of another signal processing method provided by an embodiment of the present application;

[0039] Figure 7 is a structural schematic diagram of a signal processing device provided in an embodiment of the present application;

[0040] Figure 8 It is a structural schematic diagram of another signal processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0042] See also Figure 1 , which shows a flow chart of a signal processing method provided by an embodiment of the present application, which may include the following steps:

[0043] 101: Acquire a collection signal for representing image information, and process the collection signal according to a processing mode to generate a collection image. The processing mode at least includes an initial gain value. The collection signal is obtained by an optical sensor.

[0044] The light emitted by the electronic device shines onto the screen, and part of the light passes through the screen. This part of the light provides illumination for the optical sensor in the process of the optical sensor obtaining the collection signal. Under the action of light, the optical sensor can obtain the collection signal used to represent the image information.

[0045] When the optical sensor acquires the acquisition signal, the ambient light of the environment where the optical sensor is located affects the acquisition of the acquisition signal, so that at least a noise signal generated by the ambient light exists in the acquisition signal. With respect to the noise signal in the acquisition signal, the influence of the noise signal can be reduced in the process of processing the acquisition signal according to the processing mode, and an acquisition image with a valid image is generated. For example, the acquisition signal is input into an ADC (Analog-to-Digital Converter), and the ADC performs analog-to-digital conversion on the acquisition signal based on the initial gain value in the processing mode to obtain a grayscale image as the acquisition image, and the grayscale information in the grayscale image can represent the image information.

[0046] However, due to the influence of the ambient light of the environment where the optical sensor is located and the factors of the acquisition object itself, there will be certain problems with the acquisition image generated by processing the acquisition signal based on the initial gain value. For example, if the brightness of the ambient light of the environment where the optical sensor is located is too high, the white area in the acquisition image will increase, indicating that the overexposure phenomenon of the acquisition image is serious and the acquisition image cannot be used. If the acquisition object is a finger, if the humidity on the surface of the finger is too low (that is, the finger is dry), the acquisition image generated based on the initial gain value processing will also be unusable. The acquisition image cannot be used because there are too few valid images in the acquisition image, resulting in less feature data extracted from the acquisition image, and the acquisition object restored by the extracted feature data is missing, so it cannot pass the recognition verification.

[0047] For example, in one application scenario, the object to be collected is a finger. Figure 2The electronic device shown collects fingerprints for fingerprint recognition and verification, wherein the electronic device includes: an optical sensor under the screen (an optical sensor), an ADC and a processor, and there is a fingerprint collection area in the electronic device, the fingerprint collection area is used to monitor whether there is a finger fingerprint input, and the corresponding acquisition of the acquisition signal used to represent the image information includes: if a finger fingerprint input is detected, the acquisition signal used to represent the fingerprint image information is obtained by using the optical sensor under the screen, and the acquisition signal is transmitted to the ADC, and the acquisition signal is processed by the ADC according to the initial gain value in the processing mode to obtain the acquisition image. The acquired image is recognized and verified by the processor. If the acquired image has an overexposure phenomenon, there are too few fingerprint images in the acquired image, so that the acquired image cannot pass the recognition and verification of the processor. If there are too few fingerprint images in the acquired image, the processor extracts little fingerprint feature data from the acquired image, and the acquisition object restored by the processor based on the fingerprint feature data is missing, such as the fingerprint cannot be restored or only part of the fingerprint can be restored. Figure 2 As shown, the fingerprint cannot be recognized and verified by the processor.

[0048] For the above situation, this embodiment determines the degree of abnormality of the acquired image, and adjusts the initial gain value based on the degree of abnormality to reduce the abnormality in the acquired image so as to increase the effective image in the acquired image. That is to say, the adjustment of the initial gain value in this embodiment meets two conditions: one is that there is an abnormality; the other is that the degree of abnormality reaches a certain level. Because the initial gain value has a certain redundancy, it can recover some abnormalities in the acquired image. Therefore, if the degree of abnormality is greater than the degree of abnormality corresponding to the initial gain value, the adjustment of the initial gain value is triggered.

[0049] The degree of abnormality of the acquired image includes but is not limited to the following:

[0050] One method is to determine an abnormal region in the acquired image where an abnormality exists; obtain the area occupied by the abnormal region in the acquired image; and determine the degree of abnormality according to the area. The larger the area occupied by the abnormal region in the acquired image, the greater the degree of abnormality; the abnormal region in the acquired image may be, but is not limited to, a white region in the acquired image, and the abnormal region is determined by detecting the pixel values ​​of the pixels in the acquired image. For example, for a white region, the pixel value of the pixel is (255, 255, 255), and the pixel with the value of (255, 255, 255) is identified to obtain the area occupied by the abnormal region in the acquired image.

[0051] Another way is to obtain the brightness value of each pixel in the collected image; determine the degree of abnormality based on the brightness value of each pixel and the brightness value of the screen displaying the collected image. Because the optical sensor acquires the collected signal under the action of light passing through the screen, different brightness values ​​of the screen have different effects on the brightness values ​​of each pixel in the collected image. For this reason, a threshold can be determined based on the brightness value of the screen displaying the collected image, and the degree of abnormality can be determined based on the comparison result of the brightness value of each pixel in the collected image and the threshold. For example, the comparison result is used to characterize the difference between the brightness value of each pixel and the threshold and the number of pixels with differences. The more pixels with differences, the greater the difference value, and the greater the degree of abnormality, and vice versa. The value of the threshold is not limited in this embodiment.

[0052] 102: Determine an adjustment gain value based on the degree of abnormality of the acquired image.

[0053] The adjusted gain value can be greater than the initial gain value or less than the initial gain value. For example, if the white area in the acquired image (the white area is an invalid image in the acquired image) increases due to overexposure, the adjusted gain value is less than the initial gain value to reduce the overexposure phenomenon. Conversely, the adjusted gain value is greater than the initial gain value.

[0054] And by analyzing the white area in the collected image under different overexposure conditions, it is found that if the white area is larger, the adjusted gain value is smaller, so that the white area in the collected image can be reduced. Therefore, the relationship between the difference value between the adjusted gain value and the initial gain value and the degree of abnormality is that the difference value is proportional to the degree of abnormality. For example, the greater the degree of abnormality, the greater the difference value, and the smaller the degree of abnormality, the smaller the difference value. If the adjusted gain value is less than the initial gain value, then the adjusted gain value will become smaller and smaller as the degree of abnormality increases.

[0055] Based on the relationship between the adjustment gain value and the abnormality degree, a method of determining the adjustment gain value may include: if the acquired image has a first abnormality degree, determining the adjustment gain value to a first adjustment gain value; if the acquired image has a second abnormality degree, determining the adjustment gain value to a second adjustment gain value;

[0056] Wherein, if the first abnormality degree is greater than the second abnormality degree, the difference between the first adjustment gain value and the initial gain value is greater than the difference between the second adjustment gain value and the initial gain value, satisfying the proportional relationship between the difference value and the abnormality degree. For example, if the initial gain value needs to be reduced, if the first abnormality degree is greater than the second abnormality degree, the first adjustment gain value is less than the second adjustment gain value.

[0057] 103: Based on the adjusted gain value, the initial gain value of the processing mode is replaced with the adjusted gain value to improve the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again, wherein the improvement means that the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again according to the adjusted processing mode is greater than the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment according to the pre-adjustment processing mode.

[0058] The same environment is the environment in which the above-mentioned optical sensor obtains the acquisition signal. After the initial gain value is replaced by the adjusted gain value, if the acquisition signal in this environment is obtained again by the optical sensor, the acquisition signal is adjusted according to the processing mode by using the adjusted gain value to process the acquisition signal, which will make the effective image in the generated acquisition image larger than the effective image in the acquisition image generated by processing the same acquisition signal with the initial gain value, such as the area occupied by the effective image increases or the feature data extracted from the effective image increases, thereby increasing the possibility of recovering the acquisition object.

[0059] For the acquired image obtained again, if the abnormality level of the acquired image obtained again indicates to adjust the initial gain value, the adjusted gain value is determined based on the abnormality level of the acquired image obtained again, and the adjusted gain value is continued to be used to adjust the initial gain value, so as to realize dynamic and continuous adjustment of the initial gain value based on the abnormality level of the acquired image.

[0060] The following is an example of how the under-screen optical sensor collects fingerprints. Figure 3 As shown, the following steps may be included:

[0061] 201: Acquire a collection signal for representing fingerprint image information, and process the collection signal according to a processing mode to generate a collection image. The processing mode includes at least an initial gain value. The collection signal is obtained by the optical sensor under the screen. For example, when a finger fingerprint input is detected, the optical sensor under the screen is triggered to collect signals to obtain a collection signal.

[0062] 202: Determine the degree of abnormality based on the area occupied by the abnormal region in the acquired image.

[0063] 203: If the abnormality level belongs to the first type of abnormality, determine that the adjusted gain value is a first gain value, where the first gain value may be, but is not limited to, obtained by multiplying the initial gain value and the first value, and the first value is less than 1.

[0064] 204: If the abnormality degree belongs to the second type of abnormality, determine that the adjusted gain value is the second gain value, the second gain value can be but is not limited to being obtained by multiplying the initial gain value and the second value, and the second value is less than 1, the abnormality degree of the second type of abnormality is greater than the abnormality degree of the first type of abnormality, and the second value is less than the first value, so that the second gain value is less than the first gain value.

[0065] 205: If the abnormality degree belongs to the third type of abnormality, determine that the adjusted gain value is the third gain value, the third gain value can be but is not limited to the initial gain value and the third value multiplied, and the third value is less than 1, the abnormality degree of the third type of abnormality is greater than the abnormality degree of the second type of abnormality, the third value is less than the second value, so that the third gain value is less than the second gain value, the first type of abnormality, the second type of abnormality and the third type of abnormality can be divided by two abnormality degrees, and this embodiment does not limit how to divide and the values ​​of the first value to the third value. In addition to obtaining the adjusted gain value by multiplying the initial gain value with the value, it can also be obtained by any method such as subtraction and division.

[0066] 206: Based on the adjusted gain value, the initial gain value of the processing mode is replaced with the adjusted gain value to improve the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again, wherein the improvement means that the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again according to the adjusted processing mode is greater than the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment according to the pre-adjustment processing mode.

[0067] An electronic device is used to collect fingerprint images and use the above Figure 3 The effects of each adjustment gain value after processing are described as follows: Figure 4 The figure shows the effect of different adjustment gain values. Figure 4 The electronic device shown in the figure obtains a captured image. Due to the problem of ambient light, the captured image has an overexposure phenomenon, such as Figure 4 There are too many white areas in the collected images, which makes the collected images have few valid images and it is impossible to extract valid feature data. Figure 3 By adjusting the initial gain value in the manner shown, the effective image in the acquired image generated by the acquired signal obtained from the same environment again is improved, such as Figure 4 Different adjusted initial gain values ​​result in different effective images in the acquired images. The smaller the adjusted initial gain value is, the more effective images there are and the better the restoration effect is.

[0068] If the abnormality still exists and is serious after using an adjusted initial gain value, you can continue to adjust the initial gain value, such as Figure 5As shown. If the abnormality of the acquired image after adjustment with the first gain value is still serious, the adjusted gain value can be determined based on the abnormality of the acquired image obtained again, and the initial gain value can be adjusted. The initial gain value can be the gain value used in the digital-to-analog conversion process of the ADC. The gain value of the ADC can be dynamically and continuously adjusted in the above manner.

[0069] The signal processing method described above obtains a collection signal for representing image information, processes the collection signal according to a processing mode to generate a collection image, the processing mode includes at least an initial gain value, the collection signal is obtained by an optical sensor; the adjustment gain value is determined based on the abnormality degree of the abnormality in the collection image; based on the adjustment gain value, the initial gain value of the processing mode is replaced by the adjustment gain value, wherein the effective image in the collection image generated by processing the collection signal in the same environment again according to the post-adjustment processing mode is greater than the effective image in the collection image generated by processing the collection signal in the same environment again according to the pre-adjustment processing mode, so that the abnormality of the collection image obtained in the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by adjusting the initial gain value. And the adjustment gain value that replaces the initial gain value is determined based on the abnormality degree of the abnormality in the collection image, indicating that the adjustment gain value may be different for different abnormality degrees, and the adjustment gain value is dynamically adjusted based on the abnormality degree of the abnormality in the collection image, so that different environments can use the adapted adjustment gain value to replace the initial gain value based on the abnormality degree of the abnormality in the collection image, and the collection image obtained again in the same environment is restored, thereby improving the image restoration effect.

[0070] See also Figure 6 , which shows a flowchart of another signal processing method provided by an embodiment of the present application, which may include the following steps:

[0071] 301: Acquire a collection signal for representing image information, and process the collection signal according to a processing mode to generate a collection image, wherein the processing mode at least includes an initial gain value, and the collection signal is obtained by an optical sensor.

[0072] 302: Determine an adjustment gain value based on the degree of abnormality of the acquired image.

[0073] 303: Based on the adjusted gain value, the initial gain value of the processing mode is replaced with the adjusted gain value to improve the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again, wherein the improvement means that the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again according to the adjusted processing mode is greater than the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment according to the pre-adjustment processing mode.

[0074] 304: If the acquired image generated based on the adjusted initial gain value is a normal image, restore the initial gain value of the processing mode, that is, restore the initial gain value of the processing mode to the original value. This is because the initial gain value of the processing mode can adapt to a variety of situations at the original value, such as adapting to the situation where there is no abnormality in the acquired image and the situation where there is an abnormality in the acquired image but the abnormality is less than the preset degree, and the initial gain value is adjusted because the environment in which it is located has a sudden change, etc. The adjusted initial gain value is suitable for the environment in which it is located during the adjustment, which means that in most cases the adjusted initial gain value is not suitable, so if the acquired image generated based on the adjusted initial gain value is a normal image, restore the initial gain value of the processing mode.

[0075] The acquisition image generated based on the adjusted initial gain value is a normal image, which can indicate that the acquisition image has no abnormality or that there is an abnormality in the acquisition image but the abnormality is less than a preset degree. In these cases, the acquisition object can be effectively restored. Therefore, if the acquisition image has no abnormality or there is an abnormality in the acquisition image but the abnormality is less than a preset degree, the acquisition image generated based on the adjusted initial gain value is determined to be a normal image. The preset degree is the degree of abnormality when there is a difference in the acquisition image but the feature data extracted from the acquisition image can restore the acquisition object. The value of the preset degree is not limited in this embodiment.

[0076] In the above-mentioned signal processing method, if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is restored, that is, the initial gain value of the processing mode is restored to the original value, so as to process the acquired signal through the initial gain value. Since the initial gain value of the processing mode is at the original value, it can adapt to a variety of situations, thereby being able to adapt to the processing and recovery requirements of acquired images in various scenarios, thereby improving the recovery accuracy and efficiency.

[0077] In addition to the above-mentioned restoration of the initial gain value of the processing mode, the present embodiment may also adopt other methods, such as after adjusting the initial gain value for a preset period of time, if the captured image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is restored; or, if the environment in which the optical sensor is located changes, the initial gain value of the processing mode is restored, wherein the change in the environment in which the optical sensor is located may be but is not limited to a change in the intensity of the monitored ambient light, and the present embodiment does not limit the method of restoring the initial gain value of the processing mode.

[0078] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0079] Corresponding to the above method embodiment, the present application embodiment also provides a signal processing device, whose optional structure is as follows: Figure 7 As shown, it may include: an acquisition unit 10 , a determination unit 20 and an adjustment unit 30 .

[0080] The acquisition unit 10 is used to acquire a collection signal for representing image information, and to process the collection signal according to a processing mode to generate a collection image. The processing mode at least includes an initial gain value, and the collection signal is obtained by an optical sensor.

[0081] When the optical sensor acquires the acquisition signal, the ambient light of the environment where the optical sensor is located affects the acquisition of the acquisition signal, so that at least a noise signal generated by the ambient light exists in the acquisition signal. With respect to the noise signal in the acquisition signal, the influence of the noise signal can be reduced in the process of processing the acquisition signal according to the processing mode, and an acquisition image with a valid image is generated. For example, the acquisition signal is input into the ADC, and the ADC performs analog-to-digital conversion on the acquisition signal based on the initial gain value in the processing mode, and obtains a grayscale image as the acquisition image, and the grayscale information in the grayscale image can represent the image information.

[0082] For example, the optical sensor may be an under-screen optical sensor. The obtaining unit 10 is used to obtain a collection signal for representing fingerprint image information by using the under-screen optical sensor if fingerprint input is detected. The fingerprint image in the collection image generated by processing the collection signal according to the processing mode is a valid image.

[0083] However, due to the influence of the ambient light of the environment where the optical sensor is located and the factors of the collected object itself, the collected image generated by processing the collected signal based on the initial gain value will have certain problems, affecting the use of the collected image. Therefore, in this embodiment, it can be triggered to determine the adjustment gain value based on the collected image to adjust the initial gain value. The degree of abnormality of the collected image includes but is not limited to the following ways:

[0084] One way is to determine an abnormal region in the acquired image where an abnormality exists; obtain the area occupied by the abnormal region in the acquired image; and determine the degree of abnormality based on the area. Another way is to obtain the brightness value of each pixel in the acquired image; and determine the degree of abnormality based on the brightness value of each pixel and the brightness value of the screen displaying the acquired image.

[0085] The determination unit 20 is used to determine the adjustment gain value based on the abnormality degree of the abnormality in the acquired image. The adjustment gain value can be greater than the initial gain value or less than the initial gain value. For example, if the white area in the acquired image (the white area is an invalid image in the acquired image) increases due to overexposure, the adjustment gain value is less than the initial gain value to reduce the overexposure phenomenon, and vice versa. The relationship between the difference value between the adjustment gain value and the initial gain value and the abnormality degree is that the difference value is proportional to the abnormality degree, such as the greater the abnormality degree, the greater the difference value, and the smaller the abnormality degree, the smaller the difference value. If the adjustment gain value is less than the initial gain value, then the adjustment gain value will become smaller and smaller as the abnormality degree increases.

[0086] Based on the relationship between the adjustment gain value and the abnormality degree, a method for determining the adjustment gain value by the determination unit 20 may include: if the collected image has a first abnormality degree, determining the adjustment gain value to a first adjustment gain value; if the collected image has a second abnormality degree, determining the adjustment gain value to a second adjustment gain value;

[0087] Wherein, if the first abnormality degree is greater than the second abnormality degree, the difference between the first adjustment gain value and the initial gain value is greater than the difference between the second adjustment gain value and the initial gain value, satisfying the proportional relationship between the difference value and the abnormality degree. For example, if the initial gain value needs to be reduced, if the first abnormality degree is greater than the second abnormality degree, the first adjustment gain value is less than the second adjustment gain value.

[0088] The adjustment unit 30 is used to replace the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value. The effective image in the acquisition image generated by the acquisition signal under the same environment obtained again by processing in the processing mode after the adjustment is greater than the effective image in the acquisition image generated by processing in the processing mode before the adjustment to obtain the acquisition signal under the same environment.

[0089] The same environment is the environment in which the above-mentioned optical sensor obtains the acquisition signal. After the initial gain value is replaced by the adjusted gain value, if the acquisition signal in this environment is obtained again by the optical sensor, the acquisition signal is adjusted according to the processing mode by using the adjusted gain value to process the acquisition signal, which will make the effective image in the generated acquisition image larger than the effective image in the acquisition image generated by processing the same acquisition signal with the initial gain value, such as the area occupied by the effective image increases or the feature data extracted from the effective image increases, thereby increasing the possibility of recovering the acquisition object.

[0090] For the acquired image obtained again, if the abnormality level of the acquired image obtained again indicates to adjust the initial gain value, the adjusted gain value is determined based on the abnormality level of the acquired image obtained again, and the adjusted gain value is continued to be used to adjust the initial gain value, so as to realize dynamic and continuous adjustment of the initial gain value based on the abnormality level of the acquired image.

[0091] The above-mentioned signal processing device obtains a collection signal for representing image information, processes the collection signal according to a processing mode to generate a collection image, the processing mode includes at least an initial gain value, and the collection signal is obtained by an optical sensor. The adjustment gain value is determined based on the abnormality degree of the abnormality in the collection image. Based on the adjusted gain value, the initial gain value of the processing mode is replaced by the adjusted gain value, wherein the effective image in the collection image generated by processing the collection signal in the same environment again according to the adjusted processing mode is greater than the effective image in the collection image generated by processing the collection signal in the same environment before the adjustment, so that the abnormality of the collection image obtained in the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by adjusting the initial gain value. And the adjustment gain value that replaces the initial gain value is determined based on the abnormality degree of the abnormality in the collection image, indicating that the adjustment gain value may be different for different abnormality degrees, and the adjustment gain value is dynamically adjusted based on the abnormality degree of the abnormality in the collection image, so that different environments can use the adapted adjustment gain value to replace the initial gain value based on the abnormality degree of the abnormality in the collection image, and the collection image obtained again in the same environment is restored, thereby improving the image restoration effect.

[0092] See also Figure 8 , which shows an optional structure of another signal processing device provided by an embodiment of the present application, and may also include: a recovery unit 40, which is used to restore the initial gain value of the processing mode if the acquired image generated based on the adjusted initial gain value is a normal image, that is, to restore the initial gain value of the processing mode to the original value. This is because the initial gain value of the processing mode can adapt to a variety of situations at the original value, such as adapting to the situation where there is no abnormality in the acquired image and the situation where there is an abnormality in the acquired image but the abnormality is less than a preset degree, and the initial gain value is adjusted because the environment in which it is located has a sudden change, etc. The adjusted initial gain value is suitable for the environment in which it is located during the adjustment, which means that in most cases the adjusted initial gain value is not suitable, so if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is restored.

[0093] The acquisition image generated based on the adjusted initial gain value is a normal image, which can indicate that the acquisition image has no abnormality or that there is an abnormality in the acquisition image but the abnormality is less than a preset degree. In these cases, the acquisition object can be effectively restored. Therefore, if the acquisition image has no abnormality or there is an abnormality in the acquisition image but the abnormality is less than a preset degree, the acquisition image generated based on the adjusted initial gain value is determined to be a normal image. The preset degree is the degree of abnormality when there is a difference in the acquisition image but the feature data extracted from the acquisition image can restore the acquisition object. The value of the preset degree is not limited in this embodiment.

[0094] The above-mentioned signal processing device, if the acquired image generated based on the adjusted initial gain value is a normal image, restores the initial gain value of the processing mode, that is, restores the initial gain value of the processing mode to the original value, so as to process the acquired signal through the initial gain value. Since the initial gain value of the processing mode is at the original value, it can adapt to a variety of situations, thereby being able to adapt to the processing and restoration requirements of the acquired image in a variety of scenarios, thereby improving the restoration accuracy and efficiency.

[0095] The embodiment of the present application further provides an electronic device, comprising: a processor and a memory for storing instructions executable by the processor, wherein the processor is configured to execute the instructions to implement the above signal processing method.

[0096] An embodiment of the present application also provides a storage medium, in which instructions are stored. When the instructions in the storage medium are executed, the above-mentioned signal processing method is implemented.

[0097] It should be noted that the various embodiments in this specification can be described in a progressive manner, and the features recorded in the various embodiments in this specification can be replaced or combined with each other. Each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0098] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0099] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

[0100] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A signal processing method, comprising: Acquire a collection signal for representing image information, input the collection signal into an analog-to-digital converter, so that the analog-to-digital converter performs analog-to-digital conversion on the collection signal based on an initial gain value in a processing mode to obtain a collection image, wherein the processing mode at least includes an initial gain value, and the collection signal is obtained by an optical sensor; Determining the adjustment gain value based on the degree of abnormality of the acquired image; Based on the adjusted gain value, the initial gain value of the processing mode is replaced with the adjusted gain value; wherein, the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment again by processing according to the adjusted processing mode is greater than the effective image in the acquisition image generated by obtaining the acquisition signal under the same environment by processing according to the pre-adjustment processing mode.

2. The method according to claim 1, wherein determining the adjustment gain value based on the abnormality degree of the acquired image comprises: If the collected image has a first abnormality degree, determining the adjustment gain value to be a first adjustment gain value; If the collected image has a second abnormality degree, determining the adjustment gain value to a second adjustment gain value; If the first abnormality degree is greater than the second abnormality degree, the difference between the first adjusted gain value and the initial gain value is greater than the difference between the second adjusted gain value and the initial gain value.

3. According to the method of claim 1 or 2, the adjusted gain value is smaller than the initial gain value, and the relationship between the difference between the adjusted gain value and the initial gain value and the abnormality degree is that the difference is proportional to the abnormality degree.

4. The method according to claim 1, further comprising: If the collected image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is restored.

5. According to the method of claim 1, the step of acquiring a collection signal for representing image information comprises: If fingerprint input is detected, an acquisition signal for representing fingerprint image information is obtained using the under-screen optical sensor, wherein the fingerprint image in the acquisition image generated by processing the acquisition signal according to the processing mode is the valid image.

6. According to the method of claim 1, the method for obtaining the degree of abnormality of the acquired image comprises: Determine an abnormal region in the acquired image where an abnormality exists; Acquire the area occupied by the abnormal area in the acquired image; determining the degree of abnormality according to the area; or Obtaining the brightness value of each pixel in the acquired image; The abnormality degree is determined according to the brightness value of each pixel point and the brightness value of the screen displaying the collected image.

7. A signal processing device, comprising: an acquisition unit, configured to acquire an acquisition signal for representing image information, and input the acquisition signal into an analog-to-digital converter, so that the analog-to-digital converter performs analog-to-digital conversion on the acquisition signal based on an initial gain value in a processing mode to obtain an acquisition image, wherein the processing mode at least includes an initial gain value, and the acquisition signal is obtained by an optical sensor; A determination unit, configured to determine an adjustment gain value based on the degree of abnormality of the acquired image; An adjustment unit is used to replace the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value; wherein, a valid image in a captured image generated by re-obtaining the captured signal under the same environment by processing in accordance with the adjusted processing mode is greater than a valid image in a captured image generated by obtaining the captured signal under the same environment by processing in accordance with the adjusted processing mode.

8. The device according to claim 7, wherein the adjusted gain value is smaller than the initial gain value, and the relationship between the difference between the adjusted gain value and the initial gain value and the abnormality degree is that the difference is proportional to the abnormality degree.

9. The device according to claim 7, further comprising: The restoring unit is used to restore the initial gain value of the processing mode if the collected image generated based on the adjusted initial gain value is a normal image.

10. The device according to claim 7, wherein the acquisition unit is used to obtain a collection signal for representing fingerprint image information using the under-screen optical sensor if a fingerprint input is detected, wherein: The fingerprint image in the collected image generated by processing the collected signal according to the processing mode is the valid image.

Citation Information

Patent Citations

  • Image processor

    JP2011151521A

  • Apparatus and method for processing an image to control auto white balance of image sensor

    KR100724253B1

  • Enhancing image quality based on characteristics of a reference region of interest

    US10621709B1

  • Authentication apparatus employing image, method of authentication, authentication program product, and storage medium having the program stored therein

    US20060215887A1