Image generation method, device, image sensor and storage medium

By correcting the original digital image signal value of the image sensor, the problem of low image quality generated by the image sensor is solved, eliminating the influence of noise, and improving the quality and balance of the image.

CN116055902BActive Publication Date: 2024-11-22SHENZHEN RUISHIZHIXIN TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202211729410.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-30
Publication Date
2024-11-22
Estimated Expiration
2042-12-30

AI Technical Summary

Technical Problem

The image sensor directly generates images based on the original digital image signal values ​​in the original image file, resulting in lower image quality, especially in color image scenes with more significant impact on noise factors.

Method used

By calling the target pixel position and correction parameters in the preset correction file, the original digital image signal value is corrected, the effective digital image signal value is calculated, and the target output image is generated based on all pixel positions to eliminate noise factors in the sensor output signal.

Benefits of technology

Improve the quality of the image, eliminate the influence of noise, avoid image color cast and proportional offset, and ensure the balance and quality of the image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116055902B_ABST
    Figure CN116055902B_ABST
Patent Text Reader

Abstract

The present application provides an image generation method, device, image sensor and storage medium, the method comprising: after the image sensor generates an original image file at the actual working moment, calling the target pixel position and the corresponding correction parameters stored in the preset correction file; correcting the original digital image signal value corresponding to the target pixel position according to the correction parameters to obtain the corrected digital image signal value; calculating the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculating the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value; combining the effective digital image signal values ​​of all pixel positions to generate the target output image. Through the implementation of the scheme of the present application, the original digital image signal values ​​of some pixel positions are locally corrected, and then the target output image is generated by combining the effective digital image signal values ​​of all pixel positions, so as to eliminate the noise factors introduced in the sensor output signal and improve the quality of the target output image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of image sensors, and in particular to an image generation method, device, image sensor and storage medium. Background Art

[0002] With the continuous development of science and technology, image sensors are widely used in products such as smart phones, digital cameras, and security cameras. At present, when image sensors are in working state, they usually directly obtain the original digital image signal values ​​in the original image file to generate images without considering the influence of noise factors, resulting in low quality of the final generated image. Especially in the scenario where the image sensor generates color images, for image sensors based on the Bayer array, interpolation method is required to generate color images, and the noise factor has a greater impact on the quality of the final generated color image. Summary of the invention

[0003] The embodiments of the present application provide an image generation method, device, image sensor and storage medium, which can at least solve the problem of low image quality caused by the image sensor in the related art directly generating an image based on the original digital image signal value in the original image file.

[0004] A first aspect of an embodiment of the present application provides an image generation method, comprising: after an image sensor generates an original image file at an actual working moment, calling a target pixel position and corresponding correction parameters stored in a preset correction file; wherein the original image file includes the original digital image signal value corresponding to each pixel position in the overall pixel array; correcting the original digital image signal value corresponding to the target pixel position according to the correction parameter to obtain a corrected digital image signal value; calculating an effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculating the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value; and generating a target output image by combining the effective digital image signal values ​​of all the pixel positions.

[0005] A second aspect of an embodiment of the present application provides an image generating device, comprising: a calling module, for calling the target pixel position and the corresponding correction parameters stored in a preset correction file after the image sensor generates an original image file at the actual working moment; wherein the original image file includes the original digital image signal value corresponding to each pixel position in the overall pixel array; a correction module, for correcting the original digital image signal value corresponding to the target pixel position according to the correction parameter to obtain a corrected digital image signal value; a calculation module, for calculating the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculating the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value; a generation module, for combining the effective digital image signal values ​​of all the pixel positions to generate a target output image.

[0006] A third aspect of an embodiment of the present application provides an image sensor, comprising: a memory and a processor, wherein the processor is used to execute a computer program stored in the memory, and when the processor executes the computer program, it implements each step of the image generation method provided in the first aspect of the embodiment of the present application.

[0007] The fourth aspect of the embodiments of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the image generation method provided in the first aspect of the embodiments of the present application are implemented.

[0008] As can be seen from the above, according to the image generation method, device, image sensor and storage medium provided by the scheme of the present application, after the image sensor generates the original image file at the actual working moment, the target pixel position and the corresponding correction parameters stored in the preset correction file are called, wherein the original image file includes the original digital image signal value corresponding to each pixel position in the overall pixel array; the original digital image signal value corresponding to the target pixel position is corrected according to the correction parameter to obtain the corrected digital image signal value; the effective digital image signal value of the target pixel position is calculated based on the corrected digital image signal value, and the effective digital image signal value of other pixel positions except the target pixel position is calculated based on the original digital image signal value; the target output image is generated by combining the effective digital image signal values ​​of all pixel positions. Through the implementation of the scheme of the present application, the original digital image signal values ​​of some pixel positions are locally corrected, and then the target output image is generated by combining the effective digital image signal values ​​of all pixel positions, so as to eliminate the noise factors introduced in the sensor output signal and improve the quality of the target output image. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1A schematic diagram of the basic flow of an image generation method provided in one embodiment of the present application;

[0010] Figure 2 A schematic diagram of assigning values ​​to an entire pixel array provided in one embodiment of the present application;

[0011] Figure 3 A detailed flowchart of an image generation method provided in one embodiment of the present application;

[0012] Figure 4 A schematic diagram of a program module of an image generating device provided in one embodiment of the present application;

[0013] Figure 5 A schematic diagram of the structure of an image sensor provided in one embodiment of the present application. DETAILED DESCRIPTION

[0014] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0015] In the description of the embodiments of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0016] An image generation method, device, image sensor, and storage medium according to an embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0017] In order to solve the problem of low target output image quality caused by the image sensor in the related art directly generating a target output image based on the original digital image signal value in the original image file, an embodiment of the present application provides an image generation method, which is applied to an image sensor. The overall pixel array of the image sensor can preferably be configured as APS (Active-Pixel Sensor) pixels. The active pixel sensor is a commonly used image sensor, in which each pixel sensor unit has a photodetector and at least one active transistor. In a metal oxide semiconductor (MOS) active pixel sensor, a MOS field effect transistor (MOSFET) is used as an amplifier. There are many types of APS, including the early NMOS type APS and the more common CMOS type APS.

[0018] like Figure 1 This is a basic flow chart of an image generation method provided in an embodiment of the present application. The image generation method specifically includes the following steps:

[0019] Step 101: After the image sensor generates an original image file at the actual working moment, the target pixel position and corresponding correction parameters stored in the preset correction file are called.

[0020] Specifically, in this embodiment, when the image sensor enters the working state, the photodetectors configured for each pixel in the overall pixel array synchronously perform light-sensing detection, thereby generating a raw image file (i.e., a RAW file). The raw image file refers to the raw data of the image sensor converting the captured light signal into a digital signal. For the APS image sensor, the raw image file includes the raw digital image signal value corresponding to each pixel position in the overall pixel array. It should be understood that the image sensor of this embodiment is calibrated with a calibration file after the test phase, which is used to calibrate the digital image signal value in the actual working phase. In a preferred embodiment, the above-mentioned digital image signal value can be a grayscale value.

[0021] In an optional manner of the present embodiment, before the step of calling the target pixel position and the corresponding correction parameters stored in the preset correction file, the step also includes: obtaining the original image file generated by the image sensor under dark field conditions at the test working time; calculating the average noise digital image signal value associated with the dark current based on the original digital image signal value in the original image file; and generating a correction file according to the average noise digital image signal value.

[0022] Specifically, in practical applications, the circuit of the image sensor has dark current, which causes the pixel circuit to generate a certain output voltage when there is no light, thereby generating dark current. Then, under lighting conditions, the output signal of the image sensor is the effective signal superimposed with the dark current signal, resulting in obvious dark noise in the output signal. When the dark current is too large, it will have a significant impact on the transparency, contrast, clarity, etc. of the output image.

[0023] Based on this, in the test phase, the present embodiment controls the image sensor to work under dark field conditions, and the generated raw digital image signal value corresponds to the dark current signal. By averaging the raw digital image signal values ​​at all pixel positions, the average noise digital image signal value associated with the dark current can be obtained, and then the correction file is calibrated based on the average noise digital image signal value. It should be noted that in the present embodiment, part of the pixel array area in the overall pixel array of the image sensor can be controlled to be in dark field conditions, that is, part of the pixels in the overall pixel array are used as light-shielding pixels, so that part of the pixels work in the dark, so as to obtain the average noise digital image signal value.

[0024] Furthermore, in an optional manner of the present embodiment, the above-mentioned step of generating a correction file based on the average noise digital image signal value includes: obtaining a fractional part value of the average noise digital image signal value, and obtaining a total number of pixels of the entire pixel array; and generating a correction file based on the fractional part value and the total number of pixels.

[0025] Specifically, in the related art, when grayscale correction is performed on an image sensor, the correction of the decimal part of the dark current signal is usually not considered. When the average noise digital image signal value is 4.4, usually only the integer part of the average noise digital image signal value caused by the dark current is considered to be corrected, that is, the decimal part of the average digital image signal value 0.4 is used as the effective signal component, which will cause image color cast and imbalance. This imbalance will change the ratio between RGB and produce color cast. In this embodiment, the decimal part of the average noise digital image signal value is also confirmed as the dark current signal to be corrected, and a correction file is generated accordingly to improve the quality of the target output image generated by the image sensor during actual work.

[0026] Furthermore, in an optional method of the present embodiment, the above-mentioned step of generating a correction file based on the decimal part value and the total number of pixels includes: inputting the decimal part value and the total number of pixels into a preset indicator calculation formula to calculate the number of pixels to be corrected and the correction parameters; generating a correction file based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array; wherein the correction parameters of all target pixel positions are equal.

[0027] The above indicator calculation formula can be expressed as:

[0028] a*b=C(m*n),

[0029] C*n=1;

[0030] Among them, a represents the decimal value, b represents the total number of pixels, C represents a known constant, m represents the number of pixels to be corrected, and n represents the correction parameter and its value is negative.

[0031] Specifically, this embodiment multiplies the fractional value by the total number of pixels, and the result is the regression of the fractional value of the unit pixel to the total value of the entire pixel array of the image sensor. The final product is the total value of the fractional value of the average dark current signal that needs to be corrected for the entire pixel array. Figure 2 The figure shows a schematic diagram of the assignment of an overall pixel array provided by the present embodiment. The pixel positions marked with "-1" in the figure are all the target pixel positions of the present embodiment. The figure shows that 10 pixel positions in the overall pixel array are used as pixels to be corrected, and the corresponding correction parameters of these 10 pixels to be corrected are all "-1". In the present embodiment, the value of C can preferably be -1, so the value of n is also -1. Continuing with the example that the decimal part of the average noise digital image signal value is 0.4, if the size of the overall pixel array is 5*5, that is, the overall pixel array includes 25 pixels, then the value of m is 10, that is, 10 pixels are selected from a total of 25 pixels as pixels to be corrected, and the correction parameters of these pixels are all assigned to -1. It is worth noting that in the present embodiment Figure 2 The size of the overall pixel array shown is only an exemplary description and does not limit the size of the pixel array in actual applications.

[0032] Of course, in practical applications, the value of C and / or the value of n can also be other values. For example, if C is -0.5 and n is still -1, then the value of m is 20, that is, 20 pixels are selected from a total of 25 pixels as pixels to be corrected, and the correction parameter value of -1 is assigned to each pixel; or, if the value of C is -1 and the value of n is -2, then the value of m is 5, that is, 5 pixels are selected from a total of 25 pixels as pixels to be corrected, and the correction parameter value of -2 is assigned to each pixel. It should be understood that the above description of this embodiment is only a partial exemplary implementation, and does not constitute the sole limitation of this embodiment.

[0033] Step 102: Correct the original digital image signal value corresponding to the target pixel position according to the correction parameter to obtain a corrected digital image signal value.

[0034] Specifically, in this embodiment, in order to correct the fractional part of the average noise digital image signal value caused by the dark current signal, the positions of some pixels to be corrected are determined from the overall pixel array based on the correction file, and the correction parameters preset in the correction file are used to perform the first stage correction on the original digital image signal value, that is, to correct the original signal of the local pixel, so as to achieve the correction of the fractional part of the average noise digital image signal value.

[0035] Step 103: Calculate the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculate the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value.

[0036] Specifically, the present embodiment further performs a second stage correction on all pixels in the overall pixel array, which can be understood as correcting the integer part of the average noise digital image signal value, wherein, for the target pixel position, the correction basis is the corrected digital image signal value after the first stage correction, and for other pixel positions on the overall pixel array, the correction basis is the corresponding original digital image signal value in the original image file.

[0037] In an optional implementation of the present embodiment, the above-mentioned steps of calculating the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculating the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value, include: calculating the difference between the corrected digital image signal value and the integer part value of the average noise digital image signal value to obtain the effective digital image signal value of the target pixel position, and calculating the difference between the original digital image signal value and the integer part value of other pixel positions except the target pixel position to obtain the effective digital image signal values ​​of other pixel positions.

[0038] Specifically, this embodiment further illustrates the above-mentioned average noise digital image signal value of 4.4, and the integer part of the average noise digital image signal value is also 4. Therefore, when performing the second stage correction, the calculated value obtained by subtracting 4 from the corrected digital image signal value of the target pixel position is the effective digital image signal value of the target pixel position. Similarly, the calculated value obtained by subtracting 4 from the original digital image signal value of other pixel positions is the effective digital image signal value of other pixel positions.

[0039] Step 104: Generate a target output image by combining the valid digital image signal values ​​at all pixel positions.

[0040] Specifically, after the aforementioned correction process, the original digital image signal value of the pixel is corrected for dark current noise, so that the final obtained values ​​are all valid digital image signal values, and the target output image generated finally eliminates the dark current influence of the sensor circuit itself, effectively improving the output target output image quality. It should be understood that the type of the target output image of this embodiment can be a grayscale image or a color image.

[0041] In an optional implementation of the present embodiment, before the above-mentioned step of inputting the decimal value and the total number of pixels into the preset index calculation formula to calculate the number of pixels to be corrected and the correction parameters, it also includes: determining corresponding known constants according to different scene dynamic levels. Accordingly, based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array, the step of generating a correction file includes: for each scene dynamic level, based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array, generating a corresponding correction file. Accordingly, the step of calling the target pixel position and the corresponding correction parameters stored in the preset correction file includes: calling the corresponding correction file according to the actual scene dynamic level, and obtaining the target pixel position and the corresponding correction parameters stored in the correction file.

[0042] Specifically, this embodiment takes into account that the actual imaging scenes of the image sensor are different, especially the dynamic levels of the scenes are different. For example, the dynamic level is higher in a motion shooting scene or a high ambient brightness, while the dynamic level is relatively lower in a static shooting scene or a low ambient brightness. In order to ensure good imaging quality in different imaging scenes, this embodiment associates different values ​​of the known constant C with different scene dynamic levels, and generates multiple different correction files for different scene dynamic levels accordingly, so that in the actual working process of the image sensor, the correction file can be adaptively called according to the actual scene dynamic level to improve the applicability of the digital image signal value correction mechanism of this embodiment in different imaging scenes.

[0043] Furthermore, in an optional implementation of the present embodiment, before the above-mentioned step of generating a corresponding correction file based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array, it also includes: determining an array area of ​​interest in the overall pixel array according to the scene dynamic level; and selecting target pixel positions corresponding to the number of pixels to be corrected from the array area of ​​interest.

[0044] Specifically, in actual applications, the target pixel position required to participate in the average noise digital image signal value correction can be randomly selected from the overall pixel array. In order to improve the adaptability of the sensor imaging behavior to the actual imaging scene, this embodiment selects a specific array area in the overall pixel array as the array area of ​​interest according to the dynamic level of the actual scene, and selects the target pixel position from the array area of ​​interest.

[0045] Based on the technical solution of the above-mentioned embodiment of the present application, after the image sensor generates the original image file at the actual working moment, the target pixel position and the corresponding correction parameters stored in the preset correction file are called, wherein the original image file includes the original digital image signal values ​​corresponding to each pixel position in the overall pixel array; the original digital image signal values ​​corresponding to the target pixel position are corrected according to the correction parameters to obtain the corrected digital image signal values; the effective digital image signal values ​​of the target pixel position are calculated based on the corrected digital image signal values, and the effective digital image signal values ​​of other pixel positions except the target pixel position are calculated based on the original digital image signal values; the target output image is generated by combining the effective digital image signal values ​​of all pixel positions. Through the implementation of the solution of the present application, the original digital image signal values ​​of some pixel positions are locally corrected, and then the target output image is generated by combining the effective digital image signal values ​​of all pixel positions, so as to eliminate the noise factors introduced in the sensor output signal, avoid image color cast and imbalance of proportion, ensure image balance, and improve the quality of the target output image.

[0046] Next, this embodiment further provides a refined image generation method, such as Figure 3 FIG. 1 is a flow chart of a refined image generation method provided by an embodiment of the present application. The image generation method specifically includes the following steps:

[0047] Step 301, obtaining an original image file generated by an image sensor in a dark field condition during a test operation;

[0048] Step 302, calculating an average noise gray value associated with the dark current based on the original gray value in the original image file;

[0049] Step 303, obtaining the decimal value of the average noise gray value, and obtaining the total number of pixels in the entire pixel array;

[0050] Step 304: input the decimal value and the total number of pixels into a preset indicator calculation formula to calculate the number of pixels to be corrected and the pixel grayscale correction value;

[0051] Step 305, generating a correction file based on the pixel grayscale correction value and the target pixel positions corresponding to the number of pixels to be corrected selected from the entire pixel array;

[0052] Step 306: After the image sensor generates an original image file at the actual working moment, the target pixel position and the corresponding pixel grayscale correction value stored in the preset correction file are called;

[0053] Step 307: Subtract the original grayscale value corresponding to the target pixel position from the pixel grayscale correction value to obtain a corrected grayscale value;

[0054] Step 308: Subtract the corrected grayscale value of the target pixel position from the integer part of the average noise grayscale value to obtain the effective grayscale value of the target pixel position, and subtract the original grayscale value of other pixel positions from the integer part to obtain the effective grayscale values ​​of other pixel positions;

[0055] Step 309: Generate a grayscale image by combining the effective grayscale values ​​of all pixel positions.

[0056] It should be understood that the size of the serial number of each step in this embodiment does not mean the order of execution of the steps. The execution order of each step should be determined by its function and internal logic, and should not constitute a sole limitation on the implementation process of the embodiment of this application.

[0057] Figure 4 An image generating device is provided in one embodiment of the present application. The image generating device can be used to implement the image generating method in the above-mentioned embodiment. The image generating device mainly includes:

[0058] The calling module 401 is used to call the target pixel position and the corresponding correction parameters stored in the preset correction file after the image sensor generates the original image file at the actual working moment; wherein the original image file includes the original digital image signal value corresponding to each pixel position in the overall pixel array;

[0059] A correction module 402, configured to correct the original digital image signal value corresponding to the target pixel position according to the correction parameter to obtain a corrected digital image signal value;

[0060] A calculation module 403, configured to calculate an effective digital image signal value at a target pixel position based on the corrected digital image signal value, and to calculate effective digital image signal values ​​at other pixel positions except the target pixel position based on the original digital image signal value;

[0061] The generating module 404 is used to generate a target output image by combining the valid digital image signal values ​​at all pixel positions.

[0062] In some implementations of this embodiment, the image generating device also includes: an acquisition module, used to acquire the original image file generated by the image sensor under dark field conditions at the time of testing; accordingly, the calculation module is also used to calculate the average noise digital image signal value associated with the dark current based on the original digital image signal value in the original image file; the generation module is also used to generate a correction file based on the average noise digital image signal value.

[0063] In some implementations of this embodiment, when the generation module performs the above-mentioned function of generating a correction file according to the average noise digital image signal value, it is specifically used to: obtain the decimal part value of the average noise digital image signal value, and obtain the total number of pixels of the entire pixel array; generate the correction file based on the decimal part value and the total number of pixels.

[0064] In some implementations of this embodiment, when the generation module performs the above-mentioned function of generating a correction file based on the fractional value and the total number of pixels, it is specifically used to: input the fractional value and the total number of pixels into a preset index calculation formula to calculate the number of pixels to be corrected and the correction parameters; based on the correction parameters and the target pixel position corresponding to the number of pixels to be corrected selected from the entire pixel array, generate a correction file. The index calculation formula is expressed as:

[0065] a*b=C(m*n),

[0066] C*n=1;

[0067] Among them, a represents the decimal value, b represents the total number of pixels, C represents a known constant, m represents the number of pixels to be corrected, and n represents the correction parameter and its value is negative.

[0068] In some implementations of the present embodiment, when the calculation module performs the above-mentioned functions of calculating the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculating the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value, it is specifically used to: calculate the difference between the corrected digital image signal value and the integer part of the average noise digital image signal value to obtain the effective digital image signal value of the target pixel position, and calculate the difference between the original digital image signal value and the integer part of the other pixel positions except the target pixel position to obtain the effective digital image signal values ​​of other pixel positions.

[0069] In some implementations of this embodiment, the image generation device further includes: a determination module, which is used to determine corresponding known constants according to different scene dynamic levels. Accordingly, when the generation module performs the above-mentioned function of generating a correction file based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array, it is specifically used to: generate a corresponding correction file for each scene dynamic level based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array. The calling module is specifically used to: call the corresponding correction file according to the actual scene dynamic level, and obtain the target pixel position and corresponding correction parameters stored in the correction file.

[0070] In some implementations of this embodiment, the determination module is further used to: determine the array region of interest in the overall pixel array according to the scene dynamic level. The image generation device also includes: In addition, the image generation device also includes a selection module for selecting a target pixel position corresponding to the number of pixels to be corrected from the array region of interest.

[0071] It should be noted that the image generating methods in the aforementioned embodiments can all be implemented based on the image generating device provided in this embodiment. Ordinary technical personnel in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the image generating device described in this embodiment can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0072] Figure 5 An image sensor provided in one embodiment of the present application can be used to implement the image generation method in the aforementioned embodiment, mainly comprising:

[0073] The memory 501, the processor 502, and the computer program 503 stored in the memory 501 and executable on the processor 502 are connected to the memory 501 and the processor 502 via communication. When the processor 502 executes the computer program 503, the method in the aforementioned embodiment is implemented. The number of processors may be one or more.

[0074] The memory 501 may be a high-speed random access memory (RAM) memory, or a non-volatile memory, such as a disk memory. The memory 501 is used to store executable program codes, and the processor 502 is coupled to the memory 501 .

[0075] Furthermore, the present application embodiment also provides a computer-readable storage medium, which may be disposed in the image sensor in the above embodiment. The computer-readable storage medium may be the above Figure 5Memory in the illustrated embodiment.

[0076] The computer readable storage medium stores a computer program, and when the program is executed by the processor, the image generation method in the aforementioned embodiment is implemented. Furthermore, the computer storable medium can also be a U disk, a mobile hard disk, a read-only memory (ROM), a RAM, a magnetic disk or an optical disk, and other media that can store program codes.

[0077] It should also be noted that the devices and methods disclosed in the several embodiments provided in this application can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0078] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0079] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0080] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a readable storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned readable storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks, or optical disks.

[0081] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0082] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0083] The above is a description of the image generation method, device, image sensor and storage medium provided in the present application. For technicians in this field, according to the ideas of the embodiments of the present application, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An image generation method, characterized in that: include: After the image sensor generates an original image file at the actual working moment, the target pixel position and the corresponding correction parameters stored in the preset correction file are called; wherein the original image file includes the original digital image signal value corresponding to each pixel position in the overall pixel array; Correcting the original digital image signal value corresponding to the target pixel position according to the correction parameter to obtain a corrected digital image signal value; Calculating the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculating the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value; Combining the valid digital image signal values ​​of all the pixel positions to generate a target output image; Before the step of calling the target pixel position and the corresponding correction parameters stored in the preset correction file, the method also includes: obtaining an original image file generated by the image sensor under dark field conditions at the time of testing; calculating an average noise digital image signal value associated with the dark current based on the original digital image signal value in the original image file; obtaining a fractional part value of the average noise digital image signal value, and obtaining the total number of pixels of the overall pixel array; and generating the correction file based on the fractional part value and the total number of pixels.

2. The image generation method according to claim 1, characterized in that: The step of generating the correction file based on the fractional value and the total number of pixels comprises: The decimal value and the total number of pixels are input into a preset index calculation formula to calculate the number of pixels to be corrected and the correction parameters; the index calculation formula is expressed as: a*b=C(m*n), C*n=1; Wherein, a represents the decimal value, b represents the total number of pixels, C represents a known constant, m represents the number of pixels to be corrected, and n represents the correction parameter and is a negative value; The correction file is generated based on the correction parameters and target pixel positions selected from the overall pixel array corresponding to the number of pixels to be corrected.

3. The image generation method according to claim 1, characterized in that: The step of calculating the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and calculating the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value, comprises: The difference between the corrected digital image signal value and the integer part value of the average noise digital image signal value is calculated to obtain the effective digital image signal value of the target pixel position, and the difference between the original digital image signal value and the integer part value of other pixel positions except the target pixel position is calculated to obtain the effective digital image signal values ​​of the other pixel positions.

4. The image generation method according to claim 2, characterized in that: Before the step of inputting the decimal value and the total number of pixels into a preset indicator calculation formula to calculate the number of pixels to be corrected and the correction parameters, the step further includes: Determine the corresponding known constants according to different scene dynamic levels; The step of generating the correction file based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array comprises: For each of the scene dynamic levels, generating the corresponding correction file based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array; The step of calling the target pixel position and the corresponding correction parameters stored in the preset correction file includes: The corresponding correction file is called according to the actual scene dynamic level, and the target pixel position and corresponding correction parameters stored in the correction file are obtained.

5. The image generation method according to claim 4, characterized in that: Before the step of generating the corresponding correction file based on the correction parameters and the target pixel positions corresponding to the number of pixels to be corrected selected from the overall pixel array, the method further includes: Determining an array region of interest in the overall pixel array according to the scene dynamic level; The target pixel positions corresponding to the number of pixels to be corrected are selected from the array region of interest.

6. An image generating device, characterized in that: include: A calling module, used for calling the target pixel position and the corresponding correction parameters stored in the preset correction file after the image sensor generates the original image file at the actual working moment; wherein the original image file includes the original digital image signal value corresponding to each pixel position in the overall pixel array; A correction module, used for correcting the original digital image signal value corresponding to the target pixel position according to the correction parameter to obtain a corrected digital image signal value; a calculation module, configured to calculate the effective digital image signal value of the target pixel position based on the corrected digital image signal value, and to calculate the effective digital image signal values ​​of other pixel positions except the target pixel position based on the original digital image signal value; A generating module, configured to generate a target output image by combining the valid digital image signal values ​​at all the pixel positions; An acquisition module, used for acquiring an original image file generated by the image sensor in a dark field condition at the time of the test operation; The calculation module is further used to: calculate an average noise digital image signal value associated with a dark current based on the original digital image signal value in the original image file; The generation module is also used to: obtain the fractional value of the average noise digital image signal value, and obtain the total number of pixels of the entire pixel array; and generate the correction file based on the fractional value and the total number of pixels.

7. An image sensor, characterized in that: The device comprises a memory and a processor, wherein: The processor is used to execute the computer program stored in the memory; When the processor executes the computer program, the steps of the image generating method according to any one of claims 1 to 5 are implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the image generating method according to any one of claims 1 to 5 are implemented.