An image acquisition device, method and related apparatus

By combining a layered arrangement of a light-transmitting photosensitive element and a data processing unit, the problem of insufficient image restoration accuracy in lensless imaging technology is solved, achieving efficient and economical image acquisition, which is suitable for small-volume target objects.

CN116320682BActive Publication Date: 2026-06-23INST OF MICROELECTRONICS CHINESE ACAD OF SCI LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
INST OF MICROELECTRONICS CHINESE ACAD OF SCI LTD
Filing Date
2023-03-16
Publication Date
2026-06-23

Smart Images

  • Figure CN116320682B_ABST
    Figure CN116320682B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides an image acquisition device, method and related equipment, and relates to the technical field of image acquisition, so as to solve the problem that the image restoration precision of the current lens-free imaging technology is poor, the array density of the photosensitive device in the photosensitive device is improved, which leads to the increase of the surface area of the photosensitive device, the increase of the manufacturing cost, and the color sensitivity of the small volume target object is not obviously enhanced, thereby affecting the practicability and convenience of the lens-free acquisition technology. The device comprises: at least two photosensitive device layers, wherein at least one of the photosensitive device layers close to the target object is used for light transmission, the photosensitive device layer comprises at least one photosensitive device, and the at least two photosensitive layers are stacked; each photosensitive device layer is used for acquiring a group of image data of the target object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of image acquisition technology, and in particular to an image acquisition device, method and related equipment. Background Technology

[0002] With the development of science and technology and the progress of society, image acquisition technology is also evolving. Lensless imaging technology is a new type of imaging technology that typically uses a photosensitive device instead of a traditional optical lens. An imaging model is trained to reconstruct the image of the target from the data acquired by the photosensitive device. Because lensless imaging technology does not require a traditional optical lens, the design of such systems does not need to consider the impact of factors such as focal length on camera image quality, greatly reducing the system's size.

[0003] However, in the current lensless imaging technology for image acquisition, since data acquisition relies on photosensitive devices, the accuracy of image reproduction is significantly affected by the color sensitivity of these devices. Currently, the main approach to improving image reproduction accuracy is to increase the array density of the photosensitive devices to enhance their color sensitivity, essentially increasing the number of pixels to improve the clarity and accuracy of the reproduced image. However, increasing the array density leads to a larger surface area of ​​the photosensitive devices, increasing manufacturing costs, and the enhancement effect on color sensitivity for small objects is not significant, thus affecting the practicality and convenience of lensless acquisition technology. Summary of the Invention

[0004] This application provides an image acquisition device, method, and related equipment, relating to the field of image acquisition technology, to address the problems of poor image restoration accuracy in current lensless imaging technology, the increase in the surface area of ​​the photosensitive device due to the array density of the photosensitive device, the increase in manufacturing cost, and the lack of significant enhancement effect on the color sensitivity of small target objects, thus affecting the practicality and convenience of lensless acquisition technology.

[0005] A first aspect of this application provides an image acquisition device, comprising:

[0006] At least two photosensitive layers, wherein at least one photosensitive layer near the target object is used for light transmission, the photosensitive layer includes at least one photosensitive device, and at least two photosensitive layers are stacked.

[0007] Each of the photosensitive layers is used to acquire a set of image data of the target object.

[0008] In some embodiments, each of the photosensitive device layers includes a plurality of the photosensitive devices, and the plurality of photosensitive devices are arranged in an array;

[0009] The image acquisition device further includes:

[0010] A first data processing unit, wherein the input terminal of the first data processing unit is electrically connected to the output terminal of at least one of the photosensitive device layers, and the first data processing unit is used to obtain first image data corresponding to the photosensitive device layer according to the array mode of the photosensitive devices in the photosensitive device layer and the corresponding image data;

[0011] The second data processing unit has its input terminal electrically connected to the output terminal of the first data processing unit. The second data processing unit is used to obtain the imaging data of the target object according to the stacking order of all the photosensitive device layers and all the first image data.

[0012] In some embodiments, the second data processing unit is used to superimpose all the first image data according to the stacking order of the photosensitive device layers and the alignment of each pixel in the first image data to obtain the imaging data.

[0013] In some embodiments, the image acquisition device further includes:

[0014] The control unit has its input terminal electrically connected to the output terminal of the first data processing unit, and its output terminal electrically connected to the input terminals of at least two of the photosensitive device layers.

[0015] The control unit is used to control the switching state of at least one of the photosensitive devices in at least one second photosensitive device layer according to the first image data corresponding to the first photosensitive device layer, wherein the first photosensitive device layer is the light-transmitting photosensitive device layer that is closest to the target object, and the second photosensitive device layer is any other photosensitive device layer besides the first photosensitive device layer.

[0016] In some embodiments, the image acquisition device further includes:

[0017] An illumination acquisition unit, the output of which is connected to the input of the control unit, is used to acquire illumination data of the environment in which at least two photosensitive device layers are located, wherein the illumination data includes illumination intensity and / or illumination direction.

[0018] In some embodiments, the image acquisition device further includes:

[0019] The third image processing unit has its input terminal electrically connected to the output terminal of the illumination acquisition unit and the output terminal of the second data processing unit, respectively. The third image processing unit is used to determine the correction parameters of the imaging data based on the illumination data, and to correct the imaging data based on the correction parameters.

[0020] A second aspect of this application provides an image acquisition method, applied to any of the image acquisition devices described in the first aspect above, the method comprising:

[0021] At least two sets of image data of the target object are acquired through at least two of the photosensitive device layers.

[0022] In some embodiments, the image acquisition method further includes:

[0023] The second data processing unit, based on the stacking order of the photosensitive device layers, superimposes all the first image data according to the alignment of each pixel in the first image data to obtain the imaging data.

[0024] In some embodiments, prior to the step of acquiring at least two sets of image data of the target object through at least two photosensitive layers, the method further includes:

[0025] The control unit adjusts the light transmittance parameter of the first photosensitive layer based on the illumination data of the environment in which at least two photosensitive layers are located.

[0026] And / or,

[0027] The control unit adjusts the target distance between the first photosensitive layer and the target object based on the illumination data of the environment in which at least two photosensitive layers are located.

[0028] And / or,

[0029] The control unit adjusts the light transmission parameters of the second photosensitive layer and / or the arrangement order of the second photosensitive layer according to the first image data corresponding to the first photosensitive layer.

[0030] A third aspect of this application also provides an electronic device, including:

[0031] The image acquisition apparatus as described in any of the first aspects above. A memory and a processor, the processor being configured to execute a computer program stored in the memory to implement the steps of the image acquisition method as described in any of the second aspects above.

[0032] This application embodiment uses at least two photosensitive device layers stacked together, with at least one photosensitive device layer close to the target object for light transmission. Therefore, the light-transmitting photosensitive layer allows light to pass through to the other photosensitive layers, enabling the simultaneous acquisition of at least two sets of image data about the target object from at least two photosensitive device layers. This increases the amount of data acquired in a single session, improves data acquisition efficiency, and increases the amount of sample analysis, thereby increasing the training data for the image reconstruction model, improving the accuracy of the image reconstruction model, and ultimately enhancing the accuracy of image reconstruction, the practicality of the image acquisition device, and the quality of image reconstruction. Attached Figure Description

[0033] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 A schematic structural diagram of an image acquisition device provided in an embodiment of this application;

[0035] Figure 2 A schematic flowchart illustrating an image acquisition method provided in an embodiment of this application;

[0036] Figure 3 A schematic structural diagram of an electronic device provided in an embodiment of this application;

[0037] Figure 4 This is a schematic structural diagram of a computer-readable storage medium provided in an embodiment of this application. Detailed Implementation

[0038] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims. In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can also be implemented in other ways, and the apparatus embodiments described below are merely exemplary.

[0039] Figure 1 This is a schematic structural diagram of an image acquisition device provided in an embodiment of this application. Figure 1As shown, this application embodiment provides an image acquisition device 100, including: at least two photosensitive device layers 110, wherein at least one photosensitive device layer close to the target object is used for light transmission, the photosensitive device layer includes at least one photosensitive device 111, and at least two photosensitive layers are stacked; each photosensitive device layer is used to acquire a set of image data of the target object.

[0040] By stacking at least two photosensitive layers, with at least one photosensitive layer close to the target object for light transmission, the light-transmitting photosensitive layer can allow light to pass through to the other photosensitive layers. Therefore, at least two sets of image data about the target object from at least two photosensitive layers can be acquired simultaneously. This increases the amount of data acquired in a single session, improves data acquisition efficiency, and increases the number of samples analyzed. This, in turn, increases the training data for the image reconstruction model, improves the accuracy of the image reconstruction model, and consequently enhances the accuracy of image reconstruction, thereby improving the practicality of the image acquisition device and the quality of image reconstruction.

[0041] In some feasible implementations, each photosensitive layer includes multiple photosensitive devices arranged in an array.

[0042] By arraying multiple photosensitive devices within each photosensitive layer, the acquisition range of each device can be easily determined based on its array arrangement. Furthermore, based on the characteristics of the photosensitive devices, the array arrangement, and the acquisition range, the confidence acquisition interval for each photosensitive device can be determined. Subsequently, based on the confidence acquisition interval of each photosensitive device and the image data it acquires, the image data of the photosensitive layer to which that photosensitive device belongs can be determined. This improves the data acquisition capability of each photosensitive layer, enhances the quality of image data acquisition, and consequently improves the accuracy of image reconstruction, thereby enhancing the practicality of the image acquisition device and the quality of image reconstruction.

[0043] In some feasible implementations, the above-mentioned image acquisition device further includes:

[0044] The first data processing unit has its input terminal electrically connected to the output terminal of at least one photosensitive device layer. The first data processing unit is used to obtain the first image data corresponding to the photosensitive device layer according to the array mode of the photosensitive devices in the photosensitive device layer and the corresponding image data.

[0045] The second data processing unit has its input terminal electrically connected to the output terminal of the first data processing unit. The second data processing unit is used to obtain the imaging data of the target object based on the stacking order of all photosensitive device layers and all first image data.

[0046] For example, an image reconstruction model of an image acquisition device can be established. The image reconstruction model can determine the acquisition range of each photosensitive device based on the image data corresponding to each photosensitive device in the same photosensitive device layer and the array arrangement of the photosensitive devices. Based on the array arrangement and acquisition range of each photosensitive device, the confidence acquisition interval of each photosensitive device can be determined. Then, based on the confidence acquisition interval of each photosensitive device and the image data acquired, the first image data of the photosensitive device layer to which the photosensitive device belongs can be determined.

[0047] For example, the stacking order described above can be determined by the distance order between the photosensitive device and the target object. At least two photosensitive device layers can be tightly fitted together, thereby saving the volume of the image acquisition device, or they can be spaced a certain distance apart, thereby avoiding reflection between the at least two photosensitive device layers, which would cause color deviation in the photosensitive device and reduce accuracy, thus improving the image reproduction quality of the image acquisition device.

[0048] For example, the image reconstruction model described above can be established based on the light transmittance characteristics of each photosensitive layer. These light transmittance characteristics can be the light transmittance of the photosensitive layer. Since photosensitive layers with low light transmittance scatter light, for the first image data of a photosensitive layer located on the side of the photosensitive layer furthest from the target object, it is necessary to determine the diffusion effect of the preceding photosensitive layer on the associated first image data based on the light transmittance of the preceding photosensitive layer. Thus, the relative position of the first image data associated with the subsequent photosensitive layer relative to the first image data associated with the preceding photosensitive layer can be determined based on the diffusion effect. Based on the relative position of the two, the relative position of the first image data acquired by the subsequent photosensitive layer relative to the target object can be determined.

[0049] For example, the aforementioned light transmission characteristic can be the color of the photosensitive layer. Since the colored photosensitive layer absorbs light of a specific wavelength, the effect of the previous photosensitive layer on light can be determined based on the color of the photosensitive layer. Thus, the light entering the next photosensitive layer can be determined based on the second image information of the previous photosensitive layer. Based on the second image information of the next photosensitive layer and the aforementioned light entering the next photosensitive layer, the image reconstruction model of the image acquisition device can be corrected.

[0050] By stacking at least two photosensitive layers and setting the photosensitive layer closest to the target object as a light-transmitting photosensitive layer, at least two sets of image data collected by the photosensitive devices in at least two photosensitive layers can be acquired simultaneously. Based on the array configuration of the photosensitive devices in the photosensitive layer, image data from the same photosensitive layer can be combined to obtain the first image data of that layer. Furthermore, since different light-transmitting photosensitive layers have different light transmission characteristics, the imaging results of the target object will differ when the same type of photosensitive layer is arranged on different sides of the light-transmitting photosensitive layer away from the target object. Therefore, by setting a light-transmitting photosensitive layer, the photosensitive layer on the side of the light-transmitting photosensitive layer away from the target object can have a certain filtering effect, and the filtering effect of a light-transmitting photosensitive layer with known composition can be determined. Therefore, by combining the arrangement and light transmission characteristics of the photosensitive layer, the change in light received by the subsequent photosensitive layer on the side of the transparent photosensitive layer away from the target object relative to the previous transparent photosensitive layer can be determined. Thus, a mapping relationship between the two and their associated second image information can be established based on the difference, thereby improving the image restoration model, which in turn can improve the accuracy of image restoration, and further improve the practicality of the image acquisition device and the image acquisition quality.

[0051] In some feasible implementations, the second data processing unit is used to superimpose all the first image data according to the stacking order of the photosensitive device layers and the alignment of each pixel in the first image data to obtain imaging data.

[0052] The second data processing unit acquires imaging data based on the stacking order of the photosensitive device layers and the alignment of each pixel in the first image data, which can improve the image acquisition quality.

[0053] In some feasible implementations, the image acquisition device further includes:

[0054] The control unit has its input terminal electrically connected to the output terminal of the first data processing unit, and its output terminal electrically connected to the input terminals of at least two photosensitive device layers.

[0055] The control unit is used to control the switching state of at least one photosensitive device in at least one second photosensitive device layer according to the first image data corresponding to the first photosensitive device layer, wherein the first photosensitive device layer is the light-transmitting photosensitive device layer closest to the target object, and the second photosensitive device layer is any other photosensitive device layer besides the first photosensitive device layer.

[0056] For example, the outline of the target object can be determined based on the first image data of the first photosensitive device layer, and the effective acquisition range of the second photosensitive device layer relative to the target object can be determined based on the outline of the target object. The photosensitive devices within the effective acquisition range of the second photosensitive device layer are turned on, and other photosensitive devices are turned off.

[0057] Since the first photosensitive layer is closest to the target object, it is necessary to keep the photosensitive devices in the first photosensitive layer fully on to locate the target object. By controlling the on / off state of the photosensitive devices in the second photosensitive layer based on the first image data associated with the first photosensitive layer, the same number of photosensitive devices can be avoided for target objects of different sizes, which would increase the amount of data processing and energy consumption. This can save energy and computing power and improve the efficiency of data processing.

[0058] In some feasible implementations, the image acquisition device further includes:

[0059] The illumination acquisition unit has its output connected to the input of the control unit and is used to acquire illumination data of the environment in which at least two photosensitive device layers are located. The illumination data includes illumination intensity and / or illumination direction.

[0060] Since the light intensity and direction of the environment in which the photosensitive layer is located have a certain impact on the imaging of the photosensitive layer during the image acquisition process, obtaining the light data of the environment in which the photosensitive layer is located can facilitate the evaluation of image restoration quality, and thus the image can be corrected, thereby improving the practicality and integration of the image acquisition device.

[0061] In some feasible implementations, the image acquisition device further includes:

[0062] The third image processing unit has its input terminal electrically connected to the output terminal of the illumination acquisition unit and the output terminal of the second data processing unit, respectively. The third image processing unit is used to determine the correction parameters of the imaging data based on the illumination data, and to correct the imaging data based on the correction parameters.

[0063] The relative relationship between the image acquisition direction and the illumination direction of the photosensitive layer can be determined by the illumination direction of the environment surrounding the photosensitive layer. When the target object is located between the photosensitive layer and the light source, the photosensitive layer is in a backlight acquisition state during image acquisition, resulting in a clearer outline in the obtained third image compared to internal details. Therefore, by combining illumination intensity and illumination direction, the impact of the light source on the imaging data under backlight acquisition state can be determined. This allows for the determination of imaging data correction parameters, adjustment of the image restoration model, and improvement of image restoration quality, thereby enhancing the practicality and convenience of the image acquisition device.

[0064] Figure 2 This is an illustrative flowchart of an image acquisition method provided in an embodiment of this application. For example... Figure 2 As shown, this application embodiment also provides an image acquisition method for use with the image acquisition device described above, including:

[0065] Step S210: Acquire at least two sets of image data of the target object through at least two photosensitive device layers.

[0066] By stacking at least two photosensitive layers, with at least one layer close to the target object for light transmission, the light-transmitting photosensitive layer allows light to pass through to the other photosensitive layers. Therefore, at least two sets of image data about the target object from at least two photosensitive layers can be acquired simultaneously. This increases the amount of data collected in a single session, improves data acquisition efficiency, and increases the number of samples analyzed. Consequently, it increases the training data for the image reconstruction model, improves the accuracy of the image reconstruction model, and ultimately enhances the accuracy of image reconstruction, the practicality of the image acquisition method, and the quality of image reconstruction.

[0067] In some feasible implementations, the image acquisition method further includes:

[0068] The second data processing unit, based on the stacking order of the photosensitive device layers, superimposes all the first image data according to the alignment of each pixel in the first image data to obtain imaging data.

[0069] The second data processing unit acquires imaging data based on the stacking order of the photosensitive device layers and the alignment of each pixel in the first image data, which can improve the image acquisition quality.

[0070] In some feasible implementations, prior to the step of acquiring at least two sets of image data of the target object through at least two photosensitive layers, the method further includes:

[0071] The control unit adjusts the light transmittance parameters of the first photosensitive layer based on the illumination data of the environment in which at least two photosensitive layers are located.

[0072] For example, the light transmittance parameters of the first photosensitive layer can be determined based on the ambient light intensity. For instance, when the light intensity exceeds a preset threshold, the color of the first photosensitive layer can be determined based on the color of the light to absorb some of the light and filter the second photosensitive layer. When the light intensity exceeds the preset threshold and the target object is small, the color of the first photosensitive layer can be determined based on the color of the light, and a photosensitive layer with lower transparency can be selected as the first photosensitive layer, thereby magnifying the target object.

[0073] Determining the light transmission characteristics of the first photosensitive layer based on the illumination data of the environment in which the photosensitive layer is located can improve the light filtering efficiency of the first photosensitive layer, improve the availability and effectiveness of the first image data of the second photosensitive layer, and thus improve the practicality of the image acquisition method.

[0074] In some feasible implementations, prior to the step of acquiring at least two sets of image data of the target object through at least two photosensitive layers, the method further includes:

[0075] The control unit adjusts the target distance between the first photosensitive layer and the target object based on the illumination data of the environment where at least two photosensitive layers are located.

[0076] For example, the light intensity of the environment in which the photosensitive device layer is located is negatively correlated with the target distance between the first photosensitive device layer and the target object.

[0077] When the light intensity is high and the target object is located between the light source and the photosensitive layer, the target distance can be shortened to display the details of the target object more clearly. When the light intensity is low and the target object is located between the light source and the photosensitive layer, the target distance can be lengthened to avoid incomplete image acquisition of the target object, increase the acquisition range, and thus improve the practicality of the image acquisition method.

[0078] In some feasible implementations, prior to the step of acquiring at least two sets of image data of the target object through at least two photosensitive layers, the method further includes:

[0079] The control unit adjusts the light transmission parameters of the second photosensitive layer and / or the arrangement order of the second photosensitive layer according to the first image data corresponding to the first photosensitive layer.

[0080] For example, when there are at least two second photosensitive layers, the light transmission parameters of at least two photosensitive layers and the distance between at least two second photosensitive layers can be determined based on color distribution information. For instance, if the difference in color values ​​of adjacent color patches in the first imaging data is greater than a preset difference, the contrast of the first imaging data can be considered strong. In this case, the distance between the two second photosensitive layers can be increased, reducing the number of second photosensitive layers and saving image acquisition costs. If at least one color patch with a related color value has an area proportion in the first image data that is higher than a preset proportion, the color of at least one second photosensitive layer can be set to the aforementioned color value. This allows the associated color patch to be absorbed, facilitating further acquisition and analysis of the remaining color patches by the other second photosensitive layers, thereby improving the accuracy of image reconstruction.

[0081] By setting the color distribution information of the first image information to the second photosensitive layer, the filtering effect of the photosensitive layer can be improved, the device cost can be saved, and the size of the image acquisition device can be reduced, thereby improving the practicality and economy of the image acquisition method.

[0082] In some feasible implementations, at least two sets of image data of the target object are acquired through at least two photosensitive layers, including:

[0083] The outline of the target object is determined based on the image data associated with the first photosensitive layer;

[0084] Based on the light transmittance parameters of the first photosensitive layer and the distance between the first photosensitive layer and at least one second photosensitive layer, the target acquisition area of ​​at least one second photosensitive layer is determined.

[0085] The photosensitive devices within the target acquisition area are kept in the on state.

[0086] Since the first photosensitive layer is closest to the target object, it is necessary to keep the photosensitive units in the first photosensitive layer fully open to locate the target object. By controlling the on / off state of the photosensitive devices in the second photosensitive layer based on the first image data associated with the first photosensitive layer, the same number of photosensitive devices can be avoided for target objects of different sizes, which would increase the amount of data processing and energy consumption. This can save energy and computing power and improve the efficiency of data processing.

[0087] Figure 3 This is a schematic structural diagram of an electronic device provided in an embodiment of this application. Figure 3 As shown, this application embodiment also provides an electronic device 300, including a memory 310, a processor 320, and a computer program 311 stored in the memory 310 and executable on the processor 320. When the processor 320 executes the computer program 311, it performs the following steps:

[0088] At least two sets of image data of the target object are acquired through at least two photosensitive layers.

[0089] Since the electronic device described in this embodiment is a device used to implement a device in the embodiments of this application, those skilled in the art can understand the specific implementation method and various variations of the electronic device in this embodiment based on the method described in the embodiments of this application. Therefore, how the electronic device implements the method in the embodiments of this application will not be described in detail here. Any device used by those skilled in the art to implement the method in the embodiments of this application falls within the scope of protection of this application.

[0090] Figure 4This is a schematic structural diagram of a computer-readable storage medium provided for an embodiment of this application. Figure 4 As shown, this application embodiment also provides a computer-readable storage medium 400, on which a computer program 411 is stored. When the computer program 411 is executed by a processor, it performs the following steps:

[0091] At least two sets of image data of the target object are acquired through at least two photosensitive layers.

[0092] It should be noted that the descriptions of each embodiment in the above embodiments have different focuses. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0093] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0094] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0095] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0096] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0097] This application also provides a computer program product, which includes computer software instructions that, when executed on a processing device, cause the processing device to perform actions such as... Figure 2 The process of the image acquisition method in the corresponding embodiment.

[0098] The aforementioned computer program product includes one or more computer instructions. When the aforementioned computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The aforementioned computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The aforementioned computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the aforementioned computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The aforementioned computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that integrates one or more available media. The aforementioned available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks (SSDs)).

[0099] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0100] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units through some interfaces, and may be electrical, mechanical, or other forms.

[0101] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0102] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0103] If the aforementioned integrated units are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0104] In summary, the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. An image acquisition device, wherein the image acquisition device does not include an optical lens, characterized in that, include: At least two photosensitive device layers, wherein at least one of the photosensitive device layers near the target object is used for light transmission, the photosensitive device layer includes at least one photosensitive device, and at least two of the photosensitive device layers are stacked. Each of the photosensitive device layers is used to acquire a set of image data of the target object; Each of the photosensitive device layers includes a plurality of photosensitive devices, and the plurality of photosensitive devices are arranged in an array; The image acquisition device further includes: A first data processing unit, wherein the input terminal of the first data processing unit is electrically connected to the output terminal of at least one of the photosensitive device layers, and the first data processing unit is used to obtain first image data corresponding to the photosensitive device layer according to the array mode of the photosensitive devices in the photosensitive device layer and the corresponding image data; The second data processing unit has its input terminal electrically connected to the output terminal of the first data processing unit. The second data processing unit is used to obtain imaging data of the target object according to the stacking order of all the photosensitive device layers and all the first image data. Specifically, it is used to superimpose all the first image data according to the alignment of each pixel in the first image data based on the stacking order of the photosensitive device layers to obtain imaging data. Also includes: The control unit has its input terminal electrically connected to the output terminal of the first data processing unit, and its output terminal electrically connected to the input terminals of at least two of the photosensitive device layers. The control unit is used to control the switching state of at least one of the photosensitive devices in at least one second photosensitive device layer according to the first image data corresponding to the first photosensitive device layer; wherein, the first photosensitive device layer is the light-transmitting photosensitive device layer that is closest to the target object, and the second photosensitive device layer is any other photosensitive device layer besides the first photosensitive device layer.

2. The image acquisition device according to claim 1, characterized in that, The second data processing unit is used to superimpose all the first image data according to the stacking order of the photosensitive device layer and the alignment of each pixel in the first image data to obtain the imaging data.

3. The image acquisition device according to claim 1, characterized in that, Also includes: An illumination acquisition unit, the output of which is connected to the input of the control unit, is used to acquire illumination data of the environment in which at least two photosensitive device layers are located, wherein the illumination data includes illumination intensity and / or illumination direction.

4. The image acquisition device according to claim 3, characterized in that, Also includes: The third image processing unit has its input terminal electrically connected to the output terminal of the illumination acquisition unit and the output terminal of the second data processing unit, respectively. The third image processing unit is used to determine the correction parameters of the imaging data based on the illumination data, and to correct the imaging data based on the correction parameters.

5. An image acquisition method, characterized in that, Applied to the image acquisition device as described in any one of claims 1-4, the method comprises: At least two sets of image data of the target object are acquired through at least two of the photosensitive device layers.

6. The image acquisition method according to claim 5, characterized in that, Also includes: The second data processing unit, based on the stacking order of the photosensitive device layers, superimposes all the first image data according to the alignment of each pixel in the first image data to obtain the imaging data.

7. The image acquisition method according to claim 5, characterized in that, Prior to the step of acquiring at least two sets of image data of the target object through at least two photosensitive layers, the method further includes: The control unit adjusts the light transmittance parameters of the first photosensitive layer based on the illumination data of the environment in which at least two of the photosensitive layers are located. And / or, The control unit adjusts the target distance between the first photosensitive layer and the target object based on the illumination data of the environment in which at least two photosensitive layers are located. And / or, The control unit adjusts the light transmission parameters of the second photosensitive layer and / or the arrangement order of the second photosensitive layer according to the first image data corresponding to the first photosensitive layer.

8. An electronic device, comprising: The image acquisition device, memory, and processor as described in any one of claims 1-4, characterized in that the processor is used to execute the computer program stored in the memory to implement the steps of the image acquisition method as described in any one of claims 5 to 7.