Image information processing method and device, raster imaging system and storage medium

Abstract

Embodiments of the present application provide an image information processing method, device, grating imaging system and storage medium. The image information processing method comprises: acquiring an original image containing a moire fringe; acquiring a plurality of information separation groups according to the original image, wherein each information separation group comprises N first images, and N is a positive integer greater than 2; acquiring a second image of the information separation group according to N first images; and combining a plurality of second images to form a recombined image. Embodiments of the present application provide an image information processing method, device, grating imaging system and storage medium to reduce the high requirement for system mechanical precision, save time cost, and obtain high-quality images.

Description

Technical Field

[0001] This invention relates to image processing technology, and more particularly to image information processing methods, apparatus, grating imaging systems, and storage media. Background Technology

[0002] Grating imaging devices, combined with appropriate algorithms, can separate the absorption, refraction, and scattering information of a sample. The most common information separation method is the phase-stepping method. The phase-stepping method involves translating any grating section at equal intervals (three steps or more) along the direction perpendicular to the grating grooves, while simultaneously recording the light intensity distribution on the detector, and then calculating the absorption, refraction, and scattering images.

[0003] Although phase stepping is the primary method for data acquisition and analysis using grating interferometers, it places high demands on the system's mechanical precision and incurs significant time costs for data acquisition. Summary of the Invention

[0004] This invention provides an image information processing method, apparatus, grating imaging system, and storage medium to reduce the high requirements for system mechanical precision, save time and costs, and obtain high-quality images.

[0005] In a first aspect, embodiments of the present invention provide an image information processing method, comprising:

[0006] Obtain the original image containing moiré stripes;

[0007] Multiple information separation groups are obtained based on the original image, wherein each information separation group includes N first images, where N is a positive integer greater than 2;

[0008] Based on N of the first images, obtain the second image of the information separation group;

[0009] A reconstructed image is formed by combining multiple second images.

[0010] Optionally, multiple information separation groups are obtained based on the original image, including:

[0011] The first information separation group is obtained based on the original image;

[0012] The second information separation group is obtained based on the original image;

[0013] Obtaining the first information separation group based on the original image includes:

[0014] Starting from the first column of pixels in the original image, one column of pixels is extracted every N columns to form the first first image;

[0015] Then, from the second column of pixels in the original image, one column of pixels is extracted for every N columns to form a second first image;

[0016] Until, from the Nth column of pixels in the original image, one column of pixels is extracted every N columns to form the Nth first image;

[0017] The acquisition of the second information separation group based on the original image includes:

[0018] Starting from the second column of pixels in the original image, one column of pixels is extracted every N columns to form the (N+1)th first image;

[0019] Then, from the third column of pixels in the original image, one column of pixels is extracted every N columns to form the (N+2)th first image;

[0020] Until, from the Nth column of pixels in the original image, one column of pixels is extracted from every N columns to form the (2N-1)th first image;

[0021] From the first column of pixels in the original image, one column of pixels is extracted every N columns, and the (N)th column of pixels in the original image is... 2 +1) column pixels are used as the Nth column pixels of the Nth first image to form the 2Nth first image.

[0022] Optionally, obtaining multiple information separation groups based on the original image further includes:

[0023] Until the Nth information separation group is obtained based on the original image;

[0024] The process of obtaining the Nth information separation group based on the original image includes:

[0025] Starting from the Nth column of pixels in the original image, one column of pixels is extracted from every N columns to form the (N×(N-1)+1)th first image;

[0026] Then, from the first column of pixels in the original image, one column of pixels is extracted for every N columns, and the (N)th column of pixels in the original image is... 2 +1) columns of pixels are used as the Nth column of pixels in the (N×(N-1)+2)th first image to form the (N×(N-1)+2)th first image;

[0027] Until, from the (N-1)th column of pixels in the original image, one column of pixels is extracted every N columns, and the (N)th column of pixels in the original image is... 2 +N-1) columns of pixels are used as the Nth column 2 The Nth column pixels of the first image form the Nth... 2 The first image.

[0028] Optionally, based on N first images, obtaining the second image of the information separation group includes:

[0029] Based on the first first image to the Nth first image, obtain the first second image;

[0030] Based on the (N+1)th to the 2Nth first images, obtain the second second image;

[0031] Until, according to the (N×(N-1)+1)th first image to the Nth 2 Get the first image, and then get the Nth second image.

[0032] Optionally, a reconstructed image is formed by combining multiple second images, including:

[0033] The first column of pixels of the first second image is used as the first column of pixels of the reconstructed image, the first column of pixels of the second second image is used as the second column of pixels of the reconstructed image, and so on, until the first column of pixels of the Nth second image is used as the Nth column of pixels of the reconstructed image;

[0034] The second column of pixels of the first second image is used as the (N+1)th column of pixels of the reconstructed image, the second column of pixels of the second second image is used as the (N+2)th column of pixels of the reconstructed image, and so on, until the second column of pixels of the Nth second image is used as the 2Nth column of pixels of the reconstructed image;

[0035] Until the Nth column pixel of the first second image is used as the (N×(N-1)+1)th column pixel of the reconstructed image, the Nth column pixel of the second second image is used as the (N×(N-1)+2)th column pixel of the reconstructed image, and so on, until the Nth column pixel of the Nth second image is used as the Nth column pixel of the reconstructed image. 2 Column pixels.

[0036] Optionally, the second image may include an absorption image, a phase-shifted image, or a scattering image.

[0037] Optionally, the period of the moiré stripes is P, and the size of the pixels in the original image is Q, satisfying: P = Q × N.

[0038] In a second aspect, embodiments of the present invention provide an image information processing apparatus, comprising:

[0039] The original image acquisition module is used to acquire the original image containing moiré stripes;

[0040] The information separation group acquisition module is used to acquire multiple information separation groups based on the original image, wherein each information separation group includes N first images, where N is a positive integer greater than 2;

[0041] The second image acquisition module is used to acquire the second image of the information separation group based on N first images;

[0042] The reconstructed image acquisition module is used to combine multiple second images to form a reconstructed image.

[0043] Thirdly, embodiments of the present invention provide a grating imaging system, including a grating imaging device and a processing device; the processing device is connected to the grating imaging device, and the processing device includes:

[0044] One or more processors;

[0045] Memory, used to store one or more programs;

[0046] When the one or more programs are executed by the one or more processors, the one or more processors implement the image information processing method as described in the first aspect for each of the grating imaging devices.

[0047] Fourthly, embodiments of the present invention provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the image information processing method as described in the first aspect.

[0048] This invention provides an image information processing method. The method involves acquiring an original image containing moiré fringes, obtaining multiple information separation groups from the original image, wherein each information separation group includes N first images, obtaining second images from the N first images, and combining the multiple second images to form a reconstructed image. On one hand, this invention eliminates the need for grating stepping, reducing the high requirements for system mechanical precision and saving time. On the other hand, by acquiring multiple second images through multiple information separation groups and reconstructing these second images, a higher-quality reconstructed image is formed, thereby obtaining a high-quality image. Attached Figure Description

[0049] Figure 1 A flowchart of an image information processing method provided in an embodiment of the present invention;

[0050] Figure 2 A schematic diagram of an original image provided for an embodiment of the present invention;

[0051] Figures 3-6 A schematic diagram of the first image in the first information separation group provided in an embodiment of the present invention;

[0052] Figures 7-10 A schematic diagram of the first image in the second information separation group provided in an embodiment of the present invention;

[0053] Figures 11-14 A schematic diagram of the first image in the third information separation group provided in an embodiment of the present invention;

[0054] Figures 15-18 A schematic diagram of the first image in the fourth information separation group provided in an embodiment of the present invention;

[0055] Figure 19 A flowchart illustrating a detailed step S120 provided in an embodiment of the present invention;

[0056] Figure 20 A flowchart illustrating a detailed step S121 provided in an embodiment of the present invention;

[0057] Figure 21 A flowchart illustrating a detailed step S122 provided in an embodiment of the present invention;

[0058] Figure 22 A flowchart illustrating a detailed step S123 provided in an embodiment of the present invention;

[0059] Figure 23 A schematic diagram of the first second image provided in an embodiment of the present invention;

[0060] Figure 24 A schematic diagram of the second second image provided in an embodiment of the present invention;

[0061] Figure 25 A schematic diagram of the third second image provided in an embodiment of the present invention;

[0062] Figure 26 A schematic diagram of the fourth second image provided in an embodiment of the present invention;

[0063] Figure 27 A flowchart illustrating a detailed step S130 provided in an embodiment of the present invention;

[0064] Figure 28 A schematic diagram of a reconstructed image provided in an embodiment of the present invention;

[0065] Figure 29 A flowchart illustrating a detailed step S140 provided in an embodiment of the present invention;

[0066] Figure 30 This is a schematic diagram of an image information processing device provided in an embodiment of the present invention;

[0067] Figure 31This is a schematic diagram of the structure of a grating imaging system provided in an embodiment of the present invention;

[0068] Figure 32 This is a schematic diagram of the structure of a grating imaging device provided in an embodiment of the present invention;

[0069] Figure 33 This is a schematic diagram of the structure of a processing device according to an embodiment of the present invention. Detailed Implementation

[0070] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.

[0071] Figure 1 This is a flowchart illustrating an image information processing method according to an embodiment of the present invention. This embodiment is applicable to image information processing scenarios. The method can be executed by an image information processing device, which can consist of hardware and / or software and is generally integrated into a processing device, such as a processing device in a grating imaging system. (Reference) Figure 1 The method includes:

[0072] S110. Obtain the original image containing moiré stripes.

[0073] Moiré fringes are an optical phenomenon first discovered by the 18th-century French researcher, Mr. Moiré. Technically speaking, moiré fringes are the visual result of interference between two lines or two objects at a constant angle and frequency. When the human eye cannot distinguish between the two lines or objects, it can only see the interference pattern; this pattern in the optical phenomenon is called moiré fringes.

[0074] The original image consists of pixels arranged in multiple rows and columns.

[0075] S120. Obtain multiple information separation groups based on the original image, wherein each information separation group includes N first images, where N is a positive integer greater than 2.

[0076] In this step, within an information separation group, one column of pixels is extracted from every N columns of the original image to form a new projected image, i.e., the first image. Thus, N first images can be obtained. Here, a pixel column refers to a column formed by multiple pixels arranged along a column direction; that is, a column of pixels.

[0077] In this step, at least two information separation groups are obtained based on the original image, and at least two of these information separation groups are different. That is, the first images in the two information separation groups are different, and a certain first image in one information separation group cannot be found as an identical first image in the other information separation group.

[0078] S130. Based on N first images, obtain the second image of the information separation group.

[0079] In this step, the second image of the information separation group is obtained based on the N first images in the same information separation group.

[0080] Based on N first images from multiple information separation groups, obtain the second images corresponding to each of the multiple information separation groups.

[0081] For example, the second image may include an absorption image, a phase-shifted image, or a scattering image. An absorption image is an image formed due to the absorption of light by the sample. A phase-shifted image is an image formed due to the phase shift of light by the sample. A scattering image is an image formed due to the scattering of light by the sample.

[0082] S140. Based on multiple second images, combine them to form a reconstructed image.

[0083] In this step, multiple second images are recombined to form a recombined image. As a result, the number of pixel columns in the recombined image is greater than that in a single second image. The recombined image has more pixel columns and can achieve higher image quality than the second images.

[0084] This invention provides an image information processing method. The method involves acquiring an original image containing moiré fringes, obtaining multiple information separation groups from the original image, wherein each information separation group includes N first images, obtaining second images from the N first images, and combining the multiple second images to form a reconstructed image. On one hand, this invention eliminates the need for grating stepping, reducing the high requirements for system mechanical precision and saving time. On the other hand, by acquiring multiple second images through multiple information separation groups and reconstructing these second images, a higher-quality reconstructed image is formed, thereby obtaining a high-quality image.

[0085] Figure 2 This is a schematic diagram of an original image provided in an embodiment of the present invention. Figures 3-6 This is a schematic diagram of the first image in the first information separation group provided in an embodiment of the present invention. Figures 7-10 This is a schematic diagram of the first image in the second information separation group provided in an embodiment of the present invention. Figures 11-14 This is a schematic diagram of the first image in the third information separation group provided in an embodiment of the present invention. Figures 15-18This is a schematic diagram of the first image in the fourth information separation group provided in an embodiment of the present invention. (See reference) Figures 2-18 Taking N=4 as an example, but not limited to this. For ease of description, the original image is denoted as 100, the first image as 111, the second image as 112, the third image as 113, the fourth image as 114, the fifth image as 121, the sixth image as 122, the seventh image as 123, the eighth image as 124, the ninth image as 131, the tenth image as 132, the eleventh image as 133, the twelfth image as 134, the thirteenth image as 141, the fourteenth image as 142, the fifteenth image as 143, and the sixteenth image as 144.

[0086] Figure 19 A flowchart illustrating a detailed step S120 provided in this embodiment of the invention, in conjunction with reference to [reference needed]. Figures 2-18 ,as well as Figure 19 The above step S120 may include:

[0087] S121. Obtain the first information separation group based on the original image.

[0088] For example, refer to Figures 3-6 The first information separation group is obtained based on the original image 100, specifically, the first first image 111, the second first image 112, the third first image 113 and the fourth first image 114 are obtained based on the original image 100.

[0089] S122. Obtain the second information separation group based on the original image.

[0090] For example, refer to Figures 7-10 The second information separation group is obtained based on the original image 100, specifically, the fifth first image 121, the sixth first image 122, the seventh first image 123 and the eighth first image 124 are obtained based on the original image 100.

[0091] S123, until the Nth information separation group is obtained based on the original image.

[0092] In this step, following the pattern in steps S121 and S122 above, we continue to obtain the third information separation group, the fourth information separation group, ..., until the Nth information separation group based on the original image.

[0093] For example, refer to Figures 11-14The third information separation group is obtained based on the original image 100, specifically, the ninth first image 131, the tenth first image 132, the eleventh first image 133 and the twelfth first image 134 are obtained based on the original image 100.

[0094] For example, refer to Figures 15-18 The fourth information separation group is obtained based on the original image 100, specifically, the thirteenth first image 141, the fourteenth first image 142, the fifteenth first image 143 and the sixteenth first image 144 are obtained based on the original image 100.

[0095] In this embodiment of the invention, N information separation groups are obtained based on the original image 100. The division of the original image 100 is relatively sufficient, which reduces information loss and helps to improve the image quality of the final reconstructed image.

[0096] In other implementations, fewer than N information separation groups can be obtained, for example, N-1 information separation groups can be obtained.

[0097] Figure 20 A flowchart illustrating a detailed step S121 provided in this embodiment of the invention, in conjunction with reference to [reference needed]. Figures 2-6 ,as well as Figure 20 The above step S121 may include:

[0098] S1211. Starting from the first column of pixels in the original image, extract one column of pixels every N columns to form the first image.

[0099] For example, refer to Figure 2 and Figure 3 Starting with the first column of pixels in the original image 100, one column of pixels is extracted every four columns to form the first first image 111. In other words, starting with the first column of pixels in the original image 100, one column of pixels is extracted every three (i.e., N-1, N=4) columns to form the first first image 111. The first column of pixels in the original image 100 is used as the first column of the first first image 111, the fifth column of pixels in the original image 100 is used as the second column of the first first image 111, the ninth column of pixels in the original image 100 is used as the third column of the first first image 111, and the thirteenth column of pixels in the original image 100 is used as the fourth column of the first first image 111.

[0100] S1212. Then, from the second column of pixels of the original image, one column of pixels is extracted for every N columns to form the second first image.

[0101] For example, refer to Figure 2 and Figure 4The second first image 112 is formed by extracting one column of pixels from every four columns of the second column of the original image 100. The second column of pixels in the original image 100 is used as the first column of the second first image 112, the sixth column of pixels in the original image 100 is used as the second column of the second first image 112, the tenth column of pixels in the original image 100 is used as the third column of the second first image 112, and the fourteenth column of pixels in the original image 100 is used as the fourth column of the second first image 112.

[0102] S1213. Until, from the Nth column of pixels in the original image, one column of pixels is extracted from every N columns to form the Nth first image.

[0103] In this step, following the pattern in steps S1212 and S1213 above, we continue to obtain the third first image, the fourth first image, ..., until the Nth first image based on the original image.

[0104] For example, refer to Figure 2 and Figure 5 The third first image 113 is formed by extracting one column of pixels every four columns from the third column of the original image 100. The third column of pixels from the original image 100 is used as the first column of the third first image 113, the seventh column of pixels from the original image 100 is used as the second column of the third first image 113, the eleventh column of pixels from the original image 100 is used as the third column of the third first image 113, and the fifteenth column of pixels from the original image 100 is used as the fourth column of the third first image 113.

[0105] For example, refer to Figure 2 and Figure 6 The fourth first image 114 is formed by extracting one column of pixels from every four columns of the fourth column of the original image 100. The fourth column of the original image 100 is used as the first column of the fourth first image 114, the eighth column of the original image 100 is used as the second column of the fourth first image 114, the twelfth column of the original image 100 is used as the third column of the fourth first image 114, and the sixteenth column of the original image 100 is used as the fourth column of the fourth first image 114.

[0106] Figure 21 A flowchart illustrating a detailed step S122 provided in this embodiment of the invention, in conjunction with reference to [reference needed]. Figure 2 , Figures 7-10 ,as well as Figure 21 The above step S122 may include:

[0107] S1221. Starting from the second column of pixels in the original image, extract one column of pixels every N columns to form the (N+1)th first image.

[0108] For example, refer to Figure 2 and Figure 7 Starting from the second column of pixels in the original image 100, one column of pixels is extracted every four columns to form the fifth (i.e., N+1, N=4) first image 121.

[0109] For example, the fifth first image 121 can be the same as the second first image 112.

[0110] S1222. Then, from the third column of pixels in the original image, one column of pixels is extracted every N columns to form the (N+2)th first image.

[0111] For example, refer to Figure 2 and Figure 8 Starting from the third column of pixels in the original image 100, one column of pixels is extracted every four columns to form the sixth (i.e., N+2, N=4) first image 122.

[0112] For example, the sixth first image 122 can be the same as the third first image 113.

[0113] S1223. Until, from the Nth column of pixels in the original image, one column of pixels is extracted from every N columns to form the (2N-1)th first image;

[0114] In this step, following the pattern in steps S1221 and S1222 above, we continue to obtain the seventh first image based on the original image, ..., until the (2N-1)th first image.

[0115] For example, refer to Figure 2 and Figure 9 Starting from the fourth column of pixels in the original image 100, one column of pixels is extracted every four columns to form the seventh (i.e., 2N-1, N=4) first image 123.

[0116] For example, the seventh first image 123 can be the same as the fourth first image 114.

[0117] S1224. Starting from the (N+1)th column of pixels in the original image, extract one column of pixels every N columns, until the (N+1)th column of pixels in the original image is extracted. 2 +1) column pixels are used as the Nth column pixels of the Nth first image to form the 2Nth first image.

[0118] In this step, starting from the (N+1)th column of pixels in the original image 100, one column of pixels is extracted every N columns until the (N-1)th column of pixels in the 2Nth first image is formed. For the last column of pixels in the 2Nth first image, the (N)th column of pixels in the original image is used. 2 +1) column pixels.

[0119] For example, refer to Figure 2 and Figure 10 The fifth column of pixels in the original image 100 is used as the first column of the eighth first image 124, the ninth column of pixels in the original image 100 is used as the second column of the eighth first image 124, the thirteenth column of pixels in the original image 100 is used as the third column of the eighth first image 124, and the seventeenth (i.e., N) column of pixels in the original image 100 is used as the third column of the eighth first image 124. 2 +1, N=4) column pixels as the fourth column of the eighth first image 124.

[0120] In this embodiment of the invention, the last column of pixels in the 2Nth first image is taken from the (Nth)th column of the original image. 2 +1) column pixels, the 2Nth first image is different from any first image in the first information separation group, obtains additional information, reduces information loss, and helps to improve the image quality of the final reconstructed image.

[0121] Taking N=4 as an example, the above step S123 includes the process of obtaining the third information separation group and the process of obtaining the fourth information separation group. Since the process of obtaining the third information separation group and the process of obtaining the fourth information separation group are similar, here, only the process of obtaining the fourth information separation group is described by example.

[0122] Figure 22 A flowchart illustrating a detailed step S123 provided in this embodiment of the invention, in conjunction with reference to [reference needed]. Figure 2 , Figures 15-18 ,as well as Figure 22 The above step S123 may include:

[0123] S1231. Starting from the Nth column of pixels in the original image, extract one column of pixels from every N columns to form the (N×(N-1)+1)th first image.

[0124] For example, refer to Figure 2 and Figure 15 Starting from the fourth (N=4) column of pixels in the original image 100, one column of pixels is extracted every four columns to form the thirteenth (i.e., (N×(N-1)+1), N=4) first image 141. The fourth column of pixels in the original image 100 is used as the first column of the thirteenth first image 141, the eighth column of pixels in the original image 100 is used as the second column of the thirteenth first image 141, the twelfth column of pixels in the original image 100 is used as the third column of the thirteenth first image 141, and the sixteenth column of pixels in the original image 100 is used as the fourth column of the thirteenth first image 141.

[0125] S1232. Then, starting from the (N+1)th column of pixels in the original image, extract one column of pixels every N columns, until the (N+1)th column of pixels in the original image is extracted. 2+1) columns of pixels are used as the Nth column of pixels in the (N×(N-1)+2)th first image to form the (N×(N-1)+2)th first image.

[0126] For example, refer to Figure 2 and Figure 16 The fourteenth first image 142 is formed by extracting one column of pixels every four columns from the fifth column of the original image 100. This is done by taking pixels from the fifth column of the original image 100. The first column of the fourteenth first image 142 is formed from the fifth column of the original image 100, the second column from the ninth column of the original image 100, the third column from the thirteenth column of the original image 100, and the fourth column from the seventeenth column of the original image 100.

[0127] S1233, until, from the (2N-1)th column of pixels in the original image, one column of pixels is extracted every N columns, until the (N)th column of pixels in the original image is obtained. 2 +N-1) columns of pixels are used as the Nth column 2 The Nth column pixels of the first image form the Nth... 2 The first image.

[0128] For example, refer to Figure 2 and Figure 17 The fifteenth first image 143 is formed by extracting one column of pixels every four columns from the sixth (i.e., N+2, N=4) column of the original image 100. The first column of the fifteenth first image 143 is formed from the sixth column of the original image 100, the second column is formed from the tenth column of the original image 100, the third column is formed from the fourteenth column of the original image 100, and the fourth column is formed from the eighteenth column of the original image 100.

[0129] For example, refer to Figure 2 and Figure 18 The sixteenth first image 144 is formed by extracting one column of pixels from every four columns of the seventh (i.e., 2N-1, N=4) column of the original image 100. The first column of the sixteenth first image 144 is formed from the seventh column of the original image 100, the second column from the eleventh column of the original image 100, the third column from the fifteenth column of the original image 100, and the fourth column from the nineteenth (i.e., (N=4)) column of the original image 100. 2 +N-1), N=4) column pixels as the sixteenth (i.e., N 2 , N=4) the fourth column of the first image 144.

[0130] In this embodiment of the invention, starting from the (N×(N-1)+2)th first image, up to the Nth... 2 The first image, the last column of pixels of each first image is taken from the Nth column of the original image. 2 The pixels following the column. Thus, from the (N×(N-1)+2)th first image to the Nth... 2 The first image, unlike any first image in the first information separation group, has acquired additional information, reducing information loss and improving the image quality of the final reconstructed image.

[0131] For example, in another embodiment, the last column of the first image is the Nth column of the original image. 2 The virtual pixels following the column. Virtual pixels refer to pixels that are not directly acquired through image acquisition, but are calculated through numerical simulation based on pixels acquired directly through image acquisition.

[0132] For example, the original image directly acquires 18 columns of pixels through image acquisition. The fourth column of pixels in the sixteenth first image 144 is calculated using numerical simulation from the 18 columns of pixels in the original image. That is, the nineteenth column of pixels is obtained through numerical simulation from the 18 columns of pixels in the original image, where the nineteenth column of pixels is a virtual pixel, and this nineteenth column of pixels is used as the fourth column of pixels in the sixteenth first image 144.

[0133] Figure 23 This is a schematic diagram of the first second image provided in an embodiment of the present invention. Figure 24 This is a schematic diagram of the second second image provided in an embodiment of the present invention. Figure 25 This is a schematic diagram of the third second image provided in an embodiment of the present invention. Figure 26 This is a schematic diagram of the fourth second image provided in an embodiment of the present invention, with reference to... Figures 23-26 Taking N=4 as an example, but not limited to this. For ease of description, the first second image is denoted as 211, the second second image as 212, the third second image as 213, and the fourth second image as 214.

[0134] Figure 27 A flowchart illustrating a detailed step S130 provided in this embodiment of the invention, in conjunction with reference to [reference needed]. Figures 2-18 , Figures 23-27 The above step S130 may include:

[0135] S131. Obtain the first second image based on the first first image to the Nth first image.

[0136] For example, the first second image 211 is obtained from the first first image 111, the second first image 112, the third first image 113, and the fourth first image 114.

[0137] S132. Based on the (N+1)th to the 2Nth first images, obtain the second second image.

[0138] For example, the second second image 212 is obtained from the fifth first image 121, the sixth first image 122, the seventh first image 123, and the eighth first image 124.

[0139] S133, until, based on the (N×(N-1)+1)th first image to the Nth... 2 Get the first image, then get the Nth second image.

[0140] In this step, following the pattern in steps S131 and S132 above, we continue to obtain the third second image, the fourth second image, ..., until the Nth second image, based on multiple first images.

[0141] For example, the third second image 213 is obtained from the ninth first image 131, the tenth first image 132, the eleventh first image 133 and the twelfth first image 134.

[0142] For example, the fourth second image 214 is obtained from the thirteenth first image 141, the fourteenth first image 142, the fifteenth first image 143 and the sixteenth first image 144.

[0143] Figure 28 This is a schematic diagram of the reconstructed image provided in an embodiment of the present invention. Figure 29 A flowchart illustrating a detailed step S140 provided in this embodiment of the invention is shown below. Figures 23-26 , Figure 28 and Figure 29 The above step S140 may include:

[0144] S141. Use the first column of pixels of the first second image as the first column of pixels of the reconstructed image, use the first column of pixels of the second second image as the second column of pixels of the reconstructed image, and so on, until the first column of pixels of the Nth second image is used as the Nth column of pixels of the reconstructed image.

[0145] For example, the first column of pixels of the first second image 211 is used as the first column of pixels of the reconstructed image 200, the first column of pixels of the second second image 212 is used as the second column of pixels of the reconstructed image 200, the first column of pixels of the third second image 213 is used as the third column of pixels of the reconstructed image 200, and the first column of pixels of the fourth second image 214 is used as the fourth column of pixels of the reconstructed image 200.

[0146] S142. Take the second column of pixels of the first second image as the (N+1)th column of pixels of the reconstructed image, take the second column of pixels of the second second image as the (N+2)th column of pixels of the reconstructed image, and so on until the second column of pixels of the Nth second image is taken as the 2Nth column of pixels of the reconstructed image.

[0147] For example, the second column of pixels of the first second image 211 is used as the fifth column of pixels of the reconstructed image 200, the second column of pixels of the second second image 212 is used as the sixth column of pixels of the reconstructed image 200, the second column of pixels of the third second image 213 is used as the seventh column of pixels of the reconstructed image 200, and the second column of pixels of the fourth second image 214 is used as the eighth column of pixels of the reconstructed image 200.

[0148] S143. Until the Nth column pixel of the first second image is used as the (N×(N-1)+1)th column pixel of the reconstructed image, and the Nth column pixel of the second second image is used as the (N×(N-1)+2)th column pixel of the reconstructed image, until the Nth column pixel of the Nth second image is used as the Nth column pixel of the reconstructed image. 2 Column pixels.

[0149] For example, the third column of pixels of the first second image 211 is used as the ninth column of pixels of the reconstructed image 200, the third column of pixels of the second second image 212 is used as the tenth column of pixels of the reconstructed image 200, the third column of pixels of the third second image 213 is used as the eleventh column of pixels of the reconstructed image 200, and the third column of pixels of the fourth second image 214 is used as the twelfth column of pixels of the reconstructed image 200.

[0150] For example, the fourth column of pixels of the first second image 211 is used as the thirteenth column of pixels of the reconstructed image 200, the fourth column of pixels of the second second image 212 is used as the fourteenth column of pixels of the reconstructed image 200, the fourth column of pixels of the third second image 213 is used as the fifteenth column of pixels of the reconstructed image 200, and the fourth column of pixels of the fourth second image 214 is used as the sixteenth column of pixels of the reconstructed image 200.

[0151] Optionally, the period of the moiré fringe is P, and the size of the pixel in the original image is Q, satisfying: P = Q × N. That is, the period of the moiré fringe is N times the size of the pixel in the original image.

[0152] Figure 30 This is a schematic diagram of an image information processing device provided in an embodiment of the present invention, with reference to... Figure 30 The image information processing device includes a raw image acquisition module 310, an information separation group acquisition module 320, a second image acquisition module 330, and a reconstructed image acquisition module 3340. The raw image acquisition module 310 acquires a raw image containing moiré patterns. The information separation group acquisition module 320 acquires multiple information separation groups based on the raw image, wherein each information separation group includes N first images, where N is a positive integer greater than 2 and greater than or equal to 3. The second image acquisition module 330 acquires second images from the N first images based on the information separation groups. The reconstructed image acquisition module 3340 combines the multiple second images to form a reconstructed image.

[0153] The image information processing apparatus provided in this embodiment of the invention is used to execute the above-described image information processing method, and therefore has the technical effects of the above-described image information processing method. On the one hand, this embodiment of the invention eliminates the need for stepping the grating, reducing the high requirements for the mechanical precision of the system and saving time costs. On the other hand, by using multiple information separation groups to acquire multiple second images, and by recombining the multiple second images, a recombined image with higher image quality is formed, thereby obtaining a high-quality image.

[0154] Figure 31 This is a schematic diagram of the structure of a grating imaging system provided in an embodiment of the present invention. Figure 32 This is a schematic diagram of the structure of a grating imaging device provided in an embodiment of the present invention. Figure 33 This is a schematic diagram of the structure of a processing device according to an embodiment of the present invention, with reference to... Figures 31-33 The grating imaging system includes a grating imaging device 61 and a processing device 60. The processing device 60 is connected to the grating imaging device 61. Figure 33 A block diagram of an exemplary processing apparatus 60 suitable for implementing embodiments of the present invention is shown. Figure 33 The processing device 60 shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of the present invention. Figure 33 As shown, the processing device 60 is presented in the form of a general-purpose computing device. The components of the processing device 60 may include, but are not limited to: one or more processors 601, system memory 602, and bus 603 connecting different system components (including system memory 602 and processor 601).

[0155] Bus 603 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0156] Processing device 60 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by processing device 60, including volatile and non-volatile media, removable and non-removable media.

[0157] System memory 602 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 604 and / or cache memory 605. Processing device 60 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 606 may be used to read and write non-removable, non-volatile magnetic media (…). Figure 33 Not shown; usually referred to as a "hard drive"). Although Figure 33 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 603 via one or more data media interfaces. System memory 602 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0158] A program / utility 608 having a set (at least one) of program modules 607 may be stored, for example, in system memory 602. Such program modules 607 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 607 typically perform the functions and / or methods described in the embodiments of the present invention.

[0159] The processing device 60 can also communicate with one or more external devices 609 (e.g., keyboard, pointing device, display 610, etc.), and with one or more devices that enable user interaction with the device, and / or with any device that enables the processing device 60 to communicate with one or more other computing devices (e.g., network interface card, modem, etc.). This communication can be performed via the input / output (I / O) interface 611. Furthermore, the processing device 60 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via the network adapter 612. Figure 33 As shown, network adapter 612 communicates with other modules of processing device 60 via bus 603. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with processing device 60, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0160] The processor 601 executes various functional applications and data processing by running programs stored in the system memory 602, such as implementing the image information processing method provided in the embodiments of the present invention for a grating imaging device.

[0161] For example, refer to Figure 32 The grating imaging device 61 includes a first grating 613, a second grating 614, a third grating 615, and an imaging device 616. The sample 617 is disposed between the first grating 613 and the second grating 614.

[0162] For example, the incoherent light source is divided into several sub-light sources after passing through the first grating 613. These sub-light sources are small enough to form a self-image at the position of the third grating 615 after passing through the second grating 614. The self-image interferes with the third grating 615 on the imaging device 616 and forms magnified moiré fringes.

[0163] This invention also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, can implement the image information processing method described in the above embodiments.

[0164] The computer storage medium of this invention can be any combination of one or more computer-readable media. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0165] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.

[0166] Program code contained on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0167] Computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages—such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0168] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, combinations, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.

Claims

1. An image information processing method characterized by comprising: The method comprises: acquiring an original image containing mura; acquiring a plurality of information separation groups according to the original image, wherein each information separation group comprises N first images, and N is a positive integer greater than 2; acquiring a second image of the information separation group according to N first images; combining a plurality of second images to form a recombined image; wherein acquiring a plurality of information separation groups according to the original image comprises: acquiring a first information separation group according to the original image; acquiring a second information separation group according to the original image; wherein acquiring a first information separation group according to the original image comprises: extracting a column of pixels every N columns from the first column of pixels of the original image to form a first first image; then extracting a column of pixels every N columns from the second column of pixels of the original image to form a second first image; and so on, until extracting a column of pixels every N columns from the Nth column of pixels of the original image to form an Nth first image; wherein acquiring a second information separation group according to the original image comprises: extracting a column of pixels every N columns from the second column of pixels of the original image to form an (N+1)th first image; then extracting a column of pixels every N columns from the third column of pixels of the original image to form an (N+2)th first image; and so on, until extracting a column of pixels every N columns from the Nth column of pixels of the original image to form a (2N-1)th first image; from the (N+1)th column of pixels of the original image, every N columns of pixels are extracted until the (N+1)th column of pixels of the original image is taken as the Nth column of pixels of the Nth first image to form the 2Nth first image. 2 from the (N+1)th column of pixels of the original image, every N columns of pixels are extracted until the (N+1)th column of pixels of the original image is taken as the Nth column of pixels of the Nth first image to form the 2Nth first image.

2. The image information processing method according to claim 1, characterized by, acquiring a plurality of information separation groups according to the original image further comprises: until acquiring an Nth information separation group according to the original image; wherein acquiring an Nth information separation group according to the original image comprises: extracting a column of pixels every N columns from the Nth column of pixels of the original image to form an (N×(N-1)+1)th first image; Then, from the (N+1)th column of pixels of the original image, every Nth column of pixels is extracted until the (N 2 +1)th column of pixels of the original image is taken as the Nth column of pixels of the (N×(N-1)+2)th first image to form the (N×(N-1)+2)th first image. Until, by the (2N-1)th column pixel of the original image, every N column pixel is extracted a column pixel, until the (N+1)th column pixel of the original image is taken as the Nth column pixel of the Nth first image, the Nth first image is composed. 2 2 2 ​​​ 3. The image information processing method according to claim 2, characterized by, acquiring a second image of the information separation group according to N first images comprises: acquiring a first second image according to the first first image to the Nth first image; acquiring a second second image according to the (N+1)th first image to the 2Nth first image; Until, according to the (N x (N-1) + 1) first image to the N 2 th first image, the Nth second image is acquired.

4. The image information processing method according to claim 2, characterized by, combining a plurality of second images to form a recombined image comprises: taking the first column of pixels of the first second image as the first column of pixels of the recombined image, taking the first column of pixels of the second second image as the second column of pixels of the recombined image, and so on, until taking the first column of pixels of the Nth second image as the Nth column of pixels of the recombined image; taking the second column of pixels of the first second image as the (N+1)th column of pixels of the recombined image, taking the second column of pixels of the second second image as the (N+2)th column of pixels of the recombined image, and so on, until taking the second column of pixels of the Nth second image as the 2Nth column of pixels of the recombined image; until the Nth column pixel of the Nth second image is taken as the Nth column pixel of the reorganized image. 2 until the Nth column pixel of the Nth second image is taken as the Nth column pixel of the reorganized image.

5. The image information processing method according to claim 1, characterized by, the second image comprises an absorption image, a phase shift image, or a scattering image.

6. The image information processing method according to claim 1, characterized by, The period of the mura is P, and the size of a pixel in the original image is Q, and P=Q×N is satisfied.

7. An image information processing apparatus characterized by comprising: The method comprises: An original image acquisition module is configured to acquire an original image containing moire fringes; An information separation group acquisition module is configured to acquire a plurality of information separation groups from the original image, wherein each information separation group includes N first images, and N is a positive integer greater than 2; A second image acquisition module is configured to acquire a second image of each information separation group from N first images; A recombined image acquisition module is configured to combine a plurality of second images to form a recombined image; The acquiring of the plurality of information separation groups from the original image includes: The first information separation group is acquired from the original image; The second information separation group is acquired from the original image; The acquiring of the first information separation group from the original image includes: A first first image is formed by extracting one column of pixels every N columns from the first column of pixels of the original image; A second first image is formed by extracting one column of pixels every N columns from the second column of pixels of the original image; A Nth first image is formed by extracting one column of pixels every N columns from the Nth column of pixels of the original image; The acquiring of the second information separation group from the original image includes: An (N+1)th first image is formed by extracting one column of pixels every N columns from the second column of pixels of the original image; An (N+2)th first image is formed by extracting one column of pixels every N columns from the third column of pixels of the original image; An (2N-1)th first image is formed by extracting one column of pixels every N columns from the Nth column of pixels of the original image; from the (N+1)th column of pixels of the original image, every N columns of pixels are extracted until the (N+1)th column of pixels of the original image is taken as the Nth column of pixels of the Nth first image to form the 2Nth first image. 2 from the (N+1)th column of pixels of the original image, every N columns of pixels are extracted until the (N+1)th column of pixels of the original image is taken as the Nth column of pixels of the Nth first image to form the 2Nth first image.

8. A grating imaging system characterized by, The system includes a grating imaging device and a processing device; the processing device is connected to the grating imaging device, and the processing device includes: one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the image information processing method according to any one of claims 1-6 for each grating imaging device.

9. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the image information processing method according to any one of claims 1-6.

Images