A grating imaging processing method, device, system and medium

Abstract

The present invention discloses a grating imaging processing method, device, system, and medium. The method includes: when the moiré fringes on the detector are uniformly distributed, obtaining a projection image of at least one angle of a sample placed in the grating imaging system, as well as a background image when no sample is placed; combining the projection image with the background image to separate absorption information, refraction information, and scattering information, and simultaneously obtaining an absorption information image corresponding to bright fringes in the moiré fringes, an absorption information image corresponding to dark fringes, an average absorption information image, a refraction information image, and a scattering information image. Thus, the grating imaging system can obtain multimodal imaging, and the sample structure can be analyzed based on the images of each modality, thereby obtaining more comprehensive information about the sample's interior.

Description

Technical Field

[0001] The present invention relates to the field of grating imaging technology, and in particular to a grating imaging processing method, device, system and medium. Background Art

[0002] Currently, CT imaging is widely used in medicine, and it can be used to identify lesions in patients. In the past, a limitation of single-energy imaging was that objects with different compositions might exhibit similar attenuation characteristics, making it difficult to distinguish between different substances using only CT values. Later, two photon beams of different energies were used to penetrate an object for imaging, and the differences in the energy absorption curves of different substances were used to accurately infer the composition of the object. However, current dual-energy CT imaging is relatively complex, or can only perform dual-energy CT imaging alone without other imaging functions, making it inflexible for clinical use. Summary of the Invention

[0003] The present invention provides a grating imaging processing method, device, system and medium, which can realize multimodal imaging, have flexible application and simple imaging.

[0004] According to a first aspect of the present invention, a grating imaging processing method is proposed, comprising:

[0005] When the moiré fringes on the detector are uniformly distributed, a projection image of at least one angle of a sample placed in the grating imaging system and a background image when no sample is placed are acquired;

[0006] The absorption information, refraction information and scattering information of the projection image are separated in combination with the background image, and the absorption information image corresponding to the bright fringes in the moiré fringes, the absorption information image corresponding to the dark fringes, the average absorption information image, the refraction information image and the scattering information image are obtained at the same time.

[0007] Optionally, when acquiring images of multiple angles of a sample placed in a grating imaging system, the sample is three-dimensionally reconstructed based on the absorption information images corresponding to the bright stripes, the absorption information images corresponding to the dark stripes, the average absorption information image, the refraction information image and the scattering information image acquired at each angle.

[0008] Optionally, separating absorption information, refraction information, and scattering information of the projected image in combination with the background image, and simultaneously obtaining absorption information images corresponding to bright fringes and absorption information images corresponding to dark fringes in the moiré fringes includes:

[0009] Separating the absorption information image corresponding to the bright fringes in the moiré fringes in the projected image and removing the background image to obtain a high-energy absorption image;

[0010] The absorption information image corresponding to the dark fringes in the moiré fringes in the projection image is separated, and the background image is removed to obtain a low-energy absorption image.

[0011] Optionally, separating the absorption information, the refraction information, and the scattering information of the projection image in combination with the background image, and simultaneously acquiring an average absorption information image, a refraction information image, and a scattering information image includes:

[0012] Get the average absorption information image, the average absorption information satisfies

[0013] Obtain a refraction information image, the refraction information satisfies

[0014] Acquire a scattering information image, the scattering information satisfies

[0015] in, is the light intensity at point m, n on the detector when there is a sample, is the light intensity at point m, n on the detector when there is no sample, p2 is the period of the second grating in the grating imaging system, d is the distance between the first and second gratings in the grating imaging system, arg is a complex number angle operation, rem is a complex number modulus operation, and k (k = 1, 2, …, N) is the number of steps of uniform motion of a point m, n on the detector.

[0016] Optionally, the light intensity at point m, n on the detector is

[0017] Among them, A0 is the average intensity, A1 is the amplitude, For phase.

[0018] According to a second aspect of the present invention, a grating imaging processing device is provided, comprising:

[0019] An image acquisition module is used to acquire a projection image of at least one angle of a sample placed in the grating imaging system when the moiré fringes on the detector are evenly distributed, and a background image when no sample is placed;

[0020] An image processing module is used to separate the absorption information, refraction information, and scattering information of the projection image in combination with the background image, and simultaneously obtain the absorption information image corresponding to the bright fringes in the moiré fringes, the absorption information image corresponding to the dark fringes, the average absorption information image, the refraction information image, and the scattering information image.

[0021] Optionally, it also includes: a reconstruction module, which is used to reconstruct the sample in three dimensions according to the absorption information image corresponding to the bright stripes, the absorption information image corresponding to the dark stripes, the average absorption information image, the refraction information image and the scattering information image obtained at each angle when acquiring images of multiple angles of the sample placed in the grating imaging system.

[0022] Optionally, the image processing module includes:

[0023] a first separation unit, configured to separate an absorption information image corresponding to bright fringes in the moiré fringes in the projection image, and obtain a high-energy absorption image after removing the background image;

[0024] The second separation unit is used to separate the absorption information image corresponding to the dark fringes in the moiré fringes in the projection image, and obtain the low-energy absorption image after removing the background image.

[0025] Optionally, the image processing module includes:

[0026] The average absorption information separation unit is used to obtain an average absorption information image, wherein the average absorption information satisfies

[0027] A refraction information separation unit is used to obtain a refraction information image, wherein the refraction information satisfies

[0028]

[0029] The scattering information separation unit is used to obtain a scattering information image, wherein the scattering information satisfies

[0030]

[0031] in, is the light intensity at point m, n on the detector when there is a sample, is the light intensity at point m, n on the detector when there is no sample, p2 is the period of the second grating in the grating imaging system, d is the distance between the first and second gratings in the grating imaging system, arg is a complex number angle operation, rem is a complex number modulus operation, and k (k = 1, 2, …, N) is the number of steps of uniform motion of a point m, n on the detector.

[0032] Optionally, the light intensity at point m, n on the detector is

[0033] Among them, A0 is the average intensity, A1 is the amplitude, For phase.

[0034] According to a third aspect of the present invention, a grating imaging processing system is provided, comprising:

[0035] A light source, a zeroth grating, a first grating, a second grating and a detector are sequentially arranged along the light transmission direction, and a sample can be placed between the zeroth grating and the first grating;

[0036] It also includes: at least one processor, the at least one processor is electrically connected to the detector; the at least one processor is also communicatively connected to the memory; wherein,

[0037] The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can perform the grating imaging processing method proposed in any embodiment of the present invention.

[0038] According to a fourth aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the grating imaging processing method provided in any embodiment of the present invention when executed.

[0039] The grating imaging processing method, device, system, and medium proposed in the present invention include: when the moiré fringes on the detector are uniformly distributed, obtaining a projection image of at least one angle of a sample placed in the grating imaging system, as well as a background image when no sample is placed; separating the absorption information, refraction information, and scattering information from the projection image and the background image, thereby obtaining an absorption information image corresponding to the bright fringes in the moiré fringes, an absorption information image corresponding to the dark fringes, an average absorption information image, a refraction information image, and a scattering information image. Thus, the grating imaging system can obtain multimodal imaging, and the sample structure can be analyzed based on the images of each modality, thereby obtaining more comprehensive information about the sample's interior.

[0040] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0042] Figure 1 is a flow chart of a grating imaging processing method proposed in an embodiment of the present invention;

[0043] Figure 2Schematic diagram of the structure of the grating imaging system proposed in an embodiment of the present invention;

[0044] Figure 3 Schematic diagram of initial moiré fringes in the grating imaging processing method proposed in an embodiment of the present invention;

[0045] Figure 4 Schematic diagram of a moiré fringe adjusted once in the grating imaging processing method proposed in an embodiment of the present invention;

[0046] Figure 5 Schematic diagram of the moiré fringes secondary adjustment in the grating imaging processing method proposed in an embodiment of the present invention;

[0047] Figure 6 Schematic diagram of uniform moiré fringes in the grating imaging processing method proposed in an embodiment of the present invention;

[0048] Figure 7 This is a projection diagram after a sample is placed in the grating imaging processing method proposed in an embodiment of the present invention;

[0049] Figure 8 Schematic diagram of high-energy absorption corresponding to moiré bright fringes in the grating imaging processing method proposed in an embodiment of the present invention;

[0050] Figure 9 Schematic diagram of low-energy absorption corresponding to moiré dark fringes in the grating imaging processing method proposed in an embodiment of the present invention;

[0051] Figure 10 Schematic diagram of high-energy absorption of a background image corresponding to moiré bright fringes in a grating imaging processing method according to an embodiment of the present invention;

[0052] Figure 11 Schematic diagram of low-energy absorption of a background image corresponding to moiré dark fringes in a grating imaging processing method proposed in an embodiment of the present invention;

[0053] Figure 12 is a schematic diagram of average absorption in the grating imaging processing method proposed in an embodiment of the present invention;

[0054] Figure 13 is a schematic diagram of refraction in the grating imaging processing method proposed in an embodiment of the present invention;

[0055] Figure 14 is a schematic diagram of scattering in the grating imaging processing method proposed in an embodiment of the present invention;

[0056] Figure 15 1 is a block diagram of a grating imaging processing device according to an embodiment of the present invention;

[0057] Figure 16 It is a structural diagram of a grating imaging processing system proposed in an embodiment of the present invention. DETAILED DESCRIPTION

[0058] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0059] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0060] Figure 1 This is a flow chart of the grating imaging processing method proposed in an embodiment of the present invention. Figure 1 As shown, the method includes:

[0061] S101, when the moiré fringes on the detector are evenly distributed, acquiring a projection image of at least one angle of a sample placed in the grating imaging system, and a background image when no sample is placed in the system;

[0062] It is understandable that if Figure 2 As shown in FIG, the grating imaging system is provided with a light source, a zeroth grating, a first grating, a second grating and a detector in the order of light transmission direction. Among them, the light source is X-ray, the zeroth grating is used to divide the light source into several sub-light sources, and the zeroth grating is an absorption grating. The first grating is a phase grating, and the second grating is an absorption grating. After the sub-light sources pass through the first grating, they form a self-image at the position of the second grating. The self-image interferes with the second grating to form amplified moiré fringes on the detector (such as Figure 3 shown).

[0063] The first grating and the second grating can be aligned first (eg Figure 4 Then adjust the pitch angle of the second grating to make the periods of the upper and lower moiré fringes in the field of view equal (as shown in Figure 5 Then adjust the scroll angle of the second grating to obtain approximately vertical moiré fringes (as shown in Figure 6 As shown). At this time, the moiré fringes on the detector are evenly distributed. During the adjustment of the first grating and the second grating, the detector can continue to collect images until the moiré fringes in the image collected by the detector are evenly distributed. At this time, the adjustment of the first grating and the second grating can be stopped. At this time, the background image without the sample can be saved. Afterwards, the sample is placed, and the projection image of the sample is obtained by the detector (as shown). Figure 7 shown).

[0064] S102, separating the absorption information, refraction information, and scattering information of the projection image and the background image to obtain an absorption information image corresponding to bright fringes in the moiré fringes, an absorption information image corresponding to dark fringes, an average absorption information image, a refraction information image, and a scattering information image.

[0065] Ultimately, the projected image and background image yield dual-energy CT images (absorption information images corresponding to the bright and dark fringes in the moiré pattern), as well as average absorption information images, refraction information images, and scattering information images. These images can be used to comprehensively analyze the internal structure of the sample. Separation methods can include Fourier transforms and phase-stepping methods. The image separation process is described in detail below.

[0066] Optionally, when acquiring images of multiple angles of a sample placed in a grating imaging system, the sample is three-dimensionally reconstructed based on the absorption information images corresponding to the bright stripes, the absorption information images corresponding to the dark stripes, the average absorption information image, the refraction information image, and the scattering information image acquired at each angle.

[0067] In other words, if a sample placed in a grating imaging system is stationary, the detector can only detect an image of the sample from a single angle. However, if the sample is rotated, the detector can detect images from all angles, allowing for a three-dimensional reconstruction of the sample. The three-dimensional reconstruction can be performed using computer graphics, computer-aided geometric design, computer vision, computer animation, and other related technologies. Software options include 3DMAX, Maya, AutoCAD, and UG, which are not specifically limited here.

[0068] Optionally, separating the absorption information, the refraction information, and the scattering information of the projected image in combination with the background image to obtain an absorption information image corresponding to bright fringes and an absorption information image corresponding to dark fringes in the moiré fringes includes:

[0069] Separate the absorption information image corresponding to the bright fringes in the moiré fringes in the projected image, and remove the background image to obtain the high-energy absorption image;

[0070] The absorption information image corresponding to the dark fringes in the moiré fringes in the projection image is separated, and the background image is removed to obtain a low-energy absorption image.

[0071] It is understandable that in Figure 7 On the projected image shown, the image corresponding to the moiré bright fringes can be seen, and this part of the image can be selected as the absorption information image corresponding to the bright fringes in the moiré fringes (such as Figure 8 Similarly, we can see the image corresponding to the dark moiré fringes, and we can select this part of the image as the absorption information image corresponding to the dark fringes in the moiré fringes (as shown in Figure 9 As shown). The selection process can be separated according to the light intensity of each pixel. For example, a light intensity threshold is set and the pixels with corresponding light intensity are selected according to the light intensity. Figure 10 yes Figure 8 High energy absorption image after background removal, Figure 11 yes Figure 9 Remove low-energy absorption images from the background.

[0072] Optionally, separating the absorption information, the refraction information, and the scattering information of the projection image in combination with the background image to obtain the average absorption information image, the refraction information image, and the scattering information image includes:

[0073] Get the average absorption information image, the average absorption information satisfies

[0074] Get the refraction information image, the refraction information satisfies

[0075] Get the scattering information image, the scattering information satisfies

[0076] in, is the light intensity at point m, n on the detector when there is a sample, is the light intensity at point m, n on the detector when there is no sample, p2 is the period of the second grating in the grating imaging system, d is the distance between the first and second gratings in the grating imaging system, arg is a complex number angle operation, rem is a complex number modulus operation, and k (k = 1, 2, …, N) is the number of steps of uniform motion of a point m, n on the detector.

[0077] Optionally, the light intensity at point m, n on the detector

[0078] Among them, A0 is the average intensity, A1 is the amplitude, For phase.

[0079] That is, when there is a sample, the light intensity at point m, n on the detector is When there is no sample, the light intensity at point m, n on the detector

[0080] When the phase stepping method is used to separate the average absorption, refraction and scattering information, the average absorption, refraction and scattering information can be separated along the vertical grating groove direction ( Figure 2 The process of translating any grating at equal intervals (three steps or more) in the x-direction and recording the light intensity distribution on the detector at the same time, and obtaining the average absorption, refraction and scattering images by calculation. After collecting data with and without samples respectively, the absorption, refraction and scattering information images of the sample can be obtained by the above calculation. Among them, for the next step of CT reconstruction, the average absorption image is taken as Figure 12 As shown, the refraction image is Figure 13 As shown, the scattering image is Figure 14 shown.

[0081] Therefore, high-energy absorption images, low-energy absorption images, average absorption images, refraction images and scattering images were obtained through the above image processing method to obtain rich sample information.

[0082] Figure 15 FIG is a block diagram of a grating imaging processing device according to an embodiment of the present invention. Figure 15 As shown, the device includes:

[0083] An image acquisition module 101 is configured to acquire, when the moiré fringes on the detector are uniformly distributed, a projection image of at least one angle of a sample placed in the grating imaging system, and a background image when no sample is placed;

[0084] The image processing module 102 is used to separate the absorption information, refraction information, and scattering information of the projection image combined with the background image, and obtain the absorption information image corresponding to the bright stripes in the moiré stripes, the absorption information image corresponding to the dark stripes, the average absorption information image, the refraction information image, and the scattering information image.

[0085] Optionally, it also includes: a reconstruction module, which is used to reconstruct the sample in three dimensions according to the absorption information image corresponding to the bright stripes, the absorption information image corresponding to the dark stripes, the average absorption information image, the refraction information image and the scattering information image obtained at each angle when acquiring images of multiple angles of the sample placed in the grating imaging system.

[0086] Optionally, the image processing module includes:

[0087] The first separation unit is used to separate the absorption information image corresponding to the bright fringes in the moiré fringes in the projected image and obtain the high-energy absorption image after removing the background image;

[0088] The second separation unit is used to separate the absorption information image corresponding to the dark fringes in the moiré fringes in the projection image and obtain the low-energy absorption image after removing the background image.

[0089] Optionally, the image processing module includes:

[0090] The average absorption information separation unit is used to obtain the average absorption information image, and the average absorption information satisfies

[0091] The refraction information separation unit is used to obtain a refraction information image, and the refraction information satisfies

[0092]

[0093] Scattering information separation unit, used to obtain scattering information image, scattering information meets

[0094] in, is the light intensity at point m, n on the detector when there is a sample, is the light intensity at point m, n on the detector when there is no sample, p2 is the period of the second grating in the grating imaging system, d is the distance between the first and second gratings in the grating imaging system, arg is a complex number angle operation, rem is a complex number modulus operation, and k (k = 1, 2, …, N) is the number of steps of uniform motion of a point m, n on the detector.

[0095] Optionally, the light intensity at point m, n on the detector

[0096]

[0097] Among them, A0 is the average intensity, A1 is the amplitude, For phase.

[0098] The grating imaging processing device provided in the embodiment of the present invention can execute the grating imaging processing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method, which will not be described in detail here.

[0099] Figure 16 FIG. 1 is a schematic diagram of the structure of the grating imaging processing system proposed in an embodiment of the present invention. Figure 2 and Figure 16 As shown, the system includes:

[0100] A light source, a zeroth grating, a first grating, a second grating and a detector are sequentially arranged along the light transmission direction, and a sample can be placed between the zeroth grating and the first grating;

[0101] It also includes: at least one processor 11, at least one processor 11 is electrically connected to the detector; at least one processor 11 is also communicatively connected to the memory; wherein,

[0102] The memory stores a computer program that can be executed by at least one processor 11. The computer program is executed by at least one processor 11 so that the at least one processor 11 can execute the grating imaging processing method proposed in any embodiment of the present invention.

[0103] An embodiment of the present invention further provides a computer-readable storage medium storing computer instructions. The computer instructions are used to enable a processor to implement the grating imaging processing method provided in any embodiment of the present invention when executed.

[0104] Figure 16 A schematic diagram of a raster imaging processing system that can be used to implement embodiments of the present invention is shown. The processing system is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The processing system can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0105] like Figure 16 As shown, the raster imaging processing system includes at least one processor 11 and memory, such as a read-only memory (ROM) 12 and a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores a computer program executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from the storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the processing system 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0106] Various components in processing system 10 are connected to I / O interface 15, including an input unit 16, such as a keyboard, mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, optical disk, etc.; and a communication unit 19, such as a network card, modem, wireless communication transceiver, etc. Communication unit 19 allows processing system 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0107] The processor 11 may be any general-purpose and / or specialized processing component with processing and computing capabilities. Examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the raster imaging processing method.

[0108] In some embodiments, the raster imaging processing method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed onto processing system 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the raster imaging processing method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the raster imaging processing method in any other suitable manner (e.g., via firmware).

[0109] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0110] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0111] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0112] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0113] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0114] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0115] In summary, the grating imaging processing method, device, system, and medium proposed in the present invention include: when the moiré fringes on the detector are uniformly distributed, obtaining a projection image of at least one angle of a sample placed in the grating imaging system, as well as a background image when no sample is placed; combining the projection image with the background image to separate absorption information, refraction information, and scattering information, thereby obtaining an absorption information image corresponding to the bright fringes in the moiré fringes, an absorption information image corresponding to the dark fringes, an average absorption information image, a refraction information image, and a scattering information image. Thus, the grating imaging system can obtain multimodal imaging, and the sample structure can be analyzed based on the images of each modality, thereby obtaining more comprehensive information about the sample's interior.

[0116] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0117] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A grating imaging processing method, characterized in that: include: When the moiré fringes on the detector are uniformly distributed, a projection image of at least one angle of a sample placed in the grating imaging system and a background image when no sample is placed are acquired; Separating absorption information, refraction information, and scattering information from the projected image in combination with the background image, and simultaneously obtaining an absorption information image corresponding to bright fringes, an absorption information image corresponding to dark fringes, an average absorption information image, a refraction information image, and a scattering information image in the moiré fringes; When images of a sample placed in a grating imaging system are acquired at multiple angles, three-dimensional reconstruction of the sample is performed based on the absorption information images corresponding to the bright stripes, the absorption information images corresponding to the dark stripes, the average absorption information image, the refraction information image, and the scattering information image acquired at each angle; Separating absorption information, refraction information, and scattering information of the projection image in combination with the background image, and simultaneously obtaining absorption information images corresponding to bright fringes and dark fringes in the moiré fringes includes: Separating the absorption information image corresponding to the bright fringes in the moiré fringes in the projected image and removing the background image to obtain a high-energy absorption image; The absorption information image corresponding to the dark fringes in the moiré fringes in the projection image is separated, and the background image is removed to obtain a low-energy absorption image.

2. The grating imaging processing method according to claim 1, characterized in that: Separating absorption information, refraction information, and scattering information from the projection image in combination with the background image, and simultaneously obtaining an average absorption information image, a refraction information image, and a scattering information image includes: Get the average absorption information image, the average absorption information satisfies Obtain a refraction information image, the refraction information satisfies Acquire a scattering information image, the scattering information satisfies in, is the light intensity at point (m,n) on the detector when there is a sample, is the light intensity at point (m,n) on the detector in the absence of a sample, p2 is the period of the second grating in the grating imaging system, d is the distance between the first and second gratings in the grating imaging system, arg is a complex angle operation, rem is a complex modulus operation, and k (k = 1, 2, …, N) is the number of steps of uniform motion of a point (m,n) on the detector.

3. The grating imaging processing method according to claim 2, characterized in that: The light intensity at point (m,n) on the detector Among them, A0 is the average intensity, A1 is the amplitude, For phase.

4. A grating imaging processing device, characterized in that: include: An image acquisition module is used to acquire a projection image of at least one angle of a sample placed in the grating imaging system when the moiré fringes on the detector are evenly distributed, and a background image when no sample is placed; an image processing module, configured to separate absorption information, refraction information, and scattering information from the projected image in combination with the background image, and simultaneously obtain an absorption information image corresponding to bright fringes, an absorption information image corresponding to dark fringes, an average absorption information image, a refraction information image, and a scattering information image in the moiré fringes; The invention also includes: a reconstruction module for, when acquiring images of multiple angles of a sample placed in the grating imaging system, performing three-dimensional reconstruction of the sample according to the absorption information image corresponding to the bright stripes, the absorption information image corresponding to the dark stripes, the average absorption information image, the refraction information image, and the scattering information image corresponding to each angle; The image processing module includes: a first separation unit, configured to separate an absorption information image corresponding to bright fringes in the moiré fringes in the projection image, and obtain a high-energy absorption image after removing the background image; The second separation unit is used to separate the absorption information image corresponding to the dark fringes in the moiré fringes in the projection image, and obtain the low-energy absorption image after removing the background image.

5. The grating imaging processing device according to claim 4, characterized in that: The image processing module includes: The average absorption information separation unit is used to obtain an average absorption information image, wherein the average absorption information satisfies A refraction information separation unit is used to obtain a refraction information image, wherein the refraction information satisfies The scattering information separation unit is used to obtain a scattering information image, wherein the scattering information satisfies in, is the light intensity at point (m,n) on the detector when there is a sample, is the light intensity at point (m,n) on the detector in the absence of a sample, p2 is the period of the second grating in the grating imaging system, d is the distance between the first and second gratings in the grating imaging system, arg is a complex angle operation, rem is a complex modulus operation, and k (k = 1, 2, …, N) is the number of steps of uniform motion of a point (m,n) on the detector.

6. The grating imaging processing device according to claim 4, characterized in that: The light intensity at point (m,n) on the detector Among them, A0 is the average intensity, A1 is the amplitude, For phase.

7. A grating imaging processing system, characterized in that: include: A light source, a zeroth grating, a first grating, a second grating and a detector are sequentially arranged along the light transmission direction, and a sample can be placed between the zeroth grating and the first grating; It also includes: at least one processor, the at least one processor is electrically connected to the detector; the at least one processor is also communicatively connected to the memory; wherein, The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform the grating imaging processing method according to any one of claims 1 to 3.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the grating imaging processing method according to any one of claims 1 to 3 when executed.

Images