Method and apparatus for simultaneously acquiring ultra-high resolution images and high speed wide field of view images

The image acquisition method controls light amplitude across dynamic and static regions to enhance both spatial and temporal resolution, enabling ultra-high resolution and high-speed wide field of view imaging, suitable for observing biological phenomena.

JP7756416B2Active Publication Date: 2025-10-20UNIST (ULSAN NAT INST OF SCI & TECH)
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2021114007
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-24
Filing Date
2021-07-09
Publication Date
2025-10-20
Estimated Expiration
2041-07-09

AI Technical Summary

Technical Problem

Existing optical microscopes face limitations in achieving both high spatial and temporal resolution due to the diffraction limit and the complexity of using short wavelength light, which can damage living cells and require complex sample preparation.

Method used

An image acquisition method that controls the amplitude of light irradiation differently across dynamic and static regions within a single image, using a digital micro-mirror device or similar to separate and process these regions, allowing for simultaneous improvement of spatial and temporal resolution.

Benefits of technology

The method enables the acquisition of ultra-high resolution images with high-speed wide field of view, overcoming the trade-off between spatial and temporal resolution, and allows for accurate observation of both static and dynamic biological phenomena without artifacts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007756416000005
    Figure 0007756416000005
  • Figure 0007756416000006
    Figure 0007756416000006
  • Figure 0007756416000007
    Figure 0007756416000007
Patent Text Reader

Abstract

To provide a method and apparatus for simultaneously acquiring a super-high resolution image and a high-speed wide-field image.SOLUTION: An image acquisition method includes the steps of: receiving a first image signal from an optical microscope; generating a first plurality of entire images using the first image signal; distinguishing a dynamic region with respect to the first plurality of entire images and a static region with respect to the first plurality of entire images on the basis of movements of a plurality of objects included in the first plurality of entire images; and controlling the optical microscope so as to irradiate the dynamic region and the static region with light having different amplitudes respectively.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a method and apparatus for simultaneously acquiring ultra-high resolution images and high speed wide field of view images. [Background technology]

[0002] The higher the spatial resolution of a microscope objective lens, the better the resolution of the captured image, allowing for more detailed structure observation.General optical microscopes observe materials using visible light, so there is a limit to the spatial resolution (diffraction limit) defined as the numerical aperture and wavelength.

[0003] Optical microscopes can achieve high spatial resolution by using lenses with a large numerical aperture or by irradiating light with wavelengths shorter than visible light, such as ultraviolet light or electron beams. However, optical microscopes have physical limitations in expanding the numerical aperture of their lenses. Furthermore, measurement methods using short wavelength light are more complex to implement and require more difficult sample preparation than optical microscopes in the visible light range. In particular, measurement methods using short wavelength light cannot replace optical microscopes because the high energy of short wavelength light can damage living cells, making it difficult to observe cells in their natural state.

[0004] Fluorescence optical microscopes have the advantage of being able to selectively capture images of the desired area of ​​observation by using fluorescent proteins on specific organelles within a cell. However, like general optical microscopes, fluorescence optical microscopes are subject to the diffraction limit, which limits spatial resolution. To overcome the spatial resolution limitations of fluorescence optical microscopes, super-resolution fluorescence microscopes such as single molecular localization microscopy (SMLM) and stimulated emission depletion (STED) microscopy have been developed.

[0005] Structured illumination microscopy (SIM) has superior temporal resolution compared to fluorescence molecular location-based microscopy and stimulated emission depletion microscopy. However, because SIM requires multiple images to construct a single ultra-high resolution image, as with other ultra-high resolution fluorescence microscopes, increasing spatial resolution still results in a decrease in temporal resolution across the entire image. Summary of the Invention [Problem to be solved by the invention]

[0006] The embodiment provides a technique that can simultaneously improve spatial resolution and temporal resolution by controlling spatial differences in the amplitude of light irradiated within a single image. However, the technical issues are not limited to those mentioned above, and further technical issues exist. [Means for solving the problem]

[0007] An image acquisition method according to one embodiment includes the steps of receiving a first video signal from an optical microscope, generating a first plurality of images using the first video signal, dividing the first plurality of images into dynamic regions and static regions based on the movements of a plurality of objects contained in the first plurality of images, and controlling the optical microscope so that light having different amplitudes is irradiated onto the dynamic regions and the static regions.

[0008] The method may further include generating a mask that separates the dynamic region and the static region using two consecutive images from among the first plurality of images.

[0009] The method may further include receiving a second video signal from the optical microscope, the second video signal being acquired when the dynamic region and the static region are irradiated with light having different amplitudes from each other; generating a second plurality of entire images using the second video signal; generating a plurality of static region images showing only the static region and a dynamic region image showing only the dynamic region based on the second plurality of entire images and the mask; and generating a final image for the plurality of objects based on the plurality of static region images and the dynamic region image.

[0010] The step of generating the final image may include the steps of generating a super-high resolution image for the static region using the plurality of static region images, and generating the final image using the super-high resolution image and the dynamic region image.

[0011] The controlling step may include controlling the optical microscope so that the dynamic region is irradiated with light in a plane wave pattern, and controlling the optical microscope so that the static region is irradiated with light in a sinusoidal wave pattern.

[0012] The light may be in the form of electromagnetic waves within a certain wavelength range.

[0013] The first image signal can be acquired by irradiating light of a plane wave pattern from the optical microscope.

[0014] The optical microscope may be implemented using a digital micro-mirror device (DMD), a liquid crystal-based optical modulator, a micro-electro-mechanical systems (MEMS)-based optical modulator, or an LED.

[0015] According to one embodiment, an image acquisition device includes a memory that stores instructions for simultaneously acquiring an ultra-high resolution image and a high-speed wide-field image, and a processor that executes the instructions. When the instructions are executed by the processor, the processor receives a first video signal from an optical microscope, generates a first plurality of images using the first video signal, divides the first plurality of images into a dynamic region and a static region based on movements of a plurality of objects included in the first plurality of images, and controls the optical microscope so that light having different amplitudes is irradiated onto the dynamic region and the static region.

[0016] The processor may generate a mask that separates the dynamic region and the static region using two consecutive images from the first plurality of images.

[0017] The processor can receive a second video signal acquired by irradiating the dynamic region and the static region with light having different amplitudes from each other from the optical microscope, generate a second plurality of entire images using the second video signal, generate a plurality of static region images showing only the static region and a dynamic region image showing only the dynamic region based on the second plurality of entire images and the mask, and generate final images for the plurality of objects based on the plurality of static region images and the dynamic region images.

[0018] The processor may generate a super-resolution image for the static region using the plurality of static region images, and generate the final image using the super-resolution image and the dynamic region image.

[0019] The processor may control the optical microscope so that the dynamic region is illuminated with light in a plane wave pattern, and may control the optical microscope so that the static region is illuminated with light in a sinusoidal wave pattern.

[0020] The light may be in the form of electromagnetic waves within a certain wavelength range.

[0021] The first image signal can be acquired by irradiating light of a plane wave pattern from the optical microscope.

[0022] The optical microscope may be implemented using a digital micro-mirror device (DMD), a liquid crystal-based optical modulator, a micro-electro-mechanical systems (MEMS)-based optical modulator, or an LED. [Effects of the Invention]

[0023] According to the present invention, the amplitude of light irradiated within one image can be spatially controlled to be different, thereby improving both spatial and temporal resolutions. [Brief explanation of the drawings]

[0024] [Figure 1] FIG. 1 illustrates an image acquisition system according to one embodiment. [Figure 2] FIG. 2 is a schematic diagram of the image acquisition device shown in FIG. 1; [Figure 3] 1 is a flowchart illustrating an operation of the image acquisition device. [Figure 4] 1 shows an example of an entire image generated by an image capture device. [Figure 5] 1 shows an example in which an image generating device separates dynamic and static regions. [Figure 6] 1 shows an example where the image generator covers dynamic areas via a mask. [Figure 7] 1 shows an example in which the image generator has static areas covered via a mask. [Figure 8] FIG. 1 is a diagram showing an example in which an optical microscope is realized by a micromirror element. DETAILED DESCRIPTION OF THE INVENTION

[0025] The specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified in various forms. Therefore, the embodiments are not limited to the specific disclosed forms, and the scope of the present specification includes modifications, equivalents, or alternatives within the technical spirit.

[0026] Although terms such as "first" or "second" may be used to describe multiple components, such terms should be construed only to distinguish one component from the other components. For example, a first component may be designated as a second component, and similarly, a second component may be designated as a first component.

[0027] The singular expression includes the plural expression unless the context clearly dictates otherwise. In this specification, the words "comprise" or "have" and the like indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, and should be understood as not precluding the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0028] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the present invention pertains. Commonly used predefined terms should be interpreted as having a meaning consistent with the meaning they have in the context of the relevant art, and should not be interpreted as having an ideal or overly formal meaning unless expressly defined herein.

[0029] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings, in which the same reference numerals in the various drawings denote the same elements.

[0030] FIG. 1 is a diagram illustrating an image acquisition system according to one embodiment.

[0031] The image acquisition system 10 includes an optical microscope 100 and an image acquisition device 300 .

[0032] The image acquisition system 10 is capable of simultaneously measuring biological phenomena at different spatiotemporal scales in the same system within a single image.

[0033] The image acquisition system 10 can eliminate the trade-off effect that would otherwise have been required to sacrifice either spatial or temporal resolution. The image acquisition system 10 can apply ultra-high resolution images and ultra-high speed images to other regions within the image as needed. The image acquisition system 10 is effective for research related to microfluidic channels, research fields requiring the observation of biological and physical phenomena such as calcium signaling that require high temporal resolution, and for observing systems in which microstructural changes and macroscopic rapid dynamics coexist.

[0034] The optical microscope 100 may irradiate light onto an object to be observed. The optical microscope 100 may irradiate light having different amplitudes depending on the region of the object to be observed. The optical microscope 100 may irradiate light in accordance with a control signal received from the image capture device 300. For example, the optical microscope 100 may irradiate light in the visible light range. The optical microscope 100 may irradiate light in the form of electromagnetic waves in a certain wavelength range (e.g., all wavelengths) other than the visible light range. The optical microscope 100 may irradiate light in a plane wave pattern. The optical microscope 100 may irradiate light in a sinusoidal wave pattern. The optical microscope 100 may be implemented using a digital micro-mirror device (DMD), a liquid crystal-based optical modulator, a micro-electromechanical systems (MEMS)-based optical modulator, or an LED. The optical microscope 100 may be implemented to irradiate light in the form of electromagnetic waves of various wavelengths.

[0035] The optical microscope 100 may transmit a video signal acquired through the irradiated light to the image acquisition device 300. For example, the optical microscope 100 may irradiate light of a plane wave pattern to acquire a first video signal. The optical microscope 100 may transmit the first video signal to the image acquisition device 300. The optical microscope 100 may irradiate at least two or more regions of the observation object with light having different amplitudes based on a control signal received from the image acquisition device 300. The optical microscope 100 may irradiate at least two or more regions of the observation object with light having different amplitudes to acquire a second video signal. The optical microscope 100 may transmit the second video signal to the image acquisition device 300.

[0036] The image acquisition device 300 can make it possible to observe areas that were previously unobservable due to artifacts caused by objects that move or change shape when constructing an ultra-high resolution image, with a spatial resolution that corresponds to the diffraction limit.

[0037] The image acquisition device 300 can track the position and shape of a moved or deformed object at the moment each image is acquired with spatial resolution approaching the diffraction limit while the number of images required to construct an ultra-high resolution image of the structured illumination microscope are acquired.

[0038] The image acquisition device 300 can control the optical microscope 100 so that light having different amplitudes is irradiated depending on the region of the observation target. The image acquisition device 300 can improve the spatial resolution and / or temporal resolution within a single image depending on the region of the observation target. The image acquisition device 300 can simultaneously acquire an ultra-high resolution image and a high-speed wide-field image depending on the region of the observation target and output them to a user.

[0039] FIG. 2 is a schematic diagram of the image acquisition device shown in FIG.

[0040] The image acquisition device 300 includes a processor 310 and a memory 350 .

[0041] The processor 310 may include one or more of a central processing unit, an application processor, or a communication processor.

[0042] The processor 310 performs calculations and data processing related to the control of at least one other component of the image capture device 300. For example, the processor 310 may execute applications and / or software stored in the memory 350.

[0043] The processor 310 may process data received and data stored in the memory 350. The processor 310 may process data stored in the memory 350. The processor 310 may execute computer-readable code (e.g., software) stored in the memory 350 and instructions triggered by the processor 310.

[0044] Processor 310 is a hardware-implemented data processing device having circuitry with physical structures for performing desired operations, which may include, for example, code or instructions contained in a program.

[0045] For example, a data processing device implemented in hardware may include a microprocessor, a central processing unit, a processor core, a multi-core processor, a multiprocessor, an ASIC (Application-Specific Integrated Circuit), or an FPGA (Field Programmable Gate Array).

[0046] The processor 310 can receive a first video signal from the optical microscope 100. For example, the first video signal may be a video signal acquired when the optical microscope 100 is irradiated with light in a plane wave pattern.

[0047] The processor 310 may generate a first plurality of entire images using the first video signal. For example, the first plurality of entire images may refer to images including the entire image acquired by irradiating the object with light of a plane wave pattern.

[0048] The processor 310 classifies a dynamic region for the first plurality of images based on the movement of the plurality of objects included in the first plurality of images. For example, the dynamic region may be a region for acquiring a wide-field-of-view image. The processor 310 may classify a region including at least one of the plurality of objects as a dynamic region when the movement speed of the object is equal to or greater than a user-set object movement speed.

[0049] The processor 310 classifies the first plurality of images into static regions based on the motion of the plurality of objects included in the first plurality of images. For example, the static region may be a region for capturing ultra-high resolution video. The processor 310 may classify a region including at least one of the plurality of objects as a static region when the speed of the object motion is less than a speed set by a user.

[0050] The processor 310 may control the optical microscope 100 to illuminate a dynamic region across the first plurality of images and a static region across the first plurality of images with light having different amplitudes. For example, the processor 310 may control the optical microscope 100 to illuminate a dynamic region with light in a plane wave pattern. The processor 310 may control the optical microscope 100 to illuminate a static region with light in a sinusoidal wave pattern.

[0051] The processor 310 generates a mask that separates the dynamic and static regions using two consecutive images from the first plurality of images. For example, the mask may cover only the dynamic regions. The mask may cover only the static regions.

[0052] The processor 310 may receive a second video signal obtained by irradiating the dynamic region and the static region with light having different amplitudes from each other from the optical microscope 100.

[0053] The processor 310 may generate a second plurality of whole images using the second video signal. For example, the second plurality of whole images may refer to images including whole images acquired by irradiating each region of the observation target with light having a different amplitude.

[0054] The processor 310 may generate a plurality of static region images showing only the static regions and a dynamic region image showing only the dynamic regions based on the second plurality of images and the mask.

[0055] The processor 310 may generate a final image for multiple objects included in the observation target based on the multiple static area images and the dynamic area image. For example, the processor 310 may generate a super-resolution image for the static area using the multiple static area images. The processor 310 may generate a final image using the super-resolution image and the dynamic area image.

[0056] The processor 310 can generate a control signal for controlling the optical microscope 100. The processor 310 may send the control signal to the optical microscope 100.

[0057] The memory 350 may include volatile and / or non-volatile memory. The memory 350 stores instructions and / or data related to at least one other component of the image acquisition device 300.

[0058] The memory 350 can store software and / or programs, etc. For example, the memory 350 can store applications and software for simultaneously acquiring ultra-high resolution images and high-speed wide-field images, etc.

[0059] FIG. 3 is a flowchart illustrating the operation of an image capture device, FIG. 4 shows an example of an entire image generated by the image capture device, FIG. 5 shows an example of an image generation device dividing dynamic and static areas, FIG. 6 shows an example of an image generation device covering dynamic areas through a mask, and FIG. 7 shows an example of an image generation device covering static areas through a mask.

[0060] The image capture device 300 receives a first video signal (S3010).

[0061] The image capture device 300 uses the first video signal to generate (S3020) a first plurality of overall images 410. Referring to Figure 4, the first plurality of overall images 410 includes a plurality of objects 411, 451, 453, and 455 to be observed.

[0062] The image acquisition device 300 generates a mask for separating a dynamic region from a static region using two consecutive images from the first plurality of images 410 (S3030).

[0063] The image acquisition device 300 divides the first plurality of entire images 410 into a dynamic region 435 and a static region 431 based on the movements of the plurality of objects 411, 451, 453, and 455 included in the first plurality of entire images 410 (S3040).

[0064] The image acquisition device 300 controls the optical microscope 100 so that the dynamic region 435 and the static region 431 are irradiated with light having different amplitudes (S3050).

[0065] The image acquisition device 300 receives a second image signal acquired by irradiating the dynamic area 435 and the static area 431 with light having different amplitudes from each other from the optical microscope 100 (S3060).

[0066] The image capture device 300 generates a second plurality of entire images 430 using the second video signal (S3070).

[0067] The image acquisition device 300 generates a plurality of static region images 450 showing only the static region and a dynamic region image 470 showing only the dynamic region based on the second plurality of entire images 430 and the mask (S3080). Referring to FIGS. 6 and 7, the image acquisition device 300 may multiply the second plurality of entire images 430 by the mask to separate the region illuminated with the sine wave pattern from the region illuminated with the plane wave, as shown in FIGS. 6 and 7. The image acquisition device 300 generates an ultra-high resolution image of the region illuminated with the sine wave pattern (static region 431), thereby generating an image that allows accurate analysis of the microstructure of the object of observation without generating artifacts. The image acquisition device 300 can analyze the rapidly changing dynamics of the region illuminated with the plane wave (dynamic region 435), thereby generating an image that allows analysis of the correlation between dynamics and microstructure changes.

[0068] The image acquisition device 300 generates a final image for the plurality of objects based on the plurality of static area images 450 and the dynamic area images 470 (S3090). The image acquisition device 300 generates the final image for the static area 431 with ultra-high resolution, allowing for accurate analysis of fine structures, and for the dynamic area 435, allows for analysis of rapidly changing dynamics.

[0069] FIG. 8 is a diagram showing an example in which an optical microscope is realized by a micromirror device.

[0070] The optical microscope 100 can irradiate an object to be observed with an illumination pattern having a spatial distribution of sinusoidal intensity, and acquire an image that passes through the lens as a video signal. The image acquired by the optical microscope 100 is defined by Equation (1).

number

[0071] The image acquisition device 300 can irradiate multiple sinusoidal patterns with different phases and directions, and generate a super-high resolution image using each acquired image.

[0072] However, if the object being observed moves or deforms, artifacts may appear in the generated super-high resolution image, making it difficult to accurately identify the surrounding area where the movement occurred.

[0073] The image acquisition device 300 defines an observation target (for example, a plurality of objects included in the observation target) that moves or deforms as shown in Equation (2) by introducing time t.

number

[0074] If there is no movement or deformation between the acquisition of the multiple images required to construct an ultra-high resolution image for the entire image area O(r,t), the temporal resolution will decrease by the number of images required, but the spatial resolution can be improved by up to 2 times. Conversely, if all areas of the image area O(r,t) are moved or deformed, the only option is to acquire and observe wide-field images with spatial resolution according to the diffraction limit.

[0075] The image acquisition device 300 can spatially control the amplitude of the light emitted when the optical microscope 100 acquires the video signal via Equation (3).

number

[0076] The image acquisition device 300 acquires the static region of the image, O(r s ) and the dynamic domain O(r c , t), and the optical microscope 100 can be controlled so that it can irradiate the sine wave pattern used when acquiring an ultra-high resolution image with the optical microscope 100 and the plane wave pattern used when acquiring a wide field of view image, respectively.

[0077] 8, the image acquisition device 300 can control the optical microscope 100 so that each micromirror constituting the micromirror element precisely coincides with a camera pixel. The image acquisition device 300 can also spatially control the amplitude of light irradiated to each region of the observation target through control of the optical microscope 100. The optical microscope 100 can also arbitrarily irradiate a sine wave pattern and a plane wave within the image through control of the image acquisition device 300.

[0078] The image acquisition device 300 can derive Equation (4) by substituting Equation (2) and Equation (3) into Equation (1). While acquiring multiple images required to construct one super-high resolution image through Equation (4), the image acquisition device 300 may irradiate a non-moving region with a sine wave pattern used in structured illumination microscopy and a moving or deforming region with a plane wave pattern.

number

[0079] For example, the image acquisition device 300 may implement a structured illumination microscope in some areas of the image (e.g., static areas) to acquire ultra-high resolution images, while illuminating other areas (e.g., dynamic areas) with plane waves to capture rapidly changing dynamics.

[0080] The above-described embodiments may be implemented using hardware components, software components, or a combination of hardware and software components. For example, the devices and components described herein may be implemented using one or more general-purpose or special-purpose computers, such as a processor, controller, arithmetic logic unit (ALU), digital signal processor, microcomputer, field programmable array (FPA), programmable logic unit (PLU), microprocessor, or other device that executes and responds to instructions. The processing device executes an operating system (OS) and one or more software applications that run on the operating system. The processing device also accesses, stores, manipulates, processes, and generates data in response to the execution of the software. For ease of understanding, although a single processing device may be described, those skilled in the art will recognize that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0081] Software includes computer programs, codes, instructions, or a combination of one or more thereof, which can configure a processing device to operate as desired or can independently or in combination instruct the processing device. The software and / or data can be permanently or temporarily embodied in any type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave to be interpreted by the processing device or to provide instructions or data to the processing device. The software can be distributed across computer systems coupled to a network and stored and executed in a distributed manner. The software and data can be stored on one or more computer-readable recording media.

[0082] The methods according to the present invention may be embodied in the form of program instructions that can be executed by various computer means and stored on a computer-readable storage medium. The storage medium may include program instructions, data files, data structures, and the like, alone or in combination. The storage medium and program instructions may be specially designed and constructed for the purposes of the present invention, or they may be well-known and available to those skilled in the art of computer software. Examples of computer-readable storage media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code, such as produced by a compiler, but also high-level language code that is executed by a computer using an interpreter, for example. A hardware device may be configured to operate as one or more software modules to perform the operations described in the present invention, or vice versa.

[0083] Although the embodiments have been described above with reference to limited drawings, those skilled in the art may apply various technical modifications and variations based on the above description. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than described, or may be replaced or substituted with other components or equivalents, and still achieve suitable results.

[0084] Therefore, the scope of the present invention should not be limited to the disclosed embodiments, but should be determined by the appended claims and their equivalents.

Claims

1. receiving a first video signal from an optical microscope; generating a first plurality of entire images using the first video signal; dividing the first plurality of images into a dynamic region and a static region based on movements of a plurality of objects included in the first plurality of images; controlling the optical microscope so that the dynamic region and the static region are irradiated with light having amplitudes different from each other; receiving a second video signal acquired by irradiating the dynamic region and the static region with light having different amplitudes from the optical microscope; generating a second plurality of entire images using the second video signal; generating a plurality of static region images showing only the static region and a dynamic region image showing only the dynamic region based on the second plurality of images as a whole and a mask that separates the dynamic region and the static region; generating a final image for the plurality of objects based on the plurality of static area images and the dynamic area image; Image acquisition methods including:

2. The image acquisition method of claim 1 , further comprising generating the mask that separates the dynamic region and the static region using two consecutive images from the first plurality of images.

3. generating the final image comprises: generating a super-resolution image for the static region using the plurality of static region images; generating the final image using the super-resolution image and the dynamic area image; The image acquisition method of claim 1 , comprising:

4. The controlling step includes: controlling the optical microscope so that the dynamic region is irradiated with light in a plane wave pattern; controlling the optical microscope so that the static area is illuminated with light in a sinusoidal pattern; 2. The image acquisition method of claim 1, comprising:

5. The image acquisition method of claim 1 , wherein the light is in the form of electromagnetic waves within a certain wavelength range.

6. The image acquisition method according to claim 1 , wherein the first video signal is acquired by irradiating light having a plane wave pattern from the optical microscope.

7. 2. The image acquisition method of claim 1, wherein the optical microscope is implemented using a digital micro-mirror device (DMD), a liquid crystal-based light modulator, a micro electro mechanical systems (MEMS)-based light modulator, or an LED.

8. a memory for storing instructions for simultaneously acquiring ultra-high resolution images and high-speed wide-field images; a processor for executing said instructions; Including, When the instructions are executed by the processor, the processor: receiving a first video signal from the optical microscope; generating a first plurality of entire images using the first video signal; dividing the first plurality of images into a dynamic region and a static region based on movements of a plurality of objects included in the first plurality of images; controlling the optical microscope so that the dynamic region and the static region are irradiated with light having amplitudes different from each other; receiving a second video signal acquired by irradiating the dynamic region and the static region with light having different amplitudes from each other from the optical microscope; generating a second plurality of entire images using the second video signal; generating a plurality of static region images showing only the static region and a dynamic region image showing only the dynamic region based on the second plurality of images as a whole and a mask that distinguishes the dynamic region from the static region; an image capture device that generates a final image for the plurality of objects based on the plurality of static area images and the dynamic area image;

9. The image acquisition device of claim 8 , wherein the processor generates the mask that separates the dynamic region and the static region using two consecutive images from the first plurality of images.

10. The processor: generating a super-resolution image for the static region using the plurality of static region images; The image acquisition device of claim 8 , wherein the ultra-high resolution image and the dynamic range image are used to generate the final image.

11. The processor: controlling the optical microscope so that the dynamic region is irradiated with light in a plane wave pattern; The image acquisition device of claim 8 , wherein the optical microscope is controlled so that the static area is illuminated with light in a sinusoidal pattern.

12. The image acquisition device of claim 8 , wherein the light is in the form of electromagnetic waves within a certain wavelength range.

13. The image acquisition device according to claim 8 , wherein the first video signal is acquired by irradiating light having a plane wave pattern from the optical microscope.

14. 9. The image acquisition device of claim 8, wherein the optical microscope is implemented using a digital micro-mirror device (DMD), a liquid crystal-based optical modulator, a micro electro mechanical systems (MEMS)-based optical modulator, or an LED.

Citation Information

Patent Citations

  • Fast and efficient adaptive optical imaging compensation method and system based on interference enhancement

    CN107132646A

  • Spatio-temporal wavefront shaping of optical beams

    EP3385770A1

  • Object identification using multiple imaging

    JP2002514304A

  • Display controller for dark room

    JP2009251454A

  • Observation device and observation method

    JP2012118126A