Optical Detection System and Method for Image Segmentation Base

Abstract

To provide a system and method for optical detection based on image segmentation.SOLUTION: An optical detection system based on image segmentation is provided, comprising a pattern generation unit 10 configured to select at least one region-of-interest from a target image and generate a specific pattern for controlling an optical path for each of the at least one region-of-interest, a light modulation unit 20 configured to receive the specific pattern and selectively separate the optical path for each of the at least one region-of-interest from the target image, and an optical detection unit 30 configured to detect a separated optical signal for each of the at least one region-of-interest based on different pixels.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an optical detection system and method based on image segmentation.

Background Art

[0002] Adaptive optical modulation technology is a technology for controlling an optical path using a digital optical modulation device, and is used in a beam projector or a hologram display. Recently, it has been used in various applications such as photoinduced dielectric stimulation, fluorescence excitation, and multiphoton microscopy, and is mainly used in an optical irradiation module. Some optical modulation technologies may be used by positioning them in a measurement path between a sample and a photodetector (or a camera). However, it is mainly used for the purpose of reducing image distortion by reducing optical aberration.

[0003] Devices for detecting optical signals include cameras and point detector methods. When using a camera, in order to perform high-speed imaging, methods such as recording only a part of the imaging area (subarray readout) or binding pixels for recording (pixel binning) are mainly used. However, in this case, problems occur in that the observation area is limited or the resolution is decreased.

[0004] The frame rate of a general camera is mostly in the range of several tens of Hz to several hundreds of Hz. That is, in order to increase the frame rate to kHz or higher, it is necessary to perform image processing using only very limited pixels, which results in significant limitations in applications. Also, in the case of a point detector, there is virtually no limitation in terms of speed, but since only the information of one pixel is recorded at a time, there is a problem that it is necessary to combine with a scanning module to record an image. Also in this case, the more scanning is performed, the slower the speed becomes, and thus it is difficult to implement kHz or higher.

[0005] In this regard, Korean Patent Publication No. 2017-0099985 (Title of the Invention: Imaging Method and System for Obtaining Super-Resolution Image of an Object) discloses an imaging method for obtaining a super-resolution image of an object based on an optical microscope configured to capture an image of the object.

Summary of the Invention

Problems to be Solved by the Invention

[0006] The present invention is for solving the problems as described above, and aims to provide an optical detection system and method capable of detecting optical signals in units of any region-of-interest (ROI) desired by a user.

[0007] However, the technical problems to be achieved by this embodiment are not limited to the above technical problems, and there may be other technical problems.

Means for Solving the Problems

[0008] As a technical means for solving the above-described technical problems, an image segmentation-based optical detection system according to an embodiment of the present invention includes a pattern generation unit that selects one or more regions of interest from a target video and generates a specific pattern for controlling an optical path for each region of interest, an optical modulation unit that selectively separates the optical paths of each region of interest from the target video while receiving the specific pattern, and an optical detection unit that detects the optical signals separated for each region of interest based on different pixels.

[0009] A light detection method using an image segmentation-based light detection system according to another embodiment of the present invention includes: (a) a step of selecting one or more regions of interest from a target video by a pattern generation unit and generating a specific pattern for controlling an optical path for each region of interest; (b) a step of selectively separating the optical paths of each region of interest from the target video while receiving the specific pattern by an optical modulation unit; and (c) a step of detecting the optical signals separated for each region of interest based on different pixels by an optical detection unit.

Advantages of the Invention

[0010] According to any one of the means for solving the problems of the present application described above, after optically separating the ROI region to be observed at ultra-high speed from a video captured at a low speed with high resolution, by detecting the optical signals generated from each region of interest based on different pixels, it is possible to record at ultra-high speed.

[0011] Furthermore, since the present invention can be attached in the form of an additional module to various microscopes based on a camera, industrial application is easy.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0013] Hereinafter, with reference to the accompanying drawings, embodiments of the present application will be described in detail so that those having ordinary knowledge in the technical field to which the present application belongs can easily implement it. However, the present application can be embodied in various different forms and is not limited to the embodiments described herein. In the drawings, for the sake of clarity in explaining the present application, parts not related to the explanation are omitted, and similar parts throughout the specification are given similar drawing reference numerals.

[0014] Suffixes such as "module" and "section" for components used in the following description are given or mixed only for ease of preparation of the specification and do not have meanings or roles that distinguish them from each other. Also, when it is determined that a specific description of a related known technique may weaken the gist of the embodiments disclosed in this specification in explaining the embodiments disclosed in this specification, the detailed description thereof is omitted.

[0015] Throughout the specification, when one part is "connected (joined, in contact with, or coupled) to" another part, this includes not only the case where it is "directly connected (joined, in contact with, or coupled)", but also the case where it is "indirectly connected (joined, in contact with, or coupled)" with other members intervening therebetween. Also, when one part "includes (comprises or has)" one component, this means that, unless otherwise stated to the contrary, it does not necessarily exclude other components, and it can further "include (comprise or have)" other components.

[0016] First, existing spatial light modulators have been used to control the form of the light source irradiated onto a sample. That is, the light reaction or fluorescence signal in some selective regions is measured through the form of the excitation light source for irradiation. For example, common optical imaging methods include pixel binning for enhancing temporal resolution, optical zoom, subarray readout for observing only a partial region of a sensor, scanning only a limited observation region, or a combination of these methods. Thus, existing optical imaging methods are implemented in a manner of enhancing temporal resolution by restricting spatial resolution or the observation region. Here, when restricting spatial resolution, there is a problem that signals in adjacent regions interfere with each other.

[0017] However, in the present invention, in a high-resolution state, the optical path of the observation region is modulated, separated from adjacent regions, and then compressed to one or a very limited number of detection pixels to detect light. As a result, since data sampling is reduced, it is possible to analyze signals at ultra-high speed.

[0018] That is, different from the prior art, the present invention is not limited to the form of the light source and is applicable to cases of fluorescence, reflection, transmission, and luminescence. At the same time, it has an extended application in that signals generated from many adjacent regions can be measured without interference. Also, since there is no interference between observation regions, it is possible to measure ultra-high-speed optical signals through additional optical compression.

[0019] Therefore, the present invention can flexibly modulate the normalized optical signal measurement path of existing optical imaging methods and separate the spatial resolution and the temporal resolution. That is, by separating the spatial resolution and the temporal resolution, changes in optical signals generated from complex-shaped structures can be measured at ultra-high speed without the influence of surrounding structures.

[0020] As an example, when performing high-speed imaging with an existing method, high-speed imaging is performed by reducing the resolution of a normal image or taking only a part of it. However, in the present invention, after setting a region to be observed (region-of-interest; ROI) in a digital image in a high-resolution state, the optical signal generated from this region (region of interest) can be separated through an optical modulation technique. Thereafter, the separated optical signal can be arbitrarily assigned to one or a very small number of optical lenses and photodetectors (photodetection units). As a result, one or more optical lenses and photodetectors (photodetection units) have different pixels from each other, so that it is possible to record an optical signal using only a very small number of pixels compared to the existing case.

[0021] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

[0022] FIG. 1 is a configuration diagram of an optical detection system of an image segmentation base according to an embodiment of the present invention.

[0023] As shown in FIG. 1, the optical detection system 1 of the image segmentation base may include a pattern generation unit 10, an optical modulation unit 20, an optical detection unit 30, and a display unit 40.

[0024] Referring to FIG. 1, the optical detection system 1 of the image segmentation base includes a pattern generation unit 10 that selects one or more regions of interest from a target video and generates a specific pattern for controlling the optical path for each region of interest, and an optical modulation unit 20 that selectively separates the optical paths of each region of interest from the target video while receiving the specific pattern, and an optical detection unit 30 that detects the optical signals separated for each region of interest based on different pixels from each other.

[0025] Therefore, the present invention can significantly increase the measurement speed and effectively remove readout noise compared with the existing pixel-based measurement method by using different pixels for each region of interest.

[0026] Exemplarily, the optical detection system 1 of the image segmentation base can further include a memory (not shown) that stores an optical path control program for the region of interest. At this time, the optical path control program for the region of interest stored in the memory can be driven by the pattern generation unit 10.

[0027] Note that the memory functions to store the data processed by the pattern generation unit 10. Here, the memory can include non-volatile storage media.

[0028] The memory can also store a separate program such as an operation system for the processing and control of the pattern generation unit 10, and can also function for temporarily storing the input or output data.

[0029] The memory can include at least one type of storage medium among flash memory type, hard disk type, multimedia card micro type, card type memory (such as SD or XD memory, etc.), random access memory, and read only memory. Also, the optical detection system 1 of the image segmentation base can operate a web storage that performs the storage function of the memory on the internet.

[0030] The pattern generation unit 10 executes the optical path control program of the region of interest stored in the memory and controls the overall operation for the optical path control of the region of interest.

[0031] For this purpose, the pattern generation unit 10 can be embodied including at least one processing unit (such as CPU, micro - processor, DSP, etc.), RAM (Random Access Memory), ROM (Read - Only Memory), etc., read the program stored in the memory with the RAM, and execute it through at least one processing unit. Also, according to the embodiment, the term "processor" can be interpreted to have the same meaning as terms such as "controller", "arithmetic unit", "pattern generation unit", etc.

[0032] FIG. 2 is a structural diagram of an optical detection system of an image segmentation base according to an embodiment of the present invention.

[0033] Specifically, the optical modulation unit 20 selectively separates the optical paths of each region of interest while receiving the target video. For example, the optical modulation unit 20 includes a digital micromirror device, a transmissive or reflective spatial light modulator based on a liquid crystal substrate, or a scanner (such as galvanometers, acousto-optic deflectors, electro-optic deflectors, etc.).

[0034] Here, the target video includes, but is not limited to, videos taken at high resolution, and includes optical signals including transmission, reflection, fluorescence, and phase-contrast, etc.

[0035] The light detection unit 30 detects the optical signals separated by region of interest based on different pixels from each other. That is, the light detection unit 30 can be composed of a point detector array or a camera using only a limited number of pixels. Therefore, signals generated simultaneously from many adjacent regions of interest can be measured without interference. Also, since there is no interference between the regions of interest to be observed, measurement of ultra-high-speed optical signals is possible through additional optical compression.

[0036] For example, the light detection unit 30 includes an optical lens and a photodetector. Exemplarily, the optical lens includes, but is not limited to, an optical camera such as sCMOS, EMCCD, CCD, etc. Also, the photodetector includes, but is not limited to, a plurality of point light source detectors or an array-shaped detector based on a PMT (photomultiplier tube), APD (avalanche photodiode), and SPAD (single-photon avalanche diode).

[0037] The light modulation unit 20 can be composed of a spatial light modulator (SLM). At this time, the present invention can include a relay lens unit 210 that adjusts so that the size of the image transmitted from the spatial light modulator matches the size of the pixels of the light detection unit 30 whose size has already been determined.

[0038] As an example, referring to FIG. 2, the light detection system 1 of the image segmentation base of the present invention can be formed in an additional module form in various microscopes based on a camera. Exemplarily, the light detection unit 30 can include a relay lens unit 210, a first light detector 301, a second light detector 302, a third light detector 303, and a microlens array 310.

[0039] As shown in FIG. 2, the present invention includes a relay lens unit 210 that transmits the target video 100 to the light modulation unit 20, the light modulation unit 20, and a light detection unit 30 in which the microlens array 310 or the relay lens unit 210 is composed of one module for each of the light detectors 301 to 303. That is, the light detection unit 30 can include a first light detector 301 to a third light detector 303 that detect optical signals for each region of interest divided from the target video 100 transmitted from the light modulation unit 20. At this time, there is no limit to the number of light detectors. Here, the operation process of the pattern generation unit 10 that generates a specific pattern for controlling the optical path for each region of interest will be described later with reference to FIGS. 3 to 6.

[0040] Exemplarily, the target video 100 is an optical image formed at the camera port position of the microscope and can be transmitted to the surface of the light modulation unit 20 via the relay lens unit 210. At this time, considering the size and modulation parameters of the light modulation unit 20, the relay lens unit 210 can increase or decrease the size of the target video 100.

[0041] For example, if the optical modulation unit 20 is a spatial light modulator, a relay lens unit 210 can be disposed between the spatial light modulator and the first photodetector 301. At this time, the relay lens unit 210 can adjust the optical signals for different regions of interest from the spatial light modulator to match the pixel sizes of the first to third photodetectors 301 to 303.

[0042] That is, the photodetection unit 30 can be composed of a plurality of photodetector modules. As an example, the photodetector module is composed of a microlens array 310 and a second photodetector 302, and can detect the image received through the microlens array 310 after separating it into sub-images. As another example, the photodetector module is composed of a microlens array 310, a relay lens unit 210, and a third photodetector 303, and can detect the sub-image separated through the microlens array 310 after adjusting it to a sub-image of an appropriate size that matches the size of the third photodetector 303 through the relay lens unit 210 again.

[0043] The display unit 40 can output a target video so that the user can select a region of interest, or can output the optical signal received from the photodetection unit. A detailed description of the display unit 40 will be given later.

[0044] FIG. 3 is a sequence diagram for explaining a method by which the pattern generation unit according to an embodiment of the present invention controls the optical path of the region of interest. FIG. 4 is a diagram showing an example in which the optical path of the region of interest is controlled for each step according to FIG. 3 and each object is output. FIG. 5 is a diagram for explaining a specific pattern for controlling the moving direction of the object corresponding to each region of interest according to an embodiment of the present invention.

[0045] Referring to FIG. 3, the pattern generation unit 10 receives a target video (S21), selects one or more regions of interest from the target video (S22), and can generate a specific pattern for controlling the optical path for each region of interest (S23). Next, the pattern generation unit 10 sets the direction, interval, and color of the stripe-like pattern to be different for each region of interest to classify the specific pattern, and at the same time, can control the optical path of each video object corresponding to each region of interest (S24).

[0046] Exemplarily, as shown in FIG. 4(a), in the step of S21, the pattern generation unit 10 can receive the target video and output the target video so that the user can select a region of interest through the display unit 40. Next, as shown in FIG. 4(b), in the step of S22, one or more regions of interest can be selected from the target video through the user or the pattern generation unit 10. For example, if the target video for which the region of interest is to be set is output through the display unit 40, the user can directly select each of the 8 characters from the target image consisting of the characters DEMOSAIC as each of the 8 regions of interest. Alternatively, each of the 8 regions of interest can be automatically selected by the pattern generation unit 10. At this time, the pattern generation unit 10 can convert the image resolution so that the specific coordinates of the region of interest output by the display unit 40 and the specific coordinates of the region of interest received by the optical modulation unit 20 match. For example, since the resolution of the target image captured by the camera and the resolution of the optical modulation unit 20 are different, the target image (R I1 ) = transformation matrix (M SLM ) * optical modulation unit (R I2 ) can be used to convert the image resolution. At this time, the transformation matrix can be calculated by a co-registration method of point-based spatial data, but is not limited thereto.

[0047] As shown in FIG. 4(c), in step S23, a specific pattern for controlling the optical path can be generated for each region of interest. Next, the pattern generation unit 10 can set the direction, interval, and color of the stripe-shaped pattern to be different for each region of interest to distinguish the specific pattern. At the same time, as shown in FIG. 4(d), in step S24, the optical path of each video object corresponding to each region of interest can be controlled.

[0048] For example, the pattern generation unit 10 can generate a binary image for each region of interest and fill a grating pattern within the white region of the binary image. At this time, the grating pattern can be filled so that the interval from the stripe-shaped direction constituting each white region is different. Thereby, the pattern generation unit 10 transmits the regions of interest (each video object) filled with different patterns to the optical modulation unit 20, and the optical modulation unit 20 can selectively separate the optical paths of each region of interest (each video object).

[0049] Exemplarily, referring to FIGS. 4 and 5, the stripe-shaped pattern for splitting the optical path of each region of interest can be composed of pattern units divided into eight diffraction directions with the middle as a reference. At this time, the pattern unit can be composed of three straight lines (3d) with different brightness for each parallel straight line (d) as one unit.

[0050] For example, as shown in FIGS. 4(c) and 4(d), a specific pattern can be applied to the region of interest corresponding to the "A" object. In this case, as shown in FIG. 5, the specific pattern of the "A" object can include a diffraction direction formed from the lower left direction (7:30 in the clockwise direction) and a pattern unit formed from a diagonal line inclined in the lower right direction. At this time, the pattern unit can be composed of three straight lines (3d) of black - gray - white. Among the three straight lines, the darkest black diagonal line of the pattern unit of the "A" object can be arranged below the left side in the same direction as the diffraction direction of the "A" object. As shown in FIGS. 4(c) and 4(d), the specific pattern of the "M" object facing the "A" object can include a diffraction direction formed from the upper right direction (1:30 in the clockwise direction) opposite to the diffraction direction of the "A" object and a pattern unit formed from a diagonal line inclined in the lower right direction. In this case, the direction of the striped pattern of the "A" object and the "M" object is the same. Different from the pattern unit of the "A" object, among the three straight lines (3d) of the pattern unit of the "M" object, the darkest black diagonal line can be arranged above the upper right side in the same direction as the diffraction direction of the "M" object.

[0051] Similarly, the specific pattern of the "D" object can include a diffraction direction formed from the upper right direction (10:30 in the clockwise direction) and a pattern unit formed from a diagonal line inclined downward to the left. At this time, among the three straight lines of the pattern unit of the "D" object, the diagonal line with the lowest lightness (black color) can be arranged in the upper right direction, which is the same direction as the diffraction direction of the "D" object. The specific pattern of the "C" object facing the "D" object can include a diffraction direction formed from the lower left direction (4:30 in the clockwise direction) and a pattern unit formed from a diagonal line inclined downward to the left. In this case, while the stripe patterns of the "C" object and the "D" object are in the same direction, different from the pattern unit of the "D" object, the pattern unit of the "C" object can be arranged in the lower right direction, where the diagonal line with the lowest lightness (black color) among the three straight lines is in the same direction as the diffraction direction of the "C" object.

[0052] In the case of the "E" object having a diffraction direction in the upper direction (12 o'clock in the clockwise direction) and the "I" object having a diffraction direction in the lower direction (6 o'clock in the clockwise direction), among the three straight lines of the pattern unit of the "E" object, the straight line with the lowest lightness (black color) is arranged above, which is the same direction as the diffraction direction of the "E" object, and among the three straight lines of the pattern unit of the "I" object, the straight line with the lowest lightness (black color) can be arranged below, which is the same direction as the diffraction direction of the "I" object.

[0053] In the case of the "S" object having a diffraction direction in the left direction (9 o'clock in the clockwise direction) and the "O" object having a diffraction direction in the right direction (3 o'clock in the clockwise direction), among the three straight lines of the pattern unit of the "S" object, the straight line with the lowest lightness (black color) is arranged on the left, which is the same direction as the diffraction direction of the "S" object, and among the three straight lines of the pattern unit of the "O" object, the straight line with the lowest lightness (black color) can be arranged on the right, which is the same direction as the diffraction direction of the "O" object.

[0054] As shown in FIG. 4(d), the pattern generation unit 10 outputs an overall object corresponding to each region of interest through the display unit 40, and based on the overall object screen, can provide a split screen in a direction that coincides with the moving direction (diffraction direction) of each object.

[0055] FIGS. 6 and 7 are diagrams for explaining by comparing the analysis results of the optical signals measured with the present invention and an existing microscope, and FIG. 8 is a diagram showing another example in which each object is output by the method of controlling the optical path of the region of interest of the present invention.

[0056] Exemplarily, to compare the optical detection performance of the present invention with that of an existing microscope, the optical signals of each region of interest were detected using an optical setup including an optical modulation unit 20 composed of a digital micro-reflection display and an optical detection unit 30 composed of a PMT device. As shown in FIG. 6(a), for this purpose, as a target image, a target image in a form where the characters "DEMOSAIC" overlap was irradiated on the surface of the optical modulation unit 20, and then each object (character) was set to blink in units of 105 microseconds according to a time sequence.

[0057] As shown in FIG. 7, as a result of measurement using an existing microscope, it was difficult to distinguish signals that blink in units of microseconds, and even when using an existing single PMT device, it was not possible to tell from which object the optical signal was generated.

[0058] However, as shown in FIGS. 4(b), 6(b), and 6(c), the present invention is a result of measurement at 125 kHz, and it is possible to confirm the mode, position, and change in the intensity of the optical signal of each object (region of interest) where the optical signal is generated. For example, FIG. 6(b) is a graph showing the change in the intensity of the optical signal of the entire object, and FIG. 6(c) is a graph showing the change in the intensity of the optical signal of the "I" object that first blinks according to the time sequence of FIG. 6(a). That is, the present invention, unlike the existing technology, can identify from which object the optical signal is generated. Such a measurement speed is more than 600 times faster than the maximum speed (200 Hz in the case of general sCMOS) that can be achieved when observing the same region of interest with an existing microscope.

[0059] As another example, as shown in FIG. 8(a), if four regions of interest are selected from the target video, as shown in FIG. 8(b), the pattern generation unit 10 applies a specific pattern including the diffraction directions in the above-described up, down, left, and right directions and a pattern unit composed of three straight lines of black - gray - white for each region of interest. The optical modulation unit 20 receives a specific pattern in which the moving direction of each object is set for each of the four regions of interest, and can separate the optical paths of each region of interest. At this time, as shown in FIG. 8(c), the display unit 40 can output four entire objects on the main screen and output a split screen of each object in a direction that coincides with the moving direction of each object based on the central main screen.

[0060] Hereinafter, among the configurations shown in FIGS. 1 to 8 described above, descriptions of the same configurations will be omitted.

[0061] FIG. 9 is a sequence diagram showing an optical detection method using an optical detection system of an image division base according to another embodiment of the present invention.

[0062] Referring to FIG. 9, a light detection method using the light detection system 1 of the image segmentation infrastructure according to another embodiment of the present invention includes: a step (S110) of selecting one or more regions of interest from a target video by a pattern generation unit 10 and generating a specific pattern for controlling an optical path for each region of interest; a step (S120) of selectively separating the optical paths of each region of interest from the target video while receiving the specific pattern by an optical modulation unit 20; and a step (S130) of detecting the optical signals separated for each region of interest based on different pixels by a light detection unit 30.

[0063] In step S110, the pattern generation unit 10 can set the direction, interval, and color of the stripe-shaped pattern to be different for each region of interest to distinguish the specific pattern, and at the same time, can control the moving direction of each region of interest and the corresponding video object. Also, the pattern generation unit 10 can convert the image resolution, size, position, and direction so that the coordinates of the region of interest output by the display unit 40 match the specific coordinates of the region of interest received by the optical modulation unit 20. Exemplarily, the optical modulation unit 30 is a spatial light modulator, and includes a phase only spatial light modulator (phase only SLM) that modulates the optical phase and a digital micromirror device (DMD) that can be controlled for each pixel, and can further include a relay lens unit that adjusts so that the size of the image divided from the spatial light modulator matches the size of the pixels of the light detection unit whose size is already determined.

[0064] Before step S110, it can include a step of outputting a target video by the display unit 40 so that a user selects a region of interest.

[0065] After step S130, the display unit 40 outputs the optical signal received from the light detection unit 30, and the pattern generation unit 10 can output an overall object screen corresponding to each region of interest through the display unit 40, and based on the overall object screen, provide a split screen in a direction consistent with the moving direction of each object.

[0066] One embodiment of the present invention can also be embodied in the form of a recording medium containing computer-executable instructions such as program modules executed by a computer. A computer-readable medium can be any available medium accessible by a computer, including both volatile and non-volatile media, and both removable and non-removable media. Also, a computer-readable medium can include a computer storage medium. A computer storage medium includes any method or technology embodied in volatile and non-volatile, removable and non-removable media for storing information such as computer-readable instructions, data structures, program modules, or other data.

[0067] The methods and systems of the present invention have been described in connection with specific embodiments, but some or all of their components or operations can be implemented using a computer system having a general-purpose hardware architecture.

[0068] The foregoing description of the present application is for illustrative purposes only, and those with ordinary knowledge in the technical field to which the present application belongs will understand that it can be easily deformed into other specific forms without changing the technical idea and essential features of the present application. Therefore, it should be understood that the foregoing embodiments are illustrative in all respects and not restrictive. For example, each component described as a single type can also be implemented in a distributed manner, and similarly, components described as distributed can also be implemented in a combined form.

[0069] The scope of the present application is indicated by the claims hereinafter rather than the foregoing detailed description, and all changes or modified forms derived from the meaning and scope of the claims and the concept of their equivalents should be construed as being included within the scope of the present application.

Description of Reference Numerals

[0070] 1: Light detection system 10: Pattern generation unit 20: Light modulation unit 30: Light detection unit 40: Display unit 210: Relay lens unit 301: First photodetector 302: Second photodetector 303: Third photodetector 310: Microlens array

Claims

1. In an image division based optical detection system, a pattern generator for selecting a plurality of regions of interest from a target image and generating a specific pattern for controlling a light path for each of the regions of interest; an optical modulation unit that receives the specific pattern and selectively separates an optical path of each of the regions of interest from the target image in accordance with the specific pattern for each of the regions of interest; a light detection unit for detecting the light signals separated for each region of interest based on different pixels; The pattern generation unit sets a striped pattern within each of the regions of interest and sets at least one of the direction, spacing, and color of the striped pattern to be different, thereby dividing the specific pattern corresponding to the multiple regions of interest.

2. a display unit configured to output the target image so that a user can select the region of interest, or to output the optical signal received from the optical detector unit; 2. The optical detection system of claim 1, wherein the pattern generation unit provides an entire object screen that outputs an entire object corresponding to each of the regions of interest through the display unit, and a split screen in a direction corresponding to a moving direction of each object based on the entire object screen.

3. The target image includes an image captured in high resolution; The optical detection system of claim 2 , wherein the pattern generation unit converts at least one of image resolution, size, position, and orientation so that the coordinates of the area of ​​interest output by the display unit match the specific coordinates of the area of ​​interest received by the optical modulation unit.

4. 2. The optical detection system of claim 1, wherein the optical modulation unit is a spatial light modulator, and includes a phase only spatial light modulator (SLM) that modulates an optical phase and a digital mirror device (DMD) that can be controlled for each pixel, and further includes a relay lens unit that adjusts the size of an image divided from the spatial light modulator so that it matches a predetermined pixel size of the optical detection unit.

5. 1. A method for detecting light using an image division-based light detection system, comprising: (a) selecting a plurality of regions of interest from a target image by a pattern generating unit, and generating a specific pattern for controlling an optical path for each of the regions of interest; (b) selectively isolating an optical path of each of the regions of interest from the target image in accordance with the specific pattern for each of the regions of interest while receiving the specific pattern by an optical modulation unit; (c) detecting the optical signals separated for each region of interest by a light detection unit based on different pixels; In the step (a), the pattern generation unit sets a striped pattern within each of the regions of interest and sets at least one of a direction, an interval, and a color of the striped pattern to be different, thereby dividing the specific pattern corresponding to the multiple regions of interest.

6. Prior to the step (a), outputting the target image by a display unit so that a user can select the region of interest; After the step (c), the display unit outputs the optical signal received from the optical detection unit; 6. The optical detection method of claim 5, wherein the pattern generation unit provides an entire object screen that outputs an entire object corresponding to each of the regions of interest through the display unit, and a split screen in a direction corresponding to a moving direction of each object based on the entire object screen.

7. In the step (a), The target image includes an image captured in high resolution, The optical detection method of claim 6, wherein the pattern generation unit converts at least one of image resolution, size, position, and direction so that the coordinates of the area of ​​interest output by the display unit match the specific coordinates of the area of ​​interest received by the optical modulation unit.

8. 6. The optical detection method of claim 5, wherein the optical modulation unit is a spatial light modulator, and includes a phase only spatial light modulator (SLM) that modulates an optical phase, and a digital mirror device (DMD) that can be controlled for each pixel, and further includes a relay lens unit that adjusts a size of an image divided from the spatial light modulator so that it matches a predetermined pixel size of the optical detection unit.

Images