Light-based diagnostic and therapeutic device and operating method for light-based diagnostic and therapeutic device

Abstract

Disclosed are a light-based diagnostic and therapeutic device and an operating method for the light-based diagnostic and therapeutic device. The operating method for the light-based diagnostic and therapeutic device may comprise the operations of: acquiring local images over time through a camera of the light-based diagnostic and therapeutic device; extracting image feature points from the local images; generating a lesion map including a lesion area of a user by combining the local images on the basis of the extracted image feature points; and generating a cumulative light irradiation map indicating cumulative information of therapeutic light output to the lesion area on the basis of the lesion map and position information of a light stimulation unit of the light-based diagnostic and therapeutic device over time.

Description

Light-based diagnostic treatment device and method of operating the light-based diagnostic treatment device

[0001] The disclosure below relates to light-based diagnostic treatment technology.

[0002] In conventional treatment of lesions such as tumors, the lesion is first identified using a diagnostic device. Then, for treatment, a person manually identifies the lesion location and performs surgery / procedure, or the coordinate system must be aligned between the diagnostic image and the current surgical equipment to utilize radiation or robotics. However, errors inevitably arise during the coordinate alignment process. In particular, in soft tissues such as the brain, preoperative images may differ from intraoperative images due to cerebrospinal fluid loss, tumor removal, and respiration. Furthermore, conventional photodiagnostic methods using light suffer from low resolution, and photodynamic therapy (PDT) relies on limited drug selectivity, requiring a long treatment time of more than 10 minutes. Research is urgently needed to address these shortcomings of conventional techniques.

[0003] A method of operating a light-based diagnostic treatment device according to another embodiment may include: acquiring local images over time through a camera of the light-based diagnostic treatment device; extracting image feature points from the local images; generating a lesion map including a lesion area of ​​a user by combining the local images based on the extracted image feature points; and generating a light quantity cumulative irradiation map indicating cumulative information of therapeutic light output to the lesion area based on positional information of a light stimulator of the light-based diagnostic treatment device over time and the lesion map.

[0004] The operation of generating the above light quantity cumulative irradiation map may include an operation of estimating the amount of light irradiated to the lesion area by the therapeutic light output from the optical stimulation unit by recording the path along which the probe moves over time in the lesion area; and an operation of generating the light quantity cumulative irradiation map by displaying the estimated light quantity on the lesion map.

[0005] The operation of generating the lesion map may include an operation of generating the lesion map by connecting the local images based on corresponding image feature points among image feature points extracted from the local images.

[0006] The method further includes an operation of recognizing the shape of the lesion area based on the lesion map; an operation of determining an output pattern of therapeutic light based on the shape of the recognized lesion area; and an operation of outputting patterned therapeutic light based on the determined output pattern, wherein the shape of the lesion area may correspond to the output pattern of the patterned therapeutic light.

[0007] The operation of outputting the patterned therapeutic light may include an operation of determining an intensity of the patterned therapeutic light to be outputted at each predetermined location of the lesion area based on an amount of light accumulated by the patterned therapeutic light at each predetermined location of the lesion area indicated on a light amount accumulation irradiation map; and an operation of outputting therapeutic light having the determined intensity of the therapeutic light through the optical stimulation unit.

[0008] A method for operating a light-based diagnostic treatment device including a lesion detection unit and a therapeutic light generation unit sharing a single optical path according to one embodiment may include: obtaining a first lesion image of a lesion region of a user based on an optical signal transmitted through the single optical path; detecting the lesion region from the obtained first lesion image; transmitting a first trigger signal to the therapeutic light generation unit in response to terminating detection of the lesion region; generating patterned therapeutic light based on a shape of the lesion region in response to the therapeutic light generation unit receiving the first trigger signal; and outputting the patterned therapeutic light to the lesion region through the single optical path.

[0009] In response to the termination of the output of the patterned therapeutic light, the method may further include: transmitting a second trigger signal to a lesion image acquisition unit; In response to the lesion detection unit receiving the second trigger signal, the method may further include: acquiring a second lesion image of the lesion region based on an optical signal transmitted through the single optical path; and detecting the lesion region from the second lesion image.

[0010] The operation of generating the patterned therapeutic light further includes an operation of determining an output pattern of the therapeutic light based on the shape of the lesion region; and an operation of outputting the patterned therapeutic light based on the determined output pattern, wherein the shape of the lesion region may correspond to the output pattern of the patterned therapeutic light.

[0011] In another embodiment, a light-based diagnostic treatment device may include: a lesion image acquisition unit for acquiring local images over time through a camera of the light-based diagnostic treatment device; an image feature extraction unit for extracting image feature points from the local images; a lesion map generation unit for generating a lesion map including a lesion area of ​​a user by combining the local images based on the extracted image feature points; and a light-amount cumulative irradiation map generation unit for generating a light-amount cumulative irradiation map representing cumulative information of therapeutic light output to the lesion area based on positional information of a light stimulator of the light-based diagnostic treatment device over time and the lesion map.

[0012] The above light quantity cumulative irradiation map generation unit can generate the light quantity cumulative irradiation map by recording the path along which the probe moves over time in the lesion area, thereby estimating the amount of light irradiated to the lesion area by the therapeutic light output from the optical stimulation unit, and displaying the estimated amount of light on the lesion map.

[0013] The above lesion map generation unit can generate the lesion map by connecting the local images based on corresponding image feature points among the image feature points extracted from the local images.

[0014] The device further includes a therapeutic light generating unit that recognizes the shape of the lesion area based on the lesion map, determines an output pattern of therapeutic light based on the shape of the recognized lesion area, and outputs patterned therapeutic light based on the determined output pattern, wherein the shape of the lesion area may correspond to the output pattern of the patterned therapeutic light.

[0015] The above therapeutic light generating unit can determine the intensity of the patterned therapeutic light to be output at each predetermined location of the lesion area based on the amount of light accumulated by the patterned therapeutic light at each predetermined location of the lesion area indicated on the light amount accumulation irradiation map, and output therapeutic light having the determined intensity of the therapeutic light through the light stimulation unit.

[0016] In one embodiment, a light-based diagnostic treatment device may include a lesion detection unit that acquires a first lesion image of a lesion region of a user based on an optical signal transmitted through a single optical path, detects the lesion region from the acquired first lesion image, and transmits a first trigger signal to a therapeutic light generation unit in response to terminating detection of the lesion region; and a therapeutic light generation unit that generates patterned therapeutic light based on a shape of the lesion region and outputs the patterned therapeutic light to the lesion region through the single optical path in response to receiving the first trigger signal.

[0017] The above therapeutic light generating unit transmits a second trigger signal to the lesion detection unit in response to the termination of the output of the patterned therapeutic light, and the lesion detection unit, in response to receiving the second trigger signal, obtains a second lesion image for the lesion region based on an optical signal transmitted through the single optical path, and detects the lesion region from the obtained second lesion image.

[0018] The above therapeutic light generating unit determines an output pattern of therapeutic light based on the shape of the lesion area, and generates patterned therapeutic light based on the determined output pattern, and the shape of the lesion area may correspond to the output pattern of the patterned therapeutic light.

[0019] In one embodiment, a single device may provide both diagnostic capabilities for a lesion and therapeutic capabilities for a lesion.

[0020] According to one embodiment, a system control framework related to a phototherapy device capable of analyzing real-time optical diagnostic images and irradiating patterned beams can be constructed.

[0021] In one embodiment, since both photodiagnosis and phototherapy are possible with a single device, errors that may occur in the process of aligning coordinates between a diagnostic device and a treatment device in conventional techniques can be eliminated.

[0022] According to one embodiment, a lesion map indicating a lesion and a light dose accumulation map can be generated based on local images acquired through a probe.

[0023] In one embodiment, a lesion map can be generated by scanning the entire lesion area and recording the current probe position to determine whether treatment is necessary and how much light to deliver.

[0024] FIG. 1 is a schematic diagram illustrating an overall outline of a light-based diagnostic treatment device according to one embodiment.

[0025] FIG. 2 is a flowchart illustrating an operation method of a light-based diagnostic treatment device according to another embodiment.

[0026] FIG. 3 is a flowchart illustrating an operation method of a light-based diagnostic treatment device according to one embodiment.

[0027] FIG. 4 is a drawing for explaining patterned light according to one embodiment.

[0028] FIGS. 5A and 5B are drawings for explaining a process of generating a lesion map and a light dose accumulation map according to another embodiment.

[0029] FIG. 6 is a diagram illustrating a configuration of a light-based diagnostic treatment device according to another embodiment.

[0030] Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified and implemented in various forms. Therefore, the actual implementation is not limited to the specific embodiments disclosed, and the scope of this specification includes modifications, equivalents, or alternatives within the technical concepts described in the embodiments.

[0031] Although terms such as "first" or "second" may be used to describe various components, these terms should be interpreted solely to distinguish one component from another. For example, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

[0032] When it is said that a component is "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but there may also be other components in between.

[0033] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this document, phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can each include any one of the items listed together in that phrase, or all possible combinations thereof. In this specification, it should be understood that the terms "comprises" or "has" and the like are intended to specify the presence of a described feature, number, step, operation, component, part, or combination thereof, but do not exclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0034] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art. Terms defined in commonly used dictionaries should be interpreted to have a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0035] The term "module" as used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or portion of a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0036] The term "~ component" as used in this document refers to a software or hardware component such as an FPGA or ASIC, and the "~ component" performs certain roles. However, the "~ component" is not limited to software or hardware. The "~ component" may be configured to reside on an addressable storage medium and may be configured to execute one or more processors. For example, the "~ component" may include components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and "~ components" may be combined into a smaller number of components and "~ components" or further separated into additional components and "~ components." Furthermore, the components and "~ components" may be implemented to execute one or more CPUs within a device or a secure multimedia card. Additionally, '~bu' may include one or more processors.

[0037] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are assigned the same reference numerals regardless of the drawing numbers, and redundant descriptions thereof will be omitted.

[0038] FIG. 1 is a schematic diagram illustrating an overall outline of a light-based diagnostic treatment device according to one embodiment.

[0039] The light-based diagnostic treatment device described herein can observe tissue in real time, analyze lesions, and selectively irradiate light, i.e., therapeutic light, to treat them. In addition, the light-based diagnostic treatment device can freely scan over tissue in the form of a handheld scanner, diagnose lesions in real time using an imaging function, and activate a treatment function within a short time to irradiate local therapeutic light to the diagnosed lesion area. The functions of scanning and diagnosing lesions and the treatment function can be performed through a probe that shares the same optical path. The light-based diagnostic treatment device can perform image acquisition and treatment simultaneously, and can be performed through a single device and a single optical path. The light-based diagnostic treatment device described herein can perform a real-time control method of interleaving light and therapeutic light for acquiring lesion images that commonly use a single optical path. In addition, the light-based diagnostic treatment device can form an extended lesion map for the entire lesion area based on a local image having a narrow field of view (FOV) for precise lesion diagnosis, and can record the position of the current diagnostic probe to determine whether to treat each area and determine the amount of light delivered to each area. The light-based diagnostic treatment device can form a lesion map by acquiring a local image or a lesion image including the lesion area based on an optical signal delivered through a single optical path, and can generate a light dose cumulative irradiation map representing accumulated information of therapeutic light output to the lesion area based on position information of the optical stimulation unit of the light-based diagnostic treatment device over time and the lesion map. In addition, the light-based diagnostic treatment device can interleave an operation of forming a lesion map by acquiring a local image or a lesion image or an operation of detecting a lesion area and an operation of outputting therapeutic light to the lesion area based on a trigger signal.The interleaving of these two actions can be performed in a very short period of time. The lesions described herein may refer to, but are not limited to, brain lesions.

[0040] Referring to FIG. 1, in one embodiment, a light-based diagnostic treatment device (110) may include a lesion detection unit (120) and a therapeutic light generation unit (130). The lesion detection unit (120) and the therapeutic light generation unit (130) may be connected to a probe (140). The optical signal of the lesion detection unit (120) and the therapeutic light of the therapeutic light generation unit (130) may be transmitted through a single optical path (160), and the single optical path (160) may be connected to the probe (140) as an optical fiber bundle, or may be included in the probe (140).

[0041] The lesion detection unit (120) can acquire a first lesion image of the user's lesion area (150) based on an optical signal transmitted through a single optical path (160). The lesion area (150) can be detected from the acquired first lesion image, and in response to terminating the detection of the lesion area (150), a first trigger signal can be transmitted to the therapeutic light generation unit (130).

[0042] The therapeutic light generating unit (130) can generate patterned therapeutic light based on the shape of the lesion area (150) in response to receiving the first trigger signal, and output the patterned therapeutic light to the lesion area (150) through a single light path (160). The therapeutic light generating unit (130) can determine an output pattern of the therapeutic light based on the shape of the lesion area (150), and generate patterned therapeutic light based on the determined output pattern.

[0043] The therapeutic light generating unit (130) can transmit a second trigger signal to the lesion detection unit (120) in response to the termination of the output of the patterned therapeutic light. The lesion detection unit (120) can, in response to receiving the second trigger signal, obtain a second lesion image of the lesion area (150) based on the optical signal transmitted through the single optical path (160) and detect the lesion area (150) from the obtained second lesion image. The operation of the lesion detection unit (120) and the operation of the therapeutic light generating unit (130) performed through the single optical path (160) can be interleaved through a trigger signal including the first trigger signal and the second trigger signal.

[0044] FIG. 2 is a flowchart illustrating an operation method of a light-based diagnostic treatment device according to another embodiment.

[0045] Referring to FIG. 2, in one embodiment, the light-based diagnostic treatment device can acquire local images over time through a camera of the light-based diagnostic treatment device in step (210). The light-based diagnostic treatment device can acquire local images of, for example, 5 mm or less using the camera. That is, the light-based diagnostic treatment device can acquire local images over time while moving over a lesion area of ​​a user (or patient). Since the light-based diagnostic treatment device collects local images while moving over the lesion area over time, it can collect local images for a lesion area that gradually expands over time. Since the local image is an image generated for the lesion area, it can also be referred to as a lesion image.

[0046] The light-based diagnostic treatment device can extract image features from local images by performing preprocessing on the local images in step (220). For example, the light-based diagnostic treatment device can extract image features from the local images using the Scale Invariant Feature Transform (SIFT) method. The light-based diagnostic treatment device can perform not only extracting image features from the local images but also performing other preprocessing-related tasks.

[0047] In step (230), the light-based diagnostic treatment device can generate a lesion map including the user's lesion area by combining local images based on the extracted image feature points. More specifically, the light-based diagnostic treatment device can generate the lesion map by connecting local images based on corresponding image feature points among the image feature points extracted from the local images. That is, the light-based diagnostic treatment device can generate the lesion map by connecting local images that include at least one identical image feature point based on the identical image feature point. The operation of the light-based diagnostic treatment device combining local images based on the image feature point may also be referred to as mapping, stitching, overlapping, or connecting the local images, but is not limited to the description herein. The light-based diagnostic treatment device can generate the lesion map by combining local images acquired over time based on the image feature points. Since the light-based diagnostic treatment device collects local images while moving over the lesion area over time, it can generate a lesion map for a wider lesion area over time.

[0048] In step (240), the light-based diagnostic treatment device can generate a light dose cumulative irradiation map representing cumulative information of therapeutic light output to a lesion area based on the positional information of the light stimulation unit of the light-based diagnostic treatment device over time and the lesion map.

[0049] The light-based diagnostic treatment device can estimate the amount of therapeutic light irradiated to the lesion area by recording the path of the probe moving over time in the lesion area. The light-based diagnostic treatment device can generate a light dose cumulative irradiation map by displaying the estimated light amount on a lesion map. That is, the light dose cumulative irradiation map can indicate at least one of whether therapeutic light has been irradiated to each predetermined location in the lesion area and cumulative information on the amount of therapeutic light irradiated to each predetermined location in the lesion area.

[0050] A light-based diagnostic treatment device can recognize the shape of a lesion region based on a lesion map. More specifically, the light-based diagnostic treatment device can recognize at least one of the shape and state of the lesion region based on the lesion map. The light-based diagnostic treatment device can determine an output pattern of therapeutic light based on the recognized shape of the lesion region, and can output patterned therapeutic light based on the determined output pattern. The shape of the lesion region can correspond to the output pattern of the patterned therapeutic light. Furthermore, at least one of the shape and state of the lesion region can correspond to the output pattern of the patterned therapeutic light, and the output pattern of the patterned therapeutic light can be determined based on at least one of the shape and state of the lesion region. The light-based diagnostic treatment device can detect the shape of the lesion region by performing binarization on the lesion map, and can convert coordinates used for detecting the lesion region or the shape of the lesion region into coordinates for outputting therapeutic light. The light-based diagnostic treatment device can output patterned therapeutic light for the shape of the detected lesion region based on the converted coordinates. The lesion region irradiated with the therapeutic light can glow. The details of the patterned therapeutic light based on the output pattern can be described in more detail in the description of FIG. 4.

[0051] Again, in the embodiment of FIG. 2, the light-based diagnostic treatment device can determine the intensity of patterned therapeutic light to be output for each predetermined location in the lesion region based on the accumulated amount of patterned therapeutic light for each predetermined location in the lesion region indicated on the light dose accumulation irradiation map. The light-based diagnostic treatment device can output therapeutic light having the determined intensity of therapeutic light through the optical stimulation unit. For example, the light-based diagnostic treatment device can determine the intensity of patterned therapeutic light to be output for each predetermined location based on the accumulated information of therapeutic light for each predetermined location to prevent it from exceeding or falling too low a threshold value of the accumulated information. The light-based diagnostic treatment device can determine the intensity of patterned therapeutic light to be output for each location to prevent too much or too little therapeutic light from being irradiated for each location in the lesion region. The light-based diagnostic treatment device can also determine a different intensity of patterned therapeutic light to be output for each location.

[0052] FIG. 3 is a flowchart illustrating an operation method of a light-based diagnostic treatment device according to one embodiment.

[0053] A light-based diagnostic treatment device may include a lesion detection unit and a therapeutic light generation unit that share a single optical path. Referring to FIG. 3, the light-based diagnostic treatment device may acquire a first lesion image of a user's lesion area based on an optical signal transmitted through a single optical path in step (310). In step (320), the light-based diagnostic treatment device may detect a lesion area (or region of interest) from the acquired first lesion image.

[0054] In step (330), the light-based diagnostic treatment device can transmit a first trigger signal to the therapeutic light generating unit in response to terminating the detection of the lesion region. In step (340), the therapeutic light generating unit can generate patterned therapeutic light based on the shape of the lesion region in response to receiving the first trigger signal. The light-based diagnostic treatment device can determine an output pattern of the therapeutic light based on the shape of the lesion region. The shape of the lesion region can correspond to the output pattern of the patterned therapeutic light. The process of generating the patterned therapeutic light can be described in more detail with reference to FIG. 4.

[0055] Referring again to FIG. 3, at step (350), the light-based diagnostic treatment device can output patterned therapeutic light to the lesion area through a single optical path. The light-based diagnostic treatment device can output patterned therapeutic light based on the determined output pattern.

[0056] The light-based diagnostic treatment device can determine whether a termination condition is satisfied in step (360). Here, the termination condition may include, for example, a condition related to the completion of treatment.

[0057] If it is determined that the termination condition is satisfied, the light-based diagnostic treatment device can transmit a second trigger signal to the lesion image acquisition unit in response to the termination of the output of the patterned therapeutic light in step (370).

[0058] The light-based diagnostic treatment device may perform step (310) again in response to the lesion detection unit receiving the second trigger signal. The light-based diagnostic treatment device may acquire a second lesion image of the lesion region based on an optical signal transmitted through a single optical path. Furthermore, the light-based diagnostic treatment device may detect the lesion region from the second lesion image. The light-based diagnostic treatment device may continuously repeat steps (310) to (370) of FIG. 3 until a termination condition is satisfied.

[0059] If it is determined that the termination condition is satisfied in step (360), the light-based diagnostic treatment device may terminate the above process. In this embodiment, if the lesion image including the first lesion image and the second lesion image is locally collected, it may also be referred to as a local image.

[0060] The method of operating the light-based diagnostic treatment device according to another embodiment described in FIG. 2 and the method of operating the light-based diagnostic treatment device according to one embodiment described in FIG. 3 may be performed as a series of processes in the same light-based diagnostic treatment device, or after the process of generating a lesion map in the method of operating the light-based diagnostic treatment device according to another embodiment is performed as a prerequisite, the operation of the light-based diagnostic treatment device according to another embodiment excluding the process of generating a lesion map and the operation of the light-based diagnostic treatment device according to one embodiment may be performed as a series of processes.

[0061] FIG. 4 is a drawing for explaining patterned light according to one embodiment.

[0062] Referring to FIG. 4, a light-based diagnostic treatment device (400) according to an exemplary embodiment may include a lesion detection unit (410) and a treatment light generation unit (430).

[0063] The lesion detection unit (410) may include an illumination light source (411) and an optical fiber (or optical fiber bundle) (412) connected to the illumination light source (411) to transmit illumination light to the lesion area. In addition, the lesion detection unit (410) may include one or more lenses (413, 416), a mirror (414), a filter (415), and an image sensor (417). Reflected light, scattered light, or fluorescence from the lesion area is collected through the first lens (413), and the collected reflected light, scattered light, or fluorescence is transmitted to the image sensor (417) through the mirror (414), the filter (415), and the second lens (416) to be used to generate a lesion image (10).

[0064] The lesion detection unit (410) can analyze the lesion image (10) generated by the image sensor (417) to extract and diagnose the lesion area (11).

[0065] The therapeutic light generating unit (430) may include a therapeutic light source (431) that outputs therapeutic light, a beam expander (432) that expands the diameter of the output therapeutic light, one or more mirrors (433, 434), a patterning unit (435) that patterns the therapeutic light to form patterned therapeutic light corresponding to the lesion area (11), and a third lens (436).

[0066] The therapeutic light output from the therapeutic light source (431) can be expanded in diameter through a beam expander (432), and the expanded therapeutic light can be transmitted to the patterning unit (431) through one or more mirrors (433, 434). The patterning unit (431) can form patterned therapeutic light corresponding to the lesion area (11) based on the pattern or shape (12) of the lesion area (11), and irradiate the lesion area (11) through the third lens (436), the mirror (414), and the first lens (413).

[0067] In one embodiment, the first lens (413) may be an objective lens, and the second lens (416) and the third lens (436) may be tube lenses.

[0068] Meanwhile, according to one embodiment, if the image sensor (417) includes a point detector, a scanner may be included between the first lens (413) and the second lens (416).

[0069] FIGS. 5A and 5B are drawings for explaining a process of generating a lesion map and a light dose accumulation map according to another embodiment.

[0070] Referring to FIG. 5A, a probe (510) may be connected to a light-based diagnostic treatment device. A medical professional may hold the probe (510) in his / her hand to acquire local images from a lesion area (500), generate a lesion map and a light dose accumulation map, and direct therapeutic light to the lesion area (500). The probe (510) may include a soft fiber bundle. The light-based diagnostic treatment device may continuously collect local images of a narrow field of view over time and combine the local images to generate a lesion map encompassing the entire lesion area.

[0071] A light-based diagnostic treatment device can acquire a local image with a narrow field of view (FOV). The local image may be, for example, as shown in reference numeral (520). The size of the local image acquired at a time may be, for example, approximately 5 mm, but is not limited to the description herein.

[0072] A light-based diagnostic treatment device can collect local images over time through a camera connected to a probe. The light-based diagnostic treatment device can extract image features from the local images collected over time and generate a lesion map by combining the local images based on the image features. The local image can refer to an image that can be captured at a time while the probe is stationary over the lesion area. The probe can collect multiple local images including reference numbers (512, 514, 516) while moving over the user's lesion area over time, and generate a lesion map by combining the collected local images based on the image features. The lesion map can also be referred to as a global map or a wide-area map.

[0073] Reference numbers (530, 531, 532, 533, 534, 535, 536, 537, 538, 539) may be lesion maps generated at predetermined time intervals. In the embodiment of FIG. 5A, the predetermined time interval is 2 seconds, but is not limited to this embodiment. The light-based diagnostic treatment device may generate a lesion map (531) by combining local images acquired from a lesion area for 2 seconds based on image feature points. In addition, the light-based diagnostic treatment device may generate a lesion map (532) by combining local images acquired from a lesion area for 4 seconds based on image feature points, and may generate a lesion map (533) by combining local images acquired from a lesion area for 6 seconds based on image feature points. The light-based diagnostic treatment device can generate a lesion map (539) by repeatedly acquiring local images over time and combining the local images based on image features extracted from the acquired local images for 18 seconds. If the lesion area is larger and the light-based diagnostic treatment device collects local images for longer than 18 seconds, the light-based diagnostic treatment device can generate a lesion map larger than the lesion maps disclosed in FIG. 5A.

[0074] The light-based diagnostic treatment device can generate a light dose cumulative irradiation map (540) representing cumulative information of therapeutic light output to a lesion area based on the positional information of the optical stimulation unit of the light-based diagnostic treatment device over time and the lesion map. The light dose cumulative irradiation map (540) can represent cumulative information of therapeutic light output to a lesion area as a binarized pattern (550) or by color or grouping.

[0075] A grouped and expressed light quantity cumulative irradiation map (540) is illustrated in FIG. 5B. Referring to FIG. 5B, areas having the same cumulative information of therapeutic light may be grouped as the same area or displayed in the same color. That is, areas included in area (542) may have the same cumulative information of therapeutic light. In addition, areas included in area (544) may have the same cumulative information of therapeutic light, and areas included in area (546) may have the same cumulative information of therapeutic light. In addition, areas included in area (548) may have the same cumulative information of therapeutic light. Here, having the same cumulative information of therapeutic light may mean that the same amount of therapeutic light was irradiated.

[0076] The generation of the lesion map and the generation of the irradiance accumulation map can be performed simultaneously or sequentially.

[0077] FIG. 6 is a diagram illustrating a configuration of a light-based diagnostic treatment device according to another embodiment.

[0078] Referring to FIG. 6, the light-based diagnostic treatment device (600) may include a lesion image acquisition unit (610), a feature point extraction unit (620), a lesion map generation unit (630), a light dose cumulative irradiation map generation unit (640), and a treatment light generation unit (650). Here, the light-based diagnostic treatment device (600) may correspond to the light-based diagnostic treatment device described herein. In one embodiment, the light-based diagnostic treatment device (600) may include a processor and a memory, and the operations of the feature point extraction unit (620), the lesion map generation unit (630), and the light dose cumulative irradiation map generation unit (640) may be performed by the processor.

[0079] The lesion image acquisition unit (610) can acquire local images over time through a camera of a light-based diagnostic treatment device. The lesion image acquisition unit (610) may include a camera or be connected to a camera. The feature extraction unit (620) can extract image feature points from the local images. The lesion map generation unit (630) can generate a lesion map including the user's lesion area by combining the local images based on the extracted image feature points. The lesion image acquisition unit (610) can generate a lesion map by connecting the local images based on corresponding image feature points among the image feature points extracted from the local images.

[0080] The light quantity cumulative irradiation map generation unit (640) can generate a light quantity cumulative irradiation map that represents accumulated information on therapeutic light output to a lesion area based on the positional information of the optical stimulation unit of the light-based diagnostic treatment device over time and the lesion map. The light quantity cumulative irradiation map generation unit (640) can generate a light quantity cumulative irradiation map by recording the path along which the probe moves over time in the lesion area, thereby estimating the amount of therapeutic light output from the optical stimulation unit irradiated to the lesion area, and displaying the estimated amount of light on the lesion map.

[0081] The therapeutic light generating unit (650) can recognize the shape of the lesion area based on the lesion map, determine an output pattern of therapeutic light based on the shape of the recognized lesion area, and output patterned therapeutic light based on the determined output pattern. The therapeutic light generating unit (650) can determine the intensity of the patterned therapeutic light to be output for each predetermined position of the lesion area based on the accumulated amount of patterned therapeutic light for each predetermined position of the lesion area indicated on the light amount accumulation irradiation map, and output therapeutic light having the determined intensity of the therapeutic light through the light stimulator.

[0082] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and software applications running on the operating system. Furthermore, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0083] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on a computer-readable recording medium.

[0084] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may store program commands, data files, data structures, etc., alone or in combination, and the program commands recorded on the medium may be those specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0085] The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

[0086] Although the embodiments described above have been described with limited drawings, those skilled in the art will appreciate that various technical modifications and variations can be applied based on the described embodiments. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0087] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In the operating method of a light-based diagnostic treatment device, An operation of acquiring local images over time through a camera of the above light-based diagnostic treatment device; An operation of extracting image features from the above local images; An operation of generating a lesion map including the user's lesion area by combining the local images based on the extracted image features; and An operation of generating a light quantity accumulation irradiation map representing accumulated information of therapeutic light output to the lesion area based on the position information of the light stimulation unit of the light-based diagnostic treatment device over time and the lesion map. including, How it works.

2. In paragraph 1, The operation of generating the above light quantity accumulation survey map is as follows: An operation of estimating the amount of light irradiated to the lesion area by the therapeutic light output from the optical stimulation unit by recording the movement path of the probe over time in the lesion area; and An operation of generating the light quantity accumulation irradiation map by displaying the estimated light quantity on the lesion map. including, How it works.

3. In paragraph 1, The action of generating the above lesion map is: An operation of generating the lesion map by connecting the local images based on corresponding image feature points among the image feature points extracted from the local images. A method of operation including:

4. In paragraph 1, An operation of recognizing the shape of the lesion area based on the lesion map; An operation of determining an output pattern of therapeutic light based on the shape of the recognized lesion area; and An operation of outputting patterned therapeutic light based on the output pattern determined above. Including more, The shape of the above lesion area is: Corresponding to the output pattern of the above patterned therapeutic light, How it works.

5. In paragraph 4, The operation of outputting the above patterned therapeutic light is: An operation of determining the intensity of the patterned therapeutic light to be output at each predetermined location of the lesion area based on the amount of light accumulated by the patterned therapeutic light at each predetermined location of the lesion area indicated on the light quantity accumulation investigation map; and An operation of outputting therapeutic light having the intensity of the therapeutic light determined above through the optical stimulation unit. A method of operation including:

6. A method for operating a light-based diagnostic treatment device including a lesion detection unit and a therapeutic light generation unit sharing a single optical path, An operation of acquiring a first lesion image of a user's lesion area based on an optical signal transmitted through the single optical path; An operation of detecting the lesion area from the first lesion image acquired above; In response to terminating detection of the lesion area, an action of transmitting a first trigger signal to the therapeutic light generating unit; An operation of generating patterned therapeutic light based on the shape of the lesion area in response to the therapeutic light generating unit receiving the first trigger signal; and An operation of outputting the patterned therapeutic light to the lesion area through the single optical path. including, How it works.

7. In paragraph 6, In response to the termination of the output of the patterned therapeutic light, an action of transmitting a second trigger signal to the lesion image acquisition unit; An operation of acquiring a second lesion image for the lesion area based on an optical signal transmitted through the single optical path in response to the lesion detection unit receiving the second trigger signal; and An operation of detecting the lesion area from the second lesion image. including more, How it works.

8. In paragraph 6, The operation of generating the above patterned therapeutic light is: An operation of determining an output pattern of therapeutic light based on the shape of the lesion area; and An operation of outputting patterned therapeutic light based on the output pattern determined above. Including more, The shape of the above lesion area is: Corresponding to the output pattern of the above patterned therapeutic light, How it works.

9. A computer program stored in a computer-readable recording medium to execute the method of claim 1 in combination with hardware.

10. In a light-based diagnostic treatment device, A lesion image acquisition unit that acquires local images over time through a camera of the above light-based diagnostic treatment device; An image feature extraction unit for extracting image feature points from the above local images; A lesion map generation unit that generates a lesion map including the user's lesion area by combining the local images based on the extracted image features; and A light quantity accumulation map generation unit that generates a light quantity accumulation map representing accumulated information of therapeutic light output to the lesion area based on the position information of the light stimulation unit of the light-based diagnostic treatment device over time and the lesion map. including, Light-based diagnostic and therapeutic devices.

11. In paragraph 10, The above light quantity accumulation survey map generation unit is, By recording the path that the probe moves over time in the lesion area, the amount of light emitted from the optical stimulation unit for treatment is estimated to be irradiated to the lesion area. By displaying the estimated light quantity on the lesion map, the light quantity cumulative irradiation map is generated. Light-based diagnostic and therapeutic devices.

12. In paragraph 10, The above lesion map generation unit, Generating the lesion map by connecting the local images based on the corresponding image feature points among the image feature points extracted from the local images. Light-based diagnostic and therapeutic devices.

13. In paragraph 10, A therapeutic light generating unit that recognizes the shape of the lesion area based on the lesion map, determines an output pattern of therapeutic light based on the shape of the recognized lesion area, and outputs patterned therapeutic light based on the determined output pattern. Including more, The shape of the above lesion area is: Corresponding to the output pattern of the above patterned therapeutic light, Light-based diagnostic and therapeutic devices.

14. In paragraph 13, The above therapeutic light generating unit is, Based on the amount of light accumulated by the patterned therapeutic light at each predetermined location of the lesion area indicated on the light quantity accumulation investigation map, the intensity of the patterned therapeutic light to be output at each predetermined location of the lesion area is determined, The therapeutic light having the intensity of the above-determined therapeutic light is output through the optical stimulation unit. Light-based diagnostic and therapeutic devices.

15. In a light-based diagnostic treatment device, A lesion detection unit that acquires a first lesion image of a user's lesion area based on an optical signal transmitted through a single optical path, detects the lesion area from the acquired first lesion image, and transmits a first trigger signal to a therapeutic light generation unit in response to terminating the detection of the lesion area; and In response to receiving the first trigger signal, the therapeutic light generating unit generates patterned therapeutic light based on the shape of the lesion area and outputs the patterned therapeutic light to the lesion area through the single optical path. including, Light-based diagnostic and therapeutic devices.

16. In paragraph 15, The above therapeutic light generating unit is, In response to the termination of the output of the patterned therapeutic light, a second trigger signal is transmitted to the lesion detection unit, The above lesion detection unit, In response to receiving the second trigger signal, a second lesion image of the lesion region can be acquired based on an optical signal transmitted through the single optical path, and the lesion region can be detected from the acquired second lesion image. Light-based diagnostic and therapeutic devices.

17. In paragraph 15, The above therapeutic light generating unit is, Determine the output pattern of therapeutic light based on the shape of the above lesion area, Generating patterned therapeutic light based on the determined output pattern, The shape of the above lesion area is: Corresponding to the output pattern of the above patterned therapeutic light, Light-based diagnostic and therapeutic devices.

Images