Method for providing ar image of recommended information related to laser treatment and ar wearable device using the same

Abstract

The present invention provides an AR wearable device for providing recommendation information related to laser treatment using an AR image, comprising: an AR image processing section configured to receive a video image including a laser treatment region of a patient, divide the laser treatment region into a plurality of mesh regions, and determine display information for each of the plurality of mesh regions; and a display section configured to provide display information about the plurality of mesh regions generated by the AR image processing section, wherein the display information of each area in the plurality of grid areas further comprises recommendation information which is determined based on the laser energy information and the current laser irradiation position information and is related to the irradiation sequence.

Description

Technical Field

[0001] This invention relates to a method for providing AR images that offer recommendations related to laser therapy, and an AR wearable device using this method. More specifically, it relates to a method, apparatus, and system for providing AR images that divide a patient's laser therapy area into multiple mesh regions and display recommendations related to laser therapy via AR images. Background Technology

[0002] Currently, various laser treatments and techniques that involve applying laser beams to the skin for therapeutic purposes are being developed, and medical laser devices used for such treatments are also being actively researched.

[0003] A laser beam is a "special light" that is generated after energy is input into a specific substance and undergoes a stimulated emission amplification stage. Laser treatment refers to the use of this light to penetrate deep into the skin in a very short time, selectively destroying the target skin lesion without damaging the surrounding tissue. Therefore, it does not leave obvious scars and is widely used as a convenient method that can be performed in a short time.

[0004] In existing technologies, this type of laser treatment device is operated manually by doctors or other practitioners. Therefore, because the treatment process relies on the practitioner's subjective experience or intuition, it often leads to a decrease in the accuracy or efficiency of laser treatment. Furthermore, practitioners often find it difficult to maintain concentration during prolonged treatments, which raises concerns related to patient safety.

[0005] Therefore, there is a need for new laser treatment methods and equipment that can improve the precision or efficiency of laser therapy while ensuring patient safety. Summary of the Invention

[0006] Technical issues

[0007] The purpose of this invention is to provide an AR image providing method and device that can improve the precision or accuracy of laser treatment.

[0008] Furthermore, the present invention aims to provide a patient-customized AR image delivery method and device that provides the best laser treatment method based on the patient's skin characteristics.

[0009] Furthermore, the present invention aims to provide a new laser treatment method and device, which divides the patient's laser treatment area into multiple grid areas and intuitively displays the laser irradiation amount and alarm display of each grid area in an AR image through color or brightness, thereby improving the precision or accuracy of laser treatment.

[0010] Furthermore, the present invention aims to provide laser treatment methods optimized for each patient by providing customized AR images based on the patient's skin characteristics.

[0011] Furthermore, the purpose of this invention is to provide real-time temperature information and laser irradiation amount information of each grid area within the laser treatment area of ​​the patient through AR images, thereby providing a method and device that enables the practitioner to perform laser treatment more safely and systematically.

[0012] Furthermore, the purpose of this invention is to link with historical laser irradiation information of specific skin areas at specific times in the past, and to provide recommended information related to the order of laser irradiation areas, thereby providing a laser treatment method optimized for the current skin recovery status of the patient.

[0013] The technical problem to be solved by the present invention is not limited to the above-mentioned content, and other technical problems not mentioned will be clearly understood by those skilled in the art through the following description.

[0014] Technical solution

[0015] According to one embodiment of the present invention, an AR wearable device is provided that uses AR images to provide recommendation information related to laser treatment. The device may include: an AR image processing unit configured to receive an image containing a laser treatment area of ​​a patient, divide the laser treatment area into multiple grid areas, and determine display information for each of the multiple grid areas; and a display unit configured to provide display information about the multiple grid areas generated by the AR image processing unit; wherein the display information about each of the multiple grid areas includes recommendation information related to the irradiation sequence determined based on laser energy information and current laser irradiation position information.

[0016] Here, the display information may also include color or brightness information.

[0017] Furthermore, the displayed information can be customized based on the patient's skin characteristic values.

[0018] Furthermore, the displayed information can be changed based on the length of time elapsed since the grid area was irradiated by the laser.

[0019] Furthermore, the recommendation information can be determined based on the patient's laser irradiation history at specific points in the past.

[0020] In addition, the laser irradiation history information may include information related to the time elapsed since the specific point in the past, the location of the laser irradiation, the number of laser irradiations, and the wavelength of the laser irradiation.

[0021] In addition, a communication unit may be included, configured to receive information from the laser irradiator related to the number of laser irradiations applied to the patient and the irradiation energy. The AR image processing unit may be configured to determine recommended information for each region in the plurality of grid regions based on the number of laser irradiations and the irradiation energy associated with each region in the plurality of grid regions.

[0022] Furthermore, the color or brightness information of each grid region can be changed in real time based on the number of laser irradiations and the irradiation energy applied to each region of the multiple grid regions.

[0023] Furthermore, the AR image processing unit can be configured to: calculate the cumulative energy value of each grid region based on the number of laser irradiations and the irradiation energy applied to each region of the plurality of grid regions, and determine whether to generate an alarm display based on whether the cumulative energy value exceeds a preset standard.

[0024] Furthermore, the preset criteria used for comparison with the energy accumulation value can be changed based on the patient's skin characteristic values.

[0025] Furthermore, the size of each region within the segmented grid regions can be changed based on the patient's skin characteristic values.

[0026] In addition, it may include a temperature sensing sensor configured to acquire real-time temperature information of the patient's laser treatment area. The AR image processing unit may also include skin temperature information corresponding to the grid area acquired by the temperature sensing sensor for the display information of each area in the plurality of grid areas.

[0027] Furthermore, the AR image processing unit can be configured to determine whether to generate an alarm display based on whether the skin temperature information exceeds a preset standard.

[0028] Furthermore, according to another embodiment of the present invention, a method for providing AR images for laser therapy using an AR wearable device is provided. The method may include: receiving an image containing a laser treatment area of ​​a patient via an AR image processing unit; dividing the laser treatment area into multiple grid areas via the AR image processing unit and determining display information for each of the multiple grid areas; and providing display information about the multiple grid areas generated by the AR image processing unit via a display unit; wherein the display information about each of the multiple grid areas includes recommendation information related to the irradiation sequence determined based on laser energy information and current laser irradiation position information.

[0029] Furthermore, according to another embodiment of the present invention, a computer-readable recording medium storing a computer program for performing the above-described AR image providing method can be provided.

[0030] Invention Effects

[0031] According to the present invention, an AR image providing method and apparatus that can improve the precision or accuracy of laser treatment can be provided.

[0032] Furthermore, according to the present invention, a method and apparatus for providing patient-customized AR images that provide optimal laser treatment methods based on the patient's skin characteristics can be provided.

[0033] Furthermore, according to the present invention, the patient's laser treatment area is divided into multiple grid areas, and the laser irradiation amount and alarm display of each grid area are intuitively displayed in an AR image by means of color or brightness, thereby providing a new laser treatment method and device that can improve the precision or accuracy of laser treatment.

[0034] Furthermore, according to the present invention, by providing customized AR images based on the patient's skin characteristics, it is possible to provide laser treatment methods optimized for each patient.

[0035] Furthermore, according to the present invention, real-time temperature information and laser irradiation amount information of each grid area within the laser treatment area of ​​the patient are provided through AR images, thereby providing a method and device that enables the practitioner to perform laser treatment more safely and systematically.

[0036] Furthermore, according to the present invention, by linking the laser irradiation history information of a specific skin area at a specific time point in the past to provide recommendation information related to the order of laser irradiation areas, it is possible to provide laser treatment methods optimized for the current skin recovery status of the patient.

[0037] The effects of the present invention are not limited to the above description, and other effects not mentioned will be clearly understood by those skilled in the art through the following description. Attached Figure Description

[0038] Figure 1 This is an example diagram illustrating a scenario in which laser treatment is performed on a patient using an AR wearable device according to an embodiment of the present invention.

[0039] Figure 2 This is a block diagram illustrating the configuration of an AR wearable device according to an embodiment of the present invention.

[0040] Figure 3 This is a block diagram illustrating the configuration of an AR image processing unit in an AR wearable device according to an embodiment of the present invention.

[0041] Figure 4This is an example diagram illustrating the division of a treatment area into multiple grid regions according to an embodiment of the present invention.

[0042] Figure 5a , Figure 5b and Figure 5c This is an example diagram illustrating various display methods for dividing a treatment area into multiple grid regions according to an embodiment of the present invention.

[0043] Figure 6 This is a flowchart illustrating a method for providing AR images for laser therapy using an AR wearable device according to an embodiment of the present invention. Detailed Implementation

[0044] The present invention will now be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement it. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein.

[0045] The terminology used in this specification is for illustrative purposes and not for limiting the invention. In this specification, unless specifically indicated in the sentence, the singular form includes the plural form as well.

[0046] As used in this specification, the terms "comprises" and "comprising" do not exclude the presence or addition of one or more other components, steps, actions, and / or elements besides those mentioned.

[0047] Furthermore, the terms "first," "second," and other ordinal numbers used in this invention may be used to describe components, but components should not be limited by these terms. Such terms are only used to distinguish one component from another. Additionally, in describing this invention, detailed descriptions of relevant known techniques are omitted if it is determined that such descriptions might obscure the essential points of the invention.

[0048] Furthermore, the constituent parts appearing in the embodiments of the present invention are drawn independently to represent different functional features, and do not imply that each constituent part consists of separate hardware or a single software constituent unit. That is, for ease of explanation, each constituent part is described as its own constituent part, and at least two constituent parts may be combined into one constituent part, or one constituent part may be divided into multiple constituent parts to perform functions. As long as they do not depart from the essence of the present invention, these integrated and separate embodiments of the constituent parts are also included within the scope of the claims of the present invention.

[0049] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The structure of the present invention and its effects will become clear through the following detailed description.

[0050] Figure 1 This is an example diagram illustrating a scenario in which laser treatment is performed on a patient using an AR wearable device according to an embodiment of the present invention.

[0051] During laser treatment or procedures, the laser practitioner 110 may wear the augmented reality (AR) wearable device 300 according to the present invention and use a laser irradiator 200 to irradiate the treatment area of ​​the patient 120 with laser. The laser practitioner 110 may be a medical person such as a doctor or nurse.

[0052] The AR wearable device 300 is designed to be worn on the head, face, or other body parts by the user, and can be configured to divide the laser treatment area seen by the user 110 into multiple grid areas for display, and to display information including color or brightness information for each of the multiple grid areas. A more detailed description of the AR wearable device (300) will be provided below.

[0053] The AR wearable device 300 may also include a temperature sensing sensor 330 configured to acquire real-time temperature information of the laser treatment area. The AR wearable device 300 can provide skin temperature information corresponding to the grid area acquired by the temperature sensing sensor 330 through the display information of each area in multiple grid areas.

[0054] Figure 2 This is a block diagram illustrating the configuration of an AR wearable device according to an embodiment of the present invention.

[0055] AR wearable device 300 has a form that can be worn on the head or face of a laser practitioner and is configured to provide visual information for laser treatment through a display to provide augmented reality services. Its components include, but are not limited to, a display unit 310, a camera unit 320, a temperature sensing sensor 330, a communication unit 340, an AR image processing unit 350, and an audio output unit 360.

[0056] Display unit 310 is configured to display visual information to the practitioner 110 wearing AR wearable device 300. For example, it can use at least one of the following methods: a curved mirror supporting optical see-through, a light guide, or a waveguide; or it can add necessary information to the gaze image acquired by camera unit 320 to provide a mixed reality image, thereby providing the practitioner 110 with an augmented reality experience. Display unit 310 can be configured to display reality information along with the following: a shape generated by AR image processing unit 350 dividing the laser treatment area into multiple grid areas, and display information including laser irradiation information and skin temperature information for each grid area, represented by color or brightness information.

[0057] The camera unit 320 is configured to capture an image of the area in front of the practitioner 110. For example, it may include an RGB-Depth camera capable of acquiring RGB images and depth information; or, as another example, it may include an RGB acquisition module capable of acquiring RGB images and a depth acquisition module capable of acquiring depth information. After acquiring the RGB image and depth information captured by the camera unit 320, the 3D position of at least one object contained in the image can be obtained based on the camera coordinate system. The image acquired by the camera unit 320 can be transmitted to the AR image processing unit 350 for AR image processing.

[0058] A temperature sensing sensor 330 is mounted on the AR wearable device 300 and configured to sense the skin temperature of the patient 120. For example, it can be a thermal imaging camera that uses infrared light to sense temperature as a non-contact temperature sensor, and can measure skin temperature by the amount of radiation emitted from the skin surface. For instance, the temperature sensing sensor 330 can be a sensor manufactured using CMOS technology that can sense temperature pixel-by-pixel in the camera image. The thermal imaging image and skin temperature information obtained by the temperature sensing sensor 330 can be transmitted to the AR image processing unit 350 for AR image processing.

[0059] The communication unit 340 may include one or more wired / wireless communication modules for communicating with external devices. For example, it may include a short-range communication unit or a mobile communication unit, and may be configured to send and receive necessary data with the laser irradiator 200 and the patient information system 400 via wired / wireless communication. Here, the short-range wireless communication unit may include, for example, a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a Near Field Communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an IrDA (Infrared Data Association) communication unit, a WFD (Wi-Fi Direct) communication unit, a UWB (Ultrawideband) communication unit, an Ant+ communication unit, etc., but is not limited to these. Furthermore, the mobile communication unit can send and receive wireless signals with at least one of a base station, an external terminal, or a server over a mobile communication network. These wireless signals may include, for example, voice call signals, video call signals, or data in various forms depending on the transmission and reception of text / multimedia messages.

[0060] The AR wearable device 300 can establish a wired / wireless communication connection with the laser irradiator 200 via the communication unit 340 to receive setting information or irradiation information from the laser irradiator 200. For example, it can receive real-time information related to laser irradiation, such as the number of laser irradiations (the number of laser emission operations), the irradiation energy of each laser emission, and laser wavelength information. Furthermore, the AR wearable device 300 can receive the patient's past laser treatment information and skin characteristic value information through the patient information system 400. Here, past laser treatment information may include the location of the previous treatment area, the type of laser treatment, and the number and energy of laser irradiations. The patient's skin characteristic value information may include skin sensitivity information, allergy information, and information such as moisture content, epidermal thickness, and dermal thickness obtained from measurements of the patient's skin. In addition to the patient's skin characteristic values, additional information reflecting the external environment, such as seasonal information (e.g., external temperature and humidity), the type of moisturizer or cosmetic applied to the patient's skin, and the time elapsed after applying the moisturizer or cosmetic, can also be considered.

[0061] The AR image processing unit 350 can be configured to divide the laser treatment area captured by the camera unit 320 into multiple grid regions and determine the display information for each of the multiple grid regions. At this time, the display information can be registered and displayed on the corresponding grid region using 3D position information obtained through the camera coordinate system. Here, the grid region can be composed of points, lines, polygons, polyhedra, etc., for example, it can be composed of a polygonal grid consisting of multiple grid regions segmented based on the similarity of vector values ​​such as normal vectors. Furthermore, the accuracy can be changed by adjusting the judgment criteria for vector value similarity, thereby changing the size of the grid region.

[0062] Here, the display information for each grid area can be configured to change the color or brightness of each grid area in real time based on the number of laser irradiations and the irradiation energy applied to each of the multiple grid areas. For example, the cumulative laser energy applied to the corresponding grid area can be calculated based on the number of laser irradiations multiplied by the irradiation energy, and the color or brightness of the corresponding grid area can be changed based on this cumulative laser energy value. For example, the greater the applied energy, the darker the grid area will be displayed, allowing the practitioner to intuitively grasp the applied energy value.

[0063] Furthermore, the display information for each grid area can be differentiated based on patient skin characteristic values ​​measured by the camera unit 320 or obtained by the patient information system 400. For example, the AR image processing unit 350 can calculate the cumulative energy value of each grid area based on the number of laser irradiations and the irradiation energy applied to each area of ​​the plurality of grid areas, and decide whether to generate an alarm display based on whether the cumulative energy value exceeds a preset standard, and present the alarm display as the display information; at this time, the preset standard compared with the cumulative energy value can be changed based on the patient's skin characteristic values. That is, when the patient's skin characteristics are more sensitive or fragile, the standard for generating an alarm display can be set to be more sensitive. For example, during laser treatment, the brightness display standard for reaching the warning level can be differentiated according to the patient's skin characteristic values, so that under the same laser energy applied, patients with strong skin characteristics may not have reached the brightness display level indicating an alarm, while patients with weak skin characteristics may quickly reach the brightness display level indicating an alarm. Additionally, for example, if a patient's skin is determined to have relatively high moisture content, the brightness and darkness display criteria for alarms can be adjusted so that the criteria for reaching a warning level are set less sensitively. By changing the display information of the grid area in this way to reflect the patient's skin characteristics, optimal customized information can be provided for each patient.

[0064] Furthermore, the AR image processing unit 350 can be configured to change the size of each region of the segmented multiple grid regions based on the patient's skin characteristics. For example, when the patient's skin is more sensitive or fragile, the size of the grid region is set to be smaller; when the patient's skin is less sensitive and more resilient, the size of the grid region is set to be larger.

[0065] Furthermore, the displayed color or brightness of each grid area can be adjusted based on the elapsed time since the area was irradiated by the laser. For example, by comprehensively considering the elapsed time after laser irradiation in each grid area, and the time required for collagen production and elastin regeneration when different patients receive specific types or wavelengths of laser treatment at specific locations, the skin recovery status at the current point in time can be simulated to correct skin characteristic values, and the displayed information can be changed based on these corrected values. For instance, based on the number of laser irradiations applied to the grid area and the wavelength or magnitude of the irradiation energy, if the area is initially displayed as dark, the brightness can be lightened as time passes after the laser treatment ends, and these display information values ​​can be updated and stored for use in the next treatment. For example, when using an Nd:YAG laser with a wavelength of 1064nm, collagen production in the dermis can be induced, thereby improving dermal vascular lesions and pigmentation lesions while achieving skin regeneration. Alternatively, when using a copper vapor laser that uses copper vapor as the gain medium and can produce two wavelengths—a 511nm green wavelength and a 578.2nm yellow wavelength—it can be used to treat vascular lesions.

[0066] Furthermore, the AR image processing unit 350 can process the information displayed in each of the multiple grid areas to include skin temperature information corresponding to that grid area, acquired by the temperature sensing sensor 330. For example, it can display a color corresponding to the skin temperature information, or simultaneously display individual temperature values ​​in each grid area. Additionally, the AR image processing unit 350 can be configured to determine whether to generate an alarm display based on whether the skin temperature information exceeds a preset standard, and this alarm triggering standard can be changed based on the patient's skin characteristic values.

[0067] The audio output unit 360 can be configured to output audio when an alarm display is generated by the AR image processing unit 350. When the operator 110 or the patient 120 reaches a possible alarm (warning) display level during laser treatment, patient safety can be enhanced by outputting a warning tone or audio with alarm-related information.

[0068] Figure 3This is a block diagram illustrating the configuration of an AR image processing unit in an AR wearable device according to an embodiment of the present invention.

[0069] The AR image processing unit 350 may include an image receiving unit 351, a grid area generation unit 352, a grid area information processing unit 353, an AR image generation unit 354, and an alarm processing unit 355. The AR image processing unit 350 may include a program or program module executable by one or more processors, as well as necessary memory. This program or program module may be in the form of an operating system, application program, or program, and may be physically stored in various widely used storage devices. Such a program or program module may include one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing a specific task or running a specific data type, but is not limited to these forms.

[0070] First, the image receiving unit 351 can be configured to receive an image of the patient's laser treatment area acquired by the imaging unit 320 or a separate imaging device. Furthermore, the image receiving unit 351 can be configured to receive a thermal imaging image acquired by the temperature sensing sensor 330. Additionally, the image receiving unit 351 can be configured to receive or generate an image after processing a semi-transparent overlay between the thermal imaging image acquired by the temperature sensing sensor 330 and the real image acquired by the imaging unit 320.

[0071] The mesh region generation unit 352 can be configured to divide the laser treatment area into multiple mesh regions to generate multiple polygonal or similar segmented regions. The mesh region generation unit 352 can perform image analysis, analyzing the image acquired by the image receiving unit 351 to separate only the treatment area. For example, after analyzing the patient's image, if the treatment area is the face, only the facial region is separated as the object, and only the facial region is segmented into multiple mesh regions, thereby generating mesh regions only for that treatment area. Furthermore, the mesh region generation unit 352 can be configured to modify the size of each region of the segmented multiple mesh regions based on the patient's skin characteristic values.

[0072] The grid area information processing unit 353 can be configured to generate display information to be attached to the AR image. The grid area information processing unit 353 can determine the display information for each area of ​​the generated multiple grid areas, which includes color or brightness information, allowing the color or brightness of each grid area to be displayed differently. Here, even for the same value, the display information can be differentiated based on the patient's skin characteristics, applying different standards to each individual. Furthermore, the display information can be set to change based on the elapsed time since the grid area was irradiated by the laser. Moreover, after receiving information related to the number of laser irradiations applied to the patient and the irradiation energy from the laser irradiator 200 via the communication unit 340, the grid area information processing unit 353 can be configured to: calculate the cumulative energy value applied to each grid area based on the number of laser irradiations and the irradiation energy related to each area of ​​the multiple grid areas, and determine the display information for each area of ​​the multiple grid areas accordingly. In addition, for example, the grid area information processing unit 353 is configured to change the color or brightness information of each grid area in real time based on the number of laser irradiations and the irradiation energy applied to each area of ​​the multiple grid areas. According to the change of this display information, the practitioner 110 can intuitively and quickly grasp the cumulative amount of laser irradiation applied to the corresponding grid area, thereby performing treatment more systematically.

[0073] Furthermore, the display information for each grid area may include alarm display information, which can be displayed using specific colors or brightness, or presented as a separate alarm icon. For example, the grid area information processing unit 353 can be configured to calculate the cumulative energy value of each grid area based on the number of laser irradiations and the irradiation energy applied to each of the multiple grid areas, and determine whether to generate an alarm display based on whether the cumulative energy value exceeds a preset standard. Here, the preset standard compared with the cumulative energy value can be set to be changed based on the patient's skin characteristics, thereby enabling the determination of whether to generate an alarm display according to the skin characteristics of each patient. Furthermore, when the cumulative energy values ​​of multiple adjacent grid areas exceeding a predetermined number all exceed the preset standard, an alarm display can be generated.

[0074] Furthermore, the grid area information processing unit 353 can be configured to generate, as display information, further recommended information related to the irradiation sequence, determined based on laser energy information and current laser irradiation location information, to obtain the best laser treatment effect. This allows the practitioner 110 to conveniently grasp the optimal laser irradiation area location and sequence through the AR image generated on the display unit 310. Additionally, considering the minor burns and regeneration process of specific areas of the patient caused by different wavelengths of laser irradiation in the past, or simulating collagen production and elastic fiber regeneration in the dermis and subfascia of the area over time, recommended information related to the irradiation sequence of the optimal laser irradiation area is provided, reflecting the skin's recovery capacity at the current point in time for each patient. For this purpose, the recommended information can be determined based on the laser irradiation history of specific skin areas of each patient at a specific point in the past. This history may include, for example, the elapsed time since the specific point in the past, the laser irradiation location associated with past laser treatments, the number of laser irradiations, and the laser wavelength. Furthermore, the relationship between the treatment execution status of the recommended laser irradiation sequence and the resulting patient skin prognosis information can be reflected subsequently, thereby updating the laser irradiation-related recommended information.

[0075] In addition, the display information for each grid area may also include skin temperature information corresponding to that grid area, acquired by the temperature sensing sensor 330. This skin temperature information can be represented by numbers or colors. Furthermore, the grid area information processing unit 353 can be configured to determine whether to generate an alarm display based on whether the skin temperature information exceeds a preset standard for each patient.

[0076] The AR image generation unit 354 is configured to overlay multiple grid regions generated by the grid region generation unit 352 and the grid region information processing unit 353 with the display information of each grid region to generate an AR image. The AR image generated in this way can be displayed via the display unit 310 through optical perspective, or it can be displayed by adding AR image information to the gaze image acquired by the camera 320 to provide a mixed reality image.

[0077] The alarm processing unit 355 is configured to provide additional alarms when the grid area information processing unit 353 generates an alarm display. For example, it can be configured to output audio to inform the alarm via the audio output unit (360).

[0078] Figure 4 This is an example diagram illustrating the division of a treatment area into multiple grid regions according to an embodiment of the present invention.

[0079] Reference Figure 4When the laser treatment area for a patient is, for example, the face and neck, the facial and neck regions can be identified from the patient's images, and the treatment area can be segmented into multiple polygonal grid regions. Segmentation methods can be based on the similarity of vector values ​​such as normal vectors, or various other methods can be used.

[0080] Here, the color or brightness of each segmented grid area can be differentiated. For example, the color or brightness can be determined in real time based on the cumulative energy value calculated from the number of laser irradiations and the irradiation energy. It can also be adjusted to reflect the skin's recovery capacity based on the elapsed time since the laser irradiation was applied. Furthermore, it can incorporate past experiences of minor burns and regeneration in specific areas caused by different wavelengths of laser light, or simulate the generation of collagen and regeneration of elastic fibers in the dermis and subfascia over time, to reflect the skin's recovery level at each patient's current point in time and change the color or brightness accordingly. Additionally, during laser treatment, when the cumulative energy value exceeds a preset standard, an alarm can be displayed for that grid area using a specific color or brightness. The criteria for determining whether to display such an alarm can be differentiated based on the patient's skin characteristics.

[0081] Furthermore, the size of each grid region can be changed based on the patient's skin characteristics by adjusting the criteria for judging vector value similarity.

[0082] Figure 5a , Figure 5b and Figure 5c This is an example diagram illustrating various display methods for dividing a treatment area into multiple grid regions according to an embodiment of the present invention.

[0083] Reference Figure 5a It can be confirmed that during laser treatment, the brightness and darkness of each grid area changes based on the cumulative energy applied to the corresponding grid area. For example, if the cumulative energy applied to grid area A is greater than the cumulative energy applied to grid area B, the brightness and darkness of grid area A can be deeper than that of grid area B. The practitioner (110) can quickly determine the degree of energy applied to each grid area through the displayed brightness and darkness information.

[0084] Reference Figure 5b The size of each grid area can be changed according to the patient's skin characteristics. For example, when the patient's skin is highly sensitive or fragile, as shown in the right figure, by setting the size of the grid area to be more refined (smaller), more detailed display information related to laser treatment can be provided.

[0085] Reference Figure 5cFor each grid region, information related to the irradiation sequence can be provided based on laser energy information and current laser irradiation position information. For example, in grid region A, which is divided into 4 regions, the irradiation sequence of A1, A2, A3, and A4 is determined based on the proximity of the current laser irradiation positions and the similarity of the laser energy magnitude information to be irradiated to that grid region. Then, in grid region B, which is adjacent to grid region A and divided into 4 regions, the irradiation sequence of B1, B2, B3, and B4 is determined in a similar manner and displayed on the screen as display information, thereby assisting the operator 110 in more systematically determining the irradiation position and sequence when performing laser irradiation.

[0086] Figure 6 This is a flowchart illustrating a method for providing AR images for laser therapy using an AR wearable device according to an embodiment of the present invention.

[0087] Reference Figure 6 The AR wearable device 300 can acquire image data of the area where the patient received laser treatment via the camera unit 320. (S610)

[0088] Furthermore, by capturing images of the skin with the camera unit 320, or by obtaining stored skin characteristic values ​​of the patient from the patient information system 400, such as skin sensitivity information, allergy information, and information on moisture content, epidermal thickness, and dermal thickness obtained based on measurements of the patient's skin, the AR wearable device 300 can acquire these values. (S620)

[0089] The AR wearable device 300 can divide the laser treatment area into multiple grid areas using the AR image processing unit 350. (S630)

[0090] The AR wearable device 300 can update the display information of each grid area based on the laser irradiation information of each grid area through the AR image processing unit 350. (S640) For example, the color or brightness of each grid area can be changed in real time based on the cumulative value of laser energy calculated using the number of laser irradiations and irradiation energy of each grid area.

[0091] The AR wearable device 300 can update the display information of each grid area based on skin temperature information through the AR image processing unit 350. (S650) Based on the skin temperature information of each grid area obtained by the temperature sensing sensor 330, the color or brightness of each grid area can be changed in real time, or the skin temperature information can be presented in numerical form.

[0092] The AR wearable device 300 can generate alarm displays based on laser irradiation information or skin temperature information. The criteria for determining whether to generate such alarm displays can be differentiated according to the patient's skin characteristics; when the cumulative energy value caused by laser irradiation or the skin temperature information exceeds the predetermined criteria, it can be configured to generate an alarm display.

[0093] The AR wearable device 300 can store abnormal information such as whether alarms have occurred in each grid area. (S670) Based on alarm information that occurred during laser treatment of the patient, it stores information related to the grid area and the cause of the alarm, and provides this information during the next laser treatment, thereby enabling safer laser treatment.

Claims

1. An AR wearable device that uses AR images to provide recommendations related to laser therapy, characterized in that, include: An AR image processing unit is configured to receive an image containing a patient's laser treatment area, divide the laser treatment area into multiple grid areas, and determine the display information for each of the multiple grid areas; The system also includes a display unit for providing display information about the plurality of grid regions generated by the AR image processing unit. The display information for each of the plurality of grid regions includes recommended information related to the irradiation sequence, determined based on laser energy information and current laser irradiation location information. The display information is differentiated based on the patient's skin characteristic values. The display information is modified based on the elapsed time since the grid region was irradiated by the laser. The patient's skin characteristic values ​​are corrected based on simulation results of skin resilience at the current time point. These simulation results are derived using information related to the laser irradiation wavelength applied to each grid region of the patient and the elapsed time since the laser irradiation. The recommended information is determined based on historical laser irradiation information of specific skin areas of the patient at past specific time points. The historical laser irradiation information includes the simulation results of skin resilience at the current time point.

2. The AR wearable device according to claim 1, characterized in that, The display information further includes color or brightness information.

3. The AR wearable device according to claim 1, characterized in that, The laser irradiation history information includes information related to the time elapsed since the specified past point in time, the location of the laser irradiation, the number of laser irradiations, and the wavelength of the laser irradiation.

4. The AR wearable device according to claim 1, characterized in that, The system further includes a communication unit configured to receive information related to the number of laser irradiations and the irradiation energy applied to the patient from a laser irradiator; the AR image processing unit is configured to determine recommended information for each of the plurality of grid regions based on the number of laser irradiations and the irradiation energy associated with each region of the plurality of grid regions.

5. The AR wearable device according to claim 1, characterized in that, Based on the number of laser irradiations and the irradiation energy applied to each of the multiple grid regions, the color or brightness information of each grid region is changed in real time.

6. The AR wearable device according to claim 1, characterized in that, The AR image processing unit is configured to: calculate the cumulative energy value of each grid region based on the number of laser irradiations and the irradiation energy applied to each region of the plurality of grid regions, and determine whether to generate an alarm display based on whether the cumulative energy value exceeds a preset standard.

7. The AR wearable device according to claim 6, characterized in that, The preset standard for comparison with the energy accumulation value is modified based on the patient's skin characteristic values.

8. The AR wearable device according to claim 1, characterized in that, The size of each of the multiple segmented grid regions is changed based on the patient's skin characteristic values.

9. The AR wearable device according to claim 1, characterized in that, The system further includes a temperature sensing sensor configured to acquire real-time temperature information of the patient's laser treatment area; the AR image processing unit's display information for each area in the plurality of grid areas also includes skin temperature information corresponding to that grid area acquired by the temperature sensing sensor.

10. The AR wearable device according to claim 9, characterized in that, The AR image processing unit is configured to determine whether to generate an alarm display based on whether the skin temperature information exceeds a preset standard.

11. A method for providing AR images for laser therapy using an AR wearable device, characterized in that, include: The step of receiving an image containing the patient's laser treatment area via the AR image processing unit; The AR image processing unit divides the laser treatment area into multiple grid areas and determines the display information for each of the multiple grid areas. The step involves providing display information about the plurality of grid regions generated by the AR image processing unit via a display unit; wherein the display information about each region among the plurality of grid regions includes recommendation information related to the irradiation sequence determined based on laser energy information and current laser irradiation position information; the display information is differentiated based on the patient's skin characteristic values; the display information is modified based on the elapsed time since the grid region was irradiated by the laser; the patient's skin characteristic values ​​are corrected based on the simulation results of skin resilience at the current time point, which are derived using information related to the laser irradiation wavelength applied to each grid region of the patient and the elapsed time since the laser irradiation; the recommendation information is determined based on the laser irradiation history information of a specific skin area of ​​the patient at a specific time point in the past, and the laser irradiation history information includes the simulation results of skin resilience at the current time point.

12. A computer-readable recording medium having a computer program stored thereon, characterized in that, The computer program is used to perform the method of claim 11.

Images