Electronic device and method for displaying surgical site by using same

Abstract

An electronic device according to an embodiment disclosed in the present document may comprise: a display; a camera module; and a processor functionally connected to the display and the camera module, wherein the processor is configured to: allow, while an energy irradiator irradiates a treatment site of a subject with a first energy for a designated time, the camera module to face the treatment site to acquire information about the treatment site by using the camera module; on the basis of a feature change in the treatment site according to the obtained information, identify a treatment area corresponding to the site irradiated with the first energy; and display, on the display, a processed image corresponding to the treatment site of the subject so that the treatment area is distinguished from other areas.

Description

Electronic devices and methods for marking their treatment sites

[0001] Various embodiments disclosed in this document relate to medical treatment information guidance technology.

[0002] Lasers (LASER: Light Amplified by Stimulated Emission of Radiation) and various other energy delivery devices are widely used in the medical field. These devices are used in various treatments based on the principle that their energy is absorbed by human tissue and converted into heat, causing thermal damage and chemical reactions in cells or tissues.

[0003] Initially, lasers, with their high energy output and tissue-destructive properties, were used for surgical procedures such as tissue cutting, coagulation, and hemostasis. Recently, lasers have been used in cosmetic skincare procedures to improve obesity, remove scars, and treat pigmentation (spots, erythema, blemishes, and freckles). Various energy delivery devices are also being used to improve skin texture, elasticity, and lifting.

[0004] The practitioner (medical staff) uses lasers and various energy delivery devices (e.g., radiofrequency or ultrasound) to manually adjust the spot size, wavelength, irradiation time, irradiation method, frequency per second (Hz), and energy intensity to treat the area, depending on the target and treatment purpose. However, cosmetic lasers and various energy delivery devices (e.g., radiofrequency or ultrasound) may not produce noticeable changes (such as redness, scabbing, or marks) on the skin immediately after irradiation or delivery of energy. Furthermore, some wavelengths of lasers fall within the invisible infrared or ultraviolet range, making it difficult to even identify the area being treated. To address this, commercially available laser equipment utilizes a method of irradiating a point beam (laser pointer) alongside the therapeutic laser, helping to at least determine where the laser is currently being applied. Nevertheless, it is difficult for the practitioner to determine how much laser energy has been applied to which area, and which areas have been treated and which have not.

[0005] Various embodiments disclosed in this document can provide an electronic device capable of displaying a treatment site and the amount of energy delivered by a laser and various types of energy delivery devices on a display, and a method for displaying the treatment site and the amount of energy delivered.

[0006] An electronic device according to one embodiment disclosed in the present document includes a display; a camera module; and a processor functionally connected to the display and the camera module, wherein the processor is configured to, while an energy irradiator irradiates first energy to a treatment site of a subject for a specified period of time, obtain information about the treatment site by using the camera module by directing the camera module toward the treatment site, and identify a treatment area corresponding to the treatment site of the first energy based on a change in the characteristics of the treatment site according to the obtained information, and display a processed image corresponding to the treatment site of the subject on the display so that the treatment area is distinguished from other areas.

[0007] According to various embodiments disclosed in this document, the treatment area and the amount of energy delivered by lasers and various types of energy delivery devices can be visually displayed. Furthermore, various effects, directly or indirectly identified through this document, can be provided.

[0008] Figures 1a, 1b and 1c are reference drawings of the light therapy principle according to one embodiment.

[0009] Figure 2 is an example of use of an electronic device according to one embodiment.

[0010] Figure 3 is a detailed configuration diagram of an electronic device according to one embodiment.

[0011] Figure 4 is an example of displaying an investigation area of ​​a first energy according to one embodiment.

[0012] Figure 5 is a flowchart of a method for indicating a treatment site according to one embodiment.

[0013] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0014] Figures 1a, 1b, and 1c illustrate reference diagrams related to the principle of phototherapy according to one embodiment.

[0015] In therapeutic light-based treatments, light energy must be delivered deep enough to treat the lesion. The depth at which light (or wavelength) energy penetrates the skin (the distance it travels) is determined by its wavelength. Therapeutic light (or wavelength) can be ultrasound, radiofrequency, or laser. However, for ease of explanation, this document primarily focuses on laser-based therapeutic light (or energy).

[0016] Referring to Figure 1a, laser energy of various wavelengths (laser specific energy) can be converted into laser energy of a specific wavelength as it passes through a specific medium that only allows specific wavelengths to pass through. When laser energy of a specific wavelength is irradiated onto the skin, it can travel to a depth within the skin corresponding to the wavelength and transmit laser specific energy at that depth. This medium can be considered a core component of the laser device, to the extent that it can replace the name of the laser. The medium can be various, such as erbium:YAG, alexandrite, or nd:YAG.

[0017] Referring to Figure 1b, the skin can be composed of the epidermis, dermis, and subcutaneous tissue. The epidermis primarily produces freckles and pigmented lesions, the dermis primarily produces wrinkles and scars, and the subcutaneous tissue primarily produces lesions that cause changes in curvature.

[0018] Referring to FIGS. 1A and 1B, the Er:YAG medium (110A) can transmit laser energy to the outer surface (epidermis) of the skin by allowing only the 2940 nm wavelength of the laser to pass through. Therefore, the Er:YAG laser (110B) can be used primarily to treat lesions occurring in the epidermis. For example, the Alexandrite medium (120A) can transmit laser energy to the depth of the hair follicle (dermis) in the skin by allowing only the 755 nm wavelength of the laser to pass through. Therefore, the Alexandrite laser (120B) can be used primarily to treat lesions occurring in the dermis. For example, the ND:YAG medium (130A) can transmit laser energy to the subcutaneous tissue deep in the skin by allowing only the 1064 nm wavelength of the laser to pass through. Therefore, the Nd:YAG laser (130B) can be used primarily to treat lesions occurring in subcutaneous tissue.

[0019] Referring to Fig. 1c, even lasers of the same wavelength can have different effects depending on the irradiation method (pulse, continuous irradiation). For example, a laser that is fired long and strongly in a long-pulse manner can heat the lesion area and burn the lesion with heat and disappear. Therefore, a laser irradiated in a long-pulse manner is effective in treating vascular diseases such as redness and facial flushing. On the other hand, a laser that is fired short and weakly in a Q-switch manner, for example, can destroy the lesion with shock waves caused by vibration. Therefore, a laser irradiated in a Q-switch manner is effective in treating pigment diseases such as pigmentation, freckles, and pigmented blemishes.

[0020] The 532 nm wavelength laser (140B, 140C) passing through the KTP medium (140A) can be irradiated in a long pulse manner or a Q-switch manner. The 532 nm wavelength laser (140B) irradiated in a long pulse manner can treat vascular diseases occurring in the dermis, and the 532 nm wavelength laser (140C) irradiated in a Q-switch manner can treat pigmented diseases in the dermis. The Q-switched laser can have a pulse time interval (hereinafter, referred to as irradiation time) that can be controlled, and when the pulse time interval length is short, the energy density can be high, and when it is long, the energy density can be low.

[0021] Similarly, a 1064 nm wavelength laser (130B, 130C) passing through an Nd:YAG medium (130A) can treat vascular diseases and pigmented diseases in the subcutaneous tissue layer, respectively.

[0022] In this way, the laser has a specific wavelength after passing through the medium, but the laser's unique energy is delivered to a depth in the skin corresponding to the wavelength, so that different lesions can be treated depending on the irradiation method.

[0023] Figure 2 illustrates an example of use of an electronic device according to one embodiment.

[0024] Referring to FIG. 2, an electronic device (200) according to one embodiment may include a camera module (220) and a display (230).

[0025] In one embodiment, the electronic device (200) may be a laser device equipped to irradiate a laser of a specified wavelength, including a laser irradiator (210). Alternatively, the electronic device (200) may be a separate component from the energy irradiator (210). This document primarily describes an example in which the electronic device (200) includes the energy irradiator (210). However, the present invention is not limited thereto.

[0026] According to one embodiment, the energy irradiator (210) can continuously or pulse-irradiate laser energy (hereinafter, referred to as “first energy”) of a designated wavelength that has passed through a designated medium. The first energy may include various energies such as laser, ultrasound, high frequency, IPL, and plasma. In this document, for the convenience of explanation, a case in which the energy irradiator (210) irradiates laser energy is mainly described as an example. However, the present invention is not limited thereto. The laser energy of the designated wavelength can provide a therapeutic effect corresponding to the wavelength, irradiation time, irradiation method, and energy intensity to the treatment site of the patient. The treatment site may vary depending on the location of the lesion, but this document will describe a case in which the treatment site is the face as an example.

[0027] According to one embodiment, the electronic device (200) may, while irradiating the first energy, irradiate a point beam to the same area as at least a portion of the first energy. The point beam may be a visible light laser (hereinafter, referred to as a 'point beam').

[0028] According to one embodiment, the electronic device (200) obtains information about the treatment area of ​​the subject by using the camera module (220) while irradiating the first energy and point beam so that the camera module (220) faces the treatment area of ​​the subject. The electronic device (200) can identify the treatment area of ​​the subject by confirming the characteristics (e.g., color, shape, pattern, movement, other changes, etc.) of the skin contact area of ​​the point beam or energy irradiator (210) through the information obtained through the camera module (220). The electronic device (200) can display the identified treatment area on the display (230) by distinguishing the color and density in a processed image including the entire treatment area of ​​the subject (or at least the area currently being treated).

[0029] In one embodiment, the laser (for example, high frequency or ultrasound) irradiated by the electronic device (200) may not produce noticeable changes (such as redness, scabs, or marks) immediately after being irradiated on the skin of the subject. Therefore, the conventional laser equipment user (the practitioner) has the limitation that he or she must rely solely on his or her memory to know how much laser energy was irradiated to which part of the subject. However, the electronic device (200) according to one embodiment can identify the part of the subject to be laser-irradiated based on the characteristics of the skin contact area of ​​the point beam (laser pointer) or energy irradiator (210) irradiated together with the therapeutic laser (first energy), and display the identified part on the display (230), thereby assisting the practitioner to accurately identify the treatment part.

[0030] Figure 3 shows a schematic diagram of an electronic device according to one embodiment.

[0031] Referring to FIG. 3, an electronic device (200) according to one embodiment may include an energy detector (210), a camera module (220), a display (230), an input device (240), a memory (250), and a processor (260). In one embodiment, the electronic device (200) may omit some components or may further include additional components. For example, the energy detector (210) may be omitted. In addition, some of the components of the electronic device (200) may be combined to form a single entity, but may perform the same functions of the corresponding components prior to combination. For example, some of the components (230, 240, 250, 260) of the electronic device (200) excluding the camera module (220) and the energy detector (210) may be provided in a first device, and the remaining components (230, 240, 250, 260) of the electronic device (200) excluding the energy detector (210) and the camera module (220) may be provided in a second device. In this case, the first device and the second device may transmit and receive data through a mutually designated communication channel.

[0032] According to one embodiment, the energy irradiator (210) is equipped to irradiate a first energy. The first energy can provide a designated treatment effect to the irradiated skin. The first energy can include laser energy. For example, the energy irradiator (210) can generate the first energy by passing a specific laser through a designated medium. The designated medium can include at least one medium among all types of laser generating media that can be used for skin treatment, such as CO2, erbium YAG, alexandrite, ruby, diode, and Nd:YAG.

[0033] In one embodiment, the energy irradiator (210) may be configured to further irradiate the point beam. For example, when the first energy is a laser, the energy irradiator (210) may further irradiate the point beam. The point beam may be a laser point beam in the visible light band having a designated color (e.g., green, red). The point beam may be irradiated to at least a portion of the same area as the first energy for a designated time (e.g., the same time as the first energy). For example, the point beam may be irradiated to an area overlapping the entire area to which the first energy is irradiated. In another example, the point beam may be irradiated in a designated shape and a designated size, overlapping at least a portion (e.g., the center) of the area to which the first energy is irradiated. However, the present invention is not limited thereto. When ultrasonic and high-frequency energy are irradiated instead of the first energy, the energy irradiator (210) may not be provided with components and members for irradiating the point beam.

[0034] According to one embodiment, the energy irradiator (210) can irradiate a first energy and point beam of a specified wavelength (or type) with a specified irradiation method, a number of transmissions per second (Hz) and a specified energy intensity for a specified time under the control of the processor (260). The specified irradiation method may include a pulse mode (corresponding to the long pulse method) that irradiates the laser with pulses having a certain time interval and a continuous mode (corresponding to the Q switch method) that continuously irradiates the laser. At least one of the wavelength, irradiation time, irradiation method, number of transmissions per second (Hz) and energy intensity of the energy irradiator (210) can be set manually by a user input through an input device (240) or automatically by other settings.

[0035] The camera module (220) may include at least one image sensor among a charge coupled device (CCD) and a metal oxide semi-conductor (MOS). The camera module (220) may photograph the treatment area of ​​the subject and generate a related image under the control of the processor (260). The camera module (220) may be equipped to automatically adjust the lens direction by a motor or the like capable of controlling the movement of the camera module (220) or manually by a user's operation or elastic member. Alternatively, the camera module (220) may be equipped in AR, VR glasses or a headset worn on the user's forehead or eyes.

[0036] The display (230) can visually output at least one of images, symbols, numbers, or characters under the control of the processor (260). The display (230) may include, for example, at least one of a liquid crystal display, an OLED, a touchscreen display, a holographic display, a three-dimensional display, a virtual reality display, or an augmented reality display. According to one embodiment, the display (230) can display a processed image with a treatment area divided under the control of the processor (260).

[0037] The input device (240) can detect or receive a user (e.g., a practitioner) input of the electronic device (200). The input device (240) can include, for example, at least one input circuit of a push button, a tag switch, a dial switch, a touchscreen, or a microphone. The user input can be related to, for example, a setting of at least one of a wavelength of the first energy, an irradiation time, an irradiation method, a number of transmissions per second (Hz), or an energy intensity.

[0038] The memory (250) can store various data used by at least one component (e.g., the processor (260)) of the electronic device (200). The data may include, for example, input data or output data for software and commands related thereto. For example, the memory (250) can store at least one instruction for providing a laser treatment service.

[0039] According to one embodiment, the memory (250) may store area shape information related to the difference in the irradiation area between the first energy and the point beam or the difference in the irradiation area between the skin contact area of ​​the energy irradiator (210) and the irradiation area of ​​the first energy. The area shape information may be provided so as to confirm (e.g., calculate) the area where the first energy is irradiated from the irradiation area of ​​the point beam or the skin contact area of ​​the energy irradiator (210) confirmed from information acquired through the camera module (220). For example, the first energy may be irradiated in a circle of a first diameter, and the point beam may be irradiated in a circle of a second diameter (less than or equal to the first diameter) whose center overlaps the center of the irradiation area of ​​the first energy. In this case, the area shape information may include, for example, mathematical formula information for calculating the area of ​​a circle, area size information (e.g., the first diameter value and the second diameter value), or difference information between areas (e.g., the area ratio between a circle of the first diameter and a circle of the second diameter). The above-mentioned area shape information may be provided so as to be able to distinguish the treatment area irradiated with the first energy from the color of the point beam included in the information acquired through the camera module (220) in consideration of image distortion caused by the camera module (220). Similarly, the output terminal of the energy irradiator (210) has a rectangular shape, and the first energy may be irradiated through a portion of the rectangular output terminal. In this case, the above-mentioned area shape information may be provided so as to include difference information between the shape of the output terminal of the energy irradiator (210) and the irradiation area of ​​the first energy.

[0040] According to one embodiment, the memory (250) may store area expression information corresponding to the spot size, wavelength, irradiation time, irradiation method, and energy intensity of the first energy. The area expression information may include color, concentration, and concentration change information according to the setting of at least one of the spot size, wavelength, irradiation time, irradiation method, and energy intensity of the first energy.

[0041] The memory (250) may include various forms of volatile or non-volatile memory. For example, the memory may include read-only memory (ROM) and random access memory (RAM). In one embodiment, the memory may be located internally or externally to the processor, and the memory (250) may be connected to the processor (260) via various known means.

[0042] The processor (260) can control at least one other component (e.g., hardware or software component) of the electronic device (200) and perform various data processing or calculations. The processor (260) can include, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, an application processor, an application specific integrated circuit (ASIC), and a field programmable gate array (FPGA), and can have multiple cores.

[0043] According to one embodiment, the processor (260) can check at least one setting of the wavelength, irradiation time, irradiation method, number of transmissions per second (Hz), and energy intensity of the first energy input by the user or set by default through the input device (240). The processor (260) can output the first energy through the energy irradiator (210) with the spot size, wavelength, irradiation time, irradiation method, number of transmissions per second (Hz), and energy intensity according to at least one setting during the irradiation time according to at least one setting according to a user input through the input device (e.g., operation of a light irradiation start button). For example, the processor (260) can continuously irradiate a point beam to at least a part of an irradiation site of the first energy or for the same time as the first energy while irradiating the first energy using the energy irradiator (210).

[0044] The processor (260) can obtain information about the area to which the first energy and the point beam have been irradiated or the skin contact area of ​​the energy irradiator (210) by using the camera module (220) while irradiating the first energy to the treatment area of ​​the subject, by directing the camera module (220) toward the treatment area. The information obtained through the camera module (220) can include, for example, at least one of an image (e.g., a preview image or a captured image) or text. The area to which the point beam has been irradiated or the skin contact area of ​​the energy irradiator (210) can have a designated color. The designated color can be a color corresponding to the output terminal of the point beam or the energy irradiator (210).

[0045] The processor (260) can identify at least one feature among color, shape, pattern, movement, or other changes of the skin contact area of ​​the point beam or energy irradiator (210) by analyzing the information acquired through the camera module (220). Based on the at least one identified feature, the processor (260) can identify a treatment area corresponding to the irradiation area of ​​the first energy among the entire treatment area from the acquired information.

[0046] For example, among the information acquired through the camera module (220), information corresponding to the area where the point beam was irradiated or the skin contact area of ​​the energy irradiator (210) may include information on at least one feature among a specified color, shape, pattern, movement, and other changes. Accordingly, the processor (260) may select (or confirm) or recognize by artificial intelligence the feature (e.g., the specified color, shape, pattern, movement, and other changes) from the information acquired through the camera module (220), thereby confirming the area where the point beam was irradiated or the skin contact area of ​​the energy irradiator (210).

[0047] The processor (260) can identify the treatment area irradiated with the first energy from the area irradiated with the point beam based on the area shape information stored in the memory (250). For example, if the invisible first energy is irradiated with a 5 mm circular spot and the visible point beam is irradiated with a 2 mm circular spot, the processor (260) can detect the irradiation area of ​​the point beam from the acquired information based on the visual characteristic information of the point beam acquired through the camera module (220), and estimate and identify the irradiation area (treatment area) of the first energy by a formula for calculating the area of ​​a circle based on the center of the detection area (e.g., 2*π*5 mm (radius of the point beam).

[0048] In one embodiment, since there may be an error occurring in the imaging process between the actual first energy irradiation area and the point beam irradiation area, the processor (260) can confirm the irradiation area of ​​the point beam from the acquired information and confirm the treatment area by expanding (or reducing) the irradiation area of ​​the point beam based on area shape information (e.g., information on the area difference between a circle of the first diameter and a circle of the second diameter).

[0049] In one embodiment, the processor (260) may display a processed image corresponding to the entire treatment area on the display (230) so that the identified treatment area is distinguished from other areas. For example, if the treatment area is the face of the subject, the processed image may be a three-dimensional image representing the face of the subject.

[0050] According to one embodiment, the processor (260) may represent a treatment area including the entire treatment area (or at least a portion of the treatment area) of the subject with a designated color that is distinct from other areas. For example, the processor (260) may identify a color of the treatment area corresponding to the wavelength (or type) of the first energy based on the area representation information, and may identify a concentration corresponding to the irradiation amount (irradiation time, irradiation method, and energy intensity) of the first energy. The processor (260) may distinguish the treatment area in the processed image with the identified color and concentration and display the same on the display (230).

[0051] According to one embodiment, the processor (260) may display a color dot having a color corresponding to the wavelength (or type) of the first energy at a concentration corresponding to the amount of first energy irradiated to the corresponding treatment area. For a treatment area to which the first energy has been repeatedly delivered, the processor (260) may add the amount of energy delivered to the corresponding area to increase the concentration of the color dot.

[0052] In one embodiment, the electronic device (200) is a device capable of performing a procedure called laser toning, and the energy irradiator (210) can irradiate a laser in a circular manner, and irradiate first energy with an energy intensity and spot size set through an input device (240).

[0053] The practitioner (user) applies 10Hz 1.4J / cm with a spot size of 7mm through the input device (240). 2 When the energy is set, the processor (260) emits 1.4J / cm2 at 10Hz with a spot size of 7mm through the energy detector (210). 2 The first energy can be irradiated with the energy intensity (first intensity) and the point beam can be irradiated simultaneously. The processor (260) obtains information about the treatment area using the camera module (220) while irradiating light, and based on this, a processed image (e.g., a facial image) is prepared, and by superimposing 10 specific color dots of 7 mm size at a concentration corresponding to the first energy intensity per second (irradiation time: 10 Hz), the treatment area can be distinguished and displayed.

[0054] If the practitioner changes the spot size of the laser toning from 7 mm to 5 mm through the input device (240) during the treatment, the processor (260) can additionally display the treatment area corresponding to the area irradiated with the first energy by distinguishing it with a specific color dot of 5 mm in size. If the practitioner changes the (irradiation frequency per second [Hz]) of the laser toning to 5 Hz through the input device (240), the processor (260) can additionally display the treatment area corresponding to the area irradiated with the first energy with a density of 5 color dots overlapping per second.

[0055] The operator can increase the energy (intensity of energy) of the laser toning to 1.7 J / cm2 (second energy intensity) through the input device (240). The processor (260) can mark a specific color spot with a darker concentration corresponding to the degree to which the amount of energy transmitted increases. In this way, for an area among the treatment areas where the first energy is repeatedly irradiated to the same area, the processor (260) can display how much energy is continuously and repeatedly transmitted to the area by darkening the concentration of the specific color spot in the area according to the degree of repetition.

[0056] In one embodiment, the output terminal of the energy irradiator (210) may be provided to irradiate by contacting the skin. In this case, the area shape information may be set to correspond to the shape and size of the output terminal of the energy irradiator (210) in contact with the skin. The processor (260) may identify the treatment area to which the first energy has been irradiated based on the color and area shape information of the shape of the output terminal in contact with the skin from information acquired through the camera module (220). The processor (260) may output a processed image that displays the treatment area to which the first energy has been irradiated in the form of transmitted energy in color and concentration according to the spot size, wavelength, irradiation time, irradiation method, and energy intensity based on the area shape information and the area expression information.

[0057] According to one embodiment, the processor (260) can check the change in position and state of the treatment site of the subject based on the information acquired through the camera module (220). The processor (260) can display a processed image reflecting the change in position and state of the treatment site. For example, if the processor (260) determines that the face being treated is turned to the right based on the information acquired through the camera module (220), the processor (260) can display a processed image that clearly shows the face of the subject being treated turned to the right.

[0058] According to various embodiments, the processor (260) may identify the skin contact area of ​​the point beam or the energy irradiator (210) by using a software filter (or hardware filter) that can better identify the mark displayed on the energy irradiator (210). The software filter may be driven by an algorithm that can easily detect the skin contact area of ​​the point beam or the energy irradiator (210) from information acquired through, for example, a camera module (220). The hardware filter may be provided on a lens of the camera module (220) and may be photographed, for example.

[0059] In various embodiments, the processor (260) can identify the treatment area to which the first energy has been irradiated by recognizing a mark overlapping the output terminal of the point beam or energy irradiator (210) from information acquired through the camera module (220).

[0060] For example, when the first energy is irradiated in a rectangular shape of a 0.5 * 5 cm bar, and a 5 cm linear mark displayed on the output terminal of the energy irradiator (210) in contact with the skin is photographed, the processor (260) detects the area of ​​the mark from among the information acquired through the camera module (220) based on the visual characteristics of the mark, and can confirm the irradiated area (treatment area) of the first energy by applying an error between the detected area and the area where the first energy is actually irradiated based on the area shape information.

[0061] In this case, the area shape information can be set to correspond to the shape of the output terminal of the energy irradiator (210) in contact with the skin or the shape and size of a designated mark. The processor (260) can identify the treatment area to which the first energy has been irradiated based on the color and area shape information of the output terminal shape or the designated mark. The processor (260) can display the treatment area to which the first energy has been irradiated in the processed image in the form of transmitted energy with color and concentration according to the spot size, wavelength, irradiation time, irradiation method, and energy intensity based on the area shape information and the area expression information.

[0062] In the above-described embodiment, the processor (260) may not generate (or store) an image of the treatment site using the camera module (220), but instead may acquire text from the camera module (220) and analyze the acquired text based on artificial intelligence. For example, the processor (260) may identify visual characteristics of the treatment site by generating and analyzing big data about the treatment site based on the acquired text. In this case, when generating a processed image of the treatment site's face, the processor (260) may replace the treatment site's face with another facial shape (e.g., an avatar face) to generate the processed image. Accordingly, according to one embodiment, personal information such as the treatment site's face may be protected.

[0063] According to various embodiments, the processor (260) may display the treatment area by the first energy in a color according to the wavelength and irradiation method of the first energy. The processor (260) may display the color intensity of each treatment area darker according to the amount of first energy irradiated thereto (e.g., the sum of the first energy irradiation amounts).

[0064] According to various embodiments, the processor (260) may overlay in real time the information on the current first energy dose (irradiation time, irradiation method, and energy intensity) selected through the input device (240) from among the treatment areas displayed on the display (230) on the processed image or display it as text on another area outside the face in the processed image. In addition, the processor (260) may overlay the information on the cumulative first energy dose (irradiation time, irradiation method, and energy intensity) selected through the input device (240) from among the treatment areas displayed on the display (230) on the processed image or display it as text on another area outside the face in the processed image. To this end, the processor (260) may accumulate and store in the memory (250) the information on each treatment area and the first energy dose for each treatment area during a specific treatment period.

[0065] According to various embodiments, the processor (260) may generate a treatment image per session, which accumulates and represents the treatment areas corresponding to all irradiated areas of the first energy of a single treatment session, automatically or according to the manual setting of the input device (240) at the time when a single treatment session is completed. Thereafter, the processor (260) may compare the facial image of the subject taken before the treatment, the facial image taken to confirm the progress after the treatment, and the treatment image per session at the request of the practitioner (user). Based on the comparison result, the processor (260) may numerically display the treatment area missed in a single treatment session and the degree of treatment effect (e.g., pigmentation improvement rate %) through the display (230). According to one embodiment, the electronic device (200) may numerically display the treatment results of the subject by accumulating the treatment images per session several times over a specific treatment period, thereby enabling analysis of side effects of the overlapping treated area or low effectiveness of the missed treatment area.

[0066] According to various embodiments, when the first energy is ultrasound or high-frequency energy, the energy irradiator (210) may irradiate the first energy while in contact with the skin of the subject. In this case, the energy irradiator (210) does not separately irradiate a point beam, and the processor (260) may confirm the output end (tip area) of the energy irradiator (210) in contact with the skin of the subject through the camera module (220). The processor (260) may confirm (e.g., select) the treatment area based on detecting the area where the tip of the energy irradiator (210) touches the skin of the subject from the information acquired through the camera module (220). In this process, the processor (260) may distinguish and display the confirmed treatment area based on area shape information and area expression information.

[0067] According to various embodiments, the display (230) may be provided to display in three dimensions at least in one of a virtual reality screen, an augmented reality screen, or a three-dimensional hologram. In this case, the processor (260) may capture the face of the subject in real time through the camera module (220) and implement a virtual reality screen, an augmented reality screen, an augmented reality screen, or a three-dimensional hologram on the display (230). For example, the processor (260) may superimpose the virtual reality screen, the augmented reality screen, the augmented reality screen, or the three-dimensional hologram captured and implemented by the camera module (220) onto the face image of the subject to express the treatment area in a color according to the wavelength and irradiation method of the energy, and may display the color density in real time by making it darker or lighter according to the irradiation amount of the first energy delivered thereto (e.g., the sum of the irradiation amounts of the first energy). In this regard, to assist in additionally acquiring three-dimensional coordinate information through information acquired through the camera module (220), the processor (260) may utilize a circular or cross marker pre-marked on the blindfold, etc. For example, the processor (260) may obtain three-dimensional coordinates for the treatment area by calculating the degree to which the circular marker displayed on the blindfold is distorted or the left-right, up-down, or rotational degree of the cross marker.

[0068] The practitioner can distinguish between the areas irradiated with the first energy and areas not irradiated, or areas with insufficient treatment dose and areas with excessive treatment dose, by checking the color or density of the treatment area from a three-dimensionally displayed image using at least one of a virtual reality screen, an augmented reality screen, or a hologram, without having to turn his or her head to look at another display screen.

[0069] According to various embodiments, the electronic device (200) may be configured as a first device including some of the components (230, 240, 250, 260) of the electronic device (200) excluding the camera module (220) and an energy detector (210); and a second device including the remaining components (230, 240, 250, 260) of the electronic device (200) excluding the energy detector (210) and a camera module (220).

[0070] In various embodiments, the processor (260) may obtain the setting values ​​of the energy irradiator (210) displayed on the display of the first device (e.g., at least one of the type, medium, spot size, wavelength, pulse width, and energy intensity of the first energy) based on an image captured using the camera module (220). The processor (260) may identify a treatment area corresponding to the irradiation area of ​​the first energy based on the setting values ​​of the energy irradiator (210), and may display a processed image corresponding to the treatment area of ​​the subject on the display so that the treatment area is distinguished from other areas.

[0071] In various embodiments, when the first device and the second device are connected through a designated communication channel, the first device and the second device can transmit and receive data related to the set value of the first energy through the mutually designated communication channel.

[0072] In this way, the electronic device (200) according to one embodiment can help the practitioner intuitively check the treatment site and the energy delivered thereto based on detection of a point beam or output terminal having a specific color, shape, pattern, movement, or other change when using the first energy that does not significantly cause symptoms (e.g., redness) that can be visually confirmed immediately after being irradiated to the treatment site.

[0073] In addition, the electronic device (200) according to one embodiment can additionally irradiate a point beam to the first energy delivery site when the energy irradiator (210) does not irradiate a point beam, or can identify the treatment site to which the first energy is delivered based on the contact surface with the skin and visually display the treatment site, thereby supporting the precise treatment of the practitioner.

[0074] Furthermore, the electronic device (200) according to one embodiment can accumulate and image the treatment area for the treatment result of the patient (e.g., treatment image per session) and quantify the treatment effect, thereby assisting the practitioner to find a more necessary, suitable, and efficient treatment method for the patient.

[0075] Figure 4 shows an example of displaying an investigation area of ​​a first energy according to one embodiment.

[0076] Referring to FIG. 4, the energy irradiator (210) can irradiate energy of first and second intensities in circles of first and second sizes according to settings via the input device (240). In this case, the electronic device (200) can display the treatment area on the face of the patient (surgery recipient) as circles of the first and second sizes. In addition, the treatment area where the first energy is transmitted more can be displayed with a darker intensity.

[0077] Figure 5 shows a flowchart of a method for displaying a treatment site according to one embodiment.

[0078] Referring to FIG. 5, in operation 510, the electronic device (200) may irradiate first energy to a portion of the entire treatment area of ​​the subject for a predetermined period of time. The first energy may provide a designated therapeutic effect to the treatment skin. The first energy may be a laser having a designated wavelength.

[0079] In operation 520, the electronic device (200) may obtain information about a site to which the first energy has been irradiated through the camera module (220) by directing the camera module (220) toward the treatment site. For example, the electronic device (200) may obtain information about a location by irradiating a point beam to the same site as the first energy while the first energy is being irradiated and photographing the site to which the point beam has been irradiated. The point beam may be irradiated to the same site as at least a portion of the first energy so as to have a specified color, shape (e.g., circle), pattern (e.g., checkered pattern, blinking), movement, or other change. In this case, an area corresponding to a site to which the point beam has been irradiated in the information obtained through the camera module (220) may include, for example, information about visual features according to a specified color, shape, pattern, movement, or other change according to a wavelength of the point beam.

[0080] In operation 530, the electronic device (200) can identify the area where the first energy is irradiated among the entire treatment area based on the characteristics of the information acquired through the camera module (220). For example, the electronic device (200) can identify the area where the point beam is irradiated from information acquired based on at least one visual characteristic of the color, shape, pattern, movement, and other changes of the point beam, and can identify the area where the first energy is irradiated, i.e., the treatment area, based on the difference in the irradiation area between the first energy and the point beam according to the area shape information. In another example, when the energy irradiator (210) does not irradiate the point beam, the electronic device (200) can additionally irradiate the point beam to the first energy delivery area or identify the area where the first energy is irradiated based on the skin contact surface (or output terminal) of the energy irradiator (210) with respect to the treatment area of ​​the patient.

[0081] In operation 540, the electronic device (200) may display a processed image corresponding to at least the current treatment area of ​​the subject, such that the identified treatment area is distinguished from other areas. For example, the electronic device (200) may display the treatment area by adjusting the color and concentration of the treatment area based on the spot size, wavelength, irradiation time, irradiation method, and energy intensity of the first energy.

[0082] In this way, the electronic device (200) according to one embodiment can display a processed image that allows for intuitive confirmation of the treatment area and the energy delivered thereto based on detection of a colored point beam or output terminal when using a first energy that does not significantly cause visible symptoms (e.g., redness) immediately after being irradiated to the treatment area.

[0083] The various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the corresponding components from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0084] The term "module" as used herein may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or portion of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0085] Various embodiments of this document may be implemented as software (e.g., a program) including one or more commands stored in a storage medium (e.g., 250 of FIG. 3) (e.g., built-in memory or external memory) readable by a machine (e.g., an electronic device). For example, a processor (e.g., processor (260)) of a device (e.g., electronic device (200)) can call at least one command from among one or more commands stored from a storage medium and execute it. This enables the device to operate to perform at least one function according to the called at least one command. The one or more commands may include code generated by a compiler or code executable by an interpreter. A storage medium readable by the device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where data is stored temporarily in the storage medium.

[0086] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0087] Components according to various embodiments of this document may be implemented in the form of software or hardware such as a digital signal processor (DSP), a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC), and may perform certain roles. The term "components" is not limited to software or hardware, and each component may be configured to be on an addressable storage medium or configured to play one or more processors. As examples, components may include components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, properties, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.

[0088] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single or multiple entities. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; camera module; and A processor functionally connected to the display and the camera module, The above processor, Identify the treatment area corresponding to the irradiation site that is irradiated with the first energy determined by the energy irradiator, An electronic device that displays a processed image corresponding to the treatment area of ​​the subject on the display so that the treatment area is distinguished from other areas.

2. In claim 1, the processor, An electronic device that displays the treatment area in the processed image with a color that is distinct from the other areas, and adjusts the concentration of the color according to the amount of the first energy applied.

3. In claim 1, The above energy detector; and Further comprising an input device configured to adjust at least one of the spot size, wavelength, irradiation time, irradiation method, number of deliveries per second (Hz) and output energy intensity of the first energy according to the above-mentioned specified therapeutic effect, The above processor, An electronic device that irradiates the first energy corresponding to at least one setting input through the input device through the energy irradiator.

4. In claim 1, the processor, Check at least one setting related to the type of the first energy and the amount of transmission of the first energy, The above treatment area is displayed in a color corresponding to the type of the first energy, An electronic device that displays the treatment area on the processed image at a concentration corresponding to the amount of the first energy transmitted according to at least one setting.

5. In claim 1, the processor, An electronic device that identifies changes in visual characteristics of the treatment area based on visual characteristics of a point beam irradiated to the same area as the first energy.

6. In claim 5, the processor, Acquire previously stored area shape information, wherein the area shape information is related to the difference in the irradiation area between the first energy and the point beam and the image distortion by the camera module, An electronic device that identifies the irradiation area of ​​the point beam included in the acquired information based on the above-mentioned area shape information, and identifies the treatment area irradiated with the first energy based on the identified irradiation area.

7. In claim 1, the processor, Using the camera module, obtain the setting values ​​of the energy irradiator including at least one of the type, wavelength, irradiation time, irradiation method, and output energy intensity of the first energy, An electronic device that displays the treatment area in the processed image by distinguishing it from other areas based on the acquired setting value.

8. In claim 1, the processor, Using the above camera module, information about the output terminal of the energy irradiator that has come into contact with the treatment area of ​​the subject is obtained, From the information obtained above, the skin contact area of ​​the energy probe is confirmed, An electronic device that identifies the treatment area based on area shape information related to the difference between the skin contact area and the irradiation area of ​​the first energy.

9. In claim 1, the processed image is: An electronic device which is a two-dimensional or three-dimensional image of the face of a subject.

10. In claim 1, the processor, An electronic device that stores and records the change in position and accumulated state of the treatment area based on the information obtained above, and displays the processed image reflecting the change in position and accumulated state.

Images