Electronic device including mirror display, method and non-transitory computer-readable storage medium for skin care
The electronic device with a mirror display and integrated sensor and light source offers personalized phototherapy by analyzing facial features and delivering targeted light treatments, addressing the need for integrated skincare solutions.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-10-16
- Publication Date
- 2026-06-18
AI Technical Summary
Existing skincare technologies lack an integrated solution that combines mirror functionality with personalized phototherapy and skin analysis for effective skin care.
An electronic device with a mirror display that includes a half-mirror and a display, equipped with a sensor and light source, performs skin analysis and delivers targeted phototherapy by identifying facial features and irradiating specific wavelengths of light based on user settings or default protocols.
The device provides personalized phototherapy by analyzing facial features and delivering targeted light treatments, enhancing skin care efficacy and user experience.
Smart Images

Figure KR2025016379_18062026_PF_FP_ABST
Abstract
Description
Electronic device including a mirror display for skin care, method, and non-transient computer-readable storage medium
[0001] The following descriptions relate to an electronic device including a mirror display for skin care, a method, and a non-transient computer-readable storage medium.
[0002] The electronic device may include a mirror display. A mirror having a certain ratio of transmittance and reflectance may be placed in front of the display of the mirror display. Accordingly, the mirror display performs the function of a mirror that reflects external light through the mirror, while simultaneously displaying content through the display.
[0003] An electronic device is disclosed. The electronic device may include at least one processor comprising a light source, a sensor, and a processing circuit, and a memory comprising one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to acquire an image of a user's face using the sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify parts of the face based on the image. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to control the light source to irradiate at least one of the parts of the face with light of a specified wavelength according to phototherapy. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause visible light of a different wavelength distinct from the wavelength specified according to the phototherapy to be irradiated onto at least one part of the face.
[0004] A method is disclosed. The method may be performed by an electronic device comprising a light source and a sensor. The method may include the operation of acquiring an image of a user's face using the sensor. The method may include the operation of identifying parts of the face based on the image. The method may include the operation of controlling the light source to: irradiate light of a wavelength designated according to phototherapy onto at least one part of the face. The method may include the operation of irradiating visible light of a different wavelength, distinct from the wavelength designated according to phototherapy, onto at least one part of the face.
[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor of an electronic device comprising a light source and a sensor, the electronic device may cause the electronic device to acquire an image of a user's face using the sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify parts of the face based on the image. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to control the light source to irradiate at least one of the parts of the face with light of a specified wavelength according to phototherapy. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause visible light of a different wavelength distinct from the wavelength specified according to the phototherapy to be irradiated onto at least one part of the face.
[0006] FIG. 1 is a block diagram of an electronic device according to one embodiment.
[0007] FIG. 2a is a perspective view of an electronic device according to one embodiment.
[0008] FIG. 2b is a front view of an electronic device according to one embodiment.
[0009] FIG. 3a is a diagram illustrating the operation of an electronic device irradiating light through a light source to scan a user's face according to one embodiment.
[0010] FIG. 3b is a diagram illustrating the operation of an electronic device receiving reflected light through a sensor to scan a user's face according to one embodiment.
[0011] FIG. 4a is a diagram illustrating the operation of an electronic device identifying a mask for irradiating light onto a user's face according to one embodiment.
[0012] FIG. 4b is a diagram illustrating the operation of an electronic device identifying a mask for irradiating light onto a user's face according to one embodiment.
[0013] FIG. 5 is a diagram illustrating the operation of an electronic device irradiating light onto a user's face according to one embodiment.
[0014] FIG. 6a is a diagram illustrating an operation in which an electronic device provides a guide to a user according to one embodiment.
[0015] FIG. 6b is a diagram illustrating an operation in which an electronic device provides a user with a guide to the initiation of optical therapy according to one embodiment.
[0016] FIG. 6c is a diagram illustrating an operation in which an electronic device provides a user with a guide to the results of optical therapy according to one embodiment.
[0017] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0018] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0019] FIG. 1 is a block diagram of an electronic device according to one embodiment. FIG. 2a is a perspective view of an electronic device according to one embodiment. FIG. 2b is a front view of an electronic device according to one embodiment.
[0020] Referring to FIG. 1, the electronic device (101) may include a mirror display (110), a processor (140), a sensor (120), a light source (130), and a memory (150).
[0021] In one embodiment, the electronic device (101) may have a form such as a stand-type mirror or a wall-mounted mirror. In one embodiment, the mirror display (110) within the electronic device (101) may perform the functions of a mirror and a display.
[0022] In one embodiment, referring to FIG. 2a, a half mirror (220) may be placed on the front side (e.g., the side facing the user (201)) of the mirror display (110). In one embodiment, a display (210) may be placed on the rear side of the mirror display (110). In one embodiment, the mirror display (110) may perform a mirror function through the half mirror (220) while simultaneously displaying content through the display (210).
[0023] In one embodiment, the half mirror (220) may be a mirror having a certain ratio of transmittance and reflectance. For example, the half mirror (220) may have 65% reflectance and 35% transmittance, or 75% reflectance and 25% transmittance. Here, reflectivity may refer to the reflectance of light incident on the half mirror (220). Here, reflectivity may have an inverse relationship with the transmission rate.
[0024] In one embodiment, the display (210) may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or a plurality of light emitting diodes (LEDs). The LEDs of the display (210) may include organic LEDs (OLEDs), but are not limited thereto. The display (210) may include electronic paper. For example, if the display (210) has a flat shape, the display (210) may be referred to as a flat panel display (FPD). For example, if the display (210) has a curved shape, the display (210) may be referred to as a curved display. For example, if the display (210) has a deformable shape, the display (210) may be referred to as a bendable display, a flexible display, and / or a rollable display.
[0025] For example, referring to FIGS. 2a and FIGS. 2b, a user (201) can see their own mirror image (230) reflected in the half mirror (220) in front of the electronic device (101) by the visible light reflected by the half mirror (220). For example, a display (210) can display a screen. The screen displayed on the display (210) can be seen by the user (201) by passing through the half mirror (220).
[0026] In one embodiment, the sensor (120) may include one or more light sensors (e.g., a CCD (charged coupled device) sensor, a CMOS (complementary metal oxide semiconductor) sensor) that generate an electrical signal indicating the color and / or brightness of light. A plurality of light sensors within the sensor (120) may be arranged in the form of a two-dimensional grid (2 dimensional array). The sensor (120) may acquire the electrical signals of each of the plurality of light sensors substantially simultaneously to generate an image comprising a plurality of pixels arranged in two dimensions corresponding to the light reaching the light sensors of the two-dimensional grid. For example, photo data captured using the sensor (120) may refer to an image acquired from the sensor (120). For example, video data captured using the sensor (120) may refer to a sequence of a plurality of images acquired from the sensor (120) at a specified frame rate. In one embodiment, the sensor (120) may be referred to as a camera module.
[0027] In one embodiment, the sensor (120) may be positioned facing the front of the electronic device (101) (e.g., the side facing the user (201)) to receive light reflected from the user (201). For example, referring to FIGS. 2a and 2b, the sensor (120) may be positioned on the top of the electronic device (101).
[0028] According to an embodiment, the sensor (120) may be included as part of a micro-electromechanical systems (MEMS) scanner (or micro scanner). For example, the sensor (120) may be a sensor of the MEMS scanner, and the light source (130) may be a light source of the MEMS scanner. For example, the light source of the MEMS scanner may emit a light detection and ranging (LiDAR) and / or a laser used to identify objects, but is not limited thereto. For example, the MEMS scanner may include a light source for emitting a light detection and ranging (LiDAR) and / or a laser used to identify objects distinct from the light source (130).
[0029] According to one embodiment, a light source (130) of an electronic device (101) may include a plurality of hardware components assembled to emit light representing pixels arranged in two dimensions. For example, the light source (130) may include a combination of cathode-ray tubes (CRTs) for emitting light of each of the three primary colors in a color space and lenses for magnifying the light emitted from the CRTs. For example, the light source (130) may include a light source (e.g., a lamp) for emitting light, optical filters for dividing the light into light paths corresponding to each of the three primary colors, LCD panels placed in each of the light paths, and a combination of prisms and / or lenses for synthesizing the light output from the LCD panels. For example, the light source (130) may include a combination of a light source for emitting light, an optical filter for selecting one of three primary colors from the light, a digital mirror device (DMD) for controlling reflection of the primary color filtered by the optical filter, and a lens for magnifying the light reflected by the DMD. In the context of requiring the projection of light for display on a screen, at least one of the combinations exemplified above may be referred to as the light source (130). In one embodiment, the light source (130) may be referred to as a beam projector or a projection assembly.
[0030] In one embodiment, the light source (130) may irradiate light of a wavelength used to promote the activation of skin cells and to improve skin conditions and / or provide skin beauty effects. For example, blue light (light with a wavelength of 405 to 415 nm) may be used for sensitive skin or oily skin. In particular, blue light may be used to inhibit the proliferation of acne-causing bacteria (e.g., P. acnes). Additionally, green light (light with a wavelength of 416 to 525 nm) may be used to improve skin tone and wrinkles. In particular, green light may be used for skin soothing effects by removing skin toxins. Additionally, yellow light (light with a wavelength of 526 to 590 nm) may be used to inhibit melanin production and improve blemishes / freckles. In particular, yellow light may be used to treat facial flushing by improving lymphatic and blood circulation. In addition, red light (light with a wavelength of 630 to 660 nm) is light that penetrates to the dermal tissue of the skin and can be used for skin elasticity and regeneration by promoting the production of elastin and collagen. In addition, near-infrared (IR) light (light with a wavelength of 800 to 900 nm) can be irradiated deep up to 4 mm into the skin and can be used to prevent skin pigmentation and promote skin regeneration.
[0031] In one embodiment, the light source (130) may be positioned to face the front of the electronic device (101) (e.g., the side facing the user (201)) so as to irradiate light to the user (201). For example, referring to FIGS. 2a and 2b, the light source (130) may be positioned on the top of the electronic device (101). For example, the light source (130) may be positioned parallel to the sensor (120), but is not limited thereto. The sensor (120) and the light source (130) may be positioned on the edge portion along the periphery of the mirror display (110). For example, the sensor (120) and the light source (130) may be positioned on the left side of the electronic device (101) so as to face the right side of the user's (201) face. For example, the sensor (120) and the light source (130) may be positioned on the right side of the electronic device (101) so as to face the left side of the user (201). For example, the sensor (120) and the light source (130) may be positioned at multiple locations on the electronic device (101) so as to face the top side, the right side, and / or the left side of the user (201)'s face.
[0032] In one embodiment, the processor (140) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The number of processors (140) may be one or more. For example, the processor (140) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.
[0033] In one embodiment, the memory (150) of the electronic device (101) may include a hardware component for storing data and / or instructions that are input and / or output to the processor (140). The memory (150) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). In one embodiment, the volatile memory may include at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). In one embodiment, the non-volatile memory may include at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, solid state drive (SSD), and embedded multi-media card (eMMC).
[0034] According to one embodiment, within the memory (150) of the electronic device (101), one or more instructions (or commands) representing operations and / or operations to be performed on data by the processor (140) may be stored. A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the electronic device (101), and / or the processor (140) may perform at least one of the operations of FIGS. 7 and FIGS. 8 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or application is executed. In the following, the statement that an application is installed on an electronic device (101) means that one or more instructions provided in the form of an application are stored in the memory (150) of the electronic device (101), and that the one or more applications are stored in an executable format (e.g., a file having an extension specified by the operating system of the electronic device (101)) that is executable by the processor (140) of the electronic device (101).
[0035] FIG. 3a is a diagram illustrating the operation of an electronic device irradiating light through a light source to scan a user's face according to one embodiment. FIG. 3b is a diagram illustrating the operation of an electronic device receiving reflected light through a sensor to scan a user's face according to one embodiment.
[0036] FIGS. 3a and FIGS. 3b may be described with reference to the components of the electronic device (101) described with reference to FIGS. 1 to 2b.
[0037] In the following, the operations described with reference to FIGS. 3a and FIGS. 3b can be performed by the electronic device (101) when the processor (140) executes instructions stored in memory (150).
[0038] In one embodiment, the processor (140) may irradiate light using a light source (130). For example, referring to FIG. 3a, the processor (140) may irradiate light (311, 312, 313, 314, 315) through the light source (130) to be used to identify an external object (e.g., user (201)) located outside the electronic device (101) (or located in front of the electronic device (101)). For example, the light source (130) may be light (311, 312, 313, 314, 315) used to identify the distance from the user (201). For example, the light (311, 312, 313, 314, 315) may be light within the visible light spectrum, but is not limited thereto. For example, light (311, 312, 313, 314, 315) may be light outside the visible light spectrum (e.g., infrared).
[0039] In one embodiment, the processor (140) may receive light (321, 322, 323, 324, 325) using the sensor (120). For example, the light (321, 322, 323, 324, 325) may be reflected light from the user (201) of the light (311, 312, 313, 314, 315) irradiated from the light source (130). However, it is not limited thereto. For example, the light (321, 322, 323, 324, 325) from the user (201) may be reflected light of the light irradiated from an external light source. For example, the light (321, 322, 323, 324, 325) may be light within the visible light spectrum. However, it is not limited thereto. For example, light (321, 322, 323, 324, 325) may be light outside the visible light spectrum (e.g., infrared).
[0040] In one embodiment, the processor (140) can generate an image based on light (321, 322, 323, 324, 325) received using the sensor (120). For example, the image may be an RGB (red, green, blue) image containing color information. For example, the image may be a depth image. For example, the processor (140) can generate a depth image based on the time of flight (ToF) between light (311, 312, 313, 314, 315) irradiated from the light source (130) and reflected light (i.e., light (321, 322, 323, 324, 325)).
[0041] In one embodiment, the processor (140) can identify a user (201) located in space using an image (e.g., an RGB image) obtained using the sensor (120). In one embodiment, the processor (140) can identify body parts (e.g., face, and / or various parts within the face) of the user (201) using an image (e.g., an RGB image) obtained using the sensor (120). For example, the processor (140) can identify the eyes, nose, mouth, chin, ears, and facial contours of the user (201) using an image (e.g., an RGB image) obtained using the sensor (120). For example, the processor (140) can classify objects (or body parts) within the image (e.g., an RGB image) using an image processing algorithm (e.g., image segmentation). For example, the processor (140) can classify objects (or body parts) in an image (e.g., RGB image) based on a feature map of the image (e.g., RGB image) or landmarks in the image (e.g., RGB image).
[0042] In one embodiment, the processor (140) can detect a plurality of feature points in an image (e.g., RGB image) obtained using the sensor (120) and identify the location and size of the eyes, nose, mouth, and / or chin using the detected plurality of feature points. In one embodiment, the processor (140) can identify at least one of the location of wrinkles, the width of the space between the eyebrows, the location and size of the forehead, the facial contour, the size of the face, the location of hair, or the location and size of a scar using the plurality of feature points detected in an image (e.g., RGB image) obtained using the sensor (120).
[0043] In one embodiment, the processor (140) may obtain skin information related to the body part of the user (201) based on identifying the body part of the user (201). For example, the skin information may indicate the degree of skin elasticity, skin tone, wrinkle condition, degree of dryness, presence of acne, presence of blemishes / freckles, and / or degree of skin redness. For example, the processor (140) may identify a portion having a pixel value greater than a threshold value (e.g., a pixel value for red color) among a plurality of pixels representing the face area of the user (201) as the portion where acne is located. For example, the processor (140) may obtain information about blemishes or pigmentation present on a part of the user's body using an independent component analysis (ICA) algorithm. For example, the processor (140) may obtain information about wrinkles present in the face area of the user (201) by applying a Gabor filter to the acquired image. For example, the processor (140) can obtain information about pores present in the face area of the user (201) by applying a median filter to the acquired image. However, it is not limited thereto. For example, the processor (140) can obtain skin information related to the body parts of the user (201) by analyzing the energy of a specific wavelength absorbed and the energy of another specific wavelength emitted by specific molecules contained in human skin tissue (e.g., water and / or fluorescent porphyrins).
[0044] FIG. 4a is a diagram illustrating an operation in which an electronic device identifies a mask for irradiating light onto a user's face according to one embodiment. FIG. 4b is a diagram illustrating an operation in which an electronic device identifies a mask for irradiating light onto a user's face according to one embodiment.
[0045] FIGS. 4a and FIGS. 4b can be described with reference to the components of the electronic device (101) described with reference to FIGS. 1 to 3b.
[0046] In the following, the operations described with reference to FIGS. 4a and FIGS. 4b can be performed by the electronic device (101) when the processor (140) executes instructions stored in memory (150).
[0047] In one embodiment, the processor (140) can identify a body part of the user (201) to project light through the light source (130) based on an image (e.g., an RGB image).
[0048] In one embodiment, the processor (140) can identify the body parts of the user (201) to which light from the light source (130) is to be projected based on the user settings, if user settings exist. Here, the user settings may be settings that specify light (e.g., blue light, green light, yellow light, red light, or infrared light) for zones (e.g., T zone (e.g., forehead and nose), U zone (e.g., both cheeks and chin)). For example, the user settings may be settings that specify the irradiation time and / or intensity of the light.
[0049] In one embodiment, the processor (140) can identify the body parts of the user (201) to which light from the light source (130) is to be projected based on a default setting, if no user setting exists. Here, the default setting may be a setting for irradiating green light (light with a wavelength of 416 to 525 nm) to the T zone (e.g., forehead and nose) and blue light (light with a wavelength of 405 to 415 nm) to the U zone (e.g., both cheeks and chin). However, it is not limited thereto. For example, the default setting may be a setting for irradiating light specified according to the necessary phototherapy based on skin information related to the body parts of the user (201).
[0050] In one embodiment, the processor (140) may generate a mask representing a light pattern to be irradiated onto the face of the user (201). In one embodiment, referring to FIG. 4a, the processor (140) may generate a mask (401) representing a light pattern to be irradiated based on parts of the face of the user (201) identified through an image (e.g., eyes (411, 413), nose (415), mouth (417)). For example, the processor (140) may generate a mask (401) that matches light to be irradiated onto each of the parts (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)). For example, the processor (140) may set areas (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) spaced apart by a specified distance from an area requiring protection (e.g., eyes (411, 413)). For example, the processor (140) may identify an eye area including the eyes (411, 413) among the areas of the face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) based on an image acquired through the sensor (120). For example, the processor (140) may set a light pattern to be irradiated on each of the areas (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) spaced apart by a specified distance from the boundary of the eye area. For example, the specified distance may correspond to a specified movement speed of the face (e.g., speed of moving the face left-right, speed of moving the face up-down). For example, the specified distance may correspond to the value obtained by multiplying the specified movement speed of the face and the computation time required by the processor (140) to update the mask (401).
[0051] In one embodiment, the processor (140) may generate a mask (401) that subdivides parts of the face (e.g., eyes (411, 413), nose (415), mouth (417)). However, it is not limited thereto. For example, referring to FIG. 4b, the processor (140) may generate a zone-unit mask (405) that integrates parts of the face (e.g., eyes (411, 413), nose (415), mouth (417)). In one embodiment, a mask (405) may be generated that matches light to be irradiated to each of the zones (e.g., T zone (431), U zone (433)).
[0052] In one embodiment, the processor (140) may determine the areas (or at least one zone) to be irradiated with light among the areas of the user's (201) face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) (or zones (431, 433)). For example, the processor (140) may determine the areas to be irradiated with light based on skin information. For example, the processor (140) may determine the areas to be irradiated with light as the areas where the degree of skin elasticity (or degree of dryness, degree of skin redness) is less than the reference elasticity (or reference dryness, reference skin redness). For example, the processor (140) may determine the areas to be irradiated with light as the areas where the skin tone has changed from the previously measured skin tone of the user (201). For example, the processor (140) may determine an area where the density and / or number of wrinkles (or, acne, blemishes / freckles) have increased as an area to be irradiated with light. For example, the processor (140) may determine an area where the degree of skin elasticity is below a standard elasticity as an area to be irradiated with light.
[0053] In one embodiment, the processor (140) may determine which parts of the user (201)’s face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) to irradiate light based on the history of light therapy performed. For example, the parts of the areas where previous light therapy was performed that have passed a rest period may be determined as the parts to irradiate light. For example, the rest period may be determined based on the wavelength, intensity, and / or irradiation time of the light irradiated according to the previous light therapy.
[0054] In one embodiment, the processor (140) can determine the intensity of light to be irradiated onto parts of the user (201)'s face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)). For example, the processor (140) can determine the intensity of light to be irradiated onto parts of the face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) based on the distance between the user (201)'s face and the light source (130) identified through an image. For example, the processor (140) can identify the distance between at least one part of the face and the light source (130) based on a depth image. For example, the processor (140) can determine the intensity of light such that the intensity of light irradiated through the light source (130) is proportional to the square of the distance.
[0055] According to an embodiment, the processor (140) may display parts of the face of the user (201) identified through an image (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) (or zones (431, 433)) through the mirror display (110). For example, the processor (140) may display parts of the face of the user (201) identified through an area where the mirror image (230) of the user (201) is located (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) (or zones (431, 433)). In one embodiment, the processor (140) may receive user input selecting at least one of the areas of the face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) (or zones (431, 433)). In one embodiment, the user input may include touch input to the mirror display (110) and / or voice input from the user. In one embodiment, the processor (140) may determine the at least one area selected by the user input as the area to be irradiated with light.
[0056] According to an embodiment, the processor (140) can identify a user. For example, the processor (140) can recognize a user based on the fact that a face identified in an image corresponds to an image of a user registered in the memory (150) of the electronic device (101). In one embodiment, the processor (140) can select at least one of the parts of the face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) (or zones (431, 433)) based on a light therapy corresponding to the identified user. In one embodiment, the light therapy corresponding to the identified user may be a light therapy (e.g., a light therapy using blue light for the U zone (433)) that follows a light therapy previously performed on the user (e.g., a light therapy using blue light for the T zone (431)). In one embodiment, the phototherapy corresponding to the identified user may be previously performed phototherapy.
[0057] FIG. 5 is a diagram illustrating the operation of an electronic device irradiating light onto a user's face according to one embodiment.
[0058] FIG. 5 can be described with reference to the components of the electronic device (101) described with reference to FIGS. 1 to 4b.
[0059] In the following, the operations described with reference to FIG. 5 can be performed by the electronic device (101) when the processor (140) executes instructions stored in memory (150).
[0060] In one embodiment, the processor (140) can irradiate light (501) toward the face of the user (201) through a light source (130). In one embodiment, the processor (140) can control the light source (130) to irradiate light (501) toward the face of the user (201). For example, the processor (140) can irradiate light (501) toward the face of the user (201) based on a mask (e.g., mask (405) in FIG. 4b). For example, the processor (140) can irradiate light (501) toward the T zone (510) and the U zone (520).
[0061] In one embodiment, the processor (140) may control the light source (130) to irradiate light of a specified wavelength according to phototherapy to at least one of the parts of the face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)). For example, the specified wavelength may be a wavelength for blue light (e.g., 405 to 415 nm), a wavelength for green light (e.g., 416 to 525 nm), a wavelength for yellow light (e.g., 526 to 590 nm), and / or a wavelength for red light (e.g., 630 to 660 nm). However, it is not limited thereto. The specified wavelength may be a wavelength outside the visible spectrum (e.g., 800 to 900 nm).
[0062] In one embodiment, the processor (140) may control the light source (130) to irradiate light of a wavelength within the visible spectrum specified according to phototherapy to a first area (e.g., T zone (510)). In one embodiment, the processor (140) may control the light source (130) to irradiate light of a wavelength outside the visible spectrum specified according to phototherapy to a second area (e.g., U zone (520)). For example, the first area and the second area may be different areas. However, they are not limited thereto. For example, the first area and the second area may be the same area.
[0063] In one embodiment, the processor (140) can control the light source (130) to irradiate light of a specified wavelength according to phototherapy to at least one area located at a specified distance from the boundary of the eye area (e.g., 411, 413 in FIG. 4a and 4b). In one embodiment, the specified distance may correspond to a specified speed of movement of the face (e.g., speed of moving the face left-right, speed of moving the face up-down). For example, the specified distance may correspond to the value obtained by multiplying the specified speed of movement of the face and the computation time required by the processor (140) to update the at least one area to be irradiated with light.
[0064] In one embodiment, the processor (140) may control the light source (130) to irradiate visible light onto at least one part of the face to guide that phototherapy is being performed. For example, the processor (140) may control the light source (130) to irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) that is distinct from the wavelength specified for phototherapy onto at least one part of the face.
[0065] In one embodiment, the processor (140) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) onto the boundary surface of at least one area where light of a specified wavelength according to phototherapy is irradiated. In one embodiment, the processor (140) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) onto the entire area where light of a specified wavelength according to phototherapy is irradiated.
[0066] In one embodiment, the processor (140) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) only to some of the multiple areas where light of a specified wavelength according to phototherapy is irradiated. For example, the processor (140) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) only to some of the areas where light of a wavelength outside the visible spectrum is irradiated. For example, when the processor (140) irradiates light of a wavelength within the visible spectrum to a first area (e.g., T zone (510)) and light of a wavelength outside the visible spectrum to a second area (e.g., U zone (520)), it may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of a wavelength of 500 nm) to the second area (e.g., U zone (520)) among the first area (e.g., T zone (510)) and the second area (e.g., U zone (520)).
[0067] As described above, while the electronic device (101) performs phototherapy, by irradiating visible light to at least one area of the face to guide that phototherapy is being performed, the user (201) can recognize that phototherapy is being performed. Accordingly, as the user (201) is guided that phototherapy is being performed, the user (201) can decide whether to perform additional skin care on the area where phototherapy was performed after the phototherapy.
[0068] FIG. 6a is a diagram illustrating an operation in which an electronic device provides a guide to a user according to one embodiment.
[0069] FIG. 6a can be described with reference to the components of the electronic device (101) described with reference to FIGS. 1 through 5.
[0070] In the following, the operations described with reference to FIG. 6a can be performed by the electronic device (101) when the processor (140) executes instructions stored in memory (150).
[0071] The operations illustrated in FIG. 6a may be performed prior to the operation of scanning the face of the user (201) described with reference to FIG. 3a and FIG. 3b. The operations illustrated in FIG. 6a may be performed substantially simultaneously with the operation of scanning the face of the user (201) described with reference to FIG. 3a and FIG. 3b.
[0072] In one embodiment, the processor (140) can provide guidance to the user (201) through the mirror display (110).
[0073] In one embodiment, the processor (140) can identify the user (201) through the sensor (120). In one embodiment, the processor (140) can identify that the user (201) is located in front of the mirror display (110) based on the identification of an object corresponding to a person in an image acquired through the sensor (120).
[0074] In one embodiment, the processor (140) can identify the posture of the user (201) based on identifying that the user (201) is positioned in front of the mirror display (110). For example, the processor (140) can identify whether the posture of an object corresponding to a person in an image acquired through the sensor (120) is facing the front of the mirror display (110).
[0075] For example, the processor (140) may display a visual object (620) that guides the direction in which the user (201)'s face should face, based on identifying that the user (201) is located in front of the mirror display (110). For example, the processor (140) may display a visual object (620) that guides the direction in which the user (201)'s face should face, based on the fact that the posture of the object corresponding to a person in the image acquired through the sensor (120) is facing a direction other than the front of the mirror display (110).
[0076] For example, after displaying the visual object (620), the processor (140) can acquire additional images of the user (201) using the sensor (120). In one embodiment, the processor (140) can determine whether the user (201) (or the face of the user (201)) assumes a posture guided by the visual object (620) based on the additional images of the user (201). For example, the processor (140) can determine whether the user (201) (or the face of the user (201)) faces the front of the mirror display (110) based on the additional images of the user (201).
[0077] In one embodiment, the processor (140) may acquire an image of the user (201) (or the face of the user (201)) based on determining that the user (201) (or the face of the user (201)) has assumed a posture guided by the visual object (620). For example, the processor (140) may scan the face of the user (201) based on determining that the user (201) (or the face of the user (201)) has assumed a posture guided by the visual object (620).
[0078] For example, the processor (140) may display a visual object (610) indicating an area where the user (201)'s face should be located, based on identifying that the user (201) is looking at the mirror display (110). For example, the processor (140) may display a visual object (610) indicating an area where the user (201)'s face should be located, based on determining that the user (201)'s face is being scanned.
[0079] For example, the processor (140) can identify that the distance between the user (201) identified through the sensor (120) and the mirror display (110) is outside a specified distance range. For example, in response to identifying that the distance between the user (201) and the mirror display (110) is outside a specified distance range, the processor (140) can display a visual object (610) indicating the area where the user's (201) face should be located.
[0080] For example, the processor (140) can set the size of the visual object (610) to be smaller than the mirror image (230) of the user (201) when the distance between the user (201) and the mirror display (110) is shorter than the lower limit of the specified distance range. For example, the processor (140) can set the size of the visual object (610) to correspond to the size of the mirror image (230) when the user (201) is located within the specified distance range when the distance between the user (201) and the mirror display (110) is shorter than the lower limit of the specified distance range.
[0081] For example, the processor (140) can set the size of the visual object (610) to be larger than the mirror image (230) of the user (201) when the distance between the user (201) and the mirror display (110) is longer than the upper limit of the specified distance range. For example, the processor (140) can set the size of the visual object (610) to correspond to the size of the mirror image (230) when the user (201) is located within the specified distance range when the distance between the user (201) and the mirror display (110) is longer than the upper limit of the specified distance range.
[0082] FIG. 6b is a diagram illustrating an operation in which an electronic device provides a user with a guide to the initiation of optical therapy according to one embodiment.
[0083] FIG. 6b can be described with reference to the components of the electronic device (101) described with reference to FIGS. 1 through 5.
[0084] In the following, the operations described with reference to FIG. 6b can be performed by the electronic device (101) when the processor (140) executes instructions stored in memory (150).
[0085] The operations illustrated in FIG. 6b may be performed after the operation of scanning the face of the user (201) described with reference to FIG. 3a and FIG. 3b. The operations illustrated in FIG. 6b may be performed substantially simultaneously with the operation of determining a mask for phototherapy on the face of the user (201) described with reference to FIG. 4a and FIG. 4b. The operations illustrated in FIG. 6c may be performed substantially simultaneously with the operation of performing phototherapy on the face of the user (201) described with reference to FIG. 5.
[0086] In one embodiment, the processor (140) may display a user interface (UI) (630) that guides the initiation of light therapy. For example, the processor (140) may display a user interface (630) that guides the initiation of light therapy in response to identifying at least one area of the user (201)’s face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)) (or zones (431, 433)) to be irradiated with light according to light therapy. However, it is not limited thereto. For example, the UI (630) may include a guide for at least one area to which light of a specified wavelength is irradiated. For example, the UI (630) may include information about light of a specified wavelength irradiated to at least one area. For example, the information about the light may include the wavelength of the light and / or effects. For example, UI (630) may include information about the duration of light therapy.
[0087] In one embodiment, the processor (140) may display another UI that guides that light of a specified wavelength is irradiated to at least one site while light of a specified wavelength is irradiated to at least one site according to phototherapy. In one embodiment, the other UI may include a guide for at least one site where light of a specified wavelength is irradiated. In one embodiment, the other UI may include information about the light of a specified wavelength irradiated to at least one site. For example, the information about the light may include the wavelength of the light and / or effects. In one embodiment, the other UI may include information about the duration of the phototherapy and / or the remaining time.
[0088] FIG. 6c is a diagram illustrating an operation in which an electronic device provides a user with a guide to the results of optical therapy according to one embodiment.
[0089] FIG. 6c can be described with reference to the components of the electronic device (101) described with reference to FIGS. 1 through 5.
[0090] In the following, the operations described with reference to FIG. 6c can be performed by the electronic device (101) when the processor (140) executes instructions stored in memory (150).
[0091] The operations illustrated in FIG. 6c may be performed after the operation of scanning the face of the user (201) described with reference to FIG. 3a and FIG. 3b. The operations illustrated in FIG. 6c may be performed after the operation of determining a mask for phototherapy on the face of the user (201) described with reference to FIG. 4a and FIG. 4b. The operations illustrated in FIG. 6b may be performed after the operation of performing phototherapy on the face of the user (201) described with reference to FIG. 5.
[0092] In one embodiment, the processor (140) may display UIs (640, 650) indicating the state of the user (201) that has changed according to the light therapy after the light therapy is completed.
[0093] In one embodiment, the processor (140) may rescan the face of the user (201) after completing light therapy. For example, the processor (140) may irradiate light using a light source (130). For example, light may be received using a sensor (120). For example, the processor (140) may generate an image based on the light received using the sensor (120). For example, the processor (140) may obtain skin information related to the body parts of the user (201) based on the image. For example, the skin information may indicate the degree of skin elasticity, skin tone, wrinkle condition, degree of dryness, presence of acne, presence of blemishes / freckles, and / or degree of skin redness.
[0094] In one embodiment, the processor (140) can compare first skin information obtained during a scanning process performed before performing phototherapy and second skin information obtained during a scanning process performed after performing phototherapy. For example, the processor (140) can identify the condition of the user (201) that has changed according to phototherapy after completing phototherapy based on the comparison of the first skin information and the second skin information. For example, the changed condition of the user (201) may indicate a change in the degree of change in the area where acne is located, or a change in the degree of improvement in skin troubles or pigmentation.
[0095] In one embodiment, the processor (140) may display a visual object indicating the degree of improvement in the skin condition through the UI (650). In one embodiment, the processor (140) may display a visual object indicating the changed state of the user (201) through the UI (650). However, it is not limited thereto. For example, the processor (140) may provide guidance on the date of the next light therapy through the UI (650).
[0096] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0097] FIG. 7 can be explained with reference to FIGS. 1 to 6c.
[0098] In the following, the operations of FIG. 7 can be performed by the electronic device (101) when the processor (140) executes instructions stored in memory (150).
[0099] Referring to FIG. 7, in operation 710, the electronic device (101) can acquire an image of a face (e.g., the face of a user (201)) using a sensor (120).
[0100] In one embodiment, the electronic device (101) may irradiate light using a light source (130). For example, the electronic device (101) may irradiate light through the light source (130) to be used to identify an external object (e.g., user (201)) located outside the electronic device (101) (or located in front of the electronic device (101)). In one embodiment, the electronic device (101) may receive reflected light of the light irradiated from the light source (130) using a sensor (120). In one embodiment, the electronic device (101) may generate an image based on the light received using the sensor (120). For example, the image may be an RGB (red, green, blue) image containing color information. For example, the image may be a depth image.
[0101] In operation 720, the electronic device (101) can identify areas to be irradiated with light based on an image. In one embodiment, the electronic device (101) can identify a user (201) located in front of the electronic device (101) (or mirror display (110)) using an image (e.g., RGB image) obtained using a sensor (120). In one embodiment, the electronic device (101) can identify various parts within the face of the user (201) (e.g., eyes, nose, mouth, chin, ears, and facial contours) using an image.
[0102] In one embodiment, the electronic device (101) can identify at least one area among various parts of the user's (201) face to project light from the light source (130). For example, at least one area may be an area set by user settings (e.g., T-zone (e.g., forehead and nose), U-zone (e.g., both cheeks and chin)). For example, at least one area may be at least one area selected by user settings. For example, at least one area may be at least one area selected by default settings. For example, the default settings may be settings for irradiating light specified according to the necessary phototherapy based on skin information related to the user's (201) body parts.
[0103] In operation 730, the electronic device (101) can irradiate light onto identified areas. In one embodiment, the electronic device (101) can irradiate light toward the face of the user (201) through a light source (130). In one embodiment, the electronic device (101) can irradiate light toward the face of the user (201) by controlling the light source (130) based on a mask (e.g., mask (405) in FIG. 4b). In one embodiment, the mask may indicate the area where the electronic device (101) will irradiate light onto the face of the user (201) using the light source (130), the intensity of the light to be irradiated, and / or the wavelength of the light to be irradiated.
[0104] In one embodiment, the electronic device (101) may control a light source (130) to irradiate light of a specified wavelength according to phototherapy to at least one of the parts of the face (e.g., forehead, nose, chin, and / or cheeks). For example, the specified wavelength may be a wavelength for blue light (e.g., 405 to 415 nm), a wavelength for green light (e.g., 416 to 525 nm), a wavelength for yellow light (e.g., 526 to 590 nm), and / or a wavelength for red light (e.g., 630 to 660 nm). However, it is not limited thereto. The specified wavelength may be a wavelength outside the visible spectrum (e.g., 800 to 900 nm).
[0105] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0106] FIG. 8 may be described with reference to FIG. 1 through 7. Operations 810 through 830 of FIG. 8 may be included in operation 730 of FIG. 7. Depending on the embodiment, the order of the operations of FIG. 8 may be changed. Depending on the embodiment, at least two of the operations of FIG. 8 may be performed substantially simultaneously. For example, operation 810 and operation 830 may be performed substantially simultaneously.
[0107] Referring to FIG. 8, in operation 810, the electronic device (101) can irradiate light of a specified wavelength according to phototherapy to the areas. In one embodiment, the processor (140) can irradiate light (501) toward the face of the user (201) through a light source (130). In one embodiment, the processor (140) can control the light source (130) to irradiate light (501) toward the face of the user (201). For example, the processor (140) can irradiate light (501) toward the face of the user (201) based on a mask (e.g., mask (405) in FIG. 4b). For example, the processor (140) can irradiate light (501) toward the T zone (510) and the U zone (520).
[0108] In one embodiment, the electronic device (101) can control a light source (130) to irradiate light of a specified wavelength according to phototherapy to at least one of the parts of the face (e.g., forehead (421), nose (423), chin (425), and / or cheeks (427, 429)). For example, the specified wavelength may be a wavelength for blue light (e.g., 405 to 415 nm), a wavelength for green light (e.g., 416 to 525 nm), a wavelength for yellow light (e.g., 526 to 590 nm), and / or a wavelength for red light (e.g., 630 to 660 nm). However, it is not limited thereto. The specified wavelength may be a wavelength outside the visible spectrum (e.g., 800 to 900 nm).
[0109] In one embodiment, the electronic device (101) can control the light source (130) to irradiate light of a wavelength within the visible spectrum specified according to phototherapy to a first area (e.g., T-zone (510)). In one embodiment, the electronic device (101) can control the light source (130) to irradiate light of a wavelength outside the visible spectrum specified according to phototherapy to a second area (e.g., U-zone (520)). For example, the first area and the second area may be different areas. However, they are not limited thereto. For example, the first area and the second area may be the same area.
[0110] In one embodiment, the electronic device (101) can control the light source (130) to irradiate light of a specified wavelength according to phototherapy to at least one area located at a specified distance from the boundary of the eye area (e.g., 411, 413 in FIG. 4a and 4b). In one embodiment, the specified distance may correspond to a specified speed of movement of the face (e.g., speed of moving the face left-right, speed of moving the face up-down). For example, the specified distance may correspond to the value obtained by multiplying the specified speed of movement of the face and the computation time required by the electronic device (101) to update the at least one area to be irradiated with light.
[0111] In operation 820, the electronic device (101) can determine whether a guide is needed for the area where light is irradiated according to phototherapy.
[0112] For example, the electronic device (101) may determine that a guide is needed for a part where light other than visible light is irradiated. For example, the electronic device (101) may determine that a guide is needed based on identifying at least one part among the parts where the irradiated light is light other than visible light. For example, the electronic device (101) may determine that a guide is not needed based on identifying that all parts are irradiated with visible light.
[0113] For example, the electronic device (101) can determine whether the provision of a guide is set based on user settings. For example, the electronic device (101) can determine that a guide is needed based on the determination that the provision of a guide is set. For example, the electronic device (101) can determine that a guide is not needed based on the determination that the provision of a guide is disabled.
[0114] In one embodiment, based on the determination that a guide is needed, the electronic device (101) may perform operation 830. In one embodiment, based on the determination that a guide is not needed, the electronic device (101) may stop (or bypass) the performance of operation 830. In one embodiment, stopping (or bypassing) the performance of operation 830 may include the electronic device (101) not providing a guide to the area where light according to the phototherapy is irradiated while performing phototherapy.
[0115] In operation 830, the electronic device (101) can irradiate a designated visible light to the area where guidance is required.
[0116] In one embodiment, the electronic device (101) can control the light source (130) to irradiate visible light onto at least one part of the face to guide that phototherapy is being performed. For example, the electronic device (101) can control the light source (130) to irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) that is distinct from the wavelength specified for phototherapy onto at least one part of the face.
[0117] In one embodiment, the electronic device (101) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) onto the boundary surface of at least one area where light of a specified wavelength according to phototherapy is irradiated. In one embodiment, the electronic device (101) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) onto the entire area where light of a specified wavelength according to phototherapy is irradiated.
[0118] In one embodiment, the electronic device (101) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) only to some of the multiple areas where light of a specified wavelength is irradiated according to phototherapy. For example, the electronic device (101) may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of 500 nm wavelength) only to some of the areas where light of a wavelength outside the visible spectrum is irradiated. For example, when an electronic device (101) irradiates light of a wavelength within the visible spectrum to a first area (e.g., T zone (510)) and light of a wavelength outside the visible spectrum to a second area (e.g., U zone (520)), it may irradiate visible light of a different wavelength (e.g., green light) (e.g., light of a wavelength of 500 nm) to the second area (e.g., U zone (520)) among the first area (e.g., T zone (510)) and the second area (e.g., U zone (520)).
[0119] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.
[0120] As described above, the electronic device (101) may include a light source (130), a sensor (120), at least one processor (140) including a processing circuit, and a memory (150) including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the user (201) to acquire an image of the user's (201) face using the sensor (120). When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the user to identify parts of the face based on the image. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the light source (130) to irradiate at least one of the areas of the face with light of a wavelength specified according to phototherapy. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause at least one area of the face to irradiate visible light of a different wavelength distinct from the wavelength specified according to phototherapy.
[0121] The wavelength specified above may be a wavelength outside the visible spectrum.
[0122] The above at least one part may include a first part and a second part. When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the first part to be irradiated with a first light of a first wavelength within the visible spectrum designated according to the phototherapy. When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the second part to be irradiated with a second light of a second wavelength outside the visible spectrum designated according to the phototherapy. When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the second part among the first part and the second part to be irradiated with the visible light of the other wavelength.
[0123] When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may be caused to identify the distance between the at least one part of the face and the light source (130) based on the image. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may be caused to determine the intensity of the light such that the intensity of the light irradiated through the light source (130) is proportional to the square of the distance.
[0124] When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may be caused to identify an eye area including the eye among the areas of the face based on the image. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may be caused to irradiate the light of the specified wavelength onto the at least one area located at a specified distance from the boundary of the eye area.
[0125] The above-mentioned distance may correspond to the specified movement speed of the face.
[0126] When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may receive input from a user (201) selecting at least one of the parts. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the light of the specified wavelength to be irradiated in response to the input from the user (201) selecting at least one part.
[0127] As described above, the electronic device (101) may include a mirror (220) that reflects external light and a display (210) positioned behind the mirror (220). When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the display (210) to display a visual object to guide the posture of the user (201) in response to acquiring a different image of the user (201) using the sensor (120). When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the display of the visual object to cause the display of the sensor (120) to determine whether the user (201) assumes the guided posture. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the user (201) to acquire the image of the user's (201) face based on the determination that the user (201) has assumed the guided posture.
[0128] When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause a user interface (UI) (630) to be displayed through the display (210) while the light of the specified wavelength is being irradiated onto the at least one part.
[0129] When the above instructions are executed individually or collectively by the at least one processor (140), they may cause the electronic device (101) to generate another image such that light of a specified wavelength is projected onto each of the parts of the face when irradiated through the light source (130). When the above instructions are executed individually or collectively by the at least one processor (140), they may cause the electronic device (101) to irradiate the light of the specified wavelength based on the other image.
[0130] The method described above may be performed by an electronic device (101) comprising a light source (130) and a sensor (120). The method may include the operation of acquiring an image of the face of a user (201) using the sensor (120). The method may include the operation of identifying parts of the face based on the image. The method may include the operation of controlling the light source (130) to irradiate light of a wavelength designated according to phototherapy onto at least one part of the face. The method may include the operation of irradiating visible light of a different wavelength, distinct from the wavelength designated according to phototherapy, onto at least one part of the face.
[0131] The wavelength specified above may be a wavelength outside the visible spectrum.
[0132] The above at least one portion may include a first portion and a second portion. The method may include the action of irradiating the first portion with a first light of a first wavelength within a visible spectrum designated according to the phototherapy. The method may include the action of irradiating the second portion with a second light of a second wavelength outside a visible spectrum designated according to the phototherapy. The method may include the action of irradiating the second portion with the visible light of the other wavelength among the first portion and the second portion.
[0133] The above method may include an operation of identifying the distance between the at least one part of the face and the light source (130) based on the image. The above method may include an operation of determining the intensity of the light such that the intensity of the light irradiated through the light source (130) is proportional to the square of the distance.
[0134] The above method may include an action of identifying an eye region, including the eye, among the regions of the face based on the image. The above method may include an action of irradiating the light of the specified wavelength onto the at least one region located at a specified distance from the boundary of the eye region.
[0135] The above-mentioned distance may correspond to the specified movement speed of the face.
[0136] The above method may include an operation of receiving input from a user (201) selecting at least one of the above parts. The above method may include an operation of irradiating light of the specified wavelength in response to the input from the user (201) selecting at least one part.
[0137] The electronic device (101) may include a mirror (220) that reflects external light and a display (210) positioned behind the mirror (220). The method may include an action of displaying a visual object to guide the posture of the user (201) through the display (210) in response to acquiring another image of the user (201) using the sensor (120). The method may include an action of determining whether the user (201) assumes the guided posture using the sensor (120) in response to displaying the visual object. The method may include an action of acquiring the image of the face of the user (201) based on the determination that the user (201) assumes the guided posture.
[0138] The above method may include an operation of displaying a UI (user interface) (630) that guides the light to be irradiated to at least one part through the display (210) while irradiating the light of the specified wavelength.
[0139] The above method may include an operation to generate another image such that light of a specified wavelength is projected onto each of the parts of the face when irradiated through the light source (130). The above method may include an operation to irradiate the light of the specified wavelength based on the other image.
[0140] A non-transitory computer-readable storage medium as described above may store a program containing instructions. When the instructions are executed individually or collectively by at least one processor (140) of an electronic device (101) comprising a light source (130) and a sensor (120), the electronic device (101) may cause the electronic device (101) to acquire an image of a user's (201) face using the sensor (120). When the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the electronic device (101) to identify parts of the face based on the image. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause the light source (130) to irradiate at least one of the areas of the face with light of a wavelength specified according to phototherapy. When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101) may cause at least one area of the face to irradiate visible light of a different wavelength distinct from the wavelength specified according to phototherapy.
[0141] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.
[0142] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0143] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0144] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0145] Various embodiments of the present document may be implemented as software (e.g., a program) comprising one or more instructions stored in a storage medium (e.g., internal memory or external memory) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (140)) of the machine (e.g., an electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0146] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., CD-ROM (compact disc read-only memory)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0147] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101), light source (130), sensor (120), At least one processor (140) including a processing circuit; and The electronic device (101) includes a memory (150) that stores instructions and includes one or more storage media, and when the instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), Using the sensor (120), an image of the user's (201) face is obtained, and Based on the above image, identify the parts of the face, and By controlling the light source (130) above: Light of a specified wavelength is irradiated onto at least one of the above-mentioned parts of the face according to phototherapy, and Causing to irradiate at least one part of the face with visible light of a different wavelength distinct from the wavelength specified according to the phototherapy, Electronic device.
2. In Claim 1, The wavelength specified above is a wavelength outside the visible spectrum, Electronic device.
3. In claim 1 or claim 2, The above at least one portion includes a first portion and a second portion, and When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), According to the above phototherapy, a first light of a first wavelength within the designated visible spectrum is irradiated onto the first site, and A second light of a second wavelength outside the visible spectrum specified according to the above phototherapy is irradiated onto the second site, and Causing the second portion among the first portion and the second portion to be irradiated with the visible light of the other wavelength, Electronic device.
4. In any one of claims 1 to 3, When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), Based on the above image, the distance between the at least one part of the face and the light source (130) is identified, and Causing to determine the intensity of the light irradiated through the light source (130) such that the intensity of the light is proportional to the square of the distance, Electronic device.
5. In any one of claims 1 to 4, When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), Based on the above image, identify the eye area including the eye among the above parts of the face, and Causing to irradiate the light of the specified wavelength to the at least one portion located at a specified distance from the boundary of the eye portion, Electronic device.
6. In Claim 5, The above-mentioned distance corresponds to the specified movement speed of the face, Electronic device.
7. In any one of claims 1 to 6, When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), Receiving input from a user (201) selecting at least one of the above parts, In response to the input of the user (201) selecting at least one of the above parts, causing the light of the specified wavelength to be irradiated, Electronic device.
8. In any one of claims 1 to 7, A mirror (220) that reflects external light, and It includes a display (210) positioned behind the mirror (220), and When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), In response to acquiring another image of the user (201) using the sensor (120), a visual object for guiding the posture of the user (201) is displayed through the display (210). In response to displaying the above visual object, the sensor (120) is used to determine whether the user (201) assumes the guided posture, and Based on the determination that the user (201) has assumed the guided posture, causing the image of the user (201)'s face to be obtained, Electronic device.
9. In Claim 8, When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), While irradiating the light of the specified wavelength, causing the display (210) to display a UI (user interface) (630) that guides the light to be irradiated to the at least one part, Electronic device.
10. In any one of claims 1 to 9, When the above instructions are executed individually or collectively by the at least one processor (140), the electronic device (101), When irradiated through the light source (130), another image is generated such that light of a designated wavelength is projected onto each of the parts of the face, and Based on the other image above, causing to irradiate the light of the specified wavelength, Electronic device.
11. A method of an electronic device (101) comprising a light source (130) and a sensor (120), The operation of acquiring an image of the user's (201) face using the sensor (120) above, An action of identifying the parts of the face based on the above image, and By controlling the light source (130) above: The action of irradiating light of a specified wavelength according to phototherapy onto at least one of the above-mentioned parts of the face, and The operation of irradiating at least one part of the face with visible light of a different wavelength distinct from the wavelength specified according to the phototherapy. method.
12. In Claim 11, The wavelength specified above is a wavelength outside the visible spectrum, method.
13. In claim 11 or claim 12, The above at least one portion includes a first portion and a second portion, and The above method is, The action of irradiating the first part with a first light of a first wavelength within the visible spectrum specified according to the above phototherapy, The action of irradiating the second site with a second light of a second wavelength outside the visible spectrum specified according to the above phototherapy, and The operation of irradiating the second portion among the first portion and the second portion with the visible light of the other wavelength method.
14. In any one of claims 11 to 13, Based on the above image, an operation to identify the distance between the at least one part of the face and the light source (130), and The method includes an operation to determine the intensity of the light such that the intensity of the light irradiated through the light source (130) is proportional to the square of the distance. method.
15. In any one of claims 11 to 14, Based on the above image, an action of identifying an eye region including the eye among the above regions of the face, and The operation of irradiating the light of the specified wavelength onto the at least one portion located at a specified distance from the boundary of the eye portion. method.