Display device and operation method thereof

Abstract

This display device may comprise: a camera; a panel in which at least a partial area operates as a mirror or a display; a memory storing one or more instructions; and at least one processor including processing circuitry, wherein, when the one or more instructions are executed individually or collectively by the at least one processor, the display device: controls the camera to capture an image of a user to obtain a user image; obtains location information of the user; obtains information about a gaze direction of the user on the basis of the user image; and controls the panel such that at least a partial area of the panel operates as the mirror or the display on the basis of the location information and the information about the gaze direction of the user.

Description

Display device and method of operation thereof

[0001] The present disclosure relates to a display device capable of performing a mirror function and / or a display function for displaying information, and a method of operating the same.

[0002] Advancements in modern display technology have transformed the role of conventional display devices, shifting them from simply providing information to offering a wider range of functions and user experiences. While early display devices were limited to displaying content on a fixed screen, the subsequent emergence of innovative technologies such as transparent displays, translucent OLEDs, and electrochromic displays has significantly expanded the applications of display devices.

[0003] In particular, translucent display technology has enabled the combination of a standard mirror and a display device, allowing a single device to perform two roles. Smart mirrors can convert a conventional mirror into a display device or use a display device as a mirror, thereby providing both intuitiveness and practicality in information display. Furthermore, sensor technology and network connectivity embedded in the display device have laid the foundation for realizing a multi-functional display device equipped with user interaction and data processing capabilities, in addition to providing information.

[0004] Ultimately, these technological advancements linked to display devices have gone beyond simply providing visual information, presenting possibilities for expansion across various application fields such as providing customized information in diverse user environments, smart home integration, and healthcare monitoring.

[0005] A display device according to various embodiments of the present disclosure may include a camera, a panel in which at least a portion of the area may operate as a mirror and may operate as a display, a memory for storing one or more instructions, and at least one processor including a processing circuit.

[0006] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the camera to photograph the user and acquire a user image.

[0007] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can acquire the user's location information.

[0008] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can obtain information about the user's gaze direction based on the user image.

[0009] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the panel so that at least a portion of the panel operates as at least one of a mirror and a display, based on the location information and information regarding the user's gaze direction.

[0010] A method of operating a display device according to various embodiments, comprising a panel having at least a portion of which can operate as a mirror and can operate as a display, may include the step of photographing a user to obtain a user image.

[0011] A method of operating a display device according to one embodiment may include the step of obtaining location information of the user.

[0012] A method of operating a display device according to one embodiment may include the step of obtaining information about the direction of the user's gaze based on the user image.

[0013] A method of operating a display device according to one embodiment may include the step of operating at least a portion of a panel as at least one of a mirror and a display based on the position information and information regarding the user's line of sight.

[0014] FIG. 1 is a drawing showing a display device according to one embodiment.

[0015] FIG. 2 is a flowchart illustrating the operation method of a display device according to one embodiment.

[0016] FIG. 3 is a flowchart illustrating a method in which a display device according to one embodiment operates a panel as a mirror or a display.

[0017] FIG. 4 is a diagram showing an example of a display device according to one embodiment operating a panel as a display.

[0018] FIG. 5 is a diagram showing an example of a display device according to one embodiment operating a panel as a display.

[0019] FIG. 6 is a diagram showing an example in which a display device according to one embodiment operates a panel as a mirror.

[0020] FIG. 7 is a diagram showing the operation of a display device according to one embodiment when it recognizes a plurality of users.

[0021] FIG. 8 is a diagram showing an example in which a display device according to one embodiment operates a portion of a panel as a mirror.

[0022] FIG. 9 is a drawing showing an example in which a display device according to one embodiment operates at least a portion of a panel as a display or a mirror.

[0023] FIG. 10 is a diagram showing the operation of a display device according to one embodiment analyzing and displaying the user's face condition.

[0024] FIG. 11 is a diagram illustrating an example of a display device according to one embodiment providing recommendation information based on facial condition analysis.

[0025] FIG. 12 is a block diagram showing the configuration of a display device according to one embodiment.

[0026] FIG. 13 is a block diagram showing the configuration of a display device according to one embodiment.

[0027] The terms used in this specification will be briefly explained, and the invention will be described in detail.

[0028] The terms used in this invention have been selected based on currently widely used general terms, taking into account their functions within the invention; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should be defined not merely by their names, but based on their meanings and the overall content of the invention.

[0029] When a part of a specification is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part" or "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0030] The expressions used herein, such as “at least one A and B,” “at least one A, and B,” “at least one A or B,” and “at least one A, or B,” mean that they include any one of the following: A, B, A and B.

[0031] Similarly, expressions used herein such as “at least one A, B and C,” “at least one A, B, and C,” “at least one A, B or C,” “at least one A, B, or C,” etc., have the meaning of including any one of the following: A, B, C, A and B, A and C, B and C, A and B and C.

[0032] The following describes embodiments with reference to the attached drawings so that those skilled in the art can easily implement the present invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0033] In the embodiments of this specification, the term "user" refers to a person who controls a system, function, or operation, and may include a developer, administrator, or installer.

[0034] Additionally, in the embodiments of this specification, 'image' or 'picture' may represent a still image, a video composed of a plurality of consecutive still images (or frames), or a video.

[0035] FIG. 1 is a drawing showing a display device according to one embodiment.

[0036] Referring to FIG. 1, a display device (100) according to one embodiment may include a mirror function and a display function. For example, the display device (100) may include a panel that can operate as a mirror or a display. The panel may be a device that appears as a normal mirror in appearance, but can display information or images when necessary.

[0037] A panel according to one embodiment is capable of switching between a mirror mode and a display mode, and can operate in either a mirror mode or a display mode. When the panel operates as a mirror (mirror mode), it can reflect an external light source to display the user's image. Additionally, when the panel operates as a display (display mode), it can provide various visual information to the user.

[0038] A panel according to one embodiment may be formed as a single integrated module or a structure in which a plurality of layers are stacked. For example, the panel may include a mirror layer and a display layer.

[0039] A mirror layer according to one embodiment may be a layer that reflects external light to function like a conventional mirror. The mirror layer may include a half mirror, a switchable mirror, etc. A half mirror is a mirror that reflects some light and transmits some light, and may be referred to as a translucent mirror. Additionally, the transparency or reflectivity of a switchable mirror may change according to an external electrical signal. For example, a switchable mirror may be switched to reflect like a mirror when the power is off and to appear like transparent glass when the power is on.

[0040] A panel according to one embodiment may include a display layer disposed on the back of a mirror layer. The display layer may include an OLED, Micro LED, a transparent display, etc., and may display information, images, GUI, etc.

[0041] A display device (100) according to one embodiment may be referred to as a smart mirror, magic mirror, interactive mirror, smart display mirror, etc., but is not limited thereto.

[0042] A display device (100) according to one embodiment may be used as a mirror installed in a bathroom, a mirror used in a fitness center or home exercise room, a mirror used in a vanity or beauty salon, digital signage, etc., but is not limited thereto.

[0043] A display device (100) according to one embodiment may include various sensors and can recognize a user around the display device (100) using the various sensors. For example, the display device (100) can recognize a user existing within a preset range from the display device (100) using a camera, an infrared sensor, a thermal sensor, an ultrasonic sensor, a proximity sensor, etc.

[0044] A display device (100) according to one embodiment can obtain location information of a recognized user when a user is recognized. For example, the display device (100) can obtain the relative position of the user with respect to the display device (100), the distance between the display device (100) and the user, etc. by photographing the user using a camera. However, it is not limited thereto.

[0045] Referring to FIG. 1, a display device (100) according to one embodiment can control a panel to perform a display function when the distance between the display device (100) and a user is greater than or equal to a preset distance. For example, the display device (100) can operate a panel included in the display device (100) in a display mode to display various information. However, it is not limited thereto.

[0046] In addition, a display device (100) according to one embodiment can obtain the direction of the user's gaze based on a user image captured of the user. For example, the display device (100) can obtain the direction of the user's gaze by using an eye tracking function.

[0047] Referring to FIG. 1, a display device (100) according to one embodiment can control a panel to perform a mirror function when the distance between the display device (100) and a user is closer than a preset distance and the user's gaze direction is toward the user reflected in the panel. For example, the display device (100) can operate the panel included in the display device (100) in a mirror mode to provide an image of an object reflected through the panel. However, it is not limited thereto.

[0048] A display device (100) according to one embodiment can operate the panel in mirror mode or display mode based on information regarding the user's location information and the user's gaze direction. Accordingly, without additional commands or input from the user, the user's intention can be identified and the device can automatically switch to mirror or display mode, thereby improving user convenience.

[0049] Hereinafter, with reference to the drawings, a method in which a display device (100) according to one embodiment operates a panel as a mirror or a display will be described in detail.

[0050] FIG. 2 is a flowchart illustrating the operation method of a display device according to one embodiment.

[0051] Referring to FIG. 2, a display device (100) according to one embodiment can photograph a user using a camera (S210).

[0052] A display device (100) according to one embodiment may include at least one camera. The at least one camera may be built into the display device (100) or configured separately and connected to the display device (100). The at least one camera may be installed on the front or side of the display device (100), but is not limited thereto.

[0053] The display device (100) can photograph the recognized user when a user is recognized in the front area of ​​the display device (100). Additionally, when multiple users are recognized, the display device (100) can photograph the user closest to the display device (100) or the camera among the multiple users. However, it is not limited thereto.

[0054] A display device (100) according to one embodiment can obtain user location information (S220).

[0055] For example, a display device (100) according to one embodiment may acquire location information of a user by using a camera, an ultrasonic sensor, an infrared sensor, or an RF-based sensor. The display device (100) may calculate the distance between the display device (100) and the user based on sensor data collected from various sensors. Additionally, the display device (100) may calculate the direction or angle in which the user is located relative to the display device (100) based on the sensor data. However, it is not limited thereto.

[0056] A display device (100) according to one embodiment can obtain information about the direction of the user's gaze based on a user image captured in step 210 (S210) (S230).

[0057] A display device (100) according to one embodiment can track the user's gaze based on a user image. The display device (100) can recognize the user's face in a user image that captures the user. For example, the display device (100) can identify the contours of the face and major feature points such as eyes, nose, and mouth in the user image using a deep learning-based face recognition algorithm or a feature point-based algorithm. When a face is recognized, the display device (100) can extract the eye area within the face area more finely and accurately.

[0058] The display device (100) can identify the positions of the iris and pupil within the eye region and calculate the direction of gaze of the user based on the positions of the iris and pupil. Additionally, the display device (100) can calculate the direction of gaze of the user by calculating the relative positional relationship between the center point of the pupil and the eye contour. The display device (100) can calculate the direction of the user's head using major feature points of the face (feature points of the eyes, nose, and mouth) and can use the user's head direction information when calculating the direction of gaze. However, it is not limited thereto.

[0059] A display device (100) according to one embodiment can operate at least a portion of a panel as a mirror or display based on information about the user's location information and the user's gaze direction (S240).

[0060] For example, if the distance between the display device (100) and the user is greater than or equal to a preset distance, the display device (100) may operate a panel included in the display device (100) as a display to display various information. Alternatively, if the distance between the display device (100) and the user is closer than a preset distance and the user's gaze is directed toward the user reflected in the panel, the display device (100) may operate at least a portion of the panel as a mirror. However, it is not limited thereto.

[0061] FIG. 3 is a flowchart illustrating a method in which a display device according to one embodiment operates a panel as a mirror or a display.

[0062] Referring to FIG. 3, a display device (100) according to one embodiment can identify the location and distance of a user (S310).

[0063] For example, a display device (100) according to one embodiment can acquire location information of a user by using a camera, an ultrasonic sensor, an infrared sensor, or an RF-based sensor, etc. The display device (100) can calculate the distance between the display device (100) and the user based on sensor data collected from various sensors.

[0064] Additionally, the display device (100) can calculate the direction or angle in which the user is located relative to the display device (100) based on sensor data. However, it is not limited thereto.

[0065] A display device (100) according to one embodiment can identify whether the user's location and distance are within a preset range (S320).

[0066] For example, the display device (100) can identify whether the distance between the display device (100) and the user is closer than a preset distance, and can identify whether the direction or angle in which the user is located relative to the display device (100) is within a preset direction and angle range. However, it is not limited thereto.

[0067] A display device (100) according to one embodiment can display various information by operating the panel as a display when the user's location and distance are not within a preset range (S330).

[0068] A display device (100) according to one embodiment can obtain information about the direction of the user's gaze when the user's location and distance are within a preset range (S340).

[0069] For example, the display device (100) can recognize the user's face in a video of the user. The display device (100) can extract an eye region within the face region and calculate the user's gaze direction based on specific objects within the eye region (e.g., iris, pupil, etc.). The display device (100) can calculate the user's head direction using major feature points (feature points such as eyes, nose, mouth, etc.) within the face region and calculate the gaze direction using the head direction information. However, it is not limited thereto.

[0070] A display device (100) according to one example can identify whether the user's gaze direction is toward an image of the user reflected on the panel (S350).

[0071] When the user's gaze direction is not toward the image of the user reflected on the panel, the display device (100) can operate the panel as a display to display various information (S330).

[0072] The display device (100) can operate the panel as a mirror when the user's gaze direction is toward the image of the user reflected on the panel (S360).

[0073] FIG. 4 is a diagram showing an example of a display device according to one embodiment operating a panel as a display.

[0074] Referring to FIG. 4, a display device (100) according to one embodiment can recognize a user (410) present around the display device (100) using various sensors and obtain location information of the recognized user (410). For example, the location information of the user (410) may include the distance between the user and the display device (100). The display device (100) can measure the distance between the user and the display device (100) using a distance sensor. The distance sensor may include an ultrasonic sensor, an infrared sensor, a LiDAR sensor, a stereo camera, a ToF camera, a structured light sensor, etc. However, it is not limited thereto.

[0075] The display device (100) can operate the panel of the display device (100) as a display when the distance between the display device (100) and the user (410) is greater than or equal to a preset distance.

[0076] For example, as illustrated in FIG. 4, if the first distance (420) between the display device (100) and the user (410) is greater than or equal to a preset distance, the display device (100) can operate the panel as a display to display various information.

[0077] FIG. 5 is a diagram showing an example of a display device according to one embodiment operating a panel as a display.

[0078] Referring to FIG. 5, a display device (100) according to one embodiment can recognize a user present around the display device (100) and obtain location information of the recognized user. For example, the location information of the user may include the distance between the user and the display device (100). Since the operation of the display device (100) recognizing a user and measuring the distance has been described in detail in FIG. 4, the same description will be omitted.

[0079] When the second distance (520) between the display device (100) and the user (510) is less than a preset distance, the display device (100) can acquire a user image by using a camera to photograph the user.

[0080] The display device (100) can recognize the face of the user (510) in the user image. The display device (100) can extract an eye region within the recognized user's face region and can calculate the user's (510) gaze direction (530) based on the position of the user's (510) iris and pupil included in the eye region.

[0081] Additionally, the display device (100) can calculate the direction of the user's (510) head in the user image, and based on the direction of the user's (510) head, can calculate the direction of the user's (510) gaze (530).

[0082] The display device (100) can identify whether the user (510)’s gaze direction (530) is directed toward an image of the user (510) reflected on the panel. Alternatively, the display device (100) can identify whether the user (510)’s gaze direction (530) is directed toward the user (510) in a direction (540) reflected by the panel.

[0083] For example, as illustrated in FIG. 5, the display device (100) can calculate the direction (540) in which the user's line of sight is reflected by the panel. The display device (100) identifies whether the reflected direction (540) is directed toward the user (510), and if the reflected direction (540) is not directed toward the user (510), the display device (100) can operate the panel as a display to display various information.

[0084] FIG. 6 is a diagram showing an example in which a display device according to one embodiment operates a panel as a mirror.

[0085] Referring to FIG. 6, a display device (100) according to one embodiment can recognize a user present around the display device (100) and obtain location information of the recognized user. For example, the location information of the user may include the distance between the user and the display device (100). Since the operation of the display device (100) recognizing a user and measuring the distance has been described in detail in FIG. 4, the same description will be omitted.

[0086] When the third distance (620) between the display device (100) and the user (610) is less than a preset distance, the display device (100) can obtain a user image by using a camera to photograph the user (610).

[0087] The display device (100) can recognize the face of the user (610) in the user image. The display device (100) can extract an eye region within the recognized face region of the user (610), and can calculate the direction of gaze (630) of the user (610) based on the position of the iris and pupil of the user (610) included in the eye region.

[0088] Additionally, the display device (100) can calculate the direction of the user's head in the user image and, based on the direction of the user's head, can calculate the direction of the user's (610) gaze (630).

[0089] The display device (100) can identify whether the user's gaze direction (630) is directed toward the image of the user (610) reflected on the panel. Alternatively, the display device (100) can identify whether the user's gaze direction reflected by the panel is directed toward the user (610).

[0090] For example, as illustrated in FIG. 6, when the direction of the user's (610) gaze (630) is toward the image of the user (610) reflected on the panel, the display device (100) can operate the panel as a mirror.

[0091] FIG. 7 is a diagram showing the operation of a display device according to one embodiment when it recognizes a plurality of users.

[0092] Referring to FIG. 7, a display device (100) according to one embodiment can recognize a plurality of users present around the display device (100).

[0093] A display device (100) according to one embodiment can determine whether to operate the panel as a display or as a mirror based on the location information and gaze information of the user located closest among a plurality of recognized users.

[0094] The display device (100) can obtain the distance between each of the recognized multiple users and the display device (100). For example, the display device (100) can measure the distance between each of the multiple users and the display device (100) using a distance sensor.

[0095] As illustrated in FIG. 7, the display device (100) recognizes a first user (710), a second user (720), and a third user (730), and can measure a first distance (715) between the first user (710) and the display device (100), a second distance (725) between the second user (720) and the display device (100), and a third distance (735) between the third user (730) and the display device (100).

[0096] The display device (100) can operate the panel as a display or mirror based on the first user (710) located at the first distance (715), which is the closest distance among the first distance (715), second distance (725), and third distance (735).

[0097] For example, the display device (100) can check whether the distance (first distance (715)) between the first user (710) and the display device (100) is greater than or equal to a preset distance. If the first distance (715) is greater than or equal to a preset distance, the display device (100) can operate the panel as a display.

[0098] On the other hand, if the first distance (715) is less than a preset distance, the display device (100) can acquire a user image by using a camera to photograph the first user (710). The display device (100) can recognize the face of the first user (710) in the user image. The display device (100) can detect an eye area within the face area of ​​the first user (710) and calculate the gaze direction of the first user (710) based on a specific object (e.g., pupil, iris, etc.) included in the eye area. Additionally, the display device (100) can calculate the head direction of the first user (710) in the user image and calculate the gaze direction of the first user (710) based on the head direction.

[0099] The display device (100) can identify whether the gaze direction of the first user (710) is toward the image of the first user (710) reflected on the panel. Alternatively, the display device (100) can identify whether the gaze direction of the first user (710) reflected by the panel is toward the first user (710).

[0100] For example, if the direction of gaze of the first user (710) reflected by the panel is directed toward the second user (720) or the third user (730) rather than the first user (710), the display device (100) can operate the panel of the display device (100) as a display.

[0101] On the other hand, as illustrated in FIG. 7, when the direction of gaze of the first user (710) is toward the image of the first user (710) reflected on the panel, the display device (100) can operate the panel as a mirror.

[0102] FIG. 7 describes an example in which the operating mode of the panel is determined based on the user located closest to the display device (100) when multiple users are recognized, but is not limited thereto.

[0103] A display device (100) according to one embodiment may determine whether to operate the panel as a display or as a mirror based on the number of users located closer than a preset distance from the display device (100), the ratio of users located closer than a preset distance to the number of recognized users, and the size of the panel of the display device when a plurality of users are recognized. However, it is not limited thereto.

[0104] FIG. 8 is a diagram showing an example in which a display device according to one embodiment operates a portion of a panel as a mirror.

[0105] Referring to FIG. 8, a display device (100) according to one embodiment can recognize a user present around the display device (100). Based on the location information and gaze information of the recognized user, the display device (100) according to one embodiment can decide whether to operate the panel as a display or as a mirror.

[0106] In the case where the display device (100) according to one embodiment decides to operate the panel as a mirror, only some of the panels may be operated as mirrors depending on the user's position.

[0107] For example, the display device (100) can operate a first area (820) corresponding to the first position among the panels as a mirror when the first user (810) is located at a first position, the distance between the first user (810) and the display device (100) (first distance (815)) is smaller than a preset distance, and the direction of the first user's (810) gaze is toward the image of the first user (810) reflected on the panel. The display device (100) can operate the remaining area excluding the first area (820) as a display.

[0108] The display device (100) can operate the first region (820) as a mirror by increasing the reflectance of the first region (820) and decreasing the transmittance or transparency. However, it is not limited thereto.

[0109] Alternatively, the display device (100) may operate a second area (840) corresponding to the second position among the panels as a mirror when the second user (830) is located at a second position, the distance between the second user (830) and the display device (100) (second distance (835)) is smaller than a preset distance, and the direction of the second user's (830) gaze is toward the image of the second user (830) reflected on the panel. The display device (100) may operate the remaining area excluding the second area (840) as a display.

[0110] The display device (100) can operate the second region (840) as a mirror by increasing the reflectivity of the second region (840) and decreasing the transmittance or transparency. However, it is not limited thereto.

[0111] FIG. 9 is a drawing showing an example in which a display device according to one embodiment operates at least a portion of a panel as a display or a mirror.

[0112] Referring to FIG. 9, a display device (100) according to one embodiment may include a display device including a large panel. The large panel according to one embodiment may be divided into a plurality of regions, and the size and shape of each of the plurality of regions may be pre-set. For example, the plurality of regions may include a first region (901), a second region (902), a third region (903), and a fourth region (904), but is not limited thereto.

[0113] Additionally, the display device (100) can change the size and shape of each of the multiple regions as needed. For example, the multiple regions can be divided to correspond to the locations of multiple users recognized by the display device (100).

[0114] As illustrated in FIG. 9, multiple users may be located around the display device (100). The display device (100) can recognize multiple users located around the display device (100). For example, the display device (100) can recognize a first user (910), a second user (920), a third user (930), and a fourth user (940).

[0115] The display device (100) can operate a first area (901) among a plurality of areas included in a panel as a mirror or display based on the location information of the first user (910) and the gaze direction information of the first user (910). The first area (901) is an area corresponding to the location of the first user (910) and may be an area located in front of the first user (910).

[0116] For example, the display device (100) obtains a first distance (915) between the first user (910) and the display device (100) or panel, and if the first distance (915) is greater than or equal to a preset distance, the first area (901) can be operated as a display.

[0117] Additionally, the display device (100) can operate the second area (902) among the plurality of areas included in the panel as a mirror or display based on the location information of the second user (920) and the gaze direction information of the second user (920). The second area (902) is an area corresponding to the location of the second user (920) and may be an area located in front of the second user (920).

[0118] For example, the display device (100) can obtain a second distance (925) between the second user (920) and the display device (100) or panel, and if the second distance (925) is smaller than a preset distance, it can obtain information on the gaze direction of the second user (920).

[0119] The display device (100) can operate the second area (902) as a mirror when the direction of gaze of the second user (920) is toward the image of the second user (920) reflected on the panel.

[0120] Additionally, the display device (100) can operate a third area (903) among a plurality of areas included in the panel as a mirror or display based on the location information of the third user (930) and the gaze direction information of the third user (930). The third area (903) is an area corresponding to the location of the third user (930) and may be an area located in front of the third user (930).

[0121] For example, the display device (100) can obtain a third distance (935) between the third user (930) and the display device (100) or panel, and if the third distance (935) is smaller than a preset distance, it can obtain information on the gaze direction of the third user (930).

[0122] The display device (100) can operate the third area (903) as a display when the direction of gaze of the third user (930) reflected by the panel is not directed toward the third user (930).

[0123] Additionally, the display device (100) can operate the fourth area (904) among the plurality of areas included in the panel as a mirror or display based on the location information of the fourth user (940) and the gaze direction information of the fourth user (940). The fourth area (904) is an area corresponding to the location of the fourth user (940) and may be an area located in front of the fourth user (940).

[0124] For example, the display device (100) can obtain a fourth distance (945) between the fourth user (940) and the display device (100) or panel, and if the fourth distance (945) is smaller than a preset distance, it can obtain information on the gaze direction of the fourth user (940).

[0125] The display device (100) can operate the fourth area (904) as a mirror when the direction of the fourth user (940)'s head is not directed toward the fourth area (904), but the direction of the fourth user's (940) gaze is directed toward the image of the fourth user (940) reflected on the panel. However, it is not limited thereto.

[0126] FIG. 10 is a diagram showing the operation of a display device according to one embodiment analyzing and displaying the user's face condition.

[0127] Referring to FIG. 10, a display device according to one embodiment can operate a panel as a mirror. Since the method of the display device (100) operating the panel as a mirror has been described in detail in FIG. 6 to FIG. 9, a detailed description will be omitted.

[0128] A display device (100) according to one embodiment can operate as a mirror and simultaneously acquire a user's face image through a camera. The display device (100) can analyze the user's face condition based on the user's face image. For example, the display device (100) can align the position and direction of the face by applying a face recognition and facial alignment algorithm to the user's face image. The display device (100) can analyze the user's skin condition by applying an artificial intelligence model to the user's face image. For example, the display device (100) can analyze wrinkles, blemishes, pores, pigmentation, oiliness, moisture, elasticity, etc., and can divide the user's face into multiple parts to obtain analysis results for each part.

[0129] As illustrated in FIG. 10, the display device (100) can display the analysis results (1020). At this time, the display device (100) can operate the panel as a display. The display device (100) can display the analysis results for each part of the face (e.g., forehead, under eyes, cheeks, chin, etc.) and can display the colors according to the analysis results by overlaying them on the corresponding parts. Accordingly, the display device (100) can intuitively provide the user with the condition of wrinkles, pigmentation, pores, etc., for each part of the face.

[0130] Additionally, the display device (100) may display text information or scores based on the analysis results at the bottom or near a part of the display, so that the user can numerically determine the condition of each part. However, it is not limited thereto.

[0131] FIG. 11 is a diagram illustrating an example of a display device according to one embodiment providing recommendation information based on facial condition analysis.

[0132] Referring to FIG. 11, a display device (100) according to one embodiment can analyze a user's face condition and display an analysis result (1110). Since the method of the display device (100) analyzing a face condition and displaying an analysis result (1110) has been described in detail in FIG. 10, a detailed description will be omitted.

[0133] A display device (100) according to one embodiment can recommend user-customized products based on analysis results.

[0134] The display device (100) can display the facial condition analysis result (1110) in a first area of ​​the panel and the recommended product information (1120) based on the analysis result in a second area. As illustrated in FIG. 11, the recommended product information (1120) may include cosmetic 1, cosmetic 2, and cosmetic 3. The display device (100) can receive input for selecting the recommended cosmetic and can display detailed information about the selected recommended cosmetic. Alternatively, the display device (100) may display a purchase page where the selected recommended cosmetic can be purchased. However, it is not limited thereto.

[0135] FIG. 12 is a block diagram showing the configuration of a display device according to one embodiment.

[0136] Referring to FIG. 12, a display device (100) according to one embodiment may include a camera (110), a processor (120), a memory (130), and a panel (140).

[0137] A camera (110) according to one embodiment can acquire image frames, such as still images or video. For example, the camera (110) can capture images outside the display device (100). At this time, the images captured through the camera (110) can be processed through a processor (120) or a separate image processor.

[0138] A camera (110) according to one embodiment may be positioned on the front of a display device (100), for example, in the bezel area at the top of the screen. The camera (110) may be positioned to face the direction of a user located on the front of the display device (100) so as to acquire an image of the user.

[0139] For example, the camera (110) can acquire an image (e.g., a series of frames) corresponding to the user's face within the camera recognition range. A processor (120) according to one embodiment can acquire information on the user's gaze direction based on the image of the user. Since the method for acquiring information on the user's gaze direction has been described in detail in FIGS. 2 and FIGS. 3, a detailed description will be omitted.

[0140] A processor (120) according to one embodiment controls the overall operation of the display device (100) and the signal flow between the internal components of the display device (100), and performs the function of processing data.

[0141] The processor (120) may include a single core, dual core, triple core, quad core, and multiples thereof. Additionally, the processor (120) may include multiple processors. For example, the processor (120) may be implemented as a main processor (not shown) and a sub processor (not shown).

[0142] Additionally, the processor (120) may be composed of hardware components that perform arithmetic, logic, and input / output operations and signal processing. The processor (140) may be composed of, for example, at least one of a Central Processing Unit (CPU), a Microprocessor, a Graphic Processing Unit (GPU), a Video Processing Unit (VPU), Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), an Application Processor (AP), a Neural Processing Unit (NPU), or an AI-dedicated processor designed with a hardware structure specialized for processing AI models, but is not limited thereto. Alternatively, according to an embodiment, the processor (120) may be implemented in the form of a System On Chip (SoC) integrating at least one of the processors listed above.

[0143] A memory (130) according to one embodiment may include, for example, a non-volatile memory comprising at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), and a PROM (Programmable Read-Only Memory), and a volatile memory such as a RAM (Random Access Memory) or SRAM (Static Random Access Memory).

[0144] A memory (130) according to one embodiment can store various data, programs, or applications for driving and controlling a display device (100).

[0145] Additionally, the program stored in memory (130) may include one or more instructions. The program (one or more instructions) or application stored in memory (130) may be executed by the processor (120).

[0146] A processor (120) according to one embodiment may be one or more. If there is one or more processors (120), the operations of the present disclosure may be performed by one or more processors individually or collectively by executing instructions and / or programs stored in memory (130).

[0147] When a method according to one embodiment includes a plurality of operations, the plurality of operations may be performed by a single processor (120) or by a plurality of processors (120). For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor and the third operation may be performed by a second processor.

[0148] One or more processors according to one embodiment may be implemented as a single-core processor or as a multi-core processor. When a method according to one embodiment includes a plurality of operations, the plurality of operations may be performed by a single core or by a plurality of cores included in one or more processors.

[0149] A processor (120) according to one embodiment can control a camera (110) to photograph a user by executing one or more instructions stored in the memory (130) individually or collectively.

[0150] A processor (120) according to one embodiment can obtain user location information by executing one or more instructions stored in the memory (130) individually or collectively. For example, the processor (120) can calculate the distance between the display device (100) and the user based on sensor data collected from various sensors including a camera, an ultrasonic sensor, an infrared sensor, or an RF-based sensor. Additionally, the processor (120) can calculate the direction or angle in which the user is located relative to the display device (100) based on the sensor data. However, it is not limited thereto.

[0151] A processor (120) according to one embodiment can obtain information about the direction of a user's gaze based on a user image by executing one or more instructions stored in the memory (130) individually or collectively.

[0152] For example, the processor (120) can track the user's gaze based on the user video. The processor (120) can recognize the user's face in the user video that captured the user. The processor (120) can identify the contours of the face and key feature points such as eyes, nose, and mouth in the user video using a deep learning-based face recognition algorithm or a feature point-based algorithm. When the face is recognized, the processor (120) can extract the eye area within the face area more finely and accurately.

[0153] The processor (120) can identify the positions of the iris and pupil within the eye region and calculate the direction of the user's gaze based on the positions of the iris and pupil. Additionally, the processor (120) can calculate the user's gaze direction by calculating the relative positional relationship between the center point of the pupil and the eye rim. The processor (120) can calculate the user's head direction using major feature points of the face (feature points of the eyes, nose, and mouth) and can use the user's head direction information when calculating the gaze direction. However, it is not limited thereto.

[0154] A processor (120) according to one embodiment can operate at least a portion of a panel as a mirror or display based on information about the user's location information and the user's gaze direction by executing one or more instructions stored in the memory (130) individually or collectively.

[0155] For example, if the distance between the display device (100) and the user is greater than or equal to a preset distance, the processor (120) may operate the panel included in the display device (100) as a display to display various information. Alternatively, if the distance between the display device (100) and the user is closer than a preset distance and the user's gaze is directed toward the user reflected in the panel, the processor (120) may operate at least a portion of the panel as a mirror. However, it is not limited thereto.

[0156] A processor (120) according to one embodiment can determine whether to operate the panel as a display or as a mirror by executing one or more instructions stored in the memory (130) individually or collectively, based on location information and gaze direction information of the user located closest to the display device (100) when multiple users are recognized.

[0157] A processor (120) according to one embodiment can execute one or more instructions stored in the memory (130) individually or collectively, and when it is determined to operate the panel as a mirror, only some of the panels can be operated as mirrors depending on the user's location.

[0158] A panel (140) according to one embodiment is capable of switching between a mirror mode and a display mode, and can operate in either a mirror mode or a display mode. A panel (140) according to one embodiment may be formed as a single integrated module or a structure in which a plurality of layers are stacked. For example, the panel (140) may include a mirror layer and a display layer.

[0159] The mirror layer may be a layer that reflects external light to function like a conventional mirror. The mirror layer may include a half mirror, a switchable mirror, etc. A half mirror is a mirror that reflects some light and transmits some light, and may be referred to as a translucent mirror. Additionally, the transparency or reflectivity of a switchable mirror can be changed by an external electrical signal. For example, a switchable mirror can be switched to reflect like a mirror when the power is off and to appear like transparent glass when the power is on.

[0160] The display layer can be placed on the back of the mirror layer and may include OLED, Micro LED, transparent display, etc.

[0161] A panel (140) according to one embodiment may generate an electrical signal to control the reflectance or transmittance of a mirror layer and apply it to the mirror layer. Accordingly, the panel (140) may operate in a mirror mode or a display mode. Furthermore, the panel (140) may generate a driving signal for the display layer by converting an image signal, data signal, OSD signal, control signal, etc., processed by a processor (120).

[0162] Additionally, the panel (140) may operate in mirror mode for only a portion of the area and in display mode for the remaining area.

[0163] Additionally, the panel (140) can be configured as a touch screen and used as an input device in addition to an output device.

[0164] FIG. 13 is a block diagram showing the configuration of a display device according to one embodiment.

[0165] The display device (1300) of FIG. 13 may be an embodiment of the display device (100) described with reference to FIG. 1 to FIG. 12.

[0166] Referring to FIG. 13, a display device (1300) according to one embodiment may include a tuner unit (1340), a processor (1310), a display unit (1320), a communication unit (1350), a detection unit (1330), an input / output unit (1370), a video processing unit (1380), an audio processing unit (1385), an audio output unit (1360), a memory (1390), and a power supply unit (1395).

[0167] The camera unit (1332) of FIG. 13 may correspond to the camera (110) of FIG. 12, the processor (1310) of FIG. 13 may correspond to the processor (120) of FIG. 12, the memory (1390) of FIG. 13 may correspond to the memory (130) of FIG. 12, and the display unit (1320) of FIG. 13 may correspond to the panel (140) of FIG. 12. Accordingly, content identical to that described above will be omitted.

[0168] A tuner unit (1340) according to one embodiment can select only the frequency of the channel to be received by the display device (1300) among many radio wave components by tuning through amplification, mixing, resonance, etc. of a broadcast signal received via wired or wireless means. The broadcast signal includes audio, video, and additional information (e.g., EPG (Electronic Program Guide)).

[0169] The tuner unit (1340) can receive broadcast signals from various sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, etc. The tuner unit (1340) can also receive broadcast signals from sources such as analog broadcasting or digital broadcasting.

[0170] The communication unit (1350) can transmit and receive data or signals with an external device.

[0171] A communication unit (1350) according to one embodiment can transmit or receive data or signals with an external device or server. For example, the communication unit (1350) can communicate with an external device through a wired or wireless communication network. To communicate with an external device via a wired connection, the communication unit (1350) may include at least one port for being connected via a wired cable. For example, the communication unit (1350) may include at least one of an HDMI (High-Definition Multimedia Interface) port, an MHL (Mobile High-Definition Link) port, a USB (Universal Serial Bus) port, a DP (Display Port), a Thunderbolt port, a VGA (Video Graphics Array) port, an RGB port, a D-SUB (D-subminiature), a DVI (Digital Visual Interface), a component jack, or a PC port. The communication unit (1350) can communicate with an external device connected via a wired connection through at least one port.

[0172] Additionally, the communication unit (1350) may include a Wi-Fi module, a Bluetooth module, an infrared communication module and a wireless communication module, a LAN module, an Ethernet module, etc. At this time, each communication module may be implemented in the form of at least one hardware chip.

[0173] The Wi-Fi module and the Bluetooth module perform communication using the Wi-Fi method and the Bluetooth method, respectively. When using the Wi-Fi module or the Bluetooth module, various connection information such as SSID and session key is transmitted and received first, and then various information can be transmitted and received after establishing a communication connection using this information. The wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0174] A communication unit (1350) according to one embodiment can receive a control signal or control command, etc., corresponding to user input (e.g., key or button input of the control device) from a control device.

[0175] A detection unit (1330) according to one embodiment detects a user's voice, a user's image, or a user's interaction, and may include a microphone (1331), a camera unit (1332), and an optical receiver (1333).

[0176] The microphone (1331) receives the uttered voice of the user. The microphone (1331) can convert the received voice into an electrical signal and output it to the processor (1310). The user voice may include, for example, a voice corresponding to a menu or function of the display device (1300). For example, the microphone (1331) can receive a user voice corresponding to a rotation command of the display and convert the received voice into an electrical signal and output it to the processor (1310).

[0177] The camera unit (1332) can receive images (e.g., consecutive frames) corresponding to a user's motion including a gesture within the camera recognition range. The processor (1310) can use the received motion recognition result to select a menu displayed on the display device (1300) or perform control corresponding to the motion recognition result.

[0178] The light receiver (1333) receives a light signal (including a control signal) received from an external control device through a light window (not shown) in the bezel of the display unit (1320). The light receiver (1333) can receive a light signal corresponding to user input (e.g., touch, press, touch gesture, voice, or motion) from the control device. A control signal can be extracted from the received light signal under the control of the processor (1310).

[0179] An input / output unit (1370) according to one embodiment can receive video (e.g., video, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from outside the display device (1300). The input / output unit (1370) may include any one of HDMI (High-Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface), component jack, and PC port.

[0180] The processor (1310) controls the overall operation of the display device (1300) and the signal flow between the internal components of the display device (1300), and performs the function of processing data. The processor (1310) can execute an OS (Operation System) and various applications stored in memory (1390) when there is user input or when a pre-set and stored condition is satisfied.

[0181] The processor (1310) may include RAM used as a storage area for storing signals or data input from outside the display device (1300) or for various tasks performed on the display device (1300), ROM stored as a control program for controlling the display device (1300), and a processor.

[0182] The video processing unit (1380) performs processing on video data received by the display device (1300). The video processing unit (1380) can perform various image processing on the video data, such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion.

[0183] The audio processing unit (1385) performs processing on audio data. Various processing such as decoding, amplification, and noise filtering on audio data can be performed in the audio processing unit (1385). Meanwhile, the audio processing unit (1385) may be equipped with multiple audio processing modules to process audio corresponding to multiple contents.

[0184] The audio output unit (1360) outputs audio included in a broadcast signal received through the tuner unit (1340) under the control of the processor (1310). The audio output unit (1360) can output audio (e.g., voice, sound) input through the communication unit (1350) or the input / output unit (1370). Additionally, the audio output unit (1360) can output audio stored in the memory (1390) under the control of the processor (1310). The audio output unit (1360) may include at least one of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface) output terminal.

[0185] The power supply unit (1395) supplies power input from an external power source to the components inside the display device (1300) under the control of the processor (1310). Additionally, the power supply unit (1395) can supply power output from one or more batteries (not shown) located inside the display device (1300) to the internal components under the control of the processor (1310).

[0186] The memory (1390) may store various data, programs, or applications for driving and controlling the display device (1300) under the control of the processor (1310). The memory (1390) may include a broadcast receiving module, a channel control module, a volume control module, a communication control module, a voice recognition module, a motion recognition module, an optical receiving module, a display control module, an audio control module, an external input control module, a power control module, a power control module for an external device connected wirelessly (e.g., Bluetooth), a voice database (DB), or a motion database (DB), which are not illustrated. The modules not illustrated and the database of the memory (1390) may be implemented in software form to perform broadcast reception control functions, channel control functions, volume control functions, communication control functions, voice recognition functions, motion recognition functions, optical reception control functions, display control functions, audio control functions, external input control functions, power control functions, or power control functions for an external device connected wirelessly (e.g., Bluetooth) in the display device (1500). The processor (1310) can perform each of these functions using the software stored in memory (1390).

[0187] Meanwhile, the block diagrams of the display devices (100, 1300) illustrated in FIGS. 12 and 13 are block diagrams for one embodiment. Each component of the block diagrams may be integrated, added, or omitted according to the specifications of the actual implemented display device (100, 1300). That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. Furthermore, the functions performed in each block are intended to explain the embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0188] A display device according to one embodiment may include a camera, a panel in which at least a portion of the area operates as a mirror or a display, a memory for storing one or more instructions, and at least one processor including a processing circuit.

[0189] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the camera to photograph the user and acquire a user image.

[0190] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can acquire the user's location information.

[0191] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can obtain information about the user's gaze direction based on the user image.

[0192] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the panel so that at least a portion of the panel operates as a mirror or a display based on the location information and information about the user's gaze direction.

[0193] According to one embodiment, the user's location information may include information about the distance between the user and the panel.

[0194] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the panel (140) so that the panel operates as a display based on the fact that the distance is greater than or equal to a preset distance.

[0195] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can obtain information about the user's gaze direction based on the distance being less than a preset distance.

[0196] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can identify whether the user's gaze direction is toward the image of the user reflected through the panel.

[0197] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device may control the panel so that at least a portion of the panel acts as a mirror based on the identification that the direction of the user's gaze is directed toward the image of the user reflected through the panel.

[0198] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the panel based on the user's location information so that only a portion of the panel corresponding to the user's location operates as the mirror, and the remaining portion of the panel operates as the display.

[0199] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can acquire the user image by photographing the first user located closest to the display device among the plurality of users based on the recognition of a plurality of users.

[0200] A panel according to one embodiment may include a plurality of regions.

[0201] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the panel so that the first area operates as the display based on the location information and gaze information of a first user corresponding to the first area among the plurality of areas.

[0202] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the panel so that the second area operates as the mirror based on the location information and gaze information of a second user corresponding to the second area among the plurality of areas.

[0203] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can control the camera to photograph the user's face based on the panel operating as the mirror.

[0204] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can analyze the user's face state based on the user's face image.

[0205] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can operate the panel as a display to display the face state analysis result.

[0206] When the one or more instructions are executed individually or collectively by at least one processor according to one embodiment, the display device can operate the panel as a display to display recommended products based on the face state analysis result.

[0207] A panel according to one embodiment may include at least one of a switchable mirror, a half mirror, and an OLED display mirror.

[0208] A method of operating a display device according to one embodiment may include the step of capturing a user and acquiring a user image.

[0209] A method of operating a display device according to one embodiment may include the step of obtaining location information of the user.

[0210] A method of operating a display device according to one embodiment may include the step of obtaining information about the direction of the user's gaze based on the user image.

[0211] A method of operating a display device according to one embodiment may include the step of operating at least a portion of a panel as a mirror or display based on the position information and information regarding the user's line of sight direction.

[0212] According to one embodiment, the user's location information may include information about the distance between the user and the panel.

[0213] The step of operating at least a portion of a panel as a mirror or display according to one embodiment may include the step of operating the panel as a display based on the distance being greater than or equal to a preset distance.

[0214] The step of obtaining information about the direction of a user's gaze according to one embodiment may include the step of obtaining information about the direction of the user's gaze based on the fact that the distance is less than a preset distance.

[0215] The step of obtaining information about the direction of a user's gaze according to one embodiment may include identifying whether the direction of the user's gaze is toward the image of the user reflected through the panel.

[0216] The step of operating at least a portion of a panel as a mirror or display according to one embodiment may include the step of operating at least a portion of the panel as a mirror based on the identification that the direction of the user's gaze is directed toward the image of the user reflected through the panel.

[0217] The step of operating at least a portion of a panel as a mirror according to one embodiment may include, based on the user's location information, operating only a portion of the panel corresponding to the user's location as the mirror, and operating the remaining portion of the panel as the display.

[0218] The step of photographing a user and acquiring a user image according to one embodiment may include the step of photographing a first user located closest to the display device among a plurality of users based on the recognition of a plurality of users, and acquiring the user image.

[0219] A panel according to one embodiment may include a plurality of regions.

[0220] The step of operating at least a portion of a panel as a mirror or display according to one embodiment may include the step of operating the first area as the display based on the location information and gaze information of a first user corresponding to the first area among the plurality of areas.

[0221] The step of operating at least a portion of a panel as a mirror or display according to one embodiment may include the step of operating the second area as a mirror based on the location information and gaze information of a second user corresponding to the second area among the plurality of areas.

[0222] A method of operating a display device according to one embodiment may include the step of capturing the face of the user and acquiring an image of the user's face based on the panel operating as the mirror.

[0223] A method of operation of a display device according to one embodiment may include a step of analyzing the facial condition of the user based on the facial image of the user.

[0224] A method of operating a display device according to one embodiment may include the step of operating the panel as a display to display the face condition analysis result.

[0225] A method of operating a display device according to one embodiment may include the step of operating the panel as a display to display recommended products based on the result of the face condition analysis.

[0226] A display device according to one embodiment can switch between mirror mode and display mode, thereby providing various functions.

[0227] A display device according to one embodiment can automatically switch between mirror mode and display mode by identifying the user's intention without additional commands or input from the user, thereby improving user convenience.

[0228] A display device according to one embodiment can switch only a part of the panel, rather than the entire panel, to a mirror mode or a display mode, thereby allowing the display device to be utilized in various ways.

[0229] A method of operation of a display device according to one embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0230] In addition, the method of operation of the display device according to the disclosed embodiments may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product.

[0231] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable app) that is distributed electronically through a manufacturer of an electronic device or an electronic market (e.g., an application store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the manufacturer, a server of the electronic market, or a storage medium of a relay server that temporarily stores the software program.

[0232] A computer program product may include a storage medium of a server or a storage medium of a client device in a system composed of a server and a client device. Alternatively, if a third device (e.g., a smartphone) is communicationally connected to the server or client device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include the S / W program itself, which is transmitted from the server to the client device or the third device, or from the third device to the client device.

[0233] In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0234] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) can execute a computer program product stored on the server to control a client device connected to the server in communication to perform a method according to the disclosed embodiments.

[0235] Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention as defined in the following claims also fall within the scope of the present invention.

Claims

1. In a display device (100), Camera (110); A panel (140) in which at least some area can function as a mirror and can function as a display; At least one processor (120) including a processing circuit; and It includes memory that stores one or more instructions, and When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device (100) is, Control the camera (110) to capture the user and obtain a user image, and Acquire the location information of the above user, and Based on the above user image, information regarding the user's gaze direction is obtained, and A display device that controls the panel (140) so that at least a portion of the area of ​​the panel (140) operates as at least one of a mirror and a display, based on the above location information and information regarding the user's gaze direction.

2. In Paragraph 1, The location information of the above user includes information about the distance between the user and the panel, and When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that controls the panel (140) to operate as the display based on the fact that the above distance is greater than or equal to a preset distance.

3. In Paragraph 2, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, Based on the fact that the above distance is less than a preset distance, information regarding the user's gaze direction is obtained, and A display device that identifies whether the direction of the user's gaze is toward an image of the user reflected on the panel (140).

4. In Paragraph 3, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that controls the panel (140) so that at least a portion of the panel acts as a mirror, based on the identification that the direction of the user's gaze is directed toward the image of the user reflected on the panel (140).

5. In Paragraph 4, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that controls the panel (140) based on the location information of the user, such that at least a portion of the panel (140) corresponding to the user's location operates as the mirror, and another portion of the panel (140) operates as the display.

6. In any one of paragraphs 1 through 5, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that, based on the recognition of multiple users, photographs the first user located closest to the display device among the multiple users and obtains the user image.

7. In any one of paragraphs 1 through 5, The above panel (140) includes a plurality of regions, and When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, Based on the location information and gaze direction information of the first user corresponding to the first area among the plurality of areas above, the first area controls the panel (140) to operate as the display, and A display device that controls the panel (140) so that the second area operates as the mirror based on the location information and gaze direction information of the second user corresponding to the second area among the plurality of areas.

8. In any one of paragraphs 1 through 7, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, Based on the fact that the above panel (140) operates as the mirror, the camera (110) is controlled to photograph the user's face, and Based on the facial image of the user above, analyze the facial condition of the user, and A display device that operates the at least a portion of the panel (140) as the display to display the above facial condition analysis results.

9. In Paragraph 8, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that operates at least a portion of the panel (140) as a display to display recommended products based on the above facial condition analysis results.

10. In any one of paragraphs 1 through 9, The above panel (140) is a display device comprising at least one of a switchable mirror, a half mirror, and an OLED display mirror.

11. A method of operating a display device having at least a portion of which can operate as a mirror and also as a display, A step of capturing a user and acquiring a user image (S210); Step of obtaining the location information of the above user (S220); A step of obtaining information about the direction of the user's gaze based on the user image (S230); and A method of operating a display device comprising the step (S240) of operating at least a portion of a panel as at least one of the mirror and the display based on the above location information and information regarding the user's gaze direction.

12. In Paragraph 11, The location information of the above user includes information about the distance between the user and the panel, and The step (S240) of operating at least a portion of the above panel as a mirror or display is, A method of operating a display device comprising the step of operating the at least a portion of the panel as the display based on the fact that the above distance is greater than or equal to a preset distance.

13. In Paragraph 12, The step (S230) of obtaining information about the direction of the user's gaze is, A step of obtaining information about the user's gaze direction based on the fact that the above distance is less than a preset distance; and A method of operating a display device comprising the step of identifying whether the direction of the user's gaze is toward an image of the user reflected on the panel.

14. In Paragraph 13, The step (S240) of operating at least a portion of the above panel is, A method of operating a display device comprising the step of operating at least a portion of the panel as a mirror based on the identification that the direction of the user's gaze is directed toward the image of the user reflected on the panel.

15. A computer-readable, non-transient recording medium storing a program that enables the method of any one of paragraphs 11 through 14.

Images