Electronic device for controlling mirror display and operation method thereof

Abstract

The disclosed electronic device comprises: a mirror display including a display area; a memory for storing at least one instruction; and at least one processor including a circuit device, wherein the at least one instruction is configured to, when individually or collectively executed by the at least one processor, control the mirror display to: identify the ratio occupied by a content area in the display area; and control the brightness of the display area of the mirror display on the basis of the ratio occupied by the content area in the display area.

Description

Electronic device for controlling a mirror display and method of operation thereof

[0001] The present disclosure relates to an electronic device and a method of operating the same. Specifically, it relates to an electronic device for controlling a mirror display and a method of operating the same.

[0002] With the emergence of various types of electronic devices driven by technological advancements, users' digital experiences in their daily lives are increasingly expanding. A mirror display is an electronic device that combines a mirror and a display panel. Electronic devices containing mirror displays not only perform the inherent function of a mirror—reflecting the shape of an object using light reflection—but can also output various information such as weather, calendars, videos, and major news.

[0003] An electronic device including a mirror display can adjust the brightness or reflectance of the display according to the purpose of use. For example, when the electronic device including a mirror display is used primarily for the function of displaying information, the brightness can be increased to improve the readability of the information, and when it is used primarily for the mirror function, the reflectance can be increased so that the user can clearly see their own reflection.

[0004] The present invention aims to provide an electronic device for controlling a mirror display according to a disclosed embodiment and a method of operation thereof.

[0005] An electronic device according to one embodiment of the present disclosure may include a mirror display including a display area, a memory storing at least one instruction, and at least one processor including a circuit device. By executing the at least one instruction individually or collectively by the at least one processor, the ratio occupied by the content area in the display area can be identified. By executing the at least one instruction individually or collectively by the at least one processor, the brightness of the display area of ​​the mirror display can be controlled based on the ratio.

[0006] A method of operation of an electronic device according to one embodiment of the present disclosure may include an operation of identifying the ratio that a content area occupies in a display area. This method may include an operation of controlling the brightness of the display area of ​​the mirror display based on the ratio that the content area occupies in the display area.

[0007] In a computer-readable recording medium having at least one instruction recorded thereon according to one embodiment of the present disclosure, the ratio of a content area to a display area is identified by executing the at least one instruction individually or collectively by the at least one processor, and the brightness of the display area of ​​the mirror display can be controlled based on the ratio.

[0008] The present invention can be easily understood from the combination of the following detailed description and the accompanying drawings, where reference numerals denote structural elements.

[0009] FIG. 1 is a reference diagram illustrating an example of an electronic device controlling a mirror display according to one embodiment of the present disclosure.

[0010] FIG. 2 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0011] FIG. 3 is a flowchart illustrating a method for controlling a mirror display according to one embodiment of the present disclosure.

[0012] FIG. 4a is a flowchart for explaining a detailed operation of controlling the brightness of a display area according to the ratio of the content area to the display area of ​​a mirror display included in operation 320 according to one embodiment of the present disclosure.

[0013] FIG. 4b is a reference diagram for explaining an example of controlling the brightness of a display area according to the ratio of the content area to the display area of ​​a mirror display according to one embodiment of the present disclosure.

[0014] FIG. 5a is a flowchart illustrating a method for controlling the brightness of a person area or an area other than a person area of ​​a mirror display according to one embodiment of the present disclosure.

[0015] FIG. 5b is a reference diagram for explaining an example of controlling the brightness of a person area or an area other than a person area of ​​a mirror display according to one embodiment of the present disclosure.

[0016] FIG. 6a is a flowchart illustrating a detailed operation for identifying a person area projected onto a mirror display included in operation 520 according to one embodiment of the present disclosure.

[0017] FIG. 6b is a reference diagram for explaining an example of acquiring an image projected onto a mirror display based on an image acquired by a camera included in operation 610 according to one embodiment of the present disclosure.

[0018] FIG. 7a is a flowchart illustrating a method for adjusting the brightness of a display area of ​​a mirror display based on a sensor value obtained by an illuminance sensor according to one embodiment of the present disclosure.

[0019] FIG. 7b is a flowchart for explaining a detailed operation of adjusting the brightness of a display area of ​​a mirror display based on a sensor value acquired by an illuminance sensor included in operation 330 according to one embodiment of the present disclosure.

[0020] FIG. 8a is a flowchart illustrating a method for adjusting the brightness of a content area and an area other than the content area according to one embodiment of the present disclosure.

[0021] FIG. 8b is a reference diagram for explaining an example of adjusting the brightness of a content area and an area other than the content area according to one embodiment of the present disclosure.

[0022] FIG. 9a is a reference diagram for explaining the relationship between brightness and reflectance of a mirror display according to one embodiment of the present disclosure.

[0023] FIG. 9b is a reference diagram for briefly explaining the principle of a mirror display according to one embodiment of the present disclosure.

[0024] FIG. 10a is a flowchart illustrating a method for controlling a mirror display based on user input according to one embodiment of the present disclosure.

[0025] FIG. 10b is a reference diagram for explaining an example of controlling a mirror display based on user input according to one embodiment of the present disclosure.

[0026] FIG. 11 is a flowchart illustrating a method for controlling a mirror display based on identifying a person in an image according to one embodiment of the present disclosure.

[0027] FIG. 12 is a reference diagram for explaining an example of controlling an electronic device by region according to one embodiment of the present disclosure.

[0028] FIG. 13 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0029] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments.

[0030] In relation to the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of the noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise.

[0031] In this document, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.

[0032] The term “and / or” includes a combination of multiple related described components or any of the multiple related described components.

[0033] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another component and do not limit the components in other aspects (e.g., importance or order).

[0034] Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0035] Terms such as “include” or “have” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in this document, and do not preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0036] When it is said that one component is “connected,” “combined,” “supported,” or “in contact” with another component, this includes not only cases where the components are directly connected, combined, supported, or in contact, but also cases where they are indirectly connected, combined, supported, or in contact through a third component.

[0037] When it is said that a component is located “on” another component, this includes not only cases where one component is in contact with the other, but also cases where another component exists between the two components.

[0038] It should be understood that the blocks in each flowchart and combinations of flowcharts can be executed by one or more computer programs containing computer-executable instructions. One or more computer programs may be stored all in a single memory or may be partitioned and stored in multiple different memories.

[0039] One embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various numbers of hardware and / or software configurations that execute specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a specific function. Additionally, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented as algorithms executed on one or more processors. Furthermore, the present disclosure may employ prior art for electronic configuration, signal processing, and / or data processing, etc.

[0040] All functions or operations, including functions related to artificial intelligence according to the present disclosure, are operated through a processor and memory. The processor may be composed of one or more processors. A single processor or a combination of processors may include circuitry that performs processing, such as an AP (Application Processor), CP (Communication Processor), GPU (Graphical Processing Unit), NPU (Neural Processing Unit), MPU (Microprocessor Unit), SoC (System on Chip), IC (Integrated Chip), etc.

[0041] The present disclosure will be described in detail below with reference to the attached drawings.

[0042] FIG. 1 is a reference diagram illustrating an example of an electronic device controlling a mirror display according to one embodiment of the present disclosure.

[0043] The electronic device (100) can display content. The electronic device (100) can display content in the content area (20). For example, the electronic device (100) may display content stored in the electronic device (100) in the content area (20), or may display content received from an external electronic device or server. For example, the content area (20) may include an application screen, schedule information, weather information, time information, menu, photos, videos, games, educational content, etc.

[0044] The electronic device (100) can reflect light. The electronic device (100) can perform the function of reflecting light like a mirror to show an object located in front of the electronic device (100). The electronic device (100) can perform the function of projecting a user located in front of the electronic device (100) onto a display area (10) to form an image (30) of the user.

[0045] The electronic device (100) can display content in the content area (20) through the mirror display (110). The electronic device (100) can display a person located in front of the electronic device (100) in the space where the electronic device (100) is located in the display area (10) through the mirror display (110).

[0046] The mirror display (110) is a form in which a mirror and a display are combined, and it may be a display capable of providing both the functions of a general mirror and a display. For example, the mirror display (110) may reflect external light like a general mirror, or it may switch to a display to display information. For example, when the brightness of the mirror display (110) is high, the mirror display (110) switches to a display to display information, and when the brightness of the mirror display (110) is low, the mirror display (110) may reflect external light like a general mirror.

[0047] In one embodiment, the electronic device (100) may display content on the display area (10) of the mirror display, or may display an object located in front of the electronic device (100) on the display area (10) of the mirror display.

[0048] In one embodiment, the display area (10) of the mirror display may represent the entire screen of the mirror display (110). In one embodiment, the display area (10) of the mirror display may represent a physical space or physical area within the entire screen of the mirror display that may display content and may also be used as a mirror.

[0049] In one embodiment, all or part of the display area (10) of the mirror display performs a display function to output content obtained inside or outside the electronic device (100). All or part of the display area (10) of the mirror display can be used as a mirror to reflect an object in front of the electronic device (100).

[0050] In one embodiment, the display area (10) of the mirror display may be an area capable of performing both mirror and display functions. For example, the display area (10) of the mirror display may be an area that is used as a mirror when the electronic device (100) does not display content, and as a display when it displays content.

[0051] In one embodiment, the display area (10) of the mirror display may have different roles depending on the reflectivity of the mirror display (110). For example, if the reflectivity of the mirror display (110) is high (or, high area), it may be used as a mirror, and if the reflectivity of the mirror display (110) is low (or, low area), it may be an area used as a display.

[0052] In this way, the display area (10) of the mirror display may be designed to flexibly provide a mirror or display function depending on the situation to enhance the user experience.

[0053] In one embodiment, the electronic device (100) can identify the ratio of the content area displayed in the display area (10) of the mirror display to the display area.

[0054] In one embodiment, the content area (20) may represent an area within the display area (10) of the mirror display where the electronic device (100) displays content. The display area (10) of the mirror display may include the content area (20). For example, all or part of the display area (10) of the mirror display may be the content area (20).

[0055] In one embodiment, the size or position of the content area (20) may change dynamically. For example, depending on the type or size of the content, the content area (20) may represent the entire area of ​​the display area (10) of the mirror display or a partial area.

[0056] For example, if the electronic device (100) runs a clock application and a weather application and displays time and weather information on the electronic device (100), the part where the time and weather information is displayed may be the content area (20).

[0057] In one embodiment, the electronic device (100) can control the mirror display (110) to control the brightness of the display area (10) of the mirror display based on the ratio of the content area (20) to the display area (10) of the mirror display.

[0058] In one embodiment, the electronic device (100) can control the mirror display (110) so that the brightness of the display area (10) of the mirror display becomes greater than or equal to a reference brightness, based on the fact that the ratio of the content area (20) to the display area (10) of the mirror display is greater than or equal to a threshold ratio.

[0059] For example, if the electronic device (100) determines that the content area (20) occupies a ratio greater than a threshold ratio in the display area (10) of the mirror display, the electronic device (100) may determine that it performs the function of displaying information rather than reflection. The electronic device (100) may control the mirror display (110) so that the brightness of the display area (10) of the mirror display becomes greater than or equal to a reference brightness in order to improve the readability of the information and smoothly perform the information display function. Through this, the electronic device (100) can smoothly perform the information display function.

[0060] In one embodiment, the electronic device (100) may determine that it performs the function of reflecting objects rather than displaying information when the ratio of the content area (20) to the display area (10) of the mirror display is less than a threshold ratio. The electronic device (100) may control the mirror display (110) so that the brightness of the display area (10) of the mirror display is less than a reference brightness in order to smoothly perform the mirror function. Through this, the electronic device (100) can smoothly perform the mirror function.

[0061] In this way, the mirror display (110) can optimize the user experience by dynamically adjusting the brightness according to the proportion of content and mirror function.

[0062] The electronic device (100) may include a camera (161). The camera can acquire an image of the space where the electronic device (100) is located. The space where the electronic device (100) is located may refer to an indoor space where the electronic device (100) can be installed. The space where the electronic device (100) is located may correspond to various types of indoor spaces, such as a house, office, shop, guest room, commercial space, or workspace. For example, the camera (161) can acquire an image of an object located in front of the electronic device (100).

[0063] The electronic device (100) can identify a person area projected onto a mirror display (110) based on an acquired image, and the person area is an area of ​​the mirror display (110) that corresponds to the reflection of the person, and the reflection of the person may represent an image of the person included in the acquired image. For example, the field of view of the image acquired by the camera (161) may differ from the angle of the object reflected on the mirror display (110). The electronic device (100) can acquire an image projected onto the mirror display (110) by performing a viewpoint transformation on the acquired image. The electronic device (100) can identify a person area in the image projected onto the mirror display (110) and identify where the area occupied by the person is among the objects reflected on the actual electronic device (100).

[0064] In a mirror display (110), the brightness of the area excluding the person area can be set differently from the brightness of the person area. The electronic device (100) can set the brightness of each point in the area excluding the person area to gradually change from the brightness of the person area as the point moves further away from the person area. In other words, the electronic device (100) can set the brightness of each point in the area excluding the person area of ​​the mirror display (110) so that the brightness of each point in the reflective mirror display (110) excluding the person area changes along a gradient in the direction moving away from the person area. For example, the electronic device (100) can determine that the brightness of each point in the area excluding the person area decreases as each point moves further away from the person area.

[0065] The electronic device (100) may include an illuminance sensor. The illuminance sensor detects the illuminance of the space where the electronic device (100) is located. The electronic device (100) can identify or obtain an illuminance value using the sensor value of the illuminance sensor. The illuminance value may vary depending on the on / off status, set illuminance, lighting, etc. of the indoor lighting device (140) of the space where the electronic device (100) is located.

[0066] The electronic device (100) can adjust the brightness of the display area (10) of the mirror display based on the sensor value obtained by the light sensor. For example, the electronic device (100) can adjust the brightness of the display area (10) of the mirror display to be lowered if the sensor value obtained by the light sensor is greater than or equal to the threshold light level. For example, the electronic device (100) can adjust the brightness of the display area (10) of the mirror display to be increased if the sensor value obtained by the light sensor is less than the threshold light level.

[0067] In one embodiment, the electronic device (100) can enhance the user experience by adaptively controlling the brightness of the display area of ​​the mirror display. In one embodiment, the electronic device (100) can adaptively control the brightness of the display area of ​​the mirror display based on the ratio of the content area displayed on the electronic device (100) that plays the content.

[0068] In this way, when the electronic device (100) is used primarily for information display functions, the electronic device (100) can provide a visual environment optimized for viewing content, thereby increasing the user's immersion. When the electronic device (100) is used primarily for mirror functions, the electronic device (100) can be adjusted so that object reflection is easily achieved, thereby increasing the user's convenience.

[0069] In one embodiment, the electronic device (100) can improve the user experience by adaptively controlling the brightness of the display area of ​​the mirror display based on the person area projected onto the mirror display, thereby allowing the person area and other display areas to blend harmoniously. In one embodiment, the electronic device (100) can improve the user experience by adaptively controlling the brightness of the display area of ​​the mirror display based on ambient light, thereby providing optimal visibility suitable for the environment.

[0070] In this way, in one embodiment of the present disclosure, the electronic device (100) can flexibly switch between the roles of a display and a mirror in various environments to maximize user convenience.

[0071] Hereinafter, we will examine in detail a method for controlling a mirror display such that an electronic device (100) according to one embodiment of the present disclosure controls the brightness of the display area of ​​the mirror display.

[0072] FIG. 2 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0073] According to one embodiment of the present disclosure, an electronic device (100) is a device capable of displaying an image or data upon a user's request and may include a mirror display (110), a memory (120), and a processor (130).

[0074] The electronic device (100) can be implemented in various forms. The electronic device (100) can be any type of device that performs functions including a processor and memory. The electronic device (100) can be a stationary or portable device. For example, the electronic device (100) may represent a device equipped with a display capable of displaying image content, video content, game content, graphic content, etc. The electronic device (100) may include various types of electronic devices capable of receiving and outputting content, such as televisions like network TV, smart TV, internet TV, web TV, and IPTV; computers like desktops, laptops, and tablets; smartphones, cellular phones; game players, music players, video players; medical equipment; home appliances, etc. The electronic device (100) may be referred to as a display device in terms of displaying content, and may also be referred to as a content providing device, a computing device, etc.

[0075] The mirror display (110) may be a display capable of simultaneously providing the functions of a mirror and a display. The mirror display (110) is a type of display device that has both the functions of a reflective mirror and a digital screen. The mirror display (110) may represent an electronic device that combines information display and mirror functions. The mirror display (110) may be replaced with various terms. For example, the mirror display (110) may represent a smart mirror, Micro LED, an LED mirror capable of pixel-level light adjustment, a reflective screen, a smart mirror, a mirror effect display, a reflective display, or a projection display.

[0076] The mirror display (110) can reflect external light like a regular mirror and, when necessary, switch to a display to show information. The mirror display (110) can adjust brightness or reflectivity to reduce the effect of reflection of ambient light or enhance the mirror function of the display. The mirror display (110) can be used in various usage environments by adjusting brightness or reflectivity.

[0077] The mirror display (110) can indirectly control the reflectivity by adjusting the brightness. For example, if the brightness of the mirror display (110) is increased, the light emission of the mirror display (110) becomes stronger, reducing reflection and lowering the reflectivity. For example, if the brightness of the mirror display (110) is lowered, the light emission of the mirror display (110) becomes weaker, increasing reflection and raising the reflectivity.

[0078] In one embodiment, the mirror display (110) may provide at least one of a reflection function or a display function. The mirror display (110) may set the brightness or reflectivity differently for each area. For example, the mirror display (110) may set the brightness of a first area of ​​the mirror display (110) to a first brightness and the brightness of a second area to a second brightness.

[0079] In one embodiment, the mirror display (110) may include a structure in which a mirror for a reflection function and a display panel for a display function are combined. This combined structure may provide a function that allows a user to simultaneously view information displayed on the display panel and their own reflection through the mirror.

[0080] The memory (120) can store a program for processing and controlling the processor (130), and can store data that is input to or output from the electronic device (100). Additionally, the memory (120) can store data necessary for the operation of the electronic device (100).

[0081] The memory (120) may include at least one type of storage medium among flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, and optical disk.

[0082] The memory (120) may not exist separately but may be configured to be included in the processor (130). The memory (120) may be composed of volatile memory, non-volatile memory, or a combination of volatile and non-volatile memory. The memory (120) may store a program or at least one instruction for performing operations according to the embodiments described below. The memory (120) may provide stored data to the processor (130) upon the request of the processor (130).

[0083] The processor (130) controls the overall operation of the electronic device (100). The processor (130) is configured to control a series of processes to enable the electronic device (100) to operate according to the embodiments described below, and may be composed of one or more processors. The one or more processors included in the processor (130) may be circuitry such as a System on Chip (SoC) or an Integrated Circuit (IC). The one or more processors included in the processor (130) may be a general-purpose processor such as a CPU (Central Processing Unit), MPU (Micro Processor Unit), AP (Application Processor), or DSP (Digital Signal Processor); a graphics-dedicated processor such as a GPU (Graphic Processing Unit) or VPU (Vision Processing Unit); an artificial intelligence-dedicated processor such as an NPU (Neural Processing Unit); or a communication-dedicated processor such as a CP (Communication Processor). If one or more processors included in the processor (130) are artificial intelligence dedicated processors, the artificial intelligence dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0084] The processor (130) can write data to the memory (120) or read data stored in the memory (120), and in particular, can process data according to a predefined operation rule or artificial intelligence model by executing a program or at least one instruction stored in the memory (120). The processor (130) can perform operations described in subsequent embodiments, and operations described as being performed by the electronic device (100) in subsequent embodiments may be considered to be performed by the processor (130) unless otherwise specified.

[0085] For example, the processor (130) may perform the function of the electronic device (100) described in the present disclosure by individually or collectively executing at least one instruction stored in the memory (120). Alternatively, according to one embodiment, the electronic device (100) may perform the function described in the present disclosure by individually or collectively executing at least one instruction stored in the memory (120) by the processor (130).

[0086] In one embodiment, the processor (130) can identify the ratio of the content area displayed in the display area of ​​the mirror display to the ratio of the display area occupied by the content area displayed in the display area by executing at least one instruction stored in the memory (120) individually or collectively.

[0087] In one embodiment, the processor (130) can control the mirror display to control the brightness of the display area of ​​the mirror display based on the ratio of the content area to the display area by executing at least one instruction stored in the memory (120) individually or collectively.

[0088] In one embodiment, the processor (130) can control the mirror display such that the brightness of the display area of ​​the mirror display becomes greater than or equal to a reference brightness, based on the ratio of the content area to the display area being greater than or equal to a threshold ratio, by executing at least one instruction stored in the memory (120) individually or collectively.

[0089] In one embodiment, the processor (130) can control the mirror display such that the brightness of the display area becomes less than the reference brightness based on the ratio of the content area to the display area being less than the threshold ratio by executing at least one instruction stored in the memory (120) individually or collectively.

[0090] In one embodiment, the processor (130) can acquire an image through a camera by executing at least one instruction stored in memory (120) individually or collectively.

[0091] In one embodiment, the processor (130) can identify a person area projected onto the mirror display based on the acquired image by executing at least one instruction stored in the memory (120) individually or collectively. In one embodiment,

[0092] In one embodiment, the processor (130) can set the brightness of an area other than the person area in the mirror display differently from the brightness of the person area by executing at least one instruction stored in memory (120) individually or collectively.

[0093] In one embodiment, the processor (130) can set the brightness of each point in an area other than the person area to gradually change from the brightness of the person area as the point moves further away from the person area by executing at least one instruction stored in memory (120) individually or collectively.

[0094] In one embodiment, the processor (130) can adjust the brightness of the display area of ​​the mirror display based on the sensor value acquired by the illuminance sensor by executing at least one instruction stored in the memory (120) individually or collectively.

[0095] In one embodiment, the processor (130) can adjust the brightness of the display area of ​​the mirror display to be lowered when the sensor value acquired by the illuminance sensor is greater than or equal to a threshold illuminance by executing at least one instruction stored in the memory (120) individually or collectively.

[0096] In one embodiment, the processor (130) can adjust the brightness of the display area of ​​the mirror display to be increased when the sensor value acquired by the illuminance sensor is less than the threshold illuminance by executing at least one instruction stored in the memory (120) individually or collectively.

[0097] In one embodiment, the processor (130) can identify the object of the content by executing at least one instruction stored in memory (120) individually or collectively.

[0098] In one embodiment, the processor (130) can obtain a content area by inpainting the surrounding area of ​​the identified object by executing at least one instruction stored in memory (120) individually or collectively.

[0099] In one embodiment, the processor (130) can set the brightness of an area other than the content area in the mirror display differently from the brightness of the content area by executing at least one instruction stored in memory (120) individually or collectively.

[0100] In one embodiment, the processor (130) can set the brightness of each point in an area outside the content area to gradually change from the brightness of the content area as the point moves further away from the content area by executing at least one instruction stored in the memory (120) individually or collectively.

[0101] In one embodiment, the processor (130) can obtain a projection image projected onto the mirror display from an image acquired by the camera by individually or collectively executing at least one instruction stored in the memory (120). In one embodiment, the processor (130) can identify the person area in the projection image by individually or collectively executing at least one instruction stored in the memory (120).

[0102] In one embodiment, the processor (130) can obtain user input selecting a screen mode in which the brightness of the display area is set to be greater than or equal to the reference brightness, or a mirror mode in which the brightness of the display area is set to be less than or equal to the reference brightness, by executing at least one instruction stored in memory (120) individually or collectively.

[0103] In one embodiment, the processor (130) can switch to the screen mode or the mirror mode based on the user input by executing at least one instruction stored in the memory (120) individually or collectively.

[0104] In one embodiment, the processor (130) can determine whether a person is identified in an image acquired through the camera by executing at least one instruction stored in memory (120) individually or collectively.

[0105] In one embodiment, the processor (130) can switch to the mirror mode based on the determination that the person has been identified by executing at least one instruction stored in memory (120) individually or collectively.

[0106] FIG. 3 is a flowchart illustrating a method for controlling a mirror display according to one embodiment of the present disclosure.

[0107] In operation 310, the electronic device (100) can identify the ratio of the content area displayed in the display area of ​​the mirror display to the display area that the content area occupies in the display area.

[0108] For example, the electronic device (100) can identify the display area of ​​the mirror display in pixels. The electronic device (100) can calculate the ratio of the content area to the display area by calculating (or determining) the number of pixels in the display area of ​​the mirror display where content is displayed. For example, if the total number of pixels included in the display area of ​​the mirror display is 1,000 and content is displayed on 400 of those pixels, the ratio of the content area to the display area is 40%.

[0109] For example, the electronic device (100) can divide the display area of ​​the mirror display and analyze (or identify) the portion where content is displayed in each divided area. The electronic device (100) can determine the ratio of content that the content area occupies in the display area by comparing the area of ​​the portion where content is displayed with the total display area.

[0110] In one embodiment, the electronic device (100) can dynamically update (or identify, determine) the ratio of the content area to the display area when the area occupied by the content area changes in the display area of ​​the mirror display. In one embodiment, the electronic device (100) can update (e.g., calculate, determine, identify, determine) the ratio of the content area to the display area in real time when the area occupied by the content area changes in the display area of ​​the mirror display.

[0111] In operation 320, the electronic device (100) can control the mirror display to control the brightness of the display area of ​​the mirror display. In one embodiment, the electronic device (100) can control the mirror display to control (e.g., determine) the brightness of the display area of ​​the mirror display based on the ratio of the content area to the display area of ​​the mirror display.

[0112] In one embodiment, the electronic device (100) can detect in real time the ratio of the content area to the display area and dynamically control (e.g., determine) the brightness of the display area of ​​the mirror display. By adjusting the brightness of the display area of ​​the mirror display, the electronic device (100) can provide customized brightness control suitable for the user's needs and the purpose of use of the electronic device (100).

[0113] FIG. 4a is a flowchart for explaining a detailed operation of controlling the brightness of a display area according to the ratio of the content area to the display area of ​​a mirror display included in operation 320 according to one embodiment of the present disclosure.

[0114] In operation 410, the electronic device (100) can identify whether the ratio of the content area to the display area is greater than or equal to a threshold ratio.

[0115] In one embodiment, the electronic device (100) can determine whether the ratio is greater than or equal to a threshold ratio based on the ratio of the content area (124) to the display area (10) identified in operation 310.

[0116] The threshold ratio can serve as a criterion for distinguishing whether the electronic device (100) primarily performs an information display function or primarily performs a mirror function. For example, if the threshold ratio is 50%, it can be determined that the information display function takes precedence when the content area occupies more than half of the display area of ​​the mirror display. The threshold ratio may be a predetermined value, a value specified by the user, or a value that changes in real time.

[0117] In operation 420, the electronic device (100) can control the mirror display so that the brightness of the display area of ​​the mirror display is greater than or equal to the reference brightness. In one embodiment, the electronic device (100) can control the mirror display so that the brightness of the display area of ​​the mirror display is greater than or equal to the reference brightness based on the ratio that the content area occupies the display area being greater than or equal to the threshold ratio.

[0118] In one embodiment, the electronic device (100) may determine that the information display function is prioritized over the mirror function in the electronic device (100) based on the fact that the ratio of the content area to the display area is greater than or equal to a threshold ratio. The electronic device (100) may determine that brightness adjustment is necessary to lower the reflectivity of the mirror display (110) and increase the visibility of the content.

[0119] In one embodiment, the electronic device (100) can adjust the brightness of the display area of ​​the mirror display on a pixel-by-pixel basis. In one embodiment, the electronic device (100) can finely adjust the luminescence of each pixel included in the display area of ​​the mirror display to adjust the display brightness above a reference brightness. The electronic device (100) can increase the brightness of the pixels in the display area of ​​the mirror display. The electronic device (100) can individually increase the brightness of the backlight unit corresponding to each pixel within the display area of ​​the mirror display (110), for example, the brightness of the LED light source, to lower the overall reflectivity of the screen and improve information readability. For example, the electronic device (100) can set the pixel brightness of the display area of ​​the mirror display to 100%.

[0120] In one embodiment, the electronic device (100) can increase only the brightness of specific pixels within the display area of ​​the mirror display (110). In one embodiment, the electronic device (100) can control the brightness of all pixels within the display area of ​​the mirror display (110) collectively so that the necessary content is clearly visible.

[0121] In one embodiment, even if the electronic device (100) controls the mirror display (110) so that the brightness of the display area (10) of the mirror display becomes 'brighter than a reference brightness,' the mirror display (110) can also perform a mirror function. For example, the electronic device (100) can control the mirror display (110) so that the content is clearly visible, but the image of the user located in front of the electronic device (100) is also reflected in part of the electronic device (100).

[0122] In operation 430, the electronic device (100) can control the mirror display such that the brightness of the display area of ​​the mirror display is less than the reference brightness. In one embodiment, the electronic device (100) can control the mirror display such that the brightness of the display area of ​​the mirror display is less than the reference brightness based on the ratio of the content area to the display area being less than the threshold ratio.

[0123] In one embodiment, the electronic device (100) may determine that the mirror function is prioritized over the information display function in the electronic device (100) based on the fact that the ratio of the content area to the display area is less than a threshold ratio. The electronic device (100) may determine that brightness adjustment is necessary to increase the reflectivity of the mirror display (110).

[0124] In one embodiment, the electronic device (100) can adjust (e.g., determine) the brightness of the display area of ​​the mirror display on a pixel-by-pixel basis. In one embodiment, the electronic device (100) can finely adjust the luminescence of each pixel included in the display area of ​​the mirror display to adjust the display brightness to below a reference brightness (e.g., determine). The electronic device (100) can reduce the brightness of the pixels in the display area of ​​the mirror display. The electronic device (100) can individually lower the brightness of the LED light source of each pixel within the display area of ​​the mirror display (110) to increase the overall reflectivity of the screen and enhance the reflection function of the mirror. For example, the electronic device (100) can set (e.g., determine) the pixel brightness of the display area of ​​the mirror display to 0%.

[0125] In one embodiment, the electronic device (100) may lower only the brightness of specific pixels within the display area of ​​the mirror display (110). In one embodiment, the electronic device (100) may collectively adjust (e.g., determine, change) the brightness of all pixels within the display area of ​​the mirror display (110) so that the reflected object appears natural.

[0126] In one embodiment, even if the electronic device (100) controls the mirror display (110) so that the brightness of the display area (10) of the mirror display becomes 'less than reference brightness', the mirror display (110) can also perform an information display function. For example, the electronic device (100) can perform a mirror function so that the image of a user located in front of the electronic device (100) is reflected on the electronic device (100), and can control the mirror display (110) so that the content displayed on the electronic device (100) and the image of the user are displayed.

[0127] FIG. 4b is a reference diagram for explaining an example of controlling the brightness of a display area according to the ratio of the content area to the display area of ​​a mirror display according to one embodiment of the present disclosure.

[0128] In Example 1, 440, the electronic device (100) can identify the proportion of the content area (444) that occupies the display area (442) of the mirror display. In Example 1, 440, a calendar and schedule application is displayed on most of the display area (442) of the mirror display. The electronic device (100) can determine that the proportion of the content area (444) that occupies the display area (442) of the mirror display is greater than or equal to a threshold ratio.

[0129] In Example 1, 440, the electronic device (100) can control the mirror display such that the brightness of the display area of ​​the mirror display is greater than or equal to the reference brightness, based on the fact that the ratio of the content area to the display area is greater than or equal to the threshold ratio. In one embodiment, the electronic device (100) can control the mirror display such that the brightness of the display area of ​​the mirror display is greater than or equal to the reference brightness in order to improve the readability of the calendar and schedule application in the content area (444).

[0130] In Example 1, 440, the electronic device (100) can control a mirror display to improve the readability of a calendar and schedule application, while also reflecting and displaying the appearance of a user located in front of the electronic device (100) on the electronic device (100).

[0131] In Example 2, 450, the electronic device (100) can identify the proportion of the content area (454) that occupies the display area (452) of the mirror display. In Example 2, 450, a schedule application is displayed only on a portion of the upper part of the display area (452) of the mirror display. The electronic device (100) can determine that the proportion of the content area (454) that occupies the display area (452) of the mirror display is less than a threshold ratio.

[0132] In Example 2, 450, the electronic device (100) can control the mirror display such that the brightness of the display area of ​​the mirror display is less than the reference brightness, based on the fact that the ratio of the content area to the display area is less than the threshold ratio. In one embodiment, the electronic device (100) can control the mirror display such that the brightness of the display area of ​​the mirror display is less than the reference brightness in order to improve the readability of the calendar and schedule application in the content area (454).

[0133] In Example 2, 450, the electronic device (100) controls a mirror display so that the image of a user located in front of the electronic device (100) is reflected and displayed on the electronic device (100), and can also display information such as a calendar and schedule application.

[0134] For example, the electronic device (100) may reflect and display the image of a user located in front of the electronic device (100) on the electronic device (100), and may display content dimly in the area where the user's image is displayed. For example, the electronic device (100) may reflect and display the image of a user located in front of the electronic device (100) on the electronic device (100), and may display content clearly by increasing the brightness of the pixels in the content area (454), which is an area where the user's image is not displayed.

[0135] FIG. 5a is a flowchart illustrating a method for controlling the brightness of a person area or an area other than a person area of ​​a mirror display according to one embodiment of the present disclosure.

[0136] In operation 510, the electronic device (100) can acquire an image through a camera. In one embodiment, the camera of the electronic device (100) may represent an image sensor having an image acquisition function. In one embodiment, the electronic device (100) may include a camera. For example, a camera may be attached to the upper center of the electronic device (100), but the present disclosure is not limited to the described embodiments.

[0137] In operation 520, the electronic device (100) can identify a person area projected onto a mirror display based on an acquired image. The angle of the image acquired by the electronic device (100) through a camera and the angle of the object reflected onto the mirror display may be different. The electronic device (100) can identify a person area projected onto a mirror display by performing a viewpoint transformation on the acquired image.

[0138] FIG. 6a is a flowchart illustrating a detailed operation for identifying a person area projected onto a mirror display included in operation 520 according to one embodiment of the present disclosure.

[0139] In operation 610, the electronic device (100) can obtain a projection image that is projected onto a display area of ​​a mirror display from an image obtained by a camera. In one embodiment, the electronic device (100) can obtain a projection image by performing a viewpoint transformation on an image obtained by a camera. Here, obtaining a projection image that is projected onto a display area from an image obtained by a camera may include predicting a projection image from an image obtained by a camera or obtaining an image that is as close as possible to a projection image from an image obtained by a camera.

[0140] In one embodiment, the time (or angle) at which the camera acquires the image and the time (or angle) at which the image is displayed on the display of the electronic device (100) may be different. For example, if the camera is located at the top center of the front of the electronic device (100), the camera may capture an image from top to bottom.

[0141] In one embodiment, the image captured by the camera may be an image of an object to be projected onto the mirror display viewed from a relatively high angle. The object projected onto the mirror display may be an object located in front of the mirror display, such as a conventional mirror.

[0142] The electronic device (100) can correct the difference between the viewpoint of the camera and the viewpoint displayed on the mirror display. For example, the electronic device (100) can calculate the difference between the camera position and the mirror display position and viewpoint. The electronic device (100) can generate a projected image by applying a 3D perspective transformation algorithm to transform the viewpoint of the captured image to be closer to a frontal viewpoint. For example, the electronic device (100) can generate a projected image by applying a homography algorithm to transform the viewpoint of the captured image to be closer to a frontal viewpoint.

[0143] In one embodiment, the electronic device (100) can learn changes in the image reflected on the mirror display according to the position of the camera by utilizing an artificial intelligence algorithm. The electronic device (100) may include an artificial intelligence algorithm that has previously learned changes in the image reflected on the mirror display according to the position of the camera.

[0144] In operation 620, the electronic device (100) can identify a person area in the projected image. The person area may be an area representing the size and location of a person. The location and range of the person area may be identified differently depending on the size and location of the recognized person.

[0145] The electronic device (100) can identify a person area on a mirror display based on an image acquired by a camera. For example, the electronic device (100) can identify a person area by utilizing an artificial intelligence algorithm.

[0146] For example, the electronic device (100) can recognize a person by utilizing an object detection algorithm or a person recognition algorithm in a projected image. Based on the recognized person, the electronic device (100) can identify a person region based on the bounding box of the recognized person. For example, the electronic device (100) can also identify a person region by extracting the accurate outline of the person.

[0147] FIG. 6b is a reference diagram for explaining an example of acquiring an image projected onto a mirror display based on an image acquired by a camera included in operation 610 according to one embodiment of the present disclosure.

[0148] In operation 630, the mirror display of the electronic device (100) can project a user located in front. Since the camera (161) is located at the top center of the electronic device (100), it can acquire an image of the user located in front of the mirror display at a relatively high angle.

[0149] For example, the electronic device (100) can acquire an image (640) through a camera (161).

[0150] For example, the electronic device (100) can perform a viewpoint transformation on the acquired image (640) to acquire a projected image (650) that is projected onto a mirror display.

[0151] Returning to Fig. 5a, in operation 530, the electronic device (100) can set (e.g., determine) the brightness of an area other than the person area differently from the brightness of the person area.

[0152] The electronic device (100) can control the brightness of the display area of ​​the mirror display by area (e.g., determine). In one embodiment, the electronic device (100) can set the brightness of the area other than the person area to be higher than the person area (e.g., determine). In one embodiment, the electronic device (100) can control the brightness of the display area of ​​the mirror display by pixel (e.g., determine). The electronic device (100) can set the pixel brightness corresponding to the person area among the display areas of the mirror display to be lower than the pixel brightness corresponding to the area other than the person area (e.g., determine).

[0153] In one embodiment, the electronic device (100) may determine that the area where the person is projected performs a mirror function by setting the brightness of the person area to a relatively low level. In one embodiment, the electronic device (100) may determine that the area where the person is not projected performs an information display function by setting the brightness of the area other than the person area to a relatively high level (e.g., determined).

[0154] In operation 540, the electronic device (100) can set (e.g., determine) the brightness of the area other than the person area in the mirror display to change gradually based on the distance of the area other than the person area from the person area. The electronic device (100) can set (e.g., determine) a brightness value such that as the area other than the person area in the mirror display moves further away from the person area, the brightness of the area other than the person area changes gradually from the brightness of the person area.

[0155] In one embodiment, the electronic device (100) can set the brightness of the person area to a first brightness. The electronic device (100) can set the brightness of the pixel corresponding to the person area to a first brightness. The electronic device (100) can obtain (or calculate) the distance that an area other than the person area is separated from the person area. For example, the electronic device (100) can obtain (or calculate) the distance that a pixel corresponding to an area other than the person area is separated from the person area. For example, the electronic device (100) can obtain (e.g. identify, calculate, determine) the distance that a pixel corresponding to an area other than the person area is separated from the boundary of the person area.

[0156] In one embodiment, the electronic device (100) can set (e.g., determine) the brightness of an area other than the person area in the mirror display. In one embodiment, as the pixels corresponding to the area other than the person area move further away from the person area, the brightness of the area other than the person area can be set (e.g., determine) to gradually change from the brightness of the person area.

[0157] For example, the electronic device (100) may classify areas other than the person area according to their distance from the person area and individually determine the brightness of the classified areas. For example, the electronic device (100) may calculate (e.g., determine) the distance of the area other than the person area from the person area and set (e.g., determine) the brightness of the area other than the person area to a continuously changing value according to the distance. For example, the electronic device (100) may increase the brightness and decrease the reflectivity as the area other than the person area moves further away from the person area.

[0158] For example, if the brightness of the person area is 50%, the brightness of the area where the distance from the area outside the person area is greater than or equal to the first distance and less than the second distance can be set to 60%, the brightness of the area where the distance from the area outside the person area is greater than or equal to the second distance and less than the third distance can be set to 70%, and the brightness of the area where the distance from the area outside the person area is greater than or equal to the third distance and less than the fourth distance can be set to 80%. In this case, the first distance may be greater than the second distance, the second distance may be greater than the third distance, and the third distance may be greater than the fourth distance.

[0159] The electronic device (100) can gradually adjust the brightness of the area other than the person area so that the person area and the area other than the person area blend together without any sense of disparity. For example, the electronic device (100) can provide an effect where the brightness of the area other than the person area fades in or fades out from the brightness of the person area.

[0160] FIG. 5b is a reference diagram for explaining an example of controlling the brightness of a person area or an area other than a person area of ​​a mirror display according to one embodiment of the present disclosure.

[0161] The electronic device (100) can identify a person area (550) projected onto the mirror display based on an image acquired by a camera. The electronic device (100) can identify a content area (560) displayed on the mirror display.

[0162] In operation 570, the electronic device (100) can set (e.g., determine) the brightness of an area other than the person area in the mirror display differently from the brightness of the person area.

[0163] For example, the electronic device (100) can achieve a technical effect that increases the user's concentration on the person by adjusting the brightness of the person area (550) to lower and the reflectivity to raise so that the person is projected, and by adjusting the brightness of the surrounding content area (560) to relatively raise and the reflectivity to lower.

[0164] For example, the electronic device (100) may provide a function to gradually reduce the brightness of the surrounding area outside the person area (550). For example, the electronic device (100) may adjust the mirror display so that the brightness of the area outside the person area gradually increases and the reflectivity gradually decreases.

[0165] As the electronic device (100) adjusts the mirror display so that the brightness of the area other than the person area gradually increases, the user can pay more attention to the person's facial expressions or actions. Through this, the electronic device (100) can provide the user with an immersive experience by clearly distinguishing the visual difference between the person and the content in situations such as video conferencing or video calls.

[0166] In addition, the electronic device (100) can adjust the brightness and color of the person area according to the user's needs, thereby providing an optimal visual experience in various environments. This technology can contribute to improving the efficiency of video conferencing, real-time broadcasting, and the consumption of various multimedia content.

[0167] FIG. 7a is a flowchart illustrating a method for adjusting the brightness of a display area of ​​a mirror display based on the surrounding environment of an electronic device according to one embodiment of the present disclosure.

[0168] The electronic device (100) can recognize the surrounding environment of the electronic device (100). The surrounding environment of the electronic device (100) may represent physical conditions or situations near the electronic device (100). The surrounding environment may include various information related to the environment or user when the electronic device (100) displays content on the display area of ​​the mirror display. For example, the surrounding environment may include at least one of ambient light, the presence or absence of a user, or user actions. The electronic device (100) can adjust the brightness of the display area of ​​the mirror display based on the acquired surrounding environment. As an example thereof, a method for adjusting the brightness of the display area of ​​the mirror display based on the ambient light of the electronic device (100) will be described below.

[0169] In operation 330, the electronic device (100) can adjust (e.g., determine) the brightness of the display area of ​​the mirror display based on the sensor value obtained by the light sensor.

[0170] In one embodiment, the electronic device (100) may include an illuminance sensor. The illuminance sensor is a sensor that measures the brightness of the space where the electronic device (100) is located. The illuminance sensor may include, for example, a photoresistor, a photodiode, or a phototransistor. The illuminance sensor may be positioned in front of the electronic device (100) facing the space where the electronic device (100) is located to detect the illuminance of the space where the electronic device (100) is located, but is not limited to this example. The electronic device (100) may generate a sensor value and transmit it to a processor.

[0171] FIG. 7b is a flowchart for explaining a detailed operation of adjusting the brightness of a display area of ​​a mirror display based on a sensor value acquired by an illuminance sensor included in operation 330 according to one embodiment of the present disclosure.

[0172] In operation 710, the electronic device (100) can identify whether the sensor value acquired by the illuminance sensor is greater than or equal to a threshold illuminance.

[0173] In one embodiment, the electronic device (100) can obtain an illuminance value using an illuminance sensor. According to one embodiment of the present disclosure, the electronic device (100) can obtain an illuminance value by performing a predetermined processing on the sensor value obtained from the illuminance sensor. The electronic device (100) determines whether the illuminance value is greater than or equal to a threshold illuminance. The threshold illuminance may be, for example, 6 lux.

[0174] In operation 720, the electronic device (100) can adjust to lower the brightness of the display area of ​​the mirror display. In one embodiment, if the sensor value acquired by the illuminance sensor is greater than or equal to a threshold illuminance, the electronic device (100) can adjust to lower the brightness of the display area of ​​the mirror display. By lowering the brightness of the display area of ​​the mirror display, the electronic device (100) can improve the visibility of the screen and use energy efficiently in an environment with high ambient illuminance.

[0175] For example, if the ambient illumination of the electronic device (100) is above a threshold illumination level, the user of the electronic device (100) may feel glare when the electronic device (100) sets the brightness of the display area of ​​the mirror display high. In this case, the user of the electronic device (100) may feel eye strain. In this case, the electronic device (100) can create a comfortable user environment for the electronic device by lowering the brightness of the display area of ​​the mirror display to increase the contrast between the brightness of the mirror display and the ambient illumination of the electronic device (100).

[0176] In one embodiment, an illuminance sensor of an electronic device (100) can detect (e.g., identify) a change in ambient illuminance. When the electronic device (100) identifies that the ambient illuminance has changed above a threshold illuminance, it can adjust the brightness of the display area of ​​the mirror display based on the acquired sensor value. The electronic device (100) can determine the brightness of the display area of ​​the mirror display based on the ambient illuminance. By adjusting the brightness of the display area of ​​the mirror display, the electronic device (100) can improve the user's experience of using the electronic device.

[0177] In one embodiment, as the electronic device (100) lowers the brightness of the display area of ​​the mirror display, the reflectivity of the mirror display may be increased. The relationship between the brightness of the display area of ​​the mirror display and the reflectivity is to be explained with reference to FIG. 9a and FIG. 9b, and for brevity, redundant descriptions are omitted here.

[0178] In operation 730, the electronic device (100) can adjust to increase the brightness of the display area of ​​the mirror display. In one embodiment, if the sensor value acquired by the illuminance sensor is less than the threshold illuminance, the electronic device (100) can adjust to increase the brightness of the display area of ​​the mirror display. By increasing the brightness of the display area of ​​the mirror display, the electronic device (100) can ensure readability so that the user can more easily read the text of the electronic device (100) in an environment with low (or dark) ambient illuminance.

[0179] For example, if the ambient light of the electronic device (100) is below a threshold light level, the electronic device (100) may set the brightness of the display area of ​​the mirror display low, and the user of the electronic device (100) may have difficulty perceiving the content displayed on the electronic device (100). For example, if the brightness of the display area of ​​the mirror display is set low in an environment with low ambient light, the text or image displayed on the electronic device (100) may resemble a dark background, making the screen content appear blurry or difficult to recognize.

[0180] In one embodiment, an illuminance sensor of the electronic device (100) can detect a change in ambient illuminance. When the electronic device (100) detects that the ambient illuminance has changed to below a threshold illuminance, it can adjust the brightness of the display area of ​​the mirror display based on the acquired sensor value. The electronic device (100) can determine the brightness of the display area of ​​the mirror display based on the ambient illuminance. By adjusting the brightness of the display area of ​​the mirror display, the electronic device (100) can improve the user's experience of using the electronic device.

[0181] In one embodiment, as the electronic device (100) increases the brightness of the display area of ​​the mirror display, the reflectivity of the mirror display may increase. The relationship between the brightness of the display area of ​​the mirror display and the reflectivity is to be explained with reference to FIG. 9a and FIG. 9b, and for brevity, redundant descriptions are omitted here.

[0182] FIG. 8a is a flowchart illustrating a method for adjusting the brightness of a content area and an area other than the content area according to one embodiment of the present disclosure.

[0183] In operation 810, the electronic device (100) can identify an object of the content. In one embodiment, the content may represent an image displayed on the electronic device (100). In one embodiment, the content may represent an image input to the electronic device (100). The electronic device (100) can identify (or recognize) an object included in the content. In one embodiment, the object of the content may be an object displayed within a disconnected screen frame.

[0184] In one embodiment, the object may be at least one of a person or a thing. The electronic device (100) may use computer vision technology (e.g., an object detection algorithm) to identify the object of the content. The electronic device (100) may extract the location and size of the object in the screen frame. The electronic device (100) may analyze the characteristics of the object using a machine learning model and, based on this, distinguish whether the object is a person, an animal, or a specific thing.

[0185] For example, if the content contains multiple fish, the electronic device (100) can identify each fish and extract the location and size of the identified fish to determine whether there are any parts of the fish that are cut off in the middle of the screen.

[0186] For example, the electronic device (100) may use a face recognition algorithm to recognize a specific person in the content.

[0187] In operation 820, the electronic device (100) can obtain a content area by inpainting an area around an identified object. In one embodiment, inpainting may mean a method of obtaining a natural image by filling a specific area with a different background or treating it as if the object did not exist. The electronic device (100) may use an artificial intelligence-based inpainting algorithm. The electronic device (100) can naturally fill an empty area by inpainting an area around an identified object in a screen frame.

[0188] For example, if the content includes multiple fish and the fish located near the corners are in a cut-off form, the electronic device (100) can inpaint the area around the identified fish to obtain a content area that blends with the background area without the fish being cut off in the middle.

[0189] In operation 830, the electronic device (100) can set the brightness of an area other than the content area in the mirror display differently from the brightness of the content area.

[0190] In one embodiment, the electronic device (100) may set the brightness of the content area to a first brightness and the brightness of the area other than the content area to a second brightness. The first brightness may be a higher value than the second brightness or a lower value.

[0191] In one embodiment, the brightness of the content area of ​​the electronic device (100) can be set to a first brightness, and the brightness of the remaining area can be set to a value that gradually changes from the first brightness to the second brightness. For example, the electronic device (100) can gradually adjust at least one of the brightness or reflectivity of the surrounding area of ​​an identified object so that the content area can naturally blend with the area other than the content area.

[0192] In operation 840, the electronic device (100) can set the brightness of each point in the area other than the content area in the mirror display. In one embodiment, the electronic device (100) can set the brightness of each point in the area other than the content area in the mirror display to gradually change from the brightness of the content area as it moves further away from the content area.

[0193] In one embodiment, the electronic device (100) can be configured so that each point in an area other than the content area in the mirror display gradually becomes darker or brighter as it moves further away from the content area. The electronic device (100) can use coordinate information of each pixel in the display area of ​​the mirror display to change the brightness value of a specific point in proportion to the distance that point is from the center or boundary of the content area. For example, the brightness of each point in an area other than the content area can be set such that an area close to the center or boundary of the content area maintains a brightness similar to that of the content area, and the brightness is gradually lowered or raised as it moves further away.

[0194] In one embodiment, the electronic device (100) can set (e.g., determine) a brightness change value using the difference in distance between pixels between a content area and an area other than the content area. The electronic device (100) can set (e.g., determine) the brightness of the pixel corresponding to the area other than the content area to gradually change from the brightness of the content area as the distance between the pixel corresponding to the area other than the content area and the pixel corresponding to the content area increases in the mirror display. The electronic device (100) can transition the brightness more smoothly by applying a linear change or a non-linear change such as a Gaussian function.

[0195] For example, the electronic device (100) can create an environment where one can naturally focus by using a Gaussian brightness control method so that the brightness around the content area decreases gradually and the distant area becomes rapidly dark.

[0196] FIG. 8b is a flowchart illustrating an example of adjusting the brightness of a content area and an area other than the content area according to one embodiment of the present disclosure.

[0197] In one embodiment, the first mirror display (850) displays content (852). The electronic device (100) can identify an object of the content (852). In one embodiment, the electronic device (100) can determine that an object of the content (852) is contained within a disconnected screen frame. In one embodiment, the electronic device (100) can obtain a content area (862) by inpainting a surrounding area of ​​the identified content (852).

[0198] In one embodiment, the second mirror display (870) may display a content area (872). The electronic device (100) may set (e.g., determine) the brightness of an area other than the content area (872) in the second mirror display (870) differently from the brightness of the content area (e.g., higher or lower).

[0199] In one embodiment, the electronic device (100) may be set (e.g., determined) such that each point in the area other than the content area in the second mirror display (870) gradually changes from the brightness of the content area (872) as it moves further away from the content area (872). By doing so, the electronic device (100) can naturally display the content on the second mirror display (870). In one embodiment, the electronic device (100) may be set (e.g., determined) at least one of the brightness of the content area or the brightness of the area other than the content area so that the boundary between the content and the mirror blends naturally.

[0200] FIG. 9a is a reference diagram for explaining the relationship between brightness and reflectance of a mirror display according to one embodiment of the present disclosure.

[0201] In one embodiment, the brightness of the mirror display may represent the intensity of light emitted by the display. The brightness of the mirror display may determine the degree to which the content displayed on the display is clearly visible. For example, the higher the brightness of the mirror display, the more clearly the content displayed on the mirror display may be seen. For example, the higher the brightness of the mirror display, the more the effect of the mirror display as a 'display' may be emphasized.

[0202] In one embodiment, the reflectance of the mirror display may represent the ratio of external light reflected from the surface of the mirror display. In one embodiment, the higher the reflectance, the better the mirror display can reflect objects outside the mirror display. For example, the higher the reflectance of the mirror display, the more the effect of the mirror display as a 'mirror' can be emphasized.

[0203] In one embodiment, the brightness and reflectance of the mirror display may have a constant relationship. In one embodiment, the brightness and reflectance of the mirror display may have an inverse relationship.

[0204] For example, referring to Table 910, if the reflectance decreases by the first ratio (912), the brightness can increase by the first ratio (912). For example, if the reflectance increases by the second ratio (914), the brightness can decrease by the second ratio (914).

[0205] For example, referring to Table 910, if brightness increases by the first ratio (912), reflectance may decrease by the first ratio (912). For example, if brightness decreases by the second ratio (914), reflectance may increase by the second ratio (914).

[0206] Table 910 shows brightness and reflectance as integer values ​​for convenience of explanation, but the embodiments of the present disclosure are not limited thereto.

[0207] FIG. 9b is a reference diagram for briefly explaining the principle of a mirror display according to one embodiment of the present disclosure.

[0208] The mirror display of the present disclosure can be implemented in various forms. For example, the mirror display may be implemented through a micro LED mirror, may be implemented through a switchable mirror, or may be implemented as an electronic device including a mirror and a display. Below, we will briefly explain how the operation of the electronic device (100) described above with reference to FIGS. 1 to 9a can be implemented through a micro LED mirror.

[0209] A micro LED mirror (920) is a display that can simultaneously provide the functions of a mirror and a display by utilizing micro LED technology. The micro LED mirror may include micro LEDs (930), which are small LED elements of micrometer (μm) size. For example, the micro LEDs (930) may have a width and height of 508 μm each, but are not limited to this example. The micro LEDs (930) may be self-emissive displays in which each element emits light independently. An electronic device (100) can control each micro LED (930) individually. By turning on some of the micro LEDs (930) of the micro LED mirror (920), the electronic device (100) may display content in some areas and not display content in others. The areas that do not display content may function as mirrors.

[0210] The micro LED mirror (920) may include a highly reflective coating, such as mirror glass (940), on the panel surface. By including mirror glass (940), the micro LED mirror (920) can function as a mirror when the micro LED (930) is not emitting light (i.e., when the display is off). The mirror glass (940) can reflect light. When the micro LED element emits light, light is transmitted through the mirror glass (940) so that content can be displayed on the mirror display (110). The mirror glass (940) may be an Al-Nb (aluminum-niobium) alloy mirror.

[0211] A micro LED mirror (920) can be implemented in a form that enables both light transmission and reflection by arranging micro LEDs (930) on a substrate (950). If necessary, the micro LEDs (930) can act as a display while emitting light. When the micro LEDs (930) do not emit light, light is not transmitted, so the micro LED mirror (920) can function as a highly reflective mirror. The micro LEDs (930) may include RGB chips (i.e., red chips, green chips, and blue chips).

[0212] In one embodiment, the micro LED mirror (920) has a special structure that can be switched between a mirror and a display by controlling the light emission of the mirror glass (940) and the micro LED (930), and can achieve a reflectivity suitable for the usage environment through the combination of these two functions.

[0213] FIG. 10a is a flowchart illustrating a method for controlling a mirror display based on user input according to one embodiment of the present disclosure.

[0214] In operation 1010, the electronic device (100) can obtain user input. In one embodiment, the electronic device (100) can control (e.g., determine, adjust) the brightness of the display area of ​​the mirror display based on the user input.

[0215] The electronic device (100) can obtain user input through various means. For example, the electronic device (100) can obtain user input through button clicks, touchscreen operations, or voice commands of the electronic device (100). For example, the electronic device (100) can obtain user input by receiving values ​​input to an external electronic device or an external server through a communication interface. For example, user input may be obtained through physical input by the user to an external device (e.g., pressing a button on a remote controller). For example, user input may be obtained through a user interface provided by an external device. For example, user input may be obtained through a user interface provided by the electronic device (100).

[0216] In one embodiment, the user input may be an input that directly controls the brightness of the mirror display. In one embodiment, the user input may be an input that selects one of the preset brightness modes of the mirror display.

[0217] In one embodiment, the electronic device (100) may receive user input selecting a screen mode that sets the brightness of the display area of ​​the mirror display to be greater than or equal to a reference brightness. In one embodiment, the electronic device (100) may receive user input selecting a mirror mode that sets the brightness of the display area of ​​the mirror display to be less than or equal to a reference brightness.

[0218] In operation 1020, the electronic device (100) can switch to screen mode or mirror mode based on user input.

[0219] In one embodiment, the electronic device (100) can switch to a screen mode based on user input. In one embodiment, when the electronic device (100) switches to a screen mode, the brightness of the display area of ​​the mirror display can change above a reference brightness. In this case, the mirror display of the electronic device (100) can be used to display content.

[0220] In one embodiment, the electronic device (100) can switch to a mirror mode based on user input. In one embodiment, when the electronic device (100) switches to a mirror mode, the brightness of the display area of ​​the mirror display can change to a level below a reference brightness. In this case, the electronic device (100) can perform a role similar to a mirror.

[0221] In one embodiment, the reference brightness may be a value that serves as a reference for switching between the screen mode and the mirror mode of the mirror display. The reference brightness may be a value adjusted according to user settings or a preset value.

[0222] In one embodiment, the electronic device (100) can adjust the brightness of the mirror display according to various types of user input, such as voice commands, touch operations, and gesture recognition. For example, if a user gives a voice command saying "screen mode" in front of the electronic device (100), it switches to screen mode, and the brightness of the display area of ​​the mirror display can be increased so that various information such as news, weather, and schedules can be checked. For example, if a user inputs a command saying "mirror mode" in front of the electronic device (100), the electronic device (100) switches to mirror mode, and the brightness of the display area of ​​the display can be lowered.

[0223] FIG. 10b is a reference diagram for explaining an example of controlling a mirror display based on user input according to one embodiment of the present disclosure.

[0224] In operation 1030, the electronic device (100) may be a screen mode in which the brightness of the display area is set to be greater than or equal to the reference brightness. In operation 1030, the electronic device (100) may receive user input for selecting (or switching to) a mirror mode in which the brightness of the display area is set to be less than the reference brightness. User input for selecting (or switching to) a mirror mode may be input to the electronic device (100) through a physical button, or may be input to the electronic device (100) through a touch screen of the mirror display.

[0225] In operation 1040, the electronic device (100) can switch to mirror mode based on user input obtained in operation 1030. In one embodiment, the electronic device (100) can set the brightness of the display area of ​​the mirror display to below a reference brightness. In one embodiment, the electronic device (100) can increase the visibility of a person projected onto the mirror of the mirror display by lowering the brightness of the display area of ​​the mirror display.

[0226] In operation 1040, the electronic device (100) may be in a mirror mode in which the brightness of the display area is set to less than the reference brightness. In operation 1040, the electronic device (100) may receive user input to select (or switch to) a screen mode in which the brightness of the display area is set to greater than or equal to the reference brightness.

[0227] In operation 1050, the electronic device (100) can switch to a screen mode based on user input obtained in operation 1040. In one embodiment, the electronic device (100) can set the brightness of the display area of ​​the mirror display to be greater than or equal to a reference brightness. In one embodiment, the electronic device (100) can increase the readability of the content displayed on the mirror display by increasing the brightness of the display area of ​​the mirror display.

[0228] As previously explained with reference to FIGS. 10a and 10b, the electronic device (100) can increase user convenience by controlling the brightness of the display area of ​​the mirror display based on user input.

[0229] The method for adjusting the brightness of a mirror display based on user input, described above with reference to FIGS. 10a and 10b, can be used in conjunction with the method described above with reference to FIGS. 1 to 9.

[0230] For example, if the ambient illumination of the electronic device (100) is greater than or equal to a threshold illumination, and the electronic device (100) obtains user input selecting a screen mode, the electronic device (100) can increase the brightness of the display area of ​​the mirror display based on the user input selecting the screen mode, but can adjust the brightness of the display area of ​​the mirror display to be lower based on the ambient illumination (i.e., so that the brightness is not excessively high and impairs the user's visibility).

[0231] FIG. 11 is a flowchart illustrating a method for controlling a mirror display based on identifying a person in an image according to one embodiment of the present disclosure.

[0232] In operation 1110, the electronic device (100) can determine whether a person is identified in an image acquired through a camera. In one embodiment, the electronic device (100) can detect (e.g., identify, determine) whether a person is present in an image acquired through a camera.

[0233] In one embodiment, the electronic device (100) can detect (e.g., identify) a human object in an image based on an object detection algorithm. The electronic device (100) can determine (e.g., identify) whether there is a person in the image using a pre-trained artificial intelligence model.

[0234] In one embodiment, the electronic device (100) can determine whether there is a person in the image by detecting (e.g., identifying) an object based on a person's silhouette or outline. In one embodiment, the electronic device (100) can determine whether there is a person in the image by detecting an object through a machine learning technique (e.g., identifying, determining).

[0235] In operation 1120, based on the identification of a person in an image acquired by the electronic device (100) through a camera, the electronic device (100) may determine that a person is present in front of the electronic device (100). Based on the determination that a person is present in front of the electronic device (100), the electronic device (100) may adjust the brightness of the display area of ​​the mirror display.

[0236] In one embodiment, the electronic device (100) may set (e.g., determine) the brightness of the display area of ​​the mirror display of the electronic device (100) to below a reference brightness based on the determination that a person has been identified in an image acquired through a camera. The electronic device (100) may switch to mirror mode. By adjusting the brightness of the display area of ​​the mirror display based on the identification of a person, the electronic device (100) can adjust the brightness of the electronic device (100) without direct input from the user, thereby increasing user convenience. Since mirror mode has been described above with reference to FIGS. 10a and FIGS. 10b, redundant descriptions will be omitted here for brevity.

[0237] FIG. 12 is a reference diagram for explaining an example of controlling an electronic device by region according to one embodiment of the present disclosure.

[0238] The electronic device (100) may include a mirror display on at least one of the front or rear of the electronic device (100). For example, if the electronic device (100) is a mobile phone, the display of the mobile phone may be a mirror display, or the display of the mobile phone may be a regular display, but the outer cover of the mobile phone may include a mirror display.

[0239] In one embodiment of the present disclosure, all or part of the display of the electronic device (100) may be configured as a mirror display. In one embodiment of the present disclosure, all or part of the outer cover of the electronic device (100) may include a mirror display.

[0240] For example, the mirror display may be included only on the top outer cover of the electronic device (100), the mirror display may be included only on the bottom outer cover, or the mirror display may be included on both the top and bottom outer covers. For example, the mirror display may also be included in the part connecting the top and bottom parts of the electronic device (100). For example, the mirror display may not be included in the part connecting the top and bottom parts of the electronic device (100).

[0241] For example, even if the outer cover of the electronic device (100) is a single piece, a mirror display may be included in all or part of the outer cover.

[0242] In operation 1210, the electronic device (100) can set the brightness of the entire display area of ​​the mirror display to less than the reference brightness. In one embodiment, the electronic device (100) can use the entire mirror display in mirror mode.

[0243] In one embodiment, the electronic device (100) may use the entire mirror display in a mirror mode based on the ratio of the content area displayed in the display area of ​​the mirror display. For example, the electronic device (100) may use the entire mirror display in a mirror mode based on the ratio of the content area displayed in the display area of ​​the mirror display being less than a threshold ratio.

[0244] In one embodiment, the electronic device (100) can display (or project, reflect) an object on the front of the electronic device (100) on the electronic device (100). For example, the electronic device (100) can display (or project, reflect) a user on the front of the electronic device (100) on the electronic device (100).

[0245] In one embodiment, the electronic device (100) can set the brightness of the area outside the person in the mirror display differently from the brightness of the person area by recognizing a person. In one embodiment, the electronic device (100) can set the brightness of each point in the area outside the person in the mirror display to gradually change from the brightness of the person area as each point moves further away from the person area. An embodiment in which the display area of ​​the mirror display of the electronic device (100) is used in mirror mode is as described above, and for brevity, redundant descriptions are omitted here.

[0246] In operation 1220, the electronic device (100) can set the brightness of the display area of ​​the mirror display to a plurality of different values. In one embodiment, the electronic device (100) can divide the display area of ​​the mirror display into a plurality of regions and determine the brightness of the divided plurality of regions to a plurality of different values. In one embodiment, the electronic device (100) can divide the display area of ​​the mirror display into a plurality of regions and determine the reflectance of the divided plurality of regions to a plurality of different values.

[0247] For example, the electronic device (100) can set the brightness of a first area of ​​the display area of ​​the mirror display to a first brightness, and the brightness of a second area to a second brightness. For example, the electronic device (100) can set the brightness of a first area of ​​the display area of ​​the mirror display to a first brightness, the brightness of a second area to a second brightness, the brightness of a third area to a third brightness, and the brightness of a fourth area to a fourth brightness.

[0248] In one embodiment, the electronic device (100) may set the reflectance of a first area among the display areas of the mirror display as a first reflectance and the reflectance of a second area as a second reflectance. For example, the electronic device (100) may set the reflectance of a first area among the display areas of the mirror display as a first reflectance, the reflectance of a second area as a second reflectance, the reflectance of a third area as a third reflectance, and the reflectance of a fourth area as a fourth reflectance.

[0249] Through this, the electronic device (100) can adjust the brightness or reflectivity for each area of ​​the display area of ​​the mirror display. The electronic device (100) can improve the visual information transmission function by displaying (or outputting) content more clearly in areas of the display area of ​​the mirror display that are further from the person area, and can provide a more natural viewing experience to the user by displaying (or projecting, reflecting) the person more clearly in areas of the display area that are closer to the person area.

[0250] For example, the electronic device (100) can set the brightness of the first area (1221) of the display area of ​​the mirror display to 100% and the reflectance to 0%. The electronic device (100) can clearly display the content displayed (or output) in the first area (1221). The electronic device (100) may not display a person projected in the first area (1221). The electronic device (100) can set the first area (1221) to screen mode to disable the mirror function and at the same time make the content appear clearly. External light or an image of a person may not be reflected in the first area (1221). The electronic device (100) can set the first area (1221) so that the content output to the mirror display is visually focused and a person is not projected, thereby allowing the user to focus only on the screen information of the first area (1221).

[0251] In one embodiment, the electronic device (100) may set the brightness of the second area (1222) of the display area of ​​the mirror display to 0% and the reflectance to 100%. The electronic device (100) may set the second area (1222) to mirror mode to disable the display function and control it so that a person or object is reflected most clearly as a mirror. The electronic device (100) may clearly display a person or object reflected (or projected) in the second area (1222). The electronic device (100) may not display content included (or output) in the second area (1222).

[0252] In one embodiment, the electronic device (100) may set the brightness of the third area (1223) of the display area of ​​the mirror display to 30% and the reflectance to 70%. The electronic device (100) may set the third area (1223) to a mirror + screen mode (e.g., a hybrid mode). The electronic device (100) may simultaneously display a person reflected (or projected) in the third area (1223) and content included (or output) in the third area (1223). The electronic device (100) may display the person reflected (or projected) in the third area (1223) while displaying the content included (or output) in the third area (1223) dimly (or at a brightness relatively lower than that of the first area, the fourth area, or the fifth area). The electronic device (100) can set the third area (1223) to mirror + screen mode so that it can display information in a blurry form while showing a person through a mirror display.

[0253] In one embodiment, the electronic device (100) may set the brightness of the fourth area (1224) of the display area of ​​the mirror display to 70% and the reflectance to 30%. The electronic device (100) may simultaneously display a person reflected (or projected) in the fourth area (1224) and content included (or output) in the fourth area (1224). The electronic device (100) may set the fourth area (1224) to a mirror + screen mode (e.g., a hybrid mode). The electronic device (100) may display the person reflected (or projected) in the fourth area (1224) while displaying the content included (or output) in the fourth area (1224) dimly (or at a brightness relatively lower than that of the first area or the fifth area). The electronic device (100) can display the content displayed in the fourth area (1224) more clearly than the content displayed in the third area (1223).

[0254] For example, the electronic device (100) can set the brightness of the fifth area (1225) of the display area of ​​the mirror display to 100% and the reflectivity to 0%. The electronic device (100) can clearly display the content displayed (or output) in the fifth area (1225). The electronic device (100) may not display a person projected in the fifth area (1225). The electronic device (100) can set the fifth area (1225) to screen mode to disable the mirror function while simultaneously making the content appear clearly. External light or an image of a person may not be reflected in the fifth area (1225). The electronic device (100) can set the fifth area (1225) so that the content output to the mirror display is visually focused and a person is not projected, thereby allowing the user to focus only on the screen information of the fifth area (1225).

[0255] In one embodiment, the electronic device (100) can set (or personalize) the brightness and reflectance differently for each area of ​​the display area of ​​the mirror display according to the user's preference or need. By doing so, the electronic device (100) can optimize the user experience.

[0256] In operation 1230, the electronic device (100) can set the brightness of the entire display area of ​​the mirror display to be greater than or equal to the reference brightness. In one embodiment, the electronic device (100) can use the entire mirror display in screen mode.

[0257] In one embodiment, the electronic device (100) can use the entire mirror display in screen mode based on the ratio of the content area displayed in the display area of ​​the mirror display. For example, the electronic device (100) can use the entire mirror display in screen mode based on the ratio of the content area displayed in the display area of ​​the mirror display being greater than or equal to a threshold ratio.

[0258] In one embodiment, the electronic device (100) can display the content of the electronic device (100) on the electronic device (100). For example, the electronic device (100) can display at least one of the contents of a photo, video, game, ambient art, or application processed by the processor (130) of the electronic device (100) on the electronic device (100). An embodiment in which the display area of ​​the mirror display of the electronic device (100) is used in screen mode is as described above, and for brevity, redundant descriptions are omitted here.

[0259] FIG. 13 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0260] In one embodiment, the electronic device (100) may include a memory (120), a processor (130), a mirror display (110), a communication interface (140), an input / output interface (150), a sensor (160), an audio output interface (170), a video processing interface (175), an audio processing interface (180), and a power module (190). The electronic device (100) may be composed of various combinations of the components shown in FIG. 13, and not all of the components shown in FIG. 13 are essential components.

[0261] The mirror display (110) can output a video signal to the screen of the electronic device (100) under the control of the processor (130). For example, the electronic device (100) can output content through the mirror display (110). The mirror display (1330) can generate a driving signal by converting a video signal, data signal, OSD signal, control signal, etc. processed by the processor (130), and can display an image according to the driving signal.

[0262] The mirror display (110) may include any one of a liquid crystal display, a plasma display, an organic light emitting diode display, or an inorganic light emitting diode display. However, the present disclosure is not limited thereto, and the mirror display (1330) may include other types of displays capable of displaying content.

[0263] The memory (120) can store a program related to the operation of the electronic device (100) and various data generated during the operation of the electronic device (100). The memory (120) can store at least one instruction. Additionally, the memory (120) may store at least one instruction executed by the processor (130). Additionally, the memory (120) may store at least one program executed by the processor (130). Additionally, the memory (120) may store an application for providing a specific service.

[0264] The memory (120) may include various types of memory. The memory (120) may include a main memory that stores data currently being processed in the electronic device (100). For example, the main memory may include non-volatile memory including at least one of ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), and PROM (Programmable Read-Only Memory), and volatile memory such as RAM (Random Access Memory) or SRAM (Static Random Access Memory).

[0265] The memory (120) may include a secondary memory that permanently stores a large amount of data (e.g., programs, system files, etc.). For example, the secondary memory may include a hard disk drive (HDD), a solid-state drive (SSD), an optical drive (e.g., a CD), a flash drive, etc., but is not limited thereto.

[0266] The processor (130) can control the overall operations of the electronic device (100). For example, the processor (130) can perform the functions of the electronic device (100) described in this disclosure by executing one or more instructions stored in memory (120) individually or collectively. The processor (130) may include a processing circuit. There may be one or more processors (130).

[0267] In an embodiment of the present disclosure, the processor (130) may store one or more instructions in an internally provided memory and control the operation of the electronic device (100) to be performed by executing one or more instructions stored in the internally provided memory. That is, the processor (130) may perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory (120) provided within the processor (130).

[0268] According to one embodiment, the processor (130) can perform the operation of the electronic device (100) described in the present disclosure by executing one or more instructions stored in memory (120).

[0269] The processor (130) may be composed of at least one of, for example, a Central Processing Unit (CPU), a Microprocessor, a Graphic Processing Unit (GPU), ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), an Application Processor (AP), a Neural Processing Unit (NPU), or an AI-dedicated processor designed with a hardware structure specialized for processing AI models, but is not limited thereto.

[0270] The communication interface (140) can perform data communication with other electronic devices (e.g., servers) under the control of the processor (130). Here, 'communication' may mean the operation of transmitting and / or receiving data, signals, requests, and / or commands, etc. The communication interface (140) may include a communication circuit.

[0271] The communication interface (140) can perform wired or wireless communication with at least one external device. The external device may be a server, etc. For example, the communication interface (140) may include at least one of a communication module, a communication circuit, a communication device, an input / output port, and an input / output plug for performing wired or wireless communication with at least one external device.

[0272] The communication interface (140) may include one or more modules that enable wired wireless communication between the electronic device (100) and a wireless communication system or between the electronic device (100) and a network where another electronic device is located. For example, the communication interface (140) may include a mobile communication module (141), a wireless internet module (142), a Wi-Fi communication module (143), and a Bluetooth communication module (144).

[0273] The mobile communication module (141) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signals may include various forms of data such as voice call signals, video call call signals, or text / multimedia message transmission and reception.

[0274] The wireless internet module (142) refers to a module for wireless internet access, which may be built into or externally mounted on a device. Wireless internet technologies such as WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), WiMAX (World Interoperability for Microwave Access), and HSDPA (High Speed ​​Downlink Packet Access) may be used. Through the wireless internet module (142), the electronic device (100) can establish a Wi-Fi P2P (Peer to Peer) connection with another electronic device.

[0275] The communication interface (140) may include a short-range communication module for short-range communication. Short-range communication technologies such as Bluetooth, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra-Wideband), and ZigBee may be used. The communication interface (140) may include a Wi-Fi communication module (143) and a Bluetooth communication module (144) as short-range communication modules.

[0276] The input / output interface (150) processes input / output from outside the electronic device (100). The input / output interface (150) receives video (e.g., video, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.). The input / output interface (150) may include any one of an HDMI (High-Definition Multimedia Interface) port (151), a component jack (152), a PC port (153), a USB (Universal Serial Bus) port (154), an MHL (Mobile High-Definition Link), a DP (Display Port), a Thunderbolt, a VGA (Video Graphics Array) port, an RGB port, a D-SUB (D-subminiature), a DVI (Digital Visual Interface), and an audio jack. In one embodiment, the input / output interface (150) may be implemented to include a plurality of modules (e.g., USB port, HDMI port, etc.) for implementing the aforementioned input / output methods. The electronic device (100) may be connected to external devices such as a display, camera, microphone, speaker, touchpad, set-top box, etc. through the input / output interface (150).

[0277] The sensor (160) can acquire sensor data. There may be one or more sensors (160). The sensor (160) can detect ambient light, the presence or absence of a user, or the user's actions. The processor (130) can acquire information by processing the sensor data. The sensor (160) may include a camera (161), a microphone (162), a motion sensor (163), and an illuminance sensor (164). The sensor (160) can transmit the acquired sensor values ​​to the processor (130). The processor (130) can acquire the surrounding environment of the electronic device by applying a predetermined processing to the acquired sensor values. Based on the acquired surrounding environment, the electronic device (100) can adjust the brightness of the display area of ​​the mirror display. Since the function performed by each component of the sensor (160) is self-evident from the name of each sensor, redundant descriptions are omitted here for brevity.

[0278] The audio output interface (170) can output audio (e.g., voice, sound) input from the communication interface (140) or the input / output interface (150). Additionally, the audio output interface (170) can output audio stored in memory (120) under the control of the processor (130). The audio output interface (170) may include at least one of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface) output terminal, or a combination thereof.

[0279] The video processing interface (175) performs processing on video data played by the electronic device (100). The video processing interface (175) can perform various image / video processing on the video data, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, rendering, etc.

[0280] The audio processing interface (180) performs processing on audio data played by the electronic device (100). Various processing such as decoding, amplification, and noise filtering can be performed on the audio data at the audio processing interface (180).

[0281] The power module (190) supplies power input from an external power source to the components inside the electronic device (100) that operate under the control of the processor (130). Additionally, the power module (190) can supply power output from one or more batteries located inside the electronic device (100) to the internal components under the control of the processor (130).

[0282] An electronic device according to one embodiment of the present disclosure may include at least one processor comprising a memory for storing at least one instruction and a circuit device. When the at least one instruction is executed individually or collectively by the at least one processor, the ratio of a content area displayed in a display area of ​​the mirror display to the ratio occupied by the content area in the display area can be identified. When the at least one instruction is executed individually or collectively by the at least one processor, the mirror display can be controlled to control the brightness of the display area of ​​the mirror display based on the ratio occupied by the content area in the display area.

[0283] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may control the mirror display such that the brightness of the display area of ​​the mirror display is greater than or equal to a reference brightness, based on the fact that the ratio of the content area to the display area is greater than or equal to a threshold ratio. When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may control the mirror display such that the brightness of the display area is less than the reference brightness, based on the fact that the ratio of the content area to the display area is less than the threshold ratio.

[0284] The electronic device may include a camera. When the at least one instruction is executed individually or collectively by the at least one processor, the electronic device may acquire an image through the camera. When the at least one instruction is executed individually or collectively by the at least one processor, the electronic device may identify a person area projected onto the mirror display based on the acquired image. When the at least one instruction is executed individually or collectively by the at least one processor, the electronic device may set the brightness of an area other than the person area on the mirror display to be different from the brightness of the person area.

[0285] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may set the brightness of the pixel corresponding to the area outside the person area to gradually change from the brightness of the person area as the distance between the pixel corresponding to the area outside the person area and the pixel corresponding to the person area in the mirror display increases.

[0286] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can adjust the brightness of the display area of ​​the mirror display based on the sensor value acquired by the illuminance sensor.

[0287] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may adjust to lower the brightness of the display area of ​​the mirror display if the sensor value acquired by the illuminance sensor is greater than or equal to the threshold illuminance. When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may adjust to raise the brightness of the display area of ​​the mirror display if the sensor value acquired by the illuminance sensor is less than the threshold illuminance.

[0288] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can identify an object of the content. When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can acquire a content area by inpainting an area around the identified object. When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can set the brightness of an area other than the content area in the mirror display to be different from the brightness of the content area.

[0289] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may set the brightness of the pixel corresponding to the area outside the content area to gradually change from the brightness of the content area as the distance between the pixel corresponding to the area outside the content area and the pixel corresponding to the content area in the mirror display increases.

[0290] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can acquire a projection image projected onto the mirror display from an image acquired by the camera. When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can identify the person area in the projection image.

[0291] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may obtain user input selecting a screen mode in which the brightness of the display area is set to be greater than or equal to the reference brightness, or a mirror mode in which the brightness of the display area is set to be less than the reference brightness. When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device may switch to the screen mode or the mirror mode based on the user input.

[0292] When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can determine whether a person is identified in the image acquired through the camera. When the above at least one instruction is executed individually or collectively by the above at least one processor, the electronic device can switch to the mirror mode based on the determination that the person has been identified.

[0293] A method of operating an electronic device according to one embodiment of the present disclosure may include an operation of identifying the ratio that a content area displayed in a display area of ​​a mirror display occupies in the display area. The method may include an operation of controlling the mirror display to control the brightness of the display area of ​​the mirror display based on the ratio that the content area occupies in the display area.

[0294] This method may include an operation of controlling the mirror display such that the brightness of the display area of ​​the mirror display becomes greater than or equal to a reference brightness, based on the fact that the ratio of the content area to the display area is greater than or equal to a threshold ratio. This method may also include an operation of controlling the mirror display such that the brightness of the display area becomes less than the reference brightness, based on the fact that the ratio of the content area to the display area is less than the threshold ratio.

[0295] This method may include an operation of acquiring an image through a camera. This method may include an operation of identifying a person area projected onto the mirror display based on the acquired image. This method may include an operation of setting the brightness of an area other than the person area on the mirror display to be different from the brightness of the person area.

[0296] This method may include an operation of setting the brightness of the pixel corresponding to the area outside the person area to gradually change from the brightness of the person area as the distance between the pixel corresponding to the area outside the person area and the pixel corresponding to the person area in the mirror display increases.

[0297] This method may include an operation to adjust the brightness of the display area of ​​the mirror display based on the sensor value acquired by the illuminance sensor.

[0298] This method may include an operation to adjust the brightness of the display area of ​​the mirror display to lower it if the sensor value acquired by the illuminance sensor is greater than or equal to a threshold illuminance. This method may include an operation to adjust the brightness of the display area of ​​the mirror display to raise it if the sensor value acquired by the illuminance sensor is less than the threshold illuminance.

[0299] This method may include an operation of identifying an object of the content. This method may include an operation of acquiring a content area by inpainting an area around the identified object. This method may include an operation of setting the brightness of an area other than the content area in the mirror display to be different from the brightness of the content area.

[0300] This method may include an operation of setting the brightness of the pixel corresponding to the area outside the content area to gradually change from the brightness of the content area as the distance between the pixel corresponding to the area outside the content area and the pixel corresponding to the content area in the mirror display increases.

[0301] This method may include the operation of acquiring a projection image projected onto the mirror display from an image acquired by the camera. This method may include the operation of identifying the person area in the projection image.

[0302] This method may include an operation of obtaining user input selecting a screen mode in which the brightness of the display area is set to be greater than or equal to the reference brightness, or a mirror mode in which the brightness of the display area is set to be less than the reference brightness. This method may include an operation of switching to the screen mode or the mirror mode based on the user input.

[0303] This method may include an operation of determining whether a person is identified in an image acquired through the camera. This method may include an operation of switching to the mirror mode based on the determination that the person has been identified.

[0304] Some embodiments may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules executed by a computer. A computer-readable medium may be any available medium accessible by a computer and includes both volatile and non-volatile media, and both removable and non-removable media. Additionally, a computer-readable medium may include a computer storage medium. A computer storage medium includes both volatile and non-volatile, removable and non-removable media implemented by any method or technique for storing information, such as computer-readable instructions, data structures, program modules, or other data.

[0305] The disclosed embodiments may be implemented as a software program comprising instructions stored on a computer-readable storage media.

[0306] A computer is a device capable of calling instructions stored from a storage medium and performing operations according to the disclosed embodiments according to the called instructions, and may include an electronic device according to the disclosed embodiments.

[0307] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory' means merely that the storage medium does not contain a signal and is tangible, without distinguishing whether data is stored semi-permanently or temporarily on the storage medium.

[0308] In addition, the control method according to the disclosed embodiments may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product.

[0309] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable app) that is electronically distributed through a device manufacturer or an electronic market (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the manufacturer, a server of the electronic market, or a storage medium of a relay server that temporarily stores the software program.

[0310] A computer program product may include a storage medium of a server or a storage medium of a device in a system composed of a server and a device. Alternatively, if a third device (e.g., a smartphone) is communicationally connected to the server or device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include the S / W program itself that is transmitted from the server to the device or the third device, or transmitted from the third device to the device.

[0311] In this case, one of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0312] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) can execute a computer program product stored on the server to control a device connected to the server in communication to perform a method according to the disclosed embodiments.

[0313] As another example, the third device may execute a computer program product to control a device connected to the third device in communication to perform a method according to the disclosed embodiment. When the third device executes the computer program product, the third device may download the computer program product from a server and execute the downloaded computer program product. Alternatively, the third device may execute a computer program product provided in a preloaded state to perform a method according to the disclosed embodiments.

[0314] Additionally, in this specification, "interface" may be a hardware component, such as a processor or circuit, and / or a software component executed by a hardware component, such as a processor.

[0315] The foregoing description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0316] The scope of the present disclosure is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present disclosure.

Claims

1. In an electronic device (100), Mirror display (110) including a display area, A memory (120) that stores at least one instruction and It includes at least one processor (130) including a circuit device, and By executing the above at least one instruction individually or collectively by the above at least one processor (130), the electronic device, Identify the ratio that the content area occupies in the above display area, and An electronic device (100) that controls the brightness of the display area of ​​the mirror display based on the above ratio.

2. In Paragraph 1, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) Based on the above ratio being greater than or equal to a threshold ratio, the brightness of the display area is controlled to be greater than or equal to a reference brightness, and An electronic device (100) that controls the brightness of the display area to be less than the reference brightness based on the fact that the above ratio is less than the above threshold ratio.

3. In Paragraph 1 or 2, Includes a camera (161), By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) Acquire an image through the above camera, and Based on the above image, identify a person area corresponding to the reflection of a person in the mirror display, and An electronic device (100) that sets the brightness of an area other than the above-mentioned person area differently from the brightness of the above-mentioned person area.

4. In Paragraph 3, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) An electronic device (100) that adjusts the brightness of the area of ​​the mirror display other than the person area so that the area of ​​the mirror display other than the person area changes along the slope as it moves further away from the person area.

5. In any one of paragraphs 1 through 4, Includes an illuminance sensor (164), By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) An electronic device (100) that adjusts the brightness of the display area based on the sensor value obtained by the above-mentioned illuminance sensor.

6. In any one of paragraphs 1 through 5, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) Based on the fact that the sensor value acquired by the above illuminance sensor is greater than or equal to the threshold illuminance, the brightness of the above display area is lowered, and An electronic device (100) that increases the brightness of the display area based on the fact that the sensor value obtained by the above illuminance sensor is less than the threshold illuminance.

7. In any one of paragraphs 1 through 6, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) Identify the object of the above content, and The content area is obtained by inpainting the area around the identified object, and An electronic device (100) that sets the brightness of an area other than the content area differently from the brightness of the content area.

8. In Paragraph 7, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) An electronic device (100) that adjusts the brightness of the area of ​​the mirror display other than the content area so that the area of ​​the mirror display other than the content area changes along the slope as it moves away from the content area.

9. In any one of paragraphs 1 through 8, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) Based on the image acquired by the camera, a projection image projected onto the mirror display is acquired, and An electronic device (100) for identifying the person area in the projected image.

10. In any one of paragraphs 1 through 9, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) Obtaining user input to select a screen mode in which the brightness of the display area is set to be greater than or equal to the reference brightness, or a mirror mode in which the brightness of the display area is set to be less than the reference brightness, An electronic device (100) that switches between the screen mode or the mirror mode based on the above user input.

11. In any one of paragraphs 1 through 10, By having the above at least one instruction executed individually or collectively by the above at least one processor (130), the electronic device (100) Determining whether a person is identifiable in the image acquired through the above camera, and An electronic device (100) that switches to the mirror mode based on the judgment that the above person has been identified.

12. In a method of operating an electronic device, An operation (310) for identifying the ratio of the content area to the display area of ​​the mirror display; and A method comprising an operation (320) for controlling the brightness of the display area based on the above ratio.

13. In Paragraph 12, The operation of controlling the brightness of the display area based on the above ratio is, An operation to control the brightness of the display area to be greater than or equal to a reference brightness based on the above ratio being greater than or equal to a threshold ratio; and A method comprising controlling the brightness of the display area to be less than the reference brightness based on the fact that the above ratio is less than the above threshold ratio.

14. In Paragraph 12 or 13, The action of acquiring an image through a camera; Based on the above image, an operation to identify a person area corresponding to the reflection of a person in the mirror display; and A method comprising the operation of setting the brightness of an area other than the person area differently from the brightness of the person area.

15. A non-transient computer-readable recording medium having at least one instruction recorded thereon, wherein the at least one instruction is executed by a processor of an electronic device so that the electronic device is configured to perform the method of any one of claims 12 to 14 on a computer.

Images