Electronic device and control method thereof

Abstract

An electronic device and a control method thereof are provided. The present electronic device comprises: a first display including a first display panel for displaying a multi-view image and a micro-lens array which is disposed in front of the first display panel and adjusts the direction of light output through the first display panel; a second display including a second display panel which is disposed in front of the first display, displays a two-dimensional image corresponding to a multi-view image, and has a transmittance greater than or equal to a preconfigured value; a memory which stores at least one computer program; and a processor connected to the first display, the second display, and the memory in a communicable manner to control the electronic device.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof. In particular, the present disclosure relates to an electronic device capable of providing three-dimensional images using multiple displays and a control method thereof.

[0002] Advances in electronic technology have led to the development and widespread adoption of various types of electronic devices. As the performance of these devices has advanced, the variety of content they provide has also expanded. In particular, devices capable of viewing even 3D video content have recently been developed and distributed.

[0003] Electronic devices that provide 3D image content can be implemented as various types of display devices such as 3D televisions (TVs), various monitors, mobile phones, a personal digital assistance (PDA), a personal computer (PC), set-top PCs, tablet PCs, electronic picture frames, kiosks, etc., as well as signage that provides advertising images outdoors.

[0004] In particular, electronic devices that provide 3D images can be broadly categorized into glasses-free systems, which allow viewing without glasses, and glasses-based systems, which require glasses. Glasses-based systems can provide a satisfactory three-dimensional effect, but they suffer from the inconvenience of requiring the viewer to wear glasses. In contrast, glasses-free systems offer the advantage of allowing viewers to view 3D images without glasses, and thus, discussions on their development are ongoing.

[0005] The above information is provided solely as background information to aid in understanding the present disclosure. No assumptions are made, no assertions are made, and no judgment is made as to whether the present disclosure is applicable to prior art.

[0006] The present disclosure addresses at least the problems and / or disadvantages described above, and the following disclosure is intended to illustrate at least the advantages. Accordingly, the present disclosure provides an electronic device capable of providing three-dimensional images using multiple displays, and a control method thereof.

[0007] Additional aspects will be described below, will become apparent from the description below, or may be implemented by the examples provided.

[0008] According to one aspect of the present disclosure, an electronic device is provided. The electronic device includes a first display including a first display panel for displaying a multi-view image and a micro-lens array disposed in front of the first display panel for controlling the direction of light output through the first display panel; a second display including a second display panel disposed in front of the first display for displaying a two-dimensional image corresponding to the multi-view image and having a transmittance greater than a preset value; a memory storing at least one computer program; and at least one processor, wherein the first display, the second display, and the memory are communicatively connected to control the electronic device.

[0009] When the multi-view image is displayed through the first display panel and the two-dimensional image is displayed through the second display panel, an area of ​​the multi-view image corresponding to an object included in the two-dimensional image can be processed based on information about the object included in the two-dimensional image.

[0010] When the second display panel is implemented as a self-luminous display panel and the pixel resolution of the first display panel is lower than that of the second display panel, the processor can generate the multi-view image by processing an area corresponding to the object in the multi-view image with the preset color based on color information of the object included in the two-dimensional image.

[0011] An area corresponding to an object included in the re-viewpoint image is larger than an area in which the object is displayed in the two-dimensional image, and the processor can generate the two-dimensional image by processing an area corresponding to the object in the two-dimensional image, excluding an area in which the object is displayed, with a color corresponding to the re-viewpoint image.

[0012] The electronic device includes a sensor for detecting light, and the processor can process the multi-view image to include a shadow of the object included in the two-dimensional image in the multi-view image based on position information and shape information of the object included in the two-dimensional image and the intensity and direction of light detected through the sensor.

[0013] When the first display panel and the second display panel are implemented as liquid crystal displays (LCD panels), the processor may control the first display panel to display the multi-view image when operating in a three-dimensional image display mode, control the second display panel to display the two-dimensional image, and control the first display panel to display a monochrome image of a preset color when operating in a two-dimensional image display mode, and control the second display panel to display the two-dimensional image.

[0014] When the second display panel is implemented as a self-luminous display panel, the processor may control the first display panel to display the multi-view image when operating in a three-dimensional image display mode, control the second display panel to display the two-dimensional image, and turn off the first display panel and control the second display panel to display the two-dimensional image when operating in a two-dimensional image display mode.

[0015] It may include a polarization control unit disposed between the first display and the second display.

[0016] The above micro-lens array may include a lenticular lens.

[0017] According to another aspect of the present disclosure, a method for controlling an electronic device is provided. The electronic device includes a first display panel for displaying a multi-view image and a micro-lens array disposed in front of the first display panel for controlling the direction of light output through the first display panel; a second display panel disposed in front of the first display for displaying a two-dimensional image corresponding to the multi-view image and having a transmittance greater than a preset value; and the control method includes the steps of: acquiring a user command for operating in a three-dimensional image display mode; and displaying a multi-view image using the first display panel and a two-dimensional image using the second display panel in response to the user command.

[0018] When the multi-view image is displayed through the first display panel and the two-dimensional image is displayed through the second display panel, the method may include a step of processing an area corresponding to an object included in the two-dimensional image among the multi-view images based on information about the object included in the two-dimensional image.

[0019] If the second display panel is implemented as a self-luminous display panel and the pixel resolution of the first display panel is lower than that of the second display panel, the processing step may process an area corresponding to the object among the multi-view image with the preset color based on color information of the object included in the two-dimensional image.

[0020] An area corresponding to an object included in the above re-viewpoint image is larger than an area in which the object included in the two-dimensional image is displayed, and the processing step may generate the two-dimensional image by processing an area corresponding to the object in the two-dimensional image, excluding an area in which the object is displayed, with a color corresponding to the re-viewpoint image.

[0021] The electronic device includes a sensor for detecting light; and the processing step may process the multi-view image to include a shadow of the object included in the two-dimensional image in the multi-view image based on position information and shape information of the object included in the two-dimensional image and the intensity and direction of light detected through the sensor.

[0022] When the first display panel and the second display panel are implemented as LCD panels, the control method may include a step of obtaining a user command for operating in a two-dimensional image display mode; and a step of displaying a monochrome image of a preset color using the first display panel and displaying a two-dimensional image using the second display panel when operating in the two-dimensional image display mode.

[0023] When the second display panel is implemented as a self-luminous display panel, the method comprises the steps of: obtaining a user command for operating in a two-dimensional image display mode; and when operating in the two-dimensional image display mode, turning off the first display panel and displaying a two-dimensional image using the display panel.

[0024] According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes a first display including a backlight unit, a transparent photo film positioned in front of the backlight unit for outputting a fixed rendering image, and a micro-lens array positioned in front of the transparent photo film for controlling the direction of light output through the backlight unit and passing through the transparent photo film to generate a three-dimensional image; a second display including a second display panel positioned in front of the first display for displaying a two-dimensional image corresponding to the multi-view image and having a transmittance greater than a preset value; a memory storing at least one computer program, and a processor that controls the electronic device by allowing the first display, the second display, and the memory to be communicatively connected.

[0025] According to another aspect of the present disclosure, when processed by one or more processors of an electronic device, when one or more non-volatile computer-readable storage media stores computer-executable instructions, the electronic device is caused to perform an operation. The operation comprises obtaining a user command in a three-dimensional image display mode, displaying a multi-view image using a first display panel in response to the user command, and displaying a two-dimensional image using a second display panel.

[0026] The above transparent photo film and the above micro-lens array are replaceable.

[0027] According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes a first display including a display panel for outputting a multi-view image; a second display disposed in front of the first display and including a transparent self-luminous display panel that displays a two-dimensional image corresponding to the multi-view image and includes a plurality of apertures; a memory storing at least one computer program, and a processor that is communicatively connected to the first and second displays and the memory to control the electronic device.

[0028] Other embodiments, advantages, and salient features of the present disclosure will become apparent to those skilled in the art from the detailed description of the invention and the accompanying drawings.

[0029] Other embodiments, features, and advantages of specific embodiments of the present disclosure will become apparent from the following description and accompanying drawings.

[0030] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure;

[0031] FIG. 2 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure;

[0032] FIG. 3a, FIG. 3b, FIG. 3c, FIG. 3d, and FIG. 3e are drawings for explaining multi-view images representing various spaces according to various embodiments of the present disclosure.

[0033] FIG. 4A and FIG. 4B are drawings for explaining a 3D image display mode and a 2D image display mode according to various embodiments of the present disclosure.

[0034] FIG. 5 is a diagram illustrating an electronic device including a polarizing plate according to one embodiment of the present disclosure;

[0035] FIG. 6 is a drawing for explaining an electronic device including a replaceable transparent film according to one embodiment of the present disclosure;

[0036] FIG. 7 is a drawing for explaining a re-view image including a shadow according to one embodiment of the present disclosure;

[0037] FIG. 8A and FIG. 8B are drawings for explaining a multi-view image including a shadow depending on the lighting, according to various embodiments of the present disclosure;

[0038] FIG. 9 is a drawing for explaining a re-view image including a masking area according to one embodiment of the present disclosure;

[0039] FIG. 10 is a drawing for explaining an electronic device including a viewing angle limiting film according to one embodiment of the present disclosure;

[0040] FIG. 11 is a drawing for explaining an electronic device including a circular polarizing plate according to one embodiment of the present disclosure;

[0041] FIGS. 12A and 12B are drawings illustrating an electronic device including a transparent self-luminous display panel that acts as a barrier according to various embodiments of the present disclosure.

[0042] FIG. 13 is a flowchart for explaining a method for controlling an electronic device according to one embodiment of the present disclosure.

[0043] Reference numbers are used throughout the drawings to describe identical or similar components, features, or structures.

[0044]

[0045] The following description, with reference to the accompanying drawings, is provided to assist in a comprehensive understanding of the claims and their scope of equivalents disclosed in the present invention. While numerous specific details have been included to aid understanding, they are to be considered merely illustrative. Accordingly, those skilled in the art will recognize that variations and modifications of the various implementations described in the description of the invention can readily be made within the scope of the art. Furthermore, descriptions of well-known functions and structures may be omitted for clarity and brevity. The terms and words used in the detailed description and claims are not intended to be limited to merely literary meanings, but rather have been used by the inventors to facilitate a clear and consistent understanding. Therefore, it is to be understood that the various embodiments of the present invention are provided for the purpose of describing the invention to those skilled in the art, and are not intended to limit the scope of equivalents to the claims.

[0046] It should be understood that singular expressions such as "one" and "that" may include plural entities, unless the context clearly dictates otherwise. Thus, for example, "a surface of a component" includes one or more surfaces.

[0047] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0048] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0049] The terminology used in this disclosure is only used to describe specific embodiments of the disclosure and is not intended to limit the scope of the rights.

[0050] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0051] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0052] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0053] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0054] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0055] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0056] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0057] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0058] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0059] Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that a person having ordinary knowledge in the technical field to which the present disclosure pertains can easily implement the present disclosure.

[0060] Each step of the flowchart and the combination of flowcharts can be performed by one or more computer programs containing computer-executable instructions. The entirety of one or more computer programs may be stored in a single memory device, or the one or more computer programs may be divided and stored in different portions of various memory devices.

[0061] Any function or operation described herein may be controlled by a processor or a combination of processors. A processor or a combination of processors is a circuitry that performs processing, and may include an application processor (AP, e.g., a central processing unit), a communications processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a wireless fidelity (Wi-Fi chip), a Bluetooth chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connection chip, a sensor controller, a touch control controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio CODEC chip, a USB controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on a chip (SoC), an IC, or a similar chip.

[0062] FIG. 1 is a diagram illustrating an electronic device including a first display and a second display according to one embodiment of the present disclosure.

[0063] As illustrated in FIG. 1, the electronic device (100) may include a first display (110) and a second display (120). According to one embodiment of the present disclosure, the electronic device (100) may be a digital signage, but this is only one embodiment, and may be implemented as various types of display devices such as a TV, a monitor, a PC, a kiosk, a tablet PC, an electronic picture frame, a kiosk, a mobile phone, etc.

[0064] The first display (110) can display multi-view images to provide a three-dimensional image in a glasses-free manner. The multi-view images can be generated based on multiple images taken (or created) of the same object from different angles. For example, multiple images taken from different viewpoints are refracted at different angles, and an image focused on a location a certain distance away (e.g., approximately 3 m), referred to as the viewing distance, is provided. The location where such an image is formed is referred to as the viewing area (or optical view). Accordingly, when one eye of the user is positioned in a first viewing area and the other eye is positioned in a second viewing area, the user can experience a three-dimensional effect with respect to the image.

[0065] According to one embodiment of the present disclosure, the first display (110) may include a first display panel and a micro-lens array.

[0066] The first display panel (111) is configured to display a multi-view image and may be implemented as an LCD (Liquid Crystal Display) panel, an LED (Light Emitting Diode) panel, or a self-luminous display panel (e.g., an OLED (Organic Light Emitting Diodes) panel). However, the first display panel (111) is not limited thereto and may be implemented as various display panels (e.g., a plasma display panel (PDP), a VFD (Vacuum Fluorescent Display), a FED (Field Emission Display), an ELD (Electro Luminescence Display), etc.).

[0067] A micro-lens array (112) may be positioned in front of the first display panel (111) to provide different viewpoints, i.e., optical views, for each viewing area. Meanwhile, in the present disclosure, the “front” direction may be the direction in which a viewer viewing the electronic device (100) is positioned.

[0068] The micro-lens array (112) may be placed between the first display panel (111) and the second display panel to be described later. At this time, the micro-lens array (112) may be attached to the front side of the first display panel (111) or the rear side of the second display panel.

[0069] In one embodiment of the present disclosure, the micro lens array (112) may be implemented as a lenticular lens, as illustrated in FIG. 1. The lenticular lens may provide a three-dimensional image to a user by controlling the direction of light output through the first display panel (111). For example, the lenticular lens may refract light output from the first display panel (111) through a plurality of sub-lens regions. Each sub-lens region may be formed to have a size corresponding to at least one pixel, so that light passing through each pixel may be differently dispersed according to the viewing area. In this case, the micro lens array (112) may of course be implemented as a plurality of lenticular lenses that are formed by stacking lenticular lenses.

[0070] In another embodiment of the present disclosure, the micro-lens array (112) may be replaced with a parallax barrier. In this case, the parallax barrier may be implemented as a slit array including a plurality of barrier regions. Accordingly, the micro-lens array (112) may block light through slits between the barrier regions, thereby allowing images from different viewpoints to be output for each viewing area.

[0071] Meanwhile, according to one embodiment of the present disclosure, the micro-lens array (112) and the parallax barrier may be collectively referred to as a field separation unit.

[0072] The second display (120) is arranged in front of the first display (110) and is configured to display a two-dimensional image corresponding to a multi-view image. At this time, the second display (120) may include a second display panel having a transmittance of a preset value (e.g., 2%) or higher. For example, the second display (120) may include an LCD panel or a transparent display panel (e.g., a transparent OLED panel, a transparent LED panel). However, the first display panel (111) is not limited thereto and may be implemented as various display panels having a transmittance of a preset value or higher.

[0073] In order to process a multi-view image to correspond to a two-dimensional image, when a multi-view image is displayed through a first display panel (111) and a two-dimensional image is displayed through a second display panel, an area of ​​the multi-view image corresponding to an object included in the two-dimensional image may be processed based on information about the object included in the two-dimensional image. At this time, the information about the object included in the two-dimensional image may include at least one of color information, position information, and shape information of the object included in the two-dimensional image.

[0074] In one embodiment of the present disclosure, the electronic device (100) may generate a multi-viewpoint image by processing an area (or masking area) corresponding to an object in a multi-viewpoint image with a preset color based on color information of an object included in a two-dimensional image. At this time, the area corresponding to the object included in the multi-viewpoint image may be larger than the area in which the object included in the two-dimensional image is displayed. The electronic device (100) may generate a two-dimensional image by processing an area corresponding to an object in a two-dimensional image, excluding an area in which the object is displayed, with a color corresponding to the multi-viewpoint image.

[0075] In one embodiment of the present disclosure, the electronic device (100) can process a multi-view image to include a shadow of an object included in a two-dimensional image in the multi-view image based on position information and shape information of an object included in the two-dimensional image and the intensity and direction of light detected through a sensor.

[0076] Meanwhile, as illustrated in FIG. 1, the first display (110) can display a multi-view image to provide a three-dimensional image (10), and the second display (120) can display a two-dimensional image (20). At this time, the three-dimensional image (10) may be an image including a background in which a three-dimensional effect is formed in the rear direction of the electronic device (100). The two-dimensional image (20) may be an image including a two-dimensional object displayed on one area of ​​the three-dimensional image (10). For example, the electronic device (100) can display a single three-dimensional image (30) through a three-dimensional image (10) provided through the first display (110) and a two-dimensional image (20) displayed through the second display (120).

[0077] However, as described above, including a background in a multi-view image and including an object in a two-dimensional image is merely an embodiment of the present disclosure, and the multi-view image may include not only a background but also an object. For example, the electronic device (100) may generate and display a multi-view image so that the multi-view image includes not only a background but also an object (e.g., moving text, etc.) that is distinct from the object included in the two-dimensional image.

[0078] By this, the user can feel a three-dimensional effect as if a two-dimensional object exists within a three-dimensional image (e.g., a box). In particular, in the related technical field, by displaying a two-dimensional object within a three-dimensional image without a separate physical space, there may be an effect of reducing the size of the electronic device (100). In addition, when providing a three-dimensional image in a glasses-free manner, there is a problem that the resolution is lowered due to the multi-view image, but as in the present invention, the object is provided as a two-dimensional image through the second display (120), thereby overcoming the problem of the resolution being lowered due to the glasses-free manner.

[0079]

[0080] Meanwhile, according to the embodiment described above in the present invention, the first display (110) has been described as providing a 3D image in a glasses-free manner. However, this is merely one embodiment, and a 3D image can be provided in a glasses-style manner. When providing a 3D image in a glasses-style manner, the first display (110) can provide a 3D image using a stereo image including a left-eye image and a right-eye image.

[0081] FIG. 2 is a block diagram showing the configuration of an electronic device (100) according to one embodiment of the present disclosure.

[0082] As illustrated in FIG. 2, the electronic device (100) may include a first display (110), a second display (120), a first driving unit (130), a second driving unit (140), a sensor (150), a memory (160), and a processor (170). Meanwhile, the configuration described in FIG. 2 is merely an example, and it is to be understood that some configurations may be deleted or added depending on the implementation example of the electronic device (100).

[0083] The first display (110) can provide a three-dimensional image in a glasses-free manner. In particular, the first display (110) can include a first display panel (111) and a micro-lens array (112). The first display (110) can display a multi-view image by the first display driver (130), and can make the user feel as if he or she is watching a three-dimensional image through the micro-lens array (112).

[0084] The second display (120) is placed in front of the first display (110) and may be configured to display a two-dimensional image. The second display (120) may display a two-dimensional image including an object by means of a second driving unit (140).

[0085] The first driving unit (130) can drive the first display (110) under the control of the processor (170). For example, the first driving unit (130) can drive each pixel of the first display panel (111) included in the first display (110) by applying a driving voltage or flowing a driving current to drive each pixel under the control of the processor (170). For example, the first driving unit (130) can supply a driving voltage (or driving current) to the first display panel (111) using a pulse width modulation (PWM) method, and in this case, the first driving unit (130) adjusts and outputs the supply time or intensity of the driving voltage (or driving current) supplied to the first display panel (111) so as to correspond to each control signal input from the processor (170).

[0086] The second driving unit (140) drives the second display (120) under the control of the processor (170). The description of the second driving unit (140) is the same as that of the first driving unit (130), so a detailed description is omitted.

[0087] Meanwhile, according to one embodiment of the present disclosure, the electronic device (100) may include a first driving unit (130) and a second driving unit (140), but this is only one embodiment, and the first and second displays (110, 120) may be driven by a single driving unit. In this case, the first and second displays (110, 120) may include the same type of display panel (e.g., an LCD panel).

[0088] The sensor (150) can detect various information inside and outside the electronic device (100). Specifically, the sensor (150) according to the present disclosure can include a camera, a microphone, and a light sensor. In particular, the light sensor can obtain light data indicating the light intensity of the environment surrounding the electronic device (100). The processor (170) can obtain information on the direction and intensity of light based on the light data obtained by the light sensor.

[0089] The memory (160) may store at least one instruction for controlling the electronic device (100). In addition, the memory (160) may store an O / S (Operating System) for driving the electronic device (100). In addition, the memory (160) may store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. In addition, the memory (160) may include a semiconductor memory such as a flash memory (120) or a magnetic storage medium such as a hard disk.

[0090] In addition, various software modules for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (160), and the processor (170) may control the operation of the electronic device (100) by executing various software modules stored in the memory (160). For example, the memory (160) is accessed by the processor (170), and data reading / recording / modifying / deleting / updating, etc. may be performed by the processor (170).

[0091] The memory (160) according to the present disclosure may include non-volatile memory and volatile memory. Here, non-volatile memory refers to memory that can maintain stored information even when power supply is interrupted, and volatile memory refers to memory that requires continuous power supply to maintain stored information.

[0092] In particular, the memory (160) may include various modules for displaying a multi-view image through the first display (110) and a two-dimensional image through the second display (120). In particular, when a function for displaying a multi-view image through the first display (110) and a two-dimensional image through the second display (120) is executed, the electronic device (100) may load data for various modules for displaying a multi-view image through the first display (110) and a two-dimensional image through the second display (120), which are stored in a non-volatile memory, into the volatile memory. Here, loading means an operation of loading and storing data stored in the non-volatile memory into the volatile memory so that at least one processor (160) can access it.

[0093] The processor (170) can control the electronic device (100) according to at least one instruction stored in the memory (160).

[0094] In particular, the processor (170) may include a plurality of processors. Specifically, the plurality of processors may include one or more of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), a MIC (Many Integrated Core), a DSP (Digital Signal Processor), an NPU (Neural Processing Unit), a hardware accelerator, or a machine learning accelerator. The one or more processors may control one or any combination of other components of the electronic device and perform operations related to communication or data processing. The one or more processors may execute one or more programs or instructions stored in a memory. For example, the plurality of processors may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory.

[0095] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0096] The processor (170) may be implemented as one or more multi-core processors including multiple cores (e.g., homogeneous multi-cores or heterogeneous multi-cores). When at least one processor (120) is implemented as a multi-core processor, each of the multiple cores included in the multi-core processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multi-core processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multi-core processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0097] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among a plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment of the present disclosure, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0098] In embodiments of the present disclosure, the processor (170) may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single core processor, a multi-core processor, or a core included in a single core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0099] In particular, the processor (170) can control the first display (110) to display a multi-view image through the first display panel (111), and can control the second display (120) to display a two-dimensional image through the second display panel. At this time, the processor (170) controlling the first and second displays (110, 120) can include controlling the first and second displays (110, 120) through the first and second driving units (130, 140).

[0100] Additionally, a plurality of processors (170) may be provided, and among the plurality of processors, a first processor may control a first display (110), and a second processor may control a second display (120).

[0101] In one embodiment of the present disclosure, the processor (170) can acquire a multi-viewpoint image to provide a three-dimensional image. In addition, the processor (170) can acquire a two-dimensional image. In this case, the processor (170) can acquire each of the multi-viewpoint image and the two-dimensional image from the outside through a communication interface or an input / output interface (not shown), but this is only one embodiment, and the multi-viewpoint image can be acquired by reading out the multi-viewpoint image and the two-dimensional image stored in the memory (160).

[0102] In one embodiment of the present disclosure, the processor (170) can obtain a multi-view image and a two-dimensional image for providing a three-dimensional image through a single image. Specifically, the processor (170) can separate the foreground and background from an input image and extract at least one object included in the foreground. Then, the processor (170) can obtain a two-dimensional image based on the at least one extracted object. Then, the processor (170) can generate a multi-view image using the separated background image.

[0103] The processor (170) can control the first driving unit (130) to output a multi-view image acquired by various embodiments as described above through the first display panel (111). In addition, the processor (170) can control the second driving unit (140) to output a two-dimensional image acquired by various embodiments as described above through the second display panel.

[0104] Meanwhile, according to one embodiment of the present disclosure, the processor (170) may operate in one of a three-dimensional image display mode and a two-dimensional image display mode. The three-dimensional image display mode is a mode that provides a three-dimensional image by using a multi-view image provided through the first display (110) and a two-dimensional image provided through the second display (120), and the two-dimensional image display mode is a mode that provides a two-dimensional image through the second display (120) without providing a multi-view image through the first display (110).

[0105] In one embodiment of the present disclosure, when the first display panel (111) and the second display panel are implemented as LCD panels, the processor (170) may control the first display (110) to display a multi-view image using the first display panel (111) while operating in a three-dimensional image display mode, and may control the second display (120) to display a two-dimensional image using the second display panel. In addition, the processor (170) may control the first display (110) to display a monochrome image of a preset color (e.g., white) using the first display panel (111) while operating in a two-dimensional image display mode, and may control the second display (120) to display a two-dimensional image using the second display panel. At this time, the monochrome image output through the first display panel (111) may function as a backlight of the second display panel.

[0106] In one embodiment of the present disclosure, when the second display panel is implemented as a self-luminous display panel, the processor (170) may control the first display (110) to display a multi-view image using the first display panel (111) while operating in a three-dimensional image display mode, and may control the second display (120) to display a two-dimensional image using the second display panel. In addition, the processor (170) may turn off the first display panel (111) while operating in a two-dimensional image display mode, and may control the second display (120) to display a two-dimensional image using the second display panel. For example, when the second display (120) is implemented as a transparent self-luminous display panel, a separate backlight is not required, and thus the second display (120) may be turned off. However, this is merely one embodiment, and in order to improve the resolution of the second display (120), an additional image (e.g., a monochrome image) may be displayed through the first display (110).

[0107] In addition, when the second display (120) is implemented as a self-luminous display panel, the second display (120) may have difficulty expressing a preset color (e.g., black). In addition, when the pixel resolution of the first display (110) is lower than that of the second display (120), there is a problem in that it is difficult for the second display (120) to properly express the color that the first display (110) intends to express.

[0108] Accordingly, when the second display (120) is implemented as a self-luminous display panel and has a pixel resolution lower than that of the first display (110) than that of the second display (120), the processor (170) can generate a multi-view image by processing an area corresponding to an object in the multi-view image with a preset color in order to express the object included in the two-dimensional image with a preset color (e.g., black).

[0109] At this time, the area corresponding to the object included in the re-viewpoint image may be larger than the area where the object included in the 2D image is displayed. Accordingly, the processor (170) may generate a 2D image by processing the remaining area, excluding the area where the object is displayed, among the areas corresponding to the object in the 2D image, with a color corresponding to the re-viewpoint image. As a result, the re-viewpoint image and the 2D image can be displayed without a sense of incongruity.

[0110] In addition, the processor (170) can process the multi-view image to include the shadow of the object included in the two-dimensional image in the multi-view image based on the position information and shape information of the object and the intensity and direction of the light detected through the sensor (150). That is, the processor (170) can adjust the brightness of the shadow of the object in the multi-view image according to the intensity of the light detected through the sensor (150). For example, the processor (170) can adjust the brightness of the shadow of the object in the multi-view image to be darker as the intensity of the detected light is greater, and can adjust the brightness of the shadow of the object in the multi-view image to be brighter as the intensity of the detected light is smaller. In addition, the processor (170) can adjust the position of the shadow of the object in the multi-view image according to the direction of the light detected through the sensor (150).

[0111]

[0112] Hereinafter, various embodiments of the present disclosure will be described with reference to FIGS. 3a to 3e, 4a, 4b, 5 to 7, 8a, 8b, 9, 10, and 11.

[0113] FIGS. 3A, 3B, 3C, 3D, and 3E are drawings for explaining multi-view images representing various spaces according to various embodiments of the present disclosure.

[0114] Referring to FIGS. 3A, 3B, 3C, 3D, and 3E, the electronic device (100) can display a two-dimensional image according to a multi-viewpoint image having various depths. For example, the electronic device (100) can generate a multi-viewpoint image to represent a rear space. That is, the electronic device (100) can display a multi-viewpoint image representing a rear space through the first display (110), and can display a two-dimensional image displayed together with the multi-viewpoint image through the second display (120). For example, as illustrated in FIG. 3A, the electronic device (100) can provide a three-dimensional image in which an object (310-1) included in a two-dimensional image is perceived to be displayed in the front part of a three-dimensional background (310-2) formed by the multi-viewpoint image.

[0115] For example, the electronic device (100) can display a multi-viewpoint image to represent the front space. For example, the electronic device (100) can display a multi-viewpoint image representing the front space through the first display (110), and can display a two-dimensional image displayed together with the multi-viewpoint image through the second display (120). Accordingly, the electronic device (100) can provide a three-dimensional image in which an object (320-1) included in the two-dimensional image is perceived to be displayed in the rear part of a three-dimensional background (320-2) formed by the multi-viewpoint image, as illustrated in FIG. 3B.

[0116] For example, the electronic device (100) can display a multi-viewpoint image to simultaneously express the front / rear space. That is, the electronic device (100) can display a multi-viewpoint image expressing the front / rear space through the first display (110), and can display a two-dimensional image displayed together with the multi-viewpoint image through the second display (120). Accordingly, the electronic device (100) can provide a three-dimensional image in which an object (330-1) included in the two-dimensional image is perceived to be displayed in the central portion of a three-dimensional background (330-2) provided by the multi-viewpoint image, as illustrated in FIG. 3C.

[0117] For example, the electronic device (100) can display a multi-view image in which an object is positioned outside a three-dimensional background. For example, the electronic device (100) can provide a three-dimensional image in which an object (330-4) included in a two-dimensional image is perceived as being displayed in the front outer region of a three-dimensional background (330-3) provided by the multi-view image, as illustrated in FIG. 3D.

[0118] Meanwhile, when a two-dimensional image is input to the electronic device (100), the electronic device (100) can separate the foreground area and the background image from the two-dimensional image. At this time, the electronic device (100) can obtain depth information of the background image together with the background image. At this time, the depth information is information indicating the depth of the three-dimensional image, and is information corresponding to the degree of binocular disparity between the left-eye image and the right-eye image constituting the three-dimensional image. The degree of three-dimensionality perceived by a person varies depending on the depth information. For example, when the depth is large, the left-right binocular disparity is large, so the three-dimensionality is felt relatively large, and when the depth is small, the left-right binocular disparity is small, so the three-dimensionality is felt relatively small. Depth information can generally be obtained through a passive method that obtains only the two-dimensional characteristics of the image, such as stereo matching, or an active method that uses equipment such as a depth camera. Meanwhile, the depth information can be in the form of a depth map. Here, the depth map refers to a table containing depth information for each region of the image. The region may be divided into pixel units or may be defined as a preset region larger than the pixel unit. According to an example of the present invention, the depth map may be in the form of a grayscale value from 0 to 255, with 127 or 128 as the reference value, that is, 0 (or focal plane), and a value smaller than 127 or 128 is represented as a - value and a larger value is represented as a + value. The reference value of the focal plane can be arbitrarily selected from 0 to 255. Here, a - value means subsidence, and a + value means protrusion.

[0119] The electronic device (100) can provide background images (i.e., multi-view images) of various depths, as described in FIGS. 3A to 3C, based on the depth information of the background image. At this time, the depth information can be received together with the input 2D image, but this is only one embodiment, and can be obtained by analyzing the input 2D image or can be obtained based on user input.

[0120] And, the electronic device (100) can generate a multi-viewpoint image by rendering a plurality of image views of different viewpoints based on the acquired depth information. Alternatively, when a plurality of image views of different viewpoints and a plurality of corresponding depth information are input, the electronic device (100) can generate a multi-viewpoint image by rendering a preset number (hereinafter referred to as N) of image views based on at least one image view and depth information among the input plurality of image views and depth information. Alternatively, when only a plurality of image views of different viewpoints are input, the electronic device (100) can extract depth information from the plurality of image views and then render N image views based on the extracted depth information to generate a multi-viewpoint image.

[0121] For example, the electronic device (100) can select one of the three-dimensional images, that is, the left-eye image and the right-eye image, as a reference view (or center view) to generate the leftmost view and the rightmost view, which are the basis of the multi-view image. In this case, the electronic device (100) can generate the leftmost view and the rightmost view based on corrected depth information corresponding to one of the left-eye image and the right-eye image selected as the reference view. Once the leftmost view and the rightmost view are generated, the electronic device (100) can render N image views by generating a plurality of interpolation views between the center view and the leftmost view, and generating a plurality of interpolation views between the center view and the rightmost view. However, the present invention is not limited thereto, and it is also possible to generate an extrapolation view generated by an extrapolation technique. Meanwhile, when generating a multi-view image based on a two-dimensional image and depth information, it goes without saying that the electronic device (100) can select the two-dimensional image as the center view. However, the above-described rendering operation is merely an example, and it is obvious that multiple image views can be rendered by various methods other than the above-described rendering operation. In some cases, the electronic device (100) can adjust the depth information of the input image based on depth information according to various criteria, and in this case, the electronic device (100) can render multiple image views based on the image with adjusted depth information.

[0122] The electronic device (100) can generate a multi-view image to be displayed through the first display panel (111) based on sub-pixel values ​​that constitute a plurality of image views of different rendered viewpoints.

[0123] Meanwhile, although the above-described embodiments of the present disclosure have described that the multi-view image provides only a three-dimensional background, this is only one embodiment, and the multi-view image may include not only a three-dimensional background but also various three-dimensional objects. For example, as illustrated in FIG. 3e, the electronic device (100) may display not only an object (350-1) included in a two-dimensional image, but also a three-dimensional background (350-2) and a three-dimensional object (350-3) through the multi-view image. In this case, the three-dimensional object (350-3) may be text, but this is only one embodiment, and it is to be understood that it may be implemented as another image, icon, etc.

[0124]

[0125] In addition, the electronic device (100) can operate in one of a three-dimensional image display mode and a two-dimensional image display mode. At this time, the electronic device (100) can operate in one of a plurality of modes depending on a user input, but this is only one embodiment, and the electronic device (100) can operate in one of a plurality of modes depending on the type of the input image. For example, if the input image is a two-dimensional image, the electronic device (100) can operate in a two-dimensional image display mode, and if the input image is a three-dimensional image including a multi-view image and a two-dimensional image, the electronic device (100) can operate in a three-dimensional image display mode.

[0126] At this time, the electronic device (100) can operate the two-dimensional image display mode in different ways depending on the types of the first and second displays (110, 120) included in the electronic device.

[0127] FIG. 4A is a drawing for explaining a method of operating in a three-dimensional image display mode and a two-dimensional image display mode when both the first display (110) and the second display (120) are implemented as LCD panels according to one embodiment of the present disclosure.

[0128] Referring to FIG. 4A, when the electronic device (100) operates in a three-dimensional image display mode as illustrated on the left side of FIG. 4A, the electronic device (100) may display a multi-view image representing the rear space (410) using the first display panel (111) and may display a two-dimensional image using the second display panel. However, when the electronic device (100) operates in a two-dimensional image display mode as illustrated on the right side of FIG. 4B, the electronic device (100) may display a monochrome image of a preset color using the first display panel (111) and may display a two-dimensional image using the second display panel. For example, when operating in a two-dimensional image display mode, the first display panel (111) may not be turned off and may display a monochrome image of a preset color (e.g., white), thereby providing a backlight function of the second display (120).

[0129] FIG. 4b is a drawing for explaining a method of operating in a three-dimensional image display mode and a two-dimensional image display mode when a first display (110) is implemented as an LCD panel and a second display (120) is implemented as a transparent self-luminous display panel according to one embodiment of the present disclosure.

[0130] Referring to FIG. 4B, when the electronic device (100) operates in a three-dimensional image display mode as illustrated on the left side of FIG. 4B, the electronic device (100) may display a multi-view image representing the rear space (420) using the first display panel (111) and may display a two-dimensional image using the second display panel. However, when the electronic device (100) operates in a two-dimensional image display mode as illustrated on the right side of FIG. 4B, the electronic device (100) may turn off the first display panel (111) and display the two-dimensional image using the second display panel. For example, when the second display (120) is implemented as a transparent self-luminous display panel, a separate backlight is not required, and therefore, when operating in a two-dimensional image display mode, the first display panel (111) may be turned off.

[0131]

[0132] FIG. 5 is a diagram illustrating an electronic device including a polarizing plate according to one embodiment of the present disclosure.

[0133] Referring to FIG. 5, when the second display (120) in front is implemented as a transparent self-luminous display panel and the first display (110) in the back is implemented as an LCD panel, the electronic device (100) may further include a polarizer (510) as a polarization control unit between the first display (110) and the second display (120), as illustrated in FIG. 5. At this time, the polarizer performs the function of converting light incident in various directions into light vibrating in one direction and transmitting the light. For example, light that is aligned with the direction of the polarizer may pass through, and light that is opposite in direction may be blocked. In particular, while the electronic device (100) operates in a two-dimensional image display mode, the polarizer (510) may block light in some directions and transmit only some light, thereby improving the contrast ratio. Meanwhile, in the above-described embodiment, the polarization control unit is described as being implemented as a polarizing plate, but this is only one embodiment, and it may be implemented as another configuration such as a phase modulation plate (waveplate).

[0134]

[0135] FIG. 6 is a drawing illustrating an electronic device including a replaceable transparent film according to one embodiment of the present disclosure.

[0136] Referring to FIG. 6, according to one embodiment of the present disclosure, a first display (110) of an electronic device (100) may include a backlight unit (610), a transparent photo film (620), and a micro-lens array (630).

[0137] At this time, the backlight unit (610) can provide light to the transparent photo film (620).

[0138] A transparent photo film (620) is positioned in front of a backlight unit (610), and a fixed rendering image is printed on it to output a fixed rendering image. At this time, the fixed rendering image can be provided as a three-dimensional background image through a micro-lens array (630).

[0139] A micro-lens array (630) is placed in front of a transparent photo film (620), and adjusts the direction of light output through a backlight unit (610) and transmitted through the transparent photo film (620), thereby providing a user with a three-dimensional image through a re-view image.

[0140] At this time, the transparent photo film (620) and the micro-lens array (630) may be interchangeable. For example, a fixed rendering image contained within the transparent photo film (620) can be replaced with another transparent photo film to provide a new background image. This allows a three-dimensional background image to be provided by replacing the inexpensive transparent photo film (620).

[0141] Meanwhile, in the above-described embodiment of the present invention, it has been described that both the transparent photo film (620) and the micro-lens array (630) are replaced, but this is only one embodiment, and only the transparent photo film (620) can be replaced.

[0142]

[0143] FIG. 7 is a drawing for explaining a re-view image including a shadow according to one embodiment of the present disclosure.

[0144] Referring to FIG. 7, the electronic device (100) can display a shadow corresponding to a two-dimensional image along with a multi-viewpoint image. For example, as illustrated in FIG. 7, the electronic device (100) can display a shadow (730) corresponding to an object (710) viewed from multiple viewpoints within a three-dimensional background image (720).

[0145] In particular, the electronic device (100) can obtain information about an object (710) included in a two-dimensional image. At this time, the electronic device (100) can analyze the two-dimensional image to obtain shape information and position information about the object (710). Then, the electronic device (100) can render a shadow (730) corresponding to the object in the multi-view image based on the obtained shape information and position information about the object. Then, the electronic device (100) can output the multi-view image including the shadow (730) through the first display (110).

[0146] Additionally, the electronic device (100) can process the re-view image to include a shadow corresponding to an object included in a two-dimensional image within the re-view image based on the intensity and direction of light detected through the sensor (150).

[0147] Specifically, the electronic device (100) can obtain information about the intensity and direction of light based on the sensing value acquired through the sensor (150). In addition, the electronic device (100) can obtain shape information and position information about the object by analyzing the two-dimensional image. In addition, the electronic device (100) can render a shadow corresponding to the object in the multi-view image based on the information about the intensity and direction of light and the shape information and position information about the object. Specifically, the electronic device (100) can render the shadow so that the brightness of the shadow increases as the intensity of the light increases, and can render the shadow so that the brightness of the shadow decreases as the intensity of the light decreases. In addition, the electronic device (100) can render the shadow by determining the position of the shadow according to the position of the light and the position of the object. In addition, the electronic device (100) can display the multi-view image including the shadow (730) through the first display (110).

[0148] FIGS. 8A and 8B are drawings representing a re-view image including a shadow according to lighting according to various embodiments of the present disclosure.

[0149] Referring to FIG. 8A, when the light (810) is turned off, the electronic device (100) can obtain that no light is detected through the sensor (150). Accordingly, the electronic device (100) can display a multi-view image (830) using the first display panel (111) without a separate shadow, and display a two-dimensional image including the object (820) using the second display panel.

[0150] However, as illustrated in FIG. 8B, when the lighting (810) is turned on, the electronic device (100) can detect light through the sensor (150) and obtain information about the intensity and direction of the detected light. Then, the electronic device (100) can render a shadow (860) within a multi-view image (850) based on the information about the intensity and direction of the acquired light, display the multi-view image (850) including the shadow (860) through the first display panel, and display a two-dimensional image including the object (840) using the second display panel. For example, since the lighting (810) is positioned in the upper region of the electronic device (100), the electronic device (100) can display the multi-view image (850) by rendering a shadow (860) below the object (840) included in the two-dimensional image.

[0151] As described above, by rendering shadows and displaying them on a re-view image, users can view more realistic 3D images.

[0152]

[0153] FIG. 9 is a diagram illustrating a multi-view image including a masking area according to one embodiment of the present disclosure. Meanwhile, according to one embodiment of the present disclosure, the second display (120) of the electronic device (100) may include a transparent self-luminous display panel.

[0154] Referring to FIGS. 9 and 4A, when the second display (120) is implemented as a transparent self-luminous display panel, the electronic device (100) has a problem in that it is difficult to express a black object. In addition, when the pixel resolution provided by the first display (110) on the back is lower than that of the second display (120) on the front, the electronic device (100) has a limitation in that it is difficult to display an object of a desired color because the multi-view image of the first display (110) and the two-dimensional image of the second display (120) are displayed overlapping.

[0155] Accordingly, the electronic device (100) may generate a multi-viewpoint image (930) including a masking area (940) in which an area corresponding to an object in a multi-viewpoint image (930) is processed with a preset color, as illustrated in FIG. 9, in order to express an object included in a two-dimensional image in a preset color (e.g., black). At this time, the masking area (940) is an area in the multi-viewpoint image that corresponds to an object included in a two-dimensional image, and may be an area that is rendered to be distinct from other areas in the multi-viewpoint image in order to display the object in a color desired by the user. At this time, the masking area may be larger than the area in which the object included in the two-dimensional image is displayed. When the object included in the two-dimensional image and the masking area are the same, a sense of incongruity may occur between the boundary of the object and the background area, and therefore the masking area may be set to be larger than the area in which the object is displayed. At this time, the electronic device (100) can generate a two-dimensional image by processing the remaining area (920) excluding the area (910) where the object is displayed among the areas corresponding to the masking area within the two-dimensional image with a color corresponding to the re-view image (930), as shown in the first drawing of FIG. 9.

[0156] Accordingly, the electronic device (100) can display a 3D image (950) including an object of a color desired by the user, as in the third drawing of FIG. 9, by overlapping a 2D image such as the first drawing of FIG. 9 and a multi-view image such as the second drawing of FIG. 9.

[0157]

[0158] FIG. 10 is a drawing for explaining an electronic device including a viewing angle limiting film according to one embodiment of the present disclosure.

[0159] Referring to FIG. 10, the electronic device (100) may further include a viewing angle limiting film (1010) in front of the second display (120).

[0160] Specifically, the glasses-free first display (110) cannot view 3D images beyond its viewing angle limit. If the viewing angle limit is exceeded, the viewer will see a distorted image rather than a 3D image. In this case, the viewing angle limiting film (1010) may be positioned in front of the second display (120) to prevent the viewer from viewing images beyond the viewing angle limit that the first display (110) can provide.

[0161]

[0162] FIG. 11 is a drawing for explaining an electronic device including a circular polarizing plate according to one embodiment of the present disclosure.

[0163] Referring to FIG. 11, the electronic device (100) may further include a circular polarizing plate (1110) in front of the second display (120).

[0164] Specifically, when the second display (120) is positioned in front and the first display (110) is positioned at the back, a problem may arise where it is difficult to properly display the image desired by the user due to internally reflected light. Therefore, the circular polarizing plate (1110) is positioned in front of the second display (120) to block the internally reflected light and prevent the internally reflected light from being emitted externally. Accordingly, the contrast ratio of the 3D image provided by the electronic device (100) can be improved.

[0165]

[0166] FIGS. 12A and 12B are drawings illustrating an electronic device including a transparent self-luminous display panel that acts as a barrier, according to one embodiment of the present disclosure.

[0167] Referring to FIGS. 12A and 12B , as described above, the autostereoscopic display may include not only an embodiment in which images from different viewpoints are projected through a microlens array, such as a lenticular lens array, but also an array of transparent slits including a plurality of barrier regions. For example, the display may block light through slits between the barrier regions to project images from different viewpoints for each viewing area.

[0168] According to one embodiment of the present disclosure, an electronic device (100) may include a first display (110) and a second display (120), as illustrated in FIG. 12A. In this case, the first display (110) may include only a general display panel that does not include a micro-lens array as described above. In addition, the second display (120) may be implemented as a transparent self-luminous display panel.

[0169] At this time, the transparent self-luminous display panel may include a plurality of pixel modules. At this time, each pixel module may include a pixel area and an aperture area (1120), as illustrated in FIG. 12B. The pixel area of ​​each pixel module displays a display image (particularly, a two-dimensional image), and the aperture area (1120) may block some of the light output through the first display (110) to allow images from different viewpoints to be output for each viewing area. For example, the transparent self-luminous display panel may include a plurality of apertures that function as parallax barriers.

[0170] Accordingly, the electronic device (100) can provide a three-dimensional background image without a separate micro-lens array.

[0171] Meanwhile, the shape of the opening can be straight, stepped, or curved, but this is only one example, and it is obvious that it can be implemented in various shapes.

[0172]

[0173] FIG. 13 is a flowchart for explaining a method for controlling an electronic device according to one embodiment of the present disclosure.

[0174] Referring to FIG. 13, the electronic device (100) receives a user command for operating in a 3D image display mode (S1310). At this time, the user command for operating in the 3D image display mode may be a command for turning on the power of the electronic device (100) or a command for switching the mode of the electronic device (100) to the 3D image display mode, but is not limited thereto.

[0175] The electronic device (100) displays a re-view image on the first display (110) and a two-dimensional image on the second display (120) (S1320).

[0176] For example, the first display (110) may display a multi-view image to provide a background image including a background with a three-dimensional effect formed in the rear direction of the electronic device (100), and the second display (120) may display a two-dimensional image including a two-dimensional object displayed on one area of ​​the multi-view image. Accordingly, the electronic device (100) may display a single three-dimensional image through a three-dimensional background image displayed through the first display (110) and a two-dimensional object displayed through the second display (120).

[0177] By this, the user can feel a three-dimensional effect as if a two-dimensional object exists within a three-dimensional background image (e.g., a box). In particular, according to the related technical field, by displaying a two-dimensional object within a three-dimensional image without a separate physical space, there may be an effect of reducing the size of the electronic device (100). In addition, when providing a three-dimensional image in a glasses-free manner, there is a problem that the resolution is lowered due to a multi-view image, but as in the present invention, by providing the object as a two-dimensional image through the second display (120), the problem of the resolution being lowered due to the glasses-free manner can be overcome.

[0178]

[0179] Meanwhile, the methods according to various embodiments of the present disclosure may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0180] The methods according to various embodiments of the present disclosure may be implemented as software including commands stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call commands stored in the storage medium and operate according to the called commands, and may include an electronic device (e.g., a TV) according to the disclosed embodiments.

[0181] Meanwhile, a device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0182] When the above instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0183]

[0184] While the present disclosure has been illustrated and described with respect to various embodiments, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the scope of the present disclosure as defined by the claims and their equivalents.

Claims

1. In electronic devices, A first display including a first display panel for displaying a re-point image and a micro-lens array disposed in front of the first display panel and for controlling the direction of light output through the first display panel; A second display disposed in front of the first display and including a second display panel that displays a two-dimensional image corresponding to the re-view image and has a transmittance greater than a preset value; Memory for storing one or more programs; and An electronic device comprising: a processor connected in a communication manner to the memory, the first display and the second display, and controlling the electronic device; 2. In paragraph 1, An electronic device in which, when the multi-point image is displayed through the first display panel and the two-dimensional image is displayed through the second display panel, an area of ​​the multi-point image corresponding to an object included in the two-dimensional image is processed based on information about the object included in the two-dimensional image.

3. In paragraph 2, The one or more computer programs, when executed by the at least one processor, If the second display panel is implemented as a self-luminous display panel and the pixel resolution of the first display panel is lower than that of the second display panel, An electronic device including a computer-executable command that generates a multi-view image by processing an area corresponding to the object in the multi-view image with the preset color based on color information of the object included in the two-dimensional image.

4. In paragraph 3, The area corresponding to the object included in the above re-view image is larger than the area where the object included in the above two-dimensional image is displayed, The one or more computer programs, when executed by the at least one processor, An electronic device including computer-executable instructions that generate the two-dimensional image by processing an area corresponding to the object in the two-dimensional image, excluding an area where the object is displayed, with a color corresponding to the re-viewpoint image.

5. In paragraph 4, The above electronic device, A sensor for detecting light; The one or more computer programs, when executed by the at least one processor, An electronic device including computer-executable instructions for processing a multi-view image to include a shadow of an object included in the two-dimensional image in the multi-view image based on positional information and shape information of the object included in the two-dimensional image and the intensity and direction of light detected by the sensor.

6. In paragraph 1, The one or more computer programs, when executed by the at least one processor, if the first display panel and the second display panel are implemented as liquid crystal display (LCD) panels, When operating in a 3D image display mode, the first display panel is controlled to display the re-view image, and the second display panel is controlled to display the 2D image. An electronic device comprising computer-executable instructions for controlling the first display panel to display a monochrome image of a preset color and for controlling the second display panel to display a two-dimensional image when operating in a two-dimensional image display mode.

7. In paragraph 1, The above one or more computer programs, when executed by the at least one processor, if the second display panel is implemented as a self-luminous display panel, When operating in a 3D image display mode, the first display panel is controlled to display the re-view image, and the second display panel is controlled to display the 2D image. An electronic device comprising computer-executable instructions that, when operating in a two-dimensional image display mode, turn off the first display panel and control the second display panel to display a two-dimensional image.

8. In paragraph 1, An electronic device comprising a polarization control unit disposed between the first display and the second display.

9. In paragraph 1, The above micro-lens array, An electronic device comprising a lenticular lens.

10. In a method for controlling an electronic device, The above electronic device, A first display including a first display panel for displaying a re-point image and a micro-lens array disposed in front of the first display panel and for controlling the direction of light output through the first display panel; A second display is disposed in front of the first display and includes a second display panel that displays a two-dimensional image corresponding to the re-point image and has a transmittance greater than a preset value; The above method, A step of obtaining a user command for operating in a 3D image display mode; and A method comprising the steps of: displaying a re-view image using the first display panel in response to the user command; and displaying a two-dimensional image using the second display panel.

11. In paragraph 10, A method comprising: a step of processing an area of ​​the multi-point image corresponding to an object included in the two-dimensional image based on information about an object included in the two-dimensional image, when the multi-point image is displayed through the first display panel and the two-dimensional image is displayed through the second display panel.

12. In paragraph 11, If the second display panel is implemented as a self-luminous display panel and the pixel resolution of the first display panel is lower than that of the second display panel, The step of processing the area corresponding to the object included in the above two-dimensional image is: A method for processing an area corresponding to an object in a re-view image with a preset color based on color information of an object included in the two-dimensional image.

13. In paragraph 12, The area corresponding to the object included in the above re-view image is larger than the area where the object included in the above two-dimensional image is displayed, The step of processing the area corresponding to the object included in the above two-dimensional image is: A method for generating a two-dimensional image by processing an area corresponding to the object in the two-dimensional image, excluding an area where the object is displayed, with a color corresponding to the re-viewpoint image.

14. In paragraph 13, The above electronic device, A sensor for detecting light; The step of processing the area corresponding to the object included in the above two-dimensional image is: A method for processing a multi-point image to include a shadow of an object included in a two-dimensional image in the multi-point image based on position information and shape information of the object included in the two-dimensional image and the intensity and direction of light detected by the sensor.

15. In paragraph 10, When the first display panel and the second display panel are implemented as liquid crystal display (LCD) panels, The above control method is, A step of obtaining a user command for operating in a two-dimensional image display mode; and A method comprising: a step of displaying a monochrome image of a preset color using the first display panel and displaying a two-dimensional image using the second display panel when operating in the two-dimensional image display mode.

Images