Display apparatus providing 3D image and method of controlling the same

By combining 3D display, enhanced display and mirror panel in the display device, using the processor to generate virtual images, the problem of wearing glasses in the stereo display system is solved, the resolution and brightness of the automatic stereo 3D image is improved, and 2D/ Flexible conversion of 3D mode.

CN118947107APending Publication Date: 2024-11-12SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202380030456.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-07-05
Filing Date
2023-03-24
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing stereo display system requires wearing glasses to view 3D images, which limits the user experience, and the automatic stereo system has insufficient resolution and brightness.

Method used

Design a display device, including a 3D display, an enhanced display and a mirror panel, display the input image in the 3D image provision mode through the processor and generate a virtual image, and use the transmittance information of the mirror panel to adjust the image quality and brightness to realize the 2D image. Offering mode to turn off the 3D display to improve the resolution and brightness of automatic stereo 3D images.

Benefits of technology

3D images can be viewed without wearing glasses, which improves the resolution and brightness of the automatic stereo 3D images, avoids the brightness reduction and moiré stripes on the front side of the transparent display layout, and realizes flexible conversion between 2D/3D modes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118947107A_ABST
    Figure CN118947107A_ABST
Patent Text Reader

Abstract

A display device for providing a 3D image is disclosed. The display device includes: a 3D display including a display panel and a field-of-view separator disposed on a front surface of the display panel; an enhanced display disposed at a first angle with respect to the 3D display; a mirror panel disposed between the 3D display and the enhancement display at a second angle; and one or more processors. In the 3D image providing mode, the processor may display an input image on the augmented display to provide a virtual image in front of the 3D display, and may display a multi-view image corresponding to the input image on the 3D display. In the 2D image providing mode, the processor may display an input image on the augmented display to provide a virtual image in front of the 3D display, and may turn off the 3D display.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a display device and a control method thereof, and more particularly, to a display device that can switch between a three-dimensional (3D) image providing mode and a two-dimensional (2D) image providing mode and a control method thereof. Background Art

[0002] With the development of electronic technology, various types of electronic devices are being developed and popularized. In particular, display devices such as televisions (TVs), which are one of the most commonly used household appliances in ordinary households, have developed rapidly in recent years.

[0003] As the performance of display devices improves, the types of content displayed in the display devices are becoming more and more diverse. In particular, stereoscopic display systems capable of viewing 3D content have been developed and are becoming popular.

[0004] The stereoscopic display device can be implemented not only as a 3D TV used in general households, but also as various types of display devices, such as various monitors, mobile phones, personal digital assistants (PDAs), personal computers (PCs), set-top PCs, tablet computers, electronic photo frames, information kiosks, etc. In addition, 3D display technology can be used in various fields that require 3D imaging, such as science, medicine, design, education, advertising, computer games, etc.

[0005] Stereoscopic display systems can be roughly divided into automatic stereoscopic systems that can be viewed without wearing glasses and stereoscopic systems that should be viewed with glasses.

[0006] The stereoscopic system can provide a satisfactory stereoscopic feeling, but has the inconvenience that the viewer must use glasses. In contrast, the autostereoscopic system has the advantage of being able to view 3D images without wearing glasses, and therefore the development of the autostereoscopic system is under continuous discussion. Summary of the invention

[0007] Provided are a display device that can switch between a 3D image providing mode and a 2D image providing mode and a control method thereof.

[0008] Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments.

[0009] According to an aspect of the present disclosure, a display device may include: a 3D display including a display panel and a field of view separator disposed on a front surface of the display panel; an enhanced display disposed at a first angle relative to the 3D display; a mirror panel disposed at a second angle relative to the 3D display and disposed between the 3D display and the enhanced display; and at least one processor configured to operate in a 3D image providing mode and to operate a 2D image providing mode, wherein the at least one processor is further configured to: in the 3D image providing mode, display an input image on the enhanced display, provide a virtual image at a front position of a front surface of the 3D display, and display a multi-view image corresponding to the input image on the 3D display, and

[0010] Wherein, at least one processor is further configured to: in a 2D image providing mode, display the input image on the augmented display, provide a virtual image at a front position of a front surface of the 3D display, and turn off the 3D display.

[0011] The 3D display may be vertically arranged with respect to the enhancement display, and the mirror panel may include a semi-reflective mirror panel tilted 45 degrees with respect to the enhancement display.

[0012] The position at which the virtual image is provided may be adjusted based on at least one of the position of the 3D display and the position of the augmented display.

[0013] At least one processor may also be configured to, in a 3D image providing mode, render multiple image views with different viewpoints based on the depth of the input image, and display a multi-view image by arranging the multiple image views according to a predetermined arrangement pattern on a display panel of the 3D display.

[0014] At least one processor may also be configured to: in a 3D image providing mode, identify multiple first pixels having different viewpoints in a multi-view image, identify multiple second pixels corresponding to the multiple first pixels in a virtual image, acquire a first processed image by processing the input image so that at least one of the pixel values ​​or brightness values ​​of the multiple second pixels has a different value, and display the first processed image on an enhanced display.

[0015] At least one processor may also be configured to: in a 3D image providing mode, predict crosstalk (X-talk) generated between image views of different viewpoints based on the arrangement positions of multiple image views, obtain a second processed image compensated for X-talk by processing the input image based on the predicted X-talk, and display the second processed image on an enhanced display.

[0016] At least one processor may also be configured to predict user-recognized image quality information of the virtual image based on transmittance information of the mirror panel, obtain a third processed image by processing the image quality of the input image based on the user-recognized image quality information and the target image quality information, and display the third processed image on the enhanced display.

[0017] The at least one processor may also be configured to acquire a fourth processed image by enhancing at least one of a boundary region, an edge region, and a point region included in the input image in a 3D image providing mode, and display the fourth processed image on an enhanced display.

[0018] The at least one processor may be further configured to predict brightness information of the virtual image based on brightness information of the input image and transmittance information of the mirror panel, and adjust brightness of the multi-view image based on the predicted brightness information of the virtual image.

[0019] The resolution of the image displayed on the enhancement display may be equal to or lower than the resolution of the display panel of the 3D display.

[0020] According to one aspect of the present disclosure, a control method for a display device includes: a 3D display, including a display panel and a field of view separator arranged on a front surface of the display panel; an enhanced display, arranged at a first angle relative to the 3D display; and a mirror panel, arranged at a second angle relative to the 3D display and arranged between the 3D display and the enhanced display. The control method may include: in a 3D image providing mode, displaying an input image on the enhanced display, providing a virtual image at a front position of the front surface of the 3D display, and displaying a multi-view image corresponding to the input image on the 3D display; and in a 2D image providing mode, displaying the input image on the enhanced display, providing the virtual image at a front position of the front surface of the 3D display, and turning off the 3D display.

[0021] The 3D display may be vertically arranged with respect to the enhancement display, and the mirror panel may include a semi-reflective mirror panel tilted 45 degrees with respect to the enhancement display.

[0022] The position at which the virtual image is provided may be adjusted based on at least one of the position of the 3D display and the position of the augmented display.

[0023] In the 3D image providing mode, displaying the multi-view image may include rendering a plurality of image views having different viewpoints based on a depth of an input image, and displaying the multi-view image by arranging the plurality of image views in a predetermined arrangement pattern on a display panel of the 3D display.

[0024] According to one aspect of the present disclosure, a non-transitory computer-readable storage medium may store instructions which, when executed by at least one processor, cause the at least one processor to: in a 3D image providing mode, display an input image on an augmented display, the augmented display being set at a first angle relative to the 3D display, provide a virtual image at a front position of a front surface of the 3D display, and display a multi-view image corresponding to the input image on the 3D display, and in a 2D image providing mode, display the input image on the augmented display, provide the virtual image at a front position of the front surface of the 3D display, and turn off the 3D display. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0026] Figure 1 is a diagram showing the operation of an autostereoscopic three-dimensional (3D) display device according to an embodiment;

[0027] Figure 2 is a block diagram showing a configuration of a display device according to an embodiment;

[0028] Figure 3 is a diagram showing a configuration of a 3D display according to an embodiment;

[0029] Figure 4 is a diagram showing a usage form of a half mirror according to an embodiment;

[0030] Figure 5 is a diagram showing an arrangement form of a 3D display, an enhancement display, and a mirror panel according to an embodiment;

[0031] Figure 6 is a flowchart illustrating the operation of a processor according to an embodiment;

[0032] Figure 7 is a diagram showing an operation of a display device in a 3D image providing mode according to an embodiment;

[0033] Figure 8 is a diagram showing an operation of a display device in a 2D image providing mode according to an embodiment;

[0034] Fig. 9 is a flow chart illustrating a method of processing an enhanced image according to an embodiment;

[0035] Fig.10 is a flow chart illustrating a method of processing an enhanced image according to an embodiment;

[0036] Fig.11 is a flow chart illustrating a method of processing an enhanced image according to an embodiment;

[0037] Fig.12 is a diagram showing transmittance information of a mirror panel according to an embodiment;

[0038] Fig.13 is a flow chart illustrating a method of processing an enhanced image according to an embodiment;

[0039] Fig.14 is a flowchart illustrating a method of processing a multi-view image according to an embodiment;

[0040] Fig.15 is a diagram illustrating a method of acquiring a correction image according to an embodiment; and

[0041] Fig.16 is a diagram showing a detailed configuration of a display device according to an embodiment. DETAILED DESCRIPTION

[0042] Hereinafter, the exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. The same reference numerals are used for the same components in the figures, and their redundant descriptions will be omitted. The embodiments described herein are exemplary embodiments, and therefore, the present disclosure is not limited thereto and can be implemented in various other forms. It should be understood that, unless the context clearly specifies otherwise, the singular form includes plural indicators. The terms used in the present disclosure (including technical terms or scientific terms) may have the same meaning as those skilled in the art generally understand. In view of the functions described in the present disclosure, the currently widely used general terms are selected as the terms used in the present disclosure as much as possible. However, these terms may vary according to the intentions of those skilled in the art, previous court decisions, or the emergence of new technologies, etc. In addition, in certain cases, there may be terms arbitrarily specified by the applicant, and in this case, the meaning of the terms will be described in detail in the relevant descriptions in the present disclosure. Therefore, the terms used in the present disclosure should be defined based on the meaning of the terms and the overall content of the present disclosure, and should not be based solely on the names of the terms.

[0043] In addition, terms such as “first”, “second”, etc. may be used to describe various elements, but these terms are not intended to limit these elements. These terms are only used to distinguish one element from another element.

[0044] In addition, singular expressions include plural expressions unless clearly defined differently in the context. In addition, in the present disclosure, terms such as "including" and "consisting of" should be understood to indicate the presence of such features, numbers, steps, operations, elements, components, or combinations thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, elements, components, or combinations thereof.

[0045] Furthermore, the expression “at least one of A or B” should be interpreted as referring to “A” only, “B” only, or both “A” and “B”.

[0046] In addition, in the present disclosure, a "module" or "component" performs at least one function or operation and can be implemented as hardware or software, or a combination of hardware and software. In addition, in addition to the "module" or "component" that needs to be implemented as specific hardware, multiple "modules" or "components" can be integrated into at least one module and implemented as at least one processor.

[0047] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that a person skilled in the art can easily implement the present disclosure. However, it should be noted that the present disclosure can be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the accompanying drawings, in order to clearly illustrate the present disclosure, parts not related to the description are omitted, and similar components are represented by similar reference numerals throughout the specification.

[0048] Figure 1 2 is a diagram illustrating an operation of an autostereoscopic three-dimensional (3D) display device according to an embodiment.

[0049] Figure 1 The operating method of the device for providing a stereoscopic image in an automatic stereoscopic method by displaying a multi-view image according to an embodiment is shown, and the multi-view image includes a plurality of images of the same object taken from different angles. That is, an image is provided in which a plurality of images taken from different viewpoints are refracted at different angles and focused at a position at a specific distance, which can be referred to as a viewing distance. The position forming the viewing area can be referred to as an optical view. Therefore, if one eye of the user is in a first optical view and the other eye is in a second optical view, a stereoscopic sense can be felt.

[0050] According to an embodiment, the display device may provide an optical view by using a plurality of image views. Specifically, the display device may generate a plurality of image views by rendering an input image, and generate a multi-view image such that at least two of the plurality of image views provide an optical view. As an example, Figure 1 is a diagram showing a display operation in the case where four optical views are provided using a total of eight image views of different viewpoints. Figure 1, the autostereoscopic 3D display device may emit light corresponding to the first viewpoint image and the second viewpoint image to project to the left eye, and emit light corresponding to the third viewpoint image and the fourth viewpoint image to project to the right eye. Therefore, the user sees images of different viewpoints on the left eye and the right eye, so that the stereoscopic effect can be felt. However, this is only an example, and in the case where a total of M (M>>N) optical views are provided using image views corresponding to N viewpoints, one optical view may include image views of N / M viewpoints.

[0051] A problem with the aforementioned autostereoscopic 3D techniques is that the resolution decreases as much as the viewpoints are used to increase the viewing range.

[0052] In the following, various embodiments will be described in which virtual images may be used to improve the resolution of autostereoscopic 3D images.

[0053] Figure 2 is a block diagram showing a configuration of a display device according to an embodiment.

[0054] according to Figure 2 , the display device 100 includes a 3D display 110 , an enhanced display 120 , a mirror panel 130 , and a processor 140 .

[0055] According to an embodiment, as the display device 100, any device can be applied without restriction as long as it is a device equipped with a display function, such as a television (TV), a monitor, a personal computer (PC), a kiosk, a large screen display (LFD), a digital signage, a digital information display (DID), a video wall, an electronic display device (or a vehicle display), etc.

[0056] The 3D display 110 performs the function of providing multiple optical views in the viewing area of ​​the user. According to an embodiment, the 3D display 110 includes a display panel 111 for providing multiple optical views and a field separator 112 (eg, a lenticular lens array), such as Figure 3 shown.

[0057] The display panel 111 includes a plurality of pixels, which include a plurality of sub-pixels. The sub-pixels may include red (R), green (G) and blue (B). That is, the pixels including R, G and B sub-pixels may be arranged in the direction of a plurality of rows and columns and constitute the display panel 111. The display panel 111 may be implemented as a display including a self-luminous element or a display including a non-self-luminous element and a backlight. For example, the display panel 111 may be implemented as various forms of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a light emitting diode (LED), a plasma display panel (PDP), a quantum dot light emitting diode (QLED), etc. Inside the display panel 111, a driving circuit and a backlight unit, etc., which may be implemented in the form of amorphous silicon thin film transistor (TFT), low temperature polycrystalline silicon (LTPS) TFT, organic TFT (OTFT), etc., may also be included at the same time. The display panel 111 may be implemented as a touch screen combined with a touch sensor, a flexible display, a rollable display, a 3D display, a display with multiple display modules physically connected, etc.

[0058] The field separator 112 may be disposed on the front surface of the display panel 111 and provide different viewpoints (ie, optical views for each viewing area). In this case, the field separator 112 may be implemented as a lenticular lens or a parallax barrier.

[0059] Figure 3 is a diagram showing a configuration of a 3D display according to an embodiment. Figure 3 As shown, the field of view separator 112 can be implemented as a cylindrical lens including a plurality of lens areas. Therefore, the cylindrical lens can refract the image displayed on the display panel 111 through the plurality of lens areas. Each lens area can be formed to correspond to the size of at least one pixel, and the light passing through each pixel is dispersed differently for each viewing area. As another example, the field of view separator 112 can be implemented as a parallax barrier. The parallax barrier is implemented as a transparent slit array including a plurality of barrier areas. Therefore, light can be blocked by the slits between the barrier areas, and images of different viewpoints can be output for each viewing area.

[0060] according to Figure 3 , the display panel 111 includes a plurality of pixels divided into a plurality of columns. For each column, an image view of a different viewpoint is arranged. Figure 3 , shows a form in which the first to eighth views as a plurality of image views of different viewpoints are arranged in sequence in a repetitive manner. That is, each pixel column is arranged in groups numbered 1, 2, 3, 4, 5, 6, 7, and 8.

[0061] Each image view formed on the display panel 111 is projected onto a field of view separator 112 (e.g., a cylindrical lens array), and the field of view separator 112 disperses the light of each projected image view and transmits the light in the direction of the user. That is, the field of view separator 112 generates an exit pupil at the user's position (i.e., viewing distance). The thickness and diameter of the cylindrical lenses when implemented as a cylindrical lens array and the spacing of the slits when implemented as a parallax barrier can be designed so that the exit pupils generated by each column are separated by an average binocular center distance of less than about 65 mm. The separated image lights form optical views respectively. That is, as Figure 3 As shown, in the case where a plurality of optical views are formed in the viewing area and the left eye and the right eye of the user are respectively located in different optical views, a 3D image can be viewed.

[0062] The enhanced display 120 can be implemented as a conventional display panel that displays 2D images. For example, the enhanced display 120 can be implemented as a display including a self-luminous element or a display including a non-self-luminous element and a backlight. For example, the enhanced display 120 can be implemented as a display in various forms such as LCD, OLED display, LED, PDP, QLED, etc. Inside the enhanced display 120, a driving circuit and a backlight unit that can be implemented in forms such as a-si TFT, LTPS TFT, OTFT, etc. can also be included at the same time. The enhanced display 120 can be implemented as a touch screen combined with a touch sensor, a flexible display, a rollable display, a 3D display, a display with multiple display modules physically connected, etc.

[0063] Figure 4 1 is a diagram showing a use form of a half-mirror according to an embodiment. The mirror panel 130 may be implemented in a form including a half-mirror (or a mirror film). The half-mirror may be implemented as a glass plate or a transparent plastic plate on which a metal thin film or a dielectric multilayer film is deposited, and the metal thin film or the dielectric multilayer film reflects a portion of the introduced light and allows another portion to pass. Figure 4 The general use form of the half mirror is shown. The user views the image displayed on the display panel 410 through the half mirror 420, and when the images are not reproduced at the same time, the light seen by the user is the external light source reflected by the half mirror 420, so the half mirror 420 can be used as a reflector. In the half mirror 420, a special coating process is performed on the glass, so the reflectivity and transmittance can each account for half, but the present disclosure is not necessarily limited to this.

[0064] Figure 5 is a diagram showing an arrangement form of a 3D display, an enhancement display, and a mirror panel according to an embodiment.

[0065] According to an embodiment, Figure 5As shown, the augmented display 120 may be disposed at a first angle relative to the 3D display 110. In addition, the mirror panel 130 may be disposed between the 3D display 110 and the augmented display 120 at a second angle.

[0066] For example, the 3D display 110 may be vertically arranged with respect to the augmented display 120. However, the present disclosure is not necessarily limited thereto, and the first angle may have different values ​​within the threshold angle range based on 90 degrees.

[0067] In addition, the mirror panel 130 may be arranged to be inclined at 45 degrees with respect to the augmented display 120. However, the present disclosure is not necessarily limited thereto, and the second angle may have a different value within the threshold angle range based on 45 degrees.

[0068] At least one processor 140 (also referred to as processor 140) is electrically connected to the 3D display 110, the enhanced display 120, and the mirror panel 130, and controls the overall operation of the display device 100. The at least one processor 140 may include one or more processors. The at least one processor 140 may be implemented as at least one software or at least one hardware, or a combination of at least one software and at least one hardware. According to an embodiment, the software or hardware logic corresponding to the at least one processor 140 may be implemented in one chip. According to an embodiment, the software or hardware logic corresponding to some of the plurality of processors may be implemented in one chip, and the software or hardware logic corresponding to the remaining processors may be implemented in different chips.

[0069] In particular, the processor 140 may perform operations of the display device 100 according to various embodiments of the present disclosure by executing at least one instruction stored in the memory.

[0070] According to an embodiment, the processor 140 may be implemented as a digital signal processor (DSP), a microprocessor, a graphics processing unit (GPU), an artificial intelligence (AI) processor, a neural processing unit (NPU), and a timing controller (TCON) for processing digital image signals. However, the present disclosure is not limited thereto, and the processor 140 may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), and an ARM processor, or may be defined by these terms. In addition, the processor 140 may be implemented as a system on chip (SoC) or a large-scale integrated circuit (LSI) in which a processing algorithm is stored, or in the form of an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA).

[0071] In addition, the processor 140 for executing the neural network model according to the embodiment can be implemented as a general-purpose processor such as a CPU, AP, DSP, etc., a graphics-specific processor such as a GPU and a visual processing unit (VPU), or a combination of an AI-specific processor such as an NPU and software. The processor 140 can perform control to process input data according to the neural network model stored in the memory or predefined operating rules. Alternatively, in the case where the processor 140 is a dedicated processor (or an AI-specific processor), the processor 140 can be designed as a hardware structure dedicated to processing a specific neural network model. For example, hardware dedicated to processing a specific neural network model can be designed as a hardware chip such as an ASIC, FPGA, etc. In the case where the processor 140 is implemented as a dedicated processor, the processor 140 can be implemented to include a memory for implementing an embodiment of the present disclosure, or to include a memory processing function for using an external memory.

[0072] Figure 6 is a flowchart illustrating the operation of a processor according to an embodiment.

[0073] According to an embodiment, the processor 140 may operate in either a 3D image providing mode or a 2D image providing mode. For example, the display device 100 may operate in either a 3D image providing mode or a 2D image providing mode based on a user instruction, a type of input image, a predetermined mode, etc.

[0074] According to an embodiment, a 3D image providing mode is identified in operation S610. In operation S620, the processor 140 may display an input image on the augmented display 120 and display a multi-view image corresponding to the input image on the 3D display 110. The input image may be not only the input image itself but also a processed image in which the input image is processed into a specific image, and various embodiments related thereto will be described later.

[0075] The input image may be received from various external devices (e.g., source devices), external storage media (e.g., universal serial bus (USB) memory), external servers (e.g., network hard disks), etc., by a streaming or downloading method. Alternatively, the input image may be an image pre-stored in an internal memory. According to an embodiment, the input image may be any one of a single-view image, a stereoscopic image, or a multi-view image. A single-view image may refer to an image captured by a general shooting device. A stereoscopic image may refer to a 3D video image represented by only a left-eye image and a right-eye image, and is a stereoscopic image captured by a stereoscopic shooting device. Typically, a stereoscopic shooting device is a shooting device including two lenses, and is used to shoot stereoscopic images. A multi-view image may refer to a 3D video image that geometrically corrects an image captured by at least one shooting device and provides a user with various viewpoints in multiple directions through spatial synthesis, etc.

[0076] According to an embodiment, an input image may be received together with the depth information of the image. In general, the depth of an image is a depth value assigned to each pixel of the image, and as an example, an 8-bit depth may have a grayscale value of 0-255. For example, when represented based on black / white, black (low value) may represent a place farther from the viewer, and white (high value) may represent a place closer to the viewer. Depth information is information indicating the depth of a 3D image, and is information corresponding to the degree of binocular disparity between a left eye image and a right eye image constituting the 3D image. According to the depth information, the degree of stereoscopic perception felt by a person varies. That is, when the depth is large, the binocular disparity between the left eye and the right eye becomes larger, so the stereoscopic perception felt is relatively large, and when the depth is small, the binocular disparity between the left eye and the right eye becomes smaller, so the stereoscopic perception felt is relatively small. In general, the depth information may be obtained by the following methods: a passive method such as stereo matching that only uses the two-dimensional characteristics of an image to obtain depth information; and an active method using a device such as a depth camera. The depth information may be in the form of a depth map. A depth map may refer to a table including depth information for each area of ​​an image. The area may be divided in units of pixels, or may be defined as a predetermined area larger than a pixel unit. According to an embodiment, the depth map may be in the form of using 127 or 128 of the grayscale values ​​0-255 as a reference value, for example, 0 (or focal plane). The depth map may represent values ​​less than 127 or 128 as -values, and values ​​greater than 127 or 128 as +values. The reference value of the focal plane may be randomly selected between 0 and 255. -values ​​may represent sinking, and +values ​​may represent protrusion.

[0077] The processor 140 may render multiple image views of different viewpoints based on the input image and / or depth information.

[0078] In the case where the input image is a 2D image, the processor 140 may render multiple image views of different viewpoints based on the depth information extracted for 2D / 3D conversion. Alternatively, if multiple image views of different viewpoints and multiple corresponding depth information are received, the processor 140 may render a certain number (hereinafter referred to as N) of image views based on at least one of the multiple image views and depth information. Alternatively, if only multiple image views of different viewpoints are received, the processor 140 may extract depth information from the multiple image views and then render N image views based on the extracted depth information.

[0079] The processor 140 generates a multi-view image to be displayed on the 3D display 110 based on sub-pixel values ​​constituting a plurality of rendered image views of different viewpoints. For example, the processor 140 may provide a multi-view image by arranging a plurality of image views on the display panel 111 in a predetermined arrangement pattern.

[0080] Figure 7 is a diagram illustrating an operation of a display device in a 3D image providing mode according to an embodiment.

[0081] according to Figure 7 , when an image is displayed on the augmented display 120, a virtual image 710 may be provided in the front space of the 3D display 110 by the operation of the mirror panel 130. That is, the virtual image 710 may be set in a front position of the front side of the 3D display 110 so that the virtual image 710 may be separated from the front side of the 3D display 110 by a predetermined distance. For example, a Pepper's Ghost method may be used, but the present disclosure is not limited thereto. A virtual image may refer to an image projected and provided on a space, rather than a physical panel.

[0082] That is, a virtual image 710 that can improve the viewing resolution of a 3D image with reduced resolution is provided between the 3D display 110 and the viewer, thereby improving the viewing resolution, color purity, contrast, etc. of the 3D image. In particular, it is possible to prevent a reduction in brightness and moire fringes that may be generated in a structure in which a transparent display is arranged in front of the 3D display 110. For example, in the case of a structure in which a transparent display is arranged in front of the 3D display 110, there may be a limit to the resolution that can be improved due to the trade-off relationship between transmittance and resolution. In addition, if moire fringes are generated due to the overlap of regular patterns of the 3D display 110 and the transparent display, and a dispersion function is inserted between the two displays in order to overcome this problem, the stereoscopic characteristics may be reduced, and this may become a factor in the reduction in brightness.

[0083] However, if Figure 7In the illustrated embodiment, if the virtual image 710 is used as an enhanced image, the resolution of the 3D viewing image is improved and moire fringes are not generated.

[0084] According to an embodiment, the virtual image 710 may be disposed in a position at a predetermined distance from the front side of the 3D display 110. In this case, the position where the virtual image 710 is provided (i.e., the interval between the 3D display 110 and the virtual image 710) may be adjusted by changing the position of at least one of the 3D display 110 or the augmented display 120. For example, as the distance between the 3D display 110 and the augmented display 120 increases, the virtual image 710 may be disposed in a position at a relatively large distance from the 3D display 110.

[0085] According to an embodiment, the resolution of the image displayed on the enhanced display 120 may be equal to or lower than the resolution of the display panel included in the 3D display 110. For example, the image displayed on the 3D display 110 may be any one of a standard definition (SD) image, a high definition (HD) image, a full HD image, and an ultra HD image. In addition, the image displayed on the enhanced display 120 may be any one of an SD image, an HD image, a full HD image, and an ultra HD image. If the cost reduction of the enhanced display 120 is not considered, according to an implementation example, the resolution of the image displayed on the enhanced display 120 may be higher than the resolution of the multi-view image displayed on the 3D display 110.

[0086] According to an embodiment, the 2D image providing mode is identified in operation S630. In operation S640, the processor 140 may display the input image on the augmented display 120 and turn off the 3D display 110.

[0087] Figure 8 is a diagram showing the operation of the display device according to the embodiment in the 2D image providing mode. Figure 8 As shown, the same effect as watching a general 2D display can be achieved by making the 3D display 110 a black screen (i.e., turning off the 3D display) and implementing a 2D image in the blank space as a virtual 2D image 1410. That is, the virtual image 1410 can be set in a front position of the front side of the 3D display 110, so that the virtual image 1410 can be separated from the front side of the 3D display 110 by a predetermined distance.

[0088] Fig. 9 is a flow chart illustrating a method of processing an enhanced image according to an embodiment.

[0089] according to Fig. 9In operation S910, the processor 140 may identify a plurality of first pixels having different viewpoints in a multi-view image to be displayed on the 3D display 110. Figure 3 As shown, eight pixels corresponding to the first to eighth viewpoints may be identified as the first pixel. If it is assumed that the eight pixels corresponding to the first to eighth viewpoints are provided to a plurality of users, respectively, the eight pixels may be identified as one pixel for one user.

[0090] In operation S920, the processor 140 may identify a plurality of second pixels corresponding to the plurality of first pixels in a virtual image to be provided through the augmented display 120. Figure 3 As shown, the second pixel corresponding to the eight pixels corresponding to the first to eighth viewpoints on the virtual image can be identified. In this case, although the plurality of first pixels identified in operation S910 are identified as one pixel to the user, the plurality of second pixels are respectively identified as different pixels.

[0091] In operation S930, the processor 140 may process the input image so that at least one of the pixel values ​​or the brightness values ​​of the plurality of second pixels has a different value. In operation S935, the processor 140 may acquire a first processed image.

[0092] According to the embodiment, Figure 3 As shown, the multiple first pixels identified in operation S910 are identified as one pixel for the user, and therefore, at least one of the resolution or brightness value identified by the user for the image displayed on the 3D display 110 may be reduced. Therefore, the processor 140 may process the virtual image as an image for improving at least one of the resolution or brightness value of the 3D image. For example, the processor 140 may process the input image so that the multiple second pixels included in the virtual image corresponding to the multiple first pixels included in the 3D image have different pixel values. The processor may also acquire a first processed image. Alternatively, the processor 140 may process the input image so that the multiple second pixels corresponding to the multiple first pixels have different brightness values, and acquire a first processed image. Alternatively, the processor 140 may process the input image so that the multiple second pixels corresponding to the multiple first pixels have different pixel values ​​and brightness values, and acquire a first processed image.

[0093] In operation S940 , the processor 140 may display the first processed image on the augmented display 120 .

[0094] Fig.10 is a flow chart illustrating a method of processing an enhanced image according to an embodiment.

[0095] according to Fig.10In operation S1010, the processor 140 may predict the crosstalk (X-talk) generated between image views of different viewpoints based on the arrangement positions of the plurality of image views in the multi-view image. The prediction of X-talk may be performed by applying various conventional methods (e.g., X-talk matrix).

[0096] In operation S1020, the processor 140 may process the input image based on the predicted X-talk, and obtain a second processed image compensated for X-talk in operation S1025. According to an embodiment, the processor 140 may process the input image to achieve reverse compensation for the predicted X-talk. The processor 140 may obtain a second processed image.

[0097] In operation S1030 , the processor 140 may display the second processed image on the augmented display 120 .

[0098] Fig.11 is a flow chart illustrating a method of processing an enhanced image according to an embodiment.

[0099] according to Fig.11 , in operation S1110 , the processor 140 may predict user-recognized image quality information of a virtual image provided through the augmented display 120 based on transmittance information of the mirror panel 130 .

[0100] The transmittance information of the mirror panel 130 may include information of a brightness value of a grayscale of a virtual image determined based on the transmittance of the mirror panel 130. For example, the brightness characteristic information of the mirror panel 130 may be a brightness measurement value according to the grayscale of the virtual image. That is, the mirror panel 130 has a fixed transmittance, and therefore, by displaying an image signal for each grayscale on the enhanced display 120, a brightness value according to the grayscale of the virtual image recognized by the user may be obtained. That is, by displaying an image signal of 0IRE (Institute of Radio Engineers) (black) -100IRE (white) on the enhanced display 120 (for example, an image with a grayscale of 0-255 in the case of an 8-bit image), a brightness measurement value is calculated according to the grayscale of the virtual image, and the brightness measurement value may be stored in a memory.

[0101] Fig.12 is a diagram showing transmittance information of a mirror panel according to an embodiment.

[0102] like Fig.12As shown, by displaying an image signal of 0IRE (black)-100IRE (white) on the enhanced display 120, the brightness value of the virtual image can be measured, and the brightness measurement value for each grayscale generated thereby (i.e., transmittance characteristic information) can be stored in the memory. In addition, as described above, the brightness measurement value for each grayscale can be a value predicted by the processor 140 instead of an actually measured value, or it can be received from the outside. However, depending on the situation, the memory can store only a basic brightness map, and the processor 140 can calculate the brightness map corresponding to the transmittance of the mirror panel 130 in real time according to a lookup table (LUT), a calculation formula, etc.

[0103] In operation S1120, the processor 140 may process the image quality of the input image based on the user recognition image quality information and the target image quality information of the virtual image, and acquire a third processed image in operation S1125.

[0104] According to an embodiment, the processor 140 may identify user recognition brightness information of an image displayed on the 3D display 110 based on information stored in the memory, process brightness of the input image based on target brightness information, and acquire a third processed image.

[0105] In operation S1130 , the processor 140 may display the third processed image on the augmented display 120 .

[0106] Fig.13 is a flow chart illustrating a method of processing an enhanced image according to an embodiment.

[0107] according to Fig.13 , in operation S1310, the processor 140 may perform an enhancement process on at least one of the boundary area, the edge area, or the point area included in the input image, and in operation S1315, obtain a fourth processed image. The boundary area, the edge area, and the point area may be the area that the user first recognizes. The boundary area may be a boundary area of ​​an object or a text area, and the edge area may be an area including clear straight edges. For example, the boundary area may be an area with a thickness greater than or equal to a threshold thickness, and the edge area may be an area with a thickness less than a specific threshold thickness. The point area is an area where a specific pixel value aggregation is greater than or equal to a specific range, and may include a point area of ​​an object. For example, the point area may include areas such as a person's eyes, eyebrows, lips, etc.

[0108] According to an embodiment, the processor 140 may perform enhancement processing (eg, adjusting pixel values, shadow processing, etc.) on at least one of the boundary region, the edge region, or the point region, and acquire a fourth processed image.

[0109] In operation S1320, the processor 140 may display the fourth processed image on the augmented display 120. For example, in the case where a virtual image is provided by the fourth processed image in which at least one of the boundary region, the edge region, or the point region is enhanced, the user may recognize the region more clearly.

[0110] Fig.14 is a flowchart illustrating a method of processing a multi-view image according to an embodiment.

[0111] according to Fig.14 In operation S1410, the processor 140 may predict brightness information of the virtual image based on brightness information of the input image and transmittance information of the mirror panel 130.

[0112] According to an embodiment, in the case where the enhanced display 120 is implemented as an LCD, the processor 140 may acquire a dimming ratio (i.e., a lighting duty ratio of a current (hereinafter referred to as a current duty ratio)) for driving a backlight unit based on pixel information (or a physical quantity of a pixel) of an input image. The pixel information may be at least one of an average pixel value, a maximum pixel value (or a peak pixel value), a minimum pixel value, a median pixel value, or an average picture level (APL) of each block area. In this case, the pixel value may include at least one of a brightness value (or a grayscale value) or a color coordinate value.

[0113] The processor 140 may be configured as follows: Fig.12 As shown, the brightness information of the virtual image is predicted based on the brightness information of the input image and the transmittance information of the mirror panel 130 .

[0114] In operation S1420 , the processor 140 may adjust the brightness of the multi-view image based on the predicted brightness information of the virtual image, and display the multi-view image on the 3D display 110 in operation S1425 .

[0115] According to an embodiment, the processor 140 may adjust the brightness of the multi-view image based on the predicted brightness information of the virtual image so that the brightness of the multi-view image recognized by the user's eyes becomes the target brightness, and display the multi-view image on the 3D display 110 .

[0116] Fig.15 is a diagram illustrating a method of acquiring a corrected image according to an embodiment.

[0117] According to an embodiment, the processor 140 may acquire an image to correct the input image based on the illumination information acquired by the sensor. For example, the corrected image may be an image whose color, brightness, etc. are corrected to suit the illumination information.

[0118] according to Fig.15, the processor 140 may input the input image 1501 and the lighting information 1502 into the trained AI model 1510, and obtain a corrected image 1520. The corrected image 1520 may be an image used to generate an image to be displayed on the 3D display 110, or an image to be displayed on the augmented display 120.

[0119] An embodiment may input other environmental information (weather information, time information, etc.) or user profile information (user vision information, age information, etc.) in addition to lighting information into the AI ​​model together with the input image, and obtain a corrected image.

[0120] According to an embodiment, the AI ​​model can be implemented as a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN) or a deep Q network, etc., but is not limited thereto.

[0121] According to an embodiment, the A1 model may be trained based on input training data and output training data, or may be trained based on input training data. The feature of training an AI model may refer to training a basic AI model (e.g., an AI model including any random parameters) using a plurality of training data through a learning algorithm to form a predefined operating rule or an AI model set to perform desired characteristics (or purposes). This learning may be performed by the display device 100, but the present disclosure is not limited thereto, and may be performed by a separate server and / or system. As examples of learning algorithms, there are supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but the learning algorithms in the present disclosure are not limited to the above examples.

[0122] Fig.16 is a diagram showing a detailed configuration of a display device according to an embodiment.

[0123] according to Fig.16 , the display device 100 may include a 3D display 110, an enhanced display 120, a mirror panel 130, a processor 140, a memory 150, a communication interface 160, a user interface 170, and a speaker 180. Fig.16 Of the components shown, Figure 2 Detailed description of components that are repeated among the components shown will be omitted.

[0124] The memory 150 may store data used in various embodiments of the present disclosure. The memory 150 may be implemented in the form of a memory embedded in the display device 100, or in the form of a memory that can communicate with the display device 100 (or can be attached to or detached from the display device 100), depending on the purpose of storing data. For example, for data used to operate the display device 100, the data may be stored in a memory embedded in the display device 100, and for data used for extended functions of the display device 100, the data may be stored in a memory that can communicate with the display device 100. For the memory embedded in the display device 100, the memory may be implemented as at least one of a volatile memory (e.g., a dynamic random access memory (RAM) (DRAM), a static RAM (SRAM), or a synchronous dynamic RAM (SDRAM), etc.) or a non-volatile memory (e.g., a one-time programmable read-only memory (ROM) (OTPROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., a NAND flash memory, a NOR flash memory, etc.), a hard disk drive, or a solid-state drive (SSD)). In addition, for the memory that can communicate with the display device 100, the memory may be implemented in a form such as a memory card (e.g., a compact flash (CF), a secure digital (SD), a micro secure digital (Micro-SD), a mini secure digital (Mini-SD), an extreme digital (xD), a multimedia card (MMC), etc.), an external memory that can be connected to a USB port (e.g., a USB memory), etc.

[0125] According to an embodiment, the memory 150 may store at least one instruction or a computer program including an instruction for controlling the display apparatus 100 .

[0126] According to another embodiment, the memory 150 may store information about an AI model including a plurality of layers. The feature of storing information about the AI ​​model may refer to storing various information related to the operation of the AI ​​model (e.g., information about a plurality of layers included in the AI ​​model, information about parameters used in each of the plurality of layers (e.g., filter coefficients, biases, etc.), etc.).

[0127] According to an embodiment, the memory 150 may be implemented as a single memory storing data generated in various operations according to the embodiment. According to an embodiment, the memory 150 may also be implemented to include a plurality of memories storing different types of data, or storing data generated in different steps, respectively.

[0128] The communication interface 160 may be a component for communicating with an external device. For example, the communication interface 160 may receive an input of an image signal from an external device (e.g., a source device), an external storage medium (e.g., a USB memory), an external server (e.g., a network hard disk), etc. by a streaming or downloading method through a communication method such as Wi-Fi based on an access point (AP) (wireless local area network (LAN)), Bluetooth, Zigbee, wired / wireless LAN, wide area network (WAN), Ethernet, IEEE 1394, high-definition multimedia interface (HDMI), USB, mobile high-definition link (MHL), audio engineering society / European broadcasting union (AES / EBU), optical, coaxial, etc. The image signal may be any digital image signal of an SD image, an HD image, a full HD image, or an ultra HD image, but is not limited thereto.

[0129] The user interface 170 may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or as a touch screen, a remote control transceiver, etc. that can simultaneously perform the above-mentioned display function and operation input function. The remote control transceiver may receive a remote control signal from an external remote control device or send a remote control signal to an external remote control device through at least one communication method of infrared communication, Bluetooth communication, or Wi-Fi communication. According to an embodiment, the remote control transceiver may receive a scroll wheel input signal sent from an external remote controller.

[0130] The speaker 180 outputs an acoustic signal. For example, the speaker 180 may convert a digital acoustic signal processed by the processor 140 into an analog acoustic signal and amplify the signal, and output the signal. For example, the speaker 180 may include at least one speaker unit, a digital / analog (D / A) converter, an audio amplifier, etc., which may output at least one channel. According to an embodiment, the speaker 180 may be implemented to output various multi-channel acoustic signals. In this case, the processor 140 may perform enhancement processing on the input acoustic signal to correspond to the enhancement processing of the input image, and control the speaker 180 to output the signal. For example, the processor 140 may convert an input dual-channel acoustic signal into a virtual multi-channel (e.g., 5.1 channel) acoustic signal, or identify the position where the display device 100 is located and process the signal into a stereo signal optimized for space, or provide an acoustic signal optimized according to the type of the input image (e.g., the genre of the content).

[0131] In addition to the above, according to an implementation example, the display device 100 may further include at least one of a tuner, a demodulation part, and a camera. The tuner may tune a channel selected by a user in a radio frequency (RF) broadcast signal received through an antenna, or all pre-stored channels, and receive an RF broadcast signal. The demodulation part may receive a converted digital IF (DIF) signal from the tuner and demodulate the signal, and perform channel demodulation, etc. The camera may be turned on according to a predetermined event and perform shooting. The camera may convert a captured image into an electrical signal and generate image data based on the converted signal.

[0132] According to the various embodiments described above, a virtual image can be used to improve the resolution of a 3D image that is reduced due to multiple viewpoints. In particular, it is possible to prevent a reduction in brightness and moiré fringes that may be generated in a structure in which a transparent display is arranged in front of the 3D display 110. For example, in the case of a structure in which a transparent display is arranged in front of the 3D display 110, there may be a limit to the resolution that can be improved due to the trade-off relationship between transmittance and resolution. According to an embodiment, a virtual image can be provided at a desired resolution regardless of the transmittance of the mirror panel.

[0133] In addition, if moire fringes are generated due to the overlap of the regular patterns of the 3D display 110 and the transparent display, and a dispersion function is inserted between the two displays to overcome this problem, the stereoscopic characteristics may be reduced, and this may become a factor in the reduction of brightness. Therefore, since a diffusion sheet or the like for eliminating moire fringes is not used, the stereoscopic characteristics can be more clearly realized.

[0134] In addition, the conversion between 2D / 3D modes can also be achieved. In the 3D display device of the autostereoscopic method of the related art, the conversion between 2D / 3D modes cannot be performed, or the components or technology for the conversion are very complicated. However, according to the embodiment, the 3D mode can be realized by a combination of a 3D display and a virtual image, and the 2D mode can be realized only by a virtual image while the 3D display is turned off, so the conversion from the 3D mode to the 2D mode can be easily achieved.

[0135] The methods according to the above various embodiments of the present disclosure may be implemented in the form of an application that can be installed on a conventional electronic device. Alternatively, at least some of the methods according to the above various embodiments of the present disclosure may be performed using an AI model based on deep learning, i.e., a learning network model.

[0136] Furthermore, the methods according to the above-described various embodiments of the present disclosure may be implemented only through software upgrades, or through hardware upgrades of conventional electronic devices.

[0137] In addition, the above-mentioned various embodiments of the present disclosure may be implemented by an embedded server provided on the electronic device, or by an external server of the electronic device.

[0138] According to an embodiment of the present disclosure, the various embodiments described above may be implemented as software, which includes instructions stored in a machine-readable storage medium, which can be read by a machine (e.g., a computer). A machine refers to a device that calls instructions stored in a storage medium and can operate according to the called instructions, and the device may include an electronic device according to the above-mentioned embodiment. In the case where the instruction is executed by a processor, the processor may perform the function corresponding to the instruction by itself, or use other components under its control to perform the function corresponding to the instruction. The instruction may include code generated or executed by a compiler or interpreter. A machine-readable storage medium may be provided in the form of a non-temporary storage medium.

[0139] In addition, according to an embodiment of the present disclosure, the method according to the above-mentioned various embodiments can be provided by being included in a computer program product. A computer program product refers to a product that can be traded between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (compact disk (CD) ROM (CD-ROM))) or through an application store (e.g., PlayStore). TM ) Online distribution. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored in a storage medium such as a manufacturer's server, an application store's server, and a memory of a relay server, or may be temporarily generated.

[0140] In addition, each component (e.g., module or program) according to the various embodiments described above may be composed of a single entity or multiple entities, and some of the subcomponents described above may be omitted, or different subcomponents may also be included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into one entity to perform the same or similar functions as the functions performed by each component before integration. The operations performed by the modules, programs or other components according to the various embodiments may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or at least some operations may be performed in a different order, omitted, or other operations may be added.

[0141] Although certain embodiments of the present disclosure have been shown and described, the present disclosure is not limited to the above embodiments, and it is obvious that various modifications can be made by a person skilled in the art without departing from the gist of the present disclosure as required by the appended claims. In addition, these modifications are intended not to be interpreted independently of the technical concept or prospect of the present disclosure.

Claims

1. A display device, include: A three-dimensional 3D display comprises: a display panel, and a field separator arranged on a front surface of the display panel; an enhancement display disposed at a first angle relative to the 3D display; a mirror panel disposed at a second angle relative to the 3D display and between the 3D display and the augmented display; and at least one processor configured to operate in a 3D image providing mode and to operate in a two-dimensional 2D image providing mode, The at least one processor is further configured to: in the 3D image providing mode, displaying an input image on the enhanced display, providing a virtual image at a position forward of the front surface of the 3D display, and displaying a multi-view image corresponding to the input image on the 3D display, and The at least one processor is configured to: in the 2D image providing mode, displaying the input image on the augmented display, providing the virtual image at a position forward of the front surface of the 3D display, and The 3D display is turned off.

2. The display device according to claim 1, in, The 3D display is arranged vertically relative to the augmented display, and Wherein, the mirror panel comprises a semi-reflective mirror panel tilted 45 degrees relative to the enhanced display.

3. The display device according to claim 1, in, The position where the virtual image is provided is adjusted based on at least one of the position of the 3D display and the position of the augmented display.

4. The display device according to claim 1, in, The at least one processor is further configured to: in the 3D image providing mode, rendering a plurality of image views having different viewpoints based on the depth of the input image, and The multi-view image is displayed by arranging the plurality of image views in a predetermined arrangement pattern on the display panel of the 3D display.

5. The display device according to claim 4, in, The at least one processor is further configured to: in the 3D image providing mode, identifying a plurality of first pixels having different viewpoints in the multi-view image, identifying in the virtual image a plurality of second pixels corresponding to the plurality of first pixels, A first processed image is acquired by processing the input image so that at least one of the pixel values ​​or the brightness values ​​of the plurality of second pixels has a different value, and The first processed image is displayed on the enhanced display.

6. The display device according to claim 4, in, The at least one processor is further configured to: in the 3D image providing mode, Based on the arrangement positions of the plurality of image views, a crosstalk X-talk generated between image views of different viewpoints is predicted, By processing the input image based on the predicted X-talk, a second processed image compensated for the X-talk is obtained, and The second processed image is displayed on the enhanced display.

7. The display device according to claim 1, in, The at least one processor is further configured to: predicting user-recognized image quality information of the virtual image based on the transmittance information of the mirror panel, acquiring a third processed image by processing the image quality of the input image based on the user recognition image quality information and the target image quality information, and The third processed image is displayed on the enhanced display.

8. The display device according to claim 1, in, The at least one processor is further configured to: acquiring a fourth processed image by performing an enhancement process on at least one of a boundary region, an edge region, and a point region included in the input image in the 3D image providing mode, and The fourth processed image is displayed on the enhanced display.

9. The display device according to claim 1, in, The at least one processor is further configured to: predicting brightness information of the virtual image based on brightness information of the input image and transmittance information of the mirror panel, and The brightness of the multi-view image is adjusted based on the predicted brightness information of the virtual image.

10. The display device according to claim 1, in, The resolution of the image displayed on the enhancement display is equal to or lower than the resolution of the display panel of the 3D display.

11. A method for controlling a display device, wherein the display device include: A three-dimensional 3D display, the 3D display comprising a display panel and a field separator arranged on a front surface of the display panel; an enhancement display disposed at a first angle relative to the 3D display; and a mirror panel disposed at a second angle relative to the 3D display and between the 3D display and the enhanced display, the control method comprising: In 3D image provision mode: displaying an input image on the enhanced display; providing a virtual image at a position forward of the front surface of the 3D display; and displaying a multi-view image corresponding to the input image on the 3D display; and In 2D image provision mode: displaying the input image on the enhanced display; providing the virtual image at a position forward of the front surface of the 3D display; and The 3D display is turned off.

12. The control method according to claim 11, in, The 3D display is arranged vertically relative to the augmented display, and Wherein, the mirror panel comprises a semi-reflective mirror panel tilted 45 degrees relative to the enhanced display.

13. The control method according to claim 11, in, The position where the virtual image is provided is adjusted based on at least one of the position of the 3D display and the position of the augmented display.

14. The control method according to claim 11, in, In the 3D image providing mode, displaying the multi-view image comprises: Rendering a plurality of image views having different viewpoints based on the depth of the input image; and The multi-view image is displayed by arranging the plurality of image views in a predetermined arrangement pattern on the display panel of the 3D display.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to: In 3D image provision mode: displaying an input image on an augmented display disposed at a first angle relative to the 3D display; providing a virtual image at a position forward of a front surface of the 3D display; and displaying a multi-view image corresponding to the input image on the 3D display, and In 2D image provision mode: displaying the input image on the enhanced display; providing the virtual image at a position forward of the front surface of the 3D display; and The 3D display is turned off.

Citation Information

Cited By

  • Method and device for evaluating definition of three-dimensional light field display

    CN119722602A