Three-dimensional display device and its operating method

Abstract

To provide a three-dimensional display device and an operation method thereof are provided that can provide an improved three-dimensional image quality.SOLUTION: A three-dimensional display device includes: an eye tracking device; a display; and first and second processing parts. The first processing part calculates a coordinate of a left viewpoint and a right viewpoint based on left eye image data and right eye image data. The display includes a light emitter for emitting a light beam and a light splitter for distributing the light beam to the left viewpoint and the right viewpoint. The second processing part defines a crosstalk region based on an aperture angle and an optical path of the light beam passing through the light splitter. The crosstalk region is simultaneously irradiated with a first light beam assigned to the left viewpoint and a second light beam assigned to the right viewpoint. The second processing part compares preset gradations of the first and second light beams and then determines a corrected gradation of the first and second light beams. An operation method of the three-dimensional display device is also provided.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an electronic device and an operation method thereof, and particularly relates to a three-dimensional display device and its operation.

Background Art

[0002] In order to generate a three-dimensional image (or a stereoscopic image), a three-dimensional display device transmits left-eye image light and right-eye image light with a parallax to a user's left eye and right eye through an optical splitting unit (for example, a cylindrical lens or a parallax barrier). The light emitting unit in the three-dimensional display device is not a complete point light source, and the optical splitting unit cannot sufficiently collimate the light rays emitted by the light emitting unit, and / or the matching between the optical splitting unit and the light emitting unit is not perfect. The above factors tend to cause blurring and / or ghost (or superimposed image) in the three-dimensional image.

Summary of the Invention

Problems to be Solved by the Invention

[0003] The present invention provides a three-dimensional display device and an operation method thereof that can provide improved three-dimensional image quality.

Means for Solving the Problems

[0004] One embodiment of the present invention provides a three-dimensional display device comprising an eye-tracking device, a first processing unit, a display, and a second processing unit. The eye-tracking device provides left-eye image data and right-eye image data. The first processing unit is coupled to the eye-tracking device and calculates the coordinates of the left viewpoint and the coordinates of the right viewpoint based on the left-eye image data and the right-eye image data. The display displays an image and includes a plurality of light-emitting units for emitting a plurality of light rays and a plurality of light-splitting units for distributing the light rays to the left viewpoint and the right viewpoint. The second processing unit is coupled to the first processing unit and the display. The second processing unit defines a crosstalk region based on the aperture angle and optical path of the light rays passing through the light-splitting units. The crosstalk region is simultaneously illuminated by a first light ray from a plurality of light rays assigned to the left viewpoint and a second light ray from a plurality of light rays assigned to the right viewpoint. The second processing unit compares a first preset gradation of the first light ray with a second preset gradation of the second light ray, and then determines a first corrected gradation of the first light ray and a second corrected gradation of the second light ray.

[0005] Another embodiment of the present invention provides a method for operating a three-dimensional display device. The method includes the following steps: providing left-eye image data and right-eye image data; calculating left-viewpoint coordinates and right-viewpoint coordinates based on the left-eye image data and right-eye image data; displaying the image via a display including a plurality of light-emitting units for emitting light rays and a plurality of light-splitting units for distributing the light rays to the left-viewpoint and right-viewpoint; defining a crosstalk region based on the aperture angles and optical paths of a plurality of light rays passing through the plurality of light-splitting units; the crosstalk region is simultaneously illuminated by a first ray from a plurality of light rays assigned to the left-viewpoint and a second ray from a plurality of light rays assigned to the right-viewpoint; further comparing a first preset ray from the first ray and a second preset ray from the second ray to determine a first corrected ray from the first ray and a second corrected ray from the second ray. [Effects of the Invention]

[0006] In summary, by comparing the differences between the preset tones of the left and right eyes and performing tonal correction, when the preset tones of the left and right eyes are the same or similar (when the images are the same or similar), the degree of adjustment between the tones of the left and right eyes can be reduced, or the tonal difference between the corrected image and the preset image can be reduced, maintaining the overall light intensity of the image or improving the quality of the three-dimensional image.

[0007] To make the above easier to understand, several embodiments are described in detail below, accompanied by drawings. [Brief explanation of the drawing]

[0008] The accompanying drawings are included to provide a further understanding of the present invention and are incorporated herein and constitute part thereof. The drawings represent exemplary embodiments of the present invention and, together with the specification, serve to illustrate the principles of the present invention.

[0009] [Figure 1] This is a partial top view of a display in a three-dimensional display device according to some embodiments of the present invention. [Figure 2A] This is a partial cross-sectional view of a display in a three-dimensional display device according to some embodiments of the present invention, showing different projection states of multiple light rays when the position of a person's eye changes. [Figure 2B] This is a partial cross-sectional view of a display in a three-dimensional display device according to some embodiments of the present invention, showing different projection states of multiple light rays when the position of a person's eye changes. [Figure 3] This graph shows the relationship between light rays and light intensity. [Figure 4] This is a block diagram of a three-dimensional display device according to several embodiments of the present invention. [Figure 5] This is a block diagram of a three-dimensional display device according to several embodiments of the present invention. [Figure 6] This is a block diagram of a three-dimensional display device according to several embodiments of the present invention. [Figure 7]This is a block diagram of a three-dimensional display device according to several embodiments of the present invention. [Figure 8] This is a block diagram of a three-dimensional display device according to several embodiments of the present invention. [Figure 9] This is a flowchart illustrating the operation method of a three-dimensional display device according to several embodiments of the present invention. [Modes for carrying out the invention]

[0010] The present invention will be described with reference to exemplary embodiments shown in the accompanying drawings. Wherever possible, the same reference numerals will be used in the drawings and the specification to refer to the same or similar components.

[0011] Throughout this specification and the accompanying claims, specific terms are used to refer to certain elements. Those skilled in the art will understand that manufacturers of electronic devices may refer to the same element by different names. This invention is not intended to distinguish between elements that have the same function but different names. In the following specification and claims, terms such as “contains” and “includes” are open-ended terms and should be interpreted as “includes, but is not limited to…”.

[0012] In the following embodiments, terms used to indicate directions such as “up,” “down,” “front,” “back,” “left,” and “right” simply refer to directions in the accompanying drawings. Therefore, the directional terms provided herein are not limiting to the invention but serve an explanatory purpose. In the accompanying drawings, each figure represents a method applicable to a particular embodiment and general characteristics of the structure and / or materials in that embodiment. However, these figures should not be interpreted or defined as the scope covered by a particular embodiment. For example, the relative dimensions, thicknesses, and locations of various layers, regions, and / or structures may be reduced or enlarged for clarity.

[0013] In this specification, when one structure (or layer, element, substrate) is described as being located above / above another structure (or layer, element, substrate), it may mean that the two structures are adjacent and directly connected, or that the two structures are adjacent to each other but not directly connected. Indirect connection means that at least one intermediate structure (or intermediate layer, intermediate element, intermediate substrate, intermediate gap) is provided between the two structures, and the lower side of one structure is adjacent to or directly connected to the upper side of the intermediate structure, and the upper side of the other structure is adjacent to or directly connected to the lower side of the intermediate structure. The intermediate structure may be formed by a single-layer or multi-layer physical structure or a non-physical structure, and is not particularly limited. In this specification, when a particular structure is described as being located "on" another structure, it may mean that the particular structure is located "directly" on the other structure, or it may mean that the particular structure is located "indirectly" on the other structure, i.e., that at least one structure is provided between the particular structure and the other structure.

[0014] The terms “about,” “substantially,” and “approximately” are usually interpreted as being within 10% of a given value or range, or within 5%, 3%, 2%, 1%, or 0.5% of a given value or range. In addition, the expressions “the range is between the first and second numbers” and “the range is between the first and second numbers” mean that the range includes the first number, the second number, and other numbers in between.

[0015] The terms “first” and “second” used in this specification and the claims are used to modify elements and do not imply or indicate that the elements have a prior ordinal number, nor do they represent the order of a particular element to another element, or the order of a manufacturing method. The use of ordinal numbers is used solely to clearly distinguish an element with a specific name from another element with the same name. The claims and the specification may not necessarily use the same terminology. Therefore, in the specification, the first component may be the second component in the claims.

[0016] The electrical connection or coupling relationship described in the present invention may refer to a direct connection or an indirect connection. In the case of a direct connection, the endpoints of the elements on two circuits are directly connected to each other, or are connected to each other by a conductor segment. In the case of an indirect connection, between the endpoints of the elements on two circuits, there are switches, diodes, capacitors, inductors, resistors, other appropriate elements, or combinations of the above elements, but this should not be construed as limiting the present invention.

[0017] In the present invention, the thickness, length, and width can be measured by an optical microscope (OM), and the thickness can be measured from the cross-sectional image of an electron microscope, but the present invention is not limited thereto. In addition, a certain degree of error may be allowed between two values or directions for comparison. The expressions "a given range is from the first numerical value to the second numerical value", "a given range is within the range of the first numerical value to the second numerical value", or "a given range is between the first numerical value and the second numerical value" mean that the given range includes the first numerical value, the second numerical value, and other numerical values therebetween. When the first direction is perpendicular to the second direction, the angle between the first direction and the second direction can be between 80 degrees and 100 degrees. When the first direction is parallel to the second direction, the angle between the first direction and the second direction can be between 0 degrees and 10 degrees.

[0018] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by those skilled in the art. These terms should be construed to have a meaning consistent with the related art and the background or context of the present invention, as defined in a commonly used dictionary, and should not be construed in an idealized or overly formal manner, unless specifically defined in the embodiments of the present invention.

[0019] In the present invention, electronic devices include, but are not limited to, display devices, backlight devices, antenna devices, packaging devices, sensing devices, or bonding devices. Electronic devices may be bendable or flexible electronic devices. Display devices may be non-self-emissive or self-emissive display devices. Display devices may include, but are not limited to, liquid crystals, light-emitting diodes, phosphors, phosphorescent materials, quantum dots (QDs), other suitable display media, or combinations thereof. Antenna devices may include, for example, reconfigurable intelligent surfaces (RIS), frequency-selective surfaces (FSS), radio frequency filters (RF filters), polarizers, resonators, or antennas. Antennas may be liquid crystal antennas or varactor diode antennas. Sensing devices may be sensing devices that sense capacitance, light, thermal energy, or ultrasonic waves, but the present invention is not limited to these. In the present invention, electronic devices may include electronic elements, which may include passive and active elements such as capacitors, resistors, inductors, diodes, and transistors. Diodes may include light-emitting diodes (LEDs), varactor diodes, or photodiodes. The LED may include, but is not limited to, organic LEDs (OLEDs), submillimeter LEDs (mini-LEDs), micro-LEDs, or quantum dot LEDs. The bonding apparatus may be, for example, a display bonding apparatus or an antenna bonding apparatus, but the present invention is not limited to these. The electronic apparatus may be any combination of the above, but the present invention is not limited to these. The packaging apparatus may be a wafer-level packaging (WLP) technology such as a chip-first process or a chip-last (RDL-first) process, or a panel-level packaging ( PLP The packaging device may be applicable to the technology. The external appearance of the electronic device may be rectangular, circular, polygonal, or have curved edges, or other suitable shapes. The electronic device may include peripheral systems such as drive systems, control systems, and light source systems to support display devices, antenna devices, wearable devices (e.g., including augmented reality or virtual reality), in-vehicle devices (e.g., including car windshields), or bonding devices.

[0020] FIG. 1 is a partial top view of a display in a three-dimensional display device according to some embodiments of the present invention. FIGS. 2A and 2B are partial cross-sectional views of a display in a three-dimensional display device according to some embodiments of the present invention, showing different projection states of a plurality of light rays when the position of a person's eye changes. FIG. 3 is a graph showing the relationship between light rays and light intensity. FIGS. 4 to 8 are various block diagrams of a three-dimensional display device according to some embodiments of the present invention. FIG. 9 is a flowchart of an operation method of a three-dimensional display device according to some embodiments of the present invention. It should be understood that the following embodiments can replace, rearrange, and combine functions in some different embodiments in order to complete other embodiments without departing from the spirit of the present invention. Embodiments may be combined as needed, provided that the features of the embodiments do not violate the spirit of the present invention or conflict with each other.

[0021] First, referring to Figures 1 to 4, the three-dimensional display device 1 includes an eye-tracking device 10, a first processing unit 11, a display 12, and a second processing unit 13. The eye-tracking device 10 provides left-eye image data DL and right-eye image data DR. The first processing unit 11 is coupled to the eye-tracking device 10 and calculates the coordinates of the left-viewpoint VPL and the right-viewpoint VPR (e.g., coordinates CL and CR) based on the left-eye image data DL and the right-eye image data DR. The display displays an image and includes a plurality of light-emitting units 120 that emit a plurality of light rays B, and a plurality of light-splitting units 121 for distributing the light rays B to the left-viewpoint VPL and the right-viewpoint VPR. The second processing unit 13 is coupled to the first processing unit 11 and the display 12. The second processing unit 13 defines the crosstalk region XT based on the aperture angle θ and optical path (optical transmission path) of the light rays B passing through the light-splitting units 121. The crosstalk region XT is simultaneously illuminated by a first ray from a plurality of rays B assigned to the left-viewpoint VPL (e.g., at least one ray from a plurality of left-eye image beams BL) and a second ray from a plurality of rays B assigned to the right-viewpoint VPR (e.g., at least one ray from a plurality of right-eye image beams BR). The second processing unit 13 compares the first preset gradation of the first ray with the second preset gradation of the second ray, and then determines the first corrected gradation of the first ray and the second corrected gradation of the second ray.

[0022] In this specification, the three-dimensional display device 1 is, for example, a glasses-free three-dimensional display device. That is, the user can view three-dimensional images without wearing stereoscopic glasses (also called 3D glasses). For example, the three-dimensional display device 1 may be a display device such as a mobile phone or tablet computer, a display device for augmented reality, virtual reality, dual view, etc., an in-vehicle device, a medical device, etc., but the present invention is not limited to these.

[0023] In the three-dimensional display device 1, the eye-tracking device 10 may provide left-eye image data DL and right-eye image data DR by capturing images of the user, particularly left-eye and right-eye images. In some embodiments, as shown in Figure 4, the eye-tracking device 10 may include an imaging component 100 for capturing left-eye and right-eye images. The imaging component 100 may include, for example, two cameras capable of capturing two-dimensional images to acquire three-dimensional image data corresponding to the left and right eyes, but is not limited thereto. Alternatively, the imaging component 100 may include, but is not limited thereto, a camera capable of capturing two-dimensional images and a depth sensor (e.g., a depth camera) capable of acquiring depth information.

[0024] The imaging component 100 may be coupled to the first processing unit 11 in order to provide the left eye image data DL and the right eye image data DR to the first processing unit 11. In this specification, coupling may include signal / data transmission by wired or wireless means.

[0025] The first processing unit 11, based on the left eye image data DL and right eye image data DR provided by the imaging component 100, determines the coordinates CL of the left viewpoint VPL (e.g., left eye) and the right viewpoint VPR (For example, the coordinates of the right eye) CR It is possible to calculate the following. For example, the first processing unit 11 may be a processor, a chip, or a component with arithmetic or processing functions. In some embodiments, as shown in Figure 4, the first processing unit 11 may be integrated into the eye-tracking device 10, but the present invention is not limited thereto. Depending on different needs, the first processing unit 11 may be located in the eye-tracking device 10, the display 12, or an external device (e.g., an image source 14).

[0026] In some embodiments, as shown in Figure 4, the imaging component 100 and the first processing unit 11 may be integrated into the eye-tracking device 10, and the second processing unit 13 may be integrated into the display 12. The eye-tracking device 10 may be coupled to the display 12 to provide the coordinates CL of the left-viewpoint VPL and the coordinates CR of the right-viewpoint VPR to the second processing unit 13 in the display 12. In this way, the second processing unit 13 may perform subsequent calculations and / or processing based on the coordinates CL of the left-viewpoint VPL and the coordinates CR of the right-viewpoint VPR, but the present invention is not limited thereto. In some embodiments, as shown in Figure 4, the three-dimensional display device 1 may further include an image source 14. The image source 14 may be used to provide a two-dimensional image (also called a planar image). For example, the image source 14 may include one or more components 140, such as a computer, an endoscope, a processor, a playback box, or a streaming system.

[0027] In some embodiments, the image source 14 may further include calculation and / or processing functions, and the image source 14 may be coupled to the eye-tracking device 10 and the display 12. The eye-tracking device 10 may provide the image source 14 with at least one of the following: left-eye image data DL, right-eye image data DR, coordinates CL of the left-viewpoint VPL, and coordinates CR of the right-viewpoint VPR. In some embodiments, as shown in Figure 4, the display 12 may provide the image source 14 with the coordinates CL of the left-viewpoint VPL and the coordinates CR of the right-viewpoint VPR. The image source 14 may generate disparity-laden left-eye and right-eye images IM based on the coordinates CL of the left-viewpoint VPL and the coordinates CR of the right-viewpoint VPR. Furthermore, the image source 14 may provide the disparity-laden left-eye and right-eye images IM to the display 12.

[0028] The light-emitting portion 120 in the display 12 is, for example, a plurality of pixels. In some embodiments, as shown in Figures 1, 2A, and 2B, the light-emitting portion 120 may include a plurality of red pixels PR, a plurality of green pixels PG, and a plurality of blue pixels PB. The plurality of red pixels PR, a plurality of green pixels PG, and a plurality of blue pixels PB are arranged alternately in direction D1, for example, and a plurality of pixels of the same color (e.g., a plurality of red pixels PR, a plurality of green pixels PG, or a plurality of blue pixels PB) are arranged in direction D2, for example. Directions D1 and D2 are both perpendicular to the thickness direction of the display 12 (e.g., direction D3) and intersect each other. In some embodiments, directions D1 and D2 are perpendicular to each other, but the present invention is not limited thereto. In some embodiments, the light-emitting portion 120 may include, but is not limited to, a plurality of organic light-emitting diodes, a plurality of submillimeter light-emitting diodes, a plurality of micro light-emitting diodes, or a plurality of quantum dot light-emitting diodes.

[0029] The light-splitting section 121 in the display 12 is located on the light-emitting side of the light-emitting section 120 and is used to distribute light rays B to the left-view VPL and right-view VPR. For example, the light-splitting section 121 may include multiple cylindrical lenses (illustrated in Figures 1, 2A, and 2B), multiple parallax barriers, or other light-splitting components. In some embodiments, as shown in Figure 4, the light-splitting section 121 is located in direction D1 and extends in direction D4, where direction D4 may be parallel or perpendicular to direction D1, and direction D4 may be parallel or perpendicular to direction D2. By designing the extension direction of the light-splitting section 121 (e.g., direction D4) to be neither parallel nor perpendicular to the arrangement direction of the multiple light-emitting sections 120 (e.g., directions D1 and D2), display quality can be improved, for example, by mitigating the moiré pattern problem.

[0030] In the top view shown in Figure 1, each light-splitting section 121 may overlap with multiple light-emitting sections 120 in the light-emitting section 120 in direction D3. Figure 1 only schematically represents 18 light-emitting sections 120 and 3 light-splitting sections 121, and the light-splitting section 121 located in the center of Figure 1 overlaps with 12 light-emitting sections 120 in direction D3. However, it should be understood that the number of light-emitting sections 120 and light-splitting sections 121, and / or the number of light-emitting sections 120 overlapping with each light-splitting section 121, may vary depending on the actual needs and are not limited to those shown in Figure 1. Furthermore, in some embodiments, although not shown, the display 12 may include, but is not limited to, other components or film layers in addition to the light-emitting sections 120 and light-splitting sections 121, such as a substrate, a color conversion layer, a filter layer, a polarizing plate, an adhesive layer, a protective layer, and / or a cover plate.

[0031] Referring to Figure 1, each optical splitting section 121 may have a center line M (imaginary line) parallel to the extension direction (direction D4) of the optical splitting section 121. Whether or not the light-emitting section 120 is used to provide the left-eye image beam BL or the right-eye image beam BR may be determined based on the position of the center of the light-emitting section 120 with respect to the center line M. Using Figure 1 as an example, a light-emitting section 120 whose center is located to the right of the center line M may be used to provide the left-eye image beam BL, and a light-emitting section 120 whose center is located to the left of the center line M may be used to provide the right-eye image beam BR. The portion of the optical splitting section 121 located to the right of the center line M may be used to guide the left-eye image beam BL to the left-viewpoint VPL, and the portion of the optical splitting section 121 located to the left of the center line M may be used to guide the right-eye image beam BR to the right-viewpoint VPR.

[0032] In the actual configuration, several light-emitting units 120 cross the center line M. Figure 1 illustrates light-emitting units 120-1, 120-2, and 120-3 crossing the center line M. The centers of light-emitting units 120-1 and 120-3 are located to the left of the center line M and provide the right-eye image beam BR, while the center of light-emitting unit 120-2 is located to the right of the center line M and provides the left-eye image beam BR. BLThe following is provided: Most of the right-eye image beam BR from light-emitting units 120-1 and 120-3 is directed towards the right-viewpoint VPR by the portion of the light-splitting unit 121 located to the left of the center line M. However, a small portion of the right-eye image beam BR from light-emitting units 120-1 and 120-3 is directed towards the left-viewpoint VPL by the portion of the light-splitting unit 121 located to the right of the center line M, thus causing image blurring and / or ghosting problems. Similarly, most of the left-eye image beam BL from light-emitting unit 120-2 is directed towards the left-viewpoint VPL by the portion of the light-splitting unit 121 located to the right of the center line M. However, a small portion of the left-eye image beam BL from light-emitting unit 120-2 is directed towards the right-viewpoint VPR by the portion of the light-splitting unit 121 located to the left of the center line M, thus causing image blurring and / or ghosting problems. In addition, at least one light-emitting portion 120 located at the interface IF of adjacent light-splitting portions 121 also causes image blurring and / or ghosting problems for similar reasons.

[0033] To improve the imperfect match problem between the light splitting unit 121 and the light-emitting unit 120 described above, the signal from the first processing unit 11 may be processed or calculated by a second processing unit 13 coupled to the first processing unit 11 and the display 12. Furthermore, a crosstalk region XT is defined based on the aperture angle θ and optical path of the light ray B passing through the light splitting unit 121, and the correction result is fed back to the display 12 so that the display 12 displays the corrected left-eye and right-eye images IM. The second processing unit 13 is, for example, a field-programmable gate array (FPGA), a chip, a timing controller, or another component with calculation or processing functions. In some embodiments, as shown in Figure 4, the second processing unit 13 may be integrated into the display 12, but the present invention is not limited thereto. Depending on different needs, the second processing unit 13 may be located in the display 12 or in an external device (e.g., an image source 14).

[0034] The aperture angle θ of ray B may vary depending on the product design. For example, the aperture angle θ may be in the range of 5° to 35°, i.e., 5° ≤ θ ≤ 35°, but the present invention is not limited thereto. The crosstalk region XT refers to the region simultaneously illuminated by at least one left-eye image beam BL (also called the first ray) in ray B assigned to the left-viewpoint VPL and at least one right-eye image beam BR (also called the second ray) in ray B assigned to the right-viewpoint VPR, as shown in Figures 2A and 2B. The crosstalk of the left-viewpoint VPL is defined, for example, as the absolute value of the right-eye image beam BR - left-eye image beam BL ÷ left-eye image beam BL × 100%, i.e., [|(BR-BL)| / BL]*100%. Similarly, the crosstalk of the right-viewpoint VPR is defined, for example, as the absolute value of the left-eye image beam BL - right-eye image beam BR ÷ right-eye image beam BR × 100%, i.e., [|(BL-BR)| / BR]*100%. The crosstalk region XT is, for example, the region where crosstalk (crosstalk of the left-view VPL and / or crosstalk of the right-view VPR) is 10% or more. More specifically, the second processing unit 13 may store data such as the position, focal point, width, length, and height of each optical splitting unit 121, the position of each light-emitting unit 120, and the distance between each light-emitting unit 120 and each optical splitting unit 121, and may calculate the optical path of the light rays emitted from each light-emitting unit 120 to the optical splitting unit 121, and the optical path and emission angle after passing through the optical splitting units 121. In other words, one light splitter The aperture angle of the group of light-emitting units 120 corresponding to 121 may be calculated based on the above data, and then the crosstalk region may be defined, but the present invention is not limited thereto.

[0035] As shown in Figures 2A and 2B, the group of light-emitting units corresponding to the light-splitting unit 121 changes, for example, as the position of the person's eye changes. In some embodiments, one of the first processing unit 11 and the second processing unit 13 may further calculate the center coordinate CC of the person's eye based on the coordinates of the left viewpoint VPL and the right viewpoint VPR (e.g., coordinates CL and CR). One of the first processing unit 11 and the second processing unit 13 may further identify the central light-emitting unit C120 based on the center C121 of the light-splitting unit 121 (e.g., the light-splitting unit in Figure 2A or Figure 2B) corresponding to the center coordinate CC of the person's eye. One of the first processing unit 11 and the second processing unit 13 may further identify the light-splitting unit 121 Based on the aperture angle θ and the optical path, the left group light-emitting section GL and the right group light-emitting section GR located on either side of the central light-emitting section C120 may be further specified.

[0036] The central light-emitting section C120 is, for example, a light-emitting section 120 through which a line connecting the center coordinate CC of the human eye and the center C121 of the corresponding light-splitting section 121 passes. The left group light-emitting section GL is located to the left of the central light-emitting section C120 and includes a plurality of light-emitting sections that provide the left-eye image beam BL. The right group light-emitting section GR is located to the right of the central light-emitting section C120 and includes a plurality of light-emitting sections that provide the right-eye image beam BR. The number of light-emitting sections 120 in either the left group light-emitting section GL or the right group light-emitting section GR may be determined according to the actual needs. In some embodiments, the width W120 of the central light-emitting section C120, the left group light-emitting section GL, and the right group light-emitting section GR corresponds to the width W121 of the corresponding light-splitting section 121. For example, the width W120 may be equal to or approximately similar to the width W121. The total number of light-emitting sections GL, GR, and the central light-emitting section C120 is, for example, the total number of light-emitting sections 120 within the width W121 range.

[0037] As shown in Figure 2A or Figure 2B, in some embodiments, the crosstalk region XT may correspond to, for example, the region where the central light-emitting unit C120 is located, two lateral regions of the left group light-emitting unit GL, or two lateral regions of the right group light-emitting unit GR. For rays B in the crosstalk region XT, the second processing unit 13 may compare a first preset gradation corresponding to the first ray (one or more left eye image beams BL) and a second correction gradation corresponding to the second ray (one or more right eye image beams BR) in order to determine a first correction gradation corresponding to the first ray (one or more left eye image beams BL) and a second correction gradation corresponding to the second ray (one or more right eye image beams BR). For example, if the first preset gradation is L, the second preset gradation is R, the first correction gradation is L', the second correction gradation is R', and the correction parameter is α, then the three-dimensional display device satisfies L'=L-|(LR)|*(1-α) and R'=R-|(LR)|*(1-α), and 0≦α≦1. Based on the above relationship, the first corrected tone is, for example, below the first preset tone, and the second corrected tone is, for example, below the second preset tone. Also, as α increases, L' or R' increases, which means that the tone (or light intensity) decreases slightly. Conversely, as α decreases, L' or R' decreases, which means that the tone (or light intensity) decreases significantly.

[0038] For example, if the first preset tone L is 255, the second preset tone R is 128, and the correction parameter α is 0.5, then based on the above-mentioned relationship, the first corrected tone L' can be calculated as 192 (the result is rounded to the nearest whole number) and the second corrected tone R' as 65. If the first preset tone L is 255, the second preset tone R is 255, and the correction parameter α is 0.5, then based on the above-mentioned relationship, the first corrected tone L' can be calculated as 255 and the second corrected tone R' as 255.

[0039] By comparing the difference between the preset tones of the left and right eyes (e.g., |(LR)|) and performing tone correction, when the preset tones of the left and right eyes are the same or similar (when the images are the same or similar), the degree of adjustment of the tones of the left and right eyes may be reduced, or the tonal difference between the corrected image and the preset image may be reduced, while maintaining the overall light intensity of the image. The above relationship is just one example, and it should be understood that in other embodiments, other relationships may be used to perform tone correction.

[0040] In some embodiments, the correction parameter α may vary with respect to the distance between the corresponding light-emitting section 120 and the central light-emitting section C120. For example, as shown in Figure 2A or Figure 2B, the aperture angle θ is divided into N equal sections, and the rays in each equal section are numbered from n=0 to n=N. Then, the gradation correction described above is performed on these rays from n=0 to N. For convenience of explanation, N=255 is used as an example in Figure 3. That is, multiple rays B are numbered n in the range of 0 to 255, but the present invention is not limited thereto. In other embodiments, N may be a larger or smaller value. For example, as the resolution increases, N may be a larger value to perform more accurate gradation correction.

[0041] In Figure 3, n=0 to 128 are light rays corresponding to multiple light-emitting units 120 in the right group light-emitting unit GR in Figure 2A or Figure 2B, for example, and n=128 to 255 are light rays corresponding to multiple light-emitting units 120 in the left group light-emitting unit GL in Figure 2A or Figure 2B. In Figure 3, the dashed line L1 represents the light intensity curve of the right eye image beam, and the solid line L2 represents the light intensity curve of the left eye image beam. In ideal conditions, to achieve ideal image quality (e.g., low crosstalk), the light intensity of the right eye image beam is 0 for n=128 to 255, and the light intensity of the left eye image beam is 0 for n=0 to 128.

[0042] In Figure 3, the crosstalk region XT is irradiated by rays n=0~10, n=123~133, and n=245~255. Rays n=0~10 correspond to multiple light-emitting units 120 located away from the central light-emitting unit C120 in the right group light-emitting unit GR in Figure 2A or Figure 2B. Rays n=123~133 correspond to multiple light-emitting units 120 located adjacent to the central light-emitting unit C120 in the right group light-emitting unit GR in Figure 2A or Figure 2B, and multiple light-emitting units 120 located adjacent to the central light-emitting unit C120 in the left group light-emitting unit GL. Rays n=245~255 correspond to multiple light-emitting units 120 located far from the central light-emitting unit C120 in the left group light-emitting unit GL in Figure 2A or Figure 2B.

[0043] In some embodiments, on the side of the left group light-emitting section GL furthest from the central light-emitting section C120, α (correction parameter) gradually decreases as the distance between the corresponding light-emitting section 120 and the central light-emitting section C120 increases (see n=245~255). On the side of the left group light-emitting section GL adjacent to the central light-emitting section C120, α gradually decreases as the distance between the corresponding light-emitting section 120 and the central light-emitting section C120 decreases (see n=128~133). On the side of the right group light-emitting section GR furthest from the central light-emitting section C120, α gradually decreases as the distance between the corresponding light-emitting section 120 and the central light-emitting section C120 increases (see n=123~128). On the side of the right group light-emitting section GR adjacent to the central light-emitting section C120, α gradually decreases as the distance between the corresponding light-emitting section 120 and the central light-emitting section C120 decreases (see n=0~10).

[0044] For example, from n=0 to n=10, α gradually changes from 0 to 1; from n=123 to n=128, α gradually changes from 1 to 0; from n=128 to n=133, α gradually changes from 0 to 1; and from n=245 to n=255, α gradually changes from 1 to 0.

[0045] By gradually reducing the light intensity (or the corresponding gradation of the light-emitting part) of multiple light rays incident on the crosstalk region XT, crosstalk can be improved, the uniformity of light intensity throughout the image can be enhanced, and the image quality can be further improved.

[0046] In some embodiments, the second processing unit 13 may further compare the first corrected tone L', the first preset tone L, and the second preset tone R. If the first corrected tone L' is between the first preset tone L and the second preset tone R, the display 12 displays the first corrected tone L'. If the first corrected tone L' is less than the smaller of the first preset tone L and the second preset tone R, the display 12 displays the smaller of the first preset tone L and the second preset tone R. In some embodiments, the second processing unit 13 may further compare the second corrected tone R', the first preset tone L, and the second preset tone R. If the second corrected tone R' is between the first preset tone L and the second preset tone R, the display 12 displays the second corrected tone R'. If the second corrected tone R' is less than the smaller of the first preset tone L and the second preset tone R, the display 12 displays the smaller of the first preset tone L and the second preset tone R. For example, based on the above-mentioned relationship, if the first preset tone L is 255, the second preset tone R is 128, and the correction parameter α is 0.5, then the first corrected tone L' can be calculated as 192 and the second corrected tone R' as 65. Since the calculated first corrected tone L' is between the first preset tone L and the second preset tone R, the display 12 displays the first corrected tone L'. On the other hand, since the second corrected tone R' is less than the smaller of the first preset tone L and the second preset tone R (the smaller of 255 and 128 is 128), the display 12 displays the smaller of the first preset tone L and the second preset tone R (i.e., 128).

[0047] By comparing corrected tones (e.g., first corrected tones L' or second corrected tones R') with preset tones (including first preset tones L and second preset tones R), and adjusting the tones displayed by the display 12 based on the comparison results, the degree of change in tones can be reduced, and the light intensity of the left and right eye images displayed on the display 12 approaches the expected light intensity.

[0048] When providing evidence, a first preset tone L and a second preset tone R may be input to the three-dimensional display device, where the first preset tone L is different from the second preset tone R. Next, an image screenshot may be taken to verify the first corrected tone L' and the second corrected tone R'. If both the first corrected tone L' and the second corrected tone R' are greater than or equal to the smaller of the first preset tone L and the second preset tone R, the three-dimensional display device is determined to perform the step of comparing the corrected tone and the preset tone described above. Conversely, if at least one of the first corrected tone L' and the second corrected tone R' is less than the smaller of the first preset tone L and the second preset tone R, the three-dimensional display device is determined not to perform the step of comparing the corrected tone and the preset tone described above, but rather to further solve the system of equations by analyzing the image screenshot and changes in the source image (by inputting different first preset tone L and second preset tone R to verify the first corrected tone L' and the second corrected tone R') in order to obtain the original relationship.

[0049] In some embodiments, as shown in Figure 5, the first processing unit 11 may be located within the image source 14. For example, component 140 may be a component with computing capabilities, and the first processing unit 11 may be located within component 140, but the present invention is not limited thereto.

[0050] In some embodiments, as shown in Figure 6, the second processing unit 13 may be located within the image source 14. For example, component 140 may be a component 140 with computing capabilities, and the second processing unit 13 may be located within component 140, but the present invention is not limited thereto. The second processing unit 13 can provide the calculated three-dimensional image IM' to the display 12, which may display the three-dimensional image IM'.

[0051] In some embodiments, as shown in Figure 7, the first processing unit 11 and the second processing unit 13 may both be located in the image source 14. For example, component 140 may be a component 140 with computing capabilities, and the first processing unit 11 and the second processing unit 13 may both be located in component 140, but the present invention is not limited thereto. The second processing unit 13 can provide the calculated three-dimensional image IM' to the display 12, which may display the three-dimensional image IM'.

[0052] In some embodiments, as shown in Figure 8, the first processing unit 11 and the second processing unit 13 may be located together in the display 12. The display 12 may provide the coordinates of the left-view VPL and right-view VPR (e.g., coordinates CL and CR) to the image source 14. The image source 14 may include one or more components 140, such as a computer, endoscope, processor, playback box, or streaming system, to generate left-eye and right-eye images IM with parallax. The second processing unit 13 may process or calculate the left-eye and right-eye images IM to display a three-dimensional image.

[0053] Referring to Figure 9, the operation method of the three-dimensional display device includes the following steps: Provide left-eye image data and right-eye image data (step S100). Calculate the coordinates of the left viewpoint and the right viewpoint based on the left-eye image data and the right-eye image data (step S102). Display the image via a display that includes multiple light-emitting units for emitting light rays and multiple light-splitting units for distributing light rays to the left viewpoint and the right viewpoint (step S104). Define the crosstalk region based on the aperture angle and optical path of multiple light rays passing through the multiple light-splitting units. The crosstalk region is simultaneously illuminated by the first light ray among the multiple light rays assigned to the left viewpoint and the second light ray among the multiple light rays assigned to the right viewpoint (step S106). Furthermore, compare the first preset gradation of the first light ray and the second preset gradation of the second light ray in order to determine the first corrected gradation of the first light ray and the second corrected gradation of the second light ray (step S108). Details of the above steps are described above and will not be repeated here.

[0054] Based on the above, in an embodiment of the present invention, by comparing the difference between the preset tones of the left eye and the right eye and performing tone correction, when the preset tones of the left eye and the right eye are the same or similar (when the images are the same or similar), the degree of adjustment of the tones of the left eye and the right eye can be reduced, or the difference in tone between the corrected image and the preset image can be reduced, thereby maintaining the light intensity of the entire image or improving the quality of the three-dimensional image.

[0055] The embodiments described above are provided solely to illustrate the technical means of the present invention and should not be construed as limitations of the invention. While the embodiments described above are referenced to provide a detailed description of the invention, those skilled in the art will understand that various modifications and changes can be made to the technical means of the disclosed embodiments, or that some or all of the technical features can be replaced by equivalent substitutions. However, it is intended that such modifications, changes, and substitutions do not cause the nature of the technical means to deviate from the scope of the technical means of the embodiments of the present invention.

[0056] While embodiments and advantages of the present invention have been disclosed above, those skilled in the art will understand that modifications, substitutions, and alterations can be made without departing from the spirit and scope of the invention. Furthermore, it is possible to irregularly mix and substitute features between embodiments to form other new embodiments. Moreover, the scope of the present invention is not intended to be limited to specific embodiments of the processes, machines, articles, compositions of substances, means, methods, and steps described herein. Those skilled in the art will readily understand from this disclosure that existing or subsequently developed processes, machines, articles, compositions of substances, means, methods, or steps that perform substantially the same function or achieve substantially the same results as the corresponding embodiments described herein can be utilized in accordance with this disclosure. Accordingly, the claims of the present invention are intended to encompass such processes, machines, articles, compositions of substances, means, methods, and / or steps within their scope. Furthermore, each claim constitutes an individual embodiment, and the scope of the present invention further covers each claim and its combination with its respective embodiments. The scope of protection of the present invention shall be defined by the appended claims. [Industrial applicability]

[0057] The three-dimensional display device and its operating method of the present invention can be applied to electronic devices. [Explanation of symbols]

[0058] 1: Three-dimensional display device 10: Eye-tracking device 11: First Processing Unit 12: Display 13: Second Processing Unit 14: Image source 100: Imaging component 120, 120-1, 120-2, 120-3: Light-emitting part 121: Light splitter 140: Components B: Beam BL: Left eye image beam BR: Right eye image beam C120: Central light-emitting section C121: Center CC: Center coordinates of a human eye CL, CR: Coordinates D1, D2, D3, D4: Direction DL: Left eye image data DR: Right eye image data GL: Left group light-emitting section GR: Right group light-emitting section IF: Interface IM: Left eye and right eye images IM': Three-dimensional image L1: Dashed line L2: Solid line M: Center line n: number PB: Blue pixels PG: Green pixels PR: Red Pixel S100, S102, S104, S106, S108: Step VPL: Left View VPR: Right-hand perspective W120, W121: Width X T: Crosstalk region θ: opening angle

Claims

1. An eye-tracking device for providing left eye image data and right eye image data, A first processing unit, coupled to the eye-tracking device, calculates the coordinates of the left viewpoint and the coordinates of the right viewpoint based on the left eye image data and the right eye image data, Multiple light-emitting parts for emitting multiple rays, Multiple light splitting units for distributing the multiple light rays to the left viewpoint and the right viewpoint, A display for displaying images, including The first processing unit and the second processing unit coupled to the display Includes, The second processing unit defines a crosstalk region based on the aperture angle and optical path of the plurality of light rays passing through the plurality of light splitting units, and the crosstalk region is simultaneously illuminated by the first light ray among the plurality of light rays assigned to the left viewpoint and the second light ray among the plurality of light rays assigned to the right viewpoint. The second processing unit compares the difference between the first preset gradation corresponding to the first ray and the second preset gradation corresponding to the second ray in order to determine the first corrected gradation corresponding to the first ray and the second corrected gradation corresponding to the second ray. If the first preset tone is L, the second preset tone is R, the first corrected tone is L', the second corrected tone is R', and the correction parameter is α, L'=L-|(LR)|*(1-α), R' = R - |(L ​​- R)| * (1 - α) The following conditions are met: 0 ≤ α ≤ 1 Three-dimensional display device.

2. The first processing unit and one of the second processing units further calculate the central coordinates of the human eye based on the coordinates of the left viewpoint and the coordinates of the right viewpoint. The first processing unit and one of the second processing units further identify the central light-emitting unit based on the center of the light-dividing unit corresponding to the central coordinates of the human eye, One of the first and second processing units further identifies the left group light-emitting units and the right group light-emitting units located on both sides of the central light-emitting unit based on the aperture angle and optical path of the plurality of light-dividing units. The three-dimensional display device according to claim 1.

3. The widths of the central light-emitting section, the left group light-emitting section, and the right group light-emitting section correspond to the corresponding light-dividing sections. The three-dimensional display device according to claim 2.

4. The central light-emitting unit, the left group light-emitting unit, and the right group light-emitting unit, which correspond to the central coordinates of the human eye at the first position of the human eye, are different from the central light-emitting unit, the left group light-emitting unit, and the right group light-emitting unit, which correspond to the central coordinates of the human eye at the second position of the human eye. The three-dimensional display device according to claim 2.

5. The aforementioned crosstalk region corresponds to the region where the central light-emitting section is located, the two lateral regions of the left group light-emitting section, or the two lateral regions of the right group light-emitting section. On the side of the left group of light-emitting units that is farther from the central light-emitting unit, α gradually decreases as the distance between the corresponding light-emitting unit and the central light-emitting unit increases. On the side of the left group of light-emitting units adjacent to the central light-emitting unit, as the distance between the corresponding light-emitting unit and the central light-emitting unit decreases, α gradually decreases. On the side of the right group of light-emitting units that is farther from the central light-emitting unit, α gradually decreases as the distance between the corresponding light-emitting unit and the central light-emitting unit increases. On the side of the right group of light-emitting units adjacent to the central light-emitting unit, α gradually decreases as the distance between the corresponding light-emitting unit and the central light-emitting unit decreases. The three-dimensional display device according to claim 2.

6. The second processing unit further compares the differences between the first corrected gradation, the first preset gradation, and the second preset gradation. When the first corrected gradation is between the first preset gradation and the second preset gradation, the display displays the first preset gradation. When the first corrected gradation is less than the smaller of the first preset gradation and the second preset gradation, the display shows the smaller of the first preset gradation and the second preset gradation. The three-dimensional display device according to claim 1.

7. The second processing unit further compares the differences between the second corrected gradation, the first preset gradation, and the second preset gradation. When the second corrected gradation is between the first preset gradation and the second preset gradation, the display shows the second preset gradation. When the second corrected gradation is less than the smaller of the first preset gradation and the second preset gradation, the display shows the smaller of the first preset gradation and the second preset gradation. The three-dimensional display device according to claim 1.

8. The first processing unit is located in the eye-tracking device, the display, or an external device. The three-dimensional display device according to claim 1.

9. The second processing unit is located on the display or external device. The three-dimensional display device according to claim 1.

10. The extension direction of the plurality of light-splitting portions is neither horizontal nor perpendicular with respect to the arrangement direction of the plurality of light-emitting portions. The three-dimensional display device according to claim 1.

11. The aforementioned opening angle is in the range of 5 to 35 degrees. The three-dimensional display device according to claim 1.

12. To provide left eye image data and right eye image data, Based on the left eye image data and the right eye image data, the coordinates of the left viewpoint and the coordinates of the right viewpoint are calculated. Displaying an image via a display that includes multiple light-emitting units for emitting multiple light rays and multiple light-splitting units for distributing the multiple light rays to the left viewpoint and the right viewpoint, A crosstalk region is defined based on the aperture angle and optical path of the plurality of light rays passing through the plurality of light splitting sections, wherein the crosstalk region is simultaneously illuminated by a first light ray among the plurality of light rays assigned to the left viewpoint and a second light ray among the plurality of light rays assigned to the right viewpoint. In order to determine the first corrected tone corresponding to the first ray and the second corrected tone corresponding to the second ray, the difference between the first preset tone corresponding to the first ray and the second preset tone corresponding to the second ray is compared. Includes, If the first preset tone is L, the second preset tone is R, the first corrected tone is L', the second corrected tone is R', and the correction parameter is α, L'=L-|(LR)|*(1-α), R' = R - |(L ​​- R)| * (1 - α) The following conditions are met: 0 ≤ α ≤ 1 How a three-dimensional display device operates.

13. Based on the coordinates of the left viewpoint and the coordinates of the right viewpoint, the central coordinates of the human eye are calculated. Based on the center of the light-splitting portion corresponding to the central coordinates of the person's eye, the central light-emitting portion is identified. Based on the aperture angles and optical paths of the plurality of light-splitting sections, the left group light-emitting sections and the right group light-emitting sections located on both sides of the central light-emitting section are identified. This also includes, The method for operating a three-dimensional display device according to claim 12.

14. The widths of the central light-emitting section, the left group light-emitting section, and the right group light-emitting section correspond to the corresponding light-dividing sections. The method for operating a three-dimensional display device according to claim 13.

15. The central light-emitting unit, the left group light-emitting unit, and the right group light-emitting unit, which correspond to the central coordinates of the human eye at the first position of the human eye, are different from the central light-emitting unit, the left group light-emitting unit, and the right group light-emitting unit, which correspond to the central coordinates of the human eye at the second position of the human eye. The method for operating a three-dimensional display device according to claim 13.

16. The aforementioned crosstalk region corresponds to the region where the central light-emitting section is located, the two lateral regions of the left group light-emitting section, or the two lateral regions of the right group light-emitting section. On the side of the left group of light-emitting units that is farther from the central light-emitting unit, α gradually decreases as the distance between the corresponding light-emitting unit and the central light-emitting unit increases. On the side of the left group of light-emitting units adjacent to the central light-emitting unit, as the distance between the corresponding light-emitting unit and the central light-emitting unit decreases, α gradually decreases. On the side of the right group of light-emitting units that is farther from the central light-emitting unit, α gradually decreases as the distance between the corresponding light-emitting unit and the central light-emitting unit increases. On the side of the right group of light-emitting units adjacent to the central light-emitting unit, α gradually decreases as the distance between the corresponding light-emitting unit and the central light-emitting unit decreases. The method for operating a three-dimensional display device according to claim 13.

17. To compare the differences between the first corrected tone, the first preset tone, and the second preset tone. It further includes, When the first corrected gradation is between the first preset gradation and the second preset gradation, the display displays the first preset gradation. When the first corrected gradation is less than the smaller of the first preset gradation and the second preset gradation, the display shows the smaller of the first preset gradation and the second preset gradation. The method for operating a three-dimensional display device according to claim 12.

18. To compare the differences between the second corrected tone, the first preset tone, and the second preset tone. It further includes, When the second corrected gradation is between the first preset gradation and the second preset gradation, the display shows the second preset gradation. When the second corrected gradation is less than the smaller of the first preset gradation and the second preset gradation, the display shows the smaller of the first preset gradation and the second preset gradation. The method for operating a three-dimensional display device according to claim 12.

Images