Display device

Abstract

To provide a display unit that can further improve the image quality of a stereoscopic image provided to a user.SOLUTION: A display unit 17 comprises: a display 20 that includes a first display area 201 having a left eye visual recognition area 201L and a right eye visual recognition area 201R, and a second display area 202 displaying a plane image; a backlight 19 that is located farther than the display 20 when seen from a user 13; a barrier part 21 that is located on a side of the backlight 19 of the display 20 or on a side of the user 13 of the display 20, and has a first barrier area 211 corresponding to the first display area 201 and a second barrier area 212 corresponding to the second display area 202; and an optical member 15 that reflects image light toward the user 13 to allow the user 13 to visually recognize a virtual image 14. The virtual image 14 has a small distortion area with relatively small distortion, and a large distortion area with relatively large distortion. The first barrier area 211 corresponds to the small distortion area, and the second barrier area 212 corresponds to the large distortion area.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a viewpoint detection device and a display device. [Background technology]

[0002] A conventional viewpoint detection device and display device are described, for example, in Patent Document 1. This conventional technology describes a technique in which a control unit acquires information about the eye position of a user, such as a driver of a moving object, and dynamically controls a parallax barrier in accordance with the eye position determined by the control unit, thereby reducing distortion in the displayed image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-15823 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for a viewpoint detection device and a display device that can further improve the quality of the stereoscopic images provided to the user. [Means for solving the problem]

[0005] The viewpoint detection device of the present disclosure includes an imaging unit configured to capture an image of a user's eye and output the captured image, and a control unit configured to detect the user's viewpoint based on the captured image, and the control unit is configured to detect the position of the viewpoint from the captured image and correct the detected position of the detected viewpoint to the position of a corrected viewpoint using a conversion table.

[0006] The display device of the present disclosure includes the viewpoint detection device, a housing that houses the imaging unit and forms an eyebox to be worn by the user, and a display unit that is housed in the housing and displays the captured image, and the imaging unit is configured to capture the viewpoints of both eyes of the user wearing the housing. [Effects of the Invention]

[0007] According to the viewpoint detection device and display device of the present disclosure, the quality of the stereoscopic image provided to the user can be further improved. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a three-dimensional projection system including a line-of-sight detection device according to an embodiment of the present disclosure, and a moving object equipped with a three-dimensional display device. [Figure 2] FIG. 2 is a diagram showing a schematic configuration of the three-dimensional display device of FIG. [Figure 3] FIG. 3 is a plan view showing an example of the configuration of the display surface. [Figure 4] FIG. 4 is a plan view showing an example of the configuration of the barrier. [Figure 5] FIG. 5 is a diagram schematically showing the relationship between the user's eyes, the display unit, and the barrier unit. [Figure 6] FIG. 6 is a diagram showing a three-dimensional projection system including a line-of-sight detection device according to another embodiment of the present disclosure, and a moving body equipped with a three-dimensional display device. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the light emitting device of the present disclosure will be described with reference to the accompanying drawings. Note that each drawing used in the following description is a schematic view.

[0010] 1 is a diagram showing a mobile body equipped with a 3D projection system and a 3D display device including a gaze detection device according to an embodiment of the present disclosure. In this embodiment, the mobile body 10 includes a 3D projection system 100 and an optical member 15. The 3D projection system 100 may include a 3D display device 12. The mobile body 10 is equipped with the 3D projection system 100 and the 3D display device 12.

[0011] The three-dimensional display device 12 may be mounted at any position inside or outside the vehicle 10, for example, in the dashboard of the vehicle 10. Such a three-dimensional display device 12 emits image light toward the optical member 15.

[0012] The optical member 15 reflects the image light emitted from the three-dimensional display device 12. The image light reflected by the optical member 15 reaches the eye box 16. The eye box 16 is a region in real space where the eyes 5 of the user 13 are assumed to be present, taking into consideration, for example, the physique, posture, and changes in posture of the user 13. The shape of the eye box 16 can be set as an area of ​​any shape, either two-dimensionally or three-dimensionally. The arrow L1 shown in FIG. 1 indicates the path along which at least a portion of the image light emitted from the three-dimensional display device 12 reaches the eye box 16. When the eyes 5 of the user 13 are located within the eye box 16, the user 13 can view a virtual image 14 shown in FIG. 2 (described later) by the image light reaching the eye box 16.

[0013] Fig. 2 is a diagram showing a schematic configuration of the three-dimensional display device of Fig. 1. The virtual image 14 is located on an extension line L2, which is a forward extension of the path from the reflection point of the optical member 15 to the eye 5. The three-dimensional display device 12 functions as a head-up display (HUD) by allowing the user 13 to view the virtual image 14.

[0014] The optical member 15 may include a windshield, a combiner, or the like. In this embodiment, the optical member 15 is a windshield. In Figures 1 and 2, the direction in which the eyes 5 of the user 13 are aligned corresponds to the X-axis direction, the vertical direction corresponds to the Y-axis direction, and the direction perpendicular to the X-axis direction and the Y-axis direction corresponds to the Z-axis direction.

[0015] In the present disclosure, a "mobile body" may include, for example, vehicles, ships, and aircraft. Vehicles may include, for example, automobiles, industrial vehicles, railroad vehicles, residential vehicles, and fixed-wing aircraft that travel on runways. Automobiles may include, for example, passenger cars, trucks, buses, motorcycles, and trolleybuses. Industrial vehicles may include, for example, industrial vehicles for agriculture and construction. Industrial vehicles may include, for example, forklifts and golf carts. Industrial vehicles for agriculture may include, for example, tractors, cultivators, transplanters, binders, combines, and lawn mowers. Industrial vehicles for construction may include, for example, bulldozers, scrapers, excavators, crane trucks, dump trucks, and road rollers. Vehicles may include vehicles that are powered by human power. Vehicle classifications are not limited to the above examples. For example, automobiles may include industrial vehicles that can travel on roads, and the same vehicle may be included in multiple classifications. Examples of watercraft include marine jets, boats, and tankers, and examples of aircraft include fixed-wing aircraft and rotary-wing aircraft.

[0016] The three-dimensional projection system 100 may further include a detection device 11 that detects the position of the eye 5 of the user 13. The detection device 11 detects the position of the eye 5 of the user 13 and outputs the detected position of the eye 5 to the three-dimensional display device 12. A gaze detection device is configured including such a detection device 11. The three-dimensional display device 12 controls the image to be projected based on the position of the eye 5 of the user 13 detected by the detection device 11. The detection device 11 may be located anywhere inside or outside the mobile object 10. For example, the detection device 11 may be located in the dashboard of the mobile object 10. The detection device 11 may output information indicating the position of the eye 5 to the three-dimensional display device 12, for example, via a wired, wireless, CAN (Controller Area Network), or the like.

[0017] The detection device 11 includes an imaging device 11a. The imaging device 11a may be realized by, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging device 11a has an imaging range that can capture an image of the face of the user 13. Such an imaging range may include an eye box 16 worn on the head of the user 13. The user 13 may be, for example, a driver of the vehicle 10. The detection device 11 is configured to detect the positions of the eyes 5 of the user 13 in real space based on an image captured by the imaging device 11a. Such a detection device 11 may not include the imaging device 11a but may be connected to the imaging device 11a as an external device. The detection device 11 may include an input terminal that inputs a signal from the imaging device. In this case, the imaging device may be directly connected to the input terminal. The detection device 11 may be indirectly connected to the input terminal via a shared network. The detection device 11 may detect the position of the eye 5 of the user 13 from the video signal input to the input terminal.

[0018] The detection device 11 may include, for example, a sensor. The sensor may be an ultrasonic sensor, an optical sensor, or the like. The detection device 11 may detect the position of the head of the user 13 using the sensor, and may detect the position of the eye 5 of the user 13 based on the head position. The detection device 11 may detect the position of the eye 5 of the user 13 as coordinates in three-dimensional space using two or more sensors.

[0019] 2, the three-dimensional display device 12 includes a three-dimensional display device 17 and an optical element 18. The three-dimensional display device 12 is also referred to as an image display module. The three-dimensional display device 17 includes a backlight 19, a display unit 20 having a display surface 20a, a barrier unit 21, and a control unit 24. The three-dimensional display device 17 may further include a communication unit 22. The three-dimensional display device 17 may further include a storage unit 23.

[0020] The optical element 18 may include a first mirror 18a and a second mirror 18b. At least one of the first mirror 18a and the second mirror 18b may have optical power. In this embodiment, the first mirror 18a is a concave mirror having optical power. The second mirror 18b is a plane mirror. The optical element 18 may function as a magnifying optical system that magnifies the image displayed on the 3D display device 17. The dashed-dotted arrows in FIG. 2 indicate the path along which at least a portion of the image light emitted from the 3D display device 17 is reflected by the first mirror 18a and the second mirror 18b and exits the 3D display device 12. The image light exiting the 3D display device 12 reaches the optical element 15, is reflected by the optical element 15, and reaches the eye 5 of the user 13. As a result, the user 13 can view the virtual image 14 displayed on the 3D display device 17.

[0021] The optical element 18 and the optical member 15 allow the image light emitted from the three-dimensional display device 17 to reach the eye 5 of the user 13. The optical element 18 and the optical member 15 may constitute an optical system 30. In other words, the optical system 30 may include the optical element 18 and the optical member 15. The optical system 30 allows the image light emitted from the three-dimensional display device 17 to reach the eye 5 of the user 13 along the optical path indicated by the dashed dotted line. The optical system 30 may control the traveling direction of the image light so that the image viewed by the user 13 is enlarged or reduced. The optical system 30 may control the traveling direction of the image light so that the shape of the image viewed by the user 13 is deformed based on a predetermined matrix.

[0022] The optical element 18 is not limited to the configuration exemplified above. The mirror may be a concave mirror, a convex mirror, or a flat mirror. If the mirror is a concave mirror or a convex mirror, its shape may include at least a partial spherical shape, or at least a partial aspherical shape. The number of elements constituting the optical element 18 is not limited to two, but may be one, or three or more. The optical element 18 is not limited to a mirror, but may include a lens. The lens may be a concave lens or a convex lens. The lens shape may include at least a partial spherical shape, or at least a partial aspherical shape.

[0023] The backlight 19 is located on the farther side of the optical path than the display unit 20 and the barrier unit 21 as viewed from the user 13. The backlight 19 emits light toward the barrier unit 21 and the display unit 20. At least a portion of the light emitted by the backlight 19 travels along the optical path shown by the dashed dotted line and reaches the eye 5 of the user 13. The backlight 19 may include a light-emitting element such as an LED (Light Emission Diode) or an organic or inorganic EL. The backlight 19 may be configured so that the light emission intensity and its distribution can be controlled.

[0024] The display unit 20 may include a display panel. The display unit 20 may be, for example, a liquid crystal device such as an LCD (Liquid Crystal Display). In this embodiment, the display unit 20 may include a transmissive liquid crystal display panel. The display unit 20 is not limited to this example and may include various display panels.

[0025] The display unit 20 has a plurality of pixels, and controls the transmittance of light incident from the backlight 19 at each pixel, and emits the light as image light that reaches the eye 5 of the user 13. The user 13 views a virtual image 14 formed by the image light emitted from each pixel of the display unit 20.

[0026] The barrier section 21 defines the traveling direction of incident light. When the barrier section 21 is located closer to the backlight 19 than the display section 20, the light emitted from the backlight 19 enters the barrier section 21 and then enters the display section 20. In this case, the barrier section 21 blocks or attenuates a portion of the light emitted from the backlight 19 and transmits the other portion toward the display section 20. The display section 20 directly emits the incident light traveling in the direction defined by the barrier section 21 as image light traveling in the same direction. When the display section 20 is located closer to the backlight 19 than the barrier section 21, the light emitted from the backlight 19 enters the display section 20 and then enters the barrier section 21. In this case, the barrier section 21 blocks or attenuates a portion of the image light emitted from the display section 20 and transmits the other portion toward the eye 5 of the user 13.

[0027] Regardless of whether the display unit 20 or the barrier unit 21 is located closer to the user 13, the barrier unit 21 can control the traveling direction of the image light. The barrier unit 21 allows a portion of the image light emitted from the display unit 20 to reach either the left eye 5L or the right eye 5R of the user 13 (see FIG. 5 ), and allows another portion of the image light to reach the other of the left eye 5L and the right eye 5R of the user 13. Therefore, the barrier unit 21 divides the traveling direction of at least a portion of the image light into a direction toward the left eye 5L and a direction toward the right eye 5R of the user 13. The left eye 5L and the right eye 5R are also referred to as the first eye and the second eye, respectively. In this embodiment, the barrier unit 21 is located between the backlight 19 and the display unit 20. Therefore, the light emitted from the backlight 19 first enters the barrier unit 21 and then enters the display unit 20.

[0028] The traveling direction of the image light is regulated by the barrier unit 21, so that different image light can reach the left eye 5L and the right eye 5R of the user 13. As a result, the user 13 can view different virtual images 14 with the left eye 5L and the right eye 5R.

[0029] 3, the display unit 20 has a first display area 201 and a second display area 202 on the display surface 20a. The first display area 201 may include a left-eye viewing area 201L viewed by the left eye 5L of the user 13 and a right-eye viewing area 201R viewed by the right eye 5R of the user 13. The display unit 20 displays parallax images including a left-eye image viewed by the left eye 5L of the user 13 and a right-eye image viewed by the right eye 5R of the user 13. The parallax images are images projected onto the left eye 5L and right eye 5R of the user 13, respectively, and are images that provide parallax to both eyes of the user 13.

[0030] The display unit 20 displays a left eye image in the left eye viewing region 201L and a right eye image in the right eye viewing region 201R. Therefore, the display unit 20 displays parallax images in the left eye viewing region 201L and the right eye viewing region 201R. The left eye viewing region 201L and the right eye viewing region 201R are assumed to be aligned in the u-axis direction, which represents the parallax direction. The left eye viewing region 201L and the right eye viewing region 201R may extend along the v-axis direction, which is perpendicular to the parallax direction, or may extend in a direction inclined at a predetermined angle with respect to the v-axis direction. Therefore, the left eye viewing region 201L and the right eye viewing region 201R may be aligned alternately along a predetermined direction that includes a component of the parallax direction. The pitch at which the left eye viewing region 201L and the right eye viewing region 201R are aligned alternately is also referred to as the parallax image pitch. The left eye viewing area 201L and the right eye viewing area 201R may be positioned with an interval between them or may be adjacent to each other. The display unit 20 displays a planar image in the second display area 202. The planar image is assumed to be an image that does not cause parallax to the eyes 5 of the user 13 and is not viewed stereoscopically.

[0031] As shown in FIG. 4, the barrier unit 21 has a first barrier region 211 and a second barrier region 212. When the barrier unit 21 is located closer to the user 13 than the display unit 20, the barrier unit 21 controls the transmittance of image light emitted from the display unit 20. The first barrier region 211 corresponds to the first display region 201 and controls the transmittance of image light related to parallax images emitted from the first display region 201. The first barrier region 211 has an opening region 21b and a light-shielding surface 21a. The opening region 21b transmits light incident on the barrier unit 21 from the display unit 20. The opening region 21b may transmit light with a transmittance equal to or greater than a first predetermined value. The first predetermined value may be, for example, 100% or a value close to 100%. The light-shielding surface 21a blocks light incident on the barrier unit 21 from the display unit 20. The light-shielding surface 21a may transmit light with a transmittance equal to or less than a second predetermined value. The second predetermined value may be, for example, 0% or a value close to 0%. The first predetermined value is greater than the second predetermined value.

[0032] The opening regions 21b and the light-shielding surfaces 21a are arranged alternately in the u-axis direction, which represents the parallax direction. The boundary between the opening regions 21b and the light-shielding surfaces 21a may be along the v-axis direction, which is perpendicular to the parallax direction, as illustrated in Fig. 4, or along a direction inclined at a predetermined angle with respect to the v-axis direction. In other words, the opening regions 21b and the light-shielding surfaces 21a may be arranged alternately along a predetermined direction that includes a component of the parallax direction.

[0033] The shapes of the opening region 21b and the light-shielding surface 21a may be determined based on the shapes of the left eye visible region 201L and the right eye visible region 201R. Conversely, the shapes of the left eye visible region 201L and the right eye visible region 201R may be determined based on the shapes of the opening region 21b and the light-shielding surface 21a.

[0034] The second barrier region 212 corresponds to the second display region 202 and controls the transmittance of image light relating to a flat image emitted from the second display region 202.

[0035] In this embodiment, the barrier unit 21 is located farther from the display unit 20 as viewed from the user 13. The barrier unit 21 controls the transmittance of light incident from the backlight 19 toward the display unit 20. The opening region 21b transmits light incident from the backlight 19 toward the display unit 20. The light-shielding surface 21a blocks light incident from the backlight 19 to the display unit 20. In this manner, the traveling direction of light incident on the first display region 201 is limited to a predetermined direction. As a result, part of the image light can be controlled by the barrier unit 21 to reach the left eye 5L of the user 13. Another part of the image light can be controlled by the barrier unit 21 to reach the right eye 5R of the user 13.

[0036] The barrier section 21 may be composed of a liquid crystal shutter. The liquid crystal shutter may control light transmittance based on an applied voltage. The liquid crystal shutter may be composed of multiple pixels and may control the light transmittance of each pixel. The liquid crystal shutter may form areas with high light transmittance or areas with low light transmittance in any shape. When the barrier section 21 is composed of a liquid crystal shutter, the opening area 21b may have a transmittance equal to or greater than a first predetermined value. When the barrier section 21 is composed of a liquid crystal shutter, the light-shielding surface 21a may have a transmittance equal to or less than a second predetermined value.

[0037] The first predetermined value may be set to a value higher than the second predetermined value. For example, the ratio of the second predetermined value to the first predetermined value may be set to 1 / 100. For another example, the ratio of the second predetermined value to the first predetermined value may be set to 1 / 1000. The barrier section 21, in which the shapes of the opening region 21b and the light-shielding surface 21a are configured to be changeable, is also referred to as an active barrier.

[0038] The control unit 24 controls the display unit 20. If the barrier unit 21 is an active barrier, the control unit 24 may control the barrier unit 21. The control unit 24 may control the backlight 19. The control unit 24 may acquire information about the position of the eye 5 of the user 13 from the detection device 11, and control the display unit 20, the barrier unit 21, or the backlight 19 based on the information.

[0039] The control unit 24 is configured as, for example, a processor. The control unit 24 may include one or more processors. The processor may include a general-purpose processor that loads a specific program to execute a specific function, and a dedicated processor specialized for a specific process. The dedicated processor may include an application-specific integrated circuit (ASIC). The processor may include a programmable logic device (PLD). The PLD may include a field-programmable gate array (FPGA). The control unit 24 may be either a system-on-a-chip (SoC) or a system in a package (SiP) in which one or more processors work together.

[0040] The communication unit 22 may include an interface capable of communicating with an external device. The external device may include, for example, the detection device 11. The communication unit 22 may acquire information from the detection device 11 and output it to the control unit 24. The "communication interface" in this disclosure may include, for example, a physical connector and a wireless communication device. The physical connector may include an electrical connector compatible with transmission of electrical signals, an optical connector compatible with transmission of optical signals, and an electromagnetic connector compatible with transmission of electromagnetic waves. The electrical connector may include a connector compliant with IEC 60603, a connector compliant with the USB standard, or a connector compatible with an RCA terminal. The electrical connector may include a connector compatible with an S terminal specified in EIAJ CP-121aA or a connector compatible with a D terminal specified in EIAJ RC-5237. The electrical connector may include a connector compliant with the HDMI (registered trademark) standard or a connector compatible with coaxial cables, including BNC (British Naval Connector or Baby-series N Connector, etc.). The optical connector may include various connectors compliant with IEC 61754. The wireless communication device may include a wireless communication device that complies with various standards including Bluetooth (registered trademark) and IEEE 8021a. The wireless communication device may include at least one antenna.

[0041] The storage unit 23 may store various types of information or programs for operating each component of the three-dimensional display device 17. The storage unit 23 may be configured, for example, with a semiconductor memory or the like. The storage unit 23 may function as a work memory for the control unit 24. The storage unit 23 may be included in the control unit 24.

[0042] As shown in FIG. 5, light emitted from the backlight 19 passes through the barrier unit 21 and the display unit 20 to reach the eye 5 of the user 13. The path that the light emitted from the backlight 19 takes to reach the eye 5 is indicated by a dashed line. Light that passes through the opening region 21b of the barrier unit 21 to reach the right eye 5R passes through the right-eye visible region 201R of the display unit 20. Therefore, the right eye 5R can view the right-eye visible region 201R through the light that has passed through the opening region 21b. Light that passes through the opening region 21b of the barrier unit 21 to reach the left eye 5L passes through the left-eye visible region 201L of the display unit 20. Therefore, the left eye 5L can view the left-eye visible region 201L through the light that has passed through the opening region 21b.

[0043] The display unit 20 displays a right-eye image and a left-eye image in the right-eye viewing region 201R and the left-eye viewing region 201L, respectively. As a result, the barrier unit 21 allows image light related to the left-eye image to reach the left eye 5L and image light related to the right-eye image to reach the right eye 5R. Therefore, the opening region 21b is configured to allow image light related to the left-eye image to reach the left eye 5L of the user 13 and image light related to the right-eye image to reach the right eye 5R of the user 13. In this way, the three-dimensional display device 17 can project parallax images to both eyes of the user 13. The user 13 can see the images in three dimensions by viewing the parallax images with the left eye 5L and the right eye 5R. The direction that provides parallax to both eyes of the user 13 is also referred to as the parallax direction. The parallax direction corresponds to the direction in which the left eye 5L and right eye 5R of the user 13 are aligned.

[0044] When the user 13 is viewing stereoscopically, the user 13 may lose stereoscopic vision if image light related to a right-eye image is incident on the left eye 5L or image light related to a left-eye image is incident on the right eye 5R. The phenomenon of image light related to a right-eye image being incident on the left eye 5L or image light related to a left-eye image being incident on the right eye 5R is also referred to as crosstalk. Crosstalk deteriorates the quality of the stereoscopic vision provided to the user 13. The barrier unit 21 prevents image light related to the left-eye image from reaching the right eye 5R and prevents image light related to the right-eye image from reaching the left eye 5L. Therefore, the light-shielding surface 21a is configured to prevent image light related to the left-eye image from reaching the right eye 5R of the user 13 and prevent image light related to the right-eye image from reaching the left eye 5L of the user 13. This allows the user 13 to view only the left-eye image with the left eye 5L and only the right-eye image with the right eye 5R. As a result, crosstalk is less likely to occur.

[0045] At least a portion of the image light emitted from the display surface 20a of the display unit 20 passes through the opening region 21b of the barrier unit 21 and reaches the optical member 15 via the optical element 18. The image light is reflected by the optical member 15 and reaches the eye 5 of the user 13. As a result, the eye 5 of the user 13 can view a first virtual image 14a located on the negative side of the Z axis relative to the optical member 15. The first virtual image 14a corresponds to the image displayed on the display surface 20a. The opening region 21b and the light-shielding surface 21a of the barrier unit 21 create a second virtual image 14b in front of the optical member 15 and on the optical member 15 side of the first virtual image 14a. As shown in FIG. 5, the user 13 can view the virtual image 14 as if the display unit 20 were located at the position of the first virtual image 14a and the barrier unit 21 were located at the position of the second virtual image 14b.

[0046] Image light relating to an image displayed on the display surface 20a is emitted from the three-dimensional display device 17 in a direction determined by the barrier unit 21. The optical element 18 reflects and refracts the image light and emits it toward the optical member 15. The optical member 15 reflects the image light and causes it to travel toward the eye 5 of the user 13. When the image light enters the eye 5 of the user 13, the user 13 visually recognizes a parallax image as a virtual image 14. By visualizing the virtual image 14, the user 13 can achieve stereoscopic vision. An image of the virtual image 14 that corresponds to a parallax image is also referred to as a parallax virtual image. A parallax virtual image can also be said to be a parallax image projected via the optical system 30. An image of the virtual image 14 that corresponds to a planar image is also referred to as a planar virtual image. A planar virtual image can also be said to be a planar image projected via the optical system 30.

[0047] The parallax virtual image viewed by the user 13 is projected onto the eye 5 of the user 13 via the optical system 30. The optical system 30 may be required to enlarge or reduce an image input by incident image light while maintaining a similarity relationship when projecting it. However, the optical system 30 may not be able to maintain a similarity relationship between the input image and the projected image. Therefore, distortion may occur between the parallax image before entering the optical system 30 and the parallax image (parallax virtual image) projected via the optical system 30. For example, as shown in FIG. 6 , an image displayed on a rectangular display surface 20a may become a virtual image 14 distorted in shape so that it expands in the u-axis direction as it moves in the positive direction of the v-axis when projected onto the eye 5 of the user 13 via the optical system 30. The shape of the display surface 20a is represented by a solid line. The shape of the virtual image 14 is represented by a dashed line. The virtual image 14 may include a parallax virtual image and a planar virtual image. If the distortion of the parallax virtual image is large, crosstalk is more likely to occur. On the other hand, distortion of a planar virtual image is unrelated to crosstalk. The user 13 is more likely to recognize the occurrence of crosstalk than distortion of the virtual image 14. Therefore, distortion of a parallax virtual image is more likely to degrade the image quality of the stereoscopic vision provided to the user 13 than distortion of a planar virtual image.

[0048] It is difficult to completely eliminate distortion in the optical system 30. However, changing the distribution of distortion in the optical system 30 is easier than eliminating distortion. Therefore, in the 3D display device 12 according to this embodiment, the optical system 30 is designed so that the distortion of the parallax image projected via the optical system 30 is smaller than the distortion of the planar image projected via the optical system 30. Therefore, the optical system 30 may distribute a range of distortion equal to or greater than a predetermined value in a range through which image light of the planar image passes, and distribute a range of distortion less than the predetermined value in a range through which image light of the parallax image passes. For example, the optical system 30 may be designed to reduce distortion in a range corresponding to the first display region 201 and increase distortion in a range corresponding to the second display region 202. In this way, the quality of the stereoscopic vision provided to the user 13 can be improved even if distortion in the optical system 30 exists.

[0049] The parallax image may include right-eye images and left-eye images arranged alternately along the parallax direction. The display unit 20 displays a right-eye image in the right-eye viewing region 201R and a left-eye image in the left-eye viewing region 201L on the display surface 20a. If the parallax image (parallax virtual image) projected via the optical system 30 is distorted in the parallax direction, the right-eye image is more likely to enter the left-eye viewing region 201L and the left-eye image is more likely to enter the right-eye viewing region 201R in the parallax virtual image. Therefore, distortion in the parallax direction is more likely to cause crosstalk.

[0050] The distortion of the optical system 30 is expressed by a combination of a distortion component along the parallax direction and a distortion component along a direction intersecting the parallax direction. Controlling the direction of the distortion of the optical system 30 is easier than eliminating the distortion. Therefore, the optical system 30 may be designed so that the distortion component along the parallax direction is smaller than the distortion component along the direction intersecting the parallax direction. In this way, even if distortion of the optical system 30 exists, the image quality of the stereoscopic vision provided to the user 13 can be improved.

[0051] Assume that optical system 30 is represented by a single concave mirror. In this case, the magnification of virtual image 14 that user 13 can view by projecting the object to be projected using the concave mirror is represented by the focal length of the concave mirror, where f is the focal length of the concave mirror. When the distance between the object to be projected and the concave mirror is 0, i.e., when the object to be projected is located on the concave mirror, the magnification of virtual image 14 is 1 (life size). When the distance between the object to be projected and the concave mirror is f, i.e., when the object to be projected is located on the focal point of the concave mirror, the magnification of virtual image 14 diverges to infinity. As the distance between the object to be projected and the concave mirror approaches f, the magnification of virtual image 14 increases, and the rate of change in the magnification of virtual image 14 with respect to changes in distance also increases.

[0052] In this embodiment, the barrier unit 21 is located farther from the optical system 30 than the display surface 20a. Therefore, the distance between the barrier unit 21 and the optical system 30 is longer than the distance between the display surface 20a and the optical system 30. The distance between the display surface 20a and the optical system 30 is represented by D1.

[0053] The distance between the barrier unit 21 and the optical system 30 is represented by D2. Therefore, D2>D2 holds. If the magnifications when the distances between the projection object and the concave mirror are D1 and D2 are A1 and A2, respectively, then A2>A1 holds. Therefore, the magnification of the second virtual image 14b corresponding to the barrier unit 21 is greater than the magnification of the first virtual image 14a corresponding to the display surface 20a. If the area of ​​the barrier unit 21 and the area of ​​the display surface 20a are the same, the area of ​​the second virtual image 14b will be greater than the area of ​​the first virtual image 14a.

[0054] This allows the second virtual image 14b to cover the first virtual image 14a. Therefore, in the parallax virtual image viewed by the user 13, the barrier unit 21 can cover the image displayed on the display surface 20a. If the barrier unit 21 cannot cover a portion of the image displayed on the display surface 20a, the uncovered portion will cause crosstalk. By having the barrier unit 21 cover the image displayed on the display surface 20a, crosstalk is less likely to occur. As a result, the image quality of the stereoscopic vision provided to the user 13 can be improved.

[0055] Assuming that the optical system 30 is represented by a single concave mirror, the distortion of the virtual image 14 projected through the optical system 30 from the three-dimensional display device 17, which is the object to be projected, differs depending on the distance from the object to the optical system 30. For example, the distortion of the virtual image 14 of the object to be projected located at a first distance differs from the distortion of the virtual image 14 of the object to be projected located at a second distance. The optical system 30 can be designed so that the distortion of the virtual image 14 of the object to be projected located at a predetermined distance is minimized.

[0056] The display surface 20a and the barrier unit 21 are positioned with a predetermined gap therebetween, indicated by reference sign g in FIG. 5 . Therefore, the distance from the display surface 20a to the optical system 30 is different from the distance from the barrier unit 21 to the optical system 30. In this case, the distortion of the first virtual image 14a corresponding to the display surface 20a is different from the distortion of the second virtual image 14b corresponding to the barrier unit 21. The distortion of the second virtual image 14b deforms the right-eye-viewable region 201R and the left-eye-viewable region 201L on the first virtual image 14a. The deformation of the right-eye-viewable region 201R and the left-eye-viewable region 201L increases the possibility that the right-eye image will enter the left-eye-viewable region 201L or the left-eye image will enter the right-eye-viewable region 201R. On the other hand, the distortion of the first virtual image 14a can be corrected by distorting the image displayed on the display unit 20 based on a matrix obtained by inversely transforming a matrix representing the distortion of the optical system 30. Therefore, the distortion of the second virtual image 14b is more likely to cause crosstalk than the distortion of the first virtual image 14a.

[0057] The optical system 30 may be designed so that distortion of the barrier unit 21 is smaller than distortion of the display surface 20a. The position of the 3D display device 17 relative to the optical system 30 may be determined so that distortion of the barrier unit 21 is smaller than distortion of the display surface 20a. In other words, the barrier unit 21 may be disposed at a position where distortion of the optical system 30 is minimized. By doing so, even if distortion of the optical system 30 exists, the quality of the stereoscopic vision provided to the user 13 may be improved. The control unit detects the position of the viewpoint from the captured image and corrects the detected position of the viewpoint to the corrected position of the viewpoint using a conversion table. The conversion table includes a distortion correction table that corrects distortion of the captured image. The conversion table includes an origin correction table that corrects the offset between the origin of the captured image and the origin of the display image corresponding to that captured image.

[0058] The configurations according to the present disclosure are not limited to the embodiments described above, and many variations and modifications are possible. For example, the functions included in each component can be rearranged so as not to cause logical contradictions, and multiple components can be combined into one or divided.

[0059] The drawings illustrating the configurations according to the present disclosure are schematic, and the dimensional ratios and the like in the drawings do not necessarily correspond to the actual ones.

[0060] In this disclosure, descriptions such as "first" and "second" are identifiers for distinguishing the configuration. In this disclosure, configurations distinguished by descriptions such as "first" and "second" can have their numbers exchanged. For example, the first element can exchange the identifiers "first" and "second" with the second element. The exchange of identifiers is performed simultaneously. The configurations remain distinguished even after the identifier exchange. Identifiers may be deleted. A configuration from which an identifier has been deleted is distinguished by a symbol. The descriptions of identifiers such as "first" and "second" in this disclosure should not be used solely to interpret the order of the configurations or to justify the existence of an identifier with a smaller number.

[0061] In this disclosure, the X-axis, Y-axis, and Z-axis are provided for convenience of explanation and may be interchanged. The configurations according to this disclosure have been described using a Cartesian coordinate system formed by the X-axis, Y-axis, and Z-axis. The positional relationship between the components according to this disclosure is not limited to an orthogonal relationship.

[0062] 6, the detection device 11 may be provided inside the housing of the three-dimensional display device 12. Even if the mounting position of the detection device 11 is changed, the control unit 24 controls the operation of the optical member 15 according to the angle of incidence of the light path from the image capture device 11a to the light reflecting unit 15a provided behind the optical member 15, accurately detects the viewpoint of the user 13, and controls the projected image based on the detected information, thereby projecting a high-quality three-dimensional image. The present disclosure can be implemented in the following configurations (1) and (2). (1) A display unit including: a first display area having a left eye viewing area for displaying a left eye image to be viewed by the left eye of a user and a right eye viewing area for displaying a right eye image to be viewed by the right eye of the user; and a second display area for displaying a planar image; a backlight located on a side farther from the display unit along an optical path of image light emitted from the display unit as viewed from the user; a barrier section located on the backlight side of the display section or on the user side of the display section, the barrier section having a first barrier area corresponding to the first display area and a second barrier area corresponding to the second display area; an optical member that reflects the image light toward the user and allows the user to view a virtual image, the virtual image has a small distortion region where distortion is relatively small and a large distortion region where distortion is relatively large, The display device, wherein the first barrier region corresponds to the small strain region, and the second barrier region corresponds to the large strain region. (2) the virtual image is composed of a first virtual image corresponding to the display unit and a second virtual image corresponding to the barrier unit, which are located at different positions in a line-of-sight direction of the user; The display device described in the above configuration (1), wherein the barrier section is positioned between the backlight and the display section, so that the magnification of the second virtual image is greater than the magnification of the first virtual image and the second virtual image covers the first virtual image.

[0063] Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the above-described embodiments, and various modifications and improvements are possible within the scope of the gist of the present disclosure. It goes without saying that all or part of the components constituting each of the above-described embodiments can be combined as appropriate within the scope of not contradicting each other. [Explanation of symbols]

[0064] 5 eyes 5L left eye 5R Right eye 10 Mobile 12 3D display device (image display module) 13 User 14 Virtual Image 14a First virtual image 14b Second virtual image 15 Optical Components 16 Eye Box 17 3D display device 18 Optical Elements 18a 1st mirror 18b 2nd mirror 19 Backlight 20 Display section 20a Display surface 21 Barrier section 21a Light-shielding surface 21b Opening area 22 Communications Department 23 Memory section 24 Control Unit 30 Optical system 100 3D Projection System 201 1st display area 201L Left eye visual field 201R Right eye visibility area 202 Second display area 211 First Barrier Region 212 Second Barrier Region

Claims

1. a display unit including a first display area having a left eye viewing area for displaying a left eye image to be viewed by the left eye of a user and a right eye viewing area for displaying a right eye image to be viewed by the right eye of the user, and a second display area for displaying a planar image; a backlight located on a side farther from the display unit along an optical path of image light emitted from the display unit as viewed from the user; a barrier section located on the backlight side of the display section or on the user side of the display section, the barrier section having a first barrier area corresponding to the first display area and a second barrier area corresponding to the second display area; an optical member that reflects the image light toward the user and allows the user to view a virtual image, the virtual image has a small distortion region where distortion is relatively small and a large distortion region where distortion is relatively large, The display device, wherein the first barrier region corresponds to the small strain region, and the second barrier region corresponds to the large strain region.

2. the virtual image is composed of a first virtual image corresponding to the display unit and a second virtual image corresponding to the barrier unit, the first virtual image and the second virtual image being located at different positions in a line-of-sight direction of the user, 2. The display device according to claim 1, wherein the barrier unit is positioned between the backlight and the display unit, so that a magnification of the second virtual image is greater than a magnification of the first virtual image and the second virtual image covers the first virtual image.

Images