Display unit
The viewpoint detection device and display device improve stereoscopic image quality by capturing eye images, detecting viewpoints, and correcting positions using a conversion table, reducing distortion and crosstalk.
Patent Information
- Application Number
- JP2024161529
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-18
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2040-05-20
AI Technical Summary
Conventional viewpoint detection devices and display devices do not adequately enhance the image quality of stereoscopic images provided to users.
A viewpoint detection device that captures a user's eye image, detects the viewpoint, and corrects the position using a conversion table, integrated with a display device that includes an imaging unit, a housing for the user's eyes, and a display section to improve image quality.
Enhances the quality of stereoscopic images by reducing distortion and minimizing crosstalk, thereby improving the user's viewing experience.
Smart Images

Figure 2024169581000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a viewpoint detection device and a display device. [Background technology]
[0002] A conventional viewpoint detection device and display device are described, for example, in Patent Document 1. This conventional technology describes a technique in which a control unit acquires information on the eye position of a user, such as a driver of a moving object, and dynamically controls a parallax barrier according to the eye position determined by the control unit to reduce distortion of a displayed image. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2019-15823 A Summary of the Invention [Problem to be solved by the invention]
[0004] There is a demand for a viewpoint detection device and a display device that can further improve the quality of the stereoscopic images provided to the user. [Means for solving the problem]
[0005] The viewpoint detection device of the present disclosure includes an imaging unit configured to image a user's eye and output the captured image, and a control unit configured to detect the user's viewpoint based on the captured image, and the control unit is configured to detect the position of the viewpoint from the captured image and correct the detected position of the detected viewpoint to the position of a corrected viewpoint using a conversion table.
[0006] The display device of the present disclosure includes the viewpoint detection device, a housing in which the imaging unit is housed and which constitutes an eyebox for the user to wear, and a display unit housed in the housing and for displaying the captured image, and the imaging unit is configured to capture the viewpoints of both eyes of the user wearing the housing. Effect of the Invention
[0007] According to the viewpoint detection device and display device of the present disclosure, the quality of the stereoscopic image provided to the user can be further improved. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram showing a three-dimensional projection system including a gaze detection device according to an embodiment of the present disclosure, and a moving object equipped with a three-dimensional display device. [Diagram 2] FIG. 2 is a diagram showing a schematic configuration of the three-dimensional display device of FIG. [Diagram 3] FIG. 3 is a plan view showing an example of the configuration of the display surface. [Figure 4] FIG. 4 is a plan view showing an example of the configuration of the barrier. [Diagram 5] FIG. 5 is a diagram illustrating a schematic relationship between the user's eyes, the display unit, and the barrier unit. [Figure 6] FIG. 6 is a diagram showing a moving body equipped with a three-dimensional projection system including a gaze detection device according to another embodiment of the present disclosure and a three-dimensional display device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of a light emitting device according to the present disclosure will be described with reference to the accompanying drawings. Note that each drawing used in the following description is a schematic view.
[0010] 1 is a diagram showing a moving body equipped with a three-dimensional projection system including a gaze detection device according to an embodiment of the present disclosure and a three-dimensional display device. In this embodiment, the moving body 10 includes a three-dimensional projection system 100 and an optical member 15. The three-dimensional projection system 100 may include a three-dimensional display device 12. The moving body 10 is equipped with the three-dimensional projection system 100 and the three-dimensional display device 12.
[0011] The three-dimensional display device 12 may be mounted at any position inside or outside the vehicle 10, for example, in the dashboard of the vehicle 10. Such a three-dimensional display device 12 emits image light toward the optical member 15.
[0012] The optical member 15 reflects the image light emitted from the three-dimensional display device 12. The image light reflected by the optical member 15 reaches the eye box 16. The eye box 16 is a region in real space where the eye 5 of the user 13 is assumed to be present, taking into consideration, for example, the physique, posture, and changes in posture of the user 13. The shape of the eye box 16 can be set as a region of any shape in a plane or three-dimensional manner. The arrow L1 shown in FIG. 1 indicates the path along which at least a part of the image light emitted from the three-dimensional display device 12 reaches the eye box 16. When the eye 5 of the user 13 is located within the eye box 16, the user 13 can view the virtual image 14 shown in FIG. 2 described later by the image light reaching the eye box 16.
[0013] Fig. 2 is a diagram showing a schematic configuration of the three-dimensional display device in Fig. 1. The virtual image 14 is located on an extension line L2 obtained by extending forward a path from a reflection point of the optical member 15 to the eye 5. The three-dimensional display device 12 allows the user 13 to visually recognize the virtual image 14, thereby functioning as a head up display (HUD).
[0014] The optical member 15 may include a windshield, a combiner, or the like. In this embodiment, the optical member 15 is a windshield. In Fig. 1 and Fig. 2, the direction in which the eyes 5 of the user 13 are aligned corresponds to the X-axis direction, the vertical direction corresponds to the Y-axis direction, and the direction perpendicular to the X-axis direction and the Y-axis direction corresponds to the Z-axis direction.
[0015] The "mobile body" in the present disclosure may include, for example, vehicles, ships, and aircraft. The vehicles may include, for example, automobiles, industrial vehicles, railroad vehicles, lifestyle vehicles, and fixed-wing aircraft that run on runways. The automobiles may include, for example, passenger cars, trucks, buses, motorcycles, and trolley buses. The industrial vehicles may include, for example, industrial vehicles for agriculture and construction. The industrial vehicles may include, for example, forklifts and golf carts. The industrial vehicles for agriculture may include, for example, tractors, cultivators, transplanters, binders, combines, and lawnmowers. The industrial vehicles for construction may include, for example, bulldozers, scrapers, excavators, cranes, dump trucks, and road rollers. The vehicles may include those that run by human power. The classification of vehicles is not limited to the above examples, and for example, automobiles may include industrial vehicles that can run on roads, and the same vehicle may be included in multiple classifications. Examples of watercraft include marine jets, boats, and tankers, and examples of aircraft include fixed-wing aircraft and rotorcraft.
[0016] The three-dimensional projection system 100 may further include a detection device 11 that detects the position of the eye 5 of the user 13. The detection device 11 detects the position of the eye 5 of the user 13 and outputs the detected position of the eye 5 to the three-dimensional display device 12. A gaze detection device is configured including such a detection device 11. The three-dimensional display device 12 controls the image to be projected based on the position of the eye 5 of the user 13 detected by the detection device 11. The position of the detection device 11 is arbitrary inside and outside the moving body 10. For example, the detection device 11 may be located in the dashboard of the moving body 10. The detection device 11 may output information indicating the position of the eye 5 to the three-dimensional display device 12, for example, via a wired, wireless, CAN (Controller Area Network), or the like.
[0017] The detection device 11 includes an imaging device 11a. The imaging device 11a may be realized by, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging device 11a is set as an imaging range capable of imaging the face of the user 13. Such an imaging range may include an eye box 16 attached to the head of the user 13. The user 13 may be, for example, a driver of the moving body 10. The detection device 11 is configured to be able to detect the position of both eyes 5 of the user 13 in real space based on an image captured by the imaging device 11a. Such a detection device 11 may not include the imaging device 11a and may be connected to the imaging device 11a as an external device. The detection device 11 may include an input terminal that inputs a signal from the imaging device. In this case, the imaging device may be directly connected to the input terminal. The detection device 11 may be indirectly connected to the input terminal via a shared network. The detection device 11 may detect the position of the eye 5 of the user 13 from the video signal input to the input terminal.
[0018] The detection device 11 may include, for example, a sensor. The sensor may be an ultrasonic sensor, an optical sensor, or the like. The detection device 11 may detect the position of the head of the user 13 by the sensor, and detect the position of the eye 5 of the user 13 based on the position of the head. The detection device 11 may detect the position of the eye 5 of the user 13 as coordinates in three-dimensional space by two or more sensors.
[0019] 2, the three-dimensional display device 12 includes a three-dimensional display device 17 and an optical element 18. The three-dimensional display device 12 is also referred to as an image display module. The three-dimensional display device 17 includes a backlight 19, a display unit 20 having a display surface 20a, a barrier unit 21, and a control unit 24. The three-dimensional display device 17 may further include a communication unit 22. The three-dimensional display device 17 may further include a storage unit 23.
[0020] The optical element 18 may include a first mirror 18a and a second mirror 18b. At least one of the first mirror 18a and the second mirror 18b may have optical power. In this embodiment, the first mirror 18a is a concave mirror having optical power. The second mirror 18b is a plane mirror. The optical element 18 may function as a magnifying optical system that magnifies an image displayed on the three-dimensional display device 17. The dashed arrow in FIG. 2 indicates a path along which at least a part of the image light emitted from the three-dimensional display device 17 is reflected by the first mirror 18a and the second mirror 18b and emitted to the outside of the three-dimensional display device 12. The image light emitted to the outside of the three-dimensional display device 12 reaches the optical member 15, is reflected by the optical member 15, and reaches the eye 5 of the user 13. As a result, the user 13 can view the virtual image 14 displayed on the three-dimensional display device 17.
[0021] The optical element 18 and the optical member 15 allow the image light emitted from the three-dimensional display device 17 to reach the eye 5 of the user 13. The optical element 18 and the optical member 15 may configure an optical system 30. In other words, the optical system 30 may include the optical element 18 and the optical member 15. The optical system 30 allows the image light emitted from the three-dimensional display device 17 to reach the eye 5 of the user 13 along the optical path shown by the dashed dotted line. The optical system 30 may control the traveling direction of the image light so that the image viewed by the user 13 is enlarged or reduced. The optical system 30 may control the traveling direction of the image light so that the shape of the image viewed by the user 13 is deformed based on a predetermined matrix.
[0022] The optical element 18 is not limited to the exemplified configuration. The mirror may be a concave mirror, a convex mirror, or a plane mirror. When the mirror is a concave mirror or a convex mirror, its shape may include at least a part of a spherical shape, or may include at least a part of an aspheric shape. The number of elements constituting the optical element 18 is not limited to two, but may be one, or may be three or more. The optical element 18 is not limited to a mirror and may include a lens. The lens may be a concave lens or a convex lens. The shape of the lens may include at least a part of a spherical shape, or may include at least a part of an aspheric shape.
[0023] The backlight 19 is located on the farther side along the optical path than the display unit 20 and the barrier unit 21 as viewed from the user 13. The backlight 19 emits light toward the barrier unit 21 and the display unit 20. At least a part of the light emitted by the backlight 19 travels along the optical path shown by the dashed dotted line and reaches the eye 5 of the user 13. The backlight 19 may include a light emitting element such as an LED (Light Emission Diode) or an organic or inorganic EL. The backlight 19 may be configured so that the light emission intensity and its distribution can be controlled.
[0024] The display unit 20 may include a display panel. The display unit 20 may be, for example, a liquid crystal device such as an LCD (Liquid Crystal Display). In this embodiment, the display unit 20 may include a transmissive liquid crystal display panel. The display unit 20 is not limited to this example and may include various display panels.
[0025] The display unit 20 has a plurality of pixels, and controls the transmittance of light incident from the backlight 19 at each pixel, and emits the light as image light that reaches the eye 5 of the user 13. The user 13 visually recognizes a virtual image 14 that is configured by the image light emitted from each pixel of the display unit 20.
[0026] The barrier section 21 defines the traveling direction of the incident light. When the barrier section 21 is located closer to the backlight 19 than the display section 20, the light emitted from the backlight 19 enters the barrier section 21 and then enters the display section 20. In this case, the barrier section 21 blocks or attenuates a part of the light emitted from the backlight 19, and transmits the other part toward the display section 20. The display section 20 directly emits the incident light traveling in the direction defined by the barrier section 21 as image light traveling in the same direction. When the display section 20 is located closer to the backlight 19 than the barrier section 21, the light emitted from the backlight 19 enters the display section 20 and then enters the barrier section 21. In this case, the barrier section 21 blocks or attenuates a part of the image light emitted from the display section 20, and transmits the other part toward the eye 5 of the user 13.
[0027] Regardless of whether the display unit 20 or the barrier unit 21 is located closer to the user 13, the barrier unit 21 can control the traveling direction of the image light. The barrier unit 21 allows a part of the image light emitted from the display unit 20 to reach either the left eye 5L or the right eye 5R (see FIG. 5) of the user 13, and allows another part of the image light to reach the other of the left eye 5L and the right eye 5R of the user 13. Therefore, the barrier unit 21 divides the traveling direction of at least a part of the image light into a direction toward the left eye 5L and a direction toward the right eye 5R of the user 13. The left eye 5L and the right eye 5R are also referred to as the first eye and the second eye, respectively. In this embodiment, the barrier unit 21 is located between the backlight 19 and the display unit 20. Therefore, the light emitted from the backlight 19 first enters the barrier unit 21 and then enters the display unit 20.
[0028] The traveling direction of the image light is regulated by the barrier unit 21, so that different image lights can reach the left eye 5L and the right eye 5R of the user 13. As a result, the user 13 can view different virtual images 14 with the left eye 5L and the right eye 5R.
[0029] 3, the display unit 20 has a first display area 201 and a second display area 202 on the display surface 20a. The first display area 201 may include a left eye viewing area 201L viewed by the left eye 5L of the user 13 and a right eye viewing area 201R viewed by the right eye 5R of the user 13. The display unit 20 displays a parallax image including a left eye image viewed by the left eye 5L of the user 13 and a right eye image viewed by the right eye 5R of the user 13. The parallax image is an image projected onto each of the left eye 5L and right eye 5R of the user 13, and is an image that provides parallax to both eyes of the user 13.
[0030] The display unit 20 displays a left eye image in the left eye viewing region 201L and a right eye image in the right eye viewing region 201R. Therefore, the display unit 20 displays parallax images in the left eye viewing region 201L and the right eye viewing region 201R. The left eye viewing region 201L and the right eye viewing region 201R are arranged in the u-axis direction representing the parallax direction. The left eye viewing region 201L and the right eye viewing region 201R may extend along the v-axis direction perpendicular to the parallax direction, or may extend in a direction inclined at a predetermined angle with respect to the v-axis direction. Therefore, the left eye viewing region 201L and the right eye viewing region 201R may be arranged alternately along a predetermined direction including a component of the parallax direction. The pitch at which the left eye viewing region 201L and the right eye viewing region 201R are arranged alternately is also called the parallax image pitch. The left eye viewing region 201L and the right eye viewing region 201R may be located with an interval therebetween, or may be adjacent to each other. The display unit 20 displays a planar image in the second display region 202. The planar image is assumed to be an image that does not give parallax to the eye 5 of the user 13 and is not viewed stereoscopically.
[0031] As shown in FIG. 4, the barrier section 21 has a first barrier region 211 and a second barrier region 212. When the barrier section 21 is located closer to the user 13 than the display section 20, the barrier section 21 controls the transmittance of image light emitted from the display section 20. The first barrier region 211 corresponds to the first display region 201, and controls the transmittance of image light related to a parallax image emitted from the first display region 201. The first barrier region 211 has an opening region 21b and a light-shielding surface 21a. The opening region 21b transmits light incident from the display section 20 to the barrier section 21. The opening region 21b may transmit light with a transmittance equal to or greater than a first predetermined value. The first predetermined value may be, for example, 100% or a value close to 100%. The light-shielding surface 21a blocks light incident from the display section 20 to the barrier section 21. The light-shielding surface 21a may transmit light with a transmittance equal to or less than a second predetermined value. The second predetermined value may be, for example, 0% or a value close to 0%. The first predetermined value is greater than the second predetermined value.
[0032] The opening region 21b and the light-shielding surface 21a are alternately arranged in the u-axis direction representing the parallax direction. The boundary between the opening region 21b and the light-shielding surface 21a may be along the v-axis direction perpendicular to the parallax direction as illustrated in Fig. 4, or along a direction inclined at a predetermined angle with respect to the v-axis direction. In other words, the opening region 21b and the light-shielding surface 21a may be alternately arranged along a predetermined direction including a component of the parallax direction.
[0033] The shapes of the opening region 21b and the light-shielding surface 21a may be determined based on the shapes of the left eye visible region 201L and the right eye visible region 201R. Conversely, the shapes of the left eye visible region 201L and the right eye visible region 201R may be determined based on the shapes of the opening region 21b and the light-shielding surface 21a.
[0034] The second barrier region 212 corresponds to the second display region 202 , and controls the transmittance of image light related to a two-dimensional image emitted from the second display region 202 .
[0035] In this embodiment, the barrier section 21 is located on the farther side than the display section 20 as viewed from the user 13. The barrier section 21 controls the transmittance of light incident from the backlight 19 toward the display section 20. The opening region 21b transmits light incident from the backlight 19 toward the display section 20. The light-shielding surface 21a blocks light incident from the backlight 19 to the display section 20. In this manner, the traveling direction of light incident on the first display region 201 is limited to a predetermined direction. As a result, a part of the image light can be controlled by the barrier section 21 to reach the left eye 5L of the user 13. The other part of the image light can be controlled by the barrier section 21 to reach the right eye 5R of the user 13.
[0036] The barrier section 21 may be composed of a liquid crystal shutter. The liquid crystal shutter may control the light transmittance based on an applied voltage. The liquid crystal shutter may be composed of a plurality of pixels and may control the light transmittance of each pixel. The liquid crystal shutter may form an area with high light transmittance or an area with low light transmittance in any shape. When the barrier section 21 is composed of a liquid crystal shutter, the opening area 21b may have a transmittance equal to or greater than a first predetermined value. When the barrier section 21 is composed of a liquid crystal shutter, the light-shielding surface 21a may have a transmittance equal to or less than a second predetermined value.
[0037] The first predetermined value may be set to a value higher than the second predetermined value. In one example, the ratio of the second predetermined value to the first predetermined value may be set to 1 / 100. In another example, the ratio of the second predetermined value to the first predetermined value may be set to 1 / 1000. The barrier section 21 in which the shapes of the opening region 21b and the light-shielding surface 21a are configured to be changeable is also referred to as an active barrier.
[0038] The control unit 24 controls the display unit 20. When the barrier unit 21 is an active barrier, the control unit 24 may control the barrier unit 21. The control unit 24 may control the backlight 19. The control unit 24 may obtain information on the position of the eye 5 of the user 13 from the detection device 11, and control the display unit 20, the barrier unit 21, or the backlight 19 based on the information.
[0039] The control unit 24 is configured as, for example, a processor. The control unit 24 may include one or more processors. The processor may include a general-purpose processor that loads a specific program to execute a specific function, and a dedicated processor specialized for a specific process. The dedicated processor may include an application specific integrated circuit (ASIC). The processor may include a programmable logic device (PLD). The PLD may include a field-programmable gate array (FPGA). The control unit 24 may be either a system-on-a-chip (SoC) in which one or more processors work together, or a system in a package (SiP).
[0040] The communication unit 22 may include an interface capable of communicating with an external device. The external device may include, for example, the detection device 11. The communication unit 22 may acquire information from the detection device 11 and output it to the control unit 24. The "communication interface" in the present disclosure may include, for example, a physical connector and a wireless communication device. The physical connector may include an electrical connector corresponding to transmission by electrical signals, an optical connector corresponding to transmission by optical signals, and an electromagnetic connector corresponding to transmission by electromagnetic waves. The electrical connector may include a connector conforming to IEC60603, a connector conforming to the USB standard, or a connector corresponding to an RCA terminal. The electrical connector may include a connector corresponding to an S terminal specified in EIAJ CP-121aA, or a connector corresponding to a D terminal specified in EIAJ RC-5237. The electrical connector may include a connector conforming to the HDMI (registered trademark) standard, or a connector corresponding to a coaxial cable including BNC (British Naval Connector or Baby-series N Connector, etc.). The optical connector may include various connectors conforming to IEC 61754. The wireless communication device may include a wireless communication device that complies with various standards including Bluetooth (registered trademark) and IEEE 8021a. The wireless communication device may include at least one antenna.
[0041] The storage unit 23 may store various information or programs for operating each component of the three-dimensional display device 17. The storage unit 23 may be configured with, for example, a semiconductor memory. The storage unit 23 may function as a work memory for the control unit 24. The storage unit 23 may be included in the control unit 24.
[0042] As shown in FIG. 5, the light emitted from the backlight 19 passes through the barrier unit 21 and the display unit 20 to reach the eye 5 of the user 13. The path of the light emitted from the backlight 19 to reach the eye 5 is indicated by a dashed line. The light that passes through the opening region 21b of the barrier unit 21 to reach the right eye 5R passes through the right eye visible region 201R of the display unit 20. Therefore, the right eye 5R can view the right eye visible region 201R by the light that has passed through the opening region 21b. The light that passes through the opening region 21b of the barrier unit 21 to reach the left eye 5L passes through the left eye visible region 201L of the display unit 20. Therefore, the left eye 5L can view the left eye visible region 201L by the light that has passed through the opening region 21b.
[0043] The display unit 20 displays a right eye image and a left eye image in the right eye viewing region 201R and the left eye viewing region 201L, respectively. As a result, the barrier unit 21 allows the image light related to the left eye image to reach the left eye 5L and the image light related to the right eye image to reach the right eye 5R. Therefore, the opening region 21b is configured to allow the image light related to the left eye image to reach the left eye 5L of the user 13 and the image light related to the right eye image to reach the right eye 5R of the user 13. In this way, the three-dimensional display device 17 can project a parallax image to both eyes of the user 13. The user 13 can see the image stereoscopically by viewing the parallax image with the left eye 5L and the right eye 5R. The direction that gives parallax to both eyes of the user 13 is also called the parallax direction. The parallax direction corresponds to the direction in which the left eye 5L and the right eye 5R of the user 13 are aligned.
[0044] When the user 13 is viewing stereoscopically, the user 13 may lose stereoscopic vision due to the image light related to the right eye image being incident on the left eye 5L or the image light related to the left eye image being incident on the right eye 5R. The phenomenon in which the image light related to the right eye image is incident on the left eye 5L or the image light related to the left eye image is incident on the right eye 5R is also called crosstalk. Crosstalk deteriorates the image quality of the stereoscopic vision provided to the user 13. The barrier unit 21 prevents the image light related to the left eye image from reaching the right eye 5R and prevents the image light related to the right eye image from reaching the left eye 5L. Therefore, the light-shielding surface 21a is configured to prevent the image light related to the left eye image from reaching the right eye 5R of the user 13 and prevents the image light related to the right eye image from reaching the left eye 5L of the user 13. In this way, the user 13 can view only the left eye image with the left eye 5L and only the right eye image with the right eye 5R. As a result, crosstalk is less likely to occur.
[0045] At least a part of the image light emitted from the display surface 20a of the display unit 20 passes through the opening region 21b of the barrier unit 21 and reaches the optical member 15 via the optical element 18. The image light is reflected by the optical member 15 and reaches the eye 5 of the user 13. As a result, the eye 5 of the user 13 can visually recognize the first virtual image 14a located on the negative side of the Z axis from the optical member 15. The first virtual image 14a corresponds to the image displayed on the display surface 20a. The opening region 21b and the light-shielding surface 21a of the barrier unit 21 create a second virtual image 14b in front of the optical member 15 and on the optical member 15 side of the first virtual image 14a. As shown in FIG. 5, the user 13 can visually recognize the virtual image 14 as if the display unit 20 is present at the position of the first virtual image 14a and the barrier unit 21 is present at the position of the second virtual image 14b.
[0046] Image light relating to an image displayed on the display surface 20a is emitted from the three-dimensional display device 17 in a direction defined by the barrier unit 21. The optical element 18 reflects or refracts the image light and emits it toward the optical member 15. The optical member 15 reflects the image light and causes it to proceed toward the eye 5 of the user 13. When the image light enters the eye 5 of the user 13, the user 13 visually recognizes the parallax image as a virtual image 14. The user 13 can see three-dimensionally by visually recognizing the virtual image 14. An image of the virtual image 14 that corresponds to the parallax image is also called a parallax virtual image. The parallax virtual image can also be said to be a parallax image projected via the optical system 30. An image of the virtual image 14 that corresponds to a planar image is also called a planar virtual image. The planar virtual image can also be said to be a planar image projected via the optical system 30.
[0047] The parallax virtual image visually recognized by the user 13 is projected to the eye 5 of the user 13 via the optical system 30. The optical system 30 may be required to project an image input by the incidence of image light by enlarging or reducing it while maintaining the similarity relationship. However, the optical system 30 may not be able to maintain the similarity relationship between the input image and the projected image. Therefore, a distortion may occur between the parallax image before entering the optical system 30 and the parallax image (parallax virtual image) projected via the optical system 30. For example, as shown in FIG. 6, an image displayed on a rectangular display surface 20a may become a virtual image 14 distorted in such a way that it expands in the u-axis direction as it goes in the positive direction of the v-axis by being projected onto the eye 5 of the user 13 via the optical system 30. The shape of the display surface 20a is represented by a solid line. The shape of the virtual image 14 is represented by a dashed line. The virtual image 14 may include a parallax virtual image and a planar virtual image. If the distortion of the parallax virtual image is large, crosstalk is likely to occur. On the other hand, distortion of a planar virtual image is unrelated to crosstalk. The user 13 is more likely to recognize the occurrence of crosstalk than distortion of the virtual image 14. Therefore, distortion of a parallax virtual image is more likely to degrade the image quality of the stereoscopic vision provided to the user 13 than distortion of a planar virtual image.
[0048] It is difficult to completely eliminate the distortion of the optical system 30. However, it is easier to change the distribution of the distortion of the optical system 30 than to eliminate the distortion. Therefore, in the three-dimensional display device 12 according to the present embodiment, the optical system 30 is designed so that the distortion of the parallax image projected through the optical system 30 is smaller than the distortion of the planar image projected through the optical system 30. Therefore, the optical system 30 may distribute the range in which the distortion is equal to or greater than a predetermined value in the range through which the image light of the planar image passes, and distribute the range in which the distortion is less than a predetermined value in the range through which the image light of the parallax image passes. For example, the optical system 30 may be designed to reduce the distortion in the range corresponding to the first display region 201 and increase the distortion in the range corresponding to the second display region 202. In this way, even if there is distortion of the optical system 30, the image quality of the stereoscopic vision provided to the user 13 can be improved.
[0049] The parallax image may include right-eye images and left-eye images arranged alternately along the parallax direction. The display unit 20 displays a right-eye image in the right-eye viewing region 201R and a left-eye image in the left-eye viewing region 201L on the display surface 20a. When a parallax image (parallax virtual image) projected via the optical system 30 is distorted in the parallax direction, the right-eye image is more likely to enter the left-eye viewing region 201L and the left-eye image is more likely to enter the right-eye viewing region 201R in the parallax virtual image. Therefore, distortion in the parallax direction is more likely to cause crosstalk.
[0050] The distortion of the optical system 30 is expressed by a combination of a component of distortion along the parallax direction and a component of distortion along a direction intersecting the parallax direction. Controlling the direction of the distortion of the optical system 30 is easier than eliminating the distortion. Therefore, the optical system 30 may be designed so that the component of distortion along the parallax direction is smaller than the component of distortion along the direction intersecting the parallax direction. In this way, even if the optical system 30 has distortion, the image quality of the stereoscopic vision provided to the user 13 can be improved.
[0051] It is assumed that the optical system 30 is represented by one concave mirror. In this case, the magnification of the virtual image 14 that the user 13 can view by projecting the object to be projected using the concave mirror is represented by the focal length of the concave mirror, which is represented by f. When the distance between the object to be projected and the concave mirror is 0, that is, when the object to be projected is located on the concave mirror, the magnification of the virtual image 14 is 1 (life size). When the distance between the object to be projected and the concave mirror is f, that is, when the object to be projected is located on the focal point of the concave mirror, the magnification of the virtual image 14 diverges to infinity. As the distance between the object to be projected and the concave mirror approaches f, the magnification of the virtual image 14 increases and the rate of change of the magnification of the virtual image 14 with respect to the change in distance also increases.
[0052] In this embodiment, the barrier section 21 is located farther from the optical system 30 than the display surface 20a. Therefore, the distance between the barrier section 21 and the optical system 30 is longer than the distance between the display surface 20a and the optical system 30. The distance between the display surface 20a and the optical system 30 is represented by D1.
[0053] The distance between the barrier unit 21 and the optical system 30 is represented by D2. Therefore, D2>D2 holds. If the magnifications when the distances between the object to be projected and the concave mirror are D1 and D2 are A1 and A2, respectively, then A2>A1 holds. Therefore, the magnification of the second virtual image 14b corresponding to the barrier unit 21 is greater than the magnification of the first virtual image 14a corresponding to the display surface 20a. When the area of the barrier unit 21 and the area of the display surface 20a are the same, the area of the second virtual image 14b is greater than the area of the first virtual image 14a.
[0054] This allows the second virtual image 14b to cover the first virtual image 14a. Therefore, in the parallax virtual image viewed by the user 13, the barrier unit 21 can cover the image displayed on the display surface 20a. If the barrier unit 21 cannot cover a part of the image displayed on the display surface 20a, the uncovered part will cause crosstalk. By the barrier unit 21 covering the image displayed on the display surface 20a, crosstalk is less likely to occur. As a result, the image quality of the stereoscopic vision provided to the user 13 can be improved.
[0055] Assuming that the optical system 30 is represented by a single concave mirror, the distortion of the virtual image 14 of the three-dimensional display device 17, which is the object to be projected, projected through the optical system 30 varies depending on the distance from the object to be projected to the optical system 30. For example, the distortion of the virtual image 14 of the object to be projected located at a first distance differs from the distortion of the virtual image 14 of the object to be projected located at a second distance. The optical system 30 can be designed so that the distortion of the virtual image 14 of the object to be projected located at a predetermined distance is minimized.
[0056] The display surface 20a and the barrier unit 21 are located with a predetermined gap therebetween, which is represented by reference symbol g in FIG. 5. Therefore, the distance from the display surface 20a to the optical system 30 is different from the distance from the barrier unit 21 to the optical system 30. In this case, the distortion of the first virtual image 14a corresponding to the display surface 20a is different from the distortion of the second virtual image 14b corresponding to the barrier unit 21. The distortion of the second virtual image 14b deforms the right eye viewing region 201R and the left eye viewing region 201L on the first virtual image 14a. The deformation of the right eye viewing region 201R and the left eye viewing region 201L increases the possibility that the right eye image enters the left eye viewing region 201L and the left eye image enters the right eye viewing region 201R. On the other hand, the distortion of the first virtual image 14a can be corrected by distorting the image displayed on the display unit 20 based on a matrix obtained by inversely transforming a matrix representing the distortion of the optical system 30. Therefore, the distortion of the second virtual image 14b is more likely to cause crosstalk than the distortion of the first virtual image 14a.
[0057] The optical system 30 may be designed so that the distortion of the barrier unit 21 is smaller than the distortion of the display surface 20a. The position of the three-dimensional display device 17 with respect to the optical system 30 may be determined so that the distortion of the barrier unit 21 is smaller than the distortion of the display surface 20a. In other words, the barrier unit 21 may be disposed at a position where the distortion of the optical system 30 is minimal. In this manner, even if there is distortion of the optical system 30, the image quality of the stereoscopic vision provided to the user 13 may be improved. The control unit detects the position of the viewpoint from the captured image, and corrects the detected position of the viewpoint to the position of the corrected viewpoint by the conversion table. The conversion table includes a distortion correction table that corrects the distortion of the captured image. The conversion table includes an origin correction table that corrects the offset between the origin of the captured image and the origin of the display image corresponding to the captured image.
[0058] The configuration according to the present disclosure is not limited to the above-described embodiment, and many variations or modifications are possible. For example, the functions included in each component can be rearranged so as not to cause logical inconsistencies, and multiple components can be combined into one or divided.
[0059] The drawings illustrating the configuration according to the present disclosure are schematic, and the dimensional ratios and the like in the drawings do not necessarily correspond to the actual ones.
[0060] In this disclosure, descriptions such as "first" and "second" are identifiers for distinguishing the configuration. Configurations distinguished by descriptions such as "first" and "second" in this disclosure may exchange numbers in the configuration. For example, the first eye may exchange identifiers "first" and "second" with the second eye. The exchange of identifiers is performed simultaneously. The configurations remain distinguished even after the exchange of identifiers. Identifiers may be deleted. A configuration from which an identifier has been deleted is distinguished by a symbol. Descriptions of identifiers such as "first" and "second" in this disclosure alone should not be used to interpret the order of the configuration or to justify the existence of an identifier with a smaller number.
[0061] In the present disclosure, the X-axis, Y-axis, and Z-axis are provided for convenience of explanation and may be interchanged. The configuration according to the present disclosure has been described using an orthogonal coordinate system formed by the X-axis, Y-axis, and Z-axis. The positional relationship of each configuration according to the present disclosure is not limited to an orthogonal relationship.
[0062] In another embodiment of the present disclosure, the detection device 11 may be provided inside the housing of the three-dimensional display device 12, as shown in Fig. 6. Even if the mounting position of the detection device 11 is changed, the control unit 24 controls the operation of the optical member 15 according to the incident angle of the light path from the imaging device 11a to the light reflecting unit 15a provided behind the optical member 15, accurately detects the viewpoint of the user 13, and controls the projected image based on the detected information, thereby making it possible to project a high-quality three-dimensional image. The present disclosure can be implemented in the following configurations (1) and (2). (1) A display unit including a first display area having a left eye viewing area for displaying a left eye image to be viewed by the left eye of a user and a right eye viewing area for displaying a right eye image to be viewed by the right eye of the user, and a second display area for displaying a planar image; a backlight located on a side farther from the display unit along an optical path of image light emitted from the display unit as viewed from the user; a barrier section located on the backlight side of the display section or on the user side of the display section, the barrier section having a first barrier region corresponding to the first display region and a second barrier region corresponding to the second display region; an optical member that reflects the image light toward the user and allows the user to view a virtual image; The virtual image has a small distortion region where distortion is relatively small and a large distortion region where distortion is relatively large, The first barrier region corresponds to the small distortion region, and the second barrier region corresponds to the large distortion region. (2) the virtual image is composed of a first virtual image corresponding to the display unit and a second virtual image corresponding to the barrier unit, the first virtual image and the second virtual image being located at different positions in a line of sight axis direction of the user; The display device described in the above configuration (1), wherein the barrier section is positioned between the backlight and the display section, such that a magnification of the second virtual image is greater than a magnification of the first virtual image and the second virtual image covers the first virtual image.
[0063] Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the above-described embodiments, and various modifications and improvements are possible within the scope of the gist of the present disclosure. It goes without saying that all or part of the components of each of the above-described embodiments can be appropriately combined within a range that does not contradict each other. [Explanation of symbols]
[0064] 5 eyes 5L left eye 5R Right eye 10 Mobile 12 3D display device (image display module) 13 User 14 Virtual Image 14a First virtual image 14b Second virtual image 15 Optical components 16 Eye Box 17 3D display device 18 Optical Elements 18a 1st mirror 18b 2nd mirror 19 Backlight 20 Display section 20a Display surface 21 Barrier section 21a Light-shielding surface 21b Opening area 22 Communications Department 23 Memory section 24 Control Unit 30 Optical system 100 3D Projection System 201 1st display area 201L Left eye visual field 201R Right eye visibility area 202 Second display area 211 First Barrier Region 212 Second Barrier Region
Claims
1. A display unit including a first display area having a left eye viewing area for displaying a left eye image to be viewed by the left eye of a user and a right eye viewing area for displaying a right eye image to be viewed by the right eye of the user, and a second display area for displaying a planar image; a backlight located on a side farther from the display unit along an optical path of image light emitted from the display unit as viewed from the user; a barrier section located on the backlight side of the display section or on the user side of the display section, the barrier section having a first barrier region corresponding to the first display region and a second barrier region corresponding to the second display region; an optical member that reflects the image light toward the user and allows the user to view a virtual image; The virtual image has a small distortion region where distortion is relatively small and a large distortion region where distortion is relatively large, The first barrier region corresponds to the small distortion region, and the second barrier region corresponds to the large distortion region.
2. the virtual image is composed of a first virtual image corresponding to the display unit and a second virtual image corresponding to the barrier unit, the first virtual image and the second virtual image being located at different positions in a line of sight axis direction of the user, 2. The display device according to claim 1, wherein the barrier section is positioned between the backlight and the display section, such that a magnification of the second virtual image is greater than a magnification of the first virtual image, and the second virtual image covers the first virtual image.
Citation Information
Patent Citations
Three-dimensional projector, three-dimensional projection system, and movable body
JP2019015823A
Virtual image display device
JP2019056885A
Method and apparatus for rendering image
JP2019062532A
Head-up display system
JP2020071415A
