Video display device

Abstract

To provide a video display device with which it is possible to display a clear video to a user, in which the impact of an optical characteristic that an optical element has is reduced.SOLUTION: Provided is a video display device comprising a first and a second video display unit for respectively displaying a first and a second video for the right and left eyes of a user, and a first and a second optical display element respectively corresponding to the first and second video display units. In addition, the video display device includes an actuator for changing the relative positions of at least one or more display optical elements and the corresponding video display unit, and is constituted so as to drive the actuator in correspondence to depth information that the image being displayed in a region which is a section of the first and second video display units and that intersects with the optical axis of a display optical element in the first and second video display units. By driving the actuator, the video display device changes the position of the display optical element and the corresponding position of the video display unit relative to each other.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a video display device. [Background technology]

[0002] There are image display devices that are worn on the user's head, and image display devices that are worn like glasses. A display unit is placed near the user's eyes, and parallax images are displayed for each of the user's eyes. The parallax images contain depth information indicating whether the user is looking at something far away or close up, and by viewing the displayed parallax images, the user can obtain a three-dimensional image of the object displayed in the parallax images.

[0003] With this image display device, the user's line of sight is adjusted to the position of the 3D image created by the images displayed for each eye, but the focal point is fixed to each of the left and right images on the display screen, which creates an unnatural state that would not occur when viewing a real object.

[0004] For example, when a user views an image of an object displayed as a parallax image, the user's convergence angle changes depending on the position of the object. At this time, the focal length of the crystalline lens changes depending on the magnitude of the convergence angle based on experience in real space. In this case, the focal length of the crystalline lens may not match the fixed diopter of the image display device, which may result in the displayed parallax image being out of focus and difficult to see clearly, thereby preventing good visibility. Therefore, when adjusting the diopter of an image display device, it is desirable to change the diopter according to depth information in the parallax image that determines the user's convergence angle, for example, by driving a lens within the device.

[0005] In Patent Document 1, the visual acuity adjustment for depth information according to the position of the user's point of gaze when viewing an image is performed in accordance with individual differences and the usage state of the image display device, thereby making it possible to reduce the sense of discomfort felt when viewing a stereoscopic image.

[0006] Furthermore, in Patent Document 2, a gaze sensor is provided to adjust visibility based on depth information of an image at the gaze position of the user, resulting in a system configuration that makes it easier to see an image in the gaze direction.

[0007] The optical system of Patent Document 1 will now be described with reference to FIG.

[0008] FIG. 9 is a diagram showing a schematic configuration of a video display device 10 disclosed in Patent Document 1. As shown in FIG.

[0009] The image data acquisition unit 100, display processing unit 101, diopter change instruction unit 106, object position calculation unit 108, user information recording unit 109, and operation mode recording unit 110 are realized by one or more processors, such as a CPU, reading and executing programs. The image display device 10 can be used by being worn on the user's head or worn like glasses. In either form, the image display device 10 can be fixed near the user's left eye 2a and right eye 2b. Note that the symbols a and b are added to the reference numerals of components related to the user's left eye 2a and right eye 2b, respectively, to distinguish them from one another.

[0010] The video display device 1 includes a video data acquisition unit 100 and a display processing unit 101. The video data acquisition unit 100 acquires video data for display via an external device, a network, or the like. The display processing unit 101 performs processing such as adjusting the display magnification of the acquired video data. The processed video data is sent to two display units 102a and 102b and displayed thereon. For example, the video data may be split into separate data for the two display units 102a and 102b and displayed thereon. This configuration is not limiting, and the screen of one display unit may be split into two and the video data may be displayed on the split screen. This type of video processing tailored to the right and left eyes allows the user to view the video without feeling uncomfortable.

[0011] Here, the image display device 1 includes first and second display optical elements corresponding to the left eye 2a and the right eye 2b, respectively. The first display optical element has a lens 103a, and the second display optical element has a lens 103b. Images displayed on the display units 102a and 102b are presented to the left eye 2a and the right eye 2b through the corresponding lenses 103a and 103b, respectively.

[0012] Diopter change drive units 104a and 104b have drive sources such as motors and drive lenses 103a and 103b, respectively. That is, lenses 103a and 103b are moved in directions along their optical axes (arrows 103a1 to 104a1, and 103b1 to 104b1) by diopter change drive units 104a and 104b.

[0013] Patent Document 2 discloses that an eye-gaze sensor is provided in the above configuration, the eye-gaze position is calculated from the detected eye-gaze direction, and the display is driven in accordance with the depth information of the image at that eye-gaze position.

[0014] In Patent Document 1, the depth is adjusted by driving the lens, but in Prior Art Example 2, a similar effect is obtained by moving the display.

[0015] FIG. 10 is an explanatory diagram of the state when the lenses 103a and 103b are moved by the diopter change drive units 104a and 104b. FIG. 10(A) is a diagram showing the state when the lenses 103a and 103b are moved near the display units 102a and 102b, respectively. FIG. 10(B) is a diagram showing the state when the lenses 103a and 103b are moved near the eyes 2a and 2b, respectively. When the observer (user) looks at the display units 102a and 102b with their eyes 2a and 2b through the lenses 103a and 103b, they view virtual images 105a and 105b. The positions of the virtual images 105a and 105b in the direction of the optical axes 103a1 and 103b1, based on the positions of the observer's eyes 2a and 2b, are defined as the virtual image formation position i. As shown in Figures 10(A) and 2(B), the virtual image position i can be changed by changing the positions of the lenses 103a and 103b. For example, as the lenses 103a and 103b move closer to the display units 102a and 102b, the virtual image position i moves closer to the eyes 2a and 2b. Conversely, as the lenses 103a and 103b move closer to the eyes 2a and 2b, the virtual image position i moves farther away from the eyes 2a and 2b. Therefore, by moving the lenses 103a and 103b using the diopter change drivers 104a and 104b, the viewer can see images of distant or nearby objects without blurring. Images contain depth information, which indicates whether the point of gaze is near or far. When this depth information matches the viewer's diopter, the viewer sees the image clearly. Figure 11 shows the relationship between the line of sight and image position in a conventional image display device.

[0016] The same parts as in the conventional configuration are designated by the same reference numerals.

[0017] In FIG. 11, the user's gaze is directed to the left and he is looking at the left part of the display 102.

[0018] In this drawing, the focus is drawn on 102 to make the problem easier to understand, but in reality, as mentioned above, the virtual image plane changes as the lens moves, and the focus position (focal position) also changes.

[0019] Here, when a user looks at the left edge of the display 102, the optical system sees the image through the edge of the lens. When considering optical performance, looking at an object through the edge of the lens increases optical aberration and detection errors of the line-of-sight sensor, and the user's line of sight becomes unstable, resulting in a deterioration in the image quality of the image seen by the user. In other words, the image becomes distorted, making it impossible to obtain a clear image.

[0020] Furthermore, in a configuration that detects where the viewer is looking across the entire area of ​​the display 102 and obtains depth information for that image position, it becomes necessary to extract the depth information from the depth information of the image of the entire display, which creates the problem of increasing the processing time required to obtain the depth information. [Prior art documents] [Patent documents]

[0021] [Patent Document 1] Japanese Patent Application Publication No. 2023-32278 [Patent Document 2] Japanese Patent Application Publication No. 2023-32250 Summary of the Invention [Problem to be solved by the invention]

[0022] The present invention provides an image display device that is less affected by the optical characteristics of optical elements and can display clear images to a user. [Means for solving the problem]

[0023] The image display device of the present invention includes first and second image display units that display first and second images to the right and left eyes of a user, respectively; first and second display optical elements corresponding to the first and second image display units, respectively; an actuator that changes the relative positions of at least one of the display optical elements and the corresponding image display unit; A video display device comprising: The actuator is a part of the first and second image display units, and is characterized in that the position of the display optical element and the corresponding position of the image display unit are changed relatively by driving the actuator in accordance with depth information provided by an image displayed in an area of ​​the first and second image display units that intersects with the optical axis of the display optical element. [Effects of the Invention]

[0024] According to the present invention, it is possible to provide an image display device that is less affected by the optical characteristics of optical elements and can display clear images to a user. [Brief explanation of the drawings]

[0025] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a video display device according to a first embodiment; [Figure 2] FIG. 1 is a diagram showing an embodiment of a video display device according to a first embodiment; [Figure 3] Flowchart showing the algorithm of the first embodiment and the display contents [Figure 4] FIG. 1 is a diagram showing the optical center region of the first embodiment. [Figure 5] FIG. 10 is a diagram showing a schematic configuration of a video display device according to a second embodiment; [Figure 6] FIG. 10 is a diagram showing the relationship between the depth and the lens position according to the user in the second embodiment. [Figure 7] FIG. 10 is a diagram showing a schematic configuration of a video display device according to a third embodiment. [Figure 8] FIG. 10 is a diagram showing the relationship between a change in depth information and a lens drive position in the third embodiment. [Figure 9] FIG. 1 is a diagram showing a schematic configuration of a conventional video display device. [Figure 10] FIG. 10 is a diagram showing the relationship between the lens position and the virtual image position in a conventional image display device. [Figure 11] A diagram showing the relationship between the line of sight and the optical system in a conventional image display device. DETAILED DESCRIPTION OF THE INVENTION

[0026] The image display device of this embodiment includes the following elements: first and second image display units that display first and second images to the user's right and left eyes, respectively, and first and second display optical elements that correspond to the first and second image display units, as well as an actuator that changes the relative positions of at least one or more of the display optical elements and the corresponding image display units.

[0027] Furthermore, the actuator is configured to be driven in response to depth information provided by an image displayed in a region that is part of the first and second image display units and intersects with the optical axis of the display optical element in the first and second image display units, and by driving the actuator, the position of the display optical element and the position of the corresponding image display unit are changed relatively.

[0028] This configuration allows the user to see images with minimal optical aberration and good optical performance, providing clear images. It also has the effect of reducing user nausea and fatigue. Furthermore, limiting the image processing area reduces the amount of image processing, enabling high-speed processing.

[0029] The present invention will be described in detail below with reference to the drawings. In addition, although the following description will explain an embodiment, the present invention may be configured by combining various elements as long as it does not deviate from the spirit of the invention. [Example]

[0030] First, the terms used to describe this embodiment are defined as follows.

[0031] Optical center: The area that intersects with the optical axis of the optical system. It is not just the point of intersection, but also the area that includes the intersection position. Gaze direction: Indicates the direction the user's eyes are facing Depth information: An indicator of whether the point of gaze in the video is near or far Diopter adjustment: Moving the lens according to the depth information of the image to adjust the focus. Diopter: The point at which the object is in focus

[0032] An embodiment of the present invention will now be described with reference to Figures 1 to 4. Figure 1 shows the configuration of an image display device according to this embodiment. The same components as those in the configuration of a conventional image display device are assigned the same reference numerals. The device may also include a posture change detection unit for detecting head rotation, etc.

[0033] In this embodiment, for example, in addition to the function of adjusting the diopter, a posture change detection unit 111 is provided to detect head rotation, etc., and the position of the image is changed in response to posture changes. Figure 2 shows the image display device of this embodiment before and after diopter adjustment, with 1 representing the user, 10 representing the image display device itself, and 102 representing the appearance of the display, which is the image display unit within the image display device. Figure 2(a) shows a state in which user 1 is looking at a triangular mark, which is an image displayed in the center of the display, and the + mark indicates the user's line of sight. Here, the triangular mark is an object at a great depth (far away), and the object is in focus.

[0034] The circle on the left side of the display is an object at a small depth (nearby), and in the state of Figure 2(a) it is at the edge of the display and the focus adjustment is set to a large depth (farther), so it is out of focus and blurred. Furthermore, as shown in the issues of this proposal, when looking at the edge of the display, you are shifted from the intersection of the optical axes, and the effects of lens aberrations, which are the display optical elements, are also superimposed.

[0035] Figure 2(b) shows the state in which, as user 1 moves his / her head, the image display unit of the device moves the circle mark at the edge of the display to the optical center position, and furthermore, by adjusting the diopter, the focus changes from large depth (far) to small depth (near).

[0036] Here, since the object has been moved to the optical center position, it is no longer subject to the effects of optical aberrations and the like, and it is possible to view the object as a clear image.

[0037] 3 shows a flowchart of this embodiment and the state of the display image during the process. This flowchart will be used to explain the flow of the change from (a) to (b) in FIG.

[0038] First, the user is looking at a triangle mark with a large depth (far) at the center of the display. At this point, the lens driver 104 attached to the lens 103 has moved the lens 103 to a position where the triangle mark is in focus. (F-01, D-01)

[0039] Next, the user moves his head to the left to look at the circle (small depth (near)) on the left side of the display. (F-02)

[0040] When the head moves, the posture change detection unit 111 (for example, a detection unit configured with a head tracking sensor) shown in FIG. 1 detects the amount of change in the direction of the posture change. For example, a posture change can be detected by detecting the posture of the image display device using a detection unit mounted on the image display device. In addition, the image information to be displayed on the image display unit can be determined according to the posture detection results, such as the detected posture or posture change.

[0041] In FIG. 1, the image center calculation unit 112 moves the image center position in accordance with the posture change detection result.

[0042] In this case, the diopter adjustment position at the center of the display is set to deep (far), so the circle remains blurred. (F-03, D-02)

[0043] The circle moves to the center of the display, so we get the depth information of the circle. (F-04)

[0044] Since the depth information has changed from the previous state of large depth (far) to the circled small depth (near), the lens (motor) position is moved so that the focus is on the small depth (near). (F-05)

[0045] The lens moves to the optimal position and stops. In this state, the circle in the center of the display is in focus, and the image becomes clear. (F-06, D-03)

[0046] If the depth at the center of the display changes due to head movement, the lens is ready to move again. In this example, the image moves with head movement, and the depth information at the center of the display changes. However, even if the image changes and the depth changes without head movement, the lens can be driven to adjust the diopter, so the image can be seen clearly. (F-07)

[0047] By adjusting the diopter at the optical center as in this embodiment, there is no need to install a line-of-sight sensor, and since viewing is done at the optical center, there is the advantage that the areas at the edges of the lens, which have poor optical performance, do not need to be used. Furthermore, it is desirable to use a vibration-type motor that has a holding force when stopped to drive the motor in this embodiment, so that the lens does not move due to inertial force when posture changes due to head rotation, etc. The vibration-type motor is a vibration-type motor that has a vibrating body and a contact body that comes into contact with this vibrating body, and can be configured to hold the display optical element using the holding torque of the vibration-type motor.

[0048] 4 is a diagram showing the optical central region. The entire area of ​​the display 102 is taken as 100%, and the central 50% or less is taken as the region that looks optically clear, as it is the range that is least affected by lens aberration. This central region may be the region that includes the point where the lens intersects with the optical axis and occupies 50% or less of the display area of ​​the display 102, assuming that the area is 100%. Alternatively, it may be the region that includes the point where the lens intersects with the optical axis and corresponds to a width of 50% or less of the display area when one width of the display area is 100% if the display 102 is substantially rectangular.

[0049] Figure 4(a) shows the state when the diopter is adjusted to a small depth (near), and Figure 4(b) shows the state when the diopter is adjusted to a large depth (far), with 105a and b showing the positions of the virtual images. Although the angle of view is different, the diopter adjustment area is the center of the range that the user can see, so that depth information processing and lens drive control only need to be performed on the center of the image, resulting in not only a clear image but also high-speed, highly responsive processing.

[0050] In this embodiment, the appropriate area is set to 50% or less of the display area, but it is possible to make the area wider depending on the optical performance and information processing capacity. Also, in this embodiment, the diopter adjustment is performed by moving the lens, but a similar effect can be obtained with a device in which the display moves in the optical axis direction, as shown in Patent Document 2. In other words, it is only necessary to configure the device so that the positions of at least one of the first and second display optical elements and the positions of the first and second image display units can be changed relatively by driving the actuator. [Example]

[0051] A second embodiment of the present invention will be described with reference to FIG.

[0052] FIG. 5 is a diagram showing the configuration of a video display device according to the second embodiment.

[0053] The same components as those in the configuration of the conventional image display device are assigned the same reference numerals. In this embodiment, a left eye correction unit 106a and a right eye correction unit 106b are provided between the diopter change instruction unit 106 and the lens drive actuator, respectively.

[0054] The left eye correction unit 106a and the right eye correction unit 106b store data indicating the relationship between the characteristic data of the user's eyes and the amount of lens movement, and the amount of lens movement is set according to the user.

[0055] Figure 6 is a graph showing the relationship between the depth information (horizontal axis) and the lens position (vertical axis) for each user. Lines (A), (B), and (C) in Figure 6 show the relationship between the depth information (horizontal axis) and the lens position (vertical axis) for each user.

[0056] Generally, a user's diopter changes depending on the object distance. When a person is looking at an object at a close distance, the diopter adjusts to a closer position, and conversely, when a person is looking at an object at a farther distance, the diopter adjusts to a farther position. As a result, a person can see an object clearly, whether it is close or far away.

[0057] The depth information of the image displayed on the display has the same meaning as the distance information (object distance) from the position corresponding to the real reference position to the image in the virtual space projected on the display. Therefore, even if the position of the display does not change, the object distance appears to change when the lens moves.

[0058] In Figure 6, when the depth information on the display changes at line (A), it is equivalent to a change in the object distance, and the lens position must be changed so that the focus is adjusted at that position.

[0059] Line (B) in Figure 6 shows the lens position to improve the decline in the focusing ability of the eye's crystalline lens due to the effects of aging, for example. Middle-aged and elderly people often have a narrow range of object distances at which they can see clearly, making it difficult for them to see objects that are far or close clearly.

[0060] In this embodiment, the range of lens movement is increased for the aging user, widening the visible range. By increasing the range of movement in this way, objects can be clearly seen regardless of whether they are far or close.

[0061] In the case of line (C) in Figure 6, the relationship between the depth information and the amount of change in lens position is the same as in the case of line (A), but the lens position is different at the same object distance. This occurs when the object distance at which the image appears clear differs due to the influence of myopia, hyperopia, etc. Such people often use corrective glasses to achieve the relationship between object distance and diopter shown by line (A).

[0062] By setting the relationship between the object distance and the lens position as shown by line (C) in this embodiment, the same effect as wearing glasses can be obtained, making it possible to see the image clearly without wearing glasses.

[0063] Although Figure 6 shows the relationship between depth and lens position for a user with the same information such as visual acuity for both eyes, it is also possible to accommodate a user with different visual acuity information for the left and right eyes.

[0064] FIG. 5 shows the relationship between lens positions for a user with poorer vision in the left eye than in the right eye.

[0065] 5, the left eye correction unit 106a determines the position of the lens for the left eye so that the right eye will be in focus at a distance farther away, and the right eye correction unit 106b sets the position of the lens for the right eye so that the right eye will be in focus at a distance closer than the left eye. For example, the relationship is as shown in FIG. 6(A) for the left eye and FIG. 6(B) for the right eye.

[0066] In this way, in this embodiment, by providing the left and right correction units, the left and right lens positions can be set independently.

[0067] Furthermore, when performing the above correction, the correction data differs depending on the gaze direction, i.e., whether the user is looking at a position away from the optical center or at the optical center. In other words, in addition to data on the user's visual acuity, it is necessary to store data on the product of the gaze direction and the lens drive amount, which can lead to problems such as an increase in data volume and an increase in the time required to process the data. Furthermore, in this embodiment, as in the first embodiment, only the depth information at the position of the optical center is used, so the amount of data to be processed can be significantly reduced, and processing corresponding to the user's left and right eyes can be fully performed.

[0068] In this way, the image display device can respond to information such as the user's eyesight, and by moving the lenses, the user can view the image with the same sensation as if wearing glasses, even without glasses. Because the user can wear the image display device without glasses, there is no need for space for glasses, and the image display device can also be made smaller. [Example]

[0069] A third embodiment of the present invention will be described with reference to FIGS.

[0070] FIG. 7 is a diagram showing the configuration of a video display device according to the third embodiment.

[0071] The same components as those in the conventional image display device are designated by the same reference numerals.

[0072] In this embodiment, a variation processing unit 113 is provided between the image center calculation unit 112 and the display processing unit 101 .

[0073] In the first embodiment, the diopter adjustment was performed by moving the lens according to the depth information at the center of the image, but in this embodiment, the change in the depth information at the center of the image is calculated by the variation processing unit 113. Conventionally, even if one wanted to see the change in depth information, it was necessary to determine which information in the entire image to calculate after detecting the line of sight direction with an eye sensor, which required a long processing time.

[0074] In this embodiment, the detection position is determined to be the optical center position, so that changes in depth information can be easily detected, and information on the changes can be easily obtained.

[0075] FIG. 8 shows the change in depth of the center of the image and the lens movement over time.

[0076] Here, changes in depth information at the optical center can be detected in real time, but because the detection is performed in accordance with the optical center in this proposal, the amount of data to be processed is reduced, allowing changes in depth information to be detected almost in real time.

[0077] The variation processing section performs, for example, integration processing on the changes in the depth information, so as not to respond to sudden changes, but to respond slowly to any changes that occur.

[0078] The variation processing section is provided with a threshold value for the amount of variation from the previous value, and when the threshold value is exceeded, a command to drive the lens is issued to the diopter change instruction section.

[0079] For example, if there is a sudden change in depth information such as at time t1, where the depth information returns to the original state in an instant, the integrated result will not exceed the threshold value, and therefore the lens will not be driven.

[0080] From time t2 to t3, the depth information changes to a larger value.

[0081] In such a case, the result of integration in the fluctuation processing section exceeds the threshold value, and a command to drive the lens is sent to the diopter change instruction section, and the lens is driven.

[0082] As described above, in this embodiment, after the depth information of the optical center is processed at high speed and obtained, the variation processing section determines whether lens movement is necessary and controls the lens movement.

[0083] By operating as in this embodiment, the lens does not have to adapt to sudden changes, and the user can see smooth changes in the image, making it possible to watch the image without experiencing discomfort or nausea. [Industrial Applicability]

[0084] The proposed image display device can be used in devices such as head-mounted displays and image display glasses. Recently, there has been a demand for higher-definition images, and this device, which can provide clear images, can be deployed in products with a wide range of applications. It can also be used without corrective glasses, which can contribute to the miniaturization of devices. [Explanation of symbols]

[0085] 1 user 10. Video display device 100 Video acquisition unit 101 Display processing unit 102a,b Video display section 103a,b Lens 104a,b Actuator 104a,b Lens movement range 105a,b Virtual image 106 Diopter change instruction section 106a Left eye correction section 106b Left eye correction section 108 Object position calculation section 109 User information storage unit 110 Operation mode recording section 111 Posture change detection unit 112 Image center calculation unit 113 Variable Processing Unit 201a left eye 201b Right eye

Claims

1. first and second image display units for displaying first and second images to the right and left eyes of a user, respectively; first and second display optical elements corresponding to the first and second image display units, respectively; an actuator that changes the relative positions of at least one of the display optical elements and the corresponding image display unit; A video display device comprising: An image display device that is part of the first and second image display units, and that drives the actuator in response to depth information provided by an image displayed in an area of ​​the first and second image display units that intersects with the optical axis of the display optical element, thereby relatively changing the position of the display optical element and the corresponding position of the image display unit.

2. 2. The image display device according to claim 1, wherein the area is 50% or less of a display area of ​​the image display unit.

3. 3. The image display device according to claim 2, wherein the area of ​​the display area is 100%, and the area of ​​the display area is 50% or less.

4. 3. The image display device according to claim 2, wherein the area corresponds to a width of 50% or less when one width of the rectangular image display unit is 100%.

5. 3. The image display device according to claim 1, wherein the depth information of the image in the area intersecting the optical axis of the display optical element also includes distance information of the object displayed on the first and second image display units.

6. 3. The image display device according to claim 1, further comprising a detection unit that detects an attitude of the image display device, and determines the image information to be displayed in the area according to a result of the attitude detection.

7. the actuator is a vibration-type motor having a vibrating body and a contact body that comes into contact with the vibrating body, 7. The image display device according to claim 6, wherein the display optical element is held by a holding torque of the vibration type motor when the attitude is detected.

8. 2. The image display device according to claim 1, further comprising a correction unit for changing the position of said display optical element based on the visual acuity information of said user.

9. 9. The image display device according to claim 8, wherein the correction section changes the position of the display optical element based on depth information provided by the image in addition to the visual acuity information of the user.

10. a variation processing unit that calculates a change in depth information provided by the image; 3. The image display device according to claim 1, wherein the actuator is driven when the change exceeds a threshold value.

11. 3. The image display device according to claim 1, wherein the actuator is an actuator for changing the position of at least one of the display optical elements.

Images