Display device, display method, and program

Abstract

To improve the resolution of a video displayed on a head-mounted display.SOLUTION: A display device is mounted on the head of a user in a state of covering the user's eyes. The display device includes: a display section that is disposed in a state of facing the user's eyes; a drive section that drives the display section in a surface direction; a display control section that causes the display section to display a video; a drive control section that controls the drive section to vibrate the display section in the surface direction of the display section at a frequency twice a refresh rate of the video displayed by the display section and shift the display section by half a size of a pixel per frame; and the display control section that supplies an image signal corresponding to a shift amount of the display section by the drive control section to the display section.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a display device, a display method, and a program. [Background technology]

[0002] There is known a technique for displaying high-resolution images by performing pixel shifting. For example, Patent Document 1 discloses a technique for performing pixel shifting to display an appropriate image according to the scene. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-3108 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, head-mounted displays, which are worn on the user's head, have become popular. A head-mounted display places a small display close to the user's eyes, allowing the user to view the image as if they were looking at a large display. However, to display an image on a small display with the same resolution as a large display, the pixel pitch must be reduced, but there are technical limitations to reducing the pixel pitch. Therefore, improving the resolution of head-mounted displays has become a challenge.

[0005] The present disclosure aims to provide a display device, a display method, and a program that can improve the resolution of an image displayed on a head-mounted display. [Means for solving the problem]

[0006] The display device of the present disclosure is a display device that is worn on a user's head in a state where the user's eyes are covered, and includes a display unit that is positioned facing the user's eyes, a drive unit that drives the display unit in a planar direction, a display control unit that displays an image on the display unit, a drive control unit that controls the drive unit to vibrate the display unit in the planar direction of the display unit at a frequency twice the refresh rate of the image displayed by the display unit, and shifts the display unit by half the pixel size per frame, and a display control unit that supplies an image signal to the display unit that corresponds to the amount of shift of the display unit by the drive control unit.

[0007] The display method of the present disclosure includes the steps of: displaying an image on a display unit positioned facing the user's eyes in a display device worn on the user's head while the user's eyes are covered; and controlling a drive unit to vibrate the display unit in the surface direction of the display unit at a frequency twice the refresh rate of the image displayed by the display unit, and shifting the display unit by half the pixel size per frame.

[0008] The program disclosed herein causes a computer to execute the following steps: displaying an image on a display unit positioned facing the user's eyes in a display device worn on the user's head while the user's eyes are covered; and controlling a drive unit to vibrate the display unit in the surface direction of the display unit at a frequency twice the refresh rate of the image displayed by the display unit, and shifting the display unit by half the pixel size per frame. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to improve the resolution of images displayed on a head-mounted display. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram of a display device according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of the display device according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating the relationship between the display unit and the lens according to the embodiment. [Figure 4] FIG. 4 is a diagram for explaining a method for controlling the drive unit according to the embodiment. [Figure 5] FIG. 5 is a diagram for explaining a method for controlling the direction in which the display unit vibrates according to the embodiment. [Figure 6] FIG. 6 is a diagram for explaining a first control method for the drive unit according to the embodiment. [Figure 7] FIG. 7 is a diagram for explaining a method for converting a low-resolution image into a high-resolution image according to the embodiment. [Figure 8] FIG. 8 is a diagram for explaining a second control method for the drive unit according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing the processing flow of the video display method according to the embodiment. [Figure 10] FIG. 10 is a diagram for explaining a method for adjusting the position of an image displayed on a display unit according to a modification of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the present disclosure is not limited to these embodiments, and in the following embodiments, the same components are designated by the same reference numerals, and redundant description will be omitted.

[0012] [First embodiment] (display device) The device according to the embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a schematic diagram of the display device according to the embodiment. Fig. 2 is a block diagram showing an example of the configuration of the display device according to the embodiment.

[0013] 1 and 2, the display device 12 includes a mounting unit 14, a display unit 16, a lens 18, a drive unit 20, a first sensor 22, a second sensor 24, an audio output unit 26, a communication unit 28, a storage unit 30, and a control unit 32. The display device 10 displays various images such as two-dimensional images and three-dimensional images.

[0014] The display device 12 is worn on the head of the user U with the user U's eyes covered. The display device 12 is, for example, a goggle-type head-mounted display, but is not limited to this. The display device 12 is fixed to the head of the user U by a wearing unit 14. The wearing unit 14 is, for example, a belt wrapped around the head of the user U, but is not limited to this.

[0015] The display unit 16 is disposed facing the eyes of the user U. The display unit 16 is disposed inside the display device 12 so as to be vibrable by a floating mechanism 101. The floating mechanism 101 may be a well-known mechanism formed by, for example, a spring. The floating mechanism 101 may be formed by applying, for example, a technique used for general image stabilization. The display unit 16 displays various images. The display unit 16 is realized by a display including, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display.

[0016] The lens 18 is disposed facing the eyes of the user U. The lens 18 is disposed between the display unit 16 and the eyes of the user U. FIG. 3 is a diagram for explaining the relationship between the display unit 16 and the lenses according to the embodiment. As shown in FIG. 3, a left-eye lens 18a and a right-eye lens 18b are disposed between the display unit 16 and the eyes of the user U. The user U views the image displayed on the display unit 16 via the left-eye lens 18a and the right-eye lens 18b. As will be described later, in the present disclosure, the resolution of the display unit 16 is improved by physically vibrating the display unit 16.

[0017] The driving unit 20 is an actuator capable of vibrating in the X-axis direction, the Y-axis direction, and the Z-axis direction inside the display device 12. When the driving unit 20 is driven, the display unit 16 arranged by the floating mechanism 101 also vibrates in conjunction with the driving unit 20. Note that, although the following description will be given assuming that the driving unit 20 vibrates the display unit 16, the present disclosure is not limited thereto. For example, the driving unit 20 may be configured to vibrate the lens 18.

[0018] The first sensor 22 is provided on the display unit 16. The first sensor 22 detects acceleration occurring in the display unit 16. The first sensor 22 detects the inclination of the display unit 16 with respect to the ground. The first sensor 22 is, for example, an acceleration sensor that detects acceleration in three axial directions, namely, the X-axis direction, the Y-axis direction, and the Z-axis direction. The first sensor 22 outputs the acceleration detection results to the control unit 32. The first sensor 22 outputs the inclination of the display unit 16 with respect to the ground to the control unit 32.

[0019] The second sensor 24 is provided on the head of the user U. The second sensor 24 is provided, for example, on the mounting unit 14. The second sensor 24 detects acceleration occurring in the head of the user U. The second sensor 24 detects the inclination of the head of the user U with respect to the ground. The second sensor 24 is, for example, an acceleration sensor that detects acceleration in three axial directions, namely, the X-axis direction, the Y-axis direction, and the Z-axis direction. The second sensor 24 outputs the acceleration detection results to the control unit 32. The second sensor 24 detects the inclination of the head of the user U with respect to the ground.

[0020] The audio output unit 26 is a speaker that outputs audio to the user U. The audio output unit 26 outputs audio corresponding to the video displayed on the display unit 16, for example.

[0021] The communication unit 28 is a communication module that executes communication between the display device 12 and an external device.

[0022] The storage unit 30 stores various types of information. For example, the storage unit 30 stores video data of the video displayed by the display unit 16. The storage unit 30 stores information such as the calculation contents of the control unit 32 and programs. The storage unit 30 includes, for example, at least one of a RAM (Random Access Memory), a main storage device such as a ROM (Read Only Memory), and an external storage device such as an HDD (Hard Disk Drive).

[0023] The control unit 32 controls each unit of the display device 12. The control unit 32 has, for example, an information processing device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM or a ROM. The control unit 32 executes a program that controls the operation of the display device 12 according to the present invention. The control unit 32 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 32 may be realized by a combination of hardware and software.

[0024] The control unit 32 includes a display control unit 40, a drive control unit 42, a sensor control unit 44, and a calculation unit 46.

[0025] The display control unit 40 controls the display unit 16. The display control unit 40 controls the image to be displayed on the display unit 16. The image that the display control unit 40 causes the display unit 16 to display may be a two-dimensional image or a three-dimensional image.

[0026] The drive control unit 42 controls the drive unit 20. The drive control unit 42 controls the drive unit 20 to vibrate the display unit 16 in a predetermined direction, thereby performing pixel shifting. Specifically, the drive control unit 42 vibrates the display unit 16, thereby generating a pseudo high-resolution image from the low-resolution image displayed by the display unit 16. The control method of the drive unit 20 will be described later.

[0027] The sensor control unit 44 controls the first sensor 22 and the second sensor 24. The sensor control unit 44 controls the first sensor 22 to detect the acceleration occurring in the display unit 16 and the inclination of the display unit 16 with respect to the ground. The sensor control unit 44 controls the second sensor 24 to detect the acceleration occurring in the head of the user U and the inclination of the head of the user U with respect to the ground. The sensor control unit 44 acquires the detection results of the acceleration occurring in the display unit 16 and the inclination of the head of the user U with respect to the ground from the first sensor 22. The sensor control unit 44 acquires the detection results of the acceleration occurring in the head of the user U and the inclination of the head of the user U with respect to the ground from the second sensor 24.

[0028] The calculation unit 46 performs various calculations. The calculation unit 46 performs various calculations based on the detection results of the sensor control unit 44. The calculation unit 46 detects, for example, the difference between the acceleration occurring in the display unit 16 and the acceleration occurring in the head of the user U. The calculation unit 46 calculates, for example, the difference between the tilt of the display unit 16 with respect to the ground and the tilt of the head of the user U with respect to the ground.

[0029] (Method of controlling the drive unit) A method for controlling the drive unit according to the embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram for explaining the method for controlling the drive unit according to the embodiment. Fig. 4 shows the positional relationship between the display unit 16, the drive unit 20, and the floating mechanism 101.

[0030] 4, the display device 12 includes floating mechanisms 101a, 101b, 101c, and 101d as floating mechanisms 101. Floating mechanism 101a is provided in an upper portion inside the display device 12. Floating mechanism 101b is provided in a lower portion inside the display device 12. Floating mechanism 101c is provided in a left portion inside the display device 12. Floating mechanism 101d is provided in a right portion inside the display device 12. Note that configuration examples of the floating mechanism 101 are not limited to floating mechanisms 101a to 101d.

[0031] The display unit 16 is fixed inside the display device 12 by floating mechanisms 101a, 101b, 101c, and 101d. The floating mechanism 101a fixes the display unit 16 at the top of the display device 12. The floating mechanism 101b fixes the display unit 16 at the bottom of the display device 12. The floating mechanism 101c fixes the display unit 16 at the left side of the display device 12. The floating mechanism 101d fixes the display unit 16 at the right side of the display device 12.

[0032] As shown in FIG. 4, the display device 12 includes a driver 20a and a driver 20b as the driver 20. The driver control unit 42 drives the driver 20a in a direction perpendicular to the ground (up and down) as indicated by an arrow 111, thereby vibrating the display unit 16 in a vertical direction relative to the ground. The driver control unit 42 drives the driver 20b in a horizontal direction relative to the ground (left and right) as indicated by an arrow 112, thereby vibrating the display unit 16 in a horizontal direction relative to the ground. The driver control unit 42 controls the direction in which the display unit 16 vibrates based on, for example, the magnitude of the acceleration occurring in the display unit 16 and the magnitude of the acceleration occurring in the head of the user U. The driver control unit 42 controls the direction in which the display unit 16 vibrates based on, for example, the direction of the acceleration occurring in the display unit 16 and the direction of the acceleration occurring in the head of the user U. The driver control unit 42 controls the direction in which the display unit 16 vibrates based on, for example, the tilt of the display unit 16 relative to the ground and the tilt of the head of the user U relative to the ground. The configuration example of the drive unit 20 is not limited to the drive unit 20a and the drive unit 20b.

[0033] 5 is a diagram illustrating a method for controlling the direction in which the display unit vibrates according to the embodiment. In FIG. 5, the horizontal axis represents time, and the vertical axis represents the magnitude of acceleration occurring in the vertical direction. Waveform W1 represents the magnitude of the vertical acceleration occurring in the display unit 16. Waveform W2 represents the magnitude of the acceleration occurring in the head of the user U.

[0034] The drive control unit 42 controls the drive method of the drive units 20a and 20b based on the difference between the magnitude of the acceleration occurring in the display unit 16 and the magnitude of the acceleration occurring in the head of the user U. Because the display unit 16 is fixed to the display device 12 by the floating mechanism 101, a positional deviation may occur between the eyes of the user U and the display unit 16 due to, for example, shaking of the display unit 16 and the head of the user U. In other words, the difference between the acceleration occurring in the display unit 16 and the acceleration occurring in the head of the user U may result in parallax. Therefore, the drive control unit 42 drives the drive units 20a and 20b so as to reduce the parallax.

[0035] For example, when the difference between the magnitude of the acceleration occurring in the display unit 16 and the magnitude of the acceleration occurring in the head of the user U is less than a predetermined value, the drive control unit 42 drives the drive units 20a and 20b by the first drive method. The case where the difference between the acceleration occurring in the display unit 16 and the acceleration occurring in the head of the user U is less than a predetermined value occurs, for example, when the user U is stationary or when the user U is considered to be stationary, but is not limited to this.

[0036] For example, when the difference between the magnitude of the acceleration occurring in the display unit 16 and the magnitude of the acceleration occurring in the head of the user U is greater than or equal to a predetermined value, the drive control unit 42 drives the drive units 20a and 20b using the second drive method.

[0037] 5, between timing t1 and timing t2, the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U is equal to or greater than a predetermined value. Except between timing t1 and timing t2, the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U is less than a predetermined value. In this case, the drive control unit 42 controls the drive units 20a and 20b using the first control method except between timing t1 and timing t2. The drive control unit 42 controls the drive units 20a and 20b using the second control method between timing t1 and timing t2.

[0038] (First control method of the drive unit) A first control method of the drive unit according to the embodiment will be described using Fig. 6. Fig. 6 is a diagram for explaining the first control method of the drive unit according to the embodiment. In the example shown in Fig. 6, components other than the display unit 16, drive unit 20a, and drive unit 20b are omitted. The first control method of the drive unit is a drive method when the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U is less than a predetermined value, that is, when there is almost no difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U.

[0039] As shown in FIG. 6, when the difference between the magnitude of the acceleration occurring in the display unit 16 and the magnitude of the acceleration occurring in the head of the user U is less than a predetermined value, the drive control unit 42 drives the drive unit 20a in the vertical direction and the drive unit 20b in the horizontal direction. As a result, the drive control unit 42 vibrates the display unit 16 in the diagonal direction (oblique direction) of the display unit 16, as indicated by arrow 113. Specifically, the drive control unit 42 controls the drive units 20a and 20b to vibrate the display unit 16 at a frequency twice the refresh rate of the image displayed on the display unit 16 by the display control unit 40. As a result, the drive control unit 42 shifts the display unit 16 by half a pixel distance in the Y and Z directions in the figure per frame. The drive control unit 42 performs pixel shifting by reciprocatingly driving (vibrating) the display unit 16 by half a pixel distance in the Y and Z directions in the figure.

[0040] FIG. 7 is a diagram illustrating a method for converting a low-resolution image into a high-resolution image according to an embodiment. FIG. 7(a) is a schematic diagram illustrating an original video signal 200 to be displayed on the display unit. The (n, m) in parentheses indicates a pixel number in the video signal, and (n, m) indicates a pixel in n rows and m columns. FIG. 7(b) is a schematic diagram illustrating an actual video signal displayed on the pixels of the display unit 16. In this embodiment, as shown in the left diagrams of FIGS. 7(a) and 7(b), the size of the pixels of the display unit 16 is larger than that of the pixels of the original video signal 200. Therefore, the display control unit 40 supplies a video signal to the pixels of the display unit 16 by thinning out the pixel signals of the original video signal 200. As a result, the resolution of the display unit 16 is half that of the original video signal 200.

[0041] In the first control method of the drive unit, drive control unit 42 vibrates display unit 16 at a frequency twice the refresh rate of video signal 200, and display control unit 40 alternately supplies video signal 210 and video signal 220, which is shifted by one row and one column from video signal 210, to the pixels of display unit 16 at a frequency twice the refresh rate of video signal 200. As shown in Fig. 7(b), by alternately displaying video signals 210 and 220 while driving (vibrating) display unit 16 back and forth by half the distance of a pixel in the Y and Z directions in the figure, the user will see video signals 210 and 220 overlapping, as shown in 230, and the display resolution can be artificially improved.

[0042] In the above example, the drive control unit 42 controls the drive units 20a and 20b to reciprocate (vibrate) the display unit 16 in a diagonal (oblique) direction. However, the direction in which the display unit 16 reciprocates (vibrates) is not limited to the diagonal direction of the display unit, and may be only horizontally or vertically. In this case, the display control unit 40 alternately supplies the video signal 220 that is shifted by one row or one column in the horizontal or vertical direction with respect to the video signal 210. This improves the resolution in the horizontal or vertical direction. In other words, the display control unit 40 supplies the display unit 16 with a video signal that corresponds to the amount of shift of the display unit 16 by the drive control unit 42.

[0043] In the above explanation, an example has been described in which a video signal obtained by thinning out the original video signal is supplied to the display unit 16, but the original video signal may be supplied as is to the display unit 16 for display. In this case, in the first control method of the drive unit, the display control unit 40 doubles the refresh rate of the original video signal, generates a video signal between pixels in the original video signal by image interpolation, and supplies the original video signal and the video signal generated by interpolation alternately to the display unit 16.

[0044] (Second control method of the drive unit) A second control method of the drive unit according to the embodiment will be described using Fig. 8. Fig. 8 is a diagram for explaining the second control method of the drive unit according to the embodiment. In the example shown in Fig. 8, components other than the display unit 16, drive unit 20a, and drive unit 20b are omitted. The second control method of the drive unit is a drive method used when the difference between the magnitude of the acceleration occurring in the display unit 16 and the magnitude of the acceleration occurring in the head of the user U is equal to or greater than one pixel.

[0045] In the second control method, as in the first control method, the drive control unit 42 controls the display unit 16 to vibrate at a frequency twice the refresh rate of the image displayed by the display control unit 40 on the display unit 16. Additionally, the drive control unit 42 controls the display unit 16 to improve resolution while eliminating parallax in the YZ plane, depending on the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the user U's head. For example, the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the user U's head is assumed to be 0.5 pixels horizontally and 2 pixels vertically. In this case, pixel shifting in the horizontal direction is unnecessary, so the operation of the drive unit 20b is stopped. Furthermore, the drive unit 20a is driven to shift the display unit 16 by 1.5 pixels vertically, in a direction that eliminates the 2-pixel shift. Driving in this manner makes the display unit 16 appear to the user to be shifted by 0.5 pixels horizontally and vertically. The display control unit 40 supplies the video signals that are shifted by 0.5 pixels in the horizontal and vertical directions to the display unit 16. As a result, the same effect as in the first control method is obtained.

[0046] (Video display method) The processing flow of the video display method according to the embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the processing flow of the video display method according to the embodiment.

[0047] The display control unit 40 controls the display unit 16 to display the video (step S10), and then the process proceeds to step S12.

[0048] The sensor control unit 44 controls the first sensor 22 to detect the acceleration occurring in the display unit 16 (step S12), and then the process proceeds to step S14.

[0049] The sensor control unit 44 controls the second sensor 24 to detect the acceleration occurring in the head of the user U (step S14). Then, the process proceeds to step S16.

[0050] The sensor control unit 44 acquires the detection results of the accelerations detected by the first sensor 22 and the second sensor 24 (step S16), and then proceeds to step S18.

[0051] The calculation unit 46 calculates the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U (step S18). Then, the process proceeds to step S20.

[0052] The calculation unit 46 determines whether the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U is equal to or greater than a predetermined value (step S20). If it is determined that the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U is equal to or greater than a predetermined value (step S20; Yes), the process proceeds to step S22. If it is determined that the difference between the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U is less than a predetermined value (step S20; No), the process proceeds to step S24.

[0053] If the determination in step S20 is Yes, the drive control unit 42 drives the drive unit 20 using the second control method to vibrate the display unit 16 (step S22), and then the process proceeds to step S26.

[0054] If the determination in step S20 is No, the drive control unit 42 drives the drive unit 20 using the first control method to vibrate the display unit 16 (step S24), and then the process proceeds to step S26.

[0055] The control unit 32 determines whether or not to end the process (step S26). The control unit 32 determines to end the process when, for example, the display of the video is to be ended or the power of the display device 12 is turned off. If it is determined to end the process (step S26; Yes), the process of Fig. 9 ends. If it is not determined to end the process (step S26; No), the process returns to step S10.

[0056] As described above, in this embodiment, pixel shifting is performed by vibrating the display unit based on the acceleration occurring on the display unit displaying the video and the acceleration occurring on the user's head, thereby enabling the generation of pseudo-high-resolution video from low-resolution video.

[0057] [Modification of the embodiment] A modified example of the embodiment will be described. In the embodiment, the pixel shift is performed by physically vibrating the display unit 16, and a pseudo-high resolution image is displayed, but the present disclosure is not limited to this. In the present disclosure, when the display unit 16 is vibrated, image processing may be performed on the image displayed on the display unit 16.

[0058] If the original image to be displayed on the display unit 16 has a resolution equal to or lower than that of the display unit 16, the display control unit 40 may perform upscaling processing on the image. The upscaling processing may be, for example, a general super-resolution processing. In this case, the drive control unit 42 vibrates the display unit 16 on which the upscaling processing has been performed, thereby shifting the pixels. This makes it possible to generate a pseudo-high-resolution image more appropriately.

[0059] If the original image displayed on the display unit 16 has a higher resolution than the display unit 16, the display control unit 40 may perform downscaling processing on the image. Alternatively, the display control unit 40 may increase the resolution of the image by stopping the reduction of the image, doubling the refresh rate, and alternately displaying the original image and an image shifted in accordance with the parallax calculated by the calculation unit 46.

[0060] The display control unit 40 may adjust the position of the image displayed on the display unit 16 based on the magnitude of the acceleration occurring on the display unit 16 and the magnitude of the acceleration occurring on the head of the user U. FIG. 10 is a diagram for explaining a method for adjusting the position of the image displayed on the display unit according to a modified example of the embodiment. For example, the display control unit 40 may shift the position at which the image is displayed by an amount corresponding to a shift caused by the drive control unit 42 vibrating the display unit 16. In the example shown in FIG. 10, the display control unit 40 may shift the entire image displayed on the display unit 16 in the direction indicated by the arrow 115. This reduces the sense of discomfort felt by the user viewing the artificially generated high-resolution image.

[0061] The display control unit 40 may determine the direction in which to shift the image displayed on the display unit 16 based on, for example, the magnitude of the acceleration occurring in the display unit 16 calculated by the calculation unit 46, the magnitude of the acceleration occurring in the head of the user U, and the magnitude of the tilt of the display unit 16 with respect to the ground detected by the first sensor 22. For example, when parallax occurs in the vertical direction, the display control unit 40 shifts the image displayed on the display unit 16 in the vertical direction to eliminate the parallax. For example, when parallax occurs in the horizontal direction, the display control unit 40 shifts the image displayed on the display unit 16 in the horizontal direction to eliminate the parallax.

[0062] For example, when a still image is displayed on the display unit 16, the display control unit 40 may sequentially display pixel-shifted still images at a refresh rate corresponding to the calculation result of the difference between the magnitude of acceleration occurring on the display unit 16 and the magnitude of acceleration occurring on the head of the user U, calculated by the calculation unit 46. For example, when the difference in the magnitude of acceleration between the display unit 16 and the head of the user U is equivalent to 100 pixels, the display control unit 40 may generate a pseudo-high-resolution image by drawing at 200 frames per second and alternating between even-numbered pixels and odd-numbered pixels of an image upscaled to double the resolution. In this case, the display control unit 40 may increase the number of frames per second, for example, as the difference in the magnitude of acceleration between the display unit 16 and the head of the user U increases. In this case, the display control unit 40 may use the original image without downscaling instead of the image upscaled to double the resolution.

[0063] For example, when a moving image is displayed on the display unit 16, the display control unit 40 may insert one or more interpolation images between the frame images that make up the moving image. The display control unit 40 can generate high-resolution video by displaying the moving image by inserting the interpolation images between the frame images.

[0064] The components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads and usage conditions. This distribution and integration configuration may also be performed dynamically.

[0065] Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0066] 12 Display device 14 Mounting part 16 Display section 18 Lenses 20 Drive unit 22 First sensor 24 Second sensor 26 Audio output section 28 Communications Department 30 Storage section 32 Control section 40 Display control unit 42 Drive control unit 44 Sensor control unit 46 Calculation section

Claims

1. A display device that is worn on a user's head while covering the user's eyes, a display unit disposed facing the user's eyes; a drive unit that drives the display unit in a surface direction; a display control unit that displays an image on the display unit; a drive control unit that controls the drive unit to vibrate the display unit in a plane direction of the display unit at a frequency twice the refresh rate of an image displayed by the display unit, and shifts the display unit by half the size of a pixel per frame; a display control unit that supplies an image signal corresponding to the amount of shift of the display unit by the drive control unit to the display unit; A display device comprising:

2. a first sensor for detecting acceleration occurring in the display unit; a second sensor that detects acceleration occurring in the user's head; a calculation unit that calculates a difference between the acceleration generated in the display unit and the acceleration generated in the user's head. The drive control unit When a difference between the acceleration generated on the display unit and the acceleration generated on the user's head is less than a predetermined value, the display unit is controlled to vibrate in a surface direction of the display unit at a frequency twice the refresh rate of an image displayed on the display unit, When the difference between the acceleration occurring on the display unit and the acceleration occurring on the user's head is equal to or greater than a predetermined value, the display unit is controlled to vibrate in a plane direction of the display unit at a frequency twice the refresh rate of the image displayed on the display unit, and the display unit is controlled to move so that the difference between the acceleration occurring on the display unit in the plane direction and the acceleration occurring on the user's head is half the size of a pixel. The display device according to claim 1 .

3. the display control unit adjusts a position of the image to be displayed on the display unit based on the acceleration generated on the display unit and the acceleration generated on the user's head.

3. The display device according to claim 1 or 2.

4. a step of displaying an image on a display unit disposed facing the user's eyes in a display device worn on the user's head while covering the user's eyes; controlling a drive unit to vibrate the display unit in a plane direction of the display unit at a frequency twice the refresh rate of an image displayed by the display unit, and shifting the display unit by half the size of a pixel per frame; including, how it is displayed.

5. a step of displaying an image on a display unit disposed facing the user's eyes in a display device worn on the user's head while covering the user's eyes; controlling a drive unit to vibrate the display unit in a plane direction of the display unit at a frequency twice the refresh rate of an image displayed by the display unit, and shifting the display unit by half the size of a pixel per frame; A program that causes a computer to execute the following.

Images