Virtual image display system for virtual reality and augmented reality devices

The MEMS-based virtual image display system dynamically adjusts light direction and frequency to expand FOV and resolution in head-mounted displays, addressing the limitations of existing technologies by optimizing pixel density for clearer images.

JP7582690B2Active Publication Date: 2024-11-13WOOMY INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022506646
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-09-30
Filing Date
2021-09-30
Publication Date
2024-11-13
Estimated Expiration
2041-09-30

AI Technical Summary

Technical Problem

Existing head-mounted display devices for virtual and augmented reality struggle to expand field of view (FOV) without compromising image resolution due to technical limitations of light emitters, resulting in less clear images when the FOV is widened.

Method used

A virtual image display system utilizing Micro-Electro-Mechanical Systems (MEMS) with light emitters and direction modifiers to dynamically adjust the optical direction and frequency of light signals, allowing for increased FOV and resolution by varying pixel density and scanning speed across different areas of the image frame.

Benefits of technology

The system achieves expanded FOV and resolution without pixel density degradation, ensuring clearer images by optimizing pixel density in central and peripheral areas through dynamic adjustments, enhancing the overall image quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007582690000002
    Figure 0007582690000002
  • Figure 0007582690000003
    Figure 0007582690000003
  • Figure 0007582690000004
    Figure 0007582690000004
Patent Text Reader

Abstract

A virtual image display system for displaying a virtual image with an expanded resolution and field of view is disclosed. The virtual image display system includes a first light emitter that emits a plurality of first light signals that are projected into the eye of a viewer, and a first light direction modifier that changes the light direction of the plurality of first light signals emitted from the first light emitter. The light direction of the first light signals is changed with respect to time within a first spatial range at a first scanning rate, where the first scanning rate is not constant, to display a first image frame using a predetermined number of light signals.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a virtual image display system for virtual reality and augmented reality devices, and more particularly to a virtual image display system capable of producing virtual images with enhanced resolution and field of view without sacrificing image quality of the virtual image. [Background technology]

[0002] Head-mounted display devices for virtual reality and augmented reality have become one of the important research and development fields in recent years. The demand for display devices with higher resolution, wider field of view, and wider viewing angle for the eyes has always been the main focus for the development of head-mounted display devices. A wider field of view enhances the sense of immersion and allows the user to perceive more image information. A larger viewing angle for the eyes allows the user to move their eyes arbitrarily during observation without losing sight of the image. Although various methods and systems have been proposed for expanding the field of view and viewing angle in head mounted display devices, due to technical limitations of the light emitters used in head mounted display devices, the image resolution cannot be easily expanded along with the expansion of the field of view and viewing angle of the head mounted display device. As a result, head mounted display devices that have a wider field of view and viewing angle for the eyes produce images with less clarity. Therefore, it may be desirable to have a virtual image display system with an expanded field of view and higher image resolution. Summary of the Invention [Means for solving the problem]

[0003] In one embodiment of the present invention, the present invention discloses a Micro-Electro-Mechanical System (MEMS) based virtual image display system to overcome the above-mentioned limitations. The virtual image display system comprises a first light emitter for emitting a plurality of first light signals projected into a first eye of a viewer, and a first light direction modifier for varying the light direction of the plurality of first light signals with respect to time at a scanning speed to form a first image frame. The first light emitter emits the plurality of first light signals as light pulses at a constant speed under normal conditions, or emits the plurality of first light pulses as light pulses at a varying frequency to adjust the number of first light signals per cross-sectional area at a predetermined area in the first image frame. The first image frame consists of a predetermined number of light signals. The first light direction modifier may rotate in a first coordinate plane or a second coordinate plane with respect to a rotation axis. The light direction of the plurality of first light signals is varied within a first spatial range related to a maximum spatial range or a maximum angle that the first light direction modifier can rotate in the first coordinate plane or the second coordinate plane. Rotation of the first light direction modifier causes the light directions of the plurality of first optical signals to change in the first coordinate or the second coordinate.

[0004] According to an embodiment, the first light direction modifier varies either the first coordinate component or the second coordinate component of the plurality of first light signals with respect to time at a non-constant scan rate. The frequency of light emission of the first light emitter may also be non-constant.

[0005] According to an embodiment, multiple MEMS mirrors are implemented in addition to one light emitter. The virtual image display system may include a first light emitter, a first light direction modifier, a third light direction modifier, and a first light switch. The first light emitter is used to emit a plurality of first light signals. The first light switch is capable of periodically redirecting a first portion of the first light signals toward the first light direction modifier during a first period of time, and then redirecting a second portion of the first light signals toward the third light direction modifier during a second period of time. The first light direction modifier and the third light direction modifier are implemented to change the light direction of the plurality of first light signals with respect to time to form a first image frame consisting of a predetermined number of light signals. The first light direction modifier changes the light direction of a first portion of the first light signal within a first spatial range during a first time period at a first scan rate, and the third light direction modifier changes the light direction of a second portion of the first light signal within a third spatial range during a second time period at a fifth scan rate to display a first image frame using a predetermined number of light signals.

[0006] In another embodiment of the present invention, the resolution and FOV may be expanded by using multiple light emitters in addition to one MEMS mirror. The virtual image display system may include a first light emitter and a third light emitter for emitting a plurality of first light signals and a plurality of third light signals, respectively, to a first eye of one viewer to form a first image frame. The first light emitter and the third light emitter may each be an LBS projector. The FOV is expanded by using one light direction modifier. The plurality of first light signals obtained from the first light signal emitter and the plurality of third light signals obtained from the third light emitter are each projected onto the first light direction modifier. The light directions of the plurality of first light signals are changed at a first scanning speed within a first spatial range, and the light directions of the plurality of third light signals are changed at the first scanning speed within a third spatial range as well. In this embodiment, the first spatial range is equal to a third spatial range, which is the maximum spatial range or maximum angle that the first light direction modifier can rotate.

[0007] In another variation of this embodiment, an optical assembly may be disposed between the light emitter and the coupler to vary a predetermined cross-sectional area of ​​the optical paths of the plurality of first optical signals. Specifically, an optical assembly including a lens may be implemented to change the optical paths of the plurality of first optical signals from the first light emitter to the first coupler to change the projected area or cross-sectional size of each of the plurality of first optical signals.

[0008] In some embodiments, a pixel in the first image frame and a corresponding pixel in the second image frame form a binocular virtual image pixel at a first depth related to a first angle between the first light signal and the second light signal projecting into the viewer's eye.

[0009] In a variation of any one of the preceding embodiments, the head mounted display may include an integrated combiner replacing the first combiner and the second combiner for reflecting the light signals to the viewer's eyes, respectively. The head mounted display may include a pair of virtual image display systems for both eyes. The virtual image display systems may be any of the virtual image display systems briefly described above. The left virtual image display system may be responsible for generating the image frame to the second eye, and the right virtual image display system may be responsible for generating the image frame to the first eye. However, in one example, the left virtual image display system may be responsible for generating the image frame to the first eye, and the right virtual image display system may be responsible for generating the image frame to the second eye.

[0010] The present embodiment may be applied to a support structure such as a head mounted display for virtual reality and augmented reality devices. In this case, a virtual image display system is provided to both eyes of a viewer. A first light signal forming a pixel on a first image frame and a corresponding second light signal forming a pixel on a second image frame are perceived by the first and second eyes of the viewer to form a binocular virtual image pixel at a first depth. The first depth is related to a first angle between the first and second light signals projecting into the viewer's eyes. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic diagram of a virtual image display system according to a first embodiment of the present invention; [Diagram 2] 2 is a schematic diagram of central and peripheral areas of an image frame according to the present invention; [Diagram 3] FIG. 2 is an operational schematic diagram of the virtual image display system according to the first embodiment of the present invention. [Figure 4] FIG. 2 is an operational schematic diagram of the virtual image display system according to the first embodiment of the present invention. [Figure 5a] FIG. 2 is an operational schematic diagram of the virtual image display system according to the first embodiment of the present invention. [Figure 5b] FIG. 2 is an operational schematic diagram of the virtual image display system according to the first embodiment of the present invention. [Figure 6] 1 is a schematic diagram of a head mounted display according to a variant embodiment of the present invention. [Figure 7] 1 is a schematic diagram of another head mounted display according to a variant of an embodiment of the present invention. [Figure 8a] FIG. 4 is a schematic diagram of a virtual image display system according to a second embodiment of the present invention. [Figure 8b] FIG. 4 is a schematic diagram of a virtual image display system according to a variant of the second embodiment of the present invention. [Figure 9] FIG. 11 is a schematic diagram of a virtual image display system according to a third embodiment of the present invention. [Figure 10] 1 is a schematic diagram of a virtual image display system according to a variant of an embodiment of the present invention. [Figure 11] 1 is a schematic diagram of an optical assembly according to a variation of an embodiment of the present invention. [Figure 12a] FIG. 2 is a schematic diagram for describing a method for displaying binocular virtual image pixels at a first depth according to the present invention; [Figure 12b] FIG. 2 is another schematic diagram for describing a method for displaying binocular virtual image pixels at a first depth according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The terminology used in the description presented below is intended to be interpreted in its broadest reasonable manner, even though it is used in connection with a detailed description of certain specific embodiments of the technology. Certain terms may be highlighted below, but any terminology that is intended to be interpreted in any restrictive manner is specifically defined as such in this "Description of the Preferred Embodiments" section.

[0013] The present invention relates to a system and method for enhancing the resolution and field of view (FOV) of a virtual image with depth perception produced by a virtual image display system for a virtual reality or augmented reality device. The present invention is capable of producing a virtual image with higher resolution and wider FOV compared to the prior art without sacrificing the pixel density of the virtual image. As a result, the quality of the virtual image produced according to the present invention may be superior compared to the prior art.

[0014] The light direction modifier referred to in this invention refers to a mechanical or optical element that can dynamically change the direction of light emitted by the light emitter with respect to time. It can be, for example, but not limited to, a microelectromechanical system (MEMS) mirror. A typical MEMS mirror may be able to change the light direction in one axis or two separate axes (2D MEMS mirror). As an example, a 2D MEMS mirror may be able to rapidly deflect a laser beam up to an optical scanning angle of approximately 30° in both axes. However, the maximum scanning angle in one axis (the primary scanning axis) may be larger than the other axis. MEMS mirror technology is very versatile and can be applied to various applications such as projection display devices, 3D scanning, and laser marking. The principle for driving the movement of the MEMS mirror can be provided by various physical principles, examples of which may be electromagnetic, electrostatic, thermoelectric, and piezoelectric effects. Each of the physical principles for driving the MEMS mirror may exhibit different advantages or disadvantages. The pivoting frequency or the pivoting amplitude of the MEMS mirror may be controlled by applying different frequency and amplitude driving voltages / electromagnetic fields to the MEMS mirror, respectively, which are readily and widely known in the art.

[0015] It should be noted that the phrase "scanning speed" referred to in this disclosure refers to the "swing frequency" of the MEMS mirror, which is related to the frequency of harmonic vibration of the MEMS mirror. The phrases "scanning speed" and "swing frequency" may be used interchangeably in this disclosure, and both of these phrases relate to the amount of spatial displacement in units of time. The phrases "first eye" and "second eye" referred to in this disclosure refer to the two eyes of a user. In general, "first eye" and "second eye" may refer to the right and left eyes of a viewer, respectively, or "first eye" and "second eye" may refer to the left and right eyes of a viewer, respectively.

[0016] It is worth mentioning that different coordinate systems may be used to represent the light direction, spatial extent, or displacement of the element or device disclosed in the present invention. For example, the coordinate system may be X and Y coordinate components in a Cartesian coordinate system, or θ and φ coordinate components in a polar coordinate system. The X or θ coordinate may be expressed as the first coordinate component, and the Y or φ may be expressed as the second coordinate component. In some cases, the X or θ coordinate may be expressed as the second coordinate component, and the Y or φ may be expressed as the first coordinate component.

[0017] With reference to Figure 1, the following embodiments disclose a MEMS-based virtual image display system capable of producing virtual images with increased resolution and FOV while maintaining image quality. The MEMS mirror in this embodiment may be a two-dimensional MEMS. In this embodiment, the frequency at which the light emitter produces each light signal (pixel) of the image and / or the vertical / horizontal scanning speed of the light signals are manipulated to compensate for pixel density degradation when the FOV of the image frame is enlarged. The virtual image display system comprises a first light emitter 10 for emitting a plurality of first light signals 1000 to be projected into a first eye 50 of a viewer, and a first light direction modifier 100 for changing the light direction of the plurality of first light signals 1000 with respect to time at a scanning speed to form a first image frame F1. For example, the first light emitter 10 may be a laser beam generator, such as a laser beam scanner (LBS) projector. The first light emitter 10 emits multiple first light signals 1000 as light pulses at a constant rate under normal conditions, or emits multiple first light signals 1000 as light pulses at a variable frequency to adjust the number of first light signals 1000 per cross-sectional area (corresponding to the pixel density) within a given area in the first image frame F1. The first light frame F1 consists of a predetermined number of light signals. Each of the light signals may represent a pixel on the first image frame F1. During the formation of the first image frame F1, the first light direction modifier 100 may rotate in a first coordinate plane (e.g., horizontal plane) or a second coordinate plane (e.g., vertical plane) with respect to the rotation axis. The light directions of the plurality of first light signals 1000 are changed within a first spatial range SR1, which is related to the maximum spatial range or maximum angle that the first light direction modifier 100 can rotate in the first coordinate plane or the second coordinate plane. The rotation of the first light direction modifier 100 causes the light directions of the plurality of first light signals 1000 to change in a first coordinate (e.g., horizontal coordinate) or a second coordinate (e.g., vertical coordinate) depending on the setting.

[0018] According to this embodiment, the first light direction modifier 100 changes either the first coordinate component or the second coordinate component of the plurality of first light signals 1000 with respect to time at a non-constant scanning speed. The frequency of the light emission of the first light emitter 10 may also not be constant. The idea behind this embodiment is that when the human eye looks at a target object, the visual axis of the eye is directed to the target object, and the image of the target object will be concentrated on the macula of the eye (the most sensitive part of the retina), so that the target object appears to be in the central area C of vision. With respect to the target object in the image, other parts of the image may be less clear because they may be projected on other parts of the retina that are less sensitive to light. Based on the above-mentioned nature of human vision, the virtual image display system according to the present embodiment aims to provide a higher pixel density in the central part of the image frame relative to the peripheral area P of the image frame, so that the user of the present invention can see the symmetric object (clearer image) with a higher pixel density, whereas the image in the peripheral area P does not need to be as clear as the target object in the central area C, since the human eye cannot perceive a higher quality image in the peripheral area P anyway. The number of light signals (or pixels) in the central area C is manipulated by changing the scanning speed and / or frequency of the light emission of the first light emitter 10 in the central area C. By implementing this method, with limited hardware capabilities, the user of the present invention can still see the first image frame F1 with an expanded FOV without feeling pixel density degradation when viewing the virtual target object.

[0019] 1-4. Under normal conditions (when the scanning speed is the default speed), the first light emitter 10 and the first light direction modifier 100 may form a first image frame F1 with a default resolution (e.g., 1280×720 pixels) within a first spatial range SR1 (e.g., 40° horizontally and 22.5° vertically). It is worth mentioning that the spatial range referred to in this disclosure represents the range of both the first coordinate component and the second coordinate component, which may be expressed in two coordinates. In this embodiment, the first spatial range SR1 corresponds to the FOV of the first eye 50. To compensate for pixel density degradation when expanding the FOV (e.g., expanding the spatial range from 40° to 60° in the horizontal direction), the first image frame F1 is divided into a peripheral area P and a central area C. The central area C of the image frame is provided with a higher pixel density (more light signals in a unit area) relative to the peripheral area P. As an example, the central area C in both coordinate components may be set as 10° in the FOV in both coordinate components, and the peripheral areas P on both sides may be set as 15° in the FOV.

[0020] In the following, a method for increasing the number of light signals (or pixels) in the central area C by changing the frequency of light emission of the first light emitter 10 in the central area C is described. The image information within the central area C is produced at a higher projection frequency of the first light emitter 10 (e.g., 10 ns / pixel, based on the default frequency) to obtain a larger number of light signals, which are converted to a higher resolution. The image information within the peripheral area P can be produced at the default projection frequency of the first light emitter (e.g., 40 ns / pixel). As a result, the pixel density of the central area C and the peripheral area P in the first image frame F1 is not uniform.

[0021] Below, the steps of varying the number of light signals (or pixels) in the central area C by manipulating the scan speed of the first light emitter 10 in the central area C will be described. Specifically, the first and second coordinate components of the optical direction of the first optical signal 1000 are changed with respect to time at a first scanning speed and a second scanning speed, respectively, within the first spatial range SR1 to display the first image frame F1. In some embodiments, the first scanning speed or the second scanning speed may not be constant. In some other embodiments, neither the first scanning speed nor the second scanning speed may be constant. As an example, the scanning speed of the second coordinate component of the MEMS mirror can be reduced while moving through the central area C of the first image frame F1, and the projection frequency of the optical emitter is kept the same, so that a higher density of pixels or a larger number of optical signals can be projected within the central area C within a certain period of time (see FIG. 2).

[0022] See Figure 3. The following example illustrates one specific example of an embodiment that varies the scan speed of a MEMS mirror in one coordinate component (eg, the vertical direction).

[0023] The total FOV in the vertical direction is 40°, the central zone C is set to be 10° within the central zone C, and the target visual activity (VA) is 2.0.

[0024] The total number of pixels required for VA2.0 in central area C is 60p x 2 x 10 = 1200 pixels (almost 4 times the original number of pixels for VA=0.5) where 60 is the number of pixels at 1° of FOV required for VA=1.0.

[0025] For the remainder of the FOV (the peripheral FOV), the pixel density remains the same as it was initially. The total number of pixels in the peripheral FOV is now: 1280×30 / 40=960 pixels VA=960 / 30 / 60=0.53 It is.

[0026] The scanning speed of the MEMS mirror in other coordinate components (e.g., horizontal direction) can also be modified to increase the number of first optical signals 1000 per cross-sectional area. As an example, the scanning speed of the MEMS mirror in other coordinate components can be reduced by a factor of 2 to increase the number of pixels, e.g., from 720 pixels to 1440 pixels.

[0027] See Fig. 4. In the following, another method is disclosed for changing the pixel density or resolution of the first image frame F1 in one direction without changing the scan speed. The number of pixels in the peripheral FOV can be reduced by only emitting light signals at certain vertical positions (e.g., stopping light emission for some rows of the image frame in the vertical component). The following example illustrates one possible implementation of reducing the rotation speed of the MEMS mirror by a factor of 4 at a constant speed in the vertical direction to increase the vertical pixel density / resolution.

[0028] The total FOV in the vertical direction is 30°, the central zone C is set to be 10° within the total FOV, and the target VA is 2.0.

[0029] The total number of pixels required for VA2.0 in the central FOV is: 60 x 2 x 10 = 1200 pixels (compared to the original 320 pixels for VA0.5, which is almost 4 times the original density) This means that the total number of pixels must contain 1200 pixels for every 10° of the FOV.

[0030] If the scanning speed of the MEMS mirror in the vertical direction needs to be constant, then each peripheral FOV also contains 1200 vertical pixels (or 1200 lines of 1280×1 pixels). If the light emitter projects a light signal only on every fourth line, then the total number of lines projected within the peripheral area P is 1200 / 4=300 lines, therefore, VA = (300 / 10) / 60 = 0.5 It is.

[0031] To achieve 1200 lines per 10°, the scanning speed of the MEMS mirror in the vertical direction needs to be slower than the initial speed for VA0.5.

[0032] In the central region C, the light emitter emits a light signal while moving in both the positive and negative directions, whereas in the peripheral region P, the light emitter emits a light signal only while moving in either the positive or negative direction.

[0033] Further referring to Figures 5a and 5b, the central area C and peripheral area P of a first image frame F1 of another embodiment are shown. The central area C is represented by area A5, whereas the peripheral area P is represented by a combination of areas A1, A2, A3, A4, A6, A7, A8, and A9. During the formation of the first image frame F1, the first light direction modifier 100 simultaneously rotates to change the projection direction of the first light emitter 10 to create the first image frame F1 in a row-by-row or column-by-column manner. In detail, the first light emitter 10 creates a first image frame F1 by projecting one pixel of the image at a time, and the first light direction modifier 100 then redirects the first light signal 1000 to create another pixel of the image at a new location, often immediately next to the previous pixel in the image in the horizontal or vertical direction. Thus, after a period of time, the first light emitter 10 creates a row or column of pixel images (e.g., 1280×1 or 1×720). The first light direction modifier 100 then redirects the first light signal 1000 to the next row or column, and continues to create a second row or column of pixel images. This process is repeated until a complete image frame is created (e.g., completing a 1280×720 pixel image).

[0034] In this example, the pixels in the regions A1-A3 are completed first, followed by the pixels in the regions A4-A6, and finally the pixels in the regions A7-A9. As an example, the default resolution of the image frame may be 1280x720 pixels. When creating the pixels in the regions A1-A3, both the projection frequency of the first light emitter 10 in the column direction (or Y direction) and the scanning speed of the first light direction corrector 100 remain at default values. However, when the pixels within the regions A4-A6 are created, the scanning speed of the first light direction corrector 100 in the column direction (or Y direction) is reduced (e.g., 1 / 2 times the default value). It should be noted that since the projection frequency of the first light emitter 10 increases only when creating pixels within the region A5 (e.g., twice the default value), the number of light signals (pixels) in both the row direction and the column direction increases only within the region A5 (e.g., 2x2 times the default value). In other words, the number of optical signals within a unit cross-sectional area is greatest in region A5 (which means that the pixel density is highest, ie, four times that of regions A1-A3 and A7-A9). In regions A4 and A6, only the number of pixels in the column direction is increased (e.g., twice the default value). While producing pixels in regions A7-A9, the projection frequency of the first light emitter 10 in the column direction as well as the scanning speed of the first light direction corrector 100 return to default values. As a result, region A5 (central region C) has the highest number of pixels, A4 and A6 have the second highest number of pixels, and regions A1-A3 and A7-A9 have the default number of pixels. A viewer of the first image frame F1 can see the best optical image when looking at the central region of the first image frame F1.

[0035] In short, in this embodiment, a first scanning speed of the MEMS mirror in a first component direction (e.g., horizontal direction) and a second scanning speed of the MEMS mirror in a second component direction (e.g., vertical direction) are varied according to the horizontal position and the horizontal position. While emitting an image in the central area C, the projection frequency can be increased and / or the scanning speed of the MEMS mirror can be reduced in both the horizontal and vertical directions so that a higher density of pixels or image information can be projected in the central area C in a unit time (and thus the VA in the central area C can be increased). The projection frequency and / or the scanning speed of the MEMS mirror in both directions can return to normal in the peripheral area P.

[0036] Please refer to Fig. 6 and Fig. 7. This embodiment may be applied to a support structure such as a head-mounted display for virtual reality devices and augmented reality devices. In this case, the virtual image display system may include a first combiner 210 provided to both eyes of a viewer and redirecting a plurality of first light signals 1000 to focus on the first eye 50 of the viewer. In addition, the virtual image display system may further include a second light emitter 30 emitting a plurality of second light signals 3000 to be projected into the second eye 60 of the viewer, a second light direction corrector 300 changing the light direction of the plurality of second light signals 3000, and a second combiner 410 changing the direction of the plurality of second light signals 3000 to focus on the second eye 60 of the viewer. The light direction of the second light signal is changed in time at a third scanning speed within the second spatial range SR2 to display the second image frame F2 using a predetermined number of light signals. The third scanning speed may be constant or non-constant. In this embodiment, the first light signal forming a pixel on the first image frame F1 and the corresponding second light signal forming a pixel on the second frame image F2 are perceived by the first eye 50 and the second eye 60 of the viewer to form a binocular virtual image pixel at a first depth. And the first depth is related to a first angle between the first light signal 1000 and the second light signal 3000 projecting into the viewer's eyes.

[0037] The following embodiment discloses yet another MEMS-based light emission system for increasing the resolution of an image with an enlarged resolution and FOV. The resolution and FOV may be enlarged by using multiple light emitters in addition to one MEMS mirror, as shown in Fig. 8a and Fig. 8b. The virtual image display system may include a first light emitter 10 and a third light emitter 20 for emitting a plurality of first light signals 1000 and a plurality of third light signals 2000, respectively, to a first eye 50 of a viewer to form a first image frame F1. The first light emitter 10 and the third light emitter 20 may each be an LBS projector. The FOV is enlarged by using one light direction modifier, as illustrated in Fig. 9. The multiple first optical signals 1000 obtained from the first optical signal emitter 10 and the multiple third optical signals 2000 obtained from the third optical emitter 20 are respectively projected onto the first light direction modifier 100. In one example, optionally, the maximum angle between the multiple first optical signals 1000 and the multiple third optical signals 2000 reflected by the first light direction modifier 100 may be set as twice the maximum scanning angle of the first light direction modifier (which is the maximum spatial range or maximum angle that the light direction modifier can rotate). The first light direction modifier 100 simultaneously changes the optical directions of the multiple first optical signals 1000 and the multiple third optical signals 2000 in time to form a first image frame F1 consisting of a predetermined number of optical signals (e.g., 2560×720 pixels). The light directions of the plurality of first optical signals 1000 are changed at a first scanning speed within a first spatial range SR1, and the light directions of the plurality of third optical signals 2000 are changed at a first scanning speed within a third spatial range as well. In this embodiment, the first spatial range SR1 is equal to a third spatial range SR3, which is the maximum spatial range or maximum angle that the first light direction modifier 100 can rotate. As a result, the final scanning angle is substantially the sum of the first spatial range SR1 and the third spatial range SR3.

[0038] The first image frame F1 comprises a first image portion IP1 and a second image portion IP2. The content of the first image portion IP1 is different from the content of the second image portion IP2. During the rotation of the first light direction modifier 100, the first light direction modifier 100 changes the light direction of a plurality of first light signals 1000 with respect to time to form the first image portion IP1, the first image portion IP1 having a first number of light signals. At the same moment, the first light direction modifier 100 changes the light direction of a plurality of third light signals 2000 with respect to time to form the second image portion IP2, the second image portion IP2 having a second number of light signals. The first image portion IP1 and the second image portion IP2 are formed simultaneously. The first image portion IP1 and the second image portion IP2 represent different portions of the first image frame F1. The predetermined number of light signals (number of pixels of the first image frame F1) is generally equal to the sum of the first number of light signals (or pixels) and the second number of light signals (or pixels). However, in some embodiments, the first image portion IP1 may partially overlap with the second image portion IP2, so that the number of light signals (or pixels) of the first image frame F1 may be less than the sum of the first number of pixels and the second number of pixels.

[0039] As an example (referring to FIG. 8a), at the beginning of operation, the first light direction modifier 100 may be positioned at an angle where the incidence angle of the plurality of first optical signals 1000 is 45° and the incidence angle of the plurality of third optical signals 2000 is 5°. The light direction modifier rotates from end to end at both end positions to its maximum scanning angle (the maximum spatial range or maximum angle the light direction modifier can rotate) to complete the scanning movement in the direction of the first coordinate (e.g., horizontal coordinate). As shown in FIG. 8a, in one example, when the light direction modifier rotates to the maximum rotation angle, the incidence angle of the plurality of first light signals 1000 is 65°, and the incidence angle of the plurality of third light signals 2000 is 25°. As shown in this embodiment, each of the light emitters projects a portion of the first image frame F1 (i.e., the first image portion IP1 and the second image portion IP2), so that the combination of the images projected by the first light emitter 10 and the third light emitter 20 forms the first image frame F1. In the example provided herein, the final total scanning angle is doubled, and as a result, the FOV is expanded by a factor of two with respect to the initial FOV. The image resolution is also increased. Additionally, the number of pixels per degree of angle is maintained.

[0040] It should be noted that during the formation of the first image frame F1, the first light direction modifier 100 may rotate in a first coordinate plane or a second coordinate plane with respect to the rotation axis. The rotation of the first light direction modifier 100 causes the light directions of the plurality of first light signals 1000 and the plurality of third light signals 2000 to change in a first coordinate (e.g., vertical coordinate) or in a second coordinate (e.g., horizontal coordinate) depending on the setting. In this embodiment, the first spatial range SR1 and the third spatial range SR3 each have a first coordinate component and a third coordinate component. According to this embodiment, the first light direction modifier 100 simultaneously changes the first coordinate components of the plurality of first light signals 1000 and the plurality of third light signals 2000 with respect to time, or simultaneously changes the second coordinate components of the plurality of first light signals 1000 and the plurality of third light signals 2000 with respect to time, so that the first image portion IP1 and the second image portion IP2 are projected simultaneously to form the complete first image frame F1. Referring again to Fig. 9, it should be noted that the first spatial range SR1 borders the third spatial range with respect to the first coordinate component or the second coordinate component (meaning that IP1 and IP2 may border each other or be vertically or horizontally adjacent to each other). However, as already mentioned, in some cases, the first image portion IP1 and the second image portion IP2 may overlap, making the first spatial range SR1 overlap the third spatial range for image stitching in either the first coordinate component or the second coordinate component.

[0041] According to a variant of this embodiment, the first image frame F1 may also be divided into a peripheral area P and a central area C. The central area C of the first image frame F1 comprises a larger number of light signals (higher pixel density) per cross-sectional area relative to the peripheral area P. To achieve a different number of light signals per cross-sectional area, the scanning speed may not be constant, similar to the previous embodiment. According to another variant of this embodiment, the first and second coordinate components of the light directions of the first and third light signals 1000 and 2000 are respectively changed with a first scanning speed and a second scanning speed in time within the first spatial range SR1 and the third spatial range SR3, with the second scanning speed being not constant, similar to the previous embodiment, in order to adjust the number of light signals per cross-sectional area in a given area in the first image frame F1.

[0042] In yet another variation of this embodiment, similar to the preceding embodiment, the first light emitter 10 emits a plurality of first light signals 1000 as light pulses at a variable frequency, or the third light emitter 20 emits a plurality of third light signals 2000 as light pulses at a variable frequency, to adjust the number of light signals per cross-sectional area of ​​a given area within the first image frame F1.

[0043] Similar to the previous embodiment, this embodiment may be applied to a support structure such as a head mounted display for virtual and augmented reality devices (as shown in FIG. 8b), in which case the virtual image display system may comprise a first combiner 210 provided to both eyes of a viewer and adapted to redirect and focus a plurality of first optical signals 1000 and a plurality of third optical signals 2000 to a first eye 50 of the viewer. In addition, the virtual image display system may further include a first light emitter 10 emitting a plurality of first light signals 1000 projected into the first eye 50 of the viewer, a third light emitter 20 emitting a plurality of third light signals 2000 projected into the first eye 50 of the viewer, a first light direction modifier 100 for changing the light direction of the light signals emitted by the first light emitter 10 and the third light emitter 20, a second light emitter 30 emitting a plurality of second light signals 3000 projected into the second eye 60 of the viewer, and a fourth light emitter 40 emitting a plurality of fourth light signals 4000 projected into the second eye 60 of the viewer. In this case, in addition to the first light direction modifier, a second light direction modifier 300 is provided for simultaneously changing the light directions of the plurality of second light signals 3000 within a second spatial range SR2 and the plurality of fourth light signals within a fourth spatial range at a third scanning speed, respectively, to display a second image frame F2 using a predetermined number of lights, and a second light combiner 410 is provided for redirecting the plurality of second light signals 3000 and the fourth light signal 4000 to focus them on the second eye 60 of the viewer. When a virtual image display system is provided to both eyes of a viewer, the viewer can perceive that the first and third light signals forming pixels on a first image frame F1 and the corresponding second and fourth light signals forming pixels on a second image frame F2 display binocular image pixels at a first depth, the first depth being related to a first angle between the first or third light signal and the corresponding second or fourth light signal projected into the first eye 50 of the viewer.

[0044] In the following embodiment, another MEMS-based light emitting system is disclosed to overcome the limitations of the prior art already mentioned. In this embodiment, multiple MEMS mirrors are implemented in addition to one light emitter. As shown in FIG. 9, the virtual image display system may include a first light emitter 10 (e.g., a laser beam splitting projector / LBS projector), a first light direction modifier 100, a third light direction modifier 500, and a first light switch 90.

[0045] The first optical switch 90 is a type of beam splitter that can dynamically control the amount of light exiting the beam splitter in different directions. A typical beam splitter can split a light beam into two or more components, each of which travels a different path through the beam splitter and exits the beam splitter in a different direction. The first optical switch 90 described herein may refer to a dynamic beam splitter that can dynamically control the amplitude of the components exiting the beam splitter in each direction. In one example, an optical switch according to the present invention may comprise a liquid crystal that blocks a light beam of a first polarity while allowing light of a second polarity to pass through. During another period, the phase of the liquid crystal may be changed to allow a light beam of a first polarity to pass while blocking a light beam of a second polarity. It should be noted that the light beam may have a uniform polarity and therefore can be completely blocked or allowed to pass depending on the phase of the liquid crystal in the optical switch. The operation of the first optical switch 90 may be controlled by a voltage or an electromagnetic field.

[0046] In this embodiment, the first light emitter 10 is used to emit a plurality of first light signals. The first light switch 90 can periodically redirect a first portion of the first light signal 1000 towards the first light direction modifier 100 during a first period, and then redirect a second portion of the first light signal 1000 towards the third light direction modifier 500 during a second period. The first light direction modifier 100 and the third light direction modifier 500 are implemented to change the light direction of the plurality of first light signals 1000 with respect to time to form a first image frame F1 consisting of a predetermined number of light signals (or pixels). More specifically, to display a first image frame F1 using a predetermined number of optical signals, the first light direction modifier 100 changes the light direction of a first portion of the first optical signal 1000 in a first spatial range SR1 during a first period at a first scan rate, and the third light direction modifier 500 changes the light direction of a second portion of the first optical signal 1000 in a third spatial range SR3 during a second period at a fifth scan rate. As an example, the first light direction modifier 100 and the third light direction modifier 500 may each be a MEMS mirror. And the first optical switch 90 is controlled by an electronic voltage.

[0047] As illustrated in Fig. 9, the first optical switch 90 is inserted in line between the first light emitter 10 and the two light direction modifiers. The first optical switch 90 can be switched between a non-transmitting mode and a transmitting mode for the two light direction modifiers to respectively allow the first optical signal 1000 to pass through one of the two light direction modifiers or to reflect the first optical signal 1000 to one of the two light direction modifiers. As an example, the first optical switch 90 can be controlled by an application-specific integrated circuit (ASIC) to redirect a first portion of the first optical signal 1000 toward the first optical direction modifier 100 while redirecting a second portion of the first optical signal 1000 toward the third optical direction modifier 500 (or blocking a second portion of the first optical signal 1000).

[0048] The first light emitter 10 creates a first image frame F1 consisting of a predetermined number of light signals by dividing the first image frame F1 into a number of image parts, and then projects each of the image parts simultaneously. For example, a first image frame F1 of 2560x720 pixels is divided into two image parts of 1280x720, namely a first image part IP1 and a second image part IP2. In this embodiment, a first part of the first signal 1000 forms the first image part IP1 of the first image frame F1, which has a first number of light signals (e.g., 1280x720 light signals). A second part of the first signal 1000 forms the second image part IP2 of the first image frame F1, which has a second number of light signals (e.g., 1280x720 light signals). During the formation of the first image frame F1, a plurality of first optical signals 1000 corresponding to the first row of the first image portion IP1 (1280 x 1 pixels) pass through the first optical switch 90 and are reflected by the first optical direction corrector. After finishing the emission of the first row of the first image portion IP1, the first light switch 90 allows the first row of the second image portion IP2 (also 1280x720 pixels) to be reflected by the third light direction modifier 500 to create the first row of the second image portion IP2. Meanwhile, the first light direction modifier 100 returns to the starting position. When the third light direction modifier 500 finishes the emission of the first row of the second image portion IP2, the first row of the first image frame F1 (total of 2560x1 pixels) is drawn, and the first light switch 90 switches back to the transmission mode for the first light direction modifier 100 to enable the emission of the second row of the first image portion IP1. The first row of the first image frame F1 is formed simultaneously by the first light direction modifier 100 and the third light direction modifier 500. The third light direction modifier 500 then returns to the starting position for the next scan. As a result, the first optical switch 90 is controlled to switch between a transparent mode and a non-transparent mode to emit the first image frame F1 in a row-by-row manner (or equivalently in a column-by-column manner) until the complete first image frame F1 (2560 pixels x 720 lines) is rendered.

[0049] It should be noted that during the formation of the first image frame F1, the first light direction modifier 100 and the third light direction modifier 500 may rotate with respect to their corresponding rotation axes in a first coordinate component or a second coordinate component (e.g., a horizontal component or a vertical component). For example, the rotation of the first light direction modifier 100 and the third light direction modifier 500 causes the light directions of the plurality of first light signals 1000 to change in the vertical coordinate or the horizontal coordinate depending on the setting. The first light direction modifier 100 changes the light direction of the plurality of first light signals 1000 in a first spatial range SR1, and the third light direction modifier 500 changes the light direction of the plurality of first light signals 1000 in a third spatial range SR3. The first spatial range SR1 and the third spatial range SR3 are related to the rotation angles of the first light direction modifier 100 and the third light direction modifier 500, respectively. Each of the first spatial range SR1 and the third spatial range SR3 may be represented by a first coordinate component and a third coordinate component.

[0050] In short, according to this embodiment, the first light direction corrector 100 and the third light direction corrector 500 simultaneously change the first coordinate component with respect to time or simultaneously change the second coordinate component with respect to time, whereby the first image portion IP1 and the second image portion IP2 are projected simultaneously in a row-by-row or column-by-column manner to form a complete first image frame F1.

[0051] Furthermore, it is worth mentioning that the content of the first image portion IP1 is different from the content of the second image portion IP2, which means that the first image portion IP1 and the second image portion IP2 represent different portions of the first image frame F1: the first image portion IP1 has a first number of optical signals and the second image portion IP2 has a second number of optical signals. When the first spatial range SR1 borders the third spatial range in the first coordinate component or the second image component (meaning that IP1 and IP2 may border each other vertically or horizontally or may be near each other), the predetermined number of optical signals (the number of pixels of the first image frame F1) is generally equal to the sum of the first number of optical signals and the second number of optical signals. However, in some embodiments, when the first spatial range SR1 partially overlaps with the third spatial range due to image stitching in either the first coordinate component or the second coordinate component, the number of pixels of the first image frame F1 may be less than the sum of the first number of optical signals and the second number of optical signals. In the examples provided herein, the final total scanning angle is increased, and as a result, the FOV expands with respect to the initial FOV. Meanwhile, the image resolution is also increased. More importantly, the number of pixels per degree of angle (or the number of optical signals per cross-sectional area) is maintained.

[0052] According to a variant of this embodiment, the first image frame F1 may also be divided into a peripheral area P and a central area C. The central area C of the first image frame F1 comprises a larger number of light signals (higher pixel density) per cross-sectional area relative to the peripheral area P. To achieve a different number of light signals per cross-sectional area, the first scanning speed (scanning speed relative to the rotation axis) or the fifth scanning speed may not be constant. In particular, to collectively display the first image frame F1 with a predetermined number of light signals, a first coordinate component of the light direction of the first light signal 1000 is changed with respect to time in the first spatial range SR1 and the third spatial range SR3 at a first scanning speed and a fifth scanning speed, and a second coordinate component of the light direction of the first light signal 1000 is changed with respect to time in the first spatial range SR1 and the third spatial range SR3 at a second scanning speed and a sixth scanning speed, where the second scanning speed or the sixth scanning speed is not constant. The first light direction modifier 100 may also change either the first scan speed or the fifth scan speed to adjust the number of light signals per cross-sectional area within a given area within the first image frame F1.

[0053] In yet another variation of this embodiment, similar to the preceding embodiment, the first light emitter 10 emits a plurality of first light signals 1000 as light pulses during a first period or a second period at a variable frequency to adjust the number of light signals per unit area of ​​a given area in the first image frame F1. Furthermore, when applying this embodiment to a head mounted display for virtual reality and augmented reality devices, the head mounted display may include a second set of virtual image display systems for producing a second image frame F2 to another eye of the viewer.

[0054] In a variant of any one of the preceding embodiments, the head mounted display may include an integrated combiner 700 replacing the first combiner 210 and the second combiner 410 for reflecting light signals to the viewer's eyes, respectively. The head mounted display may include a pair of virtual image display systems for both eyes. The virtual image display systems may be any of the virtual image display systems briefly described above. The left virtual image display system (e.g., the second light direction corrector 30 or the fourth light emitter 40) may be responsible for creating an image frame to the second eye 60 (e.g., the left eye), and the right virtual image display system (e.g., the first light emitter 10 or the third light emitter 20) may be responsible for creating an image frame to the first eye 50 (e.g., the right eye). However, in one example (with reference to FIG. 10 ), the left virtual image display system (e.g., the second light emitter 30 or the fourth light emitter 40) may be responsible for creating an image frame to the first eye 50 (e.g., the right eye), and the right virtual image display system (e.g., the first light emitter 10 or the third light emitter 20) may be responsible for creating an image frame to the second eye 60 (e.g., the left eye). As shown in FIG. 10 , the FOV may be wider than that of the embodiment shown in FIG. 6 . As a result, the total overlap area of ​​the FOV is increased, giving the viewer a larger visual area with depth perception. The virtual image display system may have a single light emitter with one light direction modifier, a single light emitter with two light direction modifiers, or two light emitters with one light direction modifier, as described in the preceding embodiments.

[0055] Further referring to FIG. 11. In another variation of this embodiment, an optical assembly may be placed between the light emitter and the coupler described above to change the area of ​​a given cross section of the optical path of the plurality of first optical signals. Specifically, an optical assembly including a lens may be implemented to change the optical path of the plurality of first optical signals 1000 from the first light emitter 10 to the first coupler 210 to change the projected area or cross section size of each of the plurality of first optical signals. For example, referring to FIG. 10. The optical assembly comprises lens_1 and lens_2. Lens_1 and lens_2 are convex lenses. The light emitter is initially placed at the focal length of lens_1. When lens_1 is moved to a new position shown as lens_1', the distance between the light emitter and lens_1 is shortened, and as a result, the amount of light divergence angle from the LBS is increased. Thereby, the projected area or cross section size of each of the plurality of first optical signals 1000 is also increased.

[0056] As mentioned in the previous embodiment, a pixel in a first image frame F1 and a corresponding pixel in a second image frame F2 form a binocular virtual image pixel at a first depth related to a first angle between the first and second light signals projecting into the viewer's eyes. The following describes in detail a method for displaying a binocular virtual image pixel with a first depth. 12a and 12b. Upon receiving the light signals, the viewer perceives a number of right pixels in the first image frame F1 of the object within an area A bounded by the extent of the redirected right light signal from the combiner. Area A is called the field of view (FOV) for the right eye 50. Similarly, a number of left light signals in the second image frame F2 are redirected by the first combiner 210, pass through the center of the left pupil 62, and are finally received by the left retina 64. Upon receiving the redirected left light signals, the viewer perceives a number of left pixels of the object within an area B bounded by the extent of the redirected left light signal. Area B is called the field of view (FOV) for the left eye 60. When both a number of right pixels from a first image frame F1 and a number of left pixels from a second image frame F2 are displayed in an area C where areas A and B overlap, at least one right light signal representing one right pixel and a corresponding left light signal representing one left pixel are fused to display a binocular virtual image pixel with a characteristic depth in area C. The depth is related to the angle between the redirected right light signal and the redirected left light signal. Such an angle is also called the vergence angle.

[0057] As shown in Fig. 12b, the viewer perceives a virtual image of a dinosaur object 70 with multiple depths in region C in front of him / her. Note that region C may be desirable to be the central area C of the FOV so that the image within region C is produced with maximum pixel density since it is within the region where the eyes can converge to perceive the image with depth. The image of the dinosaur object 70 includes a first virtual binocular pixel 72 displayed at a first depth D1 and a second virtual binocular pixel 74 displayed at a second depth D2. The first angle between the first redirected right light signal 16' and the corresponding first redirected left light signal 36' is θ1. The first depth D1 is related to the first angle θ1. In particular, the first depth of the first binocular virtual image pixel of the object can be determined by the first angle θ1 of the spread of the optical path between the first redirected right light signal and the corresponding first redirected left light signal. As a result, the first depth D1 of the first binocular virtual image pixel 72 can be determined by the following equation: This can be roughly calculated using TIFF0007582690000001.tif12150. The distance between the right pupil 52 and the left pupil 62 is the interpupillary distance (IPD). Similarly, the second angle between the second redirected right light signal 18 and the corresponding second redirected left light signal is θ2. The second depth D1 is related to the second angle θ2. In particular, the second depth D2 of the second binocular virtual image pixel of the object can be approximately determined by the second angle θ2 of spread between the optical paths of the second redirected right light signal and the corresponding second redirected left light signal by the same formula. The second angle θ2 is smaller than the first angle θ1 because the second binocular virtual image pixel 74 is perceived by the viewer as being farther away from the viewer (i.e., at a greater depth) than the first binocular virtual image pixel 72.

[0058] Furthermore, the redirected right light signal 16' and the corresponding redirected left light signal 36' together display a first binocular virtual image pixel 72 with a first depth D1, but the redirected right light signal 16' is not the parallax of the corresponding redirected left light signal 36'. Since the right eye typically sees the same object from a different viewing angle than the left eye, the parallax between the image received by the right eye and the image received by the left eye is used by the viewer to perceive a 3D image with depth. However, in the present invention, the right light signal and the corresponding left light signal for a binocular virtual image pixel display an image of the same viewing angle. As a result, the intensity and / or brightness of the red, blue, and green (RBG) colors of the right light signal and the left light signal are approximately the same. In other words, the right pixel and the corresponding left pixel are approximately the same. However, in another embodiment, one or both of the right light signal and the left light signal may be modified to present some 3D effects such as shadows. In general, both the right eye and the left eye receive an image of the object from the same viewing angle in the present invention, rather than the parallax obtained from the right eye viewing angle and the left eye viewing angle, respectively, that is normally used to generate a 3D image.

[0059] As described above, multiple right light signals are generated by the right light signal generator, redirected by the second combiner 410, and then scanned directly onto the right retina to form a right retinal image on the right retina. Similarly, multiple left light signals are generated by the left light signal generator, redirected by the first combiner 210, and then scanned onto the left retina to form a left retinal image on the left retina. In the embodiment shown in FIG. 12b, the right retinal image 80 includes 36 right pixels obtained from the first image frame F1 in a 6×6 array, and the left retinal image 90 also includes 36 left pixels obtained from the second image frame F2 in a 6×6 array. In another embodiment, the right retinal image 80 includes 921,600 right pixels obtained from the first image frame F1 in a 1280×720 array, and the left retinal image 90 also includes 921,600 left pixels obtained from the second image frame F2 in a 1280×720 array. The object display system is configured to generate a number of right light signals and a corresponding number of left light signals that form a right retinal image on the right retina and a left retinal image on the left retina, respectively. As a result, the viewer perceives a virtual binocular object with a characteristic depth in the region C thanks to the image fusion. The first right light signal 16 from the right light signal generator 10 is received and reflected by the second combiner 410. The first redirected right light signal 16' passes through the right pupil 52 to the right retina of the viewer to display right pixel R34. The corresponding left light signal 36 from the left light signal generator 30 is received and reflected by the first coupler 210. The first redirected light signal 36' passes through the left pupil 62 to the left retina of the viewer to display left retinal pixel L33. As a result of the image fusion, the viewer perceives a virtual binocular object with multiple depths, the depth being determined by the angle of the multiple redirected right light signals and the corresponding multiple redirected left light signals of the same object. The angle between the redirected right light signals and the corresponding left light signals is determined by the relative horizontal distance of the right and left pixels. As a result, the depth of a binocular virtual image pixel is inversely correlated with the relative horizontal distance between the right pixel and the corresponding left pixel forming the binocular virtual image pixel. In other words, the shorter the relative horizontal distance in the X-axis between the right pixel and the left pixel forming such binocular virtual image pixel, the deeper the binocular virtual image pixel is perceived by the viewer. For example, as shown in FIG. 12b, the second binocular virtual image pixel 74 is perceived by the viewer to have a greater depth (i.e., farther away from the viewer) than the first binocular virtual image pixel 72. As a result, the horizontal distance between the second right pixel and the second left pixel is shorter than the horizontal distance between the first right pixel and the first left pixel on the retinal image. Specifically, the horizontal distance between the second right pixel R41 and the second left pixel L51 forming the second binocular virtual image pixel is 4 pixels long. However, the distance between the first right pixel R43 and the first left pixel L33 forming the first binocular virtual image pixel is 6 pixels long.

[0060] Referring again to Fig. 12a and Fig. 12b, the virtual object perceived by the viewer in area C includes a number of binocular virtual image pixels. To accurately describe the location of the binocular virtual image pixels in space, each location in space is provided with three-dimensional (3D) coordinates, for example XYZ coordinates. In alternative embodiments, other 3D coordinate systems can be used. As a result, each binocular virtual image pixel has 3D coordinates, namely horizontal, vertical and depth directions. The horizontal direction (or X-axis direction) is along the direction of the interpupillary line. The vertical direction (or Y-axis direction) is perpendicular to the horizontal direction along the midline of the face. The depth direction (or Z-axis direction) is perpendicular to the frontal plane and perpendicular to both the horizontal and vertical directions.

[0061] Although particular embodiments of the invention have been described in detail for purposes of illustration, various modifications and enhancements may be made without departing from the spirit and scope of the disclosure.

Claims

1. a first light emitter that emits a plurality of first light signals that are projected into a first eye of a viewer; a first optical switch that periodically redirects a first portion of the first optical signal toward a first optical direction modifier during a first time period and then redirects a second portion of the first optical signal toward a third optical direction modifier during a second time period; a first light direction modifier that changes a light direction of the first portion of the first light signal within a first spatial range during the first time period at a first scan rate, and a third light direction modifier that changes a light direction of the second portion of the first light signal within a third spatial range during a second time period at a fifth scan rate, to display a first image frame using a predetermined number of light signals; a central region of the first image frame having a greater number of light signals per cross-sectional area than peripheral regions of the first image frame; Virtual image display system.

2. 2. The virtual image display system of claim 1, wherein the first optical switch is controlled by a voltage or an electromagnetic field.

3. 2. The virtual image display system of claim 1, wherein a first portion of the first light signals forms a first image portion of the first image frame, the first image portion having a first number of light signals, and wherein the second portion of the first light signals forms a second image portion of the first image frame, the second image portion having a second number of light signals, and wherein the predetermined number of light signals for the first image frame is less than or equal to a sum of the first number of light signals and the second number of light signals.

4. 2. The virtual image display system of claim 1, wherein the first spatial range and the third spatial range each have a first coordinate component and a second coordinate component, and the first spatial range borders the third spatial range at either the first coordinate component or the second coordinate component.

5. 2. The virtual image display system of claim 1, wherein the first spatial range and the third spatial range each comprise a first coordinate component and a second coordinate component, and the first spatial range overlaps with the third spatial range for image stitching in either the first coordinate component or the second coordinate component.

6. 2. The virtual image display system of claim 1, wherein the first scan speed or the fifth scan speed is not constant.

7. 2. The virtual image display system of claim 1, wherein the light direction comprises a first coordinate component and a second coordinate component, the first coordinate component of the light direction of the first light signal is varied with respect to time within the first spatial range and the third spatial range at the first scanning speed and the fifth scanning speed to collectively display the first image frame using the predetermined number of light signals, and the second coordinate component of the light direction of the first light signal is varied with respect to time within the first spatial range and the third spatial range at the second scanning speed and the sixth scanning speed, wherein the second scanning speed and the sixth scanning speed are not constant.

8. 2. The virtual image display system of claim 1, wherein the first light emitter emits the plurality of first light signals as light pulses during the first and second periods at a variable frequency to adjust the number of light signals per cross-sectional area of ​​a given region within the first image frame.

9. 2. The virtual image display system of claim 1, wherein the first light direction modifier changes either the first scan speed or the fifth scan speed to adjust the number of light signals per cross-sectional area within a given area within the first image frame.

Citation Information

Patent Citations

  • The helmet mount type display device

    JP1992501927A

  • Scanned imager with switched images

    JP2004527793A

  • Scanning type picture display, imaging apparatus and picture display system

    JP2007121581A

  • Beam scanning-type display device

    JP2010117542A

  • Information display device, information providing system, mobile device, information display method, and program

    JP2017056933A