Optical hyperfocal reflective systems and methods and augmented reality and / or virtual reality displays incorporating same

Abstract

The invention relates to optical hyperfocal reflective systems and methods and augmented reality and / or virtual reality displays incorporating the same. Optical hyperfocal reflection systems and methods are provided. One such optical hyperfocal reflection system has an optical substrate, an optical input coupling portion configured to input-couple a collimated display image to the optical substrate; and an optical hyperfocal output coupling portion integrated with the optical substrate. The optical outcoupling portion includes at least one hyperfocal reflective viewport formed by discrete optical hyperfocal reflector spots integrated with the optical substrate. The discrete optical hyperfocal reflector spot is sized to form a reflected discrete spot beam having a diameter at the target area such that a view of the discrete virtual display image portion seen by a lens detector system positionable at the target area is hyperfocal.

Description

[0001] This application is a divisional application of an application with a filing date of October 8, 2019, application number 201980091735.0, and invention name “Optical hyperfocal reflection system and method and augmented reality and / or virtual reality display combining the system and method”.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This application claims priority to and is a continuation of U.S. patent application serial number 16 / 214,142, filed on December 10, 2018, the entire contents of which are incorporated herein by reference as if fully set forth herein. Technical Field

[0004] Embodiments relate to optical systems and methods, and more particularly, but not exclusively, to optical systems for augmented reality systems and / or virtual reality optical displays. Some embodiments relate to systems and methods for delivering virtual display image views to a human eye in an augmented reality imaging system and / or virtual reality imaging system. Some embodiments relate to augmented and / or virtual reality displays incorporating the aforementioned optical systems and methods associated therewith.

[0005] background

[0006] Virtual reality and augmented reality display systems, such as those used in head-mounted displays and heads-up displays, are configured to display virtual images to the human eye. In an augmented reality display system, the system delivers virtual images that overlay the real world that the human eye is viewing.

[0007] Some users of such virtual reality and augmented reality systems experience eye strain and fatigue, resulting in an uncomfortable viewing experience.

[0008] It would be desirable to provide systems that can be used in virtual reality and / or augmented reality displays to at least alleviate the problems of eye strain and fatigue.

[0009] Overview

[0010] According to one aspect, an optical hyperfocal reflective system is provided. The optical hyperfocal reflective system may include at least one optical substrate; an optical input coupling portion configured to couple a collimated display image input to the optical substrate; and an optical hyperfocal output coupling portion integrated with the optical substrate; wherein the optical output coupling portion includes at least one hyperfocal reflective viewport; wherein the hyperfocal reflective viewport includes at least one discrete optical hyperfocal reflector spot integrated with the optical substrate; wherein the discrete optical hyperfocal reflector spot is at least partially reflective and is configured to reflectively project discrete portions of the optical input coupled display image light onto a target area located at a predetermined working distance from the hyperfocal reflective viewport as discrete spot beams of light forming discrete virtual display image portions, wherein the size of the discrete optical hyperfocal reflector spot is set to form a discrete spot beam having a diameter at the target area, so that the view of the discrete virtual display image portion seen by a lens detector system that can be located at the target area is hyperfocused.

[0011] In some embodiments, the optical hyperfocal output coupling portion includes a plurality of hyperfocal reflective viewports integrated with the optical substrate, and wherein the optical hyperfocal reflector spots are spaced apart from each other in a pattern extending along the optical hyperfocal coupling portion and form a plurality of virtual display image partial hyperfocus views that collectively substantially correspond to the display image or a portion thereof.

[0012] The target area may be a target area of ​​a human eye, and the hyperfocused view of a portion of the virtual display observable by the human eye located in the target area is hyperfocused.

[0013] The optical substrate may be partially or substantially transparent to light of a real-world image received through a face of the optical substrate facing away from the target area of ​​the eye.

[0014] At least some of the optical hyperfocal reflector spots may be embedded in the optical substrate.

[0015] At least some of the optical hyperfocal reflector spots may be disposed on a face of the optical substrate.

[0016] The aperture diameter of each optical hyperfocal reflector spot may be between approximately 100 and 1000 microns.

[0017] Each discrete spot may have a diameter of between 100 and 1000 microns at the target area.

[0018] Each or some of the optical hyperfocal reflector spots in the plurality of hyperfocal viewports may be separated by an inter-reflector distance, wherein the inter-reflector distance is between approximately 500 um and 8 mm.

[0019] The shape and pattern of the optical hyperfocal reflector spot may be selected so that the virtual display image view formed by multiple hyperfocal viewports appears tessellated.

[0020] Each or some of the optical hyperfocal reflector spots may be wavelength selective hyperfocal reflector spots.

[0021] The multiple hyperfocal reflective viewports may include a multiple red light hyperfocal reflective viewports, a multiple green light hyperfocal reflective viewports, and a multiple blue light hyperfocal reflective viewports, wherein the optical hyperfocal reflector spot of each of the multiple red light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific red light wavelength or red light wavelength band, and substantially allow light having other wavelengths to pass through, wherein the optical hyperfocal reflector spot of each of the multiple green light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific green light wavelength or green light wavelength band, and substantially allow light having other wavelengths to pass through, and wherein the optical hyperfocal reflector spot of each of the multiple blue light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific blue light wavelength or blue light wavelength band, and substantially allow light having other wavelengths to pass through.

[0022] The optical substrate may be partially or substantially transparent to light of a real-world image received through a face of the optical substrate facing away from the target area of ​​the eye.

[0023] Each hyperfocal reflector spot of each of the multiple hyperfocal viewports can be configured to substantially pass light rays of a real-world image having other wavelengths of light that are not reflected by the hyperfocal reflector spot and allow them to reach the eye target area, superimposed on the displayed image light rays having a specific wavelength or wavelength band that is selectively reflected by the hyperfocal reflector spot.

[0024] The pattern of hyperfocal reflector spots may include alternating red, blue, and green hyperfocal reflector spots.

[0025] Each hyperfocal spot may include at least one reflective coating.

[0026] Each hyperfocal reflector spot may include a diffractive optical element.

[0027] Each hyperfocal reflector spot may include a polarization selective reflector spot.

[0028] Each of the plurality of hyperfocal reflector spots may include a first polarization state selective reflector spot and a second polarization state selective hyperfocal reflector spot, the first polarization state being different from the second polarization state.

[0029] The first polarization state may be orthogonal to the second polarization state or at an intermediate angle. The intermediate angle may be selected based on the location of the hyperfocal reflective spot along the optical substrate.

[0030] The pattern of hyperfocal reflector spots may include alternating first polarization state reflector spots and second polarization reflector spots.

[0031] The optical substrate may include an optical waveguide.

[0032] The optical substrate may comprise a non-waveguide optical substrate, and wherein the optical input coupling may comprise free space.

[0033] According to another aspect, an augmented or virtual reality electronic display system is provided. The system may include at least one collimated display image generating system; and at least one optical hyperfocal reflective system, the collimated display image generating system being optically coupled to the optical hyperfocal reflective system; wherein the optical hyperfocal reflective system comprises: at least one optical substrate; an optical input portion, which is integrated and / or separate from the optical substrate; and an optical hyperfocal output coupling portion; wherein the optical input portion optically couples the collimated display image generating system to the optical hyperfocal output coupling portion; wherein the optical output coupling portion comprises at least one hyperfocal reflective viewport; wherein the hyperfocal reflective viewport comprises at least one discrete optical hyperfocal reflector spot integrated with the optical substrate; wherein the discrete optical hyperfocal reflector spot is at least partially reflective and is configured to reflectively project discrete portions of the optically input coupled display image light onto a target area located at a predetermined working distance from the hyperfocal reflective viewport as discrete spot beams of light, wherein the discrete optical hyperfocal reflector spots are sized to form discrete spot beams having a diameter at the target area, such that a view of the discrete virtual display image portion seen by a lens-detector system that may be located at the target area is hyperfocused.

[0034] In some embodiments, the optical hyperfocal output coupling portion may include a plurality of hyperfocal reflective viewports integrated with the optical substrate, and wherein the optical hyperfocal reflector spots are spaced apart from each other in a pattern extending along the optical hyperfocal coupling portion.

[0035] The lens detector can be a human eye, and the display system can be a binocular system, wherein a first optical hyperfocal reflective system is optically coupled to a first collimated display image generating system; the first optical hyperfocal reflective system is configured for a left eye target area of ​​the binocular display system; and also includes a second optical hyperfocal reflective system optically coupled to a second collimated display image generating system; the second optical hyperfocal reflective system is configured for a right eye target area of ​​the binocular system.

[0036] The first optical hyperfocal reflective system and the second optical hyperfocal reflective system can be spaced apart from the left eye target area and the right eye target area so that the convergence plane of the binocular system is located within the optical range from infinity to the hyperfocal distance of the left eye lens and the right eye lens.

[0037] Each or some of the optical hyperfocal reflector spots in the multiple hyperfocal viewports may be spaced apart by an inter-reflector distance, wherein the inter-reflector distance is between approximately 500 um and 8 mm.

[0038] The shape and pattern of the optical hyperfocal reflector spot may be selected so that the virtual display image view formed by multiple hyperfocal viewports appears mosaic-like.

[0039] Each or some of the optical hyperfocal reflector spots may be wavelength selective reflector spots.

[0040] The multiple hyperfocal reflective viewports may include a multiple red light hyperfocal reflective viewports, a multiple green light hyperfocal reflective viewports, and a multiple blue light hyperfocal reflective viewports, wherein the optical hyperfocal reflector spot of each of the multiple red light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific red light wavelength or red light wavelength band, and substantially allow light having other wavelengths to pass through, wherein the optical hyperfocal reflector spot of each of the multiple green light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific green light wavelength or green light wavelength band, and substantially allow light having other wavelengths to pass through, and wherein the optical hyperfocal reflector spot of each of the multiple blue light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific blue light wavelength or blue light wavelength band, and substantially allow light having other wavelengths to pass through.

[0041] The pattern of hyperfocal viewports may include alternating red light hyperfocal viewports, blue light hyperfocal viewports, and green light hyperfocal viewports.

[0042] The optical substrate may be partially or substantially transparent to light of a real-world image received through a face of the optical substrate facing away from the target area of ​​the eye.

[0043] Each hyperfocal reflector spot of each of the multiple hyperfocal viewports can be configured to substantially pass light rays of a real-world image having other wavelengths of light that are not reflected by the hyperfocal reflector spot and allow them to reach a target area of ​​the eye, superimposed on said displayed image light rays having a specific wavelength or wavelength band that is selectively reflected by the hyperfocal reflector spot.

[0044] Each hyperfocal spot may include at least one reflective coating.

[0045] Each hyperfocal reflector spot may include a diffractive optical element.

[0046] The optical substrate may include an optical waveguide.

[0047] The optical substrate may comprise a non-waveguide optical substrate, and wherein the optical input coupling comprises free space.

[0048] The optical substrate may be partially or substantially transparent to light of a real-world image received through a face of the optical substrate facing away from the target area of ​​the eye.

[0049] The augmented or virtual reality display system may be a head mounted display.

[0050] The augmented or virtual reality display system may be a heads-up display.

[0051] An augmented or virtual reality display system may be a near-eye display.

[0052] According to another aspect, an optical exit pupil expander hyperfocal system is provided. The system may include: at least one optical substrate; an optical input coupling portion configured to couple a collimated display image input to the optical substrate; wherein the optical input coupling portion is integrated and / or separate from the optical substrate; and an optical hyperfocal output coupling portion integrated with the optical substrate; wherein the optical output coupling portion includes a plurality of hyperfocal reflective viewports integrated with the optical substrate; wherein each hyperfocal reflective viewport includes at least one discrete optical hyperfocal reflector spot integrated with the optical substrate; wherein the discrete optical hyperfocal reflector spots are configured to at least partially reflectively couple discrete portions of the optical input coupled display image light. The invention relates to a method for projecting a plurality of optical hyperfocal reflector spots onto a target area located at a predetermined working distance from the hyperfocal reflective viewport as a discrete light spot bundle of light, wherein the size of the discrete optical hyperfocal reflector spots is set to form a discrete light spot bundle having a diameter at the target area so that the view of the discrete virtual display image portion seen by a lens-detector system that can be located at the target area is hyperfocused; and wherein the plurality of optical hyperfocal reflector spots are spaced apart from each other in a pattern extending along the optical substrate in the direction of the exit pupil expansion, and are collectively configured to gradually extract the collimated display image optical input light from the pupil exit expander.

[0053] The optical substrate may include an optical waveguide.

[0054] The optical waveguide may be partially or substantially transparent to light of the real world image received through a face of the optical waveguide facing away from the target area.

[0055] The hyperfocal reflector spot may be tilted relative to the exit spread direction.

[0056] At least some of the hyperfocal reflector spots may be partially reflective spots.

[0057] At least some of the hyperfocal reflector spots may be fully reflective spots.

[0058] The tilt angle of the hyperfocal reflector spot may vary depending on the position of the hyperfocal reflector spot along the optical waveguide in the direction in which the exit pupil extends.

[0059] The substrate can be a non-waveguide substrate, and depending on the position of the hyperfocal reflector spot along the substrate in the direction in which the exit pupil extends, the hyperfocal reflector spot is gradually tilted relative to the horizontal plane and / or the vertical plane so as to maintain the field of view of the hyperfocal virtual display image visible in the target area.

[0060] The pattern of the hyperfocal reflector spot can vary depending on the position along the optical waveguide in the direction of exit pupil expansion.

[0061] The density of hyperfocal reflector spots per unit volume or area of ​​the optical waveguide may vary depending on the position along the optical waveguide in the direction of exit pupil expansion.

[0062] The hyperfocal reflector spots may be distributed in a pattern in a common area or common volume segment of the optical waveguide, the common areas or common volume segments being spaced apart along the optical waveguide in the exit pupil expansion direction.

[0063] The pattern of the hyperfocal reflector spots in each common region or common volume segment may vary depending on the position of the region or volume segment along the optical waveguide in the direction of exit pupil expansion.

[0064] The density of the hyperfocal reflector spots in each pattern in a common region or common volume segment of the optical waveguide may vary depending on the position of the common region or volume segment along the optical waveguide in the direction of exit pupil expansion.

[0065] The reflectivity of at least some of the hyperfocal reflector spots may vary depending on the location of the hyperfocal reflector spot along the optical waveguide in the direction in which the exit pupil extends.

[0066] At least some of the hyperfocal reflector spots may include angularly selective hyperfocal reflector spots.

[0067] The angular response of the angularly selective hyperfocal reflector spots can vary depending on their spacing along the optical waveguide in the direction of exit pupil expansion.

[0068] The angularly selective hyperfocal reflector spot may include an angular notch filter hyperfocal reflector spot.

[0069] At least some of the angularly selective hyperfocal reflector spots may be partially reflective spots.

[0070] At least some of the angularly selective hyperfocal reflector spots may be fully reflective spots.

[0071] At least some of the hyperfocal reflector spots may be wavelength selective hyperfocal reflector spots.

[0072] The wavelength selectivity of the wavelength-selective hyperfocal reflector spots can be varied depending on their spacing along the optical waveguide in the direction of exit pupil expansion.

[0073] At least some of the wavelength selective hyperfocal reflector spots may be partially reflecting spots.

[0074] At least some of the wavelength selective hyperfocal reflector spots may be fully reflective spots.

[0075] Each of at least some of the wavelength selective hyperfocal reflector spots may be a wavelength and angle selective hyperfocal reflector spot.

[0076] The angular response of the angular and wavelength selective hyperfocal reflector spots can be varied depending on their spacing positions along the optical waveguide in the direction of exit pupil expansion.

[0077] The wavelength and angle and the wavelength selective reflector spot can be an angle notch filter wavelength selective reflector spot.

[0078] At least some of the angle- and wavelength-selective hyperfocal reflector spots may be partially reflective spots.

[0079] At least some of the angular hyperfocal selective reflector spots may be fully reflective spots.

[0080] At least some of the hyperfocal reflector spots may be fully reflective hyperfocal reflector spots and are spaced apart in the exit pupil expansion direction and spaced apart in a direction different from the exit pupil expansion direction to allow some of the optical input collimated display image light rays propagating in the exit pupil expansion direction to pass through the optical waveguide between some of the fully reflective spots spaced apart in different directions and to be gradually reflected by the fully reflective spots further spaced apart along the optical waveguide in the exit pupil expansion direction.

[0081] At least some of the optical hyperfocal reflector spots may be embedded in the optical substrate.

[0082] At least some of the optical hyperfocal reflector spots are disposed on a face of the optical substrate.

[0083] Each optical hyperfocal reflector spot may have an aperture diameter of between approximately 100 and 1000 microns.

[0084] Each spot can be between 100 and 1000 microns in diameter at the target area.

[0085] Each or some of the optical hyperfocal reflector spots of the multiple hyperfocal viewports may be separated by an inter-reflector distance, wherein the inter-reflector distance is between approximately 500um and 8mm.

[0086] The shape and pattern of the optical hyperfocal reflector spot may be selected so that the virtual display image view formed by multiple hyperfocal viewports appears mosaic-like.

[0087] The multiple hyperfocal reflective viewports may include a multiple red light hyperfocal reflective viewports, a multiple green light hyperfocal reflective viewports, and a multiple blue light hyperfocal reflective viewports, wherein the optical hyperfocal reflector spot of each of the multiple red light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific red light wavelength or red light wavelength band, and substantially allow light having other wavelengths to pass through, wherein the optical hyperfocal reflector spot of each of the multiple green light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific green light wavelength or green light wavelength band, and substantially allow light having other wavelengths to pass through, and wherein the optical hyperfocal reflector spot of each of the multiple blue light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific blue light wavelength or blue light wavelength band, and substantially allow light having other wavelengths to pass through.

[0088] The optical substrate may be partially or substantially transparent to light of the real-world image received through the face of the optical substrate facing away from the target area of ​​the eye.

[0089] The reflector spot of each of the multiple hyperfocal viewports can be configured to substantially pass light rays of a real-world image having other wavelengths of light that are not reflected by the hyperfocal reflector spot and allow them to reach a target area of ​​the eye, superimposed on the displayed image light rays having a specific wavelength or wavelength band that is selectively reflected by the hyperfocal reflector spot.

[0090] The pattern of hyperfocal reflector spots may include alternating red, blue, and green hyperfocal reflector spots.

[0091] Each hyperfocal spot may include at least one reflective coating.

[0092] Each hyperfocal reflector spot may include a diffractive optical element.

[0093] The diffraction angle of the hyperfocal reflector spot of the diffractive optical element may vary depending on the position of the hyperfocal reflector spot along the optical waveguide in the direction in which the exit pupil extends.

[0094] Depending on the position of the hyperfocal reflector spot along the optical waveguide in the direction in which the exit pupil extends, the diffraction angle of the hyperfocal reflector spot of the diffractive optical element can be gradually tilted relative to the horizontal plane and / or the vertical plane to maintain the field of view of the hyperfocal virtual display image visible in the target area of ​​the eye.

[0095] At least some of the hyperfocal reflector spots may include polarization state selective reflector spots.

[0096] The polarization state selective reflector spots may be polarization state selective depending on their spacing positions along the optical waveguide in the pupil exit expansion direction.

[0097] The plurality of hyperfocal reflector spots may include a first polarization state selective reflector spot and a second polarization state selective reflector spot, the first polarization state being different from the second polarization state.

[0098] The first polarization state may be orthogonal to the second polarization state or at an intermediate angle. The intermediate angle may be selected based on the position of the reflector spot along the optical substrate.

[0099] The pattern of hyperfocal reflector spots may include alternating first polarization state reflector spots and second polarization state reflector spots.

[0100] The polarization state selective hyperfocal reflector spots may be distributed in a pattern in common areas and / or common volume segments of the optical waveguide, the common areas and / or common volume segments being spaced apart along the optical waveguide in the exit pupil expansion direction.

[0101] The polarization state selective hyperfocal reflector spots in each pattern of common areas and / or common volume segments may be polarization state selective depending on the position of the common areas and / or common volume segments along the optical waveguide in the exit pupil expansion direction.

[0102] The polarization state selective hyperfocal reflector spot may include a first polarization state hyperfocal reflector spot and a second polarization state selective hyperfocal reflector spot, the first polarization state being orthogonal to the second polarization state or being at an intermediate angle. The intermediate angle may be selected based on the position of the reflective spot along the optical substrate.

[0103] The density of polarization state selective hyperfocal reflector spots in each pattern in the common area and / or common volume segment may vary depending on the position of the common area and / or common volume segment along the optical waveguide in the first exit pupil expansion direction.

[0104] According to another aspect, a near-eye augmented or virtual reality electronic display system is provided. The system may include: at least one collimated display image generation system; and at least one optical hyperfocal exit pupil expander, the collimated display image generation system being optically coupled to the exit pupil expander; wherein the optical hyperfocal exit pupil expander comprises: an optical substrate; the optical substrate having an optical input coupling portion and an output coupling portion; wherein the optical input coupling portion is configured to couple the collimated display image input from the exit pupil to the optical substrate; wherein the optical output coupling portion comprises a plurality of hyperfocal reflective viewports integrated with the optical substrate; wherein each hyperfocal reflective viewport comprises at least one discrete optical hyperfocal reflector spot integrated with the optical substrate; wherein the discrete optical hyperfocal reflector spot The invention is configured to at least partially reflectively project discrete portions of the display image light coupled to the optical input as discrete spot beams of light onto a target area located at a predetermined working distance from the hyperfocal reflective viewport, wherein the size of the discrete optical hyperfocal reflector spots is set to form a discrete spot beam having a diameter in the target area so that the view of the discrete virtual display image portion seen by a lens-detector system that can be located in the target area is hyperfocused, and wherein the multiple optical hyperfocal reflector spots are spaced apart from each other in a pattern extending along the optical substrate in the direction of the exit pupil expansion, and are collectively configured to gradually extract the collimated display image optical input light from the pupil exit expander.

[0105] The lens detector system can be a human eye, and wherein the display system is a binocular system, wherein a first exit pupil expander is optically coupled to a first collimated display image generating system; the exit pupil expander is configured for a left eye target area of ​​the binocular display system; and further comprising a second exit pupil expander optically coupled to a second collimated display image generating system; the second exit pupil expander is configured for a right eye target area of ​​the binocular system.

[0106] The first exit pupil expander and the second exit pupil expander can be spaced apart from the left eye target area and the right eye target area such that the convergence plane of the binocular system is within an optical range from infinity to a hyperfocal distance of the left eye lens and the right eye lens.

[0107] Each or some of the optical hyperfocal reflector spots of the multiple hyperfocal viewports may be separated by an inter-reflector distance, wherein the inter-reflector distance is between approximately 500 um and 8 mm.

[0108] The shape and pattern of the optical hyperfocal reflector spot may be selected so that the virtual display image view formed by multiple hyperfocal viewports appears mosaic-like.

[0109] The optical substrate may include an optical waveguide.

[0110] The optical waveguide may be partially or substantially transparent to light of the real-world image received through the face of the optical waveguide facing away from the target area of ​​the eye.

[0111] The hyperfocal reflector spot may be tilted relative to the exit spread direction.

[0112] At least some of the hyperfocal reflector spots may be partially reflective spots.

[0113] At least some of the hyperfocal reflector spots may be fully reflective spots.

[0114] The substrate may be a non-waveguide substrate, and wherein the tilt angle of the hyperfocal reflector spot varies depending on the position of the hyperfocal reflector spot along the substrate in the direction in which the exit pupil extends.

[0115] Depending on the position of the hyperfocal reflector spot along the optical substrate in the direction in which the exit pupil extends, the hyperfocal reflector spot can be gradually tilted relative to the horizontal plane and / or the vertical plane to maintain the field of view of the hyperfocal virtual display image visible in the target area of ​​the eye.

[0116] The pattern of the hyperfocal reflector spot can vary depending on the position along the optical waveguide in the direction of exit pupil expansion.

[0117] The reflectivity of at least some of the hyperfocal reflector spots may vary depending on the location of the hyperfocal reflector spot along the optical waveguide in the direction in which the exit pupil extends.

[0118] At least some of the hyperfocal reflector spots may include angularly selective hyperfocal reflector spots.

[0119] The angular response of the angularly selective hyperfocal reflector spots can vary depending on their spacing along the optical waveguide in the direction of exit pupil expansion.

[0120] The angularly selective hyperfocal reflector spot may include an angular notch filter hyperfocal reflector spot.

[0121] At least some of the hyperfocal reflector spots may be wavelength selective hyperfocal reflector spots.

[0122] The wavelength selectivity of the wavelength-selective hyperfocal reflector spots can be varied depending on their spacing along the optical waveguide in the direction of exit pupil expansion.

[0123] Each of at least some of the wavelength selective hyperfocal reflector spots may be a wavelength and angle selective hyperfocal reflector spot.

[0124] At least some of the hyperfocal reflector spots may be fully reflective reflector spots and are spaced apart in the exit pupil expansion direction and spaced apart in a direction different from the exit pupil expansion direction to allow some of the optical input collimated display image light rays propagating in the exit pupil expansion direction to pass through the optical waveguide between some of the fully reflective spots spaced apart in different directions and to be gradually reflected by the fully reflective spots further spaced apart along the optical waveguide in the exit pupil expansion direction.

[0125] At least some of the optical hyperfocal reflector spots may be embedded in the optical substrate.

[0126] At least some of the optical hyperfocal reflector spots may be disposed on a face of the optical substrate.

[0127] The aperture diameter of each optical hyperfocal reflector spot can be between 100 and 1000 microns.

[0128] Each spot can be between 100 and 1000 microns in diameter at the target area.

[0129] Each or some of the optical hyperfocal reflector spots of the multiple hyperfocal viewports may be separated by an inter-reflector distance, wherein the inter-reflector distance is between approximately 500um and 8mm.

[0130] The shape and pattern of the optical hyperfocal reflector spot may be selected so that the virtual display image view formed by multiple hyperfocal viewports appears mosaic-like.

[0131] The multiple hyperfocal reflective viewports may include a multiple red light hyperfocal reflective viewports, a multiple green light hyperfocal reflective viewports, and a multiple blue light hyperfocal reflective viewports, wherein the optical hyperfocal reflector spot of each of the multiple red light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific red light wavelength or red light wavelength band, and substantially allow light having other wavelengths to pass through, wherein the optical hyperfocal reflector spot of each of the multiple green light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific green light wavelength or green light wavelength band, and substantially allow light having other wavelengths to pass through, and wherein the optical hyperfocal reflector spot of each of the multiple blue light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific blue light wavelength or blue light wavelength band, and substantially allow light having other wavelengths to pass through.

[0132] Each hyperfocal spot may include at least one reflective coating.

[0133] Each hyperfocal reflector spot may include a diffractive optical element.

[0134] At least some of the hyperfocal reflector spots include polarization state selective reflector spots.

[0135] The polarization state selective reflector spots may be polarization state selective depending on their spacing positions along the optical waveguide in the pupil exit expansion direction.

[0136] The display image generating system may include a polarization state dynamic switch, wherein the polarization state dynamic switch is configured to dynamically change the polarization state of the input coupled collimated display image so that the hyperfocal spot reflecting the optical input display image light switches between different polarization state selective reflector spots according to the polarization state of the optical input display image light.

[0137] The polarization state dynamic switch may include a liquid crystal material structure.

[0138] The plurality of hyperfocal reflector spots may include a first polarization state selective reflector spot and a second polarization state selective reflector spot, the first polarization state being different from the second polarization state.

[0139] The first polarization state may be orthogonal to the second polarization state or at an intermediate angle. The intermediate angle may be selected based on the location of the hyperfocal reflective spot along the optical substrate.

[0140] The display image generating system may include a polarization state dynamic switch, wherein the polarization state dynamic switch is configured to dynamically change the polarization state of the input coupled collimated display image between a first polarization state and a second polarization state, so that the hyperfocal spot reflecting the optical input display light is dynamically switched between a first polarization state selective reflector spot and a second polarization state selective reflector spot according to the polarization state of the optical input display image light.

[0141] The polarization state dynamic switch can also be configured to dynamically change the polarization state of the input coupled collimated display image cyclically between a first polarization state and a second polarization state, so that the hyperfocal spot of the reflected light input display light is dynamically switched between a first polarization state selective reflector spot, a combination of the first polarization state selective reflector spot and the second polarization state selective reflector spot, and a second polarization state selective reflector spot according to the circular polarization state of the light input display image light.

[0142] The polarization state dynamic switch may include a liquid crystal material structure.

[0143] The pattern of hyperfocal reflector spots may include alternating first polarization state reflector spots and second polarization state reflector spots.

[0144] The polarization state selective hyperfocal reflector spots may be distributed in a pattern in common areas and / or common volume segments of the optical waveguide, the common areas and / or common volume segments being spaced apart along the optical waveguide in the exit pupil expansion direction.

[0145] The polarization state selective hyperfocal reflector spots in each pattern of common areas and / or common volume segments may be polarization state selective depending on the position of the common areas and / or common volume segments along the optical waveguide in the exit pupil expansion direction.

[0146] The density of polarization state selective hyperfocal reflector spots in each pattern in the common area and / or common volume segment may vary depending on the position of the common area and / or common volume segment along the optical waveguide in the first exit pupil expansion direction. According to another aspect, an augmented or virtual reality electronic display system is provided. The system may include: at least one collimated display image generating system; and at least one optical hyperfocal free space reflector, the collimated display image generating system optically coupled to the optical hyperfocal free space reflector; wherein the optical hyperfocal free space reflector includes: an optical substrate having a display image receiving surface; and a plurality of hyperfocal reflective viewports integrated with the optical substrate, wherein each hyperfocal reflective viewport includes at least one discrete optical hyperfocal reflector spot integrated with the optical substrate; wherein the discrete optical hyperfocal reflector spots are configured to reflectively project discrete virtual image display portions of the optically input coupled display image light onto a target area located at a predetermined distance from the hyperfocal reflective viewport as discrete spot bundles of light, wherein the discrete optical hyperfocal reflector spots are sized to form discrete spot bundles having diameters at the target area such that a view of the discrete virtual image display portion seen by a lens-detector system that may be located at the target area is hyperfocused; and wherein the plurality of optical hyperfocal reflector spots are spaced apart from one another in a pattern extending on the display image receiving surface of the optical substrate and are collectively configured such that virtual display image views formed by the reflected discrete spot bundles together form a display image.

[0147] The optical substrate may be partially or substantially transparent to light of the real-world image received through the face of the optical substrate facing away from the target area of ​​the eye.

[0148] The optical substrate may include a flat or curved optical combiner substrate.

[0149] The optical combiner substrate may be off-axis relative to the axis of the image display generating system.

[0150] The display system can be a binocular system, wherein a first optical hyperfocal free space reflector is optically coupled to a first collimated display image generating system; the first optical hyperfocal free space reflector is configured for a left eye target area of ​​the binocular display system; and also includes a second optical hyperfocal free space reflector optically coupled to a second collimated display image generating system; the second optical hyperfocal free space reflector is configured for a right eye target area of ​​the binocular system.

[0151] The lens detector can be a human eye, and wherein the first optical hyperfocal free space reflector and the second optical hyperfocal free space reflector are spaced apart from the left eye target area and the right eye target area such that a convergence plane of the binocular system is within an optical range from infinity to the hyperfocal distance of the left eye lens and the right eye lens.

[0152] Each or some of the optical hyperfocal reflector spots of the multiple hyperfocal viewports may be separated by an inter-reflector distance, wherein the inter-reflector distance is between approximately 500 um and 8 mm.

[0153] The shape and pattern of the optical hyperfocal reflector spot may be selected so that the virtual display image view formed by multiple hyperfocal viewports appears mosaic-like.

[0154] At least some of the hyperfocal reflector spots may be partially reflective spots.

[0155] At least some of the hyperfocal reflector spots may be fully reflective spots.

[0156] The reflectivity of at least some of the hyperfocal reflector spots may vary depending on the location of the hyperfocal reflector spots on the receiving surface of the optical substrate.

[0157] At least some of the hyperfocal reflector spots may be wavelength selective hyperfocal reflector spots.

[0158] The wavelength selectivity of the wavelength-selective hyperfocal reflector spots can be varied depending on their spacing positions on the receiving surface of the optical substrate.

[0159] The aperture diameter of the optical hyperfocal reflector spot can be between 100 and 1000 microns.

[0160] Each spot can be between 100 and 1000 microns in diameter at the target area.

[0161] Each or some of the optical hyperfocal reflector spots of the multiple hyperfocal viewports may be separated by an inter-reflector distance, wherein the inter-reflector distance is between approximately 500um and 8mm.

[0162] The shape and pattern of the optical hyperfocal reflector spot may be selected so that the virtual display image view formed by multiple hyperfocal viewports appears mosaic-like.

[0163] The multiple hyperfocal reflective viewports may include a multiple red light hyperfocal reflective viewports, a multiple green light hyperfocal reflective viewports, and a multiple blue light hyperfocal reflective viewports, wherein the optical hyperfocal reflector spot of each of the multiple red light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific red light wavelength or red light wavelength band, and substantially allow light having other wavelengths to pass through, wherein the optical hyperfocal reflector spot of each of the multiple green light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific green light wavelength or green light wavelength band, and substantially allow light having other wavelengths to pass through, and wherein the optical hyperfocal reflector spot of each of the multiple blue light hyperfocal viewports is configured to selectively reflect input-coupled collimated display image light having a specific blue light wavelength or blue light wavelength band, and substantially allow light having other wavelengths to pass through.

[0164] Each hyperfocal spot may include at least one reflective coating.

[0165] Each hyperfocal reflector spot may include a diffractive optical element.

[0166] At least some of the hyperfocal reflector spots may include polarization state selective reflector spots.

[0167] The polarization state selective reflector spots can have polarization state selectivity depending on their spacing positions on the receiving surface of the optical substrate.

[0168] The display image generating system may include a polarization state dynamic switch, wherein the polarization state dynamic switch is configured to dynamically change the polarization state of the input coupled collimated display image so that the hyperfocal spot reflecting the optical input display image light switches between different polarization state selective reflector spots according to the polarization state of the optical input display image light.

[0169] The polarization state dynamic switch may include a liquid crystal material structure.

[0170] The plurality of hyperfocal reflector spots may include a first polarization state selective reflector spot and a second polarization state selective reflector spot, the first polarization state being different from the second polarization state.

[0171] The first polarization state can be orthogonal to the second polarization state or at an intermediate angle. The intermediate angles can be selected based on the position of the hyperfocal reflector spot along the optical substrate.

[0172] The display image generating system may include a polarization state dynamic switch, wherein the polarization state dynamic switch is configured to dynamically change the polarization state of the collimated display image between a first polarization state and a second polarization state, so that the hyperfocal spot of the reflected light input display light is dynamically switched between a first polarization state selective reflector spot and a second polarization state selective reflector spot according to the polarization state of the light input display image light.

[0173] The polarization state dynamic switch can also be configured to dynamically change the polarization state of the input coupled collimated display image cyclically between a first polarization state and a second polarization state, so that the hyperfocal spot of the reflected light input display light is dynamically switched between a first polarization state selective reflector spot, a combination of the first polarization state selective reflector spot and the second polarization state selective reflector spot, and a second polarization state selective reflector spot according to the circular polarization state of the light input display image light.

[0174] The polarization state dynamic switch may include a liquid crystal material structure.

[0175] The pattern of hyperfocal reflector spots may include alternating first polarization state reflector spots and second polarization state reflector spots.

[0176] According to another aspect, an optical and electronic display system is provided. The system may include any of the optical hyperfocal reflective systems mentioned above or below; at least one processor; and at least one eye tracking camera operably coupled to the processor, the eye tracking camera being configured to monitor an eye at an eye target area; wherein the processor is operably coupled to a display image generation system of an augmented or virtual reality electronic display system; and wherein the optical hyperfocal reflective system is configured to form a hyperfocused human eye view of a virtual display image of a display image based on the monitoring of the eye.

[0177] The eye tracking camera can be configured to monitor the gaze direction of an eye at an eye target area; wherein the processor can be configured to modify a display image based on an eye tracking value corresponding to the gaze direction monitored by the eye tracking camera; and wherein the optical hyperfocal reflection system can be configured to form a hyperfocused human eye view of a virtual display image of the modified display image.

[0178] The processor may be configured to apply blur to one or more objects in the displayed image based on the eye tracking output.

[0179] A processor may be configured to determine where an eye in an eye target area of ​​an augmented or virtual reality electronic display system is looking at a real-world object of a real-world scene and the position of a plane in which the real-world object lies; wherein the processor is configured to determine an expected position of an object in a hyperfocused virtual display image relative to the plane in which the real-world object lies, and wherein the display image generation system is configured to apply blur to one or more objects in the display image, the one or more objects having an expected position closer to or further away from the plane in which the real-world object lies.

[0180] The eye tracking camera may be configured to monitor pupil size of the eye and also include a brightness control system configured to control the amount of external world brightness that reaches the eye.

[0181] The brightness control system may include an electro-darkening filter or panel located between a target area of ​​the eye and the outside world, the processor being operably connected to the electro-darkening filter and configured to provide feedback control to the electro-darkening filter or panel to control the amount of outside world brightness reaching the eye based on pupil size monitoring.

[0182] Eye tracking cameras can be arranged in an indirect viewing configuration.

[0183] Eye tracking cameras may be arranged in a direct viewing configuration.

[0184] According to yet another aspect, a method for an augmented or virtual reality electronic display system is provided. The method may include determining a gaze direction of an eye at an eye target area of ​​the augmented or virtual reality electronic display system based on eye tracking information; modifying a displayed image according to the determined gaze direction; and displaying a hyperfocused human eye view of a virtual display image of the modified image using the augmented or virtual reality electronic display system.

[0185] The method may further include tracking the eye using at least one eye tracking camera and determining eye tracking information from the eye tracking camera.

[0186] Modifying the displayed image in accordance with the eye tracking may include applying blur to one or more objects in the displayed image in accordance with the eye tracking.

[0187] The method may also include determining from eye tracking where an eye in an eye target area of ​​an augmented or virtual reality electronic display system is viewing a real-world object in a real-world scene, the location of a plane in which the real-world object resides, and an expected location of an object in a displayed image relative to the plane in which the real-world object resides.

[0188] The method may further include applying blur to one or more objects in the displayed image that have expected positions that are closer to or farther from the plane in which the real-world object lies.

[0189] According to another aspect, a method for an augmented or virtual reality electronic display system is provided. The method may include: determining a gaze direction of an eye in an eye target area of ​​the augmented or virtual reality electronic display system based on eye tracking information; modifying a displayed image according to the determined gaze direction; and displaying a hyperfocused human eye view of a virtual display image of the modified image using the augmented or virtual reality electronic display system.

[0190] The method may further include tracking the eye using at least one eye tracking camera and determining eye tracking information from the eye tracking camera.

[0191] Modifying the displayed image in accordance with the eye tracking may include applying blur to one or more objects in the displayed image in accordance with the eye tracking.

[0192] The method may also include determining from eye tracking where an eye in an eye target area of ​​an augmented or virtual reality electronic display system is viewing a real-world object in a real-world scene, the location of a plane in which the real-world object resides, and an expected location of an object in a displayed image relative to the plane in which the real-world object resides.

[0193] The method may further include applying blur to one or more objects in the displayed image that have expected positions that are closer to or farther from the plane in which the real-world object lies.

[0194] According to another aspect, a device is provided. The device may include: a memory storing instructions; and one or more processors, wherein when the instructions are processed by the one or more processors, the device causes: tracking the gaze direction of an eye observing an augmented or virtual reality electronic display with an eye tracking camera; modifying a display image according to the eye tracking; and generating a hyper-focused human eye view of a virtual display image of the modified display image.

[0195] Modifying the displayed image in accordance with the eye tracking may include applying blur to one or more objects in the displayed image in accordance with the eye tracking.

[0196] At least one processor may also be configured to: determine, based on eye tracking, where an eye in an eye target area of ​​an augmented or virtual reality electronic display system is looking at a real-world object in a real-world scene; the location of a plane in which the real-world object resides; determine an expected location of an object in a displayed image relative to the plane in which the real-world object resides; and apply blur to one or more objects in the displayed image that have an expected location that is closer to or farther from the plane in which the real-world object resides.

[0197] According to yet another aspect, a computer-readable medium is provided. The computer-readable medium may include a computer program product configured to cause a processor to edit content of an image to be displayed by performing a method, the method comprising: determining a gaze direction of an eye of an observer of a hyperfocused virtual image of a displayed image from an eye-tracking camera; and editing the displayed image by applying blur to one or more objects in the displayed image according to the gaze direction, so that one or more objects in the hyperfocused virtual image appear out of focus.

[0198] According to yet another aspect, an optical hyperfocal reflective system is provided. The system may include: at least one optical substrate; an optical hyperfocal output coupling portion integrated with the optical substrate; wherein the optical output coupling portion includes at least one hyperfocal reflective viewport; wherein the hyperfocal reflective viewport includes at least one discrete optical hyperfocal reflector spot, the optical hyperfocal reflector spot being partially reflective and integrated with the optical substrate and oriented toward an eye viewing position of the system; wherein the aperture diameter of the discrete optical hyperfocal reflector spot is between about 100 and 1000 microns.

[0199] The optical hyperfocal output coupling portion may include a plurality of hyperfocal reflective viewports integrated with the optical substrate, and wherein the optical hyperfocal reflector spots are spaced apart from each other in a pattern extending along the optical hyperfocal output coupling portion.

[0200] The optical substrate may include a partially or substantially transparent material.

[0201] At least some of the optical hyperfocal reflector spots may be embedded in the optical substrate.

[0202] Each or some of the optical hyperfocal reflector spots of the multiple hyperfocal viewports may be separated by an inter-reflector distance of between approximately 500 um and 8 mm.

[0203] According to yet another aspect, a method for reflectively delivering a display image for an augmented reality and / or virtual display system is provided. The method may include projecting a display image at infinity into or onto a substrate of an optical delivery device; and forming a hyperfocused view of a virtual image of the display image at a viewing position; wherein forming the hyperfocused view of the virtual image of the display image includes reflectively projecting at least a portion of the display image as at least one discrete spot beam from at least one hyperfocal reflector spot of at least one hyperfocal reflective viewport integrated with the optical substrate, wherein the size of the optical hyperfocal reflector spot is set to form a discrete spot beam having a diameter at the viewing position, so that the view of the portion of the display image seen by a lens-detector system that can be located at the viewing position is hyperfocused.

[0204] According to another aspect, an optical exit pupil expander hyperfocal system is provided. The system may include: a first optical waveguide substrate; a first optical input coupling portion configured to selectively couple at least one collimated display image light of a first wavelength into the first optical waveguide substrate along an exit pupil expansion direction, and to allow at least some collimated image light of at least a second wavelength to pass therethrough; wherein the first optical input coupling portion is integrated with and / or separated from the first optical waveguide substrate; and a first optical hyperfocal output coupling portion integrated with the first optical waveguide substrate; wherein the first optical output coupling portion includes one or more first hyperfocal reflective viewports integrated with the first optical waveguide substrate; wherein each first hyperfocal reflective viewport includes a first discrete optical hyperfocal reflector spot integrated with the first optical waveguide substrate,

[0205] Wherein the first discrete optical hyperfocal reflector spot is configured to at least partially reflectively project discrete portions of at least a first wavelength of light input-coupled display image light onto a target area located at a predetermined working distance from the first hyperfocal reflective viewport as a first discrete spot beam of light, wherein the aperture of the first discrete optical hyperfocal reflector spot is sized so that the first discrete spot beam of light of at least the first wavelength forms a view of a virtual display image portion that is seen as hyperfocused by a lens detector that can be located in the target area.

[0206] The system may further include a second optical waveguide substrate; a second optical input coupling portion configured to selectively input-couple collimated display image light of at least a second wavelength received from the first optical input coupling portion into the second optical waveguide substrate along an exit pupil expansion direction; wherein the second optical input coupling portion is integrated with and / or separated from the second optical waveguide substrate; wherein the first wavelength is different from the second wavelength; a second optical hyperfocal output coupling portion integrated with the second optical waveguide substrate; wherein the optical hyperfocal output coupling portion is at least partially transparent to a first discrete spot beam of at least the first wavelength of light at least partially reflected from the first hyperfocal reflection spot, wherein the second optical output coupling portion includes a second optical waveguide substrate integrated with the second optical waveguide substrate; One or more second hyperfocal reflective viewports integrated with a substrate; wherein each second hyperfocal reflective viewport includes a second discrete optical hyperfocal reflector spot integrated with a second optical waveguide substrate; wherein the second discrete optical hyperfocal reflector spot is configured to at least partially reflectively project discrete portions of optical input display image light of at least a second wavelength received from the second optical input coupling portion as a second discrete light spot beam onto a target area located at a predetermined working distance from the second hyperfocal reflective viewport, wherein the aperture of the second discrete optical hyperfocal reflector spot is sized so that the second discrete light spot beam of at least the second wavelength forms a view of a virtual display image portion that is seen as hyperfocused by a lens detector that can be located at the target area.

[0207] A plurality of first optical hyperfocal reflector spots may be spaced apart from one another in a first pattern extending in an exit pupil expansion direction along a first optical waveguide substrate, and are collectively configured to gradually extract collimated display image light input light of at least a first wavelength from a pupil exit expander; and a plurality of second optical hyperfocal reflector spots may be spaced apart from one another in a second pattern extending in an exit pupil expansion direction along a second optical waveguide substrate, and are collectively configured to gradually extract collimated display image light input light of at least a second wavelength from a pupil exit expander.

[0208] Relative to the multiple second optical hyperfocal reflector spots distributed in the second optical waveguide substrate, the multiple first optical hyperfocal reflector spots can be distributed in the first optical waveguide substrate so that the hyperfocus view formed by the first discrete spot beam in the target area does not overlap with the hyperfocus view formed by the second discrete spot beam in the target area.

[0209] The collimated image may be polychromatic, and wherein at least the first wavelength may include a wavelength corresponding to a first color, and at least the second wavelength includes a wavelength corresponding to a second color.

[0210] The first optical input coupling portion may be configured to selectively input couple collimated image light of the first wavelength and some collimated image light of the second wavelength into the optical first waveguide; and

[0211] The first optical in-coupling portion may be configured to pass at least some other collimated image light of the second wavelength, and to pass collimated light of the third wavelength to the second optical in-coupling portion.

[0212] The plurality of first hyperfocal spots may be configured to selectively reflect collimated image light of the first wavelength and the second wavelength received from the first optical in-coupling portion as a first discrete light spot beam.

[0213] The second optical input coupling portion may be configured to selectively input couple the collimated image light of the second wavelength and the third wavelength received from the first second optical coupling portion into the second optical waveguide substrate.

[0214] The plurality of second hyperfocal spots may be configured to selectively reflect the collimated image light of the second wavelength and the third wavelength received from the optical input coupling portion as a second discrete spot beam.

[0215] The first wavelength may correspond to a first color, the second wavelength to a second color, and the third wavelength to a third color.

[0216] The first color may include blue, the second color may include green, and the third color may include red.

[0217] The system may further include a third optical waveguide substrate; wherein the first optical input coupling portion is further configured to allow collimated image light of a second wavelength and a third wavelength to pass through; the first, second and third wavelengths are different from each other; wherein the second optical input coupling portion is further configured to allow collimated image light of at least a third wavelength to pass through; and a third optical input coupling portion, which is configured to couple the collimated display image light of at least a third wavelength received from the second optical input coupling portion into the second optical waveguide substrate in the exit pupil expansion direction; wherein the third optical input coupling portion is integrated with and / or separated from the third optical waveguide substrate; a third optical hyperfocal output coupling portion integrated with the third optical waveguide substrate; wherein the third optical hyperfocal output coupling portion is a first discrete light spot beam reflected from at least the first wavelength and a second discrete light spot beam reflected from at least the second wavelength The discrete light spot bundle is at least partially transparent; wherein the third optical output coupling portion includes one or more third hyperfocal reflective viewports integrated with the third optical waveguide substrate; wherein each third hyperfocal reflective viewport includes a third discrete optical hyperfocal reflector spot integrated with the third optical waveguide substrate: wherein the third discrete optical hyperfocal reflector spot is configured to at least partially reflectively project discrete portions of optical input display image light of at least a third wavelength received from the third optical input coupling portion onto a target area located at a predetermined working distance from the third hyperfocal reflective viewport as a third discrete light spot bundle of light, wherein the aperture of the third discrete optical hyperfocal reflector spot is sized so that the third discrete light spot bundle of at least the third wavelength forms a view of a virtual display image portion, as seen by a lens detector that can be located at the target area, the virtual display image portion is hyperfocused.

[0218] The first optical input coupling portion can be configured to selectively couple collimated image light of a first wavelength into the optical first waveguide; and wherein the first optical input coupling portion is configured to pass collimated image light of a second wavelength and a third wavelength to the second optical input coupling portion; wherein the plurality of first hyperfocal spots can be configured to selectively reflect the collimated image light of the first wavelength received from the first optical input coupling portion as a first discrete spot beam; wherein the second optical input coupling portion can be configured to selectively couple collimated image light of a second wavelength received from the first second optical coupling portion into the second optical waveguide substrate, and wherein the first The second optical input coupling portion may be configured to allow the collimated image light of the third wavelength received from the first optical input coupling portion to pass therethrough; wherein the plurality of second hyperfocal spots may be configured to selectively reflect the collimated image light of the second wavelength received from the optical input coupling portion as a second discrete light spot beam; wherein the third optical input coupling portion may be configured to selectively couple the collimated image light of the third wavelength received from the second optical coupling portion into the third optical waveguide substrate; wherein the plurality of second hyperfocal spots may be configured to selectively reflect the collimated image light of the third wavelength received from the third optical input coupling portion as a third discrete light spot beam;

[0219] The first wavelength may correspond to a first color, the second wavelength may correspond to a second color, and the third wavelength may correspond to a third color.

[0220] The first color may include blue, the second color may include green, and the third color may include red.

[0221] A plurality of first optical hyperfocal reflector spots may be spaced apart from each other in a first pattern extending in an exit pupil expansion direction along a first optical waveguide substrate, and are collectively configured to gradually extract collimated display image light input light of at least a first wavelength from a pupil exit expander; wherein the plurality of second optical hyperfocal reflector spots may be spaced apart from each other in a second pattern extending in an exit pupil expansion direction along a second optical waveguide substrate, and are collectively configured to gradually extract collimated display image light input light of at least a second wavelength from a pupil exit expander; and wherein the plurality of third optical hyperfocal reflector spots may be spaced apart from each other in a third pattern extending in an exit pupil expansion direction along a second optical waveguide substrate, and are collectively configured to gradually extract collimated display image light input light of at least a third wavelength from a pupil exit expander.

[0222] A plurality of first optical hyperfocal reflector spots, a plurality of second optical hyperfocal reflector spots and a plurality of third optical hyperfocal reflector spots can be distributed in the first optical waveguide substrate, the second optical waveguide substrate and the third optical waveguide substrate respectively relative to each other, so that the hyperfocus views formed by the first discrete spot beam, the second discrete spot beam and the third discrete spot beam in the target area do not overlap with each other.

[0223] The one or more optical output coupling portions may comprise a diffractive optical output coupler, each reflection spot of the diffractive optical output coupler comprising a diffraction grating.

[0224] One or more of the optical input coupling sections may comprise a diffractive light input coupler.

[0225] The system may further include a pupil expansion region operably coupling the optical input coupling portion to the output coupling portion.

[0226] The pupil expansion region may include a diffraction expansion grating.

[0227] Incorporation by Reference

[0228] All publications mentioned herein are incorporated herein by reference to disclose and describe the apparatus, methods and / or materials in connection with which the publications are cited. All publications, patents and patent applications mentioned in this specification are incorporated herein by reference in their entirety and for all purposes as if each individual publication, patent or patent application was specifically and individually indicated to be incorporated by reference.

[0229] The publications discussed or referenced herein are provided solely for their disclosure prior to the filing date of the present application. Nothing herein is to be construed as an admission that the present invention is not entitled to antedate such publication by virtue of prior invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0231] In order that the present invention may be more readily understood, reference will now be made to the accompanying drawings, in which:

[0232] Figure 1A is a schematic ray diagram illustrating matched optical convergence and accommodation of a human eye observing a real-world scene;

[0233] Figure 1B is a schematic ray diagram illustrating an optical convergence-accommodation mismatch associated with conventional optical systems used in augmented reality systems and virtual reality systems;

[0234] Figure 2 is a conceptual diagram of an optical hyperfocal reflective system according to an embodiment of the present technology;

[0235] Figure 3is a simple geometric ray diagram showing the circle of confusion rendered by a lens on an optical detector;

[0236] Figure 4 is a simple geometric ray diagram showing Figure 3 How the circle of confusion is adjusted is shown;

[0237] Figure 5 shows how the hyperfocal aperture in a binocular configuration at the entrance to the eye pupil provides an accommodation range from the hyperfocal distance (H) to infinity;

[0238] Figure 6 shows a binocular optical hyperfocal reflection system according to an embodiment;

[0239] Figure 7 shows a binocular optical hyperfocal reflection system according to an embodiment;

[0240] Figure 8 A near-eye augmented reality display system according to an embodiment is shown;

[0241] Fig. 9A According to the embodiment, Figure 8 Optical hyperfocal reflective system used in display systems;

[0242] Fig. 9B According to an embodiment, a method for Figure 8 Optical hyperfocal reflective system used in display systems;

[0243] Fig. 10A yes Fig. 9A an enlarged view of a portion of an optical hyperfocal reflector system showing a hyperfocal reflector spot according to an embodiment;

[0244] Fig. 10B is an enlarged view of a portion of an optical hyperfocal reflector system showing a hyperfocal reflector spot according to an embodiment;

[0245] Fig. 10C yes Fig. 9B an enlarged view of a portion of an optical hyperfocal reflector system showing a hyperfocal reflector spot according to an embodiment;

[0246] Fig.11 is an optical hyperfocal reflective system according to an embodiment;

[0247] Fig.12 is an optical hyperfocal reflective system according to an embodiment;

[0248] Fig.13 is an optical hyperfocal reflective system according to an embodiment;

[0249] Fig.14 is a diagram showing a method for Fig. 9B A graph of the dependence of reflectivity on the incident angle of light for each of the optical hyperfocal reflector spot sequences of the angle selective notch filter in the optical hyperfocal reflector system;

[0250] Fig.15 is a diagram showing the image seen at the eye according to an embodiment Fig.14 A graph of the net angular response of the optical hyperfocal reflector spot sequence mentioned in;

[0251] Fig.16 shows a single hyperfocal reflective viewport individually captured in accordance with an embodiment;

[0252] Fig.17 shows what the eye sees without a viewport Fig.16 The image is projected at infinity;

[0253] Fig.18 Shows Fig.16 The virtual image formed by the eye through the hyperfocal reflective viewport;

[0254] Fig.19 shows a plurality of hyperfocal viewport elements distributed according to an embodiment;

[0255] Fig. 20 The diagram shown is seen by the eye and by Fig.19 A hyperfocused virtual image spot view formed by a hyperfocal viewport element;

[0256] Fig.21 shows a plurality of hyperfocal viewport elements distributed according to an embodiment;

[0257] Fig. 22 According to one embodiment, Fig.21 A hyper-focused virtual image spot view formed by a hyper-focal reflective viewport element;

[0258] Fig.23 According to an embodiment, Fig.21 A hyper-focused virtual image spot view formed by a hyper-focal reflective viewport element;

[0259] Fig.24 An optical hyperfocal reflective system according to an embodiment is shown;

[0260] Fig.25 An optical hyperfocal reflective system according to an embodiment is shown;

[0261] Fig.26 A typical emission spectrum of the image source is shown;

[0262] Fig. 27showing a plurality of optical hyperfocal reflective viewports according to an embodiment;

[0263] Fig.28 showing a plurality of optical hyperfocal reflective viewports according to an embodiment;

[0264] Fig.29 showing a plurality of optical hyperfocal reflective viewports according to an embodiment;

[0265] Fig.30 shows an image of a hyperfocused spot as seen by a detector according to a computer program model according to an embodiment;

[0266] Fig.31 shows an image of a hyperfocused spot as seen by a detector according to a computer program model according to an embodiment;

[0267] Fig.32 shows an image of a hyperfocused spot as seen by a detector according to a computer program model according to an embodiment;

[0268] Fig.33 shows an image of a hyperfocused spot as seen by a detector according to a computer program model according to an embodiment;

[0269] Fig.34 An optical augmented reality display system according to an embodiment is shown;

[0270] Fig.35 An optical hyperfocal reflective system according to an embodiment is shown;

[0271] Fig.36 An optical hyperfocal reflective system according to an embodiment is shown;

[0272] Fig.37 is a perspective view of an optical hyperfocal reflection system according to an embodiment;

[0273] Fig.38 According to an embodiment, Fig.37 A perspective view of the optical hyperfocal reflective system of the system;

[0274] Fig.39 yes Fig.38 A top view of the system;

[0275] Fig.40 is a perspective view of an optical hyperfocal reflection system according to an embodiment;

[0276] Fig.41 yes Fig.40 A top view of the system;

[0277] Fig.42illustrates a gaze direction of an eye observing a first real-world object plane and a computer-generated edited display image through an optical hyperfocal reflection system according to an embodiment;

[0278] Fig.43 shows the gaze direction of an eye observing a second real-world object plane and a computer-generated edited display image through an optical hyperfocal reflection system according to an embodiment;

[0279] Fig.44 An eye tracking camera module configured in a direct viewing configuration according to an embodiment is shown, the eye tracking camera module tracking an eye viewing a real world scene through an optical hyperfocal reflective system;

[0280] Fig.45 An eye tracking camera module configured in an indirect viewing configuration according to an embodiment is shown, the eye tracking camera module tracking an eye viewing a real world scene through an optical hyperfocal reflective system;

[0281] Fig.46 is a block diagram of various control systems for optimizing a hyperfocused human eye view of a virtual image of an optical hyperfocal reflective system, according to an embodiment;

[0282] Fig.47 is a simplified illustration of head-mounted display glasses including an optical hyperfocal reflective system according to an embodiment;

[0283] Fig.48 is a simplified illustration of a head mounted display visor including an optical hyperfocal reflective system according to an embodiment; and

[0284] Fig.49 is a diagrammatic representation of an exemplary machine in the form of a computer system for augmented and / or virtual reality displays.

[0285] Detailed Description of the Preferred Embodiments

[0286] In the following description, for the purpose of explanation rather than limitation, specific details such as specific embodiments, processes, techniques, etc. are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details.

[0287] Applicants herein have identified one or more significant shortcomings of optical image delivery systems used in virtual reality and augmented reality displays (such as, but not limited to, head-mounted displays, including near-eye displays and heads-up displays).

[0288] One such disadvantage is the undesirable effect of the so-called optical vergence-accommodation conflict. Vergence is the simultaneous movement of the two eyes in opposite directions to obtain or maintain single binocular vision. The vergence movement is closely related to the accommodation of the eye. Accommodation is the process by which the eye of a vertebrate changes the optical power to maintain a sharp image or focus on an object as the distance of the object changes. Under normal conditions, changing the focus of the eye to see objects at different distances will automatically cause vergence and accommodation.

[0289] The so-called vergence-accommodation optical conflict effect is the result of a display screen creating a virtual image at a fixed optical distance from the observer, but the observer's eyes automatically adjust their optical focus based on the perceived distance of the objects they are looking at in the virtual image and / or the real-world scene. In augmented reality displays, the conflict is the result of simultaneously viewing a virtual image at a finite focal distance that does not correspond to the real-world focal distance for a given vergence angle.

[0290] Figure 1A and Figure 1B is a schematic diagram generally illustrating the optical convergence-accommodation mismatch problem associated with conventional optical systems used in augmented reality systems and virtual reality systems. In real-world viewing, convergence and accommodation work together without conflict, as shown by Figure 1A , where the vergence distance / plane and focal length / plane are compatible, i.e. the human eye is rotated to aim or fixate on the real world scene, and has adapted to keep the real world image in focus. In augmented reality displays, and also in virtual reality displays, when the focal plane is fixed, the display can easily simulate the vergence component of different focal planes, but cannot simulate the accommodation component. Therefore, there is a conflict between the two.

[0291] As Figure 1B In the example of FIG. 1 , an optical display generates a 3D virtual image of an object, which is perceived by the eye as being identical to the object. Figure 1A The human eye automatically rotates and aims the virtual image of the object based on the object's perceived distance beyond the display screen, making the vergence component Figure 1A, the vergence component shown remains unchanged. However, the human eye naturally adapts to keep the 3D virtual image in focus at the focal plane of the display screen itself, which is significantly smaller than the vergence distance. A similar conflict occurs when the virtual image of an object generated by the display is perceived as being closer to the human eye than the actual focal plane of the display screen. Vergence-accommodation conflict can lead to double vision, reduced visual clarity, visual discomfort, and fatigue [see the following articles: Kooi, FL and Toet, A. "Visual comfort of binocular and 3D displays", Displays, 25, 99-108. doi: 10.1016 / j.displays.2004.07.004; Lambooij et al., "Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review", Journal of Imaging Science and Technology. 53(3):030201-030201-14, 2009; and Shibata T, Kim J, Hoffman DM, Banks MS, “The zone of comfort: Predicting visual discomfort with stereo displays,” Vis. 2011 Jul 21;11(8):11. doi:10.1167 / 11.8.11; each of these articles is incorporated herein by reference.

[0292] As a result of the vergence-accommodation conflict, binocular augmented reality systems have difficulty producing convincing three-dimensional images because the angular difference between the images sent to the left and right eyes that convey the distance of an object (convergence) does not match the depth at which the eyes must focus to form a clear image (accommodation).

[0293] The above optical problems can be alleviated by aspects of the present technology, which allow optical systems and methods to provide improved optical delivery that is superior to known virtual reality and / or augmented display systems. Optical systems and methods according to various aspects of the present technology will now be described in more detail for some exemplary augmented reality and virtual reality display systems. However, it will be understood that in some other aspects and embodiments, the present technology can be configured for augmented reality and / or virtual reality systems other than those shown in the examples, and can even be configured for other types of optical delivery systems used in imaging applications to deliver an improved viewing experience.

[0294] As will be explained in more detail below with reference to various aspects and embodiments of the present technology, an optical hyperfocal reflective system is provided that can be used in an augmented reality or virtual reality display system to allow for the reduction of convergence and accommodation optical conflicts. The system employs a hyperfocal reflective viewport to manipulate convergence in a display so as to allow eye accommodation to more closely match convergence. One or more hyperfocal reflective viewports may be employed in any type of optical redirection system for an augmented or virtual reality display that is configured to redirect a collimated display image into a human eye using some form of reflection. The resulting optical system (referred to herein as an optical hyperfocal reflective system) delivers an image to the eye using a hyperfocal reflective viewport structure, extending the focus accommodation range beyond that of the source image. The hyperfocal reflective viewport of the system reduces the optical effects of the convergence-convergence conflict by allowing the accommodation plane to move toward the convergence plane and maintaining a sharp image.

[0295] The optical hyperfocal reflective system can be implemented using different methods. In some methods, the optical hyperfocal reflective system is implemented as a perspective optical combiner or a non-perspective optical combiner. In some embodiments, the optical hyperfocal reflective system is a system based on an optical waveguide. In other embodiments, the optical hyperfocal reflective system is a system based on a free space optical reflector / combiner, or other types of optical modules that are configured to reflectively relay a collimated display image of a virtual or augmented reality display or other optical system.

[0296] As a general approach, an optical hyperfocal reflective system has an optical substrate. An optical input coupling portion is configured to couple a collimated display image input to the optical substrate. An optical hyperfocal output coupling portion is integrated with the optical substrate. The optical output coupling portion includes one or more hyperfocal reflective viewports. The hyperfocal reflective viewports include discrete optical hyperfocal reflector spots integrated with the optical substrate. The discrete optical hyperfocal reflector spots are configured to reflectively project discrete portions of the optically input coupled display image light onto a lens-detector system or a target area in which the lens-detector system will be placed as discrete spot bundles of light that form discrete virtual display image portions. The target area defined here refers to an area covering possible display viewing positions of a lens-detector system for viewing the discrete virtual display portion. The lens-detector system or the target area in which the lens-detector system will be placed for viewing the discrete virtual display portion is located at a predetermined working distance from the hyperfocal reflective viewport.

[0297] In some approaches, the lens detector system is a human eye. In other approaches, the lens detector system includes any optical lens detector device. In some embodiments of the optical lens-detector device, the optical lens-detector device is an optical lens or lens assembly coupled to a sensor device such as a digital or analog sensor. In some embodiments, the optical lens detector device is a camera system. Further, it should be understood that while reference is made to the human eye and its components in some embodiments described herein, the lens detector system may alternatively be another type of system, such as any of the aforementioned optical lens detector devices. Further, it should be understood that while reference is made to the optical lens detector device in some embodiments described herein, in other embodiments, the lens detector device may alternatively be a human eye system.

[0298] The aperture size of the discrete optical hyperfocal reflector spot is determined to form a virtual image hyperfocal spot of aperture diameter D at a target area of ​​an eye or other lens-detector system, such that the discrete spot beam forms a view of the portion of the virtual display image seen by the lens-detector system that is hyperfocused. The size of the virtual image hyperfocal spot at the target area is the effective (not actual) aperture size of the lens-detector system that results in a hyperfocused view of the portion of the virtual display seen by the lens-detector system when the lens-detector system is placed in the target area. For the lens-detector system, the effective aperture thus corresponds to the cross-section of the discrete spot beam portion of the virtual image forming light rays that enter the lens to present a real image spot (called a circle of confusion) on the detector of the lens-detector system. As will be explained in more detail with reference to specific embodiments, given the working distance of the hyperfocal viewport from the lens-detector system, the hyperfocal reflector viewport is much smaller than the lens of the lens-detector system to narrow the light rays, thereby providing a circle of confusion having a similar size to the lens-detector system.

[0299] To explain the purpose of the optical hyperfocal viewport in more detail, reference will now be made to Figure 2 , Figure 2 is a conceptual diagram of an optical hyperfocal reflective system according to an embodiment of the present technology. For ease of illustration and explanation, Figure 2 Elements shown in the drawings and other figures herein are not drawn to scale.

[0300] exist Figure 2In the embodiment of the present invention, the optical hyperfocal reflective system 100 is implemented as an augmented reality optical combiner, whereby, in use, the system reflectively transmits a virtual image overlaying the real world being observed by the human eye of an observer of the display system. The system 100 is implemented as a waveguide space optical combiner. However, in other embodiments, the optical hyperfocal reflective system can be implemented as a free space optical combiner, a non-see-through optical combiner (waveguide space or free space), or any type of optical module configured to reflectively relay a collimated display image of a virtual or augmented reality display or other optical system. In addition, as described above, in some embodiments, other types of optical lens-detector systems can be used in addition to the human eye.

[0301] like Figure 2 As shown, the optical hyperfocal reflective system 100 includes a hyperfocal reflective viewport 102 and a light-guide optical substrate 101. The light-guide optical substrate 101 is at least partially see-through, and typically substantially see-through, for visible light rays 131 from a real-world scene to be observed by a lens-detector system through the substrate 101. The lens-detector system is a human eye 201. In some other embodiments, the lens-detector system is an optical lens-detector device. The substrate 101 is configured such that light rays 131 from a real-world scene enter a front side 113 of the substrate 101 on the same side as the real-world scene, pass through the substrate 101, and exit from a back side 114 of the substrate on the same side as the observer's human eye 201.

[0302] The hyperfocal reflective viewport 102 is integrated with the light-guiding optical substrate 101, which means that it is disposed in the substrate and / or disposed on the surface of the substrate 101. The hyperfocal reflective viewport 102 has a discrete physical viewport aperture 112. For ease of illustration and explanation, the aperture 112 is Figure 2 102 and 105. The hyperfocal viewport aperture 112 refers to the opening through which the optical input light rays 107 of the generated display image input 106 are reflected out of the viewport 102 and thence out of the substrate 101 towards the human eye 201. The light rays 105 reflected from the viewport form a virtual image because they are reflected as collimated rays and a cone of these rays is formed by the angular extent of the hyperfocal viewport, which contributes to the field of view of the display. Virtual image forming rays in the form of a discrete spot beam 105 pass through the viewing lens aperture 115 into the eye lens 205 to present a real image spot 105C (referred to as the circle of confusion) on the retina of the eye.

[0303] In optics, the circle of confusion is a light spot caused by the cone of light from the lens not reaching perfect focus when imaging a point source. It is also called a diffusion disk, a circle of indistinctness, a blur circle or a blur spot. The circle of confusion of the human eye is a light spot caused by the cone of light from the lens of the eye not reaching perfect focus on the retina of the eye. For further explanation of the circle of confusion of the human eye, see, for example, Ray, Sidney F. 2000., including page 52, in The Manual of Photography: Photographic and Digital Imaging, 9th edition, edited by Ralph E. Jacobson, Sidney F. Ray, Geoffrey G. Atteridge and Norman R. Axford., Oxford: Focal Press. ISBN 0-240-51574-9, the entire contents of which are incorporated herein by reference.

[0304] Figure 2 An example of how two different letters "A" and "B" projected to infinity and subtending different angles will be focused on the back of the retina is shown. In each case, a separate circle of confusion (CoC) is formed. The CoC forms the basis of the point spread function of the imaging system and is convolved with each part of the image. The CoC is a blurring spot that is convolved with the scene and makes focus differences appear indistinguishable within the hyperfocal distance, which will be explained in more detail below.

[0305] The size of the reflective viewport 102 is such that the cross-sectional diameter of the discrete spot beam is small enough to allow the eye lens or other lens-detector system to hyperfocus, that is, the eye lens 205 can be focused from a desired distance (H) all the way to infinity while maintaining an acceptably sharp image without changing the image plane position.

[0306] To explain how the hyperfocal reflective viewport 102 is configured to provide hyperfocusing purposes, refer to Figure 3 and Figure 4 , which are simple geometric ray diagrams showing how to adjust the circles of confusion presented to the detector device 402 of the lens detector system 400. The lens detector system 400 includes a viewing lens 401 optically coupled to an optical sensor detector 402. In some embodiments, an optical viewing lens assembly can be used in place of the single lens 401. The optical sensor detector 402 is, for example, a CCD or CMOS image sensor. In some embodiments, such a sensor can employ a rolling shutter or a global shutter. In Figure 3In FIG. 4 , light ray 305 comes from a point source at infinity, and light ray 306 comes from an arbitrary distance H. Light ray 305 at infinity is focused at the focal length f of lens 401. Light ray 306 from H is focused at point f'. At point f', light rays 305 from infinity have expanded beyond their ideal focus and will subtend a region known as the circle of confusion (CoC). If the smallest resolvable spot on detector 402 is larger than the CoC, then the detector will not be able to distinguish between light rays originating from infinity and light rays originating from H. Both images will appear acceptably sharp.

[0307] By comparison Figure 3 and Figure 4 It can be seen that the CoC diameter can be adjusted by reducing the effective pore size D to the desired size. Figure 4 In the example, light 307 originating from infinity passes through the effective lens aperture and Figure 3 The effective lens aperture has a reduced diameter D compared to the effective aperture shown in FIG. Similarly, using the same principle, the effective lens aperture of the human eye is adjusted by projecting a discrete spot beam 105 of diameter D corresponding to the hyperfocal aperture of the eye lens onto the eye lens 205, so that Figure 2 The human eye in FIG. 102 cannot distinguish between the reflected light ray 105 from the hyperfocal reflective viewport and the light ray originating from the hyperfocal distance H. This is the basic definition of the hyperfocal reflective viewport 102.

[0308] for Figure 4 , the modified viewing lens aperture D thus corresponds to the cross-sectional diameter D of the discrete spot beam portion of the image forming light ray 307 that passes through the viewing lens 401 to present a real image spot, i.e., the circle of confusion (CoC'), on the detector 402 of the lens-detector system. Figure 2 As shown, the viewport aperture 112 provides a corresponding modified viewing lens aperture at the pupil entrance of the eye. The modified viewing lens aperture is a viewing lens effective aperture that is smaller than the viewing lens actual aperture and corresponds to the cross-section of the reflected discrete spot beam portion of the virtual image forming light ray 105 that enters the eye lens 205 to present a real image spot 105C (circle of confusion) on the eye retina. Considering the working distance of the hyperfocal viewport from the eye lens, the hyperfocal reflective viewport 102 is much smaller than the eye lens 205 to effectively reduce the virtual image forming light ray, thereby providing a circle of confusion with a similar size to the eye lens 205.

[0309] Thus, the size of the modified viewing lens aperture at the target area of ​​the lens-detector system is the effective (not actual) aperture size of the lens-detector system, which is smaller than the actual aperture diameter of the viewing lens and which results in a hyper-focused view of the portion of the virtual display seen by the lens-detector system when the lens-detector system is placed in the target area.

[0310] Hyperfocal distance has different definitions for those of ordinary skill in the art. One such definition of hyperfocal distance is the closest distance at which a lens can be focused while keeping objects at infinity acceptably sharp. When the lens is focused at this distance, all objects at distances from half the hyperfocal distance to infinity will be acceptably sharp. Another definition is that for a lens focused at infinity, the hyperfocal distance is the distance beyond which all objects are acceptably sharp. Both definitions are consistent. Hyperfocal distance allows a lens to focus from a desired distance (H) all the way to infinity while maintaining an acceptably sharp image without changing the image plane position. For the avoidance of doubt, with reference to the present technology, the hyperfocal distance referred to in this application means the desired distance H, that is, hyperfocal distance allows a viewing lens [such as, but not limited to, the human eye lens] to focus from the hyperfocal distance (H) all the way to infinity while maintaining an acceptably sharp image without changing the virtual image plane position.

[0311] The definition of "acceptable sharp image" is predetermined according to the optical specifications of the system. In some embodiments, an acceptable sharp image refers to an image with a sharpness level predetermined according to a standard value of average human eye performance. In some embodiments, an acceptable sharp image refers to an image with a sharpness level predetermined according to the performance of an individual human eye. In some embodiments, an acceptable sharp image refers to an image with a sharpness level predetermined according to the resolution of an optical detector device (non-human). In some other embodiments, an acceptable sharp image refers to an image with a sharpness level that meets the Nyquist criterion (the circle of confusion should be half the size of the smallest resolvable feature on the display). This will be determined according to the smallest resolvable feature of the lens detector system. For a lens detector system that is a human eye system, if the display is able to display image features that are lower than the smallest resolvable feature of the human eye, according to the standard acceptable value of average human eye performance, then it is clear that the resolution of the eye is the limit of acceptable sharpness. For clarity, acceptable sharpness referred to below means at least an image with a sharpness level that meets the Nyquist criterion (the circle of confusion should be half the size of the smallest resolvable feature on the display). However, acceptable sharpness can be defined according to any of the other aforementioned definitions of acceptable sharpness.

[0312] The equation describing the hyperfocal distance is given by:

[0313]

[0314] H is the hyperfocal distance, the aperture diameter D is the ratio of the focal length f to the F number N; and c is the diameter of the circle of confusion.

[0315] therefore

[0316]

[0317] (For derivations, see, e.g., Derr, Louis, 1868-1923, Photography for students of physics and chemistry, including pages 78 and 79 and the Appendix, published 1906, New York, The Macmillan Company; London, Macmillan & Co. Ltd., the entire contents of which are incorporated herein by reference).

[0318] The given F number is

[0319]

[0320] Therefore, we see that the hyperfocal distance is proportional to f and D:

[0321]

[0322] Examples of values ​​for the human eye's circle of confusion and relationship to the hyperfocal distance based on empirical data have been provided (see, e.g., Ray, Sidney F. 2000., including page 52, in The Manual of Photography: Photographic and Digital Imaging, 9th ed., edited by Ralph E. Jacobson, Sidney F. Ray, Geoffrey G. Atteridge, and Norman R. Axford., Oxford: Focal Press. ISBN 0-240-51574-9, the entire contents of which are incorporated herein by reference). The following example is given by the Ray Sidney reference mentioned above:

[0323] "Normal vision requires muscle activity to change the refractive state of the eye in order to focus. This internal focusing is known as accommodation, and the physiological limit sets sharp vision at a comfortable near distance (Dv) of about 250 mm...For example, under ideal conditions, a high-contrast line 0.075 mm wide can be perceived at Dv subtending an angle of about 1 minute of arc, and represents an image on the retina of the eye that is about 5 microns wide...Extreme performance is rarely achieved, and lower values ​​of 0.1 mm line width at Dv are usually adopted. Converted to resolving power, 0.1 mm of acuity corresponds to a spatial period of 0.2 mm, which is the width of the line plus the adjacent identical spacing (such as used on a bar resolution test target), giving a value of 5 periods per mm for the average human eye."

[0324] The aperture diameter D is determined using equations (1) to (4) above. Rearranging equations (3) to (4) gives the following equation (5) for determining the diameter D of the effective aperture of the eye lens (and hence Figure 2 The diameter of the discrete spot beam 105 at the lens of the eye as shown in FIG.

[0325] In some embodiments, the predetermined hyperfocal distance H for the system is a comfortable close distance for clear vision of the human eye. In this case, the aperture diameter D (which is the diameter of the reflected discrete spot beam at the viewing lens) is determined by equations (3) and (4) using the hyperfocal distance H equal to the comfortable close distance for clear vision of the human eye and the known circle of confusion c for the hyperfocal distance H. In some embodiments, alternatively or additionally, the setting of the hyperfocal distance H is to maintain the net reflectivity of the optical image input light to provide the desired display efficiency.

[0326] As a non-limiting example, when focused at infinity, the focal length of the lens of the eye is approximately 16 mm. When focused at the hyperfocal distance of 0.25 m, the focal length f of the eye is approximately 15.04 mm. According to the empirical treatment set forth in the above-mentioned reference Ray, Sidney F. 2000, for a spatial period of 0.2 mm, the circle of confusion is approximately 13.3 microns. The diameter of the aperture in front of the eye that gives a retinal resolution-limited focus from 0.25 m to infinity is as follows:

[0327]

[0328] Thus, in the above example, the aperture diameter D corresponding to the ideal pupil diameter for hyperfocus from infinity to 0.25 m is 210 microns on the eye lens. The hyperfocal viewport aperture 112 is configured to have the same or substantially the same aperture diameter. Since the light rays 105 are substantially parallel, the viewport aperture 112 projects substantially similar sized discrete spots of reflected light on the eye lens. For systems where the optical substrate is an optical waveguide substrate, the light rays 105 are parallel or substantially parallel. For systems where the optical substrate is an optical free space combiner substrate or other non-waveguide substrate, the light rays 105 may be parallel or substantially parallel, while in some other embodiments, they may diverge away from the hyperfocal reflective viewport rather than be parallel, in which case the discrete spot diameter D at the viewing lens may be larger than the viewport aperture 112, but may be determined by simple geometry.

[0329] The above example illustrates how to determine the aperture diameter of the hyperfocal reflective viewport for a given hyperfocal distance. It should be understood that the pupil diameter for hyperfocus on the eye lens can be calculated using other empirical data and is not limited to the specific values ​​set forth in the above reference Ray, Sidney F.

[0330] In some embodiments, the angular resolution of a head mounted display or near eye display, or other display system in combination with an optical hyperfocal reflective system, is used in combination with the Nyquist criterion to determine the size of the circle of confusion. The circle of confusion is predetermined to be half the size of the smallest resolvable feature on the image displayed at the exit pupil of the display system. In some embodiments, the circle of confusion is predetermined to be less than half the size of the smallest resolvable feature.

[0331] Referring now in more detail to near-eye waveguide displays and other types of augmented reality display systems according to some embodiments, the optics involved in the design of these displays determine the field of view (FOV), resolution, and image position (x, y, and z), among other details. In the real world, our depth perception is driven by two main factors. Convergence; the inward rotation of the eye to maintain fixation on an object. Accommodation; the adaptation of the eye lens to maintain a sharp, "focused" image on the retina. As previously discussed, a vergence-accommodation optical conflict occurs when the focal plane and the vergence plane are not aligned. In a waveguide display, the image is propagated through the waveguide with the focal plane at infinity. Such AR displays exhibit a more severe vergence-accommodation conflict when the vergence plane is not within the CoC of the accommodation plane (where the displayed image is focused). Research by Robert Konrad et al. has shown that convergence can drive accommodation (see "Accommodation-invariant Near-eye Displays", SIGGRAPH July 2017, Robert Konrad, Nitish Padmanaban, Keenan Molner, Emily A. Cooper, Gordon Wetzstein, the contents of which are incorporated herein by reference). This difference in convergence and accommodation often leads to disorientation and nausea.

[0332] In waveguide based displays, the initial focal plane is chosen to be at infinity so as not to lose resolution. This is because waveguides maintain angular information but not positional information. The only way to have an image with only angular information is to correct it for infinity. The display can be manipulated to cause the eye to converge at closer distances, but the accommodation of the eye will remain at infinity, which results in a VAC. Push-pull lenses can be used to bring the focal plane closer, but this results in additional components, increases the overall form factor, and ultimately provides a single focal plane. Waveguide based displays, by the very nature of their operation, are forced to carry an image with a focal plane at infinity, and deviation from this results in a loss of resolution. As will be explained in more detail below, by using a hyperfocal reflective viewport to deliver the image to the eye after the image has passed through the waveguide, the image focused at infinity can be viewed and accommodated by the user in a focal plane other than infinity, thereby eliminating the convergence difference.

[0333] To more fully explain how a hyperfocal reflective viewport can be used to eliminate convergence differences, reference will now be made to the accompanying drawings. Figure 5 and Figure 6 . Figure 5It is shown how a hyperfocal aperture 115 of diameter D in a binocular configuration at the pupil entrance of the eye 201 provides an accommodation range from the hyperfocal distance H to infinity. A convergence plane 140, i.e., the plane at which the lines of sight or visual axes of the two eyes converge to maintain single binocular vision, can be selected within a range of convergence 141 from H to infinity and used to determine the plane that is most comfortable to accommodate to maintain an acceptably sharp virtual image. Since the rays 307 originate from infinity, each hyperfocal aperture 115 can be moved further away from the eye along the line of sight without changing the hyperfocal performance. In a similar manner, the hyperfocal reflective viewport 102 embedded in the waveguide acts as a hyperfocal aperture for the projected display image.

[0334] As an example, Figure 6 A binocular optical hyperfocal reflective system according to an embodiment is shown, which has an optical hyperfocal reflective system 100 for each eye 201. A hyperfocal reflective viewport 102 is provided in a respective optical waveguide substrate 101, one for each eye 201. In each optical hyperfocal reflective system 100, an aperture 112 of the hyperfocal viewport is a two-dimensional aperture defined by tilted discrete reflector spots 103 embedded in the waveguide substrate 101. The substrate 101 is a geometric optical waveguide substrate.

[0335] The reflector spot 103 can be provided by any type of optical element that is configured to reflectively project discrete portions of the optical input light 107 out of the optical waveguide substrate and into the eye lens or eye target area (or other optical viewing lens-detector system) as a discrete light spot beam of substantially parallel or divergent light rays 105.

[0336] The type of discrete reflector spots used can vary. Figure 6 In some embodiments, the one or more tilted reflector spots are optical reflective coatings or layers disposed in at least one tilted plane relative to the virtual image input wave propagation axis or exit pupil expansion direction of the optical waveguide substrate, such as an optical layer including one or more metal layers or dielectric layers. In some other embodiments, the type of discrete reflector spots is selected based on the type of optical device to be used in the virtual reality or augmented reality system, such as a free space optical combiner, other exit pupil expander, or other waveguide-based optical device, such as but not limited to any class of reflective (isotropic and anisotropic), diffractive, holographic, switchable and addressable or MEMS waveguide technologies.

[0337] In some embodiments, one or more reflector spots are diffractive optical elements that can be arranged in a plane that is tilted or parallel to the propagation axis of the waveguide substrate. Optical diffractive optical elements configured in transmission mode or reflection mode can be used as reflector spots. Diffractive optical elements in transmission mode effectively act as reflector spots because they are arranged on or embedded in the optical waveguide and are used to direct the waveguide reflected light out of the waveguide.

[0338] A discrete spot beam 105 having a spot size corresponding to a hyperfocal aperture 115 is projected onto the eye lens through a hyperfocal reflective viewport in the waveguide substrate 101. The hyperfocal viewport aperture 112 corresponds to the reflector spot aperture and has a cross section selected accordingly using simple geometry so that the reflected light rays 105 emerging from the viewport aperture 112 still represent a 1D viewport aperture 112 to provide a discrete spot beam 105 having a diameter D at the viewing lens, the diameter D being determined according to the above example. Thus, the hyperfocal reflective viewport 102 having a 2D aperture is configured as a hyperfocal viewport for the projected display image. The position of the hyperfocal viewport 102 and the reflector spot tilt angle relative to the eye are selected so that the convergence plane 140 is within a range from H to infinity and is used to determine the plane most suitable for accommodation to maintain an acceptably sharp image. The position of the hyperfocal viewport 102 relative to the eye is determined by the position of the optical waveguide substrate 101 and the positions of the individual viewports 102 in the substrate optical waveguide substrate.

[0339] The aperture diameter of each hyperfocal viewport (i.e., the diameter of the discrete reflector spot aperture of that viewport) is sized small enough so that the human eye view or other optical lens-detector view of the discrete portion of the virtual image formed is hyperfocused. Each eye is able to adjust the virtual image formed by the discrete spot beam 105 over a range from infinity up to the hyperfocal distance of the eye lens without any loss of resolution of the virtual image spot. To this end, the diameter D of the discrete spot beam 105 at the viewing lens is determined using the process described above for calculating D. In turn, the discrete reflector spot aperture size is determined based on the calculated D, taking into account the reflector spot tilt angle.

[0340] In embodiments where the reflector spot beam is divergent rather than strictly parallel, the divergence of the beam is also taken into account to determine the discrete reflector spot aperture size from D by considering the angular position of the reflector spot relative to the eye lens, the distance between the reflector spot and the eye, and the divergence angle.

[0341] In some embodiments, the reflector spot aperture size is selected so that the diameter of the discrete spot beam projected at the eye lens is equal to the calculated diameter D. In some other embodiments, the reflector spot aperture size is selected so that the diameter of the discrete spot beam projected at the eye lens is less than the diameter D. As a non-limiting example, in some methods of the optical hyperfocal reflective system of any embodiment disclosed herein, the working distance between the hyperfocal reflective spot and the eye target area of ​​the human eye is typically between about 10 mm and 75 mm, and the hyperfocal reflector spot aperture size is typically about 100 to 1000 microns in diameter. In some embodiments, the hyperfocal reflector spot aperture size is less than 1000 microns. Note that other working distances and hyperfocal reflector spot sizes are contemplated and will vary depending on the type of display system used and the type of optical lens detector system used to view the hyperfocal spot image.

[0342] Using the above method, multiple hyperfocal reflective viewports 102 can be used in an optical hyperfocal reflective system to create an augmented reality display overlaid on a real-world projected image, which can converge and adjust on a plane other than infinity, even though the original projected image is at infinity. This allows for the provision of AR displays based on compact waveguides, or AR displays based on other types of optical reflective systems. Although Figure 6 The optical hyperfocal reflective system is a waveguide-based optical combiner, but the hyperfocal reflective viewport 102 can be incorporated into other reflective systems that either use waveguide technology (such as but not limited to any class of reflective (isotropic and anisotropic), diffractive, holographic, switchable and addressable or MEMS waveguide technology), or in non-waveguide systems (such as free space combiners and even non-combiners using such systems).

[0343] One disadvantage of each hyperfocal reflective viewport 102 being located away from the eye is that the field of view accessible to the eye at any one position is reduced compared to a hyperfocal aperture at the eye.

[0344] As a general approach, a pattern or distribution of multiple hyperfocal viewports is provided in the optical hyperfocal reflective system to allow the eye 201 to access the entire field of view of the display. The multiple hyperfocal reflective viewports are arranged in a specific configuration in the optical hyperfocal reflective system to extract optical input light rays to expand the exit pupil of the display image generating device, while at the same time as described above with reference to Figures 2 to 6Hyperfocusing of the virtual image is performed in the manner described. As will be explained in more detail with reference to different embodiments, the specific pattern of hyperfocal viewports may vary depending on the type of optical hyperfocal reflective system employed (e.g. waveguide-based or free space combiner or non-combiner). Importantly, the eye 201 receives a unique portion of the display field of view from each viewport to maintain hyperfocus. Oversampling will reduce the hyperfocal effect, while undersampling will create uniformity issues. This will inevitably mean that performance varies from person to person. In some embodiments, in order to achieve desired performance characteristics, the system can be configured to have a distribution of hyperfocal reflective viewports for specific conditions, and the optical performance is then characterized as these conditions vary.

[0345] Reference will now be made in more detail to near-eye waveguide display systems according to some embodiments of the present technology. In a near-eye waveguide based system, multiple hyperfocal reflective viewports are arranged in a waveguide in a specific configuration to progressively extract light rays 107 guided by internal reflections along the waveguide, thereby expanding the exit pupil of the image forming device, while simultaneously providing a plurality of hyperfocal reflective viewports in ... Figures 2 to 6 Hyperfocusing of a virtual image is performed in a manner described.

[0346] As for Figure 7 The optical hyperfocal reflective system 100 of the near-eye system is provided with a plurality of hyperfocal reflector spots 103 arranged in the optical hyperfocal reflective system to allow the human eye virtual image view to be hyperfocused over substantially the entire field of view of the display system and to be adjusted in a plane toward the convergence plane. In this manner, each optical hyperfocal reflective system in the near-eye system is configured as an exit pupil hyperfocal expander for expanding the exit pupil of the image generating display system.

[0347] refer to Figure 8 and Fig. 9A , according to one embodiment, a near-eye waveguide enhanced display system includes a display image generation system 120 and an optical reflective hyperfocal system 100, one for each eye 201 in a binocular configuration. For ease of explanation, Figure 8 and Fig. 9A Only one image generation system 120 and optical hyperfocal reflective system 100 for one left eye 201 is shown in the figure, but it should be understood that the display system includes a similar optical hyperfocal reflective system and image generation system configured for the right eye to form a binocular system. In some embodiments, the optical hyperfocal reflective system for the right eye is a mirror image of the optical hyperfocal reflective system for the left eye. In some other embodiments, the display system is a monocular display system and includes only one optical hyperfocal reflective system 100.

[0348] Figure 8 and Fig. 9A1 is a conceptual diagram illustrating an array of hyperfocal reflective viewports, wherein only a limited number of hyperfocal reflective viewports are shown in a simple distribution for ease of explanation only. Typically, the number of hyperfocal reflective viewports 102 is greater than that shown. However, in some other embodiments, when hyperfocusing of substantially the entire range of the field of view is not required, the number of hyperfocal reflective viewports is less than that shown. Figure 8 An example of a discrete light beam 105 impinging on the eye lens and reaching the retina is shown, forming a reduced circle of confusion of diameter 105Dc compared to the expected circle of confusion of diameter 201Dc for the beam diameter corresponding to the eye lens aperture. For ease of illustration, only one light beam 105 entering the eye is shown. However, in practice, multiple light beams 105 pass through the eye target area, enter the eye lens and reach the retina.

[0349] The image generation system 120 may include any type of suitable near-eye image generation device and any optical device configured to generate the display image 108 and output the display image collimated at infinity to the optical hyperfocal reflection system. As non-limiting examples, the image generation device may be an LED, an LCD display, or a laser-based device or other light source device for generating the display image. The image generation device is implemented as a microdisplay, but may be another type of display in other embodiments. The image generation system includes any optical device required to collimate the display image to infinity, such as a collimating lens.

[0350] The optical waveguide substrate 101 is made of waveguide material, such as but not limited to glass, plastic or other suitable materials. In some embodiments, the substrate material can be magnesium aluminate spinel, photonic crystal and / or other optical materials. The optical waveguide substrate 101 itself is a slab or a planar waveguide substrate. The optical substrate 101 has a Fig. 9A The x-axis arrow 118 is shown as a straight horizontal x-axis extending along the length of the waveguide substrate in the direction of exit pupil expansion. In some other embodiments, the optical waveguide substrate 101 may be curved or other shapes and configurations and have a bent or curved axis. Fig. 9A As best shown, the system 100 has an optical input coupling portion 150 and an optical output coupling portion 160 .

[0351] Various optical input coupling sections and coupling methods are possible. Fig. 9AIn the illustrated embodiment, the optical input coupling portion 150 is the side or end of the waveguide away from the optical output coupling portion 160. The optical input 106 including the collimated display image light 107 is directly injected into the optical input coupling portion 150. In some other embodiments, the optical input coupling portion 150 includes a reflector incorporated in the waveguide to reflectively couple the optical input light 107 injected into the side of the substrate into the guiding space. In some other embodiments, the optical input coupling portion includes one or more other optical coupling components integrated with or separated from the optical waveguide substrate for coupling the optical input 106 into the waveguide. For example, such optical coupling components can be prisms, lens systems and / or diffractive optical elements. In other embodiments, the input coupling portion is a diffractive coupling system, which can include one or more diffractive optical elements integrated with or separated from the waveguide substrate.

[0352] Each reflector spot has an aperture size selected according to the methods described herein so that the hyperfocal viewport projects a discrete spot beam having an aperture D at the eye lens or other optical lens-detector system, thereby providing a hyperfocus of a discrete virtual image. In this way, the eye receives and maintains a hyperfocus of a unique portion of the displayed field of view from each viewport, and maintains a hyperfocus of the entire virtual image.

[0353] The progressive extraction of the optical input light 107 in the direction of the exit pupil expansion along the optical waveguide substrate 101 is achieved in various ways. For the waveguide, the hyperfocal reflector spots are parallel to each other. The waveguide is an "angle device", so by distributing the hyperfocal reflector spots along the waveguide, it is possible to pick off a certain range of angles. Each hyperfocal reflector spot does in principle reflect over the entire angular range, and in some embodiments, the hyperfocal reflector spots are tilted to reflect at least within a maximum and minimum angular range (for example, but not limited to, for example, 40 degrees) controlled by the exit pupil distance (eye relief) of the display system. In Fig. 9A In an embodiment of the invention, progressive extraction is achieved using a pattern of hyperfocal viewports that is a combination of ports with partial hyperfocal reflector spots and ports with fully reflective hyperfocal reflector spots. Each partial hyperfocal reflector spot acts as a beam splitter that reflects only a portion of the incident optical input light ray 107 outward toward the eye lens and transmits another portion along the waveguide in the exit pupil expansion direction to another hyperfocal reflector spot in the reflector sequence that is spaced further away from the optical input coupling portion 150 along the waveguide substrate 101. The fully reflective hyperfocal reflector spots substantially fully reflect the incident optical input light ray 107 and do not allow any optical input light to pass further along the waveguide in the exit pupil expansion direction.

[0354] As Fig. 9A, the output coupling portion 160 includes partially reflective hyperfocal reflector spots 103A1 to 103A2 of the hyperfocal viewport reflector ports 102A1 to 102A2. The first partially reflective hyperfocal reflector spot 103A1 is configured to split a discrete portion 107A of the optical input light 107 incident on the first hyperfocal reflector spot 103A1 into a first discrete spot beam 105A1 and a remaining portion, the first discrete spot beam 105A1 being reflected by the spot toward the eye lens 205, and the remaining portion being transmitted through the spot 103A1 and further reaching the next hyperfocal reflector spot in the reflector sequence, i.e., the second hyperfocal reflector spot 103A2, along the waveguide substrate 101 in the exit pupil expansion direction 118. The second hyperfocal reflector spot 103A2 is configured to partially split the remaining light of the discrete portion 107A incident on the second hyperfocal reflector spot 103A2 into a second discrete spot beam 105A2 and a remaining portion, which is reflected by the spot toward the eye lens 205, and the remaining portion continues to propagate along the waveguide to any next hyperfocal reflector spot until reaching the last partially reflecting hyperfocal reflector spot in the reflector sequence, or until reaching a fully reflecting hyperfocal reflector spot. Since the discrete spot beams 105A1 and 105A2 are reflected by the spots 103A1 and 103A2, respectively, they form respective discrete spot beams of diameter D (D is calculated as described herein) at the target area of ​​the eye, so that when the virtual image spots are viewed by the human eye, they are hyperfocused.

[0355] When fully reflective hyperfocal reflector spots are used, progressive extraction of the displayed image is achieved by configuring the fully reflective hyperfocal reflector spots into a pattern and distribution along the optical waveguide in the exit pupil expansion direction 118 to allow some optical input light rays to pass through the optical waveguide substrate material between the fully reflective hyperfocal reflector spots until they impinge on fully reflective hyperfocal reflector spots further along the waveguide substrate.

[0356] For example, in Fig. 9A , a discrete portion 107B of the optical input display image light 107 propagates into the output coupling portion 160 and initially passes through the optically transparent material between the hyperfocal viewport reflector spots 103. The passing discrete portion 107B continues along the waveguide by total internal reflection without being interrupted by the hyperfocal reflector spots 103 until the discrete portion 107B reaches the totally reflective hyperfocal viewport reflector spot 103B. Since the hyperfocal reflector spot 103B is totally reflective, the reflector spot completely reflects the entirety of the discrete light portion 107B as a discrete spot beam 105B toward the eye lens and blocks any light 107 of portion 107B from being transmitted further down the waveguide.

[0357] In some other embodiments, all hyperfocal viewports have fully reflective hyperfocal reflector spots. For example, in some other embodiments, Figure 8 and Fig. 9A All of the reflective spots 103 in the reflective system shown are fully reflective. When optical input light rays 107 that form a display image travel along the waveguide substrate 101, some of the light rays strike a first hyperfocal reflector spot disposed in a first volume portion of the substrate closest to the optical input coupling portion 150, and are redirected to the eye. However, most of the light rays 107 miss the first hyperfocal reflector spot because they occupy only a small area of ​​the first volume portion. For example, if the spot occupies 5% of the first volume portion, the total reflectivity is also about 5%, and 95% of the image energy passes through the first volume portion further along the substrate to the next volume portion, and so on. The hyperfocal reflector spot reflects light rays that propagate directly into the substrate, but also reflects other light rays that arrive via large "bounces" and strike the hyperfocal reflector spot at a grazing angle.

[0358] In some other embodiments, all of the hyperfocal reflector spots are partially reflective. For example, at least some of the hyperfocal reflector spots each have a reflectivity between about 5-100%. In some embodiments, the reflectivity of at least some of the hyperfocal reflector spots is the same. In some embodiments, the reflectivity of at least some of the hyperfocal reflector spots is different.

[0359] exist Figure 8 and Fig. 9A In the embodiment of the invention, the hyperfocal reflector spot 103 is a reflective coating that is tilted relative to the propagation direction of the guided light in the exit pupil expansion direction 118. In some embodiments, the hyperfocal reflective spot of any of the embodiments herein can be a reflective coating spot. As an example, Fig. 10A yes Fig. 9A 1, showing a hyperfocal reflector spot 103 made of a reflective coating material and having a specular reflecting surface 103S. In some embodiments, the optical hyperfocal reflector spot 103 is made of a reflective material, such as but not limited to a single reflective metal layer or multiple layers of reflective oxide or other materials. Fig. 10C A non-limiting example of a hyperfocal reflector spot made from a multilayer dielectric reflective coating according to one embodiment is shown.

[0360] The hyperfocal reflector spot material can be deposited by known deposition techniques. In some embodiments, injection molding and optical 3D printing using an overmolded reflective layer can be used to form an optical substrate including a patterned area. Fig. 9AIn the illustrated embodiment, the hyperfocal reflector spot is substantially planar and is circular or elongated circular in shape. As will be explained in more detail below with respect to some other embodiments, other specific spot shapes that provide certain advantages with respect to overall virtual image viewing quality may be employed in the present technology.

[0361] In some other embodiments, the or each hyperfocal reflector spot 103 of any system disclosed herein is a diffractive optical element. In some embodiments, the diffractive optical element may be a holographic optical element. Non-limiting examples of such optical elements are Fig. 10B The diffraction grating shown

[0362] The distribution of the angular positions of the hyperfocal reflector spots can be selected so that the hyperfocal viewports project their associated discrete spot beams in a particular distribution over an eye target area at the pupil entrance of the eye. In embodiments where the hyperfocal reflector spots are contained in an optical waveguide, the hyperfocal reflector spots are tilted at the same or substantially the same angle relative to the exit pupil expansion direction. The hyperfocal reflector spots can be tilted at the same angle as the common vertical tilt plane 117, or can be tilted as shown in FIG. Figures 10A-10C The axis of the hyperfocal reflector spot in FIG. 1 is tilted away from the common plane. In some embodiments, the eye target area corresponds to an area over which the eye can have a line of sight or viewing axis to each hyperfocal reflective viewport within substantially the entire field of view of the display, taking into account movement of the eye within the viewing window.

[0363] In some embodiments, the hyperfocal reflector spots 103 of the hyperfocal reflective viewport are angled to project corresponding discrete spot beams of diameter D onto the eye target area in a uniform or irregular pattern depending on specific optical performance requirements.

[0364] In some other embodiments, the hyperfocal reflector spots 103 are disposed on the back or front side of the optical substrate in addition to being disposed within the volume of the optical substrate 101. The hyperfocal reflector spots 103 distributed within and / or on the surface of the transparent optical substrate form a pattern area. In some embodiments, the distribution of the hyperfocal reflector spots 103 is a regular pattern. In some other embodiments, the distribution of the hyperfocal reflector spots 103 is an irregular pattern. In some other embodiments, the distribution of the reflective spots 103 is a combination of regular pattern areas and irregular patterns. For ease of explanation and visualization, the hyperfocal reflector spots are shown enlarged in the accompanying drawings, rather than shown to scale. In addition, not all hyperfocal reflector spots are shown. In practice, the number of hyperfocal reflector spots will depend on the display setting and the size of the viewing lens-detector. For a near-eye display configuration, in a non-limiting example, for a 10 nm square pupil, there are typically 100 to 200 hyperfocal reflector spots in the substrate. For the red, green, and blue systems of the embodiments described herein, in a non-limiting example, there can typically be 300 to 600 spots.

[0365] For ease of manufacture and design, in some embodiments, for example Figure 8 and Fig. 9A As shown, the hyperfocal reflector spots are distributed in a plurality of different planes or planar volume segments 117 spaced apart along the length of the substrate 101. Each plane or segment 117 extends between the top and bottom sides of the substrate 101 and is tilted relative to the propagation axis 116, as shown in FIG. Fig. 9A As shown. The hyperfocal reflector spots in one or more planes 117 are distributed in a pattern not limited to that shown in the figure. The pattern in one or more planes may be a regular pattern or an irregular pattern. In addition, the shape, size, tilt and / or spacing of each hyperfocal reflector spot or at least some of the reflection points may be the same or may be different from each other. Providing reflection spots in multiple different planes or segments allows the system to be more conveniently manufactured from multiple planar substrates of optical material, on which the hyperfocal reflector spots are provided, and which are clamped together to embed the hyperfocal reflector spots into the optical substrate. However, in other embodiments, the hyperfocal reflector spots are not distributed in different planes or segments, but are distributed throughout the volume.

[0366] In some embodiments, the hyperfocal reflector spot 103 closer to the optical input coupling portion 150 has a relatively low reflectivity (a spot of small area), and subsequent hyperfocal reflector spots further away from the optical input coupling portion 105 have a greater reflectivity (a spot of larger area), with the reflectivity gradually increasing farther along the waveguide substrate 101. The ratio of the spot area to the optically transparent gap can be varied to obtain a selected reflectivity at different locations along the waveguide. The thickness of the reflective spot or other element can vary, but is typically, but not limited to, 0.1-1 micrometer (um). In some embodiments, the hyperfocal reflective spot formed by the holographic film layer can be, for example, about 1 micron.

[0367] exist Fig. 9A In the system, the spot shape is a regular shape. In other embodiments, the spots can be regular and / or random shapes. The reflective spots have the same separation distance, but can have different separation distances in other embodiments. The thickness of the reflective spots can also vary for different reflection points. The optical combiner performance and imaging can be controlled and improved by optimizing various reflector parameters, including but not limited to the following: the shape of the hyperfocal reflector spot (regular or random shape), the minimum size of the spot features, the maximum size of the spot features, the degree of randomization on the surface, the thickness of the spot reflective material, the minimum spacing between the spots, the maximum spacing between the spots, and the area fraction occupied by the spots. In some embodiments, at least some of the reflective spots or other elements have a completely or substantially reflective front side and a completely or substantially absorbing back side. Some reflective spots or elements include buried relief reflectors and positive relief reflectors.

[0368] In some embodiments, the optical hyperfocal reflective system is implemented as a free-space optical combiner including a hyperfocal viewport 102. As an example, Fig.12An optical hyperfocal reflective system implemented as a free space optical combiner (non-waveguide combiner) according to one embodiment is shown. The hyperfocal reflector spots 103 are reflective coatings spaced apart in a pattern on the surface of a concave optical substrate 101F. In some other embodiments, the optical substrate 101F may have other profiles or shapes. The optical substrate 101F is made of a partially or substantially transparent material so that light from a real-world image can be seen by the eye. The optical substrate 101F is configured to allow optical input display image light 107 incident on the substrate area between the hyperfocal reflector spots 103 to pass through the optical substrate 101F and / or be reflected away from the eye target area, rather than being reflected to the eye target area or the eye. In some embodiments, such as for virtual reality applications, the optical substrate 101 is opaque, and the optical input display image light 107 incident on the substrate area between the hyperfocal reflector spots is absorbed and / or reflected away from the eye target area or the eye.

[0369] The optical image generating device 120 directs the light input 106 (collimated light 107) to a relay lens 120C which disperses or diffuses the light 107 onto the surface of the concave substrate. The hyperfocal reflector spot 103 is oriented so that the light 107 is reflected as a discrete spot beam 105 to the target area of ​​the eye or the lens of the eye, the angular direction of which has been referred to above. Figure 8 and Fig. 9B The embodiment explained above is necessary to capture the entire field of view of the display in a manner as described in the previous embodiment. Since there is now more than one hyperfocal reflector spot, each hyperfocal reflector spot can be considered individually to provide an associated effective hyperfocal aperture 115 at the viewing lens, and therefore a unique field of view. To this end, the aperture size of each hyperfocal reflector spot 103 is selected to project a discrete display image spot beam having a diameter D at the eye and is calculated as described herein with reference to the above embodiments.

[0370] In a free space combiner or other non-waveguide combiner, access to the display system's field of view is maintained by using a correspondingly distributed and / or tilted hyperfocal viewport, thereby regaining access to the field of view that would otherwise be lost. In some embodiments, the angular position of each hyperfocal reflector spot is individually selected so that the complete display image extracted by reflection from the pattern of hyperfocal reflector spots is directed onto the eye target area or eye lens.

[0371] In some embodiments of a free-space combiner or other non-waveguide combiner, the hyperfocal reflector spot 103 is gradually tilted further horizontally across the horizontal field of view of the display and / or gradually tilted vertically (upward or downward) across the vertical field of view of the display. Other distributions of tilt angles of the hyperfocal reflector spot are contemplated. Fig. 9A and Fig. 10AAs shown in the example in FIG. 1 , the hyperfocal reflector spots 103 are tilted in different planes relative to a common plane 117 in the optical substrate. The hyperfocal reflector spots 103 are tilted at a first angle 103X on the x-axis relative to the common plane 117, and are tilted at a second angle 103Y on the y-axis relative to the common plane 117. In other embodiments, at least some of the hyperfocal reflector spots may be tilted differently or in the same manner in the x, y, z planes (or any combination thereof).

[0372] In some embodiments of a free space combiner or other non-waveguide combiner, to capture substantially the entire field of view of a display system, the hyperfocal reflector spot 103 is tilted gradually further horizontally (at a positive or negative angle 103X relative to the common plane 117, depending on whether the substrate is positioned to the left or right of the eye) in accordance with the extent of the horizontal field of view of the display. In addition, the hyperfocal reflector spot is tilted gradually further vertically (at a positive or negative angle 103Y upward or downward relative to the common plane 117) in accordance with the vertical field of view of the display, such that the hyperfocal reflective viewport captures substantially the entire field of view of the display.

[0373] As already noted above, in some other embodiments, the hyperfocal reflector spots 103 of the hyperfocal reflective viewport are diffractive optical elements, each of which is configured to a specific diffraction order, such that the diffractive optical element, alone or in combination with an optical substrate, effectively reflects a portion of the optical input light as a discrete spot beam 105. As background, diffraction is achieved when light is incident on a structure having the size and order of the wavelength of the light. The repeating or periodic structure results in diffracted light having directions determined by Bragg's law. The diffractive surface is capable of producing multiple beams, that is, the orders and relative intensities of the different diffracted beams depend on the characteristics of the diffractive structure.

[0374] The diffractive optical element is configured with a diffractive structure so that substantially all light rays diffracted by the element are directed in a specific order, that is, so that they form discrete spot beams 105 in a desired direction and profile, thereby forming discrete virtual display hyperfocused views. For example, the optical profile of a diffraction grating can be configured by known methods, such as blazing (changing the angle or shape of the grating grooves without changing its period), and changing the grating pitch, size, shape and density. Fig. 10B A non-limiting example of a hyperfocal reflector spot 103, namely a diffractive optical element 103G, is shown in . In some embodiments where the waveguide is curved, it may be appropriate to vary the grating pitch.

[0375] In some embodiments, the diffractive elements are not tilted, but extend in a plane parallel to the propagation axis of the waveguide and are spaced apart and / or embedded in the waveguide substrate along one or more faces of the waveguide substrate. As an example, Fig.11An optical hyperfocal reflective system implemented as an exit pupil expander according to an embodiment is shown. The hyperfocal reflector spot 103 of the hyperfocal viewport includes a diffractive optical element 103G disposed on the face 111 of the substrate facing the eye. In some other embodiments, the hyperfocal reflector spot diffractive optical element 103G is disposed on the face of the substrate opposite to the face 111 and / or in a parallel plane within the substrate.

[0376] exist Fig.11 In an embodiment of the present invention, the diffractive optical element 103G is a diffractive pinhole. In some other embodiments, some or all of the diffractive optical elements 103G are other types of diffraction gratings or diffractive optical elements, such as holographic diffraction gratings or other optical elements or any combination thereof. The aperture size of the diffractive optical element 103G is selected to project a virtual aperture viewport with a diameter D onto the eye and is calculated as described herein with reference to the above embodiments. In some embodiments, the optical profile of each diffractive element is gradually tuned according to the position of the diffractive element along the substrate in the direction of the exit pupil expansion, so that the light is diffracted in a specific order to provide the desired angular direction of the reflected spot beam 105 relative to the eye lens or the eye target area, which angular direction is necessary to capture the entire field of view of the display in the manner explained above.

[0377] In some aspects of the present technology, the hyperfocal reflective viewport 102 is a wavelength-dependent viewport, thereby providing a wavelength-selective optical hyperfocal reflective system. The hyperfocal reflector spots 103 of the viewport are configured as wavelength-selective hyperfocal reflector spots, so that each reflected discrete spot beam 105 consists of reflected light having only a specific wavelength or a specific wavelength band. In some embodiments, some or all of the wavelength-selective hyperfocal reflector spots are configured to reflect optical input light 107 having the same specific wavelength or the same wavelength band, while transmitting light of other wavelengths. In some other embodiments, one or more wavelength-selective hyperfocal reflector spots are configured to reflect only optical input light 107 having a specific wavelength or a specific wavelength band that is different from the specific wavelength or wavelength band of optical input light 107 reflected by one or more other hyperfocal reflector spots.

[0378] Where appropriate, the wavelength selective hyperfocal reflector spot can be used in any of the various optical reflective hyperfocal systems described herein. The wavelength selective hyperfocal reflector spot can be formed in different ways. In some embodiments, the hyperfocal reflector spot is made of a wavelength selective reflective coating. The wavelength tuned reflective coating is a multilayer dielectric layer or other type of thin film interference optical coating, etc., which is designed to reflect light in a specific wavelength band and not reflect light in a wide wavelength band. The wavelength selective notched hyperfocal reflector spot 103 having the multilayer dielectric layers 103M1 and 103M2 is formed in Fig. 10C In the non-limiting example shown. Fig. 10C Only two multilayer dielectric layers are shown, but there may be more layers than shown. In addition, as already noted above, the drawings are not drawn to scale. For illustrative purposes, Fig. 10C The thickness of the layers shown is exaggerated, and in some embodiments, the thickness is actually a fraction of the wavelength. In some other embodiments, the wavelength selective reflective spot is a diffractive optical element as described herein, and for example by Fig. 10B The non-limiting examples are shown in FIG.

[0379] In some embodiments, the optical hyperfocal reflective system includes a plurality of different wavelength selective hyperfocal viewport groups. Each set of wavelength selective hyperfocal viewports is configured to be selective to different wavelength bands. The wavelength selective hyperfocal reflector spots 103 of each set of hyperfocal viewports are configured to reflect different wavelengths or different wavelength bands. One or more different wavelength-related hyperfocal reflector spot groups can be distributed along the optical substrate of the optical hyperfocal system in the same pattern or in different patterns. In this way, discrete patterned wavelength band-related hyperfocal reflector spots form a reflective hyperfocal viewport for increasing the hyperfocal range of each angular distribution of light for each wavelength band of the projected light.

[0380] In some embodiments, the wavelength selective optical hyperfocal reflective system is configured as a waveguide based system. Fig.13 An optical hyperfocal reflective system including a plurality of different sets of wavelength selective hyperfocal viewports according to one embodiment is shown. A first hyperfocal reflector spot 103λ1 of a first set of hyperfocal viewports 102λ1 is configured to selectively reflect light 107 in a first wavelength band as a discrete spot beam 105λ1 toward an eye lens or an eye target area. The first hyperfocal reflector spot 103λ1 is distributed in a first pattern along a waveguide substrate. A second hyperfocal reflector spot 103λ2 of a second set of hyperfocal viewports 102λ2 is configured to selectively reflect light 107 in a second wavelength band as a discrete spot beam 105λ2 toward an eye lens or an eye target area. The second hyperfocal reflector spot 103λ2 is distributed in a second pattern along a waveguide substrate. A third hyperfocal reflector spot 103λ3 of a third set of hyperfocal viewports 102λ3 is configured to selectively reflect light 107 in a third wavelength band as a discrete spot beam 105λ3 toward an eye lens or an eye target area. The third hyperfocal reflector spots 103λ3 are distributed in a third pattern along the waveguide substrate. The hyperfocal reflector spots 103λ1-103λ3 are configured so that the discrete reflection spot beams 105λ1-105λ3 have an angular direction relative to the eye lens 205 or the eye target area, which angular direction is the same as that described above with reference to Figures 7 to 9B It is necessary to capture the entire field of view of the display in the manner explained. The aperture size of the hyperfocal reflector spot is selected to project a discrete spot beam with diameter D onto the eye, thereby achieving hyperfocal focusing of the virtual image in the manner explained above.

[0381] exist Fig.13 In the illustrated embodiment, the first wavelength band λ1 is a first narrow wavelength band corresponding to red light, the second wavelength band λ2 is a second narrow wavelength band corresponding to green light, and the third wavelength band λ3 is a third narrow wavelength band corresponding to blue light. The optical image generator 120 is an RGB light source, such as but not limited to an RGB LED. In some other embodiments, there may be more than Fig.13 More or fewer different sets of wavelength selective hyperfocal reflector spots are shown. In some other embodiments, the pattern, size, and shape of the wavelength selective spots of each set may be different from Fig.13 In other embodiments, each wavelength band may be different from Fig.13 Those wavelength bands are indicated.

[0382] In some embodiments, the wavelength selective hyperfocal viewports 102λ1 to 102λ3 or other ports shown in system embodiments can be configured as wavelength and angle selective hyperfocal reflective viewports. In some embodiments, one or more hyperfocal reflector spots of such ports are configured to at least partially reflect optical input light rays 107 having an incident angle in a specific angular band selected for a specific reflector relative to the hyperfocal reflector spot, and pass or transmit optical input light rays outside the specific angular band without reflection or reduced reflection. In some embodiments, one or more hyperfocal reflector spots are configured to reflect optical input light rays 107 having an incident angle in a first angular band relative to the hyperfocal reflector spot, and one or more other hyperfocal reflector spots are configured to reflect optical input light rays 107 having an incident angle in a second angular band different from the first angular band relative to the hyperfocal reflector spot.

[0383] The manner in which a wavelength-selective and angle-selective hyperfocal reflector spot is configured to achieve a particular angle selectivity will depend on the type of hyperfocal reflector spot used. For a wavelength-selective hyperfocal reflector spot that is a diffractive optical element, for example but not limited to, Fig. 10B For those shown, the angular selectivity is determined by the type of diffraction grating used, whether the diffraction grating is used in transmission mode or reflection mode, and the diffraction structure known in the art. For wavelength selective hyperfocal reflector spots formed by multiple layers of dielectric coatings or other optical layers, the angular selectivity is determined by the multilayer design. For example, in one embodiment, the wavelength and angle selective hyperfocal reflector spot is formed by wavelength and angle tuned reflective coatings (including but not limited to Fig. 10C The hyperfocal reflector spot 103 is made of 103M1 and 103M2) as shown.

[0384] In some embodiments, one or more of each hyperfocal reflector spot 103 of any embodiment is an angularly selective notch filter hyperfocal reflector spot configured to at least partially reflect optical input light rays 107 having an incident angle in a specific transflectance angle band selected for the specific hyperfocal reflector spot relative to the hyperfocal reflector spot, and to pass or transmit optical input light rays having incident angles above and below the selected specific transflectance band without reflection or reflection reduction. The specific transflectance angle band selected for a specific hyperfocal reflector spot can be the same for each hyperfocal reflector spot, or can be different for one or more hyperfocal reflector spots. In some embodiments, the specific transflectance angle bands selected for the hyperfocal reflector spots of one or more hyperfocal reflective viewport groups can be different.

[0385] In some embodiments, the specific transmission and reflection band of each angle selective notch filter optical hyperfocal reflector spot can be selected based on the order of the reflectors within the reflector sequence in the optical waveguide substrate. This allows for improved performance, particularly in optical hyperfocal reflective systems where the system is implemented as an output hyperfocal extender. Instead of using a reflective coating with a flat angular response, a range of angle selective hyperfocal reflector spots are contained within the optical waveguide substrate and optimized based on the order of their reflectors within the reflector sequence. This configuration of the reflectors ensures that the required angular information is passed through to the correct reflector within the sequence. In addition, the angular response ensures that secondary images are not formed or reduced secondary images are formed and carried to consecutive reflectors, which would otherwise result in undesirable artifacts.

[0386] As an example, Fig. 9B is an optical hyperfocal reflective system according to another embodiment, which is similar to Fig. 9A A system of, but wherein the hyperfocal reflector spot of the hyperfocal viewport is an angle selective hyperfocal reflector spot. According to one non-limiting example, the angle selective notch filter optics hyperfocal reflector spots 103C1 to 103C6 are partially reflective and distributed in a reflector sequence along the waveguide in the exit pupil expansion direction. Fig.14 is a diagram showing a method for Fig. 9B An example graph showing the dependence of reflectivity on the incident angle of input light 107 for each of the angularly selective notch filter optical hyperfocal reflector spots 103C1 to 103C6 in the optical hyperfocal reflector system. Fig.14 It can be seen that the angular dependence of each hyperfocal reflector spot 103C1 to 103C6 in the sequence is tuned to a different notch band of the incident angle of the light ray 107. Fig.14 In the example of FIG. 1 , the positions of the angular notch bands of the hyperfocal reflector spots 103C1 to 103C6 are gradually moved to higher incident angles according to the reflector sequence. Fig.15 is a graph showing the net angular response of optical reflector spots 103C1 - 103C6 as seen at the eye, according to one embodiment.

[0387] In some embodiments, based on the foregoing embodiments, the hyperfocal reflector spots are each configured as both wavelength selective hyperfocal reflector spots and angle selective hyperfocal reflector spots. For example, in some embodiments, the wavelength and angle tuned reflective coatings for each discrete patterned hyperfocal reflector spot can be configured to form a hyperfocal viewport for increasing the hyperfocal range of each angular distribution of light rays 107 for each wavelength band (e.g., red, green, and blue) of the projected light.

[0388] In each of the optical hyperfocal reflective systems described herein, the quality of the virtual image 109 seen by the eye depends on various parameters, such as the distribution of the hyperfocal reflective viewports and the shape of the hyperfocal reflector spots. There is a balance between the distribution of the hyperfocal viewports and undersampling or oversampling with respect to the optimal positioning of the hyperfocal viewports. The amount of sampling required from multiple hyperfocal reflector spots requires a lower limit on the spacing between the hyperfocal reflector spots, which is set by the smallest typical pupil size. Undersampling and oversampling occur when fewer or more than one hyperfocal viewport, respectively, contribute to the redirected image spot formed at the eye. The hyperfocal reflector spot shape is also another parameter used to improve field overlap.

[0389] In some other embodiments, the hyperfocal reflector spots are randomized shapes, but still geometrically distributed, to account for increased pupil size (= increased oversampling). The geometric distribution provides a nominal coverage of the field of view. The randomized shapes ensure that on average the system does not see equal portions of the field from more than one hyperfocal reflector spot simultaneously, which will reduce the HVP effect.

[0390] To more fully understand how to best position and distribute the hyperfocal viewports (HVPs) 102 in the optical reflective relay system described herein, reference will now be made to the accompanying drawings. Figures 16 to 33 . Fig.16 A single hyperfocal reflective viewport 102 is shown placed at position H, with the eye 201 focused on an image projected at infinity. Depending on lighting conditions, for humans, the eye pupil diameter P is typically between about 2 and 8 mm, but can be higher or lower than these values. Fig.17 The same image projected at infinity as seen by the eye (without any HVP directed to the eye) is shown in . In the simplest case of a single hyperfocal viewport at an arbitrary focal length H, Fig.18 As shown, a single image covers the entire FOV (field of view) of the image, which is what the eye sees when focusing at H. Fig.17 The image shown is projected at infinity. Fig.18The single image shown corresponds to the virtual image 109 formed.

[0391] Fig.19 A plurality of hyperfocal viewport elements 102 are shown distributed at a spacing equal to the pupil diameter P, which redirect the Fig.17 projected image 108 from the image plane. Fig.19 The image plane in corresponds to a plane that extends horizontally and vertically along the substrate of any one of the optical hyperfocal reflection systems (waveguide or free - space combiner or non - combiner) described herein, and the ports are distributed on this plane. The distance of the HVP is no longer at position H, but is farther from the eye than the focal length H. Geometrically, many HVP elements 102 are required to form an HVP array of the FOV across the image plane as Fig.19 shown. If for the pupil diameter P, the spacing of the HVP elements is d, then if d = P, the image undergoes undersampling. This means that for a given angle of incidence, there is only one complete HVP element (composed of two halves of consecutive HVP elements), and it results in tiny holes in the field, as Fig. 20 shown by the shaded regions of the image formed as seen by the eye when focused at H.

[0392] In some embodiments of the optical hyperfocal reflection system, by adopting a spacing between the HVP reflector patches of d < P, that is, more than one complete HVP element per pupil diameter, in order to utilize the HVP reflectors to provide oversampling of the pupil, the holes in the image field are alleviated. Fig.21 A plurality of HVP elements are shown distributed at a spacing d less than the pupil diameter P, which redirect the Fig.17 projected image from the image plane. As Fig. 22 and Fig.23 each shows, according to the definition of an acceptable clear image described above, the image seen by the eye is provided with acceptable image quality. However, oversampling introduces tiny blurs as Fig. 22 shown, which increases with the number of HVP elements per pupil, but the impact of the blur is a matter of trial and error, depending on the reflector size and pupil size, which will be explained in more detail below. As Fig.23 shown, there are also enhanced (brighter) regions in the field.

[0393] Fig.24 is Fig.23Perspective schematic of an optical hyperfocal reflection system that employs an optical waveguide where the spacing between HVP reflector patches is d < P, and shows the operation of the system when the eye is focused at a distance H << ∞ (infinity) and the image coupled into the waveguide is at infinity. For ease of illustration and explanation, the viewport is shown as a non-limiting example to be distributed in the same vertical plane 101P of the hyperfocal output coupling section of the optical waveguide in a 1D manner, and there are six HVP reflector patches. However, as described above, in other embodiments, the viewport can be 2D and there can be more HVPs, which can be distributed in the same or different vertical planes of the waveguide. The HVP reflector patches will have the same shape as the viewport, but in the case of an inclined 2D configuration, their size will be adjusted to provide the 1D viewport size, as has been explained above. The number of HVP reflector patches required will also depend on the amount of expansion of the exit pupil of the image generation device that the optical hyperfocal reflection system needs to perform to meet the specifications of a particular augmented or virtual reality system.

[0394] As Fig.24 shown, it includes a virtual image 109 seen by the eye, and this virtual image 109 shows the blurring of the overlapping circular field regions when the hyperfocal viewport 102 is spaced in an optimal manner for the eye pupil size. There is an overlapping region in which, due to oversampling, hyperfocusing deteriorates [is slightly blurred]. This is because a circular viewport produces a circular field of view. To ensure that there are no dark patches (and thus no information loss) in the virtual image seen by the eye, there must be a minimum overlap in the fields of view transmitted by adjacent hyperfocal viewports 102.

[0395] According to some methods, in the optical hyperfocal reflection system of one or more embodiments disclosed herein, the HVPs and thus the corresponding HVP reflector patches are arranged such that there is less interference between the hyperfocal virtual image patches formed at the eye, and the degradation of the overall virtual image seen by the eye is mitigated. According to some embodiments, the degradation of the overall virtual image formed by the hyperfocal virtual image patch view is mitigated by controlling the shape of the hyperfocal reflector patches such that the fields of view transmitted from the respective viewports are in a mosaic pattern.

[0396] According to some embodiments, the HVP element is a hexagonal viewport 102H. As can be seen from Fig.25 it, Fig.25 is Fig.24 a schematic of the system shown, but where the HVP element is shaped as a hexagonal viewport 102H instead of a circular viewport and is arranged in the waveguide plane to form a mosaic of hyperfocal virtual image patches. When the eye is focused at a distance H << ∞ (infinity) and the image coupled into the waveguide is at infinity, the hexagonal viewport reduces the blurring of the overlapping hexagonal field regions of the virtual image 109. From when the system uses a circular viewport, the eye is at Fig.24 What the eye sees in the image is similar to what the eye sees when the system uses a hexagonal viewport (and therefore a corresponding shaped hyperfocal reflector spot) to form a mosaic pattern of hyperfocused virtual image spots. Fig.25 From the comparison of the contents seen in Fig.25 In some embodiments of the present invention, the hyperfocal reflective system is designed to reduce blur due to overlapping fields of view and optimize the viewport separation for the eye pupil size. As a non-limiting example, in some methods of the optical hyperfocal reflective system of any embodiment disclosed herein, the working distance between the hyperfocal reflective spot and the eye target area of ​​the human eye is typically between about 10 mm and 75 mm, and the inter-reflector spot distance is less than 1 mm. In other non-limiting examples, the inter-reflector spot distance is greater than about 500 um. In other other examples, the inter-reflector spot distance is between about 500 um and 8 mm. As noted herein, for such working distances, typical hyperfocal reflector spot aperture sizes are between about 100 and 1000 microns, but are not limited to this size. Note that other working distances, hyperfocal reflector spot aperture sizes, and inter-reflector spot distances are contemplated and will vary depending on the type of display system used and the type of optical lens-detector system intended to view the hyperfocal spot image.

[0397] In some other embodiments, any shape of HVP reflective spots may be employed that form hyperfocal virtual image spots in a mosaic pattern at the eye or target area of ​​the eye, thereby helping to mitigate virtual image degradation. In some embodiments, the HVP ports arranged to provide a mosaic of hyperfocal visual spots, and therefore the corresponding hyperfocal reflector spots, may have regular shapes and / or randomized shapes. In some embodiments, the HVP reflector spots that form a mosaic pattern at the eye are randomly shaped HVP spots (but still geometrically distributed) to account for increased pupil size (= increased oversampling). Sampling refers to the number of hyperfocal reflector spots that instantaneously direct light into the eye.

[0398] According to some methods, a hyperfocal viewport using wavelength reflective spots according to embodiments herein is employed in an optical hyperfocal reflective system to mitigate degradation of a virtual image seen by the eye. In some embodiments, the wavelength selective hyperfocal spots of the viewport are arranged in the optical hyperfocal reflective system to form a pattern of mosaicked hyperfocused virtual image spots at the eye, while in other embodiments, the wavelength selective hyperfocal reflector spots are arranged so that no such mosaic pattern exists.

[0399] Converting the hyperfocal viewport from being broadband to being a wavelength-dependent reflective port has several potential technical advantages. The first advantage is with respect to outside-world transmission, i.e., optical transmission of light from a real-world scene through the optical substrate of the optical hyperfocal reflective system, for the case where the optical hyperfocal reflective system is implemented as an optical combiner. Fig.26The typical emission spectrum of an image source such as an OLED, the emission spectrum of broadband natural sunlight, and the reflectivity of a typical broadband reflector such as a silver mirror are shown. Fig.26 As can be seen, the broadband reflector inherently does not distinguish between natural light from the outside world and light from our AR image source. In the case of a broadband hyperfocal viewport reflector spot, the most basic measure of the efficiency of our viewport system in delivering AR images to the eye is determined by the ratio of the total area of ​​all viewports to the total area of ​​the optical hyperfocal reflective optical substrate (waveguide or goggles). This would mean that in order to reflect 10% of the light from the image generation source toward the eye, we would block 10% of the natural light from the outside world from being transmitted through the optical substrate to the eye. By employing a wavelength selective hyperfocal reflector spot in the hyperfocal viewport, more light from the outside world is able to pass through the optical substrate without reducing the efficiency of the reflected light from the AR image source.

[0400] Reducing the blockage of natural light from the outside world by the viewport can be achieved in different ways. In some embodiments, this is achieved by using a wavelength selective reflector spot that covers the entire RGB emission spectrum of the AR image source as each viewport reflector spot. In some embodiments, reducing natural light from the outside world is achieved by dividing each viewport into three separate R, G, or B portions of the AR image source emission spectrum and replicating the initial distribution of each R, G, and B hyperfocal reflector spot. As an example, Figure 27 to Figure 29 Different configurations of a hyperfocal reflective viewport are shown in accordance with some embodiments. Fig. 27 A viewport with a broadband hyperfocal reflector spot (e.g., a spot with a silver mirror or dielectric coating) is shown. Fig.28 shows a viewport with a wavelength selective hyperfocal reflector spot that reflects the total image source emission spectrum but passes other light, and Fig.29 A viewport is shown having wavelength selective hyperfocal reflector spots, some of which are configured to reflect only separate R portions of an image source emission spectrum, some of which are configured to reflect only the G portion of the image source emission spectrum, and some of which are configured to reflect only the B portion of the image source emission spectrum while allowing all other light to pass through.

[0401] exist Fig. 27 In the layout of , the viewport with broadband hyperfocal reflector spot completely blocks the natural light from the outside world and reflects all AR image source light that comes into contact with the reflector spot. Fig.28 In a layout having a viewport of a wavelength selective hyperfocal reflector spot for the total image source emission spectrum, more of the outside world natural light is allowed to pass through the substrate if the outside world natural light falls outside the reflection wavelength range of the hyperfocal reflector spot, while within this range, an equal or similar percentage of AR image source light is reflected as that of the broadband reflector.

[0402] Fig.29The layout of FIG. 1 shows a viewport with wavelength selective hyperfocal reflector spots that are used to select separate R, G, and B portions of the AR image source emission spectrum. This configuration separates the wavelength selective viewports into their RGB components and offsets each pattern. If the outside world natural light falls outside the reflection wavelength range of a specific R, G, B wavelength selective hyperfocal reflector spot, they allow more of the outside world natural light to pass through the substrate, while within this range, reflecting similar or equal percentages of AR image source R, G, B light as the broadband reflector, respectively.

[0403] In an optical hyperfocal reflective system according to some embodiments, employing a viewport with separate wavelength selective reflector spots for the R, G, and B portions of the AR image source emission spectrum provides potential benefits when it comes to undersampling the hyperfocal viewport by the eye. When viewing a display where the inter-viewport distance is too large for the eye pupil, severe information loss or dark block effects will occur. This effect is not particularly useful in the case of an AR image source that has a wavelength selective reflector spot for the R, G, and B portions of the AR image source emission spectrum. Fig.31 and Fig.33 As shown by way of example, Fig.31 and Fig.33 The image seen by the detector as determined by a computer model is shown. The computer model is, but is not limited to, an optical design program from Zemax, LLC that models the propagation of light in an optical hyperfocal reflective system and the view seen at the detector. Fig.31 and Fig.33 An example of undersampling in a hyperfocal reflective system with a broadband reflective hyperfocal viewport element, with the eye focused at 1 m and the eye focused at infinity, respectively, is shown in FIG. The dark patches are position dependent, so the two detectors have different views. Fig.30 and Fig.32 shows an image seen by the eye according to a computer model for Fig.29 Example of undersampling in a hyperfocal viewport display with separate RGB selective hyperfocal viewports in a layout of , where the eye is focused at 1m and the eye is focused at infinity, respectively.

[0404] from Figure 30 to Figure 33 It can be seen that the image is in focus when the eye is focused at 1m and at infinity, indicating that hyperfocus exists in both cases. Fig. 27 When using a broadband hyperfocal reflector spot in a layout of , the result of undersampling the white image through the viewport is that information is completely lost in some areas of the display (see Fig.31 and Fig.33 ). The same applies to Fig.28 A viewport of a wavelength selective reflector for the total image source emission spectrum in a layout of FIG, where the RGB reflections come from a single hyperfocal reflector spot. Fig.29In the case of separate RGB hyperfocal reflector spots in the layout, there is a loss of color uniformity, but the information is preserved in the image (see Fig.30 and Fig.32 ).

[0405] As will be explained below, another way to mitigate degradation of the image seen by the eye is to actively control image quality by employing a polarized hyperfocal reflector spot in the hyperfocal viewport of an optical hyperfocal reflective system, among other approaches.

[0406] In some methods of an optical hyperfocal reflective system, the HVP reflector spot is a polarized reflector spot. The polarized hyperfocal reflector spot can be a wire grid or other polarized material arranged to reflect a polarization state of interest. In some embodiments, some polarizer hyperfocal reflector spots have a first configuration and some polarizer hyperfocal reflector spots have a second configuration different from the first configuration. The polarized HVP reflector spot can be implemented in an optical hyperfocal reflective system (as an optical combiner or non-combiner) having an optical waveguide substrate or a free space optical substrate, such as but not limited to those optical substrates shown in the figures.

[0407] Unpolarized optical image input light is reflected from a first polarization state selective polarizer hyperfocal reflector spot in a first polarization state with a first electric field, and reflected from a second polarization state selective polarizer hyperfocal reflector spot in a second polarization state with a second electric field. In some embodiments, the first polarization state can be orthogonal to the second polarization state or at an intermediate angle. The intermediate angle can be selected based on the position of the hyperfocal reflective spot along the optical substrate. In some embodiments, the first polarization state is a horizontal (H) polarization state, where the first electric field is horizontal, and the second polarization state is a vertical (V) polarization state, where the second electric field is vertical. In some embodiments, the polarized hyperfocal reflector spots are distributed in an alternating pattern of first polarization state selective reflector spots and second polarization state selective reflector spots, such as but not limited to alternating horizontal (H) polarization selective reflector spots and vertical (V) polarization selective reflector spots.

[0408] refer to Fig.34, shows an augmented reality display system according to an embodiment, wherein the substrate is a free space optical substrate (free space optical combiner or non-combiner). The hyperfocal reflective viewport of the optical hyperfocal reflective system is a polarization selective viewport 102H, 102V. In the illustrated embodiment, the hyperfocal reflective viewport 102H has a horizontal polarization selective reflector spot 103H in the form of a horizontal line grid, which is configured to reflect horizontally polarized input light 107 and allow vertically polarized input light 107 to pass. The hyperfocal reflective viewport 102V has a vertical polarization selective reflector spot 103V in the form of a vertical line grid, which is configured to reflect vertically polarized input light 107 and allow horizontally polarized input light 107 to pass. Other types of polarizers may be used in other embodiments. For ease of illustration, the lines and spacing of the grid are not shown to scale. In some embodiments, the spacing is in the nanometer range, for example but not limited to 100-200nm. When unpolarized light is incident on the polarizer, the polarization having an electric field parallel to the line grid is reflected, and the polarization having an electric field perpendicular to the line grid is transmitted. When the optical image input light 107 is unpolarized, the optical display input light 107 reflected from the polarizer hyperfocal reflector spot 103V is polarized with a vertical electric field, and the hyperfocal reflector spot 103V allows the horizontal electric field to pass through, while the optical image input light 107 reflected from the polarizer hyperfocal reflector spot 103H is polarized with a horizontal electric field, and the hyperfocal reflector spot 103H allows the vertical electric field to pass through.

[0409] exist Fig.34In an optical system of FIG. 1 , the optical image input light 107 is dynamically polarized. To this end, the image 108 from the image generating device 120 (in this case, a projector) changes polarization state via a polarization module 134 (here, an LC module). When the optical input image is in the horizontal H polarization state, only the 103H hyperfocal reflector spot reflects a discrete spot beam 105H having the H polarization state, and the 103V hyperfocal reflector spot does not reflect any H state optical input light. When the image is in the vertical V polarization state, only the 103V hyperfocal reflector spot reflects a discrete spot beam 105V having the V polarization state, and the 103H hyperfocal reflector spot does not reflect any V state optical input light. The optical image input light 107 can be dynamically polarized, either continuously linearly polarized between H and V, or between H and V together and H and / or V, or circularly polarized, or by changing the degree of elliptical state so that the image is continuously directed to the eye from the HVP element in the H state, the HVP element in the V state, or from both at the same time. This approach overcomes the oversampling problem if a larger number of HVP regions are desired. In some embodiments, some or all of the hyperfocal reflector spots configured with a first polarization state may be configured with a polarization state other than a vertical polarization state, and / or some or all of the hyperfocal reflector spots configured with a second polarization state may be configured with a polarization state other than a horizontal polarization state. The first polarization state may be orthogonal to the second polarization state or at an intermediate angle. The intermediate angles may be selected based on the location of the hyperfocal reflective spots along the optical substrate.

[0410] A corresponding setup can be implemented for an optical hyperfocal reflective system, where the substrate is an optical waveguide instead of a free-space substrate. As an example, Fig.35 A perspective view of such an optical hyperfocal reflective system is shown, wherein H polarization state hyperfocal reflector spots 103H and V polarization state hyperfocal reflector spots are alternately distributed along the waveguide and are combined together in a common plane 117 spaced apart from each other. The optical image input light 107 can be dynamically polarized, or continuously polarized between H and V, have circular polarization between H and V, or by changing the degree of elliptical state so that the image is continuously directed to the eye from the HVP element in the H state, the HVP element in the V state, or from both at the same time. This approach overcomes the oversampling problem if a larger number of HVP areas are desired. In some embodiments, some or all of the hyperfocal reflector spots configured with a first polarization state can be configured with a polarization state other than a vertical polarization state, and / or some or all of the hyperfocal reflector spots configured with a second polarization state can be configured with a polarization state other than a horizontal polarization state. The first polarization state can be orthogonal to the second polarization state or at an intermediate angle. The intermediate angle can be selected based on the position of the hyperfocal reflective spot along the optical substrate.

[0411] For example, through Fig.34 and Fig.35 As demonstrated by embodiments of the optical system of FIG. 1 , in some methods, the system is able to dynamically change the distribution of active and inactive hyperfocal reflector spots over the pupil to account for different pupil sizes and positions by changing the polarization of the optical display input light 107. The active hyperfocal reflector spots are those spots that are actually turned on, that is, they are spots that reflect the optical input light 107 because the optical input light 107 is polarized according to the polarization selection state of those hyperfocal reflector spots. The inactive hyperfocal reflector spots are those spots that are actually "turned off", that is, they do not reflect the optical input light 107 because the optical input light input is not polarized according to the polarization selection state of those hyperfocal reflector spots.

[0412] In some embodiments where the optical hyperfocal reflective system is implemented as an exit pupil expander, this dynamic change in the distribution of reflective hyperfocal reflector spots and non-reflective hyperfocal reflector spots caused by changing the polarization of the optical input light can be employed to control the intensity of light passing through the waveguide along the exit pupil expansion direction by changing the density of the first polarization state selective reflector spots and / or the density of the second polarization state selective reflector spots depending on the spot position along the waveguide. In some embodiments, the first polarization state selective reflector spots are horizontal (H) polarization state selective reflector spots, and the second polarization state selective reflector spots are vertical (V) polarization state selective reflector spots.

[0413] As an example, refer to Fig.36 , Fig.36An extreme case is shown in which only hyperfocal reflector spots with the V polarization state occupy the tilted common reflector plane 117V, only hyperfocal reflector spots with the H polarization state occupy the next tilted common reflector plane 117H spaced further along the waveguide, and the combination of hyperfocal reflector spots with the V polarization state and hyperfocal reflector spots with the H polarization state occupy the final tilted common reflector plane 117HV spaced further along the waveguide. By varying the optical input image polarization state, one can select each reflector for the H and V states so that light is not blocked by the preceding HVP element (also minimizing the generation of secondary light). Increasing the duration in a particular polarization state allows control (maximization) of the brightness at a particular HVP region - i.e., the area farthest from the projector will typically be darker due to propagation losses (including the effects of the preceding HVP element), but will appear brighter if circularly polarized light is launched into the waveguide. In some embodiments, some or all of the hyperfocal reflector spots configured with a first polarization state may be configured with a polarization state other than a vertical polarization state, and / or some or all of the hyperfocal reflector spots configured with a second polarization state may be configured with a polarization state other than a horizontal polarization state. The first polarization state may be orthogonal to the second polarization state or at an intermediate angle. The intermediate angle may be selected based on the location of the hyperfocal reflective spots along the optical substrate.

[0414] As illustrated by the preceding examples of polarization-dependent hyperfocal viewports, polarization-dependent reflective viewports allow the distribution of viewports to vary based on image polarization, resulting in improved image quality.

[0415] In some approaches to optical hyperfocal reflective systems employing wavelength selective hyperfocal reflective viewports, the optical hyperfocal reflective system can be configured as a display having multiple optical waveguides. In all such embodiments, the aperture size of the hyperfocal reflector spot is selected so that the reflected discrete virtual image spot beam 105 has a diameter D at the target area, thereby achieving hyperfocal focusing of the virtual image spot beam at an eye or other lens detector located at the target area in the manner explained above. Each output coupling grating is composed of a different hyperfocal viewport, which can be the same size as the partially or fully reflective viewports described herein with reference to other embodiments of the system using a single optical waveguide, but taking into account the apparent spot to target optical path length difference of the first waveguide relative to the second waveguide.

[0416] Each waveguide includes a wavelength selective hyperfocal reflector spot in the form of a diffractive optical element to selectively reflect light 107 of a specific wavelength or wavelength band as a discrete spot beam 105. In some other embodiments, a wavelength selective hyperfocal reflector spot other than a diffractive optical element may be used. The hyperfocal reflector spot may be a partially reflective spot, a fully reflective spot, or a combination of both.

[0417] The set of diffractive optical element reflector spots in each waveguide is typically configured in the same manner as the diffractive hyperfocal reflector spots of the other waveguide embodiments described herein. However, in order to maximize the angular bandwidth of the diffractive waveguide display while also minimizing crosstalk between different colors (whereby light of one color is incorrectly diffracted by a grating having a pitch intended for another color), the diffractive waveguide display includes multiple waveguides in which different specific wavelengths or wavelength bands or colors of an optical input image are selectively reflected by the diffractive optical element hyperfocal reflector spots in different optical waveguides. In some embodiments, multiple waveguides are sandwiched together or placed very close to each other in a sandwich configuration.

[0418] In some embodiments, each of the plurality of waveguides comprises a respective set of diffractive optical element hyperfocal reflector spots configured to selectively reflect respective specific colors or wavelength bands of optical image input light. In some embodiments, the specific colors or wavelength bands of optical image input light selectively reflected by a set of hyperfocal reflector spots in one of the plurality of waveguides are different from the specific colors or wavelength bands of optical image input light selectively reflected by another set of hyperfocal reflector spots in another waveguide. In some embodiments, one or more of the plurality of waveguides comprises a plurality of different sets of hyperfocal reflector spots. In some embodiments, the specific colors or wavelength bands of optical image input light selectively reflected by a set of hyperfocal reflector spots in a waveguide of the plurality of waveguides are different from the specific colors or wavelength bands of optical image input light selectively reflected by another set of hyperfocal reflector spots in the same waveguide.

[0419] In some methods where the optical hyperfocal reflective system is configured as a diffractive optical display, the system has two waveguides. The optical input image 106 is a multi-color image. In such an embodiment, the multi-color image is composed of three different colors (a first, second, and third color), and the colors of the optical input image 106 are separated between the two waveguides. The diffractive input coupler of the first optical waveguide is configured to selectively diffract some of the optical image input light of the first and second colors, while passing the optical image input light of the third color, and passing at least some of the optical input image light of the second color to the second optical waveguide. The diffractive input coupler of the second optical waveguide is configured to selectively diffract at least some of the optical image input light of the third color and the second color that have passed through the first diffractive input coupler.

[0420] As an example, Figure 37 to Figure 39An optical hyperfocal reflective system according to one embodiment is shown, which is configured as a diffractive waveguide display having multiple optical waveguides. The diffractive input coupler of the first waveguide is optimized to diffract optical input light rays 107 having wavelengths λ1 and λ2, while the second waveguide is optimized to diffract optical input light rays 107 having wavelengths λ2 and λ3. Typically, λ1=blue, λ2=green, and λ3=red. In other embodiments, λ1, λ2, and λ3 may correspond to different colors, respectively. In some embodiments, λ1, λ2, and λ3 may represent blue, green, and red in a different order. For example, in some embodiments, λ1=red, λ2=green, and λ3=blue. As a non-limiting example, for an image source such as an organic light emitting diode (OLED), λ1=450nm, λ2=532nm, and λ3=640nm (e.g., see ) showing a typical emission spectrum of an OLED. Fig.26 ). In some embodiments, at least some of λ1, λ2, and λ3 are different from each other and correspond to light of any wavelength. The diffraction grating in the waveguide is configured to selectively diffract light of certain wavelengths. In a non-limiting example, in order to selectively diffract any one or combination of blue light, green light, and red light, the input diffraction grating pitch is correspondingly selected to be on the order of about 300nm to 500nm. The selected pitch depends on the FOV and the type of substrate material (for critical angle guidance conditions).

[0421] For more details, refer to Figure 37 to Figure 39 An exemplary embodiment of Fig.37 1 is a perspective view of one of the optical waveguides (i.e., the first optical waveguide substrate 101G1) taken separately. Each optical waveguide substrate is any optical waveguide substrate suitable for an augmented reality or virtual reality display, such as the optical waveguide substrate 101 of any embodiment disclosed herein. The optical waveguide substrate 101G1 includes a first optical input coupling portion 150G1 and a first output coupling portion 160G1. The first optical input coupling portion 150G1 and the first optical output coupling portion 160G1 are spaced apart from each other along the first waveguide substrate 101G1 in the exit pupil expansion direction 118. The first optical input coupling portion 150G1 is optically coupled to the first optical output coupling portion 160G1 via an additional first pupil expansion region 155G1. In some embodiments, the additional first pupil expansion region may be omitted.

[0422] The first optical input coupling portion 150G1 includes a first optical input diffraction grating 151G1, which is configured to selectively diffract and internally reflect the optical input light 107 having a specific first wavelength λ1 and a portion of the optical input light 107 having a specific second wavelength λ2 into the first optical waveguide 101G1 along the first optical waveguide substrate in the pupil expansion direction 118 (see Fig.39). The first optical input diffraction grating 151G1 is also configured to pass therethrough at least some of the optical input light rays 107 having a specific wavelength λ2 that are not diffracted into the first waveguide 101G1, and also pass therethrough optical input light rays 107 having a third specific wavelength λ3 to exit the face of the first optical substrate, rather than internally reflecting them. The first input diffraction grating 151G1 has a grating configuration and spacing to selectively reflect optical input waves 107 having specific wavelengths or wavelength bands λ1, λ2 along the optical waveguide substrate 101G1 in the pupil expansion direction 118, and to transmit other wavelengths therethrough.

[0423] The first additional pupil expansion region 155G1 is a first expansion diffraction grating 156G1 disposed between the first optical input coupling portion 150G1 and the first optical output coupling portion 160G1. In other embodiments, the first additional pupil expansion region 155G1 may be another type of pupil expansion component suitable for expanding optical input light of a specific wavelength in a pupil expansion direction 118, the optical input light of the specific wavelength being selectively internally reflected by the first optical input coupling region 150G1 and propagating along the first optical waveguide. The first expansion diffraction grating 151G1 is configured to selectively diffract optical input light of a specific wavelength 107 internally along the first optical waveguide 101G1 to expand the exit pupil of the image generating system in 2 dimensions in the expansion direction 118. Figure 37 to Figure 39 In the example shown, the first extended diffraction grating 151G1 has a grating configuration and spacing to selectively diffract the received reflected first optical input light 107 at wavelengths λ1, λ2 further along the first optical waveguide substrate in the pupil expansion direction 118.

[0424] The first optical output coupling portion 160G1 includes a plurality of first hyperfocal reflector spots 103G1 of a first hyperfocal viewport 102G1 in the form of a diffractive optical element disposed in the first optical waveguide 101G1. The first diffractive optical element reflector spots 103G1 are diffraction gratings embedded in the surface of the first optical waveguide substrate. In some other embodiments, the diffraction grating is further embedded in the volume of the substrate 101G1 or disposed on the surface. The first diffraction grating hyperfocal reflector spots 103G1 are configured to selectively reflect optical input light 102 having a specific first wavelength λ1 and a specific second wavelength λ2 as a discrete spot beam composed of light of the first and second specific wavelengths 105λ1 and λ2 toward the eye lens or the eye target area. In this example, the first diffraction grating hyperfocal reflector spots 103G1 have a grating configuration and grating spacing to selectively reflect a first optical input wave 107 having a first specific wavelength λ1 and a second specific wavelength λ2 as a discrete spot beam 105λ1,λ2 composed of light of the first and second specific wavelengths toward an eye or other optical detector target. The first diffraction grating hyperfocal reflector spots 103G1 are arranged in a first pattern along a first output coupling portion of a first waveguide substrate. Examples of diffraction grating spacings and materials for expanding and selectively reflecting different colors in an optical waveguide can be found in US9946068, the contents of which are incorporated herein by reference.

[0425] A second optical waveguide substrate 101G2 similar to the optical waveguide substrate 101G1 is arranged adjacent to the first optical waveguide 101G1 in a side-by-side or sandwich configuration. The front surface of the first optical waveguide substrate 101G1 faces the back surface of the second optical waveguide substrate 101G2. The first optical waveguide 101G1 is arranged parallel or substantially parallel to the second optical waveguide 101G2. A gap is provided between the first optical waveguide 101G1 and the second optical waveguide 101G2. In some other embodiments, the first optical waveguide 101G1 may be in direct contact with the second optical waveguide 101G2 without any gap therebetween.

[0426] The elements included in the second optical waveguide substrate 101G2 generally correspond to those elements identified by the same reference numerals in the first optical waveguide 101G1, but the reference numerals identifying the elements in the second substrate end with "G2" instead of "G1". However, the configurations of the second optical input portion 150G2, the second additional pupil expansion region 155G2, and the second output coupling portion 160G2 are different from the configurations of the first optical input portion 150G1, the first additional pupil expansion region 155G1, and the first output coupling portion 160G1, respectively, in that they are configured to selectively reflect optical input light of a specific second wavelength λ2 and a specific third wavelength λ3. The first wavelength λ1, the second wavelength λ2, and the third wavelength λ3 are different wavelengths. In Figure 37 to Figure 39In the example of , λ1 corresponds to blue, λ2 corresponds to green, and λ3 corresponds to red. The second optical input grating 151G2 has a grating configuration and a grating spacing to selectively reflect the optical input light 107 of wavelengths λ2 and λ3 along the second optical substrate toward the second extended diffraction grating 155G2. The second extended diffraction grating 155G2 has a grating configuration and a spacing to selectively reflect the received optical input light of wavelengths λ2 and λ3 further along the second optical substrate 101G2 toward the second output coupling portion 160G2. In addition, the second optical output coupling 160G2 includes a plurality of second hyperfocal reflector spots 103G2 of the second hyperfocal viewport 102G2, which are in the form of diffractive optical elements distributed in the second optical waveguide 101G2 along the pupil expansion direction 118. The hyperfocal reflective diffractive optical element spot 103G2 in this embodiment is a second diffraction grating configured to selectively reflect optical input light of the second wavelength λ2 and the third wavelength λ3, respectively, as a discrete spot beam 105 composed of light of the second and third wavelengths 105λ2 and λ3, toward the eye lens or the eye target area. In this example, the second diffraction grating hyperfocal reflector spot 103G2 has a grating configuration grating spacing to selectively reflect wavelengths λ2 and λ3 corresponding to green light and red light, respectively.

[0427] The second diffraction grating hyperfocal reflector spots 103G2 are arranged in a second pattern along the second output coupling portion of the second waveguide substrate. In this embodiment, the second pattern of the second diffraction grating hyperfocal reflector spots 103G2 is different from the first pattern of the first diffraction grating hyperfocal reflector spots 103G2. Other patterns of the first diffraction grating hyperfocal reflector spots and / or the second diffraction grating hyperfocal reflector spots are contemplated, which may be regular or irregular.

[0428] The first and second hyperfocal reflector spots 103G1 and 103G2 are spaced apart along the exit pupil expansion direction 118 so that the discrete reflected spot beam 105 has an angular direction relative to the eye lens 205 or the eye target area, which angular direction is the same as that described above with reference to Figures 7 to 9B The aperture size of the hyperfocal reflector spots 103G1 and 103G2 is selected so that the discrete spot beam has a diameter D at the target area of ​​the eye or other lens detector, thereby achieving a hyperfocused view of the virtual image spot in the manner explained above.

[0429] The first hyperfocal reflector spot 103G1 of the first output coupling portion 160G1 of the first optical waveguide substrate 101G1 is staggered or otherwise distributed in the exit pupil expansion direction 118 relative to the second hyperfocal reflector spot 103G2 in the second output coupling portion 160G2 of the second optical waveguide substrate 101G2, so that the hyperfocal spot image formed by the discrete spot beam 105λ1λ2 reflected from the first hyperfocal reflector spot 103G1 viewed at the eye target area or other optical detector target area does not overlap with the hyperfocal spot image formed by the discrete spot beam 105λ2λ3 reflected from the second hyperfocal reflector spot 103G2. In the same manner as the hyperfocal spot image of a single waveguide (see Figures 21 to 33 This provides benefits in terms of image quality and field of view. For example, it allows the field of view and / or quality of the overall viewing image to be increased compared to an arrangement that results in an overlap of hyperfocused spot images.

[0430] In some other embodiments, there may be Figure 37 to Figure 39 More or fewer wavelength selective hyperfocal reflector spots 103G1, 103G2 are shown. In some other embodiments, the pattern, size and shape of each group of wavelength selective spots 103G1, 103G2 may be different from the pattern shown. In other embodiments, each specific wavelength may be different from those indicated. In addition, in some embodiments, the first hyperfocal reflector spot 103G1 and the second hyperfocal reflector spot 103G2 are shaped as hexagonal spots or other shapes (which may be regular, irregular, or a combination of both) and are arranged relative to each other so that the hyperfocal spot image formed by the first hyperfocal reflector spot 103G1 and the second hyperfocal reflector spot 103G2 acquired in combination forms a mosaic of hyperfocal spot images at the target area of ​​the eye in a manner similar to the hyperfocal reflective spots in a single optical waveguide (see, for example Figures 21 to 33 and the corresponding description of spot shape and mosaicking of hyperfocused spot images).

[0431] In some methods where the optical hyperfocal reflective system is configured as a diffractive optical display, the system has at least three optical waveguides. Each waveguide is designed to support only one of three different colors, so the grating design is simpler than using only two optical waveguides. The optical input image 106 is a multi-color image. In this embodiment, the multi-color image consists of three different colors (a first, second, and third color, for example, blue, green, and red, respectively), and the colors of the optical input image 106 are separated between the three waveguides. The diffraction grating in the waveguide is configured to selectively diffract light having a specific wavelength. In a non-limiting example, in order to selectively diffract any one or combination of blue light, green light, and red light, the input diffraction grating spacing is correspondingly selected at intervals of about 300nm to 500nm. The selected spacing depends on the FOV and the type of substrate material (for critical angle guidance conditions).

[0432] A first diffractive input coupler associated with a first optical waveguide substrate is configured to diffract some of the optical image input of the first color while passing the optical images of the second and third colors to the second optical waveguide. A second diffractive input coupler associated with a second optical waveguide substrate is configured to diffract some of the optical image input of the second color while passing the optical image of the third color to the third optical waveguide. The first, second, and third pupil expansion gratings of the first, second, and third optical waveguide substrates selectively reflect the optical images of the first, second, and third colors along the substrates, respectively. The first hyperfocal reflective spot of the first waveguide substrate is configured to selectively reflect a discrete spot beam consisting of light of the first wavelength. The second hyperfocal reflective spot of the second waveguide substrate is configured to selectively reflect a discrete spot beam consisting of light of the second wavelength. The third hyperfocal reflective spot of the third waveguide substrate is configured to selectively reflect a discrete spot beam consisting of light of the third wavelength.

[0433] As an example of such an optical hyperfocal reflective system with three optical waveguides, refer to Fig.40 and Fig.41, which show a diffractive waveguide display with three optical waveguides according to one embodiment. The first diffractive input coupler 171G1 in the first waveguide substrate 101G1 is configured to selectively diffract the optical input light 107 having a wavelength λ1 internally in the exit pupil expansion direction 118, and pass the light 107λ2 and λ3 to the second optical waveguide 101G2. The second waveguide 101G2 has a second diffractive input coupler 171G2 positioned relative to the first diffractive optical coupler 171G1 so that the light 107λ2 and λ3 passing through the first diffractive optical coupler 171G1 are received by the second diffractive optical coupler 171G2 of the second optical waveguide 101G2. The second diffractive input coupler 171G2 is configured to diffract the received optical input light 107 having a wavelength λ2, and pass the received light 107λ3 to the third optical waveguide 101G3. The third waveguide 101G3 has a third diffractive input coupler 171G3, which is positioned relative to the first and second diffractive optical couplers 171G1 and 171G2 so that the light 107λ3 passing through the first and second diffractive optical couplers is received by the third diffractive optical coupler 171G3 of the third optical waveguide 101G3. First, second and third diffractive expansion gratings 176G1, 176G2 and 176G3 that selectively diffract the first, second and third wavelengths, respectively, are respectively arranged in the first, second and third optical waveguides 101G1, 101G2, 101G3 to further expand the optical input image generation system exit pupil in the direction 118.

[0434] The first, second and third hyperfocal reflector spots 173G1, 173G2 and 173G3 are respectively distributed in the first, second and third output coupling parts 160G1, 160G2 and 160G3 of the first, second and third optical waveguides. The hyperfocal reflective spots can be partial reflective spots, full reflective spots or a combination of both. The first hyperfocal reflector spot 173G1 is configured to selectively reflect the light 107 with a wavelength of λ1 as a discrete spot beam 105λ1 towards the eye lens or the eye target area. The first hyperfocal reflector spot 173G1 is distributed in the first output coupling part 160G1 of the first optical substrate 101G1 in a first pattern. The second hyperfocal reflector spot 173G2 is configured to selectively reflect the light 107 with a wavelength of λ2 as a discrete spot beam 105λ2 towards the eye lens or the eye target area. The second hyperfocal reflector spot 173G2 is distributed in the second output coupling part 160G2 of the second optical substrate 101G2 in a second pattern. The third hyperfocal reflector spot 103G3 is configured to selectively reflect light 107 of wavelength λ3 as a discrete spot beam 105λ3 towards the eye lens or eye target area. The third hyperfocal reflector spots 103G3 are distributed in a third pattern in the third outcoupling portion 160G3 of the third optical substrate 101G3.

[0435] In this way, the three optical waveguides are optimized for diffracting optical input light 107 having different wavelengths λ1, λ2, and λ3, respectively. Typically, λ1=blue, λ2=green, and λ3=red. In other embodiments, λ1, λ2, and λ3 may correspond to different colors, respectively. In some embodiments, λ1, λ2, and λ3 may represent blue, green, and red in a different order. For example, in some embodiments, λ1=red, λ2=green, and λ3=blue. As a non-limiting example, for an image source such as an organic light emitting diode (OLED), λ1=450nm, λ2=532nm, and λ3=640nm (e.g., see FIG. 10 for a typical emission spectrum of an OLED). Fig.26 ). In some embodiments, at least some of λ1, λ2, and λ3 are different from each other and correspond to light of any wavelength.

[0436] The first, second and third hyperfocal reflector spots 173G1, 173G2, 173G3 are configured so that the discrete reflected spot beam 105 has an angular direction relative to the eye lens 205 or the eye target area, which angular direction is the same as that of the first, second and third hyperfocal reflector spots 173G1, 173G2, 173G3 as has been referenced above. Figures 7 to 9B It is necessary to capture the entire field of view of the display in the manner explained. The aperture size of the hyperfocal reflector spot is selected to project a discrete spot beam with diameter D onto the eye or other lens detector, thereby achieving hyperfocusing of the virtual image spot view in the manner explained above.

[0437] The first hyperfocal reflector spot 173G1, the second hyperfocal reflector spot 173G2, and the third hyperfocal reflector spot 173G3 are staggered or otherwise distributed relative to each other in the exit pupil expansion direction 118 so that the hyperfocal spot images formed by the discrete spot beams 105λ1, 105λ2, 105λ3 reflected from the first, second, and third hyperfocal reflector spots 173G1, 173G2, and 173G3, respectively, viewed at the eye target area or other optical detector target area do not overlap with each other. In the same manner as the hyperfocal spot images of a single waveguide (see Figures 21 to 33 This provides benefits in terms of image quality and field of view. For example, it allows the field of view and / or quality of the overall viewing image to be increased compared to an arrangement that results in an overlap of hyperfocused spot images.

[0438] In some other embodiments, there may be Fig.40 and Fig.41More or fewer wavelength selective hyperfocal reflector spots are shown. In some other embodiments, the pattern, size, and shape of the wavelength selective spots of each group may be different from the pattern shown. In other embodiments, each specific wavelength may be different from those indicated. In addition, in some embodiments, the hyperfocal reflector spots are shaped as hexagonal spots or other shapes (which may be regular, irregular, or a combination of both) and are arranged relative to each other so that the hyperfocal spot image formed by the first hyperfocal reflector spot 173G1, the second hyperfocal reflector spot 173G2, and the third hyperfocal reflector spot 173G3 acquired in combination forms a mosaic of hyperfocal spot images at the target area of ​​the eye in a manner similar to the hyperfocal reflective spots in a single optical waveguide (see, for example Figures 21 to 33 and the corresponding description of spot shape and mosaicking to form a hyperfocused image spot).

[0439] As explained with reference to different exemplary embodiments of optical hyperfocal reflective systems having more than one optical waveguide substrate, the arrangement of output couplers from different waveguides can be arranged so that the formed hyperfocal spot images do not overlap, as with the wavelength selective reflective viewport for a single optical waveguide substrate described earlier herein. In the same way, this allows the FOV of the output to be increased.

[0440] As can be seen from the foregoing examples of diffractive displays with multiple optical waveguides, each output coupling grating consists of a different hyperfocal viewport, which can be of the same size as the partially or fully reflective viewports described herein with reference to other embodiments of systems using a single optical waveguide, but taking into account the difference in the spot-to-target optical path length of the first waveguide relative to the second waveguide.

[0441] In some other approaches, an optical superfocal reflection system using more than three optical waveguides is contemplated for selectively reflecting discrete spot beams of more than three different wavelengths.

[0442] In still other approaches, an optical hyperfocal reflective system having multiple optical waveguides according to embodiments disclosed herein has hyperfocal reflector spots additionally configured as differently polarized reflector spots, such as but not limited to Fig.35 and Fig.36 Those of the embodiments, and the system includes an LC module or other module for dynamically switching the polarization of the optical input image into the corresponding optical waveguide as needed to achieve the benefits discussed herein with reference to a single optical waveguide.

[0443] The optical display system of the above embodiment illustrates that by using a hyperfocal reflective viewport, the system allows a range from infinity all the way to H (hyperfocal distance) within which the eye can comfortably accommodate an image initially at infinity without loss of resolution. In addition, the system uses convergence to drive the accommodation of the eye lens, allowing the lens to focus at its most comfortable position and maintain an acceptably sharp image according to our previous definition.

[0444] Reference will now be made to some control systems according to some aspects of the present technology for optimizing a hyperfocused human eye view of a virtual image of an optical hyperfocal reflective system in a display.

[0445] According to some aspects, eye-tracking display image editing systems and methods are provided, wherein through eye tracking, convergence is used to trick the brain into believing that computer-generated objects are in focus regardless of eye gaze in the real world, thereby allowing the hyperfocal range of the viewport to support appropriate accommodation. In one embodiment, the system is configured to apply selective blurring to out-of-range objects with the same appearance as a perspective real-world scene.

[0446] As a non-limiting example, refer to Fig.42 and Fig.43 , wherein the optical hyperfocal reflection system is configured as an optical combiner in a manner explained according to the embodiments described herein. A human eye is observing a real-world scene superimposed on a hyperfocused virtual display image. The real-world scene includes real-world objects in different planes spaced apart from the observer's eyes. In this non-limiting example, the real-world scene includes object plane 1 and real-world object plane 2. Real-world object plane 1 is set at a distance X1 from the eye target area plane, and real-world object plane 2 is set in plane 2 farther than plane 1, and its distance from the eye target area or eye plane is X2 (see Fig.42 and Fig.43 ). When the eyes are directly centered, that is, when the eye gaze angle is zero, the zero optical axis for each eye is also shown in Fig.42 and Fig.43 middle.

[0447] exist Fig.42In the embodiment of the present invention, the eye is looking at a real object in plane 1, on which a hyperfocused virtual image is superimposed, that is, plane 1 is at a distance X1 from the eye target area or eye. When the eye is directly located at the center of the real world scene and the superimposed virtual display image, the gaze direction of each eye is expressed as a gaze angle relative to the optical axis of the eye. The gaze angles θ1a and θ1b correspond to the gaze angles of the left eye and the right eye, respectively, looking at plane 1, which is closer than plane 2. The gaze direction can be measured and expressed in different ways, such as the line of sight of the eye or the visible axis of the eye, which may be affected by eye movement, head movement and / or other body movement. The methods and systems of the eye tracking and image editing embodiments disclosed herein are not limited to any particular way of measuring or expressing gaze directions or angles. Any type of measurement representing the gaze direction of each eye can be used.

[0448] exist Fig.43 In the embodiment of the present invention, the eye is looking in the direction of a real-world scene object plane 2, on which a hyperfocused virtual display image is superimposed, and whose distance from the eye target area or the plane of the eye is X2. The gaze angles θ2a and θ2b correspond to the gaze angles of the left eye and the right eye, respectively, looking at plane 2, which is farther from the eye than plane 1. By tracking the eye and determining the gaze direction, the real-world object plane that the eye is looking at is determined. Objects in the display image that are intended to appear in the hyperfocused virtual image that are closer or farther from the real-world object plane that the eye is looking at are identified. One or more objects in the display image that are identified as being farther or closer to the eye than the real-world object plane that the eye is looking at can be edited so that the display image objects are blurred or otherwise altered to give the impression that those identified display objects are out of focus relative to the real-world object plane when the hyperfocused virtual display image is superimposed with the real-world scene.

[0449] As a non-limiting example, the original unedited display image includes a square object and a circular object. Fig.42 In the case of a , where the real-world object plane is nearby, resulting in a larger angle of convergence on the eye, the original image is edited so that the resulting image on the display appears as intended to be a circle at distance x1 and a square at distance x2. Since both images will appear to be in focus, eye tracking is used to monitor the eye's gaze so that if looking at plane x1, digital blur is applied to the square (and generally to any object not in plane x1). When the eye focuses further outward to object plane x2, which coincides with the location of the square, digital blur is instead applied to the circle (and generally to any object not in plane x2).

[0450] Eye tracking can be performed via direct viewing or indirect viewing. In the former case, a miniature wide-viewing camera module is located near the display to look directly into the eye. As an example, Fig.44 An eye tracking camera module is shown configured in a direct viewing configuration according to an embodiment, tracking an eye viewing a real world scene through an optical hyperfocal reflective system. For indirect viewing, a display or another direct surface can incorporate a reflective holographic or diffractive layer in the NIR region (many companies, such as 3M, have developed similar, working on holographic films) that allows the image of the eye to be reflected to a miniature wide viewing angle camera module. As an example, Fig.45 An eye tracking camera module configured in an indirect viewing configuration according to an embodiment is shown, the module tracking an eye viewing a real world scene through an optical hyperfocal reflective system;

[0451] In both cases, the illumination can be provided by the display surface in the visible or NIR wavelength region.

[0452] Fig.46 1 is a block diagram of various control systems for optimizing a hyperfocused human eye view of a virtual image of an optical hyperfocal reflective system according to an embodiment. The optical hyperfocal reflective system is any of the optical hyperfocal reflective systems of the embodiments described herein. Fig.46 As shown, control system 4000 includes an eye tracking display image editing system, which includes an eye tracking system 4201 operably connected to a display image editing system 4204. The display image editing system or controller 4204 or a portion thereof can be located at a location remote from the display and processed by a computer processing machine (such as but not limited to Fig.49 In some other embodiments, the display image editing system 4204 is local to the head mounted display or other display and may include integrated circuits or other circuits configured to perform functions similar to the computing machine. If remotely located, the display image editing system is operably connected to the eye tracking system via a wireless or cellular module 4203.

[0453] Eye tracking system 4201 includes eye tracking camera 4202 and associated components, including any tracking processor or controller 4203. The tracking processor or a portion thereof may be located remotely from the display and may be controlled by a computer processing machine such as, but not limited to, Fig.494205 is an exemplary computer machine). The eye tracking camera is operably coupled to the eye tracking processor locally or remotely via a wireless / cellular module. In some other embodiments, the eye tracking processor is local to the head mounted display or other display and may include an integrated circuit or other circuit configured to perform functions similar to the computing machine. If remotely located, the tracking processor is operably connected to the eye tracking camera 4202 via a wireless or cellular module 4203. The display image processor may be incorporated into the display image generation system 4205 itself, or into a separate processor operably coupled to the display image generation system. The display image generation system is optically coupled to the optical hyperfocal reflection system.

[0454] Fig.46 The control system in also includes a brightness control system for controlling the amount of external world brightness reaching the eyes of the observer of the optical hyperfocal reflection system. The brightness control system has an electro-darkening filter 4501 operably connected to an eye tracking system, which can be the same eye tracking system 4201 for monitoring the gaze direction, or can be another separate eye tracking system. The eye tracking system is configured to monitor the pupil size of the eye. The electro-darkening filter 4501 can be configured according to feedback control from the eye tracking system to control the amount of external world brightness reaching the eye according to the external world brightness, thereby controlling the pupil size of the eye. Therefore, the electro-darkening filter (called an electrochromic filter / panel) is able to control the external world brightness within the system and thus control the pupil size. In this way, the number of hyperfocal viewports observed by the eye at the same time can be controlled by the system. In some embodiments, the electro-darkening filter system is configured to control the maximum number of hyperfocal viewports being observed by the eye while ensuring an acceptable clear image.

[0455] In some other embodiments, the electro-darkening filter system is included in the control system without the display image editing system. In some other embodiments, the display image editing system is included in the control system without the electro-darkening filter.

[0456] In some aspects, one or more of any of the optical hyperfocal reflective systems of the embodiments disclosed herein are incorporated into a head mounted display. In some embodiments, a pair of optical hyperfocal reflective systems are included in a pair of glasses or other form factor augmented reality head mounted displays. Fig.47A front view of a pair of head-mounted display glasses according to one embodiment is shown. A goggle-type head-mounted display or other type of glasses has a left-eye optical hyperfocal reflective system 4215 and a right-eye optical hyperfocal reflective system 4210. A display image generation system is included in the head-mounted display. The optical hyperfocal reflective system can be any of the optical hyperfocal reflective systems of the embodiments described herein, with or without an electro-darkening filter. The optical display image generation system can include a processing module 4205 that generates a computer-formed image for binocular viewing and optical image projectors 4206, 4207 and associated optical couplings for each eye. The optical display image generation system can be any of the display image generation systems of the embodiments disclosed herein, as long as it is suitable for the type of optical hyperfocal reflective system used. An optomechanical frame 4220 firmly holds the optical parts and maintains the correct geometric alignment. In some embodiments, the image formed is for monocular viewing, and only one optical hyperfocal reflective system and associated display image generation system are included in the head-mounted display. An eye tracking system and a brightness control system (see 4208) are also included. The eye tracking system and brightness control system can be any of the eye tracking systems and brightness control systems of the embodiments described herein, or another type of system. In some embodiments, the eye tracking system is omitted. In some embodiments, the electric darkening filter and brightness control system are omitted.

[0457] In some embodiments, the head mounted display in which one or more optical combiners are incorporated is a helmet form factor augmented reality head mounted display. Fig.48A front view of a head mounted display helmet according to one embodiment is shown. The helmet head mounted display has a processing module 4305 that generates a computer-generated image for binocular viewing. The head mounted display includes a left eye optical hyperfocal reflection system 4315 and a display image generation system 4307 and a right eye optical hyperfocal reflection system 4320 and a display image generation system 4306. The optical hyperfocal reflection system in each system can be any of the optical hyperfocal reflection systems of the embodiments described herein, with or without an electro-darkening filter. The display image generation system can be any of the display image generation systems of the embodiments disclosed herein, as long as it is suitable for the type of optical hyperfocal reflection system used. The optical image projector and the optical coupling can, for example, form part of the display image generation system. The optical mechanical subframe 4300 firmly holds the optical parts and maintains the correct geometric alignment. The optical mechanical subframe is supported by a mechanically sturdy helmet shell. An eye tracking system and a brightness control system (see 4308) are also included. The eye tracking system and the brightness control system can be any of the eye tracking systems and the brightness control systems of the embodiments described herein, or another type of system. In some embodiments, the eye tracking system is omitted. In some embodiments, the electro-darkening filter and brightness control system are omitted.

[0458] In other embodiments, Fig.47 and Fig.48 The illustrated head mounted display may include other optical and electronic components such as, but not limited to, a depth sensor camera, a color camera, a microphone, a speaker, input / output ports, and a battery.

[0459] In some embodiments, the image formed is for monocular viewing and only one optical hyperfocal reflection system and display image generation system are included in the head mounted display.

[0460] Fig.49is a diagrammatic representation of an embodiment of a machine in the form of a computer system 4401 in which a set of instructions for causing the machine to perform any one or more of the methods discussed herein (including computer-implemented method steps for use in performing any one or combination of display image generation, eye tracking, display image editing, brightness control, and other processes) may be executed, and which may be used as a computing system for an augmented or virtual reality display in conjunction with any one of the optical hyperfocal reflective systems disclosed herein. In various example embodiments, the machine operates as a standalone device, may be connected (e.g., networked) to other machines, or may be integrated into a head-mounted display or a head-up display itself. In a networked deployment, the machine may operate as a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a robotic construction marking device, a base station, a personal computer (PC), a tablet PC, a set-top box (STB), a personal digital assistant (PDA), a cellular telephone, a portable music player (e.g., a portable hard drive audio device, such as a Moving Picture Experts Group Audio Layer 3 (MP3) player), a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by the machine. Furthermore, while only a single machine is described, the term "machine" shall also be construed to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.

[0461] An embodiment of the computer system 4401 includes a processor or multiple processors 4405 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both) and a main memory 4410 and a static memory 4415, which communicate with each other via a bus 4420. The computer system 4401 may further include a video display 4435 (e.g., a liquid crystal display (LCD)). The computer system 4401 may also include an alphanumeric input device 4430 (e.g., a keyboard), a cursor control device (e.g., a mouse), a voice recognition or biometric verification unit (not shown), a drive unit 4437 (also known as a disk drive unit), a signal generating device 4440 (e.g., a speaker), and a network interface device 4445. The computer system 4401 may further include a data encryption module (not shown) for encrypting data.

[0462] The drive unit 4437 includes a computer or machine readable medium 4450 on which is stored one or more sets of instructions and data structures (e.g., instructions 4455) that embody or utilize any one or more of the methods or functions described herein. The instructions 4455 may also reside, completely or at least partially, within the main memory 4410 and / or the processor 4405 during execution by the computer system 4401. The main memory 4410 and the processor 4405 may also constitute machine readable media.

[0463] Instructions 4455 may also be sent or received over the network via the network interface device 4445 using any of a variety of well-known transmission protocols (e.g., Hypertext Transfer Protocol (HTTP)). Although the machine-readable medium 4450 is shown as a single medium in the example embodiment, the term "computer-readable medium" should be understood to include a single medium or multiple media (e.g., centralized or distributed databases and / or associated caches and servers) storing one or more sets of instructions. The term "computer-readable medium" should also be understood to include any medium capable of storing, encoding, or carrying a set of instructions executed by a machine and causing the machine to perform any one or more methods of the present application, or any medium capable of storing, encoding, or carrying a data structure used by or associated with such a set of instructions. Therefore, the term "computer-readable medium" should be understood to include, but is not limited to, solid-state memory, optical and magnetic media, and carrier signals. Such media may also include, but are not limited to, hard disks, floppy disks, flash memory cards, digital video disks, random access memories (RAM), read-only memories (ROM), etc. The example embodiments described herein may be implemented in an operating environment including software installed on a computer, in hardware, or in a combination of software and hardware.

[0464] Not all components of computer system 4401 are required, and therefore portions of computer system 4401 may be removed if not needed, such as input / output (I / O) devices (e.g., input device 4430). Those skilled in the art will recognize that an Internet service may be configured to provide Internet access to one or more computing devices coupled to the Internet service, and that these computing devices may include one or more processors, buses, memory devices, display devices, input / output devices, etc. In addition, those skilled in the art will appreciate that an Internet service may be coupled to one or more databases, repositories, servers, etc., which may be used to implement any embodiment of the present disclosure described herein.

[0465] As used herein, the term "module" may also refer to any of an application specific integrated circuit ("ASIC"), an electronic circuit, a processor (shared, dedicated, or a group of processors) that executes one or more software or firmware programs, a combinational logic circuit, and / or other suitable components that provide the described functionality.

[0466] The computing machine can be implemented locally and / or remotely with the eye tracking system and the display image generation system. In some embodiments, the computing system is used as an eye tracking display image editing system and is located at a remote location. The eye tracking system and the image generation display system are configured to wirelessly communicate with the computing system. In some embodiments, the remote computing system also provides some functions for the purpose of generating computer images (which would otherwise be performed by the image display generation system). In some embodiments, at least a portion of the eye tracking display image editing system is a computing machine implemented locally on the head mounted display, such as a computing machine in the form of one or more modules on the head mounted display.

[0467] The corresponding structures, materials, actions, and equivalents of all means or step-plus-function elements in the appended claims are intended to include any structure, material, or action for performing a function in combination with other claimed elements as specifically claimed. The description of the technology has been presented for the purpose of illustration and description, but the description of the technology is not intended to be exhaustive or limited to the technology in the disclosed form. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the technology. The exemplary embodiments are selected and described in order to best explain the principles of the technology and its practical application, and to enable others of ordinary skill in the art to understand the technology to obtain various embodiments with various modifications suitable for the specific purpose envisioned.

[0468] Aspects of the present technology are described above with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present technology. It should be understood that each box in the flowchart and / or block diagram and the combination of boxes in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device for producing a machine, so that instructions executed by a processor of a computer or other programmable data processing device create a device for implementing the function / action specified in one or more boxes of the flowchart and / or block diagram.

[0469] These computer program instructions may also be stored in a computer-readable medium, which can direct a computer, other programmable data processing apparatus, or other device to operate in a specific manner, so that the instructions stored in the computer-readable medium produce an article of manufacture including instructions for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0470] Computer program instructions may also be loaded onto a computer, other programmable data processing device, or other device to cause a series of operational steps to be performed on the computer, other programmable device, or other device, thereby producing a computer-implemented process, such that the instructions executed on the computer or other programmable device provide a process for implementing the functions / actions specified in one or more boxes of the flowchart and / or block diagram.

[0471] The block diagram in the figure shows the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, the block diagram can represent a module, a code segment or a code portion, which includes one or more executable instructions for realizing a specified logical function. It should also be noted that in some alternative implementations, the function mentioned in the frame may not be performed in the order mentioned in the figure. For example, the two frames shown in succession can actually be performed substantially simultaneously, or these frames can sometimes be performed in reverse order, depending on the functions involved. It will also be noted that each frame in the block diagram and / or the flow chart and the combination of the frames in the block diagram and / or the flow chart can be implemented by a system based on special-purpose hardware that performs a specified function or action or by a combination of special-purpose hardware and computer instructions.

[0472] Reference to "one embodiment" or "embodiment" throughout this specification means that the specific features, structures or characteristics described about the embodiment are included in at least one embodiment of the present invention. Therefore, the phrase "in one embodiment" or "in an embodiment" or "according to an embodiment" (or other phrases with similar meanings) throughout this specification does not necessarily refer to the same embodiment. In addition, specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In addition, according to the context discussed herein, singular terms can include their plural forms, and plural terms can include their singular forms. Similarly, hyphenated terms (e.g., "on-demand") can occasionally be used interchangeably with their non-hyphenated versions (e.g., "on-demand"), capitalized items (e.g., "software") can be used interchangeably with their non-capitalized versions (e.g., "software"), plural terms can be represented with or without apostrophes (e.g., PE's or PEs), and italicized terms (e.g., "N+1") can be used interchangeably with their non-italicized versions (e.g., "N+1"). This occasional interchange should not be considered inconsistent with each other.

[0473] Additionally, some embodiments may be described in terms of "means for" performing a task or a set of tasks. It should be understood that "means for" may be expressed herein in terms of structures (e.g., processors, memory, I / O devices such as cameras, or combinations thereof). Alternatively, "means for" may include algorithms that describe functions or method steps, while in other embodiments, "means for" may be expressed in terms of mathematical formulas, prose, or as a flow chart or signal diagram.

[0474] The terms used herein are for the purpose of describing specific embodiments only and are not intended to limit the present invention. As used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that when used in this specification, the terms "comprises" and / or "comprising" specify the presence of stated features, integers, steps, operations, elements, and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, and / or groups thereof.

[0475] If any disclosure is incorporated herein by reference, and such incorporated disclosure conflicts with the present disclosure in part and / or in whole, the present disclosure shall prevail to the extent of the conflict, and / or broader disclosure, and / or broader definition of terms. If such incorporated disclosure conflicts with each other in part and / or in whole, the disclosure with the later date shall prevail to the extent of the conflict.

[0476] The terms used herein may mean directly or indirectly, in whole or in part, temporarily or permanently, immediately or delayed, synchronously or asynchronously, action or inaction. For example, when an element is referred to as being "on", "connected" or "coupled" to another element, the element may be directly on, connected or coupled to another element, and / or there may be intermediate elements, including indirect and / or direct variations. On the contrary, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intermediate elements. The description here is illustrative, not restrictive. By reading this disclosure, many variations of the present technology will become apparent to those skilled in the art.

[0477] It will be appreciated that various and other features and functions disclosed above, or alternatives thereto, may be ideally combined into many other different systems or applications (e.g., head-up displays). Various presently unforeseen or unanticipated substitutions, modifications, variations, or improvements may subsequently be made by those skilled in the art, which are also intended to be encompassed by the appended claims. For example, the head-mounted display device may be a mask, goggles, or headband structure, and is not limited to the specific types shown in the figures. Likewise, the shape of the optical combiner substrate may be any shape capable of directing and combining images in the manner described above.

[0478] The description of the present disclosure is given for the purpose of illustration and description, but is not intended to be exhaustive or to limit the present disclosure to the disclosed form. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the present disclosure. The exemplary embodiments are selected and described in order to best explain the principles of the present disclosure and its practical application, and to enable others of ordinary skill in the art to understand the present disclosure to obtain various embodiments with various modifications suitable for the specific use contemplated.

[0479] Although various embodiments have been described above, it should be understood that they are given as examples only and not as limitations. These descriptions are not intended to limit the scope of the present technology to the specific forms set forth herein. Therefore, the width and scope of the preferred embodiments should not be limited by any of the above-described exemplary embodiments. It should be understood that the above description is illustrative rather than restrictive. On the contrary, this specification is intended to cover substitutions, modifications and equivalents that may be included in the spirit and scope of the present technology defined by the attached claims and understood by ordinary technicians in other ways. Therefore, the scope of the present technology should not be determined with reference to the above description, but should be determined with reference to the full scope of the attached claims and their equivalents.

Claims

1. An augmented reality system, comprising: at least one processor that executes computer-executable instructions stored in the memory to control components of the augmented reality system; as well as A hyperfocal reflective system, the hyperfocal reflective system comprising a hyperfocal reflective viewport group, the hyperfocal reflective viewport group facilitates the transmission of an image to an eye group, extending the focus adjustment range to exceed the focus adjustment range of a source image.

2. The system of claim 1, wherein the set of hyperfocal reflective viewports reduces the optical effect of convergence.

3. The system of claim 1, wherein the hyperfocal reflective system is a perspective optical combiner.

4. The system of claim 1, wherein the hyperfocal reflective system is a non-see-through optical combiner.

5. The system of claim 1, wherein the hyperfocal reflection system is an optical waveguide based system.

6. The system of claim 1, wherein the hyperfocal reflective system is a free-space optical reflector / combiner based system.

7. The system of claim 1, wherein the hyperfocal reflector system further comprises: an optical input coupling portion configured to input couple a collimated display image to the optical substrate; and An optical hyperfocal output coupling portion, wherein the optical hyperfocal output coupling portion is integrated with the optical substrate; wherein at least one hyperfocal reflective viewport comprises at least one discrete optical hyperfocal reflector spot integrated with said optical substrate; wherein the discrete optical hyperfocal reflector spots are at least partially reflective and are configured to reflectively project discrete portions of light of the input coupled collimated display image onto a target area located at a predetermined working distance from at least one hyperfocal reflective viewport as discrete spot bundles of light forming discrete virtual display image portions, Wherein, the size of the discrete optical hyperfocal reflector spot is set to form the discrete light spot beam having a diameter at the target area, so that the view of the discrete virtual display image portion seen by the lens detector system that can be located at the target area is hyperfocused.

8. The system of claim 1, wherein at least one hyperfocal reflective viewport in the set of hyperfocal reflective viewports comprises a discrete optical hyperfocal reflective spot integrated with an optical substrate.

9. The system of claim 8, wherein the discrete optical hyperfocal reflective spot is configured to be reflectively projected onto a lens-detector system.

10. The system of claim 9, wherein the lens detector system is located at a predetermined working distance from the at least one hyperfocal reflective viewport for viewing discrete virtual display image portions.

11. The system of claim 8, wherein the discrete optical hyperfocal reflective spot is configured to be reflectively projected onto a target area where a lens-detector system is to be placed.

12. The system of claim 11, wherein the target area is located at a predetermined working distance from the at least one hyperfocal reflective viewport for viewing a discrete virtual display portion.

13. A system according to claim 12, wherein the aperture size of the discrete optical hyperfocal reflective spot is set to form a virtual image hyperfocal spot with an aperture diameter (D) at the target area of ​​the lens detector system, so that the discrete spot beam forms a hyperfocused view of the discrete virtual display portion seen by the lens detector system.

14. An enhanced display system, comprising: at least one processor that executes computer-executable instructions stored in the memory to control components of the enhanced display system; as well as A display image generating system comprising a pair of optical hyperfocal reflective systems for a pair of eyes in a binocular configuration, wherein each optical hyperfocal reflective system comprises a set of hyperfocal reflective viewports that facilitate transmission of an image to the eye extending a focus adjustment range beyond that of a source image.

15. The system of claim 14, wherein the display image generation system collimates the display image to infinity.

16. The system of claim 14, wherein the hyperfocal reflective viewport is integrated with an optical substrate, the optical substrate comprising optical hyperfocal reflector spots spaced apart from one another in a pattern extending along the optical hyperfocal coupling portion to form a plurality of virtual display image partial hyperfocus views that collectively correspond to at least a portion of a display image.

17. The system of claim 14, wherein the set of hyperfocal reflective viewports reduces the optical effects of convergence.

18. A computer-implemented method comprising: executing computer executable instructions stored in the memory using at least one processor to control components of the enhanced display system; as well as A pair of optical hyperfocal reflex systems are used for a pair of eyes in a binocular configuration, wherein each optical hyperfocal reflex system includes a set of hyperfocal reflex viewports to facilitate transmitting an image to the eye extending a focus adjustment range beyond that of a source image.

19. The method of claim 18, further comprising using the set of hyperfocal reflective viewports to reduce optical effects of convergence.

20. The method of claim 18, further comprising collimating the displayed image to infinity.

Images