Head-mounted display (HMD) devices, methods, and systems

Abstract

For example, a head-mounted display (HMD) may include: a central display configured to display a first image in a central field of view (FoV) based on an image scene to be displayed to a user's pupil; a central lens configured to direct light from the first image toward the user's pupil; a peripheral display configured to display a second image in a temporal FoV based on the image scene; and a peripheral lens configured to direct light from the second image toward the user's pupil, the peripheral lens being tilted relative to the central lens at a tilt angle.

Description

[0001] Cross-references

[0002] This application claims the benefit and priority of U.S. Provisional Patent Application No. 62 / 988,148, filed March 11, 2020, entitled “WIDE FIELD OF VIEW VIRTUAL REALITYSYSTEM (VRDOM)”, the entire disclosure of which is incorporated herein by reference. Technical Field

[0003] The implementation described herein generally relates to a head-mounted display (HMD) device. Background Technology

[0004] Head-mounted display (HMD) devices can be installed on a user's head, for example, in front of the user's eyes.

[0005] HMDs can be used to display images to the user's eyes.

[0006] HMDs can be used, for example, in virtual reality games and simulators. Attached Figure Description

[0007] To keep the illustrations simple and clear, the elements shown in the accompanying drawings are not necessarily drawn to scale. For example, some elements may be enlarged relative to others for clarity. Additionally, reference numerals may be repeated in the drawings to indicate corresponding or similar elements. The accompanying drawings are listed below.

[0008] Figure 1 This is a schematic diagram of a head-mounted display (HMD) device based on some exemplary implementation schemes.

[0009] According to some exemplary implementation plans, Figure 2A This is a schematic diagram of the HMD as observed under direct gaze of the pupil. Figure 2B This is a schematic diagram of the HMD as observed under nasal gaze of the pupil, and Figure 2C This is a schematic diagram of HMD as observed under temporal gaze of the pupil.

[0010] According to some exemplary implementation plans, Figures 3A to 3C This is a schematic diagram of the top view of the HMD, and Figure 3D This is a schematic diagram of the side view of the central display and central lens of the HMD.

[0011] According to some exemplary implementation plans, Figure 4A This is a schematic diagram of the first HMD configuration as observed under direct pupil gaze. Figure 4B This is a schematic diagram of the second HMD configuration as observed under direct pupil gaze, and Figure 4CThis is a schematic diagram of the second HMD configuration as observed under temporal gaze of the pupil.

[0012] Figure 5 These are schematic diagrams of the first, second, and third HMD configurations based on some exemplary implementation schemes.

[0013] According to some exemplary implementation plans, Figure 6A This is a schematic diagram of the first HMD configuration as observed under direct pupil gaze, and Figure 6B This is a schematic diagram of the second HMD configuration as observed under temporal gaze of the pupil.

[0014] Figure 7 This is a schematic diagram of a pre-distortion scheme for distorting image scenes to be displayed by an HMD, based on some exemplary implementation schemes.

[0015] Figure 8 This is a schematic diagram of an allocation scheme for distributing image scenes to be displayed by the central display and peripheral displays of the HMD, based on some exemplary implementation schemes.

[0016] Figure 9 This is a schematic diagram of an adjustment scheme for adjusting an image scene to be displayed by an HMD, based on some exemplary implementation schemes.

[0017] Figure 10 This is a schematic diagram of an HMD based on some exemplary implementation schemes.

[0018] Figure 11 This is a schematic diagram of a validation scheme for a continuous field of view (FoV) of an HMD, based on some exemplary implementation schemes.

[0019] Figure 12 This is a schematic diagram of planar hybrid lenses and concave hybrid lenses that can be implemented according to some exemplary implementation schemes.

[0020] Figure 13 This is a schematic block diagram of a system 1300 including a computing device and an HMD device, based on some exemplary implementation schemes.

[0021] Figure 14 This is a schematic flowchart illustrating a method for controlling HMD based on some exemplary implementation schemes.

[0022] Figure 15 These are schematic block diagrams illustrating the manufacture of products based on some exemplary implementation schemes. Detailed Implementation

[0023] In the following detailed description, numerous specific details are set forth to provide a thorough understanding of some implementations. However, those skilled in the art will understand that some implementations can be practiced without these specific details. In other instances, well-known methods, procedures, components, units, and / or circuits have not been described in detail to avoid obscuring the discussion.

[0024] The use of terms such as “processing,” “computing,” “calculating,” “determining,” “establishing,” “analyzing,” and “checking” in this document may refer to one or more operations and / or one or more processes of a computer, computing platform, computing system, or other electronic computing device that manipulates and / or converts data represented as physical (e.g., electronic) quantities in the computer’s registers and / or memory into other data similarly represented as physical quantities in the computer’s registers and / or memory or other information storage media that can store instructions to perform operations and / or processes.

[0025] As used herein, the terms “several” and “more than” include, for example, “multiple” or “two or more”. For example, “multiple items” includes two or more items.

[0026] Some parts of the following detailed embodiments are presented based on symbolic representations of algorithms and operations performed on data bits or binary digital signals in computer memory. These algorithmic descriptions and representations are techniques that can be used by those skilled in the art of data processing to communicate their working essence to others skilled in the art.

[0027] An algorithm is, and generally is, considered as a self-consistent sequence of actions or operations that produces a desired result. These actions or operations involve the physical manipulation of physical quantities. Generally, but not necessarily, these quantities take the form of electrical or magnetic signals that can be stored, transmitted, combined, compared, and otherwise manipulated. Primarily for reasons of habit, it has proven convenient to sometimes refer to these signals as bits, values, elements, symbols, characters, items, numbers, etc. However, it should be understood that all these and similar terms are associated with the appropriate physical quantities and are merely convenient labels applied to those quantities.

[0028] As used herein, the term "circuit" may refer to, be part of, or include: an application-specific integrated circuit (ASIC), an integrated circuit, an electronic circuit, a processor (shared, dedicated, or grouped) and / or memory (shared, dedicated, or grouped) executing one or more software or firmware programs, combinational logic circuitry, and / or other suitable hardware components that provide the described functionality. In some embodiments, the circuit may be implemented in one or more software or firmware modules, or the functionality associated with the circuit may be implemented by said one or more software or firmware modules. In some embodiments, the circuit may include logic that is at least partially operable in hardware.

[0029] The term "logic" can refer to computational logic, for example, in circuitry embedded in a computing device and / or stored in the memory of a computing device. For example, logic may be accessible by a processor of the computing device to perform computational functions and / or operations. In one instance, logic may be embedded in various types of memory and / or firmware, such as in silicon blocks of various chips and / or processors. Logic may be included in various circuitry, such as control circuitry, processor circuitry, and / or similar circuitry, and / or implemented as part of said circuitry. In one instance, logic may be embedded in volatile and / or non-volatile memory, including random access memory, read-only memory, programmable memory, magnetic memory, flash memory, persistent memory, and / or similar memory. Logic may be executed by one or more processors using memory (e.g., registers, buffers, stacks, etc.) coupled to one or more processors, for example, executing logic as needed.

[0030] Now to Figure 1 For reference, a head-mounted display (HMD) device 100 is schematically shown according to some exemplary embodiments.

[0031] In some exemplary embodiments, the HMD device 100 may be configured to be mounted and / or placed in front of a user's eyes. For example, the HMD device 100 may be configured to be worn on a user's head or on a helmet.

[0032] In some exemplary implementations, the HMD device 100 may be configured to display images, such as still images or video images, to a user.

[0033] In some exemplary implementations, the HMD device 100 may be implemented, for example, to display images of extended reality (XR) applications, virtual reality (VR) applications, augmented reality applications, gaming applications, civil aviation applications, simulators, engineering applications, medical applications, and / or images of any other additional or alternative applications and / or implementations.

[0034] In some exemplary embodiments, the HMD device 100 may be configured to cover a wide field of view (FoV), for example, as described below.

[0035] In some exemplary implementations, the HMD device 100 may be configured to cover a wide FoV, for example to enhance the user’s sense of immersion, presence and / or performance, such as in tasks requiring peripheral vision, such as in virtual environments and / or in enhanced video pass-through environments, as described below.

[0036] In one instance, the HMD device 100 can be configured to cover a wide temporal FoV, for example, to provide the player with the effect that "no enemy can escape from the corner of your FoV" in a VR game.

[0037] In another instance, the HMD device 100 may be configured for use by race car drivers and / or pilots in simulations, which may require the use of temporal FoV in real-world scenarios. For example, a headset with limited FoV coverage may not be adequate for such training needs, and therefore, a simulator using a "dome projection" setup may be very complex and / or expensive. For instance, the HMD device 100 may render the use of a complex and expensive dome projection unnecessary.

[0038] In some exemplary embodiments, the HMD device 100 may be configured to cover (e.g., fully cover) the human FoV, including, for example, additional FoV, which may be covered, for example, by eye movement within the comfort zone, as described below.

[0039] In one instance, FoV that fully covers human FoV can, for example, provide an improved user experience in pass-through extended reality (pass-through XR) applications by having “real” and “virtual” FoV that correspond to and simulate human natural FoV.

[0040] In some exemplary embodiments, the HMD device 100 may be configured to cover a horizontal FoV of 270 degrees (°), for example, as described below.

[0041] In one instance, for example under direct eye gaze of the user, the human horizontal field of vision (FoV) can provide 210°. Based on this instance, taking into account, for example, a horizontal eye rotation of approximately + / - 30° relative to direct gaze, the maximum horizontal FoV can be 270°, e.g., 210° + 2 × 30° = 270°.

[0042] In other embodiments, the HMD device 100 may be configured to cover any other horizontal FOV, such as less than or greater than 270°.

[0043] In some exemplary embodiments, the HMD device 100 may be configured to cover a vertical FoV of 170 degrees, for example, as described below.

[0044] In one instance, the human vertical field of view can provide 120°, for example, a vertical FOV of 50° upward and 70° downward. Based on this instance, considering, for example, a vertical eye rotation of approximately + / - 25° relative to direct gaze, the maximum vertical FoV can be 170°, for example, ((50°+25°)+(70°+25°))=170°.

[0045] In other embodiments, the HMD device 100 may be configured to cover any other vertical FOV, such as less than or greater than 170°.

[0046] In some exemplary embodiments, the HMD device 100 may be configured to cover a 270° × 170° field of view, for example, which may cover the human field of view (FOV) as well as an additional field of view (FOV) covered by the rotation of the eyes relative to direct gaze.

[0047] In some exemplary embodiments, the HMD device 100 may be configured to cover a wide FoV, for example, even without affecting visual clarity in the continuous FoV and / or the entire continuous FoV, as described below.

[0048] In some exemplary embodiments, the HMD device 100 may maintain continuous FoV and / or visual acuity, for example, for different eye gazes of the user's eyes, as described below.

[0049] In one instance, the HMD device 100 may be configured to cover a wide FoV, for example, even when there are no “black bands,” “ghosting segments,” and / or “seems” in the FoV. For example, the HMD device 100 may be configured to cover a wide FoV, for example, even in areas that do not affect the eye’s comfort zone of rotation, such as within a radius of up to about 30°, and / or in areas where the eye is forced to rotate, such as within a radius of up to about 45° relative to direct eye gaze, while maintaining visual clarity.

[0050] In some exemplary embodiments, the HMD device 100 may be configured to cover a wide FoV, such that a user can continuously view panoramic images and / or videos, for example, at any fixed eye gaze angle and / or at a convergent virtual distance, as described below.

[0051] In one instance, in a natural implementation, visual scanning of a scene can be achieved through a set of actions, such as moving the user's head and body within space and moving the user's eyes within the user's field of view. For example, the fastest scanning can be performed by the eyes, while head and body movement can be incidental. For example, the eyes can, for instance, scan from one scene location to another, such as multiple times per second.

[0052] Based on this example, a visual scan of a scene can construct a fairly complete representation of what is happening in the scene, but the eye may only have high resolution within a narrow window. For example, if any visual detail is important for understanding FoV, the coordination of head and eye movements can guide the eye to the target and allow for the encoding of the target.

[0053] Therefore, for HMDs with a wide FoV, such as continuous FoV for any gaze position in certain applications, it may be advantageous, and in some cases even very important. For example, in the presence of a "blackening" angle in the FoV, important stimulus data of the scene may be missed, and the scene's objectives may not be achieved.

[0054] In some exemplary embodiments, HMD device 100 may be configured to cover a wide FoV, for example, even without affecting the compactness, design and / or availability of HMD device 100, as described below.

[0055] In some exemplary embodiments, the HMD device 100 may support a wide range of lens-display focal lengths, for example, as described below.

[0056] In one example, the HMD device 100 can support lens-display focal lengths in the range of 15 mm to 100 mm.

[0057] In another example, the HMD device 100 can support lens-display focal lengths in the range of 25mm to 40mm.

[0058] In other implementations, any other lens-display focal length can be achieved.

[0059] In some exemplary embodiments, the HMD device 100 may be configured to cover a wide FoV, for example, when utilizing non-standard optical materials and / or non-standard manufacturing methods that may be developed specifically for cost-effective mass production.

[0060] In some exemplary embodiments, the HMD device 100 may be configured to provide a continuous field of view and / or an optically optimized field of view over a wide FoV for a number of different exit pupil distances, for example, as described below.

[0061] In some exemplary embodiments, the HMD device 100 may be configured to provide a continuous field of view and / or optically optimized field of view over a wide FoV, even when used by a user with myopia and / or hyperopia, for example, as described below.

[0062] In some exemplary embodiments, the HMD device 100 may be configured to provide, for example, a continuous field of view and / or an optically optimized field of view under different mountings of the HMD device 100 relative to the user's head, as described below. For example, the HMD device 100 may provide a continuous field of view and / or an optically optimized field of view, for example, at multiple different tilt (pitch) angles of the HMD device 100 relative to the user's head, as described below.

[0063] In some exemplary embodiments, the HMD device 100 may be configured to display panoramic image scenes, for example, as described below.

[0064] In some exemplary embodiments, the HMD device 100 may include a first HMD 102 for displaying an image scene, such as a panoramic scene, to a user's first pupil 152. For example, the pupil 152 may be the pupil of the user's right eye, as described below.

[0065] In some exemplary embodiments, HMD device 100 may include a second HMD 104 for displaying another image scene, such as a panoramic image scene, to a user's second pupil 154. For example, pupil 154 may be the pupil of the user's left eye, as described below.

[0066] In some exemplary implementations, the HMD (e.g., HMD 102 and / or HMD 104) may be configured to include only a single center display and a single peripheral display, for example, as described below.

[0067] In other embodiments, HMD 102 and / or HMD 104 may include more than one central display and / or more than one peripheral display.

[0068] In some exemplary implementations, in certain use cases and / or scenarios, such as when using a large number of displays, such as a large number of center displays and / or a large number of peripheral displays, one or more disadvantages, inefficiencies, and / or technical problems may exist. For example, an HMD may include multiple mini-displays and / or multiple micro-displays that can be configured and / or operated as a combined large display.

[0069] In one instance, an HMD utilizing a large number of displays may require complex manufacturing and / or operating procedures.

[0070] In another instance, using a large number of displays in an HMD can increase the total cost of the HMD, for example, because the cost per display area of ​​a mini-display or micro-display can be much higher than the cost per area of ​​a large display, for example, up to 5 times higher.

[0071] In one example, the center display 110 and / or the peripheral display 130 may be implemented using mini-displays. For example, mini-displays may have a display size ranging from 1.5” to 7”. This implementation may be technically advantageous compared to implementations using microdisplays with display sizes up to 1.8”. For example, approximately six microdisplays might be needed to cover the same FoV of the mini-displays. For instance, for the same FoV, if the cost of microdisplays is approximately five times higher than that of mini-displays, the implementation using microdisplays might have a total cost that is approximately 30 times higher than the implementation using mini-displays.

[0072] In some exemplary embodiments, HMD 102 may include a central display (CD) 110, a central lens 120, a peripheral display (PD) 130, and a peripheral lens 140, for example, as described below.

[0073] In some exemplary embodiments, the peripheral lens 140 may be tilted relative to the central lens 120 at an angle 127, for example, as described below.

[0074] In some exemplary embodiments, HMD 104 may include CD 160, central lens 165, PD 170 and peripheral lens 175, for example, as described below.

[0075] In some exemplary embodiments, the lenses (e.g., central lens 120, central lens 165, peripheral lens 140, and / or peripheral lens 175) can be implemented using any suitable optical structure, module, element, and / or system. In one example, the lenses (e.g., central lens 120, central lens 165, peripheral lens 140, and / or peripheral lens 175) can be implemented using an optical lens. In another example, the lenses (e.g., central lens 120, central lens 165, peripheral lens 140, and / or peripheral lens 175) can be implemented using a lens module, lens structure, and / or lens system.

[0076] In some exemplary embodiments, the peripheral lens 175 may be tilted relative to the central lens 165 at an angle similar to or different from the tilt angle 127.

[0077] In some exemplary embodiments, some or even all of the elements of HMD 102 may be similar to, or even identical to, the corresponding elements of HMD 104, for example, as described below.

[0078] In other implementations, some or all of the elements of HMD 102 may differ from the corresponding portions of HMD 104.

[0079] In some exemplary embodiments, the central display 110 may include a central zone (cz) display area 112, an extended central zone (xcz) display area 114 and / or an extended nasal zone (nz) display area 116, for example, as described below.

[0080] In some exemplary embodiments, the xcz display area 114 may be adjacent to the cz display area 112, for example, as described below.

[0081] In some exemplary implementations, the nz display area 116 may be adjacent to the cz display area 112, for example, as described below.

[0082] In some exemplary embodiments, the cz display area 112 may be located between the xcz display area 114 and the nz display area 116, for example, as described below.

[0083] In some exemplary embodiments, the central lens 120 may include a cz lens portion 122, an xcz lens portion 124, and / or an nz lens portion 126, for example, as described below.

[0084] In some exemplary embodiments, the xcz lens portion 124 may be adjacent to the cz lens portion 122, for example, as described below.

[0085] In some exemplary embodiments, the nz lens portion 126 may be adjacent to the cz lens portion 122, for example, as described below.

[0086] In some exemplary embodiments, the cz lens portion 122 may be located between the xcz lens portion 124 and the nz lens portion 126, for example, as described below.

[0087] In some exemplary embodiments, the peripheral display 130 may include a temporal lateral (tz) display area 132, an extended temporal lateral (xtz) display area 134, and / or an extended distal temporal lateral (xftz) display area 136, for example, as described below.

[0088] In some exemplary embodiments, the xtz display area 134 may be adjacent to the tz display area 132, for example, as described below.

[0089] In some exemplary implementations, the xftz display area 136 may be adjacent to the tz display area 132, for example, as described below.

[0090] In some exemplary embodiments, the tz display area 132 may be located between the xtz display area 134 and the xftz display area 136, for example, as described below.

[0091] In some exemplary embodiments, the peripheral lens 140 may include a tz lens portion 142, an xtz lens portion 144, and / or an xftz lens portion 146, for example, as described below.

[0092] In some exemplary embodiments, the xtz lens portion 144 may be adjacent to the tz lens portion 142, for example, as described below.

[0093] In some exemplary embodiments, the xftz lens portion 146 may be adjacent to the tz lens portion 142, for example, as described below.

[0094] In some exemplary embodiments, the tz lens portion 142 may be located between the xtz lens portion 144 and the xftz lens portion 146, for example, as described below.

[0095] In some exemplary embodiments, the central display 160 may include a cz display area 162, an xcz display area 164, and / or an nz display area 163.

[0096] In some exemplary embodiments, the central lens 165 may include a cz lens portion 166, an xcz lens portion 168, and / or an nz lens portion 167, for example, as described below.

[0097] In some exemplary embodiments, the peripheral display 170 may include a tz display area 172, an xtz display area 174, and / or an xftz display area 173, for example, as described below.

[0098] In some exemplary embodiments, the peripheral lens 175 may include a tz lens portion 176, an xtz lens portion 178, and / or an xftz lens portion 177, for example, as described below.

[0099] In some exemplary embodiments, lens 120 and / or lens 140 may be configured, for example, according to a hybrid lens configuration, as described below.

[0100] In other embodiments, lens 120 and / or lens 140 may be configured according to any other configuration.

[0101] In some exemplary embodiments, lens 165 and / or lens 175 may be configured, for example, according to a hybrid lens configuration, as described below.

[0102] In other embodiments, lens 165 and / or lens 175 may be configured according to any other configuration.

[0103] In some exemplary embodiments, the hybrid lens configuration may include a freeform lens, such as an aspherical lens, for central vision, and a freeform Fresnel refractive lens, such as those described below, for peripheral vision.

[0104] For example, lens 120 and / or lens 165 may include a freeform lens; and / or lens 140 and / or lens 175 may include a freeform Fresnel refractive lens, for example, as described below.

[0105] In other embodiments, lens 120, lens 165, lens 140 and / or lens 175 may include any other type of lens.

[0106] In some exemplary embodiments, the central display 110 may be configured to display a first image in the central FoV, for example, based on an image scene to be displayed to the pupil 152, as described below.

[0107] In some exemplary embodiments, the cz display area 112 may be configured to display the cz portion of the first image, for example, as described below.

[0108] In some exemplary embodiments, the xcz display area 114 may be configured to display the xcz portion of the first image, for example, as described below.

[0109] In some exemplary embodiments, the nz display area 116 may be configured to display the nz portion of the first image, for example, as described below.

[0110] In some exemplary embodiments, the central lens 120 may be configured to direct the light of the first image toward the pupil 152, for example, as described below.

[0111] In some exemplary embodiments, the cz lens portion 122 may be configured to direct light from the cz portion of the first image toward the pupil 152, for example, under direct gaze of the pupil 152, under nasal gaze of the pupil 152, and / or under temporal gaze of the pupil 152, as described below.

[0112] In some exemplary embodiments, direct gaze of the pupil 152 can be defined as gaze with the pupil 152 toward the center of the image scene. For example, direct gaze can be defined as 0 degrees around the visual axis, such as within the range of +5 degrees to -5 degrees relative to the visual axis. In other embodiments, direct gaze can be defined within any other angular range relative to the visual axis.

[0113] In some exemplary implementations, the positive horizontal angle of the pupil 152 can be defined in the direction toward the user's nose, while the negative horizontal angle of the pupil 152 can be defined in the direction toward the user's ear.

[0114] In some exemplary implementations, nasal gaze can be defined as gaze that is not direct gaze, but rather gaze in a direction toward the user's nose. For example, nasal gaze can be between 0 degrees and the maximum supporting positive gaze angle toward the nose.

[0115] In one instance, for example, when the eyes are forced to turn, nasal gaze can be defined as an angle between 0 and 70 degrees.

[0116] In another instance, for example, within the comfort zone, nasal gaze can be defined as an angle between 0 and 20 degrees.

[0117] In other implementations, nasal gaze can be defined within any other angular range.

[0118] In some exemplary implementations, temporal fixation can be defined as not direct fixation, but rather fixation in a direction away from the user's nose, such as toward the user's ear. For example, temporal fixation can be between 0 degrees and the maximum supporting negative fixation angle toward the ear.

[0119] In one instance, for example, when the eyes are forced to turn, temporal gaze can be defined as an angle between 0 degrees and -70 degrees.

[0120] In another instance, for example, within the eye's comfort zone, temporal gaze can be defined as an angle between 0 and -20 degrees.

[0121] In other implementations, temporal gaze can be defined within any other angular range.

[0122] In some exemplary embodiments, the cz lens portion 122 and the cz display area 112 may be configured to support rotational gaze optimization of the pupil 152, for example, to achieve the maximum design choice under left gaze, right gaze, upward gaze, and / or downward gaze, as described below.

[0123] In some exemplary embodiments, the xcz lens portion 124 may be configured to direct light from the xcz portion of the first image toward the pupil 152, for example, under nasal-side viewing of the pupil 152, as described below.

[0124] In one example, the xcz lens portion 124 and the xcz display area 114 may be configured to support, for example, a continuous FoV of maximum design selection under nasal gaze of the pupil 152, as described below.

[0125] In some exemplary embodiments, the nz lens portion 124 may be configured to direct light from the nz portion of the first image toward the pupil 152, for example, under direct gaze, temporal gaze, and / or nasal gaze of the pupil 152, as described below.

[0126] In one example, the nz lens portion 126 and the nz display area 116 may be configured to support direct gaze peripheral FoV optimization, and / or, for example, upper (uz) and lower (dz) areas for vertical gaze of the pupil 152, as described below.

[0127] In some exemplary embodiments, the peripheral display 130 may be configured to display a second image in the temporal FoV, for example, based on the image scene, as described below.

[0128] In some exemplary embodiments, the tz display area 132 may be configured to display a tz portion of the second image, for example, as described below.

[0129] In some exemplary embodiments, the xtz display area 134 may be configured to display an xtz portion of a second image, for example, as described below.

[0130] In some exemplary embodiments, the xftz display area 136 may be configured to display the xftz portion of the second image, for example, as described below.

[0131] In some exemplary embodiments, the peripheral lens 140 may be configured to direct the light of the second image toward the pupil 152, for example, as described below.

[0132] In some exemplary embodiments, the tz lens portion 142 may be configured to direct light from the tz portion of the second image toward the pupil 152, for example, under direct gaze, temporal gaze, and / or nasal gaze of the pupil 152, as described below.

[0133] In one example, the TZ lens portion 142 and the TZ display area 132 may be configured to support the temporal region and continuation of the CZ display area 112 under direct gaze of the pupil 152, for example, as described below.

[0134] In some exemplary embodiments, the xtz lens portion 144 may be configured to direct light from the xtz portion of the second image toward the pupil 152, for example, under temporal gaze of the pupil 152, as described below.

[0135] In one example, the xtz lens portion 144 and the xtz display area 134 may be configured to support continuous FoV, for example, maximum design selection, under temporal gaze of the pupil 152, as described below.

[0136] In some exemplary embodiments, the xftz lens portion 146 may be configured to direct light from the xftz portion of the second image toward the pupil 152, for example, under temporal gaze of the pupil 152, as described below.

[0137] In one example, the xftz lens portion 146 and the xftz display area 136 can be configured to support a maximum temporal FoV up to, for example, the maximum design selection, under temporal gaze of the pupil 152, as described below.

[0138] In some exemplary implementations, each of the central FoV and / or temporal FoV may include a horizontal FoV of at least 45 degrees, for example, as described below.

[0139] In some exemplary implementations, each of the central FoV and / or temporal FoV may include a horizontal FoV of at least 60 degrees, for example, as described below.

[0140] In some exemplary implementations, each of the central FoV and / or temporal FoV may include a horizontal FoV of at least 70 degrees, for example, as described below.

[0141] In some exemplary implementations, each of the central FoV and / or temporal FoV may include a horizontal FoV of at least 80 degrees, for example, as described below.

[0142] In some exemplary implementations, each of the central FoV and / or temporal FoV may include a vertical FoV of at least 80 degrees, for example, as described below.

[0143] In some exemplary implementations, the central FoV and / or temporal FoV may be configured, for example, to form a continuous horizontal FoV of at least 130 degrees under a nasal FoV of at least 30 degrees for a monocular FoV, for example, as described below.

[0144] In one instance, for example, under direct gaze from pupil 152, the central FoV can form a first continuous horizontal FoV of 80 degrees, and the temporal FoV can form a second continuous horizontal FoV of 80 degrees. According to this instance, with a 30-degree overlap, at least 130 degrees of continuous horizontal FoV can be formed.

[0145] In some exemplary implementations, the central FoV and temporal FoV can be configured, for example, to form a continuous horizontal FoV of at least 180 degrees under a nasal FoV of at least 40 degrees for monocular FoV.

[0146] In one instance, for example, under direct gaze from pupil 152, the central FoV can form a continuous horizontal FoV of 85 degrees, and / or the temporal FoV can form a continuous horizontal FoV of 125 degrees. According to this instance, in the presence of 30-degree overlap, a continuous horizontal FoV of at least 180 degrees can be formed.

[0147] In some exemplary implementations, the central FoV and temporal FoV can be configured, for example, to form a continuous horizontal FoV of at least 200 degrees under a nasal FoV of at least 50 degrees for monocular FoV, for example, as described below.

[0148] In one instance, for example, under forced direct fixation and temporal fixation at pupil 152, the central FoV can form a continuous horizontal FoV of 95 degrees, and / or the temporal FoV can form a continuous horizontal FoV of 135 degrees. According to this instance, in the presence of 30-degree overlap, a continuous horizontal FoV of at least 200 degrees can be formed.

[0149] In some exemplary embodiments, HMD 102 may be configured to provide continuous nasal gaze FoV to pupil 152 during nasal gaze, for example, as described below.

[0150] In some exemplary embodiments, continuous nasal-side gaze FoV may include: light from the cz portion of a first image guided toward the pupil 152 by the cz lens portion 122 under nasal-side gaze; light from the xcz portion of the first image guided toward the pupil 152 by the xcz lens portion 124 under nasal-side gaze; and / or light from the tz portion of a second image guided toward the pupil 152 by the tz lens portion 142 under nasal-side gaze, for example, as described below.

[0151] In some exemplary embodiments, HMD 102 may be configured to provide continuous temporal gaze FoV to pupil 152 during temporal gaze, for example, as described below.

[0152] In some exemplary embodiments, continuous temporal gaze FoV may include: light from the cz portion of a first image guided toward the pupil 152 by the cz lens portion 122 under temporal gaze; light from the xtz portion of a second image guided toward the pupil 152 by the xtz lens portion 144 under temporal gaze; and / or light from the tz portion of a second image guided toward the pupil 152 by the tz lens portion 142 under temporal gaze, for example, as described below.

[0153] In some exemplary embodiments, HMD 102 may be configured to provide continuous direct gaze (FoV) to pupil 152 under direct gaze, for example, as described below.

[0154] In some exemplary embodiments, continuous direct gaze FoV may include: light from the cz portion of a first image guided toward the pupil 152 by the cz lens portion 122 under direct gaze; and light from the tz portion of a second image guided toward the pupil 152 by the tz lens portion 142 under direct gaze, for example, as described below.

[0155] The following figures are for reference based on some exemplary implementation schemes: Figure 2A It schematically shows HMD 202 as observed under direct gaze of pupil 252; Figure 2B It schematically illustrates HMD 202 as observed under nasal gaze from pupil 252; and Figure 2C This schematically illustrates HMD 202 as observed under temporal fixation of pupil 252. For example, HMD 102 ( Figure 1 It may include one or more elements of HMD 202, and / or perform one or more operations and / or one or more functions of HMD 202.

[0156] In some exemplary implementation schemes, such as Figures 2A to 2C As shown, HMD 202 may include a central display 210, a central lens 220, a peripheral display 230 and / or a peripheral lens 240, for example, as described below.

[0157] In some exemplary implementation schemes, such as Figures 2A to 2C As shown, the central display 210 may include a cz display area 212, an xcz display area 214, and / or an nz display area 216. For example, the central display 110 ( Figure 1 It may include one or more elements of the central display 210, and / or may perform one or more operations and / or one or more functions of the central display 210.

[0158] In some exemplary implementation schemes, such as Figures 2A to 2CAs shown, the central lens 220 may include a cz lens portion 222, an xcz lens portion 224, and / or an nz lens portion 226. For example, the central lens 120 ( Figure 1 It may include one or more elements of the central lens 220, and / or perform one or more operations and / or one or more functions of the central lens 220.

[0159] In some exemplary implementation schemes, such as Figures 2A to 2C As shown, the peripheral display 230 may include a tz display area 232, an xtz display area 234, and / or an xftz display area 236, for example, as described below. For example, the peripheral display 130 ( Figure 1 It may include one or more elements of the peripheral display 230, and / or may perform one or more operations and / or one or more functions of the peripheral display 230.

[0160] In some exemplary implementation schemes, such as Figures 2A to 2C As shown, the peripheral lens 240 may include a TZ lens portion 242, an XTZ lens portion 244, and / or an XFTZ lens portion 246, for example, as described below. For example, peripheral lens 140 ( Figure 1 It may include one or more elements of the peripheral lens 240, and / or perform one or more operations and / or one or more functions of the peripheral lens 240.

[0161] In some exemplary implementations, the HMD 202 may be configured to provide continuous FoV for substantially any gaze direction, for example, as described below.

[0162] In some exemplary embodiments, HMD 202 may be configured to provide a continuous image, for example, under different eye gazes of pupil 252, such as between lenses, such as during the transition between central lens 220 and peripheral lens 240, as described below.

[0163] In some exemplary implementation schemes, such as Figure 2A As shown, HMD 202 can be configured to provide continuous direct gaze FoV 211 to pupil 252 under direct gaze, for example, as described below.

[0164] In some exemplary implementation schemes, such as Figure 2A As shown, continuous direct gaze FoV 211 may include: light from the cz portion of a first image guided toward the pupil 252 by the cz lens portion 222 under direct gaze; and light from the tz portion of a second image guided toward the pupil 252 by the tz lens portion 242 under direct gaze.

[0165] In some exemplary implementation schemes, such as Figure 2A As shown, for direct gaze, the central right eye FoV may include, for example, an object “black star” near the boundary of the xcz display area 214.

[0166] In some exemplary implementation schemes, such as Figure 2A As shown, for direct gaze, the temporal right eye FoV may also include, for example, the same object "black star" near the boundary of the tz display area 232.

[0167] In some exemplary implementation schemes, such as Figure 2A As shown, the black star-shaped object can generate principal rays 215 and 218, which can be refracted by the corresponding lens portions. For example, principal ray 215 can be refracted by cz lens portion 222, and / or principal ray 218 can be refracted by tz lens portion 242.

[0168] In some exemplary implementation schemes, such as Figure 2A As shown, a tangent may exist between the central lens 220 and the peripheral lens 240, such that the principal rays 215 and 218 can exit through the respective lens portions via the tangent, for example, in a collinear manner, to form a single combined principal ray 217.

[0169] In some exemplary implementation schemes, such as Figure 2A As shown, the light generated by the black star-shaped object can be collimated by the central lens 220 and the peripheral lens 240 before reaching the pupil 252, and can be focused by the eye toward the same point 219 on the retina. For example, a black star-shaped object generated in different displays (e.g., central display 210 and peripheral display 230) can be perceived by the eye / brain as a single object at point 219. Therefore, a continuous image can be perceived at the boundary between the central lens 220 and the peripheral lens 240.

[0170] In some exemplary implementation schemes, such as Figure 2A As shown, continuous direct fixation FoV 211 can be formed by nzFoV denoted as nz, czFoV denoted as cz, and tzFoV denoted as tz.

[0171] In some exemplary implementation schemes, such as Figure 2A As shown, the nz FoV may include the FoV extension of the object in the nasal FoV refracted by the nz lens portion 226.

[0172] In some exemplary implementation schemes, such as Figure 2A As shown, cz FoV can correspond to the central region, which corresponds to the object in which light is refracted by the cz lens portion 222.

[0173] In some exemplary implementation schemes, such as Figure 2AAs shown, tz FoV can be, for example, a continuous transition of czFoV for a directly gazing eye.

[0174] In some exemplary implementation schemes, such as Figure 2A As shown, continuous direct fixation FoV 211 may not include xcz FoV denoted as xcz, xtz FoV denoted as xtz, and / or xftz FoV denoted as xftz.

[0175] In some exemplary implementation schemes, such as Figure 2A As shown, xcz FoV, xtzFoV and / or xftz FoV may not be visible when looking directly at the eye.

[0176] In some exemplary implementations, xcz FoV can be used for nasal-side fixation, for example, as described below.

[0177] In some exemplary implementations, as described below, xtz FoV can be used for peripheral fixation.

[0178] In some exemplary implementation schemes, such as Figure 2A As shown, xftz FoV can be used for peripheral fixation, for example, as described below.

[0179] In some exemplary implementation schemes, such as Figure 2B As shown, HMD 202 can be configured to provide continuous nasal gaze FoV 221 to pupil 252 under nasal gaze, for example, as described below.

[0180] In some exemplary implementation schemes, such as Figure 2B As shown, the continuous nasal-side gaze FoV 221 may include: light from the cz portion of a first image guided toward the pupil 252 by the cz lens portion 222 under nasal-side gaze; light from the xcz portion of the first image guided toward the pupil 252 by the xcz lens portion 224 under nasal-side gaze; and / or light from the tz portion of a second image guided toward the pupil 252 by the tz lens portion 242 under nasal-side gaze.

[0181] In some exemplary implementation schemes, such as Figures 2A to 2C As shown, the central lens 220 may include a side cut 223, which may be configured to direct light from the edge region of the central display 210 toward the pupil, for example, as described below.

[0182] In some exemplary implementation schemes, such as Figure 2B As shown, the lateral cut 223 can be configured to direct light from the edge of the central display 210, such as the edge of the xcz display area 214, toward the pupil 252 when viewed from the nasal side.

[0183] In some exemplary implementation schemes, such as Figure 2B As shown, for nasal-side gaze, the central right eye FoV may include, for example, an object “black triangle” near the boundary of the xcz display area 214, such as the distal edge of the xcz display area 214, which is opposite to the boundary region between the xcz display area 214 and the cz display area 212.

[0184] In some exemplary implementation schemes, such as Figure 2B As shown, for nasal gaze, the right temporal FoV may also include, for example, the same object "black triangle" near the boundary of the tz display area 232.

[0185] In some exemplary implementation schemes, such as Figure 2B As shown, the black triangular object can generate principal rays 225 and 228, which can be refracted by the corresponding lens portions. For example, principal ray 225 can be refracted by the side cut 223 of the xcz lens portion 224, and / or principal ray 228 can be refracted by the tz lens portion 242.

[0186] In some exemplary implementation schemes, such as Figure 2B As shown, the side cut 223 can be configured such that the principal rays 225 and 228 can be collimated to form a single principal ray 227, and can be focused by the eye toward the same point 229 on the retina of the eye. Therefore, the black triangular object can be perceived as a single object by the eye / brain.

[0187] In some exemplary implementation schemes, such as Figure 2B As shown, light from the peripheral display 230 in the portion above the "black triangle" may not reach the pupil 252, and therefore, the portion above the "black triangle" may be invisible to the user.

[0188] In some exemplary implementation schemes, such as Figure 2B As shown, in order to maintain continuous FoV under nasal gaze, the central display 220 may include an xcz display area 214 to cover the "black triangle" point, for example to support the observation of the black triangle under nasal gaze.

[0189] In some exemplary implementation schemes, such as Figure 2B As shown, once the eye turns toward the nasal side, xczFoV can be seen, and collimated light from xcz FoV can illuminate the pupil 252 to produce an image on the mid-peripheral area of ​​the retina, for example, depending on the magnitude of eye movement. Thus, a continuous panoramic image can be maintained under nasal side gaze.

[0190] In some exemplary implementation schemes, such as Figure 2CAs shown, HMD 202 can be configured to provide continuous temporal gaze FoV 231 to pupil 252 under temporal gaze, for example, as described below.

[0191] In some exemplary implementation schemes, such as Figure 2C As shown, the continuous temporal gaze FoV 231 may include: light from the cz portion of a first image guided toward the pupil 252 by the cz lens portion 222 under temporal gaze; light from the xtz portion of a second image guided toward the pupil 252 by the xtz lens portion 244 under temporal gaze; and light from the tz portion of the second image guided toward the pupil 252 by the tz lens portion 242 under temporal gaze.

[0192] In some exemplary implementation schemes, such as Figures 2A to 2C As shown, the peripheral lens 240 may include a side cut 245, which may be configured to direct light from the edge region of the peripheral display 230 toward the pupil, for example, as described below.

[0193] In some exemplary implementation schemes, such as Figure 2C As shown, the lateral cut 245 can be configured to direct light from the edge of the peripheral display 230, such as the edge of the xtz display area 234, toward the pupil 252 during temporal gaze.

[0194] In some exemplary implementation schemes, such as Figure 2C As shown, for peripheral gaze, the central right eye FoV may include, for example, an object "black moon" near the boundary of cz display area 212.

[0195] In some exemplary implementation schemes, such as Figure 2C As shown, for peripheral fixation, the temporal right eye FoV may also include, for example, the same object “black moon” near the boundary of xtz display area 234, such as the distal edge of xtz display area 234, which is opposite to the boundary region between xtz display area 234 and tz display area 232.

[0196] In some exemplary implementation schemes, such as Figure 2C As shown, the black moon object can generate principal rays 235 and 238, which can be refracted by the corresponding lens portions. For example, principal ray 235 can be refracted by cz lens portion 224, and / or principal ray 238 can be refracted by the side cutout 245 of xtz lens portion 244.

[0197] In some exemplary implementation schemes, such as Figure 2CAs shown, the side cut 245 can be configured such that the principal rays 235 and 238 can be collimated to form a single principal ray 237, which can be focused by the eye toward the same point 239 on the retina of the eye. Therefore, the black moon object can be perceived as a single object by the eye / brain.

[0198] In some exemplary implementation schemes, such as Figure 2C As shown, light from the portion of the central display 210 located to the right of the "black moon" may not reach the pupil 252, and therefore, this portion of the central display 210 may be invisible to the user.

[0199] In some exemplary implementation schemes, such as Figure 2C As shown, in order to maintain continuous FoV under peripheral gaze, peripheral display 230 may include an xtz display area 234 that may cover the black moon highlight, for example, at least covering up to the black star-shaped object point, for example to support the observation of the black moon under peripheral gaze.

[0200] In some exemplary implementation schemes, such as Figure 2C As shown, xtz FoV may overlap with cz FoV, for example, to provide continuous FoV under temporal fixation.

[0201] In one instance, once the eye turns toward temporal gaze, the boundary region of the cz FoV may become invisible, and collimated rays from the xtz FoV may illuminate the pupil 252 to produce an image on the central / near / mid-peripheral area of ​​the retina, for example, depending on the magnitude of eye movement. Thus, a continuous panoramic image can be maintained under peripheral gaze, for example, as described below.

[0202] In some exemplary implementation schemes, such as Figure 2C As shown, xftz FoV can provide a horizontal FoV up to the maximum far peripheral gaze, which can be approximately 105°, or any other angle.

[0203] In one instance, once the eye turns toward the temporal gaze, the far peripheral viewing area can be extended toward the xftz FoV, for example, based on the magnitude of the eye turn. For example, to provide virtual content in the far peripheral area, the xftz FoV can be used, for example, to avoid “black areas” when the eye turns toward the temporal gaze by an additional 30° or more.

[0204] In some exemplary implementations, HMD 202 may be configured to provide a wide FoV for viewing images from central display 210, for example, as described below.

[0205] In one instance, HMD 202 may be configured to provide a temporal FoV of at least 35°, or any other angle, for direct eye gaze, for example, to perceive an image from central display 210, as described below.

[0206] In another instance, HMD 202 may be configured to provide a temporal FoV of at least 35° to 40°, or any other angle, when the eyes are turned to the nasal direction to the maximum extent, for example to perceive an image from the central display 210, as described below.

[0207] In another instance, HMD 202 may be configured to provide at least 30°, or any other angle of temporal FoV, when the eye is turned to the temporal direction to the maximum extent, for example to perceive an image from central display 210, as described below.

[0208] In some exemplary implementations, HMD 202 may be configured to provide a wide FoV so that images are emitted from peripheral display 230, for example, as described below.

[0209] In one instance, HMD 202 may be configured to provide a horizontal FoV that may be shifted from the direct gaze axis to the temporal side, for example, by up to 30°, or any other angle, such that an eye maximally rotated to the temporal side can perceive an image from the peripheral display 230, and / or that can produce a temporal gaze overlap of at least 5°, for example, as described below.

[0210] In some exemplary embodiments, HMD 202 may be configured to provide a temporal FoV, which may be stretched by the peripheral display 230 in the temporal side, for example, by at least an additional 80°, or any other angle, for example, up to a total of at least 110° or any other angle. For example, the stretched temporal FoV may include a nasal gaze overlap, which may exhibit a displacement of at least 35° to 40°, or any other angle, for example, as described below.

[0211] In other implementations, HMD 202 can be configured to provide any other wider or narrower FOV.

[0212] Back to reference Figure 1 In some exemplary embodiments, one or more portions of the central lens 120 may be configured to direct light to an eye rotation center 156 corresponding to the pupil 152, and / or one or more other portions of the central lens 120 may be configured to direct light to one or more other points on the pupil 152, for example, as described below.

[0213] In some exemplary embodiments, the first portion of the cz lens portion 122 may be configured to direct light beams from the xcz display area 124 and from the first portion of the cz display area 122 to the eye rotation center corresponding to the pupil 152, for example, as described below.

[0214] In some exemplary embodiments, the second portion of the cz lens portion 122 may be configured to direct a light beam from the second portion of the cz display area 122 to a point defined, for example, based on the position of the pupil 152 at the direct viewing angle, as described below.

[0215] In some exemplary embodiments, the xcz lens portion 124 may be configured to direct a light beam from the xcz display area 124 to a point defined, for example, based on the position of the pupil 152 at the nasal viewing angle, as described below.

[0216] In some exemplary embodiments, a first portion of the cz lens portion 122 may be located between the xcz lens portion 124 and a second portion of the cz lens portion 122, for example, as described below.

[0217] In some exemplary embodiments, one or more portions of the peripheral lens 140 may be configured to direct light to the eye rotation center corresponding to the pupil 152, and / or one or more other portions of the peripheral lens 140 may be configured to direct light to one or more other points on the pupil 152, for example, as described below.

[0218] In some exemplary embodiments, the TZ lens portion 142 may be configured to direct a beam of light from the TZ display area 132 to a point defined, for example, based on the position of the pupil 152 at the direct viewing angle, as described below.

[0219] In some exemplary embodiments, the xtz lens portion 144 may be configured to direct a light beam from the xtz display area 134 to the eye rotation center corresponding to the pupil 152, for example, as described below.

[0220] In some exemplary embodiments, the xftz lens portion 146 may be configured to direct a beam of light from the xftz display area 136 to a point defined, for example, based on the position of the pupil 152 at the temporal gaze angle, as described below.

[0221] In some exemplary embodiments, the top and / or bottom portions of the central lens 120 may be configured to direct a beam of light from the cz display area 122 to a point defined, for example, based on the position of the pupil 152 at the direct viewing angle, as described below.

[0222] In some exemplary embodiments, the middle portion of the central lens 120 between the top and bottom portions of the central lens 120 may be configured to direct a light beam from the cz display area 122 to the eye rotation center corresponding to the pupil 152, for example, as described below.

[0223] In other embodiments, one or more (e.g., some or all) portions of lens 120 and / or lens 140 may be configured according to any other optical settings.

[0224] The following figures are for reference based on some exemplary implementation schemes: Figures 3A to 3C It schematically shows a top view of the HMD 302; and Figure 3D This schematically shows a side view of the central display 310 and central lens 320 of the HMD 302. For example, the HMD 102 ( Figure 1 It may include one or more elements of HMD 302, and / or perform one or more operations and / or one or more functions of HMD 302.

[0225] In some exemplary implementation schemes, such as Figures 3A to 3C As shown, HMD 302 may include a peripheral display 330 and / or a peripheral lens 340, for example, as described below.

[0226] In one example, the central lens 320 may be formed, for example, by at least one refractive lens having at least one freeform surface, and / or the peripheral lens 320 may be formed, for example, by at least one refractive lens having at least one freeform surface.

[0227] In another example, the central lens 320 and / or the peripheral lens 320 may be formed by any other type of lens, for example, having a diffraction surface.

[0228] In some exemplary implementation schemes, such as Figure 3A As shown, the central lens 320 is, for example, in the cz lens section 122 ( Figure 1 The first portion 372 at the location can be configured to receive signals from the central display 310 (e.g., cz display area 112). Figure 1 The beam of the first part 312 is guided to the eye rotation center 356 corresponding to the pupil 352.

[0229] In one instance, the first part 372 may, for example, provide central visual optimization for the rotation of the pupil 352 to the temporal gaze angle and / or the nasal gaze angle.

[0230] In some exemplary implementation schemes, such as Figure 3A As shown, the central lens 320 is, for example, in the cz lens section 122 ( Figure 1 The second part 374 at the location ) can be configured to receive, for example, data from the central display 310 in the cz display area 112 ( Figure 1 The beam of the second part 314 at the point is guided to a point 351 that can be defined based on the position of the pupil 352 at the direct gaze angle, for example, for nasal-peripheral visual optimization of the direct gaze of the pupil 352.

[0231] In some exemplary implementation schemes, such as Figure 3B As shown, the xcz lens portion 376 can be configured to guide a beam of light from the xcz display area 316 to a point 353 that can be defined, for example, based on the position of the pupil 352 at the nasal gaze angle, for example, to perform temporal-peripheral visual optimization of the rotation of the pupil 352 to the nasal gaze angle.

[0232] In some exemplary implementation schemes, such as Figure 3A As shown, the first portion 372 of the central lens 320 may be located between the xcz lens portion 376 and the second portion 374 of the central lens 320, for example, as described below.

[0233] In some exemplary implementation schemes, such as Figure 3A As shown, the tz lens portion 342 of the peripheral lens 340 can be configured to guide a beam of light from the tz display area 332 to a point 351 that can be defined, for example, based on the position of the pupil 352 at the direct viewing angle.

[0234] In one instance, the tz lens portion 342 may provide temporal-peripheral visual optimization, for example, under direct gaze.

[0235] In some exemplary implementation schemes, such as Figure 3C As shown, the xtz lens portion 344 of the peripheral lens 340 can be configured to guide a beam of light from the xtz display area 334 to the eye rotation center 356 corresponding to the pupil 352, for example to visually optimize central vision when the pupil 352 rotates (e.g., rotates to its maximum extent) to the temporal gaze angle.

[0236] In some exemplary implementation schemes, such as Figure 3C As shown, the xftz lens portion 346 of the peripheral lens 340 can be configured to guide a beam of light from the xftz display area 336 to a point 357 that can be defined, for example, based on the position of the pupil 352 at the temporal gaze angle, for example to visually optimize the temporal FoV when the pupil 352 is rotated (e.g., rotated to its maximum extent) to the temporal gaze angle.

[0237] In some exemplary implementation schemes, such as Figure 3DAs shown, the top portion 362 and / or the bottom portion 364 of the central lens 320 can be configured to guide a beam of light from the cz display area 312 to a point 357 that can be defined, for example, based on the position of the pupil 352 at the direct viewing angle.

[0238] In one instance, the top portion 362 and / or the bottom portion 364 may provide top and / or bottom-peripheral visual optimization, for example, under direct viewing, at the bottom and / or top portion of the central lens 320.

[0239] In some exemplary implementation schemes, such as Figure 3D As shown, the middle portion 366 of the central lens 320, located between the top portion 362 and the bottom portion 364, can be configured to guide a light beam from the cz display area 312 to the eye rotation center 356 corresponding to the pupil 352.

[0240] In one instance, the middle portion 366 may, for example, provide central visual optimization for the rotation of the pupil 352 to the upper gaze and / or the lower gaze.

[0241] In some exemplary embodiments, the refraction of the central lens 320 may be configured, for example, according to a figure of merit function that defines multiple weights, for example, corresponding to multiple fields of view of the central display 310, as described below.

[0242] In some exemplary embodiments, the refraction of the central lens 320 may be configured, for example, according to the maximum figure of merit function weight of the central field of view, up to the maximum design selection range, under rotational gaze, such as rotation of the pupil 352 at the nasal, temporal, top, and / or bottom angles, so that light may be directed toward the eye rotation center 356.

[0243] In some exemplary embodiments, the refraction of the central lens 320 may be configured, for example, according to a figure of merit weighting of the reduction of the peripheral field of view with respect to the nasal, temporal, top, and / or bottom peripheral FoV under direct gaze, such that light can be directed toward the pupil 352 at the direct gaze eye.

[0244] In some exemplary embodiments, the central lens 320 may be configured, for example, according to the minimum merit function weight of the temporal FoV 376 to provide refraction, such that light can be directed toward the pupil 352 at the nasal-side gaze.

[0245] In some exemplary embodiments, the refraction of the peripheral lens 340 may be configured, for example, according to a figure of merit function that defines multiple weights, for example, corresponding to multiple fields of view of the peripheral display 330, as described below.

[0246] In some exemplary implementation schemes, such as Figures 3A to 3C As shown, the refraction of the peripheral lens 340 can be configured, for example, according to the maximum figure of merit function weight of the field of view 344, which starts at least at the temporal angle and extends to the end of the field of view that overlaps with the central lens 320, for example, according to the temporal fixating eye at the maximum design selection angle, such that light can be directed to the pupil 352 at the temporal eye rotation.

[0247] In some exemplary implementation schemes, such as Figures 3A to 3C As shown, the refraction of the peripheral lens 340 can be configured, for example, according to the reduced figure of merit function weight of the peripheral field of view 342 with a temporal angle of less than 105° of the peripheral lens 340, such that light can be directed toward the pupil 352 under, for example, direct gaze and according to a temporal gaze angle of 105°.

[0248] In some exemplary implementation schemes, such as Figures 3A to 3C As shown, the refraction of the peripheral lens 340 can be configured, for example, according to the minimum merit function weight of the field of view 346 with a temporal angle greater than 105° of the peripheral lens 340, such that, under temporal rotation eye gaze, the angle can be selected according to the maximum temporal rotation design to direct the light towards the pupil 352.

[0249] Back to reference Figure 1 In some exemplary embodiments, the edge 121 of the central lens 120 may be in direct contact with the edge 141 of the peripheral lens 140, for example, as described below.

[0250] In other exemplary embodiments, the edge 121 of the central lens 120 may not contact the edge 141 of the peripheral lens 140, for example, as described below.

[0251] In some exemplary embodiments, the central lens 120 may be spaced at least 1 mm from the peripheral lens 140, for example, as described below.

[0252] In some exemplary embodiments, for example, in the plane connecting the optical axes of the central lens 120 and the peripheral lens 140, the central lens 120 may be spaced at least 1 mm from the peripheral lens 140, for example, as described below.

[0253] In some exemplary embodiments, the central lens 120 may be spaced at least 2 mm from the peripheral lens 140, for example, as described below.

[0254] In some exemplary embodiments, the central lens 120 may be spaced at least 4 mm from the peripheral lens 140, for example, as described below.

[0255] In other embodiments, the central lens 120 may be separated from the peripheral lens 140 by any other distance, for example, as described below.

[0256] The following figures are for reference based on some exemplary implementation schemes: Figure 4A It schematically shows the first HMD configuration 402 as observed under direct gaze of the pupil 452; Figure 4B It schematically illustrates the second HMD configuration 404 as observed under direct gaze of the pupil 452; and Figure 4C This schematically illustrates a second HMD configuration 404 as observed under temporal gaze of pupil 452. For example, HMD 102 ( Figure 1 ) may include one or more elements of HMD configuration 402, and / or may perform one or more operations and / or one or more functions of HMD configuration 402; and / or HMD 102 ( Figure 1 It may include one or more elements of HMD configuration 404, and / or may perform one or more operations and / or one or more functions of HMD configuration 404.

[0257] In some exemplary implementation schemes, such as Figure 4A As shown, the edge 421 of the central lens 420 of the HMD 402 can directly contact the edge 441 of the peripheral lens 440 of the HMD 402.

[0258] In some exemplary implementation schemes, such as Figure 4B and Figure 4C As shown, the edge 431 of the central lens 430 of the HMD 404 may not be in direct contact with the edge 451 of the peripheral lens 450 of the HMD 404, for example, as described below.

[0259] In some exemplary implementation schemes, such as Figure 4B and Figure 4C As shown, the central lens 430 can be separated from the peripheral lens 450 by a distance 432.

[0260] In some exemplary embodiments, for example, in the plane connecting the optical axis of the central lens 430 and the peripheral lens 450, the central lens 430 may be spaced apart from the peripheral lens 450, for example, as described below.

[0261] In some exemplary embodiments, distance 432 may be at least 1 mm. In other embodiments, distance 432 may include any other distance.

[0262] In some exemplary implementation schemes, such as Figure 4BAs shown, HMD 404 can provide continuous FoV, for example, under direct viewing, even when the central lens 430 is spaced apart from the peripheral lens 450, as described below.

[0263] In some exemplary implementation schemes, such as Figure 4B As shown, the temporal FoV and central FoV can guide light from the same point 455 (e.g., a black star) in the image scene, and the light rays from point 455 directed to the central lens 430 and peripheral lens 450 can be collimated to form a single principal ray 435, which can be focused by the eye toward the same point on the retina of the eye. Therefore, the object at point 455 (e.g., a black star) can be perceived as a single object by the eye / brain.

[0264] In some exemplary implementation schemes, such as Figure 4C As shown, HMD 404 can provide continuous FoV, for example, under peripheral gaze, even when the central lens 430 is spaced apart from the peripheral lens 450, as described below.

[0265] In some exemplary implementation schemes, such as Figure 4C As shown, the temporal FoV and central FoV can cover the same point 457, such as a black moon, and the light rays from point 457 directed to the central lens 430 and the peripheral lens 450 can be collimated to form a single principal ray 437, which can be focused by the eye toward the same point on the retina of the eye. Therefore, an object at point 457 (e.g., a black moon) can be perceived as a single object by the eye / brain.

[0266] In some exemplary implementation schemes, such as Figure 4B and Figure 4C As shown, rays from overlapping objects, such as the black moon and / or the black triangle, can be connected at virtual connection points, which maintains continuous FoV. This can be compared to HMD 402, which includes physical connection points, such as direct contact between edges 441 and 421.

[0267] In some exemplary embodiments, virtual connection points may be used, for example, when the central lens 430 and the peripheral lens 450 are spaced apart, to support the curved back of the central lens 430 and / or the peripheral lens 450, and / or, for example, to support adjustment of the tilt angle 438 between the central lens 430 and the peripheral lens 450 when the central lens 430 and / or the peripheral lens 450 are curved.

[0268] In some exemplary embodiments, the use of virtual connection points, for example when the central lens 430 and the peripheral lens 450 are spaced apart, can support, for example, moving the peripheral lens 450 a distance 432 in the temporal direction, such as allowing the temples of the glasses to be mechanically fitted inside the HMD device 404 when, for example, a user of the HMD device wears the glasses.

[0269] In some exemplary embodiments, the content on the peripheral display 430 may be adjusted, for example, based on an increase in the distance between the eye and the peripheral display 430, to maintain the proportion of the object size and / or to maintain the overlap points 455 and / or 457.

[0270] Back to reference Figure 1 In some exemplary embodiments, the HMD device 100 may include a controller 150 configured to cause the central display 110 to display a first image, for example based on image information of an image scene, and / or cause the peripheral display 130 to display a second image, for example based on image information of an image scene, as described below.

[0271] In one instance, at least a portion of the functionality of controller 150 may be implemented by an integrated circuit (e.g., a chip, such as a system-on-a-chip (SoC)). In some exemplary embodiments, controller 150 may include circuitry and / or logic, such as one or more processors including circuitry and / or logic, and / or memory circuitry and / or logic, or may be partially or entirely implemented by them. Alternatively or additionally, one or more functions of controller 150 may be implemented by logic, which may be executed by a machine and / or one or more processors, for example, as described below.

[0272] In other implementations, the controller 150 may be implemented by any other logic and / or circuitry, and / or according to any other architecture.

[0273] In one instance, controller 150 may include at least one memory 158, for example, coupled to one or more processors, the at least one memory being configured, for example, to store at least some of the information processed by one or more processors and / or circuitry, and / or to store logic to be utilized by the processors and / or circuitry.

[0274] In one instance, the controller 150 may be based on any computer architecture that supports rendering graphical information that will be displayed by the central display 110 and / or the peripheral displays 130.

[0275] In some exemplary embodiments, the HMD device 100 may include a tilt angle adjuster 155 configured to adjust the tilt angle 127 of the peripheral lens 140 relative to the central lens 120, for example, as described below.

[0276] In some exemplary embodiments, the tilt angle adjuster 155 may be configured to adjust, for example, the tilt angle of the peripheral lens 175 relative to the central lens 165 in conjunction with the tilt angle 127, as described below.

[0277] In other embodiments, the HMD device 100 may include: a first tilt angle adjuster configured to adjust the tilt angle 127 of the peripheral lens 140 relative to the central lens 120, and a second tilt angle adjuster configured to adjust the tilt angle of the peripheral lens 175 relative to the central lens 165.

[0278] In some exemplary embodiments, the tilt angle adjuster 150 may include a mechanical tilt angle adjuster, an electromechanical tilt angle adjuster, and / or any other type of tilt angle adjuster.

[0279] In some exemplary implementations, the user of the HMD device 100 can use the tilt angle adjuster 155 to adjust the tilt angle 127.

[0280] In some exemplary embodiments, controller 150 may be configured to control tilt angle adjuster 155 to adjust tilt angle 127.

[0281] In some exemplary implementations, the tilt angle 127 may be adjusted, for example, according to the user's exit pupil distance (ER) setting, as described below.

[0282] In some exemplary implementations, the exit pupil distance setting can define the distance between the user's pupil 152 and the central lens 120, for example, as described below.

[0283] In one example, the user of the HMD device 100 can control the tilt angle adjuster 155 to adjust the tilt angle 127, for example, based on the exit pupil distance setting.

[0284] In another example, the HMD device 100 may be manufactured to include a pre-configured or adjustable tilt angle 127, for example, according to a predefined exit pupil distance setting. For example, HMD devices 100 of various types or sizes may be manufactured to have different tilt angles corresponding to multiple different exit pupil distance settings.

[0285] In some exemplary embodiments, controller 150 may be configured to control tilt angle adjuster 155 to adjust tilt angle 127, for example, based on exit pupil distance setting, as described below.

[0286] In some exemplary embodiments, HMD device 100 may include an ER estimator configured to estimate an exit pupil distance setting and provide the exit pupil distance setting to controller 150.

[0287] right Figure 5 For reference, the diagrams schematically illustrate a first HMD configuration 503, a second HMD configuration 505, and a third HMD configuration 507 according to some exemplary embodiments. For example, HMD 102 ( Figure 1 It may include one or more elements of HMD configuration 503, 505 and / or 507, and / or perform one or more operations and / or one or more functions of HMD 503, 505 and / or 507.

[0288] In some exemplary implementation schemes, such as Figure 5 As shown, HMD configurations 503, 505 and / or 507 may include a central display 510, a central lens 520, a peripheral display 530 and a peripheral lens 540, for example, as described below.

[0289] In some exemplary implementation schemes, such as Figure 5 As shown, the exit pupil distance setting 504 can correspond to the distance 506 between the cornea 580 and the central lens 520 of the user's eye.

[0290] In some exemplary implementation schemes, such as Figure 5 As shown, the first configuration 503 may have a first tilt angle 513 of the peripheral lens 540 relative to the central lens 520.

[0291] In some exemplary implementation schemes, such as Figure 5 As shown, the tilt angle 513 can correspond to a first exit pupil distance setting, which corresponds to a first distance 514 between the central lens 520 and the cornea 580, such as distance 506.

[0292] In one instance, the first exit pupil distance setting and tilt angle 513 can be configured for predefined ER settings. For example, the predefined ER settings can be predetermined based on ER measurement functions.

[0293] In some exemplary implementation schemes, such as Figure 5As shown, tilt angle 513 can be configured to provide a continuous FoV for a first exit pupil distance setting. For example, the beam originating from the black star in the central FoV 522 and the beam originating from the black star in the temporal FoV 524 may overlap at the point of overlap.

[0294] In some exemplary implementation schemes, such as Figure 5 As shown, the second configuration 505 may have a second tilt angle 515 of the peripheral lens 540 relative to the central lens 520.

[0295] In some exemplary implementation schemes, such as Figure 5 As shown, the tilt angle 515 can correspond to the second exit pupil distance setting, which corresponds to the second distance 516 between the central lens 520 and the cornea 580.

[0296] In one example, the second exit pupil distance setting and tilt angle 515 may correspond to the minimum distance between the central lens 520 and the cornea 580, such as distance 516, and the minimum tilt angle of the peripheral lens 540 relative to the central lens 520, respectively.

[0297] In one instance, the overlapping areas of the nasal and temporal sides can be adjusted accordingly, for example, so that the temporal overlapping field of view can be shifted upward toward the central area.

[0298] In some exemplary implementation schemes, such as Figure 5 As shown, the tilt angle 515 can be configured to provide a continuous FoV for the exit pupil distance setting 516. For example, the beam originating from the black triangle in the central FoV 522 and the beam originating from the black triangle in the temporal FoV 524 may overlap at the point of overlap.

[0299] In some exemplary implementation schemes, such as Figure 5 As shown, the third configuration 507 may have a third tilt angle 517 of the peripheral lens 540 relative to the central lens 520.

[0300] In some exemplary implementation schemes, such as Figure 5 As shown, the tilt angle 517 can correspond to the third exit pupil distance setting, which corresponds to the third distance 518 between the central lens 520 and the cornea 580.

[0301] In one example, the third exit pupil distance setting and tilt angle 517 may correspond to the maximum distance between the central lens 520 and the pupil 552, such as distance 518, and the maximum tilt angle of the peripheral lens 540 relative to the central lens 520, respectively.

[0302] In one instance, maximum distance could, for example, provide an improved user experience for users wearing glasses.

[0303] In another instance, the overlapping areas of the nasal and temporal sides can be adjusted accordingly, for example, so that the overlapping field of view of the temporal side can be shifted downward toward the temporal side.

[0304] In some exemplary implementation schemes, such as Figure 5 As shown, tilt angle 517 can be configured to provide continuous FoV for exit pupil distance setting 518. For example, the beam originating from the black moon in central FoV 522 and the beam originating from the black moon in temporal FoV 524 may overlap at the point of overlap.

[0305] In one instance, adjusting the tilt angle 513 based on the ER setting 504 can support maintaining continuous FoV. For example, when the distance 506 exceeds the working ER range, the temporal FoV 524 may degenerate, and / or multiple portions of the temporal FoV may be invisible or degenerate.

[0306] In one instance, HMD (e.g., HMD device 100) Figure 1 The ER settings for a given face may differ for different users because facial anatomy can vary. Based on this example, controller 150 ( Figure 1 ) and / or tilt angle adjuster 155 ( Figure 1 It allows users to adjust the ER setting to the optimal distance, for example, based on mechanical and / or image processing techniques.

[0307] Back to reference Figure 1 In some exemplary embodiments, the controller 150 may be configured to dynamically adjust the tilt angle 127 of the peripheral lens 140 relative to the central lens 120, for example, based on the gaze angle of the pupil 152, as described below.

[0308] In some exemplary embodiments, the controller 150 may be configured to monitor the gaze angle of the pupil 152, for example, as described below.

[0309] In one example, HMD device 100 may include a gaze tracker configured to track the gaze angle of pupil 152. For example, gaze tracker 159 may include a camera, and / or any other gaze tracking mechanism.

[0310] In another instance, the gaze angle of pupil 152 can be predicted and / or assumed, for example, based on the image scene. For instance, if the image scene includes an explosion that will be displayed on peripheral display 130, a temporal gaze can be expected toward the explosion.

[0311] In some exemplary embodiments, the controller 150 may be configured to recognize the tilt setting of the peripheral lens 140 relative to the central lens 120 at a tilt angle 127, for example, as described below.

[0312] In some exemplary embodiments, the controller 150 may be configured to determine, for example, based on tilt settings, a portion of the image scene that will be displayed by the peripheral display 130, as described below.

[0313] The following figures are for reference based on some exemplary implementation schemes: Figure 6A It schematically illustrates the HMD configuration 602 as observed under direct gaze of the pupil 652; and Figure 6B This schematically illustrates HMD configuration 602 as observed under temporal gaze of pupil 652. For example, HMD 102 ( Figure 1 It may include one or more elements of HMD configuration 602, and / or perform one or more operations and / or one or more functions of HMD configuration 602.

[0314] In some exemplary implementation schemes, such as Figure 6A and Figure 6B As shown, for example when the pupil 652 is in direct gaze, there may be a first tilt angle 627 of the peripheral lens 640 of the HMD 602 ​​relative to the central lens 620. The first tilt angle 627 may be different from, for example, a second tilt angle 637 of the peripheral lens 640 of the HMD 602 ​​relative to the central lens 620 when the pupil 652 is in temporal gaze.

[0315] In some exemplary implementation schemes, such as Figure 6B As shown, the tilt angle 637 can be configured to maintain continuous FoV under temporal gaze of the pupil 652.

[0316] In some exemplary implementation schemes, such as Figure 6B As shown, tilt angle 637 can be configured to maintain continuous FoV under temporal gaze, for example, such that there may be an overlap between the central display 610 and the peripheral display 630, for example, at the overlap point 645, including a black moon.

[0317] In one instance, for example, under temporal eye gaze, the tilt angle 637 can be adjusted to achieve optimal refraction of light that aims at the pupil 652 of the eye and reaches the macula of the retina.

[0318] In some exemplary implementations, controller 150 ( Figure 1 It can be configured, for example, to determine a portion of the image scene to be displayed by the peripheral display 630 based on a tilt setting of tilt angle 637, as described below.

[0319] In some exemplary implementations, controller 150 ( Figure 1 It can be configured, for example, to distribute the content of the image scene to the central display 610 and the peripheral displays based on the adjustment of the tilt angle 637, for example, to maintain a continuous image.

[0320] In one example, when the pupil 652 is forcefully turned toward the peripheral display 630, the content distribution on the peripheral display 630 can be adjusted, for example, along with the content allocation (e.g., shifting the content downwards). This adjustment can be made by dynamically adjusting the tilt angle 627, such that a first principal ray, such as from the black moon on the central display 610 refracted via the central lens 620, is collinear with a second principal ray, such as from the black moon on the peripheral display 630 refracted via the peripheral lens 640. This collinearity of the first and second principal rays can provide optimal refraction through the peripheral lens 640 toward the pupil, maintaining high visual acuity (VA) of the peripheral display 630 during temporal fixation.

[0321] Back to reference Figure 1 In some exemplary embodiments, controller 150 may be configured to apply one or more predistortions to the image scene to be displayed by central display 110 and / or peripheral display 130, for example, as described below.

[0322] In some exemplary embodiments, controller 150 may be configured to apply trapezoidal predistortion to a portion of the image scene to be displayed by the central display 110, and / or to a portion of the image scene to be displayed by the peripheral display 130, for example, as described below.

[0323] In some exemplary embodiments, the controller 150 may configure pre-distortion of a portion of the image scene to be displayed by the central display 110, for example, based on exit pupil distance settings, tilt angle of the HMD device 100, and / or interpupillary distance (IPD) of the user, as described below.

[0324] In some exemplary embodiments, the controller 150 may configure pre-distortion of a portion of the image scene to be displayed by the peripheral display 130, for example, based on exit pupil distance settings, tilt angle of the HMD device 100, and / or the user's IPD, as described below.

[0325] In some exemplary embodiments, the controller 150 may be configured to apply one or more predistortions to the image scene to be displayed by the central display 110 and / or the peripheral display 130, for example, based on the recognition of the gaze direction of the pupil 152, as described below.

[0326] In one instance, controller 150 may identify gaze direction, for example, based on input from gaze recognizer 159, prediction, and / or any other method, as described above.

[0327] In some exemplary embodiments, controller 150 may be configured to generate a first image by applying trapezoidal predistortion to a portion of the image scene (e.g., one or more objects) to be displayed by central display 110 based on the recognition of temporal gaze of pupil 152, for example, as described below.

[0328] In other embodiments, controller 150 may be configured to apply any other additional or alternative predistortion to the portion of the image scene to be displayed by central display 110. For example, controller 150 may be configured to apply barrel, pincushion, blending, and / or chromatic aberration predistortion to the portion of the image scene to be displayed by central display 110.

[0329] In some exemplary embodiments, the controller 150 may be configured to generate a second image based on the recognition of direct gaze at the pupil 152 by applying a first trapezoidal predistortion to a portion of the image scene to be displayed by the peripheral display 130, for example, as described below.

[0330] In some exemplary embodiments, the controller 150 may be configured to generate a second image based on the recognition of indirect gaze at the pupil 152, for example by applying a second trapezoidal predistortion to the portion of the image scene to be displayed by the peripheral display 130, as described below.

[0331] In some exemplary implementations, the second trapezoidal predistortion may differ from the first trapezoidal predistortion, for example, as described below.

[0332] In some exemplary embodiments, the controller 150 may be configured to determine, for example, based on the recognition of temporal gaze of the pupil 152, that the second trapezoidal predistortion is less than the first trapezoidal predistortion, for example, as described below.

[0333] In some exemplary embodiments, the controller 150 may be configured to determine, for example, based on the recognition of nasal gaze of the pupil 152, that the second trapezoidal predistortion is greater than the first trapezoidal predistortion, for example, as described below.

[0334] In other embodiments, controller 150 may be configured to apply any other additional or alternative predistortion to the portion of the image scene to be displayed by peripheral display 130. For example, controller 150 may be configured to apply barrel, pincushion, blending, and / or chromatic aberration predistortion to the portion of the image scene to be displayed by peripheral display 130.

[0335] right Figure 7 For reference, a pre-distortion scheme 700 is schematically shown for distorting an image scene 701 to be displayed by an HMD 702. For example, HMD 102 ( Figure 1 It may include one or more elements of HMD 702, and / or perform one or more operations and / or one or more functions of HMD 702.

[0336] In some exemplary implementation schemes, such as Figure 7 As shown, HMD 702 may include a central display 710, a central lens 720, a peripheral display 730, and a peripheral lens 740, for example, as described below.

[0337] In some exemplary implementation schemes, such as Figure 7 As shown, an image scene 701 can be displayed to the user's right and left eyes, for example, with a continuous FoV covering 270 degrees, for example, for the left eye there is a maximum temporal gaze of 135° from the scene center (CoS) to the left eye, and for the right eye there is a maximum temporal gaze of 135° from CoS to the right eye.

[0338] In one instance, image scene 701 may include a stereoscopic image scene.

[0339] In another instance, image scene 701 may include, for example, a three-dimensional (3D) image scene generated from different perspectives of the left and right eyes.

[0340] In another instance, image scene 701 can be extracted from a 360-degree image scene, for example, based on 360-degree visual information. For example, image scene 701 can be based on head orientation and / or spatial position, such as using any suitable inertial motion unit (IMU) and / or tracking from inside to outside or from outside to inside.

[0341] In some exemplary implementation schemes, such as Figure 7 As shown, controller 150 ( Figure 1 It can be configured to crop the image scene 701 into a first image scene 704 for the left eye 752 and to crop it into a second image scene for the right eye.

[0342] In one instance, controller 150 ( Figure 1 The CoS of the central display 710 can be set, for example, assuming a given exit pupil distance and tilt angle of the HMD 702, direct gaze, and the appropriateness of the central display 710 in front of the eye 752, such that the visual axis of the eye 752 is collinear with the optical axis of the central lens 710; and / or assuming a given eye convergence distance, such as causing deviation from the visual axis.

[0343] In some exemplary implementations, controller 150 ( Figure 1 The PD optical center of the peripheral display 730 can be set, for example, to -75 degrees, based on photodynamic design and a given eye convergence distance, in the presence of angular offset. The PD optical center may correspond to CoS.

[0344] In some exemplary implementations, controller 150 ( Figure 1 It can compensate for the content of the central display 710, for example, to present a realistic image, or to repair geometric distortion and chromatic aberration caused by the central lens 720 according to CoS.

[0345] In some exemplary implementation schemes, such as Figure 7 As shown, controller 150 ( Figure 1 It can be configured to crop the image scene 704 of the left eye into a first image 706 for display on the central display 710, and crop it into a second image 708 for display on the peripheral display 730.

[0346] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to generate a first image 706 and / or a second image 708, for example, to maintain color saturation balance between the central display 710 and the peripheral display 730.

[0347] In one instance, controller 150 ( Figure 1 The controller 150 can be configured to dynamically calibrate the color saturation of the first image 706 and / or the second image 708, for example, to maintain color saturation balance between the central display 710 and the peripheral display 720. Figure 1 The controller 150 can be configured to dynamically calibrate the color saturation of the first image 706 and / or the second image 708 based on the tilt angle between the central lens 720 and the peripheral lens 740, based on the ER setting of the HMD 702, based on the user's IPD, and / or based on the tilt setting of the HMD 702. Figure 1 The color saturation of the first image 706 and / or the second image 708 can be configured, for example, to dynamically calibrate by taking into account one or more spectral effects occurring through the central lens 720 and / or one or more spectral effects occurring through the peripheral lens 740.

[0348] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to dynamically calibrate the color saturation of the first image 706 and / or the color saturation of the second image 708 based on any other additional or alternative parameters and / or standards.

[0349] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to generate a first image 706 and / or a second image 708, for example, to maintain spatial light intensity balance between the central display 710 and the peripheral display 730.

[0350] In one instance, controller 150 ( Figure 1 The controller 150 can be configured to dynamically calibrate the spatial light intensity of the first image 706 and / or the spatial light intensity of the second image 708, for example, to maintain an equalization between the central display 710 and the peripheral display 720. Figure 1 The controller 150 can be configured to dynamically calibrate the spatial intensity of the first image 706 and / or the spatial intensity of the second image 708 based on the tilt angle between the central lens 720 and the peripheral lens 740, the ER setting of the HMD 702, the user's IPD, and / or the tilt setting of the HMD 702. For example, the controller 150... Figure 1 The spatial light intensity of the first image 706 and / or the second image 706 can be dynamically calibrated, for example, by taking into account the non-uniform light absorption and / or scattering through the central lens 720 and / or the peripheral lens 740, based on the distance from the optical axis of the central lens 720 and / or the peripheral lens 740.

[0351] In one instance, controller 150 ( Figure 1 The image can be configured to dynamically calibrate the spatial light intensity of the first image 706 and / or the spatial light intensity of the second image 708, for example, to maintain the balance between the central display 710 and the peripheral display 720, for example, to compensate for light absorption and / or scattering in some areas of the lens (e.g., Fresnel facets), and / or to equalize the intensity from the central display 710 and / or the peripheral display 730 (e.g., in the fusion region between the central display 710 and the peripheral display 730), for example, to maintain a seamless image.

[0352] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to dynamically calibrate the spatial light intensity of the first image 706 and / or the spatial light intensity of the second image 708 based on any other additional or alternative parameters and / or standards.

[0353] In some exemplary implementation schemes, such as Figure 7 As shown, controller 150 ( Figure 1 It can be configured to apply predistortion 715 to image 706 to generate predistorted image 716.

[0354] In some exemplary implementation schemes, such as Figure 7 As shown, the predistorted image 716 may include, for example, an additional edge 707 for filling the center display 710 after barrel predistortion.

[0355] In some exemplary implementation schemes, such as Figure 7 As shown, controller 150 ( Figure 1 It can be configured to display a predistorted image 716 on a central display 710.

[0356] In some exemplary implementation schemes, such as Figure 7 As shown, controller 150 ( Figure 1 It can be configured to apply predistortion 717 to image 708 to generate predistorted image 719.

[0357] In some exemplary implementation schemes, such as Figure 7 As shown, the predistorted image 719 may include, for example, an additional edge 709 for filling the peripheral display 730 after barrel predistortion.

[0358] In some exemplary embodiments, the content of the peripheral display 730 may be predistorted according to one or more geometric predistortions (e.g., barrel, trapezoidal and / or similar predistortions) and / or color difference predistortions relative to the peripheral display 730, for example, in order to present a realistic image and / or continuous FoV.

[0359] In one instance, to align the optical axis of the central display 710 with the visual axis of the directly looking eye 752 at a given exit pupil distance setting and suitable interpupillary distance (IPD), one or more pre-distortions may be present to compensate for distortions in the central display 710 and peripheral display 730, for example, before overlap generation. One or more pre-distortions may include geometric pre-distortion and / or chromatic aberration of the central lens 710 and / or peripheral lens 730.

[0360] In one instance, predistortion can be performed separately for each pixel's auxiliary color channel, for example, separately for red, green, and / or blue (RGB) subpixels. This allows color difference compensation without requiring a separate procedure.

[0361] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to apply trapezoidal predistortion 721 to the predistorted image 719, for example, based on the gaze of the eye 752.

[0362] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to apply trapezoidal predistortion 721 to image 719, for example, when a temporal gaze of eye 752 is identified.

[0363] In one example, predistortion (e.g., trapezoidal / trapezoidal predistortion) may be reduced on the peripheral display 730, for example, when the eye 752 moves temporally between the central display 710 and the peripheral display 730, and said predistortion may be introduced on the central display 710. In some exemplary embodiments, controller 150 ( Figure 1 It can be configured, for example, to generate a trapezoidal distortion image 725 by applying trapezoidal predistortion 721 to the predistorted image 719.

[0364] In some exemplary implementations, controller 150 ( Figure 1 The trapezoidal distortion image 725 can be displayed on the peripheral display 730.

[0365] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to generate and / or update trapezoidal distortion image 725, for example, based on eye gaze 752.

[0366] In one instance, controller 150 ( Figure 1 For example, a first trapezoidal distortion image can be generated when direct gaze of eye 752 is detected.

[0367] In another instance, controller 150 ( Figure 1 A second trapezoidal distortion image may be generated, for example, when peripheral fixation of eye 752 is detected. For example, the trapezoidal predistortion of the second trapezoidal distortion image may be less than the trapezoidal predistortion of the first trapezoidal distortion image.

[0368] In another instance, controller 150 ( Figure 1 A third trapezoidal distortion image may be generated, for example, when nasal gaze of eye 752 is identified. For example, the trapezoidal predistortion of the third trapezoidal distortion image may be greater than the trapezoidal predistortion of the first trapezoidal distortion image.

[0369] In one example, the trapezoidal predistortion at the peripheral display 730 can be reduced and even neutralized, for example, under temporal fixation, based on the fixation amplitude in the temporal direction. According to this example, trapezoidal predistortion can be introduced on the central display 710, for example, under temporal fixation.

[0370] In some exemplary embodiments, the controller 150 may be configured to apply trapezoidal predistortion to the image 706 to be displayed by the central display 710, and / or to the image 708 to be displayed by the peripheral display 730, for example, based on the exit pupil distance setting of the HMD 702, the tilt angle of the HMD 702 relative to the user's head, and / or the user's IPD.

[0371] In other embodiments, controller 150 may be configured to apply trapezoidal predistortion to image 706 to be displayed by central display 710, and / or to image 708 to be displayed by peripheral display 730, based on any other additional or alternative parameters and / or criteria.

[0372] Back to reference Figure 1 In some exemplary embodiments, the controller 150 may be configured to cause the central display 110 to display a cz portion of the first image, including a first repeating portion of the image scene, for example, as described below.

[0373] In some exemplary embodiments, the controller 150 may be configured to cause the central display 110 to display an xcz portion of the first image that includes a second repeating portion of the image scene, for example, as described below.

[0374] In some exemplary embodiments, the controller 150 may be configured to cause the peripheral display 130 to display a tz portion of the second image, including a second repeating portion of the image scene, for example, as described below.

[0375] In some exemplary embodiments, the controller 150 may be configured to cause the peripheral display 130 to display an xtz portion of the second image, including a first repeating portion of the image scene, for example, as described below.

[0376] In some exemplary implementations, the first repeating portion of the image scene may cover at least 5 degrees of FoV, for example, as described below.

[0377] In other implementations, the first repeating portion of the image scene may cover any other FoV, for example, as described below.

[0378] In some exemplary implementations, the second repeating portion of the image scene may cover at least 5 degrees of FoV, for example, as described below.

[0379] In other implementations, the second repeating portion of the image scene may cover any other FoV, for example, as described below.

[0380] right Figure 8 For reference, this schematically illustrates an allocation scheme for distributing image scenes 801 to be displayed by the center display 810 and peripheral displays 830 of an HMD. For example, HMD 102 ( Figure 1 It may include a central display 810 and a peripheral display 830.

[0381] In some exemplary implementations, controller 150 ( Figure 1It can be configured to distribute the image scene 801 to the central display 810 and the peripheral display 830.

[0382] In some exemplary implementation schemes, such as Figure 8 As shown, image scene 801 may include a first repeating portion 803 of image scene 801.

[0383] In some exemplary implementation schemes, such as Figure 8 As shown, image scene 801 may include a second repeating portion 805 of image scene 801.

[0384] In some exemplary implementation schemes, such as Figure 8 As shown, controller 150 ( Figure 1 It can be configured to display, for example, a first repeating portion 803 of an image scene 801 at the cz portion 812 of the central display 810.

[0385] In some exemplary implementation schemes, such as Figure 8 As shown, controller 150 ( Figure 1 It can be configured to display, for example, a second repeating portion 805 of image scene 801 at the xcz portion 814 of the central display 810.

[0386] In some exemplary implementation schemes, such as Figure 8 As shown, controller 150 ( Figure 1 It can be configured to cause the peripheral display 830 to display, for example, a first repeating portion 803 of the image scene 801 at the xtz portion 824 of the peripheral display 830.

[0387] In some exemplary implementation schemes, such as Figure 8 As shown, controller 150 ( Figure 1 It can be configured to cause the peripheral display 830 to display, for example, a second repeating portion 803 of the image scene 801 at the tz portion 822 of the peripheral display 830.

[0388] In some exemplary implementation schemes, such as Figure 8 As shown, the first repeating portion 803 of the image scene 801 can cover at least 5 degrees of FoV.

[0389] In other implementations, the first repeating portion 803 of the image scene 801 may cover any other FoV.

[0390] In some exemplary implementations, the second repeating portion 805 of the image scene 801 may cover at least 5 degrees of FoV.

[0391] In other embodiments, the second repeating portion 805 of the image scene 801 may cover any other FoV.

[0392] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to adjust the size of the first repeating portion 803 and / or the size of the second repeating portion 805 of the image scene 801, for example, as described below.

[0393] In some exemplary implementations, controller 150 ( Figure 1 ) can be configured, for example, based on HMD device 100 ( Figure 1 The size of the first repeating portion 803 of the image scene 801 and / or the size of the second repeating portion 805 of the image scene 801 are determined by setting the exit pupil distance and / or tilt angle, for example, as described below.

[0394] right Figure 9 For reference, an adjustment scheme 907 for adjusting an image scene 901 to be displayed by an HMD device 900 is schematically shown according to some exemplary embodiments. For example, HMD device 100 ( Figure 1 It may include one or more elements of the HMD device 900, and / or may perform one or more operations and / or one or more functions of the HMD device 900.

[0395] In some exemplary implementations, controller 150 ( Figure 1 It can be configured, for example, to adjust the image scene 801 according to adjustment scheme 900. Figure 8 For example, as described below.

[0396] In some exemplary implementation schemes, such as Figure 9 As shown, image scene 901 may include a first repeating portion 903 of image scene 901.

[0397] In some exemplary implementation schemes, such as Figure 9 As shown, image scene 901 may include a second repeating portion 905 of image scene 901.

[0398] In some exemplary implementations, controller 150 ( Figure 1 It can be configured to adjust the image scene 901, for example, based on the exit pupil distance setting and / or tilt angle 906 of the HMD device 900.

[0399] In some exemplary embodiments, tilt angle 906 can define the tilt angle between the optical axis of the central lens of the HMD device 900 and the visual axis of the pupil 953 of the user's eye.

[0400] In one instance, the tilt angle 906 may be defined as zero, for example, when the user's head is upright and the user expects a distant image to be displayed on the HMD device 900.

[0401] In another instance, the tilt angle 906 can be defined as a positive angle, for example, when the user's head is upright and the user is looking forward and the HMD is tilted upward.

[0402] In another instance, the tilt angle 906 can be defined as a negative angle, for example, when the user's head is upright and the user is looking forward and the HMD is tilted downward.

[0403] In some exemplary embodiments, image scene 901 may correspond to zero tilt angle 906 and a predefined exit pupil distance setting 914, such as a predefined design and / or preferred exit pupil distance setting.

[0404] In some exemplary implementation schemes, such as Figure 9 As shown, the exit pupil distance setting 914 can correspond to the distance 916 between the cornea 952 of the user's eye and the central lens 920 of the HMD device 900.

[0405] In some exemplary implementations, controller 150 ( Figure 1 It can be configured, for example, to adjust image scene 901 to image scene 911 based on exit pupil distance setting 914, as described below.

[0406] In some exemplary implementation schemes, such as Figure 9 As shown, controller 150 ( Figure 1 The first dimension 913 of the first repeating portion 903 and the second dimension 915 of the second repeating portion 905 can be configured to determine. For example, the second dimension 915 can be configured to be larger than the first dimension 913, for example, based on an increase in the distance 916 between the cornea 952 and the lens.

[0407] In one instance, such as during temporal gaze, when the distance 916 between the pupil and the lens of the HMD device 900 increases, the pupil 953 may miss light. Therefore, the nasal gaze overlap area corresponding to the second repetition portion 905 (e.g., xtz display area 134) Figure 1 )) may increase.

[0408] In some exemplary implementations, controller 150 ( Figure 1 The image scene 901 can be adjusted to image scene 917, for example, based on the exit pupil distance setting 914 and / or tilt angle 906 of the HMD device 900, as described below.

[0409] In some exemplary implementation schemes, such as Figure 9 As shown, controller 150 ( Figure 1The size of the first repeating portion 903 of the image scene 901 can be determined, for example, when the HMD device 900 is tilted downwards, such as when the distance between the cornea 952 and the bottom portion of the lens of the HMD device 900 is less than the distance between the cornea 952 and the upper portion of the lens of the HMD device 900.

[0410] In some exemplary implementation schemes, such as Figure 9 As shown, for example, when the upper portion of the first repeating portion 903 is farther than the lower portion of the second repeating portion 905, for example when the HMD device 900 is tilted downward, the upper portion of the first repeating portion 903 may be larger than the lower portion of the second repeating portion 905.

[0411] In one instance, when the HMD device 900 is tilted, for example, when the distance between the cornea 952 and the upper portion of the lens of the HMD device 900 increases, the upper portion of the temporal region may shift toward the center.

[0412] In another instance, for example, when the distance between the cornea 952 and the bottom portion of the lens of the HMD device 900 decreases, the bottom portion of the temporal region may shift away from the center.

[0413] right Figure 10 For reference, the HMD 1002 is schematically illustrated according to some exemplary embodiments. For example, HMD 102 ( Figure 1 It may include one or more elements of HMD 1002, and / or perform one or more operations and / or one or more functions of HMD 1002.

[0414] In some exemplary implementation schemes, such as Figure 10 As shown, HMD 1002 may include a central display 1010, a central lens 1020, a peripheral display 1030, and a peripheral lens 1040, for example, as described below.

[0415] In some exemplary embodiments, the lens-display distance (e.g., the lens-display distance between the central display 1010 and the central lens 1020 and / or the lens-display distance between the peripheral display 1030 and the peripheral lens 1040) can be adjusted, for example, to support the user's eye refractive errors, such as myopia and / or hyperopia, for example, as described below.

[0416] In some exemplary implementation schemes, such as Figure 10 As shown, a predefined center lens-display distance 1013 between the center lens 1020 of the HMD1002 and a predefined position 1015 of the center display can be set and / or adjusted, for example, as described below.

[0417] In some exemplary implementation schemes, such as Figure 10 As shown, a predefined peripheral lens-display distance 1033 between the peripheral lens 1040 and the peripheral display 1030 at a predefined position 1035 can be set and / or adjusted, for example, as described below.

[0418] In some exemplary implementation schemes, such as Figure 10 As shown, the center lens-display distance can be increased from a predefined center lens-display distance 1013, for example, toward the center lens-display distance 1011.

[0419] In one example, the central lens-display distance 1011 can be configured, for example, for a user with farsightedness, such that the user can clearly see the image scene on the central display, for example, image scene 801. Figure 8 ).

[0420] In some exemplary embodiments, the peripheral lens-display distance can be similarly defined from a predefined peripheral lens-display distance 1035, for example, toward a peripheral lens-display distance (not shown in [reference needed]). Figure 10 (In the middle) increases, for example, to enable users to clearly see the image scene on the surrounding display, such as image scene 801 ( Figure 8 ).

[0421] In some exemplary implementation schemes, such as Figure 10 As shown, the peripheral lens-display distance can be reduced from a predefined peripheral lens-display distance 1035, for example, toward a peripheral lens-display distance 1031.

[0422] In one example, the peripheral lens-display distance 1031 can be configured, for example, for a user with myopia, to enable the user to clearly see the image scene on the peripheral display, such as image scene 801. Figure 8 ).

[0423] In some exemplary embodiments, the central lens-display distance can be similarly derived from a predefined central lens-display distance 1013, for example, towards a central lens-display distance (not shown in [reference needed]). Figure 10 The image is reduced in size, for example, so that the user can clearly see the image scene on the central display, such as image scene 801. Figure 8 ).

[0424] In some exemplary implementations, controller 150 ( Figure 1 The image scene can be configured, for example, to determine and / or adjust the display area (e.g., xcz display area 114) of the image scene based on the central lens-display distance 1011. Figure 1The size of the portion 1003 shown is displayed.

[0425] In some exemplary implementations, controller 150 ( Figure 1 Controller 150 ( Figure 1 ) can be configured to determine and / or adjust the image scene to be displayed by the xtz display area (e.g., xtz display area 134) based, for example, the peripheral lens-display distance 1031. Figure 1 The size of the portion shown is 1005.

[0426] In some exemplary implementations, adjusting the lens-display distance (e.g., lens-display distance 1011 and / or lens-display distance 1013) can alter the perceived size of an object. For example, an image scene may be scaled, for example, for farsightedness and / or nearsightedness, such as zooming in or out, which may require adjusting the size of the portions of the image scene that will be displayed.

[0427] In some exemplary implementations, for example, when the image scene is magnified, the image scene can be stretched, for example due to a reduction in the lens-display distance. Therefore, portions of the image scene can be stretched, for example, before being displayed, as described below.

[0428] In some exemplary implementation schemes, such as Figure 10 As shown, the size of portion 1003 can be increased, for example, based on magnifying the image scene. The size of portion 1003 can be increased, for example, by allocating an additional portion 1004 of the central display 1010 to display the image scene, for example, to allow stretching of the image scene to be displayed on the central display 1010.

[0429] In some exemplary implementation schemes, such as Figure 10 As shown, the size of portion 1005 can be increased, for example, based on magnifying the image scene. The size of portion 1005 can be increased, for example, by allocating an additional portion 1006 of the peripheral display 1030 to display the image scene, for example, to allow stretching of the image scene to be displayed on the peripheral display 1030.

[0430] In one instance, preserving object size awareness allows for the preservation of the master ray angle, and therefore, additional pre-distortion adjustments may not be necessary.

[0431] In one example, adjusting the dimensions of portions 1003 and / or 1005 can provide a technical solution that eliminates the need to adjust the side-cut angles of the central lens 1020 and / or the peripheral lens 1040, such as adjusting the side-cut 223 of the xcz lens portion 224 (FIG. 2) and / or the side-cut 245 (FIG. 2) of the xtz lens portion 244 (FIG. 2).

[0432] Back to reference Figure 1 In some exemplary embodiments, the controller 150 may be configured to verify the continuous FoV of the HMD 1102, for example, based on a corneal reflection image from the user's eye, as described below.

[0433] In some exemplary embodiments, controller 150 may be configured to process image information of the cornea above pupil 152 to identify corneal reflection images, which include a combination of a first image from central display 110 and a second image from peripheral display 130, for example, as described below.

[0434] In some exemplary embodiments, the controller 150 may be configured to adjust, for example, a first image displayed by the central display 110 and / or a second image displayed by the peripheral display 130 based on a corneal reflection image, as described below.

[0435] In one instance, the user's eyes may be monitored, for example, to ensure continuous FoV. For example, controller 150 may be configured to adjust a first image displayed by central display 110 and / or a second image displayed by peripheral display 130, for example, based on real-time feedback, which may be determined, for example, based on analysis of corneal reflection images, which may include a combination of the first image from central display 110 and the second image from peripheral display 130, and may be reflected from the iris of the eye, for example, from a single source where it should be presented in its entirety.

[0436] In another instance, for example, if the first and second images are not merged, and therefore the continuous, realistic panoramic images may be fragmented, then the pre-distortion adjustments and content allocation for the central display 110 and the peripheral displays 130 may be incorrect.

[0437] In some exemplary embodiments, the first image from the central display 110 may include a first calibration image, and / or the second image from the peripheral display 130 may include a second calibration image, for example to verify the continuous FoV of the HMD 102, as described below.

[0438] In some exemplary embodiments, controller 150 may be configured to simultaneously display a first calibration image on central display 110 and a second calibration image on peripheral display 130, for example, as described below.

[0439] In some exemplary embodiments, the controller 150 may be configured to process image information of the cornea, for example, to identify a corneal reflection calibration image, which includes a combination of a first calibration image and a second calibration image, as described below.

[0440] In some exemplary embodiments, the controller 150 may be configured to adjust, for example, a first image displayed by the central display 110 and / or a second image displayed by the peripheral display 130 based on a corneal reflection calibration image, as described below.

[0441] In one instance, the calibration image may include a predefined pattern, which may be displayed as a visible or invisible image.

[0442] In one instance, the predefined pattern may include display stripes that transmit near-infrared (NIR) light, which may be mounted on the overlapping area of, for example, a central display 110 and / or a peripheral display 130.

[0443] In another instance, a predefined pattern may include local display RGB subpixels.

[0444] In another instance, a predefined pattern may include any other pattern.

[0445] In some exemplary implementations, such as the analysis of a combination of a first image and a second image, using a predefined pattern may be simple and easy, whereas the analysis of such a combination may require comparing visible phenomena, such as image reflections that may be common to regular content, and / or may require cross-correlation between regular content and iris reflections, which may increase computational complexity.

[0446] right Figure 11 For reference, a verification scheme 1100 for verifying the continuous FoV of HMD1102 is schematically illustrated according to some exemplary embodiments. For example, HMD 102 ( Figure 1 It may include one or more elements of HMD 1102, and / or perform one or more operations and / or one or more functions of HMD 1102.

[0447] In one instance, controller 150 may, for example, verify HMD102 according to verification scheme 1100. Figure 1 ) continuous FoV.

[0448] In some exemplary implementation schemes, such as Figure 11 As shown, HMD 1102 may include a central display 1110, a central lens 1120, a peripheral display 1130, a peripheral lens 1140, and a controller 1150, for example, as described below. For example, controller 150 ( Figure 1 It can perform one or more operations and / or one or more functions of the controller 1150.

[0449] In some exemplary implementation schemes, such as Figure 11 As shown, the controller 1150 can be configured to simultaneously display the first calibration image 1111 on the central display 1110 and the second calibration image 1131 on the peripheral display 130, for example, as described below.

[0450] In some exemplary embodiments, controller 1150 may be configured to process corneal image information 1160.

[0451] In some exemplary embodiments, image information 1160 may be captured, for example, by camera 1159.

[0452] In one instance, gaze tracker 159 ( Figure 1 It may include one or more elements of camera 1159, and / or perform one or more operations and / or one or more functions of camera 1159.

[0453] In another instance, for example, besides gaze tracker 159 ( Figure 1 In addition to ), HMD device 100 ( Figure 1 It may also include camera 1159.

[0454] In some exemplary embodiments, the controller 1150 may process corneal image information 1160, for example, to identify a corneal reflection calibration image 1162, which includes a combination of a first calibration image 1111 and a second calibration image 1131, for example, as described below.

[0455] In one instance, for example, if the combination of the first calibration image 1111 and the second calibration image 1131 in the corneal reflection calibration image 1162 is reflected as a continuous FoV, such as vertical fusion with a "+" sign, then the controller 1150 can verify the continuous FoV.

[0456] In some exemplary embodiments, the controller 1150 may be configured to adjust, for example, a first image displayed by the central display 1110 and / or a second image displayed by the peripheral display 1130 based on a corneal reflection calibration image 1162.

[0457] In one instance, for example, if the combination of the first calibration image 1111 and the second calibration image 1131 in the corneal reflection calibration image 1162 is not reflected as a continuous FoV, for example, excluding vertical fusion with a "+" sign, then the controller 1150 may adjust the first image displayed by the central display 1110 and / or the second image displayed by the peripheral display 1130.

[0458] In some exemplary embodiments, controller 1150 may be configured to adjust the tilt angle between the central display 1110 and the peripheral display 1130, for example, based on corneal reflection calibration image 1162, as described above.

[0459] In some exemplary embodiments, the controller 1150 may be configured to apply predistortion, for example, based on the corneal reflection calibration image 1162, to a first image displayed by the central display 1110 and / or a second image displayed by the peripheral display 1130.

[0460] In one example, camera 1159 may include an NIR eye-tracking camera with NIR structured light (SL), which can be configured to project a pattern onto the user's face.

[0461] In some exemplary embodiments, the controller 1150 may determine one or more HMD parameters, such as eye 3D shape estimation, gaze angle, ER setting, IPD setting, tilt angle and / or any other parameters and / or attributes, for example, based on analysis of an image including a pattern projected onto the user's face.

[0462] In some exemplary embodiments, the controller 1150 may determine eye-pupil hit efficiency and / or visual acuity (EPHEVA) for each display pixel of the central display 1110, for example, based on HMD parameters.

[0463] right Figure 12 For reference, a planar hybrid lens 1210 and a concave hybrid lens 1220, which can be implemented according to some exemplary embodiments, are schematically shown.

[0464] In one example, the central lens 120 ( Figure 1 ) and / or peripheral lens 140 ( Figure 1 It may be implemented by one or more elements of the planar hybrid lens 1210, and / or may include the one or more elements.

[0465] In another example, the central lens 120 ( Figure 1 ) and / or peripheral lens 140 ( Figure 1 This can be achieved by one or more elements of the concave hybrid lens 1220, and / or may include the one or more elements.

[0466] In other embodiments, the central lens 120 ( Figure 1 ) and / or peripheral lens 140 ( Figure 1 This can be achieved by any other type of hybrid or non-hybrid lens, and / or may include the hybrid or non-hybrid lens.

[0467] In some exemplary implementation schemes, such as Figure 12 As shown, the planar hybrid lens 1210 may include at least two freeform surface components.

[0468] In some exemplary implementation schemes, such as Figure 12 As shown, the planar hybrid lens 1210 may include a central freeform aspherical lens 1212 and a peripheral freeform Fresnel lens 1214.

[0469] In some exemplary implementation schemes, such as Figure 12 As shown, the planar hybrid lens 1210 can provide a FoV angle denoted as α1.

[0470] In some exemplary implementation schemes, such as Figure 12 As shown, the central freeform aspherical lens 1212 can provide a FoV angle denoted as α3 in terms of FoV angle α1.

[0471] In one example, the central freeform aspherical lens 1212 can provide sharp vision, for example, through non-Fresnel optics.

[0472] In some exemplary implementation schemes, such as Figure 12 As shown, the concave hybrid lens 1220 may include at least two freeform surface components.

[0473] In some exemplary implementation schemes, such as Figure 12 As shown, the concave hybrid lens 1220 may include a central freeform concave aspherical lens 1222 and a peripheral freeform Fresnel lens 1224.

[0474] In some exemplary implementation schemes, such as Figure 12 As shown, the concave hybrid lens 1220 may include, for example, a concave diffraction layer 1226 in front of and / or behind the central freeform concave aspherical lens 1222 and the peripheral freeform Fresnel lens 1224.

[0475] In some exemplary implementation schemes, such as Figure 12 As shown, the concave hybrid lens 1220 can provide a FoV angle denoted as α2.

[0476] In some exemplary implementation schemes, such as Figure 12 As shown, the central freeform aspherical lens 1222 can provide a FoV angle denoted as α4 in terms of FoV angle α2.

[0477] In some exemplary implementation schemes, such as Figure 12As shown, compared to the FoV angle α1 of the planar hybrid lens 1210, the concave hybrid lens 1220 can provide a wide FoV, such as a FoV angle α2. For example, FoV angle α2 can cover FoV angle α1, plus an additional FoV angle denoted as Δα21. For example, FoV angle α4 can cover FoV angle α3, plus an additional FoV angle denoted as Δα43.

[0478] In one instance, such as Figure 12 As shown, the concave hybrid lens 1220 appears convex when viewed from the display side and concave when viewed from the eye side.

[0479] In one instance, such as Figure 12 As shown, the peripheral freeform Fresnel lens 1224, when viewed from the eye side, is co-radial with the central freeform concave aspherical lens 1222.

[0480] In some exemplary embodiments, the concave hybrid lens 1220 may be configured to compensate for dispersion, for example, by a diffraction structure, such as a diffraction layer 1226, possibly at least on one side of the lens.

[0481] In some exemplary embodiments, the concave hybrid lens 1220 may differ from the planar hybrid lens 1210, for example, because it has a different lens shape and / or because it uses a diffraction layer (e.g., concave diffraction layer 1226).

[0482] In some exemplary implementation schemes, such as Figure 12 As shown, the concave hybrid lens 1220 may include two aspherical refractive surfaces and two diffractive surfaces, which can increase flexibility, such as producing variable visual acuity (VA) at one or more FoV angles. For example, the variable VA can be configured such that the VA decreases as the FoV angle increases.

[0483] In some exemplary embodiments, the concave hybrid lens 1220 may be formed of one or more types of materials that can be configured, for example, for near-eye display optics, as described below.

[0484] In one example, a lens formed from a material with a medium to high Abbe number (AN) minimizes chromatic aberration. However, materials with a medium to high AN may have a limited refractive index (RI), for example, for polymers, a higher RI may reduce the AN. Therefore, these materials may impose limitations on the thickness and / or diameter of the lens.

[0485] In some exemplary embodiments, the concave hybrid lens 1220 and / or the planar hybrid lens 1210 may be formed of a material with an RI to AN (RI / AN) ratio of at least 0.03.

[0486] In one instance, the lens may be formed from one or more of the following materials.

[0487]

[0488] Table 1

[0489] In one example, the concave hybrid lens 1220 and / or the planar hybrid lens 1210 may be formed from one or more of the materials listed in Table 1. In other embodiments, the concave hybrid lens 1220 and / or the planar hybrid lens 1210 may be formed from any other material.

[0490] In some exemplary embodiments, the concave diffraction layer 1226 may be implemented to support the realization of lens materials, for example, for the same diameter, the same ER and / or the same optical power, with an RI / AN ratio of at least 0.03, such as when using lenses made of materials characterized by an RI / AN ratio of less than 0.03.

[0491] In some exemplary embodiments, the concave hybrid lens 1220 may be implemented to support an increased FoV angle, such as FoV angle α4, which may allow FoV angle α3 to increase by, for example, an additional FoV angle Δα43.

[0492] In some exemplary embodiments, the concave shape of the concave hybrid lens 1220 can be configured to retain the center ER and an expanded FoV angle, such as FoV angle α2.

[0493] In some exemplary embodiments, the concave hybrid lens 1220 may be formed of a material having, for example, a relatively low AN and an RI / AN ratio of at least 0.03, to provide a technical solution that allows the concave diffraction layer 1226 to contribute more, for example, to the light deviation for each given lens angle, while compensating for chromatic aberration caused by refraction.

[0494] right Figure 13 For reference, a block diagram of a system 1300 including a computing device 1350 and an HMD device 1302 according to some exemplary embodiments is shown.

[0495] In one example, HMD device 100 ( Figure 1 It may include one or more elements of HMD device 1302, and / or perform one or more operations and / or one or more functions of HMD device 1302.

[0496] In one instance, computing device 1350 may include one or more processors, software and / or hardware configured to process and / or provide images for display by HMD device 1302.

[0497] In some exemplary embodiments, HMD device 1302 may be configured to interface with computing device 1350 and receive image scenes from computing device 1350 for display by HMD device 1302.

[0498] In some exemplary implementations, the computing device 1350 may be based on an x86 or RISC architecture and / or any other architecture that may be powerful enough to render intensive graphics information for extended reality.

[0499] In some exemplary embodiments, system 1300 may optionally include one or more controllers, referred to as controller component #1 and controller component #2, and / or one or more service sensors, motors and / or analog electronics that can provide one or more interfaces to be added to computing device 1350 and / or provide, for example, a closed control loop faster than computing device 1350.

[0500] In some exemplary embodiments, HMD device 1302 may include a MIPI-DSI mini-display, and computing device 1350 may provide a direct MIPI DSI interface and / or a conversion interface, such as HDMI, DP, LVDS, and / or any other type of interface and / or corresponding bridging circuitry for driving the mini-display of HMD device 1302, through a bridge from one or more other ports.

[0501] In one example, the number of MIPI-DSI interfaces or any other interfaces on the computing device 1350 may be less than the number of displays; for example, there may be three displays if the left and right eyes share a central display, or four displays if they do not share all displays. According to this example, MIPI and / or other router circuitry can be used to drive all displays and / or manage bandwidth by prioritizing the central display and / or through foveated rendering.

[0502] In some exemplary embodiments, the HMD device 1302 may optionally include a set of motorized linear and / or rotary shafts, which may have limit switches and / or encoders, for example.

[0503] In some exemplary embodiments, the HMD device 1302 may optionally include an eye-tracking module and / or an ER analysis module, which may be connected to a symmetrical camera, for example, directly to the computer 1350, or connected via a controller of the HMD device 1302. This implementation reduces the load on the computing device 1350, for example, by allowing the HMD device 1302 to perform local image processing and / or closed loops under the control of motors and content generation controls.

[0504] In some exemplary embodiments, the HMD device 1302 may optionally include a stereo camera for inside-out tracking, and / or one or more cameras for 360-degree tracking and / or SLAM.

[0505] In some exemplary embodiments, the HMD device 1302 may optionally include one or more IMU sensors, for example, to indicate to the computing device 1350 which information from the 360-degree sphere can be rendered and distributed in a display.

[0506] In one instance, fine-tuning of the information distribution in a peripheral display can be performed, for example, based on eye tracking and / or in conjunction with a motorized axis.

[0507] In some exemplary embodiments, the ER setting, vertical axis, and / or tilt axis can be used, for example, to adjust the position of the HMD device after the HMD device 1302 has been mounted on the user's head.

[0508] In some exemplary embodiments, the pupillary distance axis can be used, for example, for centering of the left and / or right visual units (VUs) in front of each eye, such as the left-hand side VU including a central display 160. Figure 1 ), central lens 165 ( Figure 1 ), peripheral monitor 170 ( Figure 1 ) and peripheral lens 175 ( Figure 1 ), and / or the right-hand VU includes a central display 110 ( Figure 1 ), central lens 120 ( Figure 1 ), peripheral monitor 130 ( Figure 1 ) and peripheral lens 140 ( Figure 1 ).

[0509] In some exemplary embodiments, the HMD device 1302 may optionally include two or more rotation axes configured to adjust the tilt angle between the center display and the peripheral displays.

[0510] In some exemplary embodiments, the HMD device 1302 may optionally include multiple linear axes, such as four linear axes, configured to set the distance between the display and the lens of the HMD device 1302.

[0511] In some exemplary embodiments, the symmetrical camera may be configured to detect improper installation of the HMD device 1302 on the head, for example, using analysis of facial anatomy, and may be configured to provide an alert for improper installation, for example, to allow the user to improve the position of the headset.

[0512] right Figure 14 For reference, this illustration schematically depicts methods for controlling the HMD according to some exemplary implementation schemes. For example, Figure 14 One or more of the operations of the method may be performed by: an HMD device, such as HMD device 100 ( Figure 1 HMD, such as HMD 102 and / or 104 ( Figure 1 ); controller, such as controller 150 ( Figure 1 ) and / or controller 1150 ( Figure 11 ).

[0513] As indicated in box 1402, the method may include causing the central display of the HMD to display a first image based on image information of an image scene. For example, controller 150 ( Figure 1 This allows the central display 110 ( Figure 1 The first image is displayed based on image information of the image scene, for example, as described above.

[0514] As indicated in box 1404, the method may include causing a peripheral display of the HMD to display a second image based on image information of an image scene. For example, controller 150 ( Figure 1 This allows the peripheral display to reach 140 ( Figure 1 The first image is displayed based on image information of the image scene, for example, as described above.

[0515] As indicated in box 1406, displaying the first image on the central display may include a cz portion that includes a first repeating portion of the image scene. For example, controller 150 ( Figure 1 This allows the central display 110 ( Figure 1 The first image is displayed in image scene 801. Figure 8 The first repeating part 803 () Figure 8 The cz part of ) for example, as described above.

[0516] As indicated in box 1408, displaying the first image on the central display may include an xcz portion that includes a second repeating portion of the image scene, causing the central display to display the first image. For example, controller 150 ( Figure 1 This allows the central display 110 ( Figure 1 The first image is displayed in image scene 801. Figure 8 The second repeating part 805 () Figure 8 The xcz part of ) for example, as described above.

[0517] As indicated in box 1410, displaying the second image on the peripheral display may include a tz portion that includes a second repeating portion of the image scene. For example, controller 150 ( Figure 1 This allows the peripheral display to reach 130 ( Figure 1The second image is displayed in image scene 801. Figure 8 The second repeating part 805 () Figure 8 The tz part of ) for example, as described above.

[0518] As indicated in box 1412, causing the peripheral display to display the second image may include an xtz portion that includes a first repeating portion of the image scene, causing the peripheral display to display the second image. For example, controller 150 ( Figure 1 This allows the peripheral display to reach 130 ( Figure 1 The second image is displayed in image scene 801. Figure 8 The first repeating part 803 () Figure 8 The xtz part of ) for example, as described above.

[0519] right Figure 15 For reference, a manufactured product 1500 is schematically illustrated according to some exemplary embodiments. Product 1500 may include one or more tangible computer-readable (“machine-readable”) non-transitory storage media 1502, which may include, for example, computer-executable instructions implemented by logic 1504, which are operable to cause at least one processor (e.g., a computer processor) to implement HMD device 100 when executed by at least one processor (e.g., a computer processor). Figure 1 HMD 102 and / or 104 Figure 1 ) and / or controller 150 ( Figure 1 One or more operations, performing one or more operations and / or performing, triggering and / or implementing one or more operations, and / or referring to the above. Figure 1 Figure 2, Figure 3, Figure 4 Figure 5 Figure 6 Figure 7 , Figure 8 , Figure 9 , Figure 10 , Figure 11 , Figure 12 , Figure 13 and / or Figure 14 The functions described herein, and / or one or more operations described herein. The phrases “non-transitory machine-readable medium” and “computer-readable non-transitory storage medium” encompass all computer-readable media, with the sole exception of transient propagation signals.

[0520] In some exemplary embodiments, product 1500 and / or storage medium 1502 may include one or more types of computer-readable storage media capable of storing data, including volatile memory, non-volatile memory, removable or non-removable memory, erasable or non-erasable memory, writable or non-writable memory, etc. The computer-readable storage medium may include any suitable medium involved in the following operations: downloading or transmitting a computer program from a remote computer to a requesting computer via a communication link (e.g., modem, radio, or network connection) carried by a data signal embodied in a carrier wave or other propagation medium.

[0521] In some exemplary embodiments, logic 1504 may include instructions, data, and / or code that, when executed by a machine, cause the machine to perform the methods, processes, and / or operations described herein. The machine may include, for example, any suitable processing platform, computing platform, computing device, processing device, computing system, processing system, computer, processor, etc., and may be implemented using any suitable combination of hardware, software, firmware, etc.

[0522] In some exemplary embodiments, logic 1504 may include, or may be implemented as, software, a software module, an application program, a program, a subroutine, instructions, an instruction set, computational code, a word, a value, a symbol, etc. Instructions may include any suitable type of code, such as source code, compiled code, interpreted code, executable code, static code, dynamic code, etc. Instructions may be implemented according to a predefined computer language, manner, or syntax to instruct the processor to perform specific functions. Instructions may be implemented using any suitable high-level, low-level, object-oriented, visual, compiled, and / or interpreted programming language. The functions, operations, components, and / or features described in one or more embodiments herein may be combined with, or utilized in conjunction with, one or more other functions, operations, components, and / or features described herein with reference to one or more other embodiments, or vice versa.

[0523] Example

[0524] The following examples relate to other implementation schemes.

[0525] Example 1 includes a head-mounted display (HMD) device, comprising: a central display configured to display a first image in a central field of view (FoV) based on an image scene to be displayed to a user's pupil; the central display including: a central zone (cz) display area for displaying a cz portion of the first image; and an extended central zone (xcz) display area for displaying an xcz portion of the first image, the xcz display area being adjacent to the cz display area; and a central lens configured to direct light from the first image toward the user's pupil, the central lens including a cz lens portion and an xcz lens portion adjacent to the cz lens portion, the cz lens portion being configured to direct light from the cz portion of the first image toward the pupil under direct gaze, under nasal gaze, and under temporal gaze of the pupil, the xcz lens portion being configured to direct light from the cz portion of the first image toward the pupil under nasal gaze of the pupil. The peripheral display, configured to display a second image in a temporal FoV based on the image scene, includes: a temporal zone (tz) display area for displaying the tz portion of the second image; an extended temporal zone (xtz) display area for displaying the xtz portion of the second image, adjacent to the tz display area; and a peripheral lens configured to direct light from the second image toward the user's pupil, the peripheral lens being tilted relative to the central lens at an angle, the peripheral lens including a tz lens portion and an xtz lens portion, the tz lens portion being configured to direct light from the tz portion of the second image toward the pupil under direct gaze, temporal gaze, and nasal gaze of the pupil, the xtz lens portion being configured to direct light from the xtz portion of the second image toward the pupil under temporal gaze of the pupil.

[0526] Example 2 includes the subject matter of Example 1, and optionally wherein the HMD device is configured to provide a continuous nasal gaze FoV to the pupil under nasal gaze, the continuous nasal gaze FoV including light from the cz portion of the first image guided toward the pupil under nasal gaze by the cz lens portion, light from the xcz portion of the first image guided toward the pupil under nasal gaze by the xcz lens portion, and light from the tz portion of the second image guided toward the pupil under nasal gaze by the tz lens portion.

[0527] Example 3 includes the subject matter of Example 1 or 2, and optionally wherein the HMD device is configured to provide a continuous temporal gaze FoV to the pupil under temporal gaze, the continuous temporal gaze FoV including light from the cz portion of a first image guided toward the pupil by the cz lens portion under temporal gaze, light from the xtz portion of a second image guided toward the pupil by the xtz lens portion under temporal gaze, and light from the tz portion of the second image guided toward the pupil by the tz lens portion under temporal gaze.

[0528] Example 4 includes the subject of any of Examples 1 to 3, and optionally includes a controller configured to cause the central display to display the first image based on image information of the image scene, and to cause the peripheral display to display the second image based on the image information of the image scene.

[0529] Example 5 includes the subject matter of Example 4, and optionally wherein the controller is configured to cause the central display to display the cz portion of the first image that includes a first repeating portion of the image scene; and to display the xcz portion of the first image that includes a second repeating portion of the image scene; and to cause the peripheral display to display the tz portion of the second image that includes the second repeating portion of the image scene; and to display the xtz portion of the second image that includes the first repeating portion of the image scene.

[0530] Example 6 includes the subject of Example 5, and optionally the second repeating portion of the image scene therein covers at least 5 degrees of FoV.

[0531] Example 7 includes the subject of Example 5, and optionally the first repeating portion of the image scene therein covers at least 5 degrees of FoV.

[0532] Example 8 includes the subject of any of Examples 5 to 7, and optionally wherein the controller is configured to determine the size of at least one of the first repeating portion of the image scene or the second repeating portion of the image scene based on at least one of the exit pupil distance setting or the tilt angle of the HMD device.

[0533] Example 9 includes the subject of any of Examples 5 to 8, and optionally wherein the controller is configured to determine the size of the second repeating portion of the image scene based on the central lens-display distance between the central lens and the central display.

[0534] Example 10 includes the subject of any of Examples 5 to 9, and optionally wherein the controller is configured to determine the size of the first repeating portion of the image scene based on the peripheral lens-display distance between the peripheral lens and the peripheral display.

[0535] Example 11 includes the subject matter of any of Examples 4 to 10, and optionally wherein the controller is configured to generate the second image by applying a first trapezoidal predistortion to a portion of the image scene to be displayed by the peripheral display based on the recognition of direct gaze of the pupil; and to generate the second image by applying a second trapezoidal predistortion to the portion of the image scene to be displayed by the peripheral display based on the recognition of indirect gaze of the pupil, the second trapezoidal predistortion being different from the first trapezoidal predistortion.

[0536] Example 12 includes the subject matter of Example 11, and optionally wherein the controller is configured to determine that the second trapezoidal predistortion is less than the first trapezoidal predistortion based on the recognition of the temporal gaze of the pupil.

[0537] Example 13 includes the subject matter of Example 11 or 12, and optionally wherein the controller is configured to determine that the second trapezoidal predistortion is greater than the first trapezoidal predistortion based on the recognition of the nasal gaze of the pupil.

[0538] Example 14 includes the subject of any of Examples 4 to 13, and optionally wherein the controller is configured to determine predistortion based on at least one of the exit pupil distance setting of the HMD device, the tilt angle of the HMD device, or the interpupillary distance (IPD) of the user, and to apply the predistortion to at least one portion of the image scene, the at least one portion of the image scene including at least one of an image portion to be displayed by the central display or an image portion to be displayed by the peripheral display.

[0539] Example 15 includes the subject of any of Examples 4 to 14, and optionally wherein the controller is configured to calibrate the color saturation of the first image relative to the color saturation of the second image based on one or more spectral properties of at least one of the central lens or the peripheral lens.

[0540] Example 16 includes the subject of any of Examples 4 to 15, and optionally wherein the controller is configured to calibrate the spatial intensity of the first image relative to the spatial intensity of the second image based on one or more spectral properties of at least one of the central lens or the peripheral lens.

[0541] Example 17 includes the subject matter of any of Examples 4 to 16, and optionally wherein the controller is configured to identify a tilt setting of the tilt angle of the peripheral lens relative to the central lens, and to determine a portion of the image scene to be displayed by the peripheral display based on the tilt setting.

[0542] Example 18 includes the subject matter of any of Examples 4 to 17, and optionally wherein the controller is configured to monitor the gaze angle of the pupil and dynamically adjust the tilt angle of the peripheral lens relative to the central lens based on the gaze angle of the pupil.

[0543] Example 19 includes the subject matter of any of Examples 4 to 18, and optionally wherein the controller is configured to: process image information of the cornea above the pupil to identify a corneal reflection image, the corneal reflection image including a combination of a first image from the central display and a second image from the peripheral display; and adjust at least one of the first image displayed by the central display or the second image displayed by the peripheral display based on the corneal reflection image.

[0544] Example 20 includes the subject matter of Example 19, and optionally wherein the HMD device is configured to: simultaneously display a first calibration image on the central display and a second calibration image on the peripheral display; process image information of the cornea to identify a corneal reflection calibration image, the corneal reflection calibration image including a combination of the first calibration image and the second calibration image; and adjust at least one of the first image displayed on the central display or the second image displayed on the peripheral display based on the corneal reflection calibration image.

[0545] Example 21 includes the subject matter of any of Examples 1 to 20, and optionally includes a tilt angle adjuster to adjust the tilt angle of the peripheral lens relative to the central lens.

[0546] Example 22 includes the subject matter of any of Examples 1 to 21, and optionally wherein the central lens is spaced at least 1 millimeter (mm) apart from the peripheral lens.

[0547] Example 23 includes the subject matter of any of Examples 1 to 22, and optionally wherein the central lens is spaced at least 1 millimeter (mm) from the peripheral lens in the plane connecting the optical axes of the central lens and the peripheral lens.

[0548] Example 24 includes the subject matter of any of Examples 1 to 21, and optionally wherein the edge of the central lens is in direct contact with the edge of the peripheral lens.

[0549] Example 25 includes the subject matter of any of Examples 1 to 24, and optionally wherein the peripheral display includes additional xtz display portions for displaying additional xtz portions of the second image, and the peripheral lens includes additional xtz lens portions configured to direct light from the additional xtz portions of the second image toward the pupil under the temporal gaze of the pupil, and wherein the xtz lens portions are located between the xtz lens portions and the additional xtz lens portions.

[0550] Example 26 includes the subject matter of any of Examples 1 to 25, and optionally wherein the first portion of the cz lens portion is configured to guide a light beam from the first portion of the cz display area to an eye rotation center corresponding to the pupil, wherein the second portion of the cz lens portion is configured to guide a light beam from the second portion of the cz display area to a point defined based on the position of the pupil at a direct gaze angle, wherein the xcz lens portion is configured to guide a light beam from the xcz display area to a point defined based on the position of the pupil at a nasal gaze angle, and wherein the first portion of the cz lens portion is between the xcz lens portion and the second portion of the cz lens portion.

[0551] Example 27 includes the subject matter of any of Examples 1 to 26, and optionally wherein the tz lens portion is configured to direct a light beam from the tz display area to a point defined based on the position of the pupil at the direct gaze angle, and wherein the xtz lens portion is configured to direct a light beam from the xtz display area to the eye rotation center corresponding to the pupil.

[0552] Example 28 includes the subject matter of Example 27, and optionally wherein the peripheral lens includes additional xtz lens portions configured to direct light beams from other xtz display areas of the peripheral display to a point defined based on the position of the pupil at a temporal gaze angle, and wherein the xtz lens portions are located between the xtz lens portions and the additional xtz lens portions.

[0553] Example 29 includes the subject matter of any of Examples 1 to 28, and optionally wherein the top and bottom portions of the central lens are configured to guide a light beam from the cz display area to a point defined based on the position of the pupil at the direct gaze angle, and wherein the middle portion of the central lens between the top and bottom portions of the central lens is configured to guide a light beam from the cz display area to the eye rotation center corresponding to the pupil.

[0554] Example 30 includes the subject of any of Examples 1 to 29, and optionally each of the central FoV and the temporal FoV includes a horizontal FoV of at least 45 degrees.

[0555] Example 31 includes the subject of any of Examples 1 to 30, and optionally each of the central FoV and the temporal FoV includes a horizontal FoV of at least 60 degrees.

[0556] Example 32 includes the subject of any of Examples 1 to 31, and optionally each of the central FoV and the temporal FoV includes a horizontal FoV of at least 70 degrees.

[0557] Example 33 includes the subject of any of Examples 1 to 32, and optionally each of the central FoV and the temporal FoV includes a horizontal FoV of at least 80 degrees.

[0558] Example 34 includes the subject of any of Examples 1 to 33, and optionally each of the central FoV and the temporal FoV includes a vertical FoV of at least 80 degrees.

[0559] Example 35 includes the subject matter of any of Examples 1 to 34, and optionally the central FoV and the temporal FoV are configured to form a continuous horizontal FoV of at least 130 degrees.

[0560] Example 36 includes the subject matter of any of Examples 1 to 35, and optionally the central FoV and the temporal FoV are configured to form a continuous horizontal FoV of at least 180 degrees.

[0561] Example 37 includes the subject matter of any of Examples 1 to 36, and optionally at least one of the central lens or the peripheral lens comprises a hybrid convex-concave lens that is convex in the display direction and concave in the eye direction, the hybrid convex-concave lens comprising a central freeform aspherical lens portion and a peripheral freeform Fresnel lens portion.

[0562] Example 38 includes the subject of Example 37, and optionally the hybrid convex-concave lens is formed of a material having a refractive index to Abbe number ratio of at least 0.03.

[0563] Example 39 includes the subject matter of any of Examples 1 to 38, and optionally includes: a first HMD for displaying a first image scene to the user's first pupil, the first HMD display including the central display, the central lens, the peripheral display and the peripheral lens; and a second HMD for displaying a second image scene to the user's second pupil, the second HMD display including other central displays, other central lenses, other peripheral displays and other peripheral lenses.

[0564] Example 40 includes a method for controlling an HMD device according to any one of Examples 1 to 39, the method comprising: causing a central display of the HMD to display a first image based on image information of an image scene; and causing a peripheral display of the HMD to display a second image based on the image information of the image scene.

[0565] Example 41 includes the subject matter of Example 40, and optionally includes displaying the first image on the central display as a cz portion of the first image that includes a first repeating portion of the image scene.

[0566] Example 42 includes the subject matter of Example 40 or 41, and optionally includes displaying the first image on the central display as an xcz portion of the first image that includes a second repeating portion of the image scene.

[0567] Example 43 includes the subject of any of Examples 40 to 42, and optionally includes displaying the second image on the peripheral display as a tz portion of the second image that includes the second repeating portion of the image scene.

[0568] Example 44 includes the subject of any of Examples 40 to 43, and optionally includes displaying the second image on the peripheral display as an xtz portion of the image scene that includes the first repeating portion of the image scene.

[0569] Example 45 includes an apparatus comprising components for performing any of the operations described in Examples 1 to 44.

[0570] Example 46 includes a product comprising one or more tangible computer-readable non-transitory storage media, the non-transitory storage media including computer-executable instructions operable to cause, when executed by at least one processor, the at least one processor to enable the HMD device to perform any of the operations described in Examples 1 to 44.

[0571] Example 47 includes a device comprising: a memory interface; and processing circuitry configured to perform any of the operations described in Examples 1 to 44.

[0572] Example 48 includes a method comprising any of the operations described in Examples 1 through 44.

[0573] The functions, operations, components and / or features described in this text with reference to one or more other aspects may be combined with, or used in conjunction with, one or more other functions, operations, components and / or features described herein with reference to one or more other aspects, or vice versa.

[0574] While certain features have been shown and described herein, many modifications, substitutions, alterations, and equivalents will be apparent to those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and alterations falling within the true spirit of this disclosure.

Claims

1. A head-mounted display (HMD) device, the HMD device comprising: A central display configured to display a first image in a central field of view based on an image scene to be displayed to a user's pupil, the central display comprising: a central cz display area for displaying the cz portion of the first image; and an extended central xcz display area for displaying the xcz portion of the first image, the extended central xcz display area being adjacent to the central cz display area; A central lens configured to direct light from the first image toward the user's pupil, the central lens including a cz lens portion and an xcz lens portion adjacent to the cz lens portion, the cz lens portion being configured to direct light from the cz portion of the first image toward the pupil under direct gaze, under nasal gaze, and under temporal gaze of the pupil, and the xcz lens portion being configured to direct light from the xcz portion of the first image toward the pupil under nasal gaze. A peripheral display configured to display a second image in a temporal field of view based on the image scene, the peripheral display comprising: a temporal lateral zone (tz) display area for displaying a tz portion of the second image; and an extended temporal lateral zone (xtz) display area for displaying an xtz portion of the second image, the extended temporal lateral zone (xtz) display area being adjacent to the temporal lateral zone (tz) display area; and A peripheral lens is configured to direct light from the second image toward the user's pupil. The peripheral lens is tilted relative to the central lens at a tilt angle. The peripheral lens includes a Tz lens portion and an xtz lens portion. The Tz lens portion is configured to direct light from the Tz portion of the second image toward the pupil under direct gaze, temporal gaze, and nasal gaze of the pupil. The xtz lens portion is configured to direct light from the xtz portion of the second image toward the pupil under temporal gaze of the pupil.

2. The head-mounted display (HMD) device of claim 1, wherein the HMD device is configured to provide a continuous nasal-side viewing field of view to the pupil under nasal-side viewing, the continuous nasal-side viewing field of view comprising light from the cz portion of a first image guided toward the pupil under nasal-side viewing by the cz lens portion, light from the xcz portion of the first image guided toward the pupil under nasal-side viewing by the xcz lens portion, and light from the tz portion of a second image guided toward the pupil under nasal-side viewing by the tz lens portion.

3. The head-mounted display (HMD) device of claim 1, wherein the HMD device is configured to provide a continuous temporal-side fixation field of view to the pupil under temporal-side fixation, the continuous temporal-side fixation field of view comprising light from the cz portion of a first image guided toward the pupil under temporal-side fixation by the cz lens portion, light from the xtz portion of a second image guided toward the pupil under temporal-side fixation by the xtz lens portion, and light from the tz portion of the second image guided toward the pupil under temporal-side fixation by the tz lens portion.

4. The head-mounted display (HMD) device of claim 1, wherein the HMD device includes a controller configured to cause the central display to display the first image based on image information of the image scene, and to cause the peripheral display to display the second image based on the image information of the image scene.

5. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to cause the central display to perform the following operations: displaying the cz portion of the first image that includes the first repeating portion of the image scene; as well as The xcz portion of the first image, which includes a second repeating portion of the image scene; and The peripheral display shall perform the following operations: The tz portion of the second image, which includes the second repeating portion of the image scene, and the xtz portion of the second image, which includes the first repeating portion of the image scene, are displayed.

6. The head-mounted display (HMD) device of claim 5, wherein the second repeating portion of the image scene covers a field of view of at least 5 degrees.

7. The head-mounted display (HMD) device of claim 5, wherein the first repeating portion of the image scene covers a field of view of at least 5 degrees.

8. The head-mounted display (HMD) device of claim 5, wherein the controller is configured to determine the size of at least one of the first repeating portion of the image scene or the second repeating portion of the image scene based on at least one of an exit pupil distance setting or a tilt angle of the head-mounted display (HMD) device.

9. The head-mounted display (HMD) device of claim 5, wherein the controller is configured to determine the size of the second repeating portion of the image scene based on the central lens-display distance between the central lens and the central display.

10. The head-mounted display (HMD) device of claim 5, wherein the controller is configured to determine the size of the first repeating portion of the image scene based on the peripheral lens-display distance between the peripheral lens and the peripheral display.

11. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to: The second image is generated by applying a first trapezoidal predistortion to a portion of the image scene to be displayed by the peripheral display, based on the recognition of direct gaze of the pupil; and The second image is generated by applying a second trapezoidal predistortion, which is different from the first trapezoidal predistortion, to the portion of the image scene to be displayed by the peripheral display, based on the recognition of indirect gaze of the pupil.

12. The head-mounted display (HMD) device of claim 11, wherein the controller is configured to determine, based on the recognition of the temporal gaze of the pupil, that the second trapezoidal predistortion is less than the first trapezoidal predistortion.

13. The head-mounted display (HMD) device of claim 11, wherein the controller is configured to determine that the second trapezoidal predistortion is greater than the first trapezoidal predistortion based on the recognition of the nasal gaze of the pupil.

14. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to determine predistortion based on at least one of the exit pupil distance setting of the head-mounted display (HMD), the tilt angle of the head-mounted display (HMD) device, or the interpupillary distance (IPD) of the user, and to apply the predistortion to at least one portion of the image scene, the at least one portion of the image scene including at least one of an image portion to be displayed by the central display or an image portion to be displayed by the peripheral display.

15. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to calibrate the color saturation of the first image relative to the color saturation of the second image based on one or more spectral properties of at least one of the central lens or the peripheral lens.

16. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to calibrate the spatial intensity of the first image relative to the spatial intensity of the second image based on one or more spectral properties of at least one of the central lens or the peripheral lens.

17. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to identify a tilt setting of the tilt angle of the peripheral lens relative to the central lens, and to determine, based on the tilt setting, a portion of the image scene to be displayed by the peripheral display.

18. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to monitor the gaze angle of the pupil and dynamically adjust the tilt angle of the peripheral lens relative to the central lens based on the gaze angle of the pupil.

19. The head-mounted display (HMD) device of claim 4, wherein the controller is configured to: Processing image information of the cornea above the pupil to identify a corneal reflection image, the corneal reflection image including a combination of a first image from the central display and a second image from the peripheral display; and Based on the corneal reflection image, at least one of the first image displayed by the central display or the second image displayed by the peripheral display is adjusted.

20. The head-mounted display (HMD) device of claim 19, wherein the head-mounted display (HMD) device is configured to: Simultaneously, the central display shows the first calibration image, and the peripheral displays show the second calibration image; The image information of the cornea is processed to identify a corneal reflection calibration image, the corneal reflection calibration image including a combination of the first calibration image and the second calibration image; as well as Based on the corneal reflection calibration image, adjust at least one of the first image displayed by the central display or the second image displayed by the peripheral display.

21. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein the head-mounted display (HMD) device includes a tilt angle adjuster to adjust the tilt angle of the peripheral lens relative to the central lens.

22. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein the central lens is spaced at least 1 millimeter (mm) apart from the peripheral lens.

23. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein the central lens is spaced at least 1 millimeter (mm) from the peripheral lens in a plane connecting the optical axis of the central lens and the peripheral lens.

24. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein the edge of the central lens is in direct contact with the edge of the peripheral lens.

25. The head-mounted display (HMD) device of any one of claims 1 to 20, wherein the peripheral display includes a further xtz display portion for displaying a further xtz portion of the second image, and the peripheral lens includes a further xtz lens portion configured to direct light of the further xtz portion of the second image toward the pupil under the temporal gaze of the pupil, and wherein the xtz lens portion is located between the xtz lens portion and the further xtz lens portion.

26. The head-mounted display (HMD) device as claimed in any one of claims 1 to 20, wherein a first portion of the cz lens portion is configured to guide a light beam from a first portion of the central cz display area to an eye rotation center corresponding to the pupil, wherein a second portion of the cz lens portion is configured to guide a light beam from a second portion of the central cz display area to a point defined based on the position of the pupil at a direct gaze angle, wherein an xcz lens portion is configured to guide a light beam from the extended central xcz display area to a point defined based on the position of the pupil at a nasal gaze angle, and wherein the first portion of the cz lens portion is between the xcz lens portion and the second portion of the cz lens portion.

27. The head-mounted display (HMD) device as claimed in any one of claims 1 to 20, wherein the tz lens portion is configured to direct a light beam from the temporal tz display area to a point defined based on the position of the pupil at the direct gaze angle, and wherein the xtz lens portion is configured to direct a light beam from the extended temporal xtz display area to an eye rotation center corresponding to the pupil.

28. The head-mounted display (HMD) device of claim 27, wherein the peripheral lens includes additional xtz lens portions configured to direct light beams from additional extended temporal xtz display areas of the peripheral display to a point defined based on the position of the pupil at a temporal gaze angle, and wherein the xtz lens portions are located between the xtz lens portions and the additional xtz lens portions.

29. The head-mounted display (HMD) device as claimed in any one of claims 1 to 20, wherein the top and bottom portions of the central lens are configured to guide a light beam from the central cz display area to a point defined based on the position of the pupil at the direct gaze angle, and wherein the intermediate portion of the central lens between the top and bottom portions of the central lens is configured to guide a light beam from the central cz display area to an eye rotation center corresponding to the pupil.

30. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein each of the central field of view and the temporal field of view comprises a horizontal field of view of at least 45 degrees.

31. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein each of the central field of view and the temporal field of view comprises a horizontal field of view of at least 60 degrees.

32. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein each of the central field of view and the temporal field of view comprises a horizontal field of view of at least 70 degrees.

33. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein each of the central field of view and the temporal field of view comprises a horizontal field of view of at least 80 degrees.

34. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein each of the central field of view and the temporal field of view comprises a vertical field of view of at least 80 degrees.

35. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein the central field of view and the temporal field of view are configured to form a continuous horizontal field of view of at least 130 degrees.

36. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein the central field of view and the temporal field of view are configured to form a continuous horizontal field of view of at least 180 degrees.

37. The head-mounted display (HMD) device according to any one of claims 1 to 20, wherein at least one of the central lens or the peripheral lenses comprises a hybrid convex-concave lens, the hybrid convex-concave lens being convex in the display direction and concave in the eye direction, the hybrid convex-concave lens comprising a central freeform aspherical lens portion and a peripheral freeform Fresnel lens portion.

38. The head-mounted display (HMD) device of claim 37, wherein the hybrid convex-concave lens is formed of a material having a refractive index to Abbe number ratio of at least 0.

03.

39. The head-mounted display (HMD) device as claimed in any one of claims 1 to 20, wherein the head-mounted display (HMD) device comprises: A first HMD, the first HMD being used to display a first image scene to the user's first pupil, the first HMD including the central display, the central lens, the peripheral display and the peripheral lens; as well as The second HMD is used to display a second image scene to the user's second pupil.

Images