Display system with interchangeable lens
The head-mounted display system with interchangeable lenses addresses the issue of accommodating different refractive errors by using magnetic and mechanical coupling mechanisms for precise alignment, allowing users to easily switch lenses for optimal image quality and comfort.
Patent Information
- Application Number
- JP2025112914
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2019-06-21
- Filing Date
- 2025-07-03
- Publication Date
- 2025-10-15
AI Technical Summary
Existing head-mounted displays do not adequately accommodate users with different refractive errors, requiring separate lenses for each user, which is inconvenient and inefficient.
A head-mounted display system with interchangeable lenses that can be easily attached and identified, allowing for customization based on individual eye characteristics, using magnetic and mechanical coupling mechanisms to ensure proper alignment and attachment.
Enables users to quickly switch between lenses with different prescriptions, ensuring optimal image quality and comfort by accurately aligning the lenses with the user's eyes, thus accommodating diverse refractive errors effectively.
Smart Images

Figure 2025157296000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to display systems, and more particularly to head-mounted display systems. [Background technology]
[0002] A head-mounted display (HMD) is a display device worn on a user's head and contains one or more display modules for displaying graphics to the user. Different users may have different refractive errors in their eyes, and therefore require different corrective lenses. Summary of the Invention
[0003] Disclosed herein are implementations of a display system. In one implementation, the display system includes a display, a detachable lens assembly, and a lens detection sensor. The detachable lens is detachably coupleable to the display. The lens detection sensor detects the detachable lens assembly coupled to the display. The display system may further include a head-mounted display unit including the display and the lens detection sensor. The display system may determine lens information from the detachable lens using the lens detection sensor and provide an indicator of the detachable lens according to the lens information.
[0004] In another implementation, a method for operating a head-mounted display unit is provided, the method including identifying a detachable lens coupled to a display module of the head-mounted display unit and providing an indicator according to the identification of the detachable lens. The indicator may be a configuration indicator that differs between the detachable lens and another detachable lens coupleable to the display module. The method may further include identifying a user, while the indicator may be an indicator of compatibility between the detachable lens and the user.
[0005] In another implementation, a display system includes a head-mounted display unit and a detachable lens assembly. The head-mounted display unit includes a display module. The detachable lens assembly includes a lens element and a frame coupled to the lens element. The detachable lens assembly may be detachable to the display module in a single orientation using a magnetic attachment mechanism coupled to the frame and surrounding the lens element. The detachable lens assembly may be detachably coupleable to the display module using an interference fit, for example, in which the detachable lens includes a flexible annular protrusion that axially receives a lens mount of the display module therein. The detachable lens assembly may be detachably coupleable to the display module using a spring-loaded latch mechanism.
[0006] In one implementation, a display system includes a head-mounted display unit and a detachable lens assembly. The head-mounted display unit includes a display module and a corresponding mechanical coupling mechanism. The detachable lens assembly includes a corrective lens element, a frame coupled to the corrective lens element, and a mechanical coupling mechanism coupled to the frame. The mechanical coupling mechanism is receivable by the corresponding mechanical coupling mechanism to detachably couple the detachable lens assembly to the head-mounted display unit.
[0007] The mechanical coupling mechanism engages with a corresponding mechanical coupling mechanism to prevent movement of the removable lens assembly relative to the head mounted display unit laterally relative to, along, and / or around the optical axis of the corrective lens element. The removable lens assembly may further include a magnetic coupling mechanism spaced apart from the mechanical coupling mechanism, whereby the removable lens assembly is magnetically coupleable to the head mounted display unit. The display module may include a lens mount including a corresponding mechanical coupling mechanism, and the removable lens assembly may be removably coupleable to the display module. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a side view of a display system with hidden components shown in dashed lines. [Figure 2] 2 is a cross-sectional view of the display system of FIG. 1 taken along line 2-2 of FIG. 1. [Figure 3A] 3 is a cross-sectional view of the display unit and interchangeable lens assembly of the display system of FIG. 1 taken along line 3-3 of FIG. 2 and shown assembled. [Figure 3B] 3B is a cross-sectional view of the display unit and interchangeable lens assembly of FIG. 3A shown in an exploded state. [Figure 4] 2 is a rear view of a removable lens of the display system of FIG. 1, with emission points, entry points, and exit points indicated by dashed lines (i.e., dash-dot lines). [Figure 5] FIG. 10 is a rear view of another embodiment of a removable lens. [Figure 6] FIG. 10 is a rear view of another embodiment of a removable lens. [Figure 7] FIG. 10 is a cross-sectional view of another embodiment of a removable lens. [Figure 8]FIG. 10 is a cross-sectional view of another embodiment of a removable lens. [Figure 9] FIG. 10 is a cross-sectional view of another embodiment of a removable lens. [Figure 10A] 1. FIG. 4 is a cross-sectional view of another display unit and another interchangeable lens assembly of the display system of FIG. 1 shown in an exploded state. [Figure 10B] FIG. 10B is a cross-sectional view of the display unit and interchangeable lens assembly of FIG. 10A shown in an assembled state. [Figure 11A] 1. FIG. 4 is a cross-sectional view of another display unit and another interchangeable lens assembly of the display system of FIG. 1 shown in an exploded state. [Figure 11B] FIG. 10B is a cross-sectional view of the display unit and interchangeable lens assembly of FIG. 10A shown in an assembled state. [Figure 12A] FIG. 1 is a side view of a display module for use in a display system. [Figure 12B] FIG. 1 is a front view of a display module for use in a display system. [Figure 12C] FIG. 1 is a front view of a display module for use in a display system. [Figure 12D] FIG. 1 is a front view of a display module for use in a display system. [Figure 13A] FIG. 1 is a front view of a display module for use in a display system. [Figure 13B] FIG. 13B is a front view of a removable lens assembly for use with the display module of FIG. 13A. [Figure 13C] 13A is a cross-sectional view of the display module of FIG. 13A taken along line 13A-13A. [Figure 13D] FIG. 13B is a cross-sectional view of the removable lens assembly of FIG. 13B taken along line 13B-13B. [Figure 13E]13B is a cross-sectional view of the display module of FIG. 13A and the detachable lens assembly of FIG. 13B in a partially joined state. [Figure 13F] 13B. FIG. 13C is a cross-sectional view of the display module of FIG. 13A and the detachable lens assembly of FIG. 13B in a combined state. [Figure 14A] FIG. 1 is a schematic diagram of a display system. [Figure 14B] 1 is a flowchart of a method for operating a display system. [Figure 15] 1 is a flow chart of a process for determining compatibility between a removable lens and a user. [Figure 16] 1 is a flow chart of a method for determining compatibility between a removable lens and a user. [Figure 17] FIG. 2 is a schematic diagram of an exemplary hardware configuration of a controller of a display system. DETAILED DESCRIPTION OF THE INVENTION
[0009] Disclosed herein are embodiments of a display system that includes a head-mounted display unit and one or more interchangeable lenses. The interchangeable lenses can be configured according to different eye characteristics (e.g., according to eyeglass prescriptions) of different users. For example, a pair of interchangeable lenses may be associated (e.g., prescribed) with one user, while another pair of interchangeable lenses may be associated with another user. The interchangeable lenses can be attached to the head-mounted display unit in an interchangeable manner such that different lenses can be attached to the head-mounted display unit to accommodate different users with different eye characteristics. The interchangeable lenses can be attached to the head-mounted display unit in a variety of different ways. The display system can also identify the interchangeable lenses attached to the head-mounted display unit and / or identify the user and perform various actions accordingly.
[0010] 1 and 2 , display system 100 generally includes a head-mounted display unit 110 and one or more removable lens assemblies 120. Head-mounted display unit 110 generally includes a housing 112, a head support 114, one or more display modules 116 (e.g., two, i.e., one for each eye), and various other electronics (e.g., a controller or computing device, a communications interface, audio input / output devices, sensors, a battery, or other power electronics; see also FIG. 12 ). Display system 100 is configured to provide computer-generated reality (e.g., virtual reality or mixed reality), in which case display system 100 can be considered a computer-generated reality system or display system, a virtual reality system or display system, or a mixed reality display system or system. The terms computer-generated reality, virtual reality, and mixed reality are discussed in further detail below.
[0011] The housing 112 contains or is otherwise coupled to one or more display modules 116 and other electronics. The housing 112 may also include various flexible components (not shown) coupled to engage and support the user's face thereon. The head support 114 is coupled to the housing 112 to support the head-mounted display unit 110 on the user's head with the one or more display modules 116 in a suitable position relative to the user's eyes. As shown, the head support 114 may be configured as a strap or band configured to extend around the user's head. The display module 116 is coupled to the housing 112 in a fixed position (as shown).
[0012] 3A-3B, the display module 116 generally includes a display 316a, a primary lens 316b, and a lens mount 316c. The display 316a is configured to display graphics to a user. The display 316a may be a display screen, such as a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or other suitable display. The display 316a may be coupled to a circuit board or other support.
[0013] The primary lens 316b is coupled to the display 316a. The primary lens 116b is positioned between the display 316a and the user's eyes and refracts light emitted from the display 316a before it reaches the user's eyes. The primary lens 316b may be omitted depending on the configuration of the display 316a and / or the removable lens assembly 120.
[0014] The lens mount 316c is configured to couple to and support the removable lens assembly 120 between the display 316a and the user's eyes (i.e., with the primary lens 316b between the display 316a and the removable lens assembly 120). As shown, the lens mount 316c may also couple to and support the primary lens 316b relative to the display 316a, such as by being coupled to a circuit board or other support for the display 316a. The lens mount 316c may surround the primary lens 316b (e.g., form a bezel or barrel structure for the primary lens 316b).
[0015] The removable lens assembly 120 generally includes a lens element 330 and a lens frame 340. The lens frame 340 is coupled to the lens element 330 and configured to removably couple to a lens mount 316c to support the lens element 330 in a predetermined position on the display module 116 (e.g., relative to the display 316a and / or primary lens 316b). The lens frame 340 is coupled, for example, to a periphery of the lens element 330. Variations of the lens mount 316c and their interaction with the lens frame 340 are discussed in more detail below. The removable lens assembly 120 may also be referred to as an interchangeable lens assembly, an interchangeable lens, a removable lens, or a lens.
[0016] The lens element 330 may be a corrective lens to address a refractive error of the user's eye, such as, for example, myopia, hyperopia, and / or astigmatism. The removable lens assembly 120 and the lens element 330 may be associated with a particular user by having specific lens characteristics to address the specific refractive error (e.g., eye characteristics) of the particular user's eye. Such lens characteristics and eye characteristics may each include sphere, cylinder, axis, and / or other parameters conventionally used to define an eyeglass prescription or refractive error of one or more users' eyes.
[0017] The lens properties of the lens element 330, and thereby the removable lens assembly 120, may also include a center (e.g., optical axis) that is aligned with the user's pupil. Accordingly, the removable lens assembly 120 can be attached to the lens mount 316c in predetermined positions (i.e., up / down, left / right, and rotational positions) to ensure proper spatial positioning of the lens element 330 relative to the user's eye.
[0018] Alternatively, lens elements 330 may be non-corrective lenses that protect primary lens 316b from contact by the user and / or debris that may otherwise interfere with the user's viewing of display 316a (e.g., scratching or obscuring the view). For example, one pair of removable lens assemblies 120 may include lens elements 330 that are corrective for use by a particular user, while another pair of removable lens assemblies 120 may include non-corrective lens elements 330 for use by other users (e.g., users who do not require corrective lenses).
[0019] 4-6, the periphery of the removable lens assembly 120 may have different shapes. As shown in FIG. 4, the removable lens assembly 120 has a periphery that is formed by the lens frame 340 and is elliptical (i.e., has curved left and right edges, as shown). Alternatively, the periphery may be circular (see lens frame 540 of lens assembly 520 in FIG. 5) or rectangular (see lens frame 640 of lens assembly 620 in FIG. 6). As discussed in more detail below, those lens assemblies having rotationally symmetric (e.g., oval, circular, rectangular, or other suitable shaped) peripheries may be further configured to couple to the lens mount 316c at different rotational positions about the optical axis of the lens element 330 for use with the display module 116. Alternatively, the removable lens assembly 120 may have a periphery that is rotationally asymmetric, such that the lens mount 316c is coupleable in only one position for use with the display module 116.
[0020] 3A and 4, light is emitted by display 316a, passes through primary lens 316b, and then passes through lens element 330 before reaching the user's eye. For example, light emitted from outer edge 360a of display 316a can generally follow external light path 360 (e.g., a ray trace) whereby the light emitted from display 316a is refracted by primary lens 316b and then refracted by lens element 330. External light path 360 passes through primary lens 316b and generally passes through passage location 360b. External light path 360 enters entrance side 330a of lens element 330 at entry point 360c and exits at exit side 330b of the light path at entry point 360c. As it travels through lens element 330 from entrance side 330a to exit side 330b, external light path 360 narrows, thereby focusing toward the user's eye.
[0021] Areas of lens element 330 outside of entry point 360c and exit point 360d (i.e., radially outward toward the ends of lens element 330) do not function to refract light toward the user's eye and may be considered non-functional (e.g., non-refractive). Such non-functional areas of lens element 330 may be removed and / or blocked by lens frame 340, thereby enabling different structural configurations of lens frame 340. As shown in FIG. 4, the functional area of lens element 330 may be smaller than the functional area of primary lens 316b (e.g., smaller in area, width, and / or height than functional passage locations 360b on entry side 330a at entry point 360c and / or exit side 330b at exit point 360d), as shown. As shown, the functional area of lens element 330 may be smaller than display 316a (e.g., smaller in area, width, and / or height than the emission of display 316a on entrance side 330a at entry point 360c and / or exit side 330b at exit point 360d). The functional area of primary lens 316b may be larger than display 316a (e.g., larger in area, width, and / or height than the emission area of display 316a), as shown. Additionally, the functional areas of primary lens 316b and lens element 330 may enable any eye camera 319 of head mounted display unit 110 (e.g., of display module 116) to observe the user's eye (e.g., light traveling in a direction opposite to that emitted by display 316a).
[0022] 3A-3B, the outer periphery of lens element 330 is coupled to, e.g., engaged by, and / or glued to, the inner periphery of lens frame 340. The outer periphery of lens element 330 and the inner periphery of lens frame 340 may have corresponding shapes that enable the coupling therebetween, such as being straight (e.g., having the same cross-sectional shape moving axially) or tapered (e.g., widening as moving toward display module 116). The outer periphery of lens element 330 may have approximately the same size (e.g., having approximately the same area, width, and / or height) as primary lens 316b that defines the non-functional region of lens element 330.
[0023] 7-9, as referenced above, the non-functional area of lens element 330 can be reduced with lens element 330 being smaller than primary lens 316b.
[0024] 7, removable lens assembly 720 is a variation of removable lens assembly 120 and generally includes a lens element 730 and a lens frame 740. Lens element 730 is a variation of lens element 330 that differs by being smaller, such as by being smaller (e.g., smaller area, width, and / or height) than primary lens 316b. Lens frame 740 is a variation of lens frame 340 that differs by extending further radially inward than lens frame 740, such as by having an inner periphery that is smaller (e.g., smaller area, width, and / or height) than primary lens 316b and / or lens mount 316c.
[0025] Referring to FIG. 8 , removable lens assembly 820 is a variation of removable lens assembly 120 and generally includes lens element 830 and lens frame 840. Lens element 830 is a variation of lens element 830 that differs by having sloped (e.g., tapered) ends at an angle or curvature that more closely matches the angle at which external light path 360 (e.g., angle of refraction) passes through lens element 830. For example, the outer periphery of lens element 830 may extend at an angle measured relative to the optical axis of the lens element that is greater than zero, e.g., 15-75 degrees, e.g., 30-60 degrees. The entrance and exit periphery edges of lens element 830 may be smaller (e.g., smaller in area, width, and / or height) than the periphery dimensions of primary lens 316b. The exit periphery edge of lens element 830 may be smaller than its entrance periphery edge (e.g., decreasing in size as you move away from primary lens 316b toward the user's eye). Lens frame 840 is a variation of lens frame 340 that extends further radially inward than lens frame 340, such as by having a smaller inner periphery than primary lens 316b on one or both of the entrance and exit sides of lens element 830. Lens frame 840 is coupled to the outer periphery of lens element 830 and may follow or otherwise accommodate the shape of the periphery of lens element 830 (e.g., with a matching slope or contour).
[0026] 9, removable lens assembly 920 is a variation of removable lens assembly 120 and generally includes a lens element 930 and a lens frame 940. Lens element 930 is a variation of lens element 330 that differs by having a non-functional region on the exit side (e.g., or other recess side) that is coupled to lens frame 940 and forms a front surface that may be planar surrounding the functional region of lens element 930. Lens frame 940 is a variation of lens frame 340 that is coupled to the front surface of exit side 930b of lens element 930 and protrudes inward from lens mount 316c.
[0027] 3-4, the lens mount 316c and the removable lens assembly 120 are cooperatively configured so that the removable lens assembly 120 can be removably coupled to the lens mount 316c supported thereby. As shown, the lens mount 316c and the removable lens assembly 120 each include a cooperative coupling mechanism 316d, 322. The cooperative coupling mechanisms 316d, 322 are magnetic and may be referred to as magnetic coupling mechanisms. The magnetic coupling mechanisms 316d, 322 are disposed at corresponding locations on the lens mount 316c and the lens frame 340 of the removable lens assembly 120 for the lens mount 316c to support the removable lens assembly 120 in one or more predetermined positions (i.e., vertically, laterally, and rotationally) that properly align the lens elements 330 with the user's eyes.
[0028] For each pair of corresponding magnetic coupling mechanisms 316d, 322, one may be a permanent magnet and the other may be an attractor element (e.g., an attractor plate made of a ferromagnetic material) or another suitably oriented permanent magnet. For example, the magnetic coupling mechanism 316d of the lens mount 316c may be an attractor plate, while the magnetic coupling mechanism 322 of the removable lens assembly 120 is a permanent magnet.
[0029] The magnetic coupling mechanisms 316d, 322 are provided in a suitable size, number, and location for the lens mount 316c to adequately support the removable lens assembly 120 during use, while still allowing a user to easily remove the removable lens assembly 120. For example, as shown, the lens mount 316c and removable lens assembly 120 may include approximately six pairs of magnetic coupling mechanisms 316d, 322.
[0030] The removable lens assembly 120 and lens mount 316c may be configured such that the removable lens assembly 120 is attached to the lens mount 316c in only one predetermined position. For example, the lens element 330 may have an optical axis that is eccentrically positioned relative to the lens mount 316c, thereby requiring the removable lens assembly 120 to be coupled to the lens mount 316c in one predetermined position. If the removable lens assembly 120 were instead coupled to the lens mount 316c in a different position rotated therefrom, the optical axis would be shifted relative to the lens mount 316c, and thereby shifted relative to the display 316a and the user's eyes, resulting in a decrease in the image quality perceived by the user.
[0031] The magnetic coupling features 316d, 322 may be configured to prevent incorrect positioning of the removable lens assembly 120 relative to the lens mount 316c. For example, as shown in FIG. 4, the magnetic coupling features 322 are shown in dashed lines in FIG. 4 (e.g., embedded, hidden, or otherwise coupled to the lens frame 340), and the magnetic coupling features 316d, 322 may be asymmetrically positioned and / or distributed to prevent alignment of corresponding pairs of magnetic coupling features 316d, 322, thereby preventing the removable lens assembly 120 from being coupled to the lens mount 316c in another position (e.g., rotated 180 degrees). Alternatively or additionally, the magnetic properties (e.g., orientation and whether they are attractor plates or permanent magnets) of the magnetic coupling features 316d, 322 may prevent magnetic coupling of those magnetic coupling features 316d that do not correspond to each other in another position (e.g., rotational orientation). For example, if the removable lens assembly 120 is rotated 180 degrees, aligned but non-corresponding magnetic coupling mechanisms 316d, 322 may not attract each other (e.g., two attractor plates) or may repel each other (e.g., permanent magnets with common poles positioned adjacent to each other).
[0032] The lens mount 316c and the removable lens assembly 120 may be further configured to mechanically prevent misalignment thereof. For example, the lens mount 316c and the removable lens assembly 120 may further include mechanical engagement features 316e, 324, respectively. The mechanical engagement features 316e, 324 mechanically engage with one another to ensure proper positioning and / or alignment between the lens mount 316c and the removable lens assembly 120. The mechanical engagement features 316e, 324 may further engage with one another to further prevent relative movement of the removable lens assembly 120 to the lens mount 316c (e.g., perpendicular to the optical axis and left and right, while the magnetic coupling features 316d, 322 prevent movement along the optical axis).
[0033] The mechanical engagement features 316e, 324 may be, for example, recesses and protrusions, and may be received by the recesses, or vice versa. If the removable lens assembly 120 is positioned in a different position relative to the lens mount 316c, the protrusions may instead engage another surface of the lens mount 316c, preventing the removable lens assembly 120 from mating therewith. Alternatively, opposing axially facing (e.g., mating) surfaces of the display module 116 (e.g., lens mount 316c) and the removable lens assembly 120 (e.g., lens frame 340) may have three-dimensional contours that prevent misalignment of the removable lens assembly 120 relative to the lens mount 316c.
[0034] Instead of having only one mounting position, the removable lens assembly 120 and lens mount 316c may be configured such that the removable lens assembly 120 is attached to the lens mount 316c in two or more positions. For example, the lens frame 340 and lens mount 316c, coupling mechanism, and / or mechanical alignment mechanism may be cooperatively configured such that the removable lens assembly 120 couples to the lens mount 316c in two or more (e.g., three or four) predetermined positions (e.g., bi-fold and rotationally symmetric) and does not couple to the lens mount 316c in any other positions.
[0035] 10A-11B, variations of the removable lens assembly 120 and lens mount 316c are configured to mechanically couple the removable lens assembly 120 to the lens mount 316c.
[0036] 10A-10B, the display module 1016 includes a lens mount 1016c to which a removable lens assembly 1020 is removably coupleable with a mating structure (e.g., forming an interference fit). The removable lens assembly 1020 includes a lens element 330 and a lens frame 1040, which may be coupled to one another and otherwise configured in the manner described above (see, e.g., FIGS. 3A-9). The lens frame 1040 includes a barrel 1042 having an annular protrusion 1044 (e.g., a lip or circumferential lip). The barrel 1042 extends axially rearward (e.g., of the lens element 330) while the annular protrusion 1044 projects radially inward therefrom. The lens frame 1040 may further define an annular recess 1046 (e.g., an unlabeled circumferential channel) extending radially outward from and disposed axially outward (i.e., away from the display 316a) of the annular protrusion 1044. The annular protrusion 1044 and the annular recess 1046 extend completely or substantially completely (e.g., 80% or more) circumferentially around the axis of the lens element 330.
[0037] The lens mount 1016c includes a barrel 1016d having an annular protrusion 1016e. The barrel 1016d extends axially forward, while the annular protrusion 1016e protrudes radially outward therefrom. The annular protrusion 1016e further defines an annular recess 1016f (e.g., a circumferential channel) disposed axially forward and extending radially inward therefrom. The thereby defined annular protrusion 1016e and annular recess 1016f extend entirely or substantially entirely circumferentially about the axis of the lens element 330.
[0038] The barrel 1042 of the lens frame 1040 is configured to receive the barrel 1016d of the lens mount 1016c therein so as to removably couple the removable lens assembly 1020 to the lens mount 1016c. The annular protrusion 1044 of the lens frame 1040 is received by and retained within the annular recess 1016f of the lens mount 1016c, while the annular protrusion 1016e of the lens mount 1016c is received by and retained within the annular recess 1046 of the lens frame 1040.
[0039] The inner periphery of the annular protrusion 1044 of the lens frame 1040 is smaller than the outer periphery of the annular protrusion 1016e of the lens mount 1016c, such that the axial surfaces of the annular protrusions 1044, 1016e radially overlap and axially engage one another to prevent unintentional separation of the removable lens assembly 1020 from the display module 1016. The annular protrusion 1044, as can the barrel 1042 of the lens frame 1040, is formed of a flexible material such as rubber or other polymer to allow the inner periphery of the annular protrusion 1044 to expand and stretch over the annular protrusion 1016e of the lens mount 1016c. The lens frame 1040 may be formed of or otherwise include a flexible material that forms the annular protrusion 1044, and may comprise a soft material that may incidentally contact or otherwise engage with a user's face. Alternatively, the barrel 1042 and / or the annular protrusion 1044 may form a bend. In yet a further alternative, the barrel 1042 and the annular protrusion 1044 of the removable lens assembly 1020 are rigid, while the barrel 1016d and / or the annular protrusion 1016e of the display module 1016 are flexible or form a bend.
[0040] Although the lens frame 1040 and lens mount 1016c are shown and described with the lens mount 1016c (e.g., the barrel 1016d and the annular protrusion 1016e) received within the lens frame 1040, the lens frame 1040 and lens mount 1016c may be arranged in the opposite manner with the lens frame 1040 receiving the lens mount 1016c.
[0041] 11A-11B, the display module 1116 includes a lens mount 1116c to which a removable lens assembly 1120 is removably coupled via a spring mechanism. The removable lens assembly 1120 includes a retractable latch 1122 (e.g., a latch member) that typically springs radially outward for reception within a corresponding receptacle 1116d of the lens mount 1116c. For example, the retractable latch 1122 extends axially rearward from the rear axial face of the lens frame 1140 and includes an inner end 1124 (e.g., a hooked or outwardly protruding end) extending radially outward therefrom. When the retractable latch 1122 is retracted (e.g., by a user pressing an exposed end of the protruding portion), the retractable latch 1122 is axially insertable into or removable from the corresponding receptacle 1116d in the forward axial face of the lens mount 1116c. The inner end of the retractable latch 1122 is received behind a lip 1116e of the receptacle 1116d. A spring (shown diagrammatically, without labeling) biases the retractable latch 1122 radially outward when released by a user so that the inner end of the retractable latch 1122 is disposed behind and engages the lip 1116e of the receptacle 1116d, retaining the removable lens assembly 1120 on the lens mount 1116c. Although the retractable latch 1122 has been shown and described as being part of the removable lens assembly 1120, the retractable latch may instead be included on the display module 1116 to releasably engage the removable lens assembly 1120 in a similar manner (e.g., engage a receptacle in the outer periphery of the lens frame 1140).
[0042] 12A-12B, in still further embodiments, variations of the removable lens assembly 120 may be coupled to the lens mount 1216c in other ways. For example, the removable lens assembly 1220 and the lens mount 1216c may include corresponding mating features 1222, 1223 (e.g., tabs and detents or protrusions) that allow the removable lens assembly 1220 to couple to the lens mount 1216c with one or more of an axial movement 1222a, a vertical movement 1222b, or a rotational movement 1222c. The axial movement 1222a, the vertical movement 1222b, or the rotational movement 1222c (e.g., a quarter turn) engages and couples the removable lens assembly 1220 to the lens mount 1216c via the corresponding mating features 1222, 1223.
[0043] 12C, the removable lens assembly 1220′ is coupled to the display unit 1216′ via friction or an interference fit. Specifically, the removable lens assembly 1220 includes a lens frame 1240′ that is received by a lens mount 1216c′ of the display unit 1216′ and is thereby held via friction (e.g., with the lens frame 1240′ compressed radially inward by the lens mount 1216c′).
[0044] 12D , the removable lens assembly 1220′ is coupled to the display unit 1216′ via retractable pins 1216d. For example, the display unit 1216′ includes a lens mount 1216c′ that receives a lens frame 1240′ of the removable lens assembly 1220′ therein, and retractable pins 1216d that selectively extend into corresponding recesses in the lens frame 1240′. For example, the pins 1216d′ may be spring biased radially inward to be received by the lens frame 1240′.
[0045] 13A-13F , in yet a further example, the removable lens assembly 1320 includes a mechanical coupling mechanism 1322 (e.g., a male component or protrusion), which may be referred to as a lens mechanical coupling mechanism 1322, while the display module 1310 includes a corresponding mechanical coupling mechanism 1312 (e.g., a female component, recess, or receptacle), which may be referred to as a display mechanical coupling mechanism 1312. The lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 mechanically mate with one another to mechanically couple the removable lens assembly 1320 to the display module 1310. For example, as discussed in further detail below, the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 can prevent movement of the removable lens assembly 1320 relative to the display module 1310 in a direction generally perpendicular to, generally parallel to, and / or about an optical axis of the removable lens assembly 1320.
[0046] The removable lens assembly 1320 may further include one or more magnetic coupling mechanisms 1324, which may be referred to as lens magnetic coupling mechanisms 1324, while the display module 1310 includes one or more corresponding magnetic coupling mechanisms 1314, which may be referred to as display magnetic coupling mechanisms 1314. The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 magnetically couple to one another to magnetically couple the removable lens assembly 1320 to the display module 1310. For example, as discussed in more detail below, the lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 can prevent movement of the removable lens assembly 1320 relative to the display module 1310 in a direction generally parallel to the optical axis of the removable lens assembly 1320.
[0047] The lens mechanical coupling mechanism 1322 of the removable lens assembly 1320 may be disposed on a first side thereof (e.g., left side, right side, upper side, lower side, inner side, or outer side), while one or more lens magnetic coupling mechanisms 1324 may be disposed on a second side thereof (e.g., right side, left side, lower side, upper side, outer side, or inner side, respectively), which may be spaced apart and / or opposite the first side. The lens mechanical coupling mechanism 1322 may be formed by (e.g., integrally formed with) the lens frame 340, while the one or more lens magnetic coupling mechanisms 1324 are coupled to the lens frame 340. The lens magnetic coupling mechanism 1324 may be or include one or more permanent magnets and / or attractor materials (e.g., ferromagnetic materials or components).
[0048] The display module 1310 includes a lens mount 1311 having a lens mechanical coupling mechanism 1322 and one or more lens magnetic coupling mechanisms 1324. As discussed in further detail below, the display mechanical coupling mechanism 1312 of the lens mount 1311 is configured to receive the lens mechanical coupling mechanism 1322 therein. The one or more display magnetic coupling mechanisms 1314 of the lens mount 1311 magnetically couple to the lens magnetic coupling mechanism 1324 (e.g., permanent magnets of opposite polarity or attractor materials).
[0049] As described above, the lens mechanical coupling mechanism 1322 of the removable lens assembly 1320 and the display mechanical coupling mechanism 1312 of the display module 1310 are configured to mate with one another, and in particular, the lens mechanical coupling mechanism 1322 is configured to be received by the display mechanical coupling mechanism 1312. Once received thereby, the lens mechanical coupling mechanism 1322 engages with the display mechanical coupling mechanism 1312 to prevent relative movement therebetween. For example, the lens mechanical coupling mechanism 1322 engages with the display mechanical coupling mechanism 1312 to prevent relative shear movement between the removable lens assembly 1320 and the display module 1310, such as upward movement (e.g., in a direction generally perpendicular to the optical axis of the removable lens assembly 1320), lateral movement, and / or rotational movement of the removable lens assembly 1320 relative to the display module 1310 (e.g., generally about the optical axis of the removable lens assembly 1320).
[0050] To prevent relative upward movement, the upward-facing surface of the lens mechanical coupling mechanism 1322 engages with the downward-facing surface of the display mechanical coupling mechanism 1312. To prevent relative downward movement, the downward-facing surface of the lens mechanical coupling mechanism 1322 engages with the upward-facing surface of the display mechanical coupling mechanism 1312. For example, the top and bottom ends of the lens mechanical coupling mechanism 1322 engage with the top and bottom ends, respectively, of the display mechanical coupling mechanism 1312 (see FIGS. 13A and 13B). Alternatively, the upward-facing and downward-facing surfaces at mid-heights of the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 engage with each other to prevent relative upward and downward movement.
[0051] To prevent relative lateral outward movement (e.g., away from the user's nose), the laterally outward facing surface of the lens mechanical coupling mechanism 1322 engages with the laterally inward facing surface of the display mechanical coupling mechanism 1312 (e.g., the left-facing surface and the right-facing surface, respectively, for the left removable lens assembly 1320). To prevent relative lateral inward movement (e.g., towards the user's nose), the laterally inward facing surface of the lens mechanical coupling mechanism 1322 engages with the laterally outward facing surface of the display mechanical coupling mechanism 1312 (e.g., the right-facing surface and the left-facing surface, respectively, for the left removable lens assembly 1320), as shown in FIG. For example, as shown, the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 have curved shapes, and the outward and inward facing sides (e.g., concave and convex surfaces) of the lens mechanical coupling mechanism 1322 engage with the respective outward and inward facing sides (e.g., convex and concave surfaces, respectively) of the display mechanical coupling mechanism 1312.
[0052] To prevent relative rotational movement, the lens mechanical coupling mechanism 1322 is at spaced locations on both sides (e.g., two on each side) and engages the display mechanical coupling mechanism 1312 on both sides. For example, when a clockwise torque is applied to the removable lens assembly 1320, the upper inner and lower outer surfaces of the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 engage with each other to inhibit (e.g., prevent) relative clockwise rotation therebetween. When a counterclockwise torque is applied to the removable lens assembly 1320, the upper outer and lower inner surfaces of the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 engage with each other to inhibit (e.g., prevent) relative counterclockwise rotation therebetween.
[0053] The lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 may be further configured to prevent vertical movement (e.g., generally in the direction of the optical axis) away from the display module 1310. For example, the display mechanical coupling mechanism 1312 may include a forward-facing surface (e.g., an undercut or toe-in feature) that engages with a rear-facing surface of the lens mechanical coupling mechanism 1322.
[0054] Referring to FIG. 13E, to couple the removable lens assembly 1320 to the display module 1310, the lens mechanical coupling mechanism 1322 is first inserted into the display mechanical coupling mechanism 1312, and then the removable lens assembly 1320 is rotated to bring the magnetic coupling mechanisms 1324, 1314 closer to each other and magnetically couple them, as discussed in further detail below.
[0055] As described above, the lens magnetic coupling mechanism 1324 of the removable lens assembly 1320 and the display magnetic coupling mechanism 1314 of the display module 1310 are magnetically coupled to each other. The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 are arranged in corresponding positions and with corresponding magnetic properties (e.g., opposite polarity, or one being a ferromagnetic material and the other being permanently magnetic). The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 are magnetically coupled to each other with a force applied therebetween generally in the direction of the optical axis. The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 are also spaced apart from the pivot axis defined by the display mechanical coupling mechanism 1312, such that the magnetic coupling therebetween prevents rotation about the pivot axis defined by the display mechanical coupling mechanism 1312. For example, as shown, lens magnetic coupling mechanism 1324 and display magnetic coupling mechanism 1314 are positioned generally opposite lens mechanical coupling mechanism 1322 and display mechanical coupling mechanism 1312, respectively.
[0056] Variations of the removable lens assembly 1320 and the display module 1310 are contemplated. For example, the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 may be different shapes (e.g., straight), may include different numbers (e.g., two or more sets of pins and openings, etc., spaced apart to prevent movement as described above), and / or may be located in different positions (e.g., above, below, or inside thereof). Furthermore, the display mechanical coupling mechanism 1312 may be provided by a different portion of the head mounted display unit 110, such as the housing 112 (e.g., a curtain or other structure surrounding the display module 1310). Furthermore, instead of magnetic coupling mechanisms 1324, 1314, the removable lens assembly 1320 and the display module 1310 may instead or in addition include mechanical coupling mechanisms (e.g., mating structures or latches as described above).
[0057] It should be noted that for each of the methods for coupling described above with respect to Figures 3A-3B and Figures 10A-13F, the lens mount can be coupled to another part of the head-mounted display unit 110, such as the housing 112 (e.g., chassis), as opposed to the display module 116 or a variation thereof.
[0058] 14A-16 , display system 100 and removable lens assemblies 120 are cooperatively configured with respect to display system 100 to detect removable lens assemblies 120 coupled to head-mounted display unit 110. For example, head-mounted display unit 110 includes one or more lens detection sensors 1418a for detecting one or more removable lens assemblies 120 coupled thereto. In detecting the removable lens assemblies 120, display system 100 can determine whether any of the removable lens assemblies 120 are coupled to display module 116 (e.g., using proximity sensors, image recognition, and / or mechanical switches), determine whether the removable lens assemblies 120 are properly coupled (e.g., using proximity sensors, image recognition, or Hall sensors with magnets coupled to the removable lens assemblies 120), and / or determine other information about the removable lens assemblies 120 to support other functions (e.g., presence or absence of correction, serial or model number, associated user, and / or lens characteristics using other types of lens detection sensors 1418a discussed below). The display system 100 may provide an indication of whether the removable lens assembly 120 is coupled to the display module 116, an indication of whether the removable lens assembly 120 is properly positioned relative to the display module 116, and / or other indications (e.g., lens configuration and / or lens compatibility, discussed below).
[0059] Each removable lens assembly 120 may further include a lens tag 1428 in communication with or otherwise readable by one or more lens detection sensors 1418a. Detection of a removable lens assembly 120 may cause the display system 100 to perform one or more subsequent actions, which may include altering the output of the display module 116, providing an indicator of the removable lens assembly 120, and / or providing an indicator of compatibility of the removable lens assembly 120 with a user. The display system also includes a controller 1450 that controls operation of the head-mounted display unit 110, e.g., to detect a removable lens assembly 120 coupled thereto and / or perform subsequent actions accordingly. The controller 1450 may be physically incorporated in whole or in part within the head-mounted display unit 110 (as indicated by the dashed line) or may be provided physically separate therefrom (e.g., in an external computing device). An exemplary hardware configuration of the controller 1450 is described below with reference to FIG. 14 .
[0060] Upon detecting the removable lens assembly 120, the display system 100 can identify or determine information about the removable lens assembly 120, which may be referred to as lens information. The lens information may include an identifier and / or technical characteristics of the removable lens assembly 120. The identifier may be the removable lens assembly 120 itself (e.g., a serial number or model number, referred to as a lens identifier), a user associated with the lens (e.g., a username or user ID, referred to as an associated user identifier), and / or other identifying information (e.g., a manufacturer, date, referred to as manufacturing information). The technical characteristics may include refractive characteristics such as spherical, cylindrical, and / or axis parameters and / or optical axis position of the removable lens assembly 120, which may be referred to as lens characteristics, lens characteristic information, or prescription information. The lens information determined by the display system 100 can then be used by the display system 100 to perform subsequent operations referenced above and described in further detail below.
[0061] Display system 100 can determine lens information for removable lens assemblies 120 actively coupled (e.g., coupled or currently coupled) to head-mounted display unit 110 in a variety of different ways and using different devices. Display system 100 can determine lens information from removable lens assemblies 120, such as with lens detection sensor 1418a from lens tag 1428. In a first example, lens tag 1428 is an electronic device that stores or otherwise electronically provides lens information. For example, lens tag 1428 for each removable lens assembly 120 may be an electrically-erasable programmable read-only memory device (EEPROM), a radio frequency identification device (RFID), or an internal resistive device (e.g., an electrical resistance or resistor). The lens detection sensor 1418a is a corresponding electrical device or system configured to receive and / or otherwise receive lens information from the lens tag 1428, such as by wirelessly or physically communicating with an EEPROM, reading signals from an RFID and / or measuring or otherwise determining the resistance signature of a resistive device.
[0062] In a second example, the lens tag 1428 has a magnetic signature. The removable lens assembly 120 includes various magnets (e.g., magnetic coupling mechanism 322) or other magnets, which may have various strengths and / or positions to provide the magnetic signature, and are detected by the lens detection sensor 1418a, which may include one or more Hall sensors or other magnetic sensors that sense the magnetic fields of the magnets. The combination of the magnetic fields detected by the lens detection sensor 1418a provides lens information (e.g., a lens identifier for a particular magnetic signature). The Hall sensors may alternatively or additionally be used to determine whether the removable lens assembly 120 is properly coupled.
[0063] In a third embodiment, the lens tag 1428 is an optical marking that displays or otherwise communicates lens information. For example, the lens tag 1428 may be an optical or infrared (IR) marking on the removable lens assembly 120, such as a quick response code (QR code), a barcode, or alphanumeric characters. The lens detection sensor 1418a of the head-mounted display unit 110 is a corresponding optical reading device, such as a camera or a combined illuminator / sensor device (e.g., a QR code scanner), which may be the aforementioned eye camera 319 that also observes the eye. In one particular embodiment, the lens tag 1428 is an infrared barcode.
[0064] Display system 100 can determine the lens information needed for one or more further operations directly from removable lens assembly 120 itself. Alternatively, or in addition, display system 100 may determine additional lens information from other light sources to perform subsequent operations. For example, display system 100 may receive only initial lens information (e.g., a lens identifier or an associated user identifier) from removable lens assembly 120, while other lens information (e.g., an associated user identifier and / or lens characteristics) is stored in association therewith by display system 100 (e.g., by storage of controller 1450). Thus, by determining the initial lens information from removable lens assembly 120, display system 100 can determine (e.g., obtain) other lens information to support subsequent operations.
[0065] The lens information of the removable lens assembly 120 coupled to the display module 116 may be used to control various functions of the display system 100, which may include operating the display 316a, providing an indication to a user of the removable lens assembly 120 coupled thereto, and / or determining compatibility with a user of the removable lens assembly 120. The operation of the display 316a may be performed according to the lens information of the removable lens assembly 120 coupled to the display module 116, whereby the operation of the display 316a may differ between one of the removable lens assemblies 120 having one set of lens characteristics and another of the removable lens assemblies 120 having a different set of lens characteristics (e.g., different characteristics of the optical system formed by the primary lens 316b and the lens elements 330, or different brightness and / or pixel output accounting for the different lens characteristics).
[0066] Alternatively or additionally, lens information of a removable lens assembly 120 coupled to the display module 116 can be used to provide an indicator, which may be referred to as a lens configuration indicator, to a user or potential user of the removable lens assembly 120 coupled thereto. The lens configuration indicators may vary between different ones of the removable lens assemblies 120, for example, those removable lens assemblies 120 associated with different users. A first lens configuration indicator may be provided for one of the removable lens assemblies 120 (or a pair of removable lens assemblies 120 associated with each other), while a second, different lens configuration indicator is provided for another removable lens assembly 120 (or another pair of removable lens assemblies 120 associated with each other). Display indicators (e.g., or output instructions) may be stored, for example, by the display system 100, in association with the lens information (e.g., a lens identifier, an associated user identifier, or lens characteristics) and retrieved when determining the lens identifier. The configuration indicators may be provided independently of the user (e.g., without detecting or identifying the user).
[0067] The lens configuration indicators may be provided, for example, as external light indicators, display indicators, or audible indicators. The external light indicators include external visual indicators 1418b (e.g., light-emitting diodes) on the head-mounted display unit 110 that are visible to a potential user before wearing the head-mounted display unit 110 and may differ, for example, by color (e.g., red versus blue to distinguish between a first user and a second user). The display indicators are provided by the display 316a and are visible to a user or potential user through the removable lens assembly 120. The display indicators may be, for example, different colors, symbols, or sets of letters for different users, and are distinguishable even to potential users with poor eyesight (e.g., for whom the removable lens assembly 120 may cause the display 316a to appear blurry). The audible indicators are provided by an audio output device 1418c of or associated with the head-mounted display unit 110 (e.g., speakers or headphones) and may be audible to a potential user before or after wearing the head-mounted display unit 110. The audible indicator may be, for example, a spoken word (eg, identifying the user associated with the removable lens assembly 120 ) or a tone for different users associated with the removable lens assembly 120 .
[0068] 14A and 14B , a method 1400 is provided for indicating a lens configuration, the method generally including a first operation 1410 of identifying a removable lens assembly 120 coupled to a display module 116, a second operation 1420 of obtaining configuration indicator instructions, and a third operation 1430 of providing a configuration indicator in accordance with the instructions. The first operation 1410 of identifying an interchangeable lens assembly is performed using a lens detection sensor 1418a, and a controller 1450 determines lens information from lens tags 1428 of one or more removable lens assemblies 120 coupled to one or more display modules 116 of the head-mounted display unit 110. The second operation 1420 of obtaining configuration indicator instructions is performed, for example, by the controller 1450 retrieving instructions associated with the lens information from a storage device. The third operation 1430 of providing a configuration indicator is provided, for example, by the display module 116, an external visual indicator 1418b, and / or an audio output device 1418c operated by the controller 1450.
[0069] 14A-16, alternatively or additionally, display system 100 uses lens information of detachable lens assembly 120 coupled thereto to determine compatibility with the user and provide a compatibility indicator to the user accordingly (e.g., only incompatibility is determined). In addition to determining lens information of detachable lens assembly 120 coupled to head-mounted display unit 110, display system 100 identifies the current user and compares user information with the lens information to determine compatibility.
[0070] Display system 100 can identify a user in various ways, for example, using biometric sensing, receiving user credentials, and / or authentication by another device. To identify a user via biometrics, display system 100 may include biometric sensor 1418d for identifying the user via biometrics (e.g., facial recognition, fingerprint recognition, voice recognition, iris recognition, and / or recognition of other biometric parameters such as ear geometry, bone conduction or density characteristics, forehead features, or skin). Biometric sensor 1418d may be physically coupled to the head-mounted display unit, for example. For example, if the user is identified via iris detection, biometric sensor 1418d may be the eye camera 319 described above or the same sensor for identifying removable lens assembly 120. To identify a user via user credentials, display system 100 receives user credentials (e.g., username and password) from an input device of or associated with display system 100 (e.g., a microphone on the head-mounted display unit, or an external device 1460 in communication with controller 1450 or head-mounted display unit 110). To identify a user through authentication from another device, external device 1460 can authenticate the user (e.g., via biometrics or credentials) and communicate such authentication to controller 1450. External device 1460 may be considered part of display system 100, but may also function independently therefrom (e.g., a smartphone).
[0071] Display system 100 stores or otherwise receives user information, which may include a user identifier (e.g., a username or user number) stored in association with an associated lens identifier (e.g., serial number or model number of one or more removable lens assemblies 120 associated with the user) and / or eye characteristic information (e.g., spherical, cylindrical, and / or axial parameters, referred to herein as eye characteristics).
[0072] Display system 100 may receive user information during an initialization process where the user information is associated with lens information. During the initialization process, the user information may be entered by a user or may be received from another source (e.g., external device 1460). The lens information may be obtained from removable lens assembly 120 (e.g., electronically and / or optically) when coupled to display module 116, as described above, or may be entered by a user (e.g., entering the serial or model number of removable lens assembly 120), or may be received from another source (e.g., external device 1460).
[0073] 15 , to determine compatibility, the display system 100 may, for example, use a compatibility determiner 1500 to compare lens information 1510 with user information 1520, or, for example, one or more of: (a) comparing lens information 1510 for lens identifier 1512 with user information 1520 for associated lens identifier 1522, (b) comparing lens information 1510 for associated user identifier 1514 with user information 1520 for user identifier 1524, or (c) comparing lens information 1510 for lens characteristics 1516 with user information 1520 for eye characteristics 1526. The display system 100 may determine one or more removable lens assemblies 120 as compatible if the lens information matches (e.g., is equal to) the user information, or as incompatible if it does not match.
[0074] If compatibility is determined, the compatibility indicator may provide a positive indication (e.g., that the removable lens assembly 120 is compatible with the user) or may be omitted (e.g., proceed to normal operation). If compatibility is determined to be incompatible, the compatibility indicator will be negative (e.g., indicating that the removable lens assembly 120 is incompatible with the user). Such negative indicators may include, for example, an icon graphically indicating incompatibility, textual instructions or information, and / or audible instructions or information.
[0075] 16 , a method 1600 for operating the display system 100 to determine and indicate compatibility of a removable lens assembly 120 with a user is provided. The method includes a first operation 1610 of identifying one or more removable lens assemblies 120 coupled to one or more display modules 116, a second operation 1620 of identifying the user, a third operation 1630 of comparing lens information with user information, and a fourth operation 1640 of indicating compatibility. The first operation 1610 of identifying the one or more removable lens assemblies 120 may be performed by one or more lens detection sensors 1418a in cooperation with the controller 1450. The first operation 1610 may also include determining lens information. The second operation 1620 of identifying the user may be performed biometrically (e.g., by a biometric sensor 1418d in cooperation with the controller 1450) by receiving credentials from the user and / or by user authentication with an external device 1460. The second operation 1620 may also include determining user information. A third operation 1630 of determining lens suitability is performed, for example, by the suitability determiner 1500 using the controller 1450, by comparing the lens information with the user information. A fourth operation 1640 of indicating suitability is performed, for example, using the head-mounted display unit 110 operated by the controller 1450. If there is suitability, a positive indication is provided, which may be normal operation of the display system 100. If there is no suitability, a negative indication is provided (e.g., by the head-mounted display unit 110 operated by the controller 1450) reflecting incompatibility.
[0076] 17, an exemplary hardware configuration of the controller 1450 is shown. The controller 1450 may generally include a processing device 1710 (e.g., a processor or CPU), a memory 1720 (e.g., a volatile short-term memory such as a random access memory module), a storage device 1730 (e.g., a long-term storage device such as a hard disk or solid-state drive), a communication interface 1740 through which the controller sends and receives signals to and from other components (e.g., the display module 116 and various sensors), and a bus 1750 through which other components of the controller 1450 communicate with each other. The controller 1450 may be physically connected to the head-mounted display unit 110 or may otherwise communicate with it. The display system 100 may include additional controllers 1450 or components thereof. The controller 1450 may include software programming (e.g., stored by the storage device 1730) including instructions executable by the processing device 1710 to perform the methods and operations described herein.
[0077] The physical environment refers to the physical world that people can sense and / or interact with without the aid of electronic systems. A physical environment, such as a physical park, includes physical objects such as physical trees, physical buildings, and physical people. People can directly sense and / or interact with the physical environment through their senses, such as sight, touch, hearing, taste, and smell.
[0078] In contrast, a computer-generated reality (CGR) environment refers to a wholly or partially simulated environment that people sense and / or interact with via electronic systems. In a CGR, a subset of a person's physical movements or representations thereof are tracked, and one or more properties of one or more virtual objects simulated within the CGR environment are adjusted accordingly to behave according to at least one law of physics. For example, a CGR system may detect a person's head rotation and adjust the graphical content and sound field presented to the person accordingly, in a manner similar to how such views and sounds may change in a physical environment. In some circumstances (e.g., for accessibility reasons), adjustments to the property(ies) of a virtual object(s) in a CGR environment may be made in response to representations of physical movements (e.g., voice commands).
[0079] A person may sense and / or interact with a CGR object using any one of these senses, including sight, hearing, touch, taste, and smell. For example, a person may sense and / or interact with an audio object that creates a 3D or spatially expansive audio environment that provides the perception of a point sound source in 3D space. In another example, an audio object may enable audio transparency, selectively incorporating ambient sounds from the physical environment with or without computer-generated audio. In some CGR environments, a person may sense and / or interact with only the audio object.
[0080] Examples of CGR include virtual reality and mixed reality.
[0081] A virtual reality (VR) environment refers to a simulated environment designed to be based entirely on computer-generated sensory input for one or more senses. A VR environment includes multiple virtual objects that a person can sense and / or interact with. For example, computer-generated images of trees, buildings, and avatars representing people are examples of virtual objects. A person can sense and / or interact with virtual objects in a VR environment through a simulation of the person's presence in the computer-generated environment and / or through a simulation of a subset of the person's physical movements in the computer-generated environment.
[0082] In contrast to VR environments, which are designed to be based entirely on computer-generated sensory input, mixed reality (MR) environments refer to simulated environments that are designed to incorporate sensory input from, or representations of, the physical environment in addition to including computer-generated sensory input (e.g., virtual objects). On the virtuality continuum, real environments lie somewhere between, but not including, a fully physical environment at one end and a virtual reality environment at the other.
[0083] In some MR environments, computer-generated sensory inputs may respond to changes in sensory inputs from the physical environment. Also, some electronic systems for presenting MR environments can track the location and / or orientation of virtual objects relative to the physical environment to allow them to interact with real objects (i.e., physical items or representations thereof from the physical environment). For example, the system can account for movement so that a virtual tree appears stationary relative to the physical ground.
[0084] Examples of mixed reality include augmented reality and augmented virtuality.
[0085] An augmented reality (AR) environment refers to a simulated environment in which one or more virtual objects are overlaid on a physical environment or a representation thereof. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person can directly view the physical environment. The system may be configured to present virtual objects on the transparent or translucent display, whereby a person uses the system to perceive the virtual objects overlaid on the physical environment. Alternatively, the system may have an opaque display and one or more imaging sensors that capture images or videos of the physical environment, which are representations of the physical environment. The system composites the images or videos with the virtual objects and presents the composite on the opaque display. A person uses the system to indirectly view the physical environment through the images or videos of the physical environment and perceive the virtual objects overlaid on the physical environment. As used herein, video of a physical environment shown on an opaque display is referred to as “pass-through video,” meaning that the system captures images of the physical environment using one or more imaging sensors and uses those images in presenting the AR environment on the opaque display. Further alternatively, the system may include a projection system that projects virtual objects into the physical environment, for example as holograms or onto physical surfaces, so that a person using the system perceives the virtual objects as overlaid on the physical environment.
[0086] Augmented reality environments also refer to simulated environments in which a representation of a physical environment is transformed by computer-generated sensory information. For example, in providing pass-through video, a system may transform one or more sensor images to be imposed with a selected perspective (e.g., viewpoint) that differs from the perspective captured by the imaging sensor. As another example, a representation of a physical environment may be transformed by graphically altering (e.g., magnifying) a portion thereof, thereby rendering the altered portion a representative but non-photorealistic version of the originally captured image. As a further example, a representation of a physical environment may be transformed by graphically removing or obscuring a portion thereof.
[0087] An augmented virtuality (AV) environment refers to a simulated environment in which the virtual or computer-generated environment incorporates one or more sensory inputs from the physical environment. The sensory inputs may be representations of one or more characteristics of the physical environment. For example, an AV park may have virtual trees and virtual buildings, while people with faces are realistically recreated from images of physical people. As another example, virtual objects may adopt the shape or color of physical items imaged by one or more imaging sensors. As a further example, virtual objects may adopt shadows that match the position of the sun in the physical environment.
[0088] A wide variety of electronic systems exist that allow humans to sense and / or interact with various CGR environments. Examples include head-mounted systems, projection-based systems, heads-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses designed to be placed over a person's eyes (e.g., similar to contact lenses), headphones / earphones, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablets, and desktop / laptop computers. A head-mounted system may have one or more speaker(s) and an integrated opaque display. Alternatively, a head-mounted system may be configured to accept an external opaque display (e.g., a smartphone). A head-mounted system may incorporate one or more imaging sensors for capturing images or video of the physical environment and / or one or more microphones for capturing audio of the physical environment. Rather than an opaque display, a head-mounted system may have a transparent or translucent display. A transparent or translucent display may have a medium through which light representing an image is directed to a person's eye. The display may utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser-scanned light source, or any combination of these technologies. The medium may be a light guide, a holographic medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to be selectively opaque. A projection-based system may employ retinal projection technology that projects a graphic image onto a person's retina. A projection system may also be configured to project virtual objects into a physical environment, for example, as a hologram or onto a physical surface.
[0089] As mentioned above, one aspect of the present technology is to collect and use data available from various sources to accommodate different corrective lenses for different users in a head-mounted display unit. This disclosure contemplates that, in some examples, this collected data may include personal information data that uniquely identifies a particular person or that can be used to contact or locate a particular person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, Twitter IDs, home addresses, data or records regarding a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), birth date, or any other identifying or personal information.
[0090] This disclosure recognizes that the use of such personal information data in the present technology can be for the benefit of the user. For example, personal information data can be used to accommodate different corrective lenses for different users in a head-mounted display unit. Additionally, other uses of personal information data that benefit the user are also contemplated by this disclosure. For example, health and fitness data can be used to provide insight into the user's overall wellness, or can be used as proactive feedback to individuals using the technology to pursue wellness goals.
[0091] This disclosure contemplates that entities involved in the collection, analysis, disclosure, transmission, storage, or other use of such personal information data adhere to robust privacy policies and / or privacy practices. Specifically, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or government requirements for maintaining the strict confidentiality of personal information data. Such policies should be easily accessible to users and should be updated as data collection and / or use changes. Personal information from users should be collected for the entity's lawful and legitimate use and should not be shared or sold except for those lawful uses. Furthermore, such collection / sharing should be carried out after the user's informed consent is obtained. Furthermore, such entities should consider taking all necessary measures to protect and secure access to such personal information data and to ensure that others with access to that personal information data comply with their privacy policies and procedures. Furthermore, such entities may be able to undergo third-party assessments to attest to their adherence to widely accepted privacy policies and practices. Furthermore, policies and practices should be tailored to the specific types of personal data collected and / or accessed and should comply with applicable laws and standards, including jurisdiction-specific considerations. For example, in the United States, the collection of or access to certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA), while health data in other countries may be subject to other regulations and policies and should be addressed accordingly. Therefore, different privacy practices should be maintained for different types of personal data in each country.
[0092] Notwithstanding the foregoing, the present disclosure also contemplates embodiments in which a user selectively blocks use of or access to personal information data. That is, the present disclosure contemplates that hardware and / or software elements may be provided to prevent or block access to such personal information data. For example, if a head-mounted display unit is provided with or accommodates corrective lenses, the present disclosure may be configured to allow a user to choose to “opt in” or “opt out” of participating in the collection of personal information data during service registration or at any time thereafter. In another example, a user may choose not to provide personal information during the initialization process. In addition to providing “opt-in” and “opt-out” options, the present disclosure contemplates providing notifications regarding access or use of personal information. For example, a user may be notified upon downloading an app that will access the user's personal information data, and then again immediately before the app accesses the user's personal information data.
[0093] Furthermore, it is the intent of this disclosure that personal information data should be managed and handled in a manner that minimizes the risk of unintentional or unauthorized access or use. Risk can be minimized by limiting data collection and deleting data when it is no longer needed. Furthermore, where applicable, de-identification of data can be used to protect user privacy in certain health-related applications. De-identification can be facilitated, where appropriate, by removing certain identifiers (e.g., date of birth, etc.), controlling the amount or specificity of data stored (e.g., collecting location data at a city level rather than a street address level), controlling how data is stored (e.g., aggregating data across users), and / or other methods.
[0094] Thus, while this disclosure broadly encompasses the use of personal information data to implement one or more various disclosed embodiments, this disclosure also contemplates that the various embodiments may be implemented without requiring access to such personal information data. That is, various embodiments of the present technology are not rendered inoperable by the absence of all or part of such personal information data. For example, the configuration indicators and / or suitability indicators may be based on non-personal information or a minimum amount of personal information, such as content requested by a device associated with the user, other non-personal information available to the lens provider, or publicly available information.
Claims
1. The display and a removable lens removably coupleable to the display; a lens detection sensor for detecting the removable lens coupled to the display; A display system comprising:
2. The display system of claim 1 , wherein the display system determines lens information for the removable lens.
3. The display system of claim 2 , wherein the lens information includes one or more of a lens identifier or a lens characteristic.
4. The display system of claim 1 , wherein the display system determines lens information from the removable lens using the lens detection sensor.
5. 5. The display system of claim 4, wherein the lens information is stored electronically by the removable lens, and the lens detection sensor receives the lens information electronically.
6. The display system of claim 4 , wherein the removable lens includes optical markings of the lens information, and the lens detection sensor reads the optical markings.
7. 7. The display system of claim 6, wherein the lens detection sensor is an eye camera that observes the user's eyes.
8. The display system of claim 7 , wherein the display system uses iris detection to identify the user with the eye camera.
9. 10. The display system of claim 8, wherein the display system determines compatibility of the removable lens with the user by comparing the lens information with user information for the identified user.
10. 10. The display system of claim 8, wherein the display system determines an identifier from the removable lens and determines stored lens characteristics associated with the removable lens, the lens characteristics including refractive characteristics.
11. 11. The display system of claim 1, further comprising a head-mounted display unit including the display, the display system providing an indicator of the removable lens coupled to the display.
12. The display system of claim 11 , wherein the indicator comprises a configuration indicator that is provided independently of the user.
13. 12. The display system of claim 11, wherein the indicators include a compatibility indicator that indicates whether the removable lens is compatible with a user.
14. 1. A method for operating a head mounted display unit, comprising: identifying a detachable lens coupled to a display module of the head mounted display unit; providing an indicia according to the identification of the removable lens; A method comprising:
15. The method of claim 14 , wherein the indicia are configuration indicia that differ between the detachable lens and another detachable lens coupleable to the display module.
16. The method of claim 14 , further comprising identifying a user of the head mounted display unit, wherein the indicator is a compatibility indicator of compatibility between the removable lens and the user.
17. wherein the identifying the removable lens includes determining lens information of the removable lens, and the identifying the user includes determining user information, the method comprising: determining said suitability by comparing said lens information with said user information; 17. The method of claim 16, further comprising:
18. a removable lens assembly having a corrective lens element, a frame coupled to the corrective lens element, and a mechanical coupling mechanism coupled to the frame; a head-mounted display unit having a display module and a corresponding mechanical coupling mechanism; the mechanical coupling mechanism is receivable by the corresponding mechanical coupling mechanism for removably coupling the removable lens assembly to the head mounted display unit. Display system.
19. the display module includes a lens mount including the corresponding mechanical coupling mechanism, and the removable lens assembly is removably coupleable to the display module; the mechanical coupling mechanism engages with the corresponding mechanical coupling mechanism to prevent movement of the removable lens assembly relative to the head mounted display unit laterally relative to, along, and around an optical axis of the corrective lens element; the removable lens assembly further includes a magnetic coupling mechanism spaced apart from the mechanical coupling mechanism, whereby the removable lens assembly is magnetically coupleable to the head mounted display unit.
20. The display system of claim 18.
20. 20. The display system of claim 18, further comprising a second display module and a second detachable lens assembly, the display module and the detachable lens assembly for association with a first eye of a user, and the second display module and the second detachable lens assembly for association with a second eye of the user.
Citation Information
Patent Citations
Display device
JP2013171224A
Image display device and image display method, image output device and image output method, and image display system
WO2015107817A1
Insert for augmented reality viewing device
WO2019126331A1