Display system with interchangeable lenses

The head-mounted display system with interchangeable lenses addresses the issue of varying refractive abnormalities by using magnetic and mechanical coupling mechanisms for precise lens alignment, improving image quality and user comfort.

JP7708802B2Active Publication Date: 2025-07-15APPLE INC
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2023033672
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-06-21
Filing Date
2023-03-06
Publication Date
2025-07-15
Estimated Expiration
2039-09-13

AI Technical Summary

Technical Problem

Existing head-mounted displays do not adequately accommodate the varying refractive abnormalities of different users, requiring different corrective lenses.

Method used

A head-mounted display system with interchangeable lenses that can be easily attached and identified, using magnetic and mechanical coupling mechanisms to ensure proper alignment and compatibility with the user's eye characteristics.

Benefits of technology

Enables personalized and efficient lens attachment, ensuring optimal image quality and user comfort by aligning the lenses correctly with the user's eyes, thereby enhancing the display experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007708802000001
    Figure 0007708802000001
  • Figure 0007708802000002
    Figure 0007708802000002
  • Figure 0007708802000003
    Figure 0007708802000003
Patent Text Reader

Abstract

To provide a display system with an interchangeable lens.SOLUTION: A display system includes a display, a removable lens assembly, and a lens detection sensor. The removable lens can be removably coupled to the display. The lens detection sensor detects the removable lens assembly coupled to the display. The display system may further include a head-mounted display unit that includes the display and the lens detection sensor. The display system may determine lens information from the removable lens with the lens detection sensor, and may provide an indicator of the removable lens according to the lens information.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a display system, specifically, a head-mounted display system.

Background Art

[0002] A head-mounted display (HMD) is a display device worn on a user's head and includes one or more display modules for displaying graphics to the user. Since different users may have different refractive abnormalities of their eyes, different users require different corrective lenses.

Summary of the Invention

[0003] This specification discloses an implementation form of a display system. In one implementation form, the display system includes a display, a removable lens assembly, and a lens detection sensor. The removable lens can be removably coupled to the display. The lens detection sensor detects the removable lens assembly coupled to the display. The display system may further include a head-mounted display unit including the display and the lens detection sensor. The display system can determine lens information from the removable lens using the lens detection sensor and can provide an indicator of the removable lens according to the lens information.

[0004] In another implementation, a method for operating a head-mounted display unit is provided, the method including identifying a removable lens coupled to a display module of the head-mounted display unit and providing an indicator according to the identification of the removable lens. The indicator may be a configuration indicator different between the removable lens and another removable lens attachable to the display module. The method may further include identifying a user, while the indicator may be an indicator of compatibility between the removable lens and the user.

[0005] In another implementation, a display system includes a head-mounted display unit and a removable lens assembly. The head-mounted display unit includes a display module. The removable lens assembly includes a lens element and a frame coupled to the lens element. The removable lens assembly may be removable from the display module in a single orientation using a magnetic attachment mechanism coupled to the frame and surrounding the lens element. The removable lens assembly may be removably attachable to the display module using an interference fit, for example, including a flexible annular protrusion in which the removable lens axially receives a lens mount of the display module. The removable lens assembly may be removably attachable to the display module using a spring latch mechanism.

[0006] In one implementation, a display system includes a head-mounted display unit and a removable lens assembly. The head-mounted display unit includes a display module and a corresponding mechanical coupling mechanism. The removable lens assembly includes a corrective lens element, a frame coupled to the corrective lens element, and a mechanical coupling mechanism coupled to the frame. The mechanical coupling mechanism is receivable by the corresponding mechanical coupling mechanism to removably couple the removable lens assembly to the head-mounted display unit.

[0007] The mechanical coupling mechanism engages with a corresponding mechanical coupling mechanism to prevent a removable lens assembly with respect to the head-mounted display unit from moving laterally along, and / or around the optical axis of the corrective lens element. The removable lens assembly may further include a magnetic coupling mechanism spaced apart from the mechanical coupling mechanism, whereby the removable lens assembly can be magnetically coupled to the head-mounted display unit. The display module may include a lens mount including a corresponding mechanical coupling mechanism, and the removable lens assembly may be removably coupled to the display module.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10A

Figure 10B

Figure 11A

Figure 11B

Figure 12A

Figure 12B

Figure 12C

Figure 12D

Figure 13A

Figure 13B

Figure 13C

Figure 13D

Figure 13E

Figure 13F

Figure 14A

Figure 14B

Figure 15

Figure 16

Figure 17

DETAILED DESCRIPTION OF THE INVENTION

[0009] Embodiments of a display system including a head-mounted display unit and one or more interchangeable lenses are disclosed herein. The interchangeable lenses can be configured according to different eye characteristics of different users (e.g., according to an eyeglass prescription). For example, a pair of interchangeable lenses may be associated (e.g., prescribed) with one user, while another pair of interchangeable lenses may be associated with another user. The interchangeable lenses are attachable to the head-mounted display unit in an interchangeable manner such that different lenses can be attached to the head-mounted display unit to accommodate different users with different eye characteristics. The interchangeable lenses can be attached to the head-mounted display unit in a variety of different ways. The display system can also identify the interchangeable lenses attached to the head-mounted display unit and / or identify the user and perform various operations accordingly.

[0010] Referring to FIGS. 1 and 2, display system 100 generally includes a head-mounted display unit 110 and one or more removable lens assemblies 120. The head-mounted display unit 110 generally includes a housing 112, a head support 114, one or more display modules 116 (e.g., two, one for each eye), and various other electronic devices (e.g., a controller or computing device, a communication interface, audio input / output devices, sensors, a battery, or other power electronics, see also FIG. 12). The display system 100 is configured to provide computer-generated reality (e.g., virtual reality or mixed reality), in which case the display system 100 can be regarded as a computer-generated reality system or computer-generated reality display system, a virtual reality system or virtual reality display system, or a mixed reality display system or mixed reality system. The terms computer-generated reality, virtual reality, and mixed reality are discussed in more detail below.

[0011] The housing 112 contains or is otherwise coupled to the one or more display modules 116 and other electronic devices. The housing 112 may also include various flexible components (not shown) coupled to engage and support the user's face thereon. The head support 114 is coupled to the housing 112 to support the head-mounted display unit 110 on the user's head with the one or more display modules 116 in a position suitable for the user's eyes. As shown, the head support 114 can be configured as a strap or band configured to extend around the user's head. The display module 116 is coupled to the housing 112 at a fixed position (as shown).

[0012] Referring to FIGS. 3A - 3B, the display module 116 generally includes a display 316a, a primary lens 316b, and a lens mount 316c. The display 316a is configured to display graphics to the user. The display 316a may be a display screen such as, for example, a liquid crystal display (LCD), an organic light - emitting diode (OLED) display, or other suitable display. The display 316a may be coupled to a circuit board or other support.

[0013] The primary lens 316b is coupled to the display 316a. The primary lens 116b is disposed between the display 116a and the user's eye and refracts the light emitted from the display 316a before it reaches the user's eye. The primary lens 316b may be omitted depending on the configuration of the display 316a and / or the removable lens assembly 120.

[0014] The lens mount 316c is coupled to and configured to support the removable lens assembly 120 between the display 316a and the user's eye (i.e., with the primary lens 316b between the display 316a and the removable lens assembly 120). As shown, the lens mount 316c can also be coupled to and support the primary lens 316b with respect to the display 316a, for example, by being coupled to a circuit board or other support of the display 316a. The lens mount 316c may surround the primary lens 316b (e.g., forming a bezel or barrel structure for the primary lens 316b).

[0015] The removable lens assembly 120 generally includes a lens element 330 and a lens frame 340. The lens frame 340 is coupled to the lens element 330 and is configured to be removably coupled to a lens mount 316c to support the lens element 330 at a predetermined position (e.g., with respect to the display 316a and / or the primary lens 316b) on the display module 116. The lens frame 340 is coupled to, for example, the outer peripheral surface of the lens element 330. Deformed forms of the lens mount 316c and the interaction with the lens frame 340 will be discussed in more detail below. The removable lens assembly 120 may also be referred to as an interchangeable lens assembly, an interchangeable lens, a removable lens, or a lens.

[0016] The lens element 330 may be, for example, a corrective lens for addressing refractive anomalies of a user's eye, such as myopia, hyperopia, and / or astigmatism. The removable lens assembly 120 and the lens element 330 may be associated with a particular user by having particular lens characteristics for addressing a particular refractive anomaly (e.g., eye characteristics) of the particular user's eye. Such lens characteristics and eye characteristics may each include spherical, cylindrical, axis, and / or other parameters conventionally used to define the eyeglass prescription or refractive anomaly of the eye of one or more users.

[0017] The lens characteristics of the lens element 330, and thus the removable lens assembly 120, may also include a center (e.g., an optical axis) that is aligned with the pupil of the user. Thus, the removable lens assembly 120 can be mounted at a predetermined position (i.e., up / down, left / right, and rotational positions) on the lens mount 316c to ensure proper spatial positioning of the lens element 330 with respect to the user's eye.

[0018] Alternatively, the lens element 330 may be a non-corrective lens that protects the primary lens 316b from contact by the user and / or debris that could otherwise interfere with a user looking at the display 316a (e.g., rubbing or blocking the field of view). For example, a pair of removable lens assemblies 120 may include a lens element 330 that is corrected for use by a particular user, while another pair of removable lens assemblies 120 may include a non-corrective lens element 330 for use by other users (e.g., users who do not require corrective lenses).

[0019] Referring to FIGS. 4-6, the outer perimeter of the removable lens assembly 120 may have different shapes. As shown in FIG. 4, the removable lens assembly 120 has an outer perimeter that is formed by a lens frame 340 and is oval (i.e., having a curved left and right end as shown). Alternatively, the outer perimeter may be circular (see the lens frame 540 of the lens assembly 520 in FIG. 5) or rectangular (see the lens frame 640 of the lens assembly 620 in FIG. 6). As discussed in more detail below, those lens assemblies having a rotationally symmetric (e.g., oval, circular, rectangular, or other suitable shape) outer perimeter may be further configured to couple to the lens mount 316c at different rotational positions around the optical axis of the lens element 330 for use with the display module 116. Alternatively, the removable lens assembly 120 may have an outer perimeter that is rotationally asymmetric, such that the lens mount 316c can be coupled to only one position for use with the display module 116.

[0020] Referring again to FIGS. 3A and 4, light is emitted by the display 316a, passes through the primary lens 316b, and then passes through the lens element 330 before reaching the user's eye. For example, light emitted from the outer end 360a of the display 316a can generally follow the outer optical path 360 (e.g., a ray trace), whereby the light emitted from the display 316a is refracted by the primary lens 316b and then refracted by the lens element 330. The outer optical path 360 passes through the primary lens 316b and generally passes through the passage position 360b. The outer optical path 360 enters the entrance side 330a of the lens element 330 at the entrance point 360c and exits the exit side 330b of the optical path at the entrance point 360c. As it moves from the entrance side 330a to the exit side 330b through the lens element 330, the outer optical path 360 narrows, thereby focusing towards the user's eye.

[0021] The regions of the lens element 330 outside the entry point 360c and the exit point 360d (i.e., radially outward toward the ends of the lens element 330) do not function to refract light toward the user's eye and can be considered non-functional (e.g., non-refractive). Such non-functional regions of the lens element 330 are removed and / or blocked by the lens frame 340, thereby enabling different structural configurations of the lens frame 340. As shown in FIG. 4, the functional region of the lens element 330 may be smaller than the functional region of the primary lens 316b as shown (e.g., smaller in area, width, and / or height than the functional passage positions 360b on the entry side 330a at the entry point 360c and / or the exit side 330b at the exit point 360d). As shown, the functional region of the lens element 330 may be smaller than the display 316a (e.g., smaller in area, width, and / or height than the light emission of the display 316a on the entry side 330a at the entry point 360c and / or the exit side 330b at the exit point 360d). The functional region of the primary lens 316b may be larger than the display 316a as shown (e.g., larger in area, width, and / or height than the light emission region of the display 316a). Additionally, the functional regions of the primary lens 316b and the lens element 330 may enable any eye camera 319 (e.g., of the display module 116) of the head-mounted display unit 110 to observe the user's eye (e.g., light traveling in a direction opposite to the direction in which light is emitted by the display 316a).

[0022] Referring further to FIGS. 3A - 3B, the outer periphery of the lens element 330 is coupled to, for example, engaged by, and / or adhered to the inner periphery of the lens frame 340. The outer periphery of the lens element 330 and the inner periphery of the lens frame 340 are straight (e.g., move axially and have the same cross - sectional shape) or tapered (e.g., widen as it moves towards the display module 116) and have corresponding shapes that enable the coupling therebetween. The outer periphery of the lens element 330 may have approximately the same size as the primary lens 316b that defines the non - functional region of the lens element 330 (e.g., having approximately the same area, width, and / or height).

[0023] Referring to FIGS. 7 - 9, as referred to above, the non - functional region of the lens element 330 can be reduced with the lens element 330 being smaller than the primary lens 316b.

[0024] As shown in FIG. 7, the removable lens assembly 720 is a variant form of the removable lens assembly 120 and generally includes a lens element 730 and a lens frame 740. The lens element 730 is a variant form of the lens element 330 that is different by being smaller (e.g., having a smaller area, width, and / or height) than the primary lens 316b. The lens frame 740 is a variant form of the lens frame 340 that is different by extending further radially inwards than the lens frame 740 by having an inner periphery that is smaller (e.g., having a smaller area, width, and / or height) than the primary lens 316b and / or the lens mount 316c.

[0025] Referring to FIG. 8, the removable lens assembly 820 is a variant of the removable lens assembly 120 and generally includes a lens element 830 and a lens frame 840. The lens element 830 is a variant of the different lens elements 830 by having an end portion (e.g., tapered) inclined at an angle or curvature that more closely matches the angle at which the external optical path 360 (e.g., the angle of refraction) passes through the lens element 830. For example, the outer peripheral surface of the lens element 830 may extend at an angle measured with respect to the optical axis of the lens element that is greater than zero, for example, 15 to 75 degrees, for example, 30 to 60 degrees. The end portions of the outer peripheral surfaces on the entrance side and the exit side of the lens element 830 may be smaller than the peripheral dimensions of the primary lens 316b (e.g., the area, width, and / or height are smaller). The end portion of the peripheral surface on the exit side of the lens element 830 may be smaller than the end portion of the peripheral surface on its entrance side (e.g., the size becomes smaller as it moves away from the primary lens 316b and toward the user's eye). The lens frame 840 is a variant of the lens frame 340 that extends further radially inward than the lens frame 340, such as by having an inner circumference smaller than the primary lens 316b on one or both of the entrance side and the exit side of the lens element 830. The lens frame 840 is coupled to the outer peripheral surface of the lens element 830 and can follow the shape of the peripheral surface of the lens element 830 (e.g., having a matching inclination or contour) or be accommodated in another way.

[0026] Referring to FIG. 9, the removable lens assembly 920 is a variant of the removable lens assembly 120 and generally includes a lens element 930 and a lens frame 940. The lens element 930 is a variant of the lens element 330 that is different by having a non-functional region on the exit side (e.g., or the other recessed side) that is a plane that can form a front surface that is coupled to the lens frame 940 and surrounds the functional region of the lens element 930. The lens frame 940 is coupled to the front surface of the exit side 930b of the lens element 930 and is a variant of the lens frame 340 that protrudes inward from the lens mount 316c.

[0027] Referring again to FIGS. 3-4, the lens mount 316c and the removable lens assembly 120 are cooperatively configured such that the removable lens assembly 120 is removably coupled to the lens mount 316c by which it is supported. As shown, the lens mount 316c and the removable lens assembly 120 each include cooperative coupling mechanisms 316d, 322. The cooperative coupling mechanisms 316d, 322 are magnetic and may be referred to as magnetic coupling mechanisms. The magnetic coupling mechanisms 316d, 322 are disposed at corresponding positions on the lens mount 316c and the lens frame 340 of the removable lens assembly 120 for the lens mount 316c to support the removable lens assembly 120 at one or more predetermined positions (i.e., vertical, horizontal, and rotational directions) where the lens element 330 is properly aligned with the user's eye.

[0028] For each pair of corresponding magnetic coupling mechanisms 316d, 322, one may be a permanent magnet and the other may be an attractor element (e.g., an attractor plate made of a ferromagnetic material) or another permanent magnet in a suitable orientation. For example, the magnetic coupling mechanism 316d of the lens mount 316c may be an attractor plate, while the magnetic coupling mechanism 322 of the removable lens assembly 120 is a permanent magnet.

[0029] The magnetic coupling mechanisms 316d, 322 are provided in a suitable size, number, and position for the lens mount 316c to properly support the removable lens assembly 120 during use, while still allowing the user to easily remove the removable lens assembly 120. For example, as shown, the lens mount 316c and the removable lens assembly 120 may include approximately six pairs of magnetic coupling mechanisms 316d, 322.

[0030] The removable lens assembly 120 and the lens mount 316c may be configured such that the removable lens assembly 120 is attachable to the lens mount 316c at only one predetermined position. For example, the lens element 330 may have an optical axis that is offset with respect to the lens mount 316c, thereby requiring the removable lens assembly 120 to be coupled to the lens mount 316c at one predetermined position. If the removable lens assembly 120 is instead coupled to a different position where the lens mount 316c is rotated therefrom, the optical axis is moved with respect to the lens mount 316c and thereby moved with respect to the display 316a and the user's eye, resulting in a degradation of the image quality perceived by the user.

[0031] The magnetic coupling mechanisms 316d, 322 may be configured to prevent incorrect positioning of the removable lens assembly 120 with respect to the lens mount 316c. For example, as shown in FIG. 4, the magnetic coupling mechanism 322 is shown in dashed lines in FIG. 4 (e.g., embedded, hidden, or otherwise coupled to the lens frame 340), and the magnetic coupling mechanisms 316d, 322 may be positioned and / or distributed asymmetrically to prevent alignment of corresponding pairs of the magnetic coupling mechanisms 316d, 322, thereby preventing the removable lens assembly 120 from being coupled to the lens mount 316c at a different position (e.g., rotated 180 degrees). Alternatively or in addition, the magnetic characteristics of the magnetic coupling mechanisms 316d, 322 (e.g., orientation, and whether they are attractor plates or permanent magnets) may prevent magnetic coupling of those magnetic coupling mechanisms 316d that do not correspond to each other at a different position (e.g., rotational orientation). For example, if the removable lens assembly 120 is rotated 180 degrees, the aligned but non-corresponding magnetic coupling mechanisms 316d, 322 may not attract each other (e.g., two attractor plates) or may repel each other (e.g., permanent magnets with common poles arranged adjacent to each other).

[0032] The lens mount 316c and the removable lens assembly 120 can be further configured to mechanically prevent their misalignment. For example, the lens mount 316c and the removable lens assembly 120 can each further include mechanical engagement mechanisms 316e, 324. The mechanical engagement mechanisms 316e, 324 mechanically engage with each other to ensure proper positioning and / or alignment between the lens mount 316c and the removable lens assembly 120. The mechanical engagement mechanisms 316e, 324 can further engage with each other to further prevent relative movement of the removable lens assembly 120 relative to the lens mount 316c (e.g., in a direction perpendicular to and lateral to the optical axis while the magnetic coupling mechanisms 316d, 322 prevent movement along the optical axis).

[0033] The mechanical engagement mechanisms 316e, 324 can be, for example, recesses and protrusions, which can be received by the recesses or vice versa. When the removable lens assembly 120 is disposed at a different position relative to the lens mount 316c, the protrusion engages with another surface of the lens mount 316c instead to prevent the removable lens assembly 120 from fitting thereinto. Alternatively, the opposing axially facing (e.g., mating) surfaces of the display module 116 (e.g., the lens mount 316c) and the removable lens assembly 120 (e.g., the lens frame 340) can have a three-dimensional contour to prevent misalignment of the removable lens assembly 120 relative to the lens mount 316c.

[0034] Instead of having only one attachment position, the removable lens assembly 120 and the lens mount 316c may be configured such that the removable lens assembly 120 is attached to the lens mount 316c at two or more positions. For example, the lens frame 340, the lens mount 316c, the coupling mechanism, and / or the mechanical alignment mechanism may be cooperatively configured such that the removable lens assembly 120 is coupled to the lens mount 316c at two predetermined positions (e.g., rotationally symmetric in pairs, such as two positions), or more (e.g., three or four positions), and not coupled to the lens mount 316c at other positions.

[0035] Referring to FIGS. 10A - 11B, a variant of the removable lens assembly 120 and the lens mount 316c is configured to mechanically couple the removable lens assembly 120 to the lens mount 316c.

[0036] As shown in FIGS. 10A - 10B, the display module 1016 includes a lens mount 1016c to which a removable lens assembly 1020 can be removably coupled in a fitting structure (e.g., forming an interference fit). The removable lens assembly 1020 includes a lens element 330 and a lens frame 1040, which are coupled to each other and may otherwise be configured in the manner described above (e.g., refer to FIGS. 3A - 9). The lens frame 1040 includes a barrel 1042 having an annular protrusion 1044 (e.g., a lip or circumferential lip). The barrel 1042 extends axially rearward (e.g., of the lens element 330), while the annular protrusion 1044 protrudes radially inward therefrom. The lens frame 1040 can further define an annular recess 1046 (e.g., an unlabeled circumferential channel) that extends radially outward from the annular protrusion 1044 and is axially outwardly disposed (i.e., away from the display 316a). The annular protrusion 1044 and the annular recess 1046 extend circumferentially around the axis of the lens element 330 completely or substantially completely (e.g., 80% or more).

[0037] The lens mount 1016c includes a barrel 1016d having an annular protrusion 1016e. The barrel 1016d extends axially forward, while the annular protrusion 1016e protrudes radially outward therefrom. The annular protrusion 1016e further defines an annular recess 1016f (e.g., a circumferential channel) that is axially forwardly disposed and extends radially inwardly therefrom. The annular protrusion 1016e and the annular recess 1016f thus defined extend circumferentially around the axis of the lens element 330, either wholly or substantially wholly.

[0038] The barrel 1042 of the lens frame 1040 is configured to receive the barrel 1016d of the lens mount 1016c therein so as to removably couple the removable lens assembly 1020 to the lens mount 1016c. The annular protrusion 1044 of the lens frame 1040 is received and held therein by the annular recess 1016f of the lens mount 1016c, while the annular protrusion 1016e of the lens mount 1016c is received and held therein by the annular recess 1046 of the lens frame 1040.

[0039] The inner circumference of the annular protrusion 1044 of the lens frame 1040 is smaller than the outer circumference of the annular protrusion 1016e of the lens mount 1016c, whereby the axial surfaces of the annular protrusions 1044, 1016e overlap radially with each other and engage axially with each other to prevent the removable lens assembly 1020 from being inadvertently separated from the display module 1016. The annular protrusion 1044 may be formed of a flexible material such as rubber or other polymer so that the barrel 1042 of the lens frame 1040 can be formed, allowing the inner circumference of the annular protrusion 1044 to expand and stretch over the annular protrusion 1016e of the lens mount 1016c. The lens frame 1040 may be formed of or include the flexible material forming the annular protrusion 1044 and may include a soft material that can accidentally contact the user's face or engage with it in another way. Alternatively, the barrel 1042 and / or the annular protrusion 1044 may form a bend. In yet a further alternative, the barrel 1042 and the annular protrusion 1044 of the removable lens assembly 1020 are rigid, while the barrel 1016d and / or the annular protrusion 1016e of the display module 1016 are flexible or form a bend.

[0040] The lens frame 1040 and the lens mount 1016c are shown and described with the lens mount 1016c (e.g., the barrel 1016d and the annular protrusion 1016e) received within the lens frame 1040, but the lens frame 1040 and the lens mount 1016c may be arranged in a manner opposite to that of the lens frame 1040 that receives the lens mount 1016c.

[0041] As shown in FIGS. 11A-11B, the display module 1116 includes a lens mount 1116c to which a removable lens assembly 1120 is removably coupled by a spring mechanism. The removable lens assembly 1120 typically includes a retractable latch 1122 (e.g., a latch member) that is sprung radially outward to be received within a receptacle 1116d of a corresponding lens mount 1116c. For example, the retractable latch 1122 extends axially rearward from an axially rearward face of the lens frame 1140 and includes an inner end 1124 (e.g., a key-shaped or outwardly projecting end) that extends radially outward therefrom. When the retractable latch 1122 is retracted (e.g., by a user pressing on an exposed end of the protrusion), the retractable latch 1122 is axially insertable into or removable from the receptacle 1116d of the forward axially facing surface of the corresponding lens mount 1116c. The inner end of the retractable latch 1122 is received behind a lip 1116e of the receptacle 1116d. A spring (shown schematically without labeling) biases the retractable latch 1122 radially outward when released by the user such that the inner end of the retractable latch 1122 is positioned rearward and engages the lip 1116e of the receptacle 1116d to hold the removable lens assembly 1120 on the lens mount 1116c. Although the retractable latch 1122 has been shown and described as being part of the removable lens assembly 1120, alternatively, a retractable latch may be provided in the display module 1116 to releasably engage the removable lens assembly 1120 in a similar manner (e.g., engage a receptacle within an outer peripheral surface of the lens frame 1140).

[0042] Referring to FIGS. 12A - 12B, in yet a further embodiment, a variant of the removable lens assembly 120 can be coupled to the lens mount 1216c in other ways. For example, the removable lens assembly 1220 and the lens mount 1216c may include corresponding mating mechanisms 1222, 1223 (e.g., tabs and detents or protrusions) that allow the removable lens assembly 1220 to be coupled to the lens mount 1216c in one or more of an axial movement 1222a, a perpendicular movement 1222b, or a rotational movement 1222c. The removable lens assembly 1220 is engaged and coupled to the lens mount 1216c via the corresponding mating mechanisms 1222, 1223 by an axial movement 1222a, a perpendicular movement 1222b, or a rotational movement 1222c (e.g., a quarter turn).

[0043] Referring further to FIG. 12C, a removable lens assembly 1220' is coupled to the display unit 1216' via friction or an interference fit. Specifically, the removable lens assembly 1220 includes a lens frame 1240' that is received by the lens mount 1216c' of the display unit 1216' and is thereby held via friction (e.g., in a state where the lens frame 1240' is radially inwardly compressed by the lens mount 1216c').

[0044] Referring further to FIG. 12D, a removable lens assembly 1220' is coupled to the display unit 1216' via a retractable pin 1216d. For example, the display unit 1216' includes a lens mount 1216c' that receives the lens frame 1240' of the removable lens assembly 1220' therein, and a retractable pin 1216d that selectively extends into a corresponding recess of the lens frame 1240'. For example, the pin 1216d' may be spring - biased radially inwardly so as to be received by the lens frame 1240'.

[0045] Referring to FIGS. 13A - 13F, in yet a further example, the removable lens assembly 1320 includes a mechanical coupling mechanism 1322 (e.g., a male component or a protrusion), which may be referred to as a lens mechanical coupling mechanism 1322. On the other hand, the display module 1310 includes a corresponding mechanical coupling mechanism 1312 (e.g., a female component, a recess, or a receptacle), which may be referred to as a display mechanical coupling mechanism 1312. The lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 mechanically fit together to mechanically couple the removable lens assembly 1320 to the display module 1310. For example, as will be discussed in more detail below, the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 can prevent movement of the removable lens assembly 1320 relative to the display module 1310 in a direction generally perpendicular, generally parallel, and / or around the optical axis of the removable lens assembly 1320.

[0046] The removable lens assembly 1320 may further include one or more magnetic coupling mechanisms 1324, which may be referred to as a lens magnetic coupling mechanism 1324. On the other hand, the display module 1310 includes one or more corresponding magnetic coupling mechanisms 1314, which may be referred to as a display magnetic coupling mechanism 1314. The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 magnetically couple to each other to magnetically couple the removable lens assembly 1320 to the display module 1310. For example, as will be discussed in more detail below, the lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 can prevent movement of the removable lens assembly 1320 relative to the display module 1310 in a direction generally parallel to the optical axis of the removable lens assembly 1320.

[0047] The lens mechanical coupling mechanism 1322 of the removable lens assembly 1320 may be disposed on its first side (e.g., left, right, top, bottom, inner, or outer side), while one or more lens magnetic coupling mechanisms 1324 may be disposed on its second side (e.g., right, left, bottom, top, outer, or inner side, respectively, such as in a state where lens elements 330 are disposed therebetween) spaced away from and / or opposite to the first side. The lens mechanical coupling mechanism 1322 may be formed by (e.g., integrally formed with) the lens frame 340, while one or more lens magnetic coupling mechanisms 1324 are coupled to the lens frame 340. The lens magnetic coupling mechanism 1324 may be or include one or more permanent magnets and / or attractor materials (e.g., ferromagnetic materials or components).

[0048] The display module 1310 includes a lens mount 1311 having a lens mechanical coupling mechanism 1322 and one or more lens magnetic coupling mechanisms 1324. As discussed in more detail below, the display mechanical coupling mechanism 1312 of the lens mount 1311 is configured to receive the lens mechanical coupling mechanism 1322 therein. One or more display magnetic coupling mechanisms 1314 of the lens mount 1311 magnetically couple to the lens magnetic coupling mechanism 1324 (e.g., permanent magnets of opposite polarities or attractor materials).

[0049] As described above, the lens mechanical coupling mechanism 1322 of the removable lens assembly 1320 and the display mechanical coupling mechanism 1312 of the display module 1310 are configured to fit with each other. In particular, the lens mechanical coupling mechanism 1322 is configured to be received by the display mechanical coupling mechanism 1312. When received thereby, the lens mechanical coupling mechanism 1322 engages with the display mechanical coupling mechanism 1312 to prevent relative movement therebetween. For example, the lens mechanical coupling mechanism 1322 engages with the display mechanical coupling mechanism 1312 to prevent relative shear movement between the removable lens assembly 1320 and the display module 1310, such as upward movement, lateral movement, etc. (in a direction generally perpendicular to the optical axis of the removable lens assembly 1320), and / or rotational movement of the removable lens assembly 1320 relative to the display module 1310 (e.g., around the generally optical axis of the removable lens assembly 1320).

[0050] To prevent relative upward movement, the upward surface of the lens mechanical coupling mechanism 1322 engages with the downward surface of the display mechanical coupling mechanism 1312. To prevent relative downward movement, the downward surface of the lens mechanical coupling mechanism 1322 engages with the upward surface of the display mechanical coupling mechanism 1312. For example, the upper and lower ends of the lens mechanical coupling mechanism 1322 engage with the respective upper and lower ends of the display mechanical coupling mechanism 1312 (see FIGS. 13A and 13B). Alternatively, the upward and downward surfaces at an intermediate height between the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 engage with each other to prevent upward and downward relative movement.

[0051] To prevent relative lateral outward movement (e.g., away from the user's nose), the lateral outward surfaces of the lens mechanical coupling mechanism 1322 engage the lateral inward surfaces of the display mechanical coupling mechanism 1312 (e.g., the leftward and rightward surfaces, respectively, for the left removable lens assembly 1320). To prevent relative lateral inward movement (e.g., toward the user's nose), as shown in FIG. 13F, the lateral inward surfaces of the lens mechanical coupling mechanism 1322 engage the lateral outward surfaces of the display mechanical coupling mechanism 1312 (e.g., the rightward and leftward surfaces, respectively, for the left removable lens assembly 1320). For example, as shown, the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 have a curved shape, and the outward and inward side portions (e.g., concave and convex surfaces) of the lens mechanical coupling mechanism 1322 engage the respective outward and inward side portions (e.g., convex and concave surfaces, respectively) of the display mechanical coupling mechanism 1312.

[0052] To prevent relative rotational movement, the lens mechanical coupling mechanism 1322 is located at spaced locations on both of its sides (e.g., two on each side) and engages the display mechanical coupling mechanism 1312 on both of its sides. For example, when clockwise torque is applied to the removable lens assembly 1320, the upper inner surfaces and the lower outer surfaces of the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 engage each other to suppress (e.g., prevent) relative clockwise rotation therebetween. When counterclockwise torque is applied to the removable lens assembly 1320, the upper outer surfaces and the lower inner surfaces of the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 engage each other to suppress (e.g., prevent) relative counterclockwise rotation therebetween.

[0053] The lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 may be further configured to prevent vertical movement away from the display module 1310 (e.g., in the direction of the optical axis generally). For example, the display mechanical coupling mechanism 1312 may include a forward-facing surface (e.g., an undercut or a toin mechanism) that engages the rearward-facing surface of the lens mechanical coupling mechanism 1322.

[0054] Referring to FIG. 13E, to couple the removable lens assembly 1320 to the display module 1310, the lens mechanical coupling mechanism 1322 is first inserted into the display mechanical coupling mechanism 1312, and then, as discussed in more detail below, the removable lens assembly 1320 is rotated to bring the magnetic coupling mechanisms 1324, 1314 closer together and magnetically couple them.

[0055] As described above, the lens magnetic coupling mechanism 1324 of the removable lens assembly 1320 and the display magnetic coupling mechanism 1314 of the display module 1310 magnetically couple with each other. The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 are arranged at corresponding positions and with corresponding magnetic characteristics (e.g., opposite polarities or one being a ferromagnetic material and the other being a permanent magnet). The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 magnetically couple with each other by a force applied generally in the direction of the optical axis therebetween. The lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 are also spaced apart from the pivot axis defined by the display mechanical coupling mechanism 1312, whereby the magnetic coupling between them prevents rotation about the pivot axis defined by the display mechanical coupling mechanism 1312. For example, as shown, the lens magnetic coupling mechanism 1324 and the display magnetic coupling mechanism 1314 are arranged generally on opposite sides of the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312, respectively.

[0056] Consider variants of the removable lens assembly 1320 and the display module 1310. For example, the lens mechanical coupling mechanism 1322 and the display mechanical coupling mechanism 1312 may have different shapes (e.g., straight), different numbers (e.g., two or more sets of pins and apertures spaced apart to prevent movement as described above), and / or may be provided at different positions (e.g., on its upper, lower, or inner side). Further, the display mechanical coupling mechanism 1312 may be provided by different portions of the head-mounted display unit 110, such as the housing 112 (e.g., a curtain or other structure surrounding the display module 1310). Further, instead of the magnetic coupling mechanisms 1324, 1314, the removable lens assembly 1320 and the display module 1310 may alternatively or additionally include a mechanical coupling mechanism (e.g., a mating structure or latch as described above).

[0057] For each case of the methods for coupling described above with respect to FIGS. 3A - 3B and FIGS. 10A - 13F, it should be noted that the lens mount can be coupled to a different portion of the head-mounted display unit 110, such as the housing 112 (e.g., chassis), as opposed to the display module 116 or its variants.

[0058] Referring to FIGS. 14A - 16, the display system 100 and the removable lens assembly 120 are cooperatively configured with respect to the display system 100 to detect the removable lens assembly 120 coupled to the head - mounted display unit 110. For example, the head - mounted display unit 110 includes one or more lens detection sensors 1418a for detecting one or more removable lens assemblies 120 coupled thereto. When detecting the removable lens assembly 120, the display system 100 determines whether any of the removable lens assemblies 120 are coupled to the display module 116 (e.g., using a proximity sensor, image recognition, and / or a mechanical switch), determines whether the removable lens assembly 120 is properly coupled (e.g., using a proximity sensor, image recognition, or a hall sensor with a magnet coupled to the removable lens assembly 120), and / or determines other information regarding the removable lens assembly 120 for supporting other functions (e.g., presence or absence of correction, serial or model number, associated user, and / or lens characteristics using other types of lens detection sensors 1418a discussed below). The display system 100 may provide an indication of whether the removable lens assembly 120 is coupled to the display module 116, an indication of whether the removable lens assembly 120 is properly positioned with respect to the display module 116, and / or other indications (e.g., lens configuration and / or lens compatibility discussed below).

[0059] Each removable lens assembly 120 may further include one or more lens detection sensors 1418a or, alternatively, a lens tag 1428 that is readable thereby. Detection of the removable lens assembly 120 enables the display system 100 to perform one or more subsequent operations, including changing the output of the display module 116, providing an indicator of the removable lens assembly 120, and / or providing an indicator of the compatibility of the removable lens assembly 120 with the user. The display system may also include a controller 1450 that controls the operation of the head-mounted display unit 110 to, for example, detect a removable lens assembly 120 coupled thereto and / or perform subsequent operations in response thereto. The controller 1450 may be physically incorporated, in whole or in part (as shown by the dashed lines), within the head-mounted display unit 110 or may be physically provided separately, in whole or in part, therefrom (e.g., within an external computing device). An exemplary hardware configuration of the controller 1450 will be described below with reference to FIG. 14.

[0060] When detecting the removable lens assembly 120, the display system 100 can identify or determine information regarding the removable lens assembly 120, which may be referred to as lens information. The lens information may include an identifier of the removable lens assembly 120 and / or technical characteristics. The identifier may be the removable lens assembly 120 itself (e.g., a serial number or model number, referred to as a lens identifier), a user associated with the lens (e.g., a user name or user ID, referred to as an associated user identifier), and / or other identification information (e.g., a manufacturer, date, referred to as manufacturing information). The technical characteristics may include refractive characteristics such as the spherical, cylindrical, and / or axis parameters of the removable lens assembly 120, which may be referred to as lens characteristics, lens characteristic information, or prescription information, and / or the position of the optical axis. The lens information determined by the display system 100 can then be used by the display system 100 to perform subsequent operations that are referenced above and described in more detail below.

[0061] The display system 100 can determine the lens information of a removable lens assembly 120 that is actively coupled (e.g., coupled or currently coupled) to the head-mounted display unit 110 in a variety of different ways and using different devices. The display system 100 can determine the lens information from the removable lens assembly 120, such as with a lens detection sensor 1418a from a lens tag 1428. In a first embodiment, the lens tag 1428 is an electronic device that stores or otherwise electrically provides the lens information. For example, each lens tag 1428 of the removable lens assembly 120 may be an electrically-erasable programmable read-only memory device (EEPROM), a radio frequency identification device (RFID), or an internal resistance device (e.g., an electrical resistance or resistor). The lens detection sensor 1418a is a corresponding electrical device or system configured to receive the lens information from the lens tag 1428 and / or otherwise receive it, such as by wirelessly or physically communicating with the EEPROM, reading the RFID signal, and / or measuring or otherwise determining the resistance signature of the resistance device.

[0062] In a second example, the lens tag 1428 has a magnetic signature. The removable lens assembly 120 includes various magnets (e.g., magnetic coupling mechanism 322) or other magnets that can provide a magnetic signature by having various strengths and / or positions and is detected by a lens detection sensor 1418a that may include one or more Hall sensors or other magnetic sensors that sense the magnetic field of the magnets. The combination of magnetic fields detected by the lens detection sensor 1418a provides lens information (e.g., a lens identifier for a particular magnetic signature). The Hall sensor may alternatively or additionally be used to determine whether the removable lens assembly 120 is properly coupled.

[0063] In a third embodiment, the lens tag 1428 is an optical marking that displays or otherwise communicates lens information. For example, the lens tag 1428 may be an optical or infrared (IR) marking on the removable lens assembly 120 such as a quick response code (QR code (registered trademark)), bar code, or alphanumeric. The lens detection sensor 1418a of the head-mounted display unit 110 is a corresponding optical reading device such as a camera or a combined illuminator / sensor device (e.g., a QR code scanner), which may be the eye camera 319 that also observes the aforementioned eye. In one particular example, the lens tag 1428 is an infrared bar code.

[0064] The display system 100 can determine lens information necessary for one or more further operations directly from the removable lens assembly 120 itself. Alternatively or in addition, the display system 100 may determine additional lens information from other light sources for performing subsequent operations. For example, the display system 100 may receive only initial lens information (e.g., a lens identifier or a related user identifier) from the removable lens assembly 120, while other lens information (e.g., a related user identifier and / or lens characteristics) is associated with and stored by the display system 100 (e.g., by a storage device of the controller 1450). Thus, by determining the initial lens information from the removable lens assembly 120, the display system 100 can determine (e.g., obtain) other lens information to support subsequent operations.

[0065] Using the lens information of the removable lens assembly 120 coupled to the display module 116, various functions of the display system 100 can be controlled, which may include operating the display 316a, providing an indication to the user of the removable lens assembly 120 coupled thereto, and / or determining the compatibility with the user of the removable lens assembly 120. The operation of the display 316a may be performed according to the lens information of the removable lens assembly 120 coupled to the display module 116, whereby the operation of the display 316a may differ between one of the removable lens assemblies 120 having one set of lens characteristics and another of the removable lens assemblies 120 having another set of lens characteristics (e.g., different characteristics of the optical system formed by the primary lens 316b and the lens element 330, or different luminance and / or pixel outputs explaining different lens characteristics).

[0066] Alternatively or in addition, lens information of the removable lens assembly 120 coupled to the display module 116 can be used to provide an indication to the user or potential user of the removable lens assembly 120, which may be referred to as a lens configuration indicator, associated therewith. The lens configuration indicator varies, for example, among different ones of the removable lens assemblies 120 associated with different users. A first lens configuration indicator is provided for one of the removable lens assemblies 120 (or a pair of removable lens assemblies 120 associated with each other), while a second different lens configuration indicator is provided for another removable lens assembly 120 (or another pair of removable lens assemblies 120 associated with each other). The display indication (e.g., or output command) is stored, for example, by the display system 100, associated with the lens information (e.g., lens identifier, associated user identifier, or lens characteristics), and can be retrieved when determining the lens identifier. The configuration indicator may be provided regardless of the user (e.g., without detecting or identifying the user).

[0067] The lens configuration indicator may be provided, for example, as an external light indicator, a display indicator, or an audible indicator. The external light indicator includes an external visual indicator 1418b (e.g., a light-emitting diode) of the head-mounted display unit 110 that is visible to a potential user before the head-mounted display unit 110 is worn, which may vary, for example, by color (e.g., red versus blue to distinguish between a first user and a second user). The display indicator is provided by the display 316a and can be seen by a user or a potential user through the removable lens assembly 120. The display indicator may be, for example, a different set of colors, symbols, or characters for different users, and is distinguishable even for potential users with low vision (e.g., the display 316a may appear blurred) in the removable lens assembly 120. The audible indicator is provided by an audio output device 1418c of or associated with the head-mounted display unit 110 (e.g., a speaker or headphones) and may be audible to a potential user before or after the head-mounted display unit 110 is worn. The audible indicator may be, for example, speech (e.g., to identify a user associated with the removable lens assembly 120), or tones for different users associated with the removable lens assembly 120.

[0068] Referring to FIGS. 14A and 14B, method 1400 is provided to show a lens configuration. The method generally includes a first operation 1410 of identifying a removable lens assembly 120 coupled to a display module 116, a second operation 1420 of obtaining a configuration indicator command, and a third operation 1430 of providing a configuration indicator according to the command. The first operation 1410 of identifying the interchangeable lens assembly is performed using a lens detection sensor 1418a. The controller 1450 determines lens information from a lens tag 1428 of one or more removable lens assemblies 120 coupled to one or more display modules 116 of the head-mounted display unit 110. The second operation 1420 of obtaining the configuration indicator command is performed, for example, by the controller 1450 obtaining a command associated with the lens information from a storage device. The third operation 1430 of providing the configuration indicator is provided by, for example, a display module 116, an external visual indicator 1418b, and / or an audio output device 1418c operated by the controller 1450.

[0069] Referring to FIGS. 14A - 16, alternatively or in addition, the display system 100 uses the lens information of the removable lens assembly 120 coupled thereto to determine compatibility with the user and provides a compatibility indicator to the user accordingly (e.g., only incompatibility is determined). In addition to determining the lens information of the removable lens assembly 120 coupled to the head-mounted display unit 110, the display system 100 identifies the current user, compares the user information with the lens information, and determines compatibility.

[0070] The display system 100 can identify a user in various ways, for example, using biometric sensing, receiving user credentials, and / or authentication by another device. To identify the user via biometric measurements, the display system 100 may include a biometric sensor 1418d for identifying the user by biometric measurements (e.g., face recognition, fingerprint recognition, voice recognition, iris recognition, and / or recognition of other biometric measurement parameters such as the geometric shape of the ear, bone conduction or density characteristics, forehead features, or skin). The biometric sensor 1418d may be physically coupled to, for example, a head-mounted display unit. For example, when identifying the user by iris detection, the biometric sensor 1418d may be the aforementioned eye camera 319, or it may be the same sensor for identifying the removable lens assembly 120. To identify the user via user credentials, the display system 100 receives user credentials (e.g., username and password) from an input device of the display system 100 or associated therewith (e.g., a microphone of the head-mounted display unit, or a controller 1450 or an external device 1460 communicating with the head-mounted display unit 110). To identify the user by authentication from another device, the external device 1460 can authenticate the user (e.g., via biometric measurements or credentials) and communicate such authentication to the controller 1450. The external device 1460 may be considered part of the display system 100, but it may also function independently thereof (e.g., a smartphone).

[0071] The display system 100 stores or otherwise receives user information. The user information may include a user identifier (e.g., username or user number) associated with a related lens identifier (e.g., the serial number or model number of one or more removable lens assemblies 120 associated with the user), and / or eye characteristic information (e.g., spherical, cylindrical, and / or axis parameters, referred to herein as eye characteristics).

[0072] During the initialization process in which user information is associated with lens information, the display system 100 may receive the user information. During the initialization process, the user information may be input by the user or received from another source (e.g., external device 1460). The lens information may be obtained from a lens assembly 120 that is removable (e.g., electronically and / or optically) when coupled to the display module 116 as described above, or may be input by the user (e.g., inputting the serial or model number of the removable lens assembly 120), or may be received from another source (e.g., external device 1460).

[0073] Referring to FIG. 15, to determine compatibility, the display system 100 compares the lens information 1510 with the user information 1520 using, for example, a compatibility determination unit 1500. Or, for example, (a) comparing the lens information 1510 of the lens identifier 1512 with the user information 1520 of the associated lens identifier 1522, (b) comparing the lens information 1510 of the associated user identifier 1514 with the user information 1520 of the user identifier 1524, or (c) comparing the lens information 1510 of the lens characteristics 1516 with the user information 1520 of the eye characteristics 1526, or one or more of these. The display system 100 determines that one or more removable lens assemblies 120 are compatible if the lens information matches (e.g., is equal to) the user information, or not compatible if they do not match.

[0074] If it is determined that there is compatibility, the compatibility indicator may provide a positive indicator (e.g., that the removable lens assembly 120 is compatible with the user), or may be omitted (e.g., proceed to normal operation). If it is determined that there is no compatibility, the compatibility indicator becomes negative (e.g., indicating that the removable lens assembly 120 is not compatible with the user). Such a negative indicator may include, for example, icons graphically indicating incompatibility, text instructions or information, and / or audible instructions or information.

[0075] Referring to FIG. 16, a method 1600 is provided for operating the display system 100 to determine and indicate compatibility with a user of the removable lens assembly 120. This method includes a first operation 1610 of identifying one or more removable lens assemblies 120 coupled to one or more display modules 116, a second operation 1620 of identifying the user, a third operation 1630 of comparing the lens information with the user information, and a fourth operation 1640 of indicating compatibility. The first operation 1610 of identifying one or more removable lens assemblies 120 may be performed by one or more lens detection sensors 1418a in cooperation with the controller 1450. The first operation 1610 may also include determining the lens information. The second operation 1620 of identifying the user may be performed biometrically (e.g., in cooperation with the controller 1450 by the biometric sensor 1418d) by receiving credentials from the user and / or by user authentication with an external device 1460. The second operation 1620 may also include determining the user information. The third operation 1630 of determining lens compatibility is performed, for example, by using the controller 1450 by a compatibility determination unit 1500 to compare the lens information with the user information. The fourth operation 1640 of indicating compatibility is performed, for example, by using the head-mounted display unit 110 operated by the controller 1450. If there is compatibility, a positive indicator that may be the normal operation of the display system 100 is provided. If there is no compatibility, a negative indicator reflecting the incompatibility (e.g., by the head-mounted display unit 110 operated by the controller 1450) is provided.

[0076] Referring to FIG. 17, an exemplary hardware configuration of the controller 1450 is shown. The controller 1450 generally includes a processing device 1710 (e.g., a processor or CPU), a memory 1720 (e.g., a volatile short-term memory such as a random access memory module), a storage device 1730 (e.g., a long-term storage device such as a hard disk or solid state drive), a communication interface 1740 through which the controller sends and receives signals to and from other components (e.g., the display module 116 and various sensors), and a bus 1750 through which other components of the controller 1450 communicate with each other. The controller 1450 may be physically connected to or communicate with the head-mounted display unit 110 in another way. The display system 100 may include an additional controller 1450 or components thereof. The controller 1450 may include software programming (e.g., stored by the storage device 1730) that includes instructions executable by the processing device 1710 to perform the methods and operations described herein.

[0077] The physical environment refers to the physical world in which people can perceive and / or interact without the aid of an electronic system. Physical environments such as a physical park include physical objects such as physical trees, physical buildings, and physical people. People can directly perceive and / or interact with the physical environment through vision, touch, hearing, taste, and smell, etc.

[0078] In contrast, a computer-generated reality (CGR) environment refers to an environment that is wholly or partially simulated for people to perceive and / or interact with via an electronic system. In CGR, a subset of a person's body movements or their representations are tracked, and in response, one or more characteristics of one or more virtual objects simulated within the CGR environment are adjusted to behave according to at least one law of physics. For example, a CGR system can detect the rotation of a person's head and, in response, adjust the graphic content and sound field presented to the person in a similar way to how such views and sounds might change in a physical environment. Depending on the situation (e.g., for accessibility reasons), the adjustment of the characteristic(s) of the virtual object(s) in the CGR environment may be made in response to a representation of a body movement (e.g., a voice command).

[0079] A person may perceive and / or interact with CGR objects using any one of these senses, including vision, hearing, touch, taste, and smell. For example, a person can perceive and / or interact with an audio object that creates an audio environment with a 3D or spatial spread that provides the perception of a point sound source in 3D space. In another example, the audio object can enable audio transparency that selectively incorporates ambient sound from the physical environment, with or without including computer-generated audio. In some CGR environments, a person can only perceive and / or interact with audio objects.

[0080] Examples of CGR include virtual reality and mixed reality.

[0081] A virtual reality (VR) environment refers to a simulation environment designed to be based entirely on computer-generated sensory input for one or more senses. A VR environment includes a plurality of virtual objects with which a person can perceive and / or interact. For example, computer-generated images representing trees, buildings, and avatars of people are examples of virtual objects. A person can perceive and / or interact with the virtual objects in a VR environment through a simulation of the presence of the person within the computer-generated environment and / or through a simulation of a subset of the person's body movements within the computer-generated environment.

[0082] In contrast to a VR environment designed to be based entirely on computer-generated sensory input, a mixed reality (MR) environment refers to a simulation environment designed to incorporate sensory input or a representation thereof from the physical environment in addition to including computer-generated sensory input (e.g., virtual objects). On the virtual continuum, the real environment is somewhere between a completely physical environment at one end and a virtual reality environment at the other end, but neither end is included.

[0083] Depending on the MR environment, the computer-generated sensory input can respond to changes in sensory input from the physical environment. Also, some electronic systems for presenting an MR environment can track the location and / or orientation with respect to the physical environment to enable virtual objects to interact with real objects (i.e., physical items or a representation thereof from the physical environment). For example, the system can account for movement so that a virtual tree appears stationary with respect to the physical ground.

[0084] Examples of mixed reality include augmented reality and augmented virtuality.

[0085] An augmented reality (AR) environment refers to a simulation environment in which one or more virtual objects are superimposed on a physical environment or its representation. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person can directly view the physical environment. The system may be configured to present virtual objects on the transparent or translucent display, whereby a person can use the system to perceive virtual objects superimposed on the physical environment. Alternatively, the system may have an opaque display and one or more imaging sensors that capture an image or video of the physical environment, which is a representation of the physical environment. The system synthesizes the image or video with virtual objects and presents the composite on the opaque display. A person uses the system to indirectly view the physical environment through the image or video of the physical environment and to perceive virtual objects superimposed on the physical environment. As used herein, a video of a physical environment shown on an opaque display is referred to as a "pass-through video," meaning that the system uses one or more imaging sensors to capture an image of the physical environment and uses those images when presenting the AR environment on the opaque display. Further alternatively, the system may have a projection system that projects virtual objects onto the physical environment, for example, as a hologram or on a physical surface, whereby a person can use the system to perceive virtual objects superimposed on the physical environment.

[0086] An augmented reality environment also refers to a simulation environment in which the representation of the physical environment is transformed by computer-generated sensory information. For example, when providing a see-through video, the system can transform one or more sensor images to perform face rendering using a selected perspective (e.g., viewpoint) different from the perspective captured by the imaging sensor. As another example, the representation of the physical environment may be transformed by graphically modifying (e.g., magnifying) a portion thereof, thereby making the modified portion a non-photorealistic version that represents the original captured image. As a further example, the representation of the physical environment may be transformed by graphically removing or obscuring a portion thereof.

[0087] An augmented virtuality (AV) environment refers to a simulation environment in which a virtual environment or a computer-generated environment incorporates one or more sensory inputs from the physical environment. The sensory input can be a representation of one or more characteristics of the physical environment. For example, an AV park may have virtual trees and virtual buildings, but people with faces are realistically reproduced from images of physical people. As another example, virtual objects may adopt the shape or color of physical articles imaged by one or more imaging sensors. As a further example, virtual objects can adopt shadows that match the position of the sun in the physical environment.

[0088] The existence of a variety of electronic systems enables a person to perceive and / or interact with various CGR environments. Examples include head-mounted systems, projection-based systems, head-up displays (HUDs), vehicle windshields with integrated display functionality, windows with integrated display functionality, displays formed as lenses designed to be placed on a person's eye (similar to contact lenses), headphones / earphones, speaker arrays, input systems (e.g., wearable or handheld controllers with or without tactile feedback), smartphones, tablets, and desktop / laptop computers. A head-mounted system may have one or more speakers (singular or plural) and an integrated opaque display. Alternatively, a head-mounted system may be configured to receive an external opaque display (e.g., a smartphone). A head-mounted system may incorporate one or more imaging sensors for capturing images or video of the physical environment and / or one or more microphones for capturing audio of the physical environment. Instead of an opaque display, a head-mounted system may have a transparent or translucent display. A transparent or translucent display may have a medium through which light representing an image is directed towards a person's eye. The display can utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scan light source, or any combination of these technologies. The medium may be an optical waveguide, hologram medium, optical coupler, optical reflector, or any combination thereof. In one embodiment, a transparent or translucent display may be configured to selectively become opaque. A projection-based system can employ retinal projection technology that projects a graphic image onto a human retina. A projection system may also be configured to project virtual objects into the physical environment, for example, as a hologram or onto a physical surface.

[0089] As described above, one aspect of the present technology is to collect and use data available from various sources to accommodate different corrective lenses for different users in a head-mounted display unit. The present disclosure contemplates that in some instances, this collected data may include personally identifiable data that uniquely identifies a particular person, or personally identifiable data that can be used to contact or locate a particular person. Such personally identifiable data can include demographic data, location-based data, phone numbers, email addresses, Twitter IDs, home addresses, data or records regarding a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), birthdays, or any other identifying or personal information.

[0090] The present disclosure recognizes that the use of such personally identifiable data in the present technology can be a use that benefits the user. For example, personally identifiable data can be used to accommodate different corrective lenses for different users in a head-mounted display unit. Additionally, other uses of personally identifiable data that benefit the user are also contemplated by the present disclosure. For example, health data and fitness data can be used to provide insights into a user's overall well-being, or can be used as positive feedback to individuals who are using technologies to pursue wellness goals.

[0091] This disclosure contemplates that entities involved in the collection, analysis, disclosure, transfer, storage, or other use of such personal information data comply with robust privacy policies and / or privacy practices. Specifically, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or government requirements for maintaining the confidentiality of personal information data. Such policies should be readily accessible to users and updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and proper uses of the entity and not shared or sold except for those legitimate uses. Further, such collection / sharing should be done after informing and obtaining consent from the users. Further, such entities should consider taking all necessary measures to protect and secure access to such personal information data and ensure that others with access to such personal information data comply with their privacy policies and procedures. Further, such entities should be able to subject themselves to third-party evaluations to prove their compliance with widely accepted privacy policies and practices. Further, the policies and practices should be tailored to the specific types of personal information data being collected and / or accessed and should also comply with applicable laws and regulations, including jurisdiction-specific considerations. For example, in the United States, the collection or access to certain health data can be regulated by federal and / or state laws such as the Health Insurance Portability and Accountability Act (HIPAA), while health data in other countries can be subject to different regulations and policies and should be addressed accordingly. Therefore, different privacy practices should be maintained for different types of personal data in different countries.

[0092] Notwithstanding the foregoing, the present disclosure also contemplates embodiments that selectively block a user from using or accessing personal information data. That is, the present disclosure contemplates that hardware elements and / or software elements can be provided to prevent or block access to such personal information data. For example, when providing or accommodating corrective lenses in a head-mounted display unit, the technology can be configured to allow a user to select an "opt-in" or "opt-out" of participating in the collection of personal information data either during registration of the service or at any time thereafter. In another example, a user can choose not to provide personal information during an initialization process. In addition to providing "opt-in" and "opt-out" options, the present disclosure contemplates providing notice regarding access or use of personal information. For example, a user can be notified when downloading an app that will access the user's personal information data, and then be alerted again immediately before the personal information data is accessed by the app.

[0093] Furthermore, it is an aspect of the present disclosure that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. The risk can be minimized by restricting the collection of data and deleting it when it is no longer needed. Additionally, in certain health-related applications, when applicable, data anonymization can be used to protect a user's privacy. Anonymization can be facilitated, when appropriate, by removing certain identifiers (e.g., date of birth, etc.), controlling the amount or specificity of the data stored (e.g., collecting location data at the city level rather than the address level), controlling how the data is stored (e.g., aggregating the data across all users), and / or other means.

[0094] Therefore, while the present disclosure encompasses the use of personal information data for implementing one or more of the various disclosed embodiments, the present disclosure also contemplates that it is possible to implement those various embodiments without the need to access such personal information data. That is, the various embodiments of the present technology are not rendered inoperable by the absence of all or a portion of such personal information data. For example, the configuration indicators and / or compliance indicators may be based on non-personal information data, such as content required by a device associated with a user, other non-personal information available to the lens provider, or publicly available information, or a minimal amount of personal information.

Claims

1. A display, A removable lens removably attachable to the display, the removable lens including a lens tag including an optical marking, A lens detection sensor for detecting the removable lens attached to the display and observing the optical marking of the lens tag, A controller, Confirm lens information from the optical marking of the lens tag, the lens information including prescription information and refractive characteristics of the removable lens, Confirm identification information of the user based on an image of the user's eyes acquired by the lens detection sensor, the identification information of the user including eye characteristic information, and the eye characteristic information including refractive anomalies of the user's eyes, A controller that determines whether the removable lens is suitable for the user by comparing the refractive characteristics of the removable lens with the refractive anomalies of the user's eyes, A display system comprising.

2. The display system according to claim 1, wherein the lens information includes a lens identifier.

3. The display system according to claim 1 or 2, wherein the display system determines the lens information from the removable lens using the lens detection sensor.

4. The display system according to claim 3, wherein the lens information is electronically stored by the removable lens and the lens detection sensor electronically receives the lens information.

5. The display system according to claim 3, wherein the lens detection sensor reads the optical marking to confirm the lens information.

6. The display system according to claim 5, wherein the lens detection sensor is an eye camera for observing the user's eyes.

7. The display system according to claim 6, wherein the display system uses iris detection to identify the user with the eye camera.

8. The display system according to claim 6, wherein the display system determines an identifier from the removable lens and determines lens characteristics stored in association with the removable lens, the lens characteristics including refractive characteristics.

9. The display system according to any one of claims 1 to 8, further comprising a head-mounted display unit including the display.

10. The display system provides a configuration indicator that is provided regardless of the user, The display system according to claim 9, wherein the configuration indicator can be viewed by the user through the removable lens assembly.

11. The display system according to claim 9, wherein the display system provides a compatibility indicator indicating that the removable lens is not compatible with the user.

12. The removable lens has a corrective lens element, a frame coupled to the corrective lens element, and a mechanical coupling mechanism coupled to the frame, The head-mounted display unit has a display module including the display and a corresponding mechanical coupling mechanism, The display system according to any one of claims 9 to 11, wherein the mechanical coupling mechanism is receivable by the corresponding mechanical coupling mechanism to removably couple the removable lens assembly to the head-mounted display unit.

13. The display module includes a lens mount including the corresponding mechanical coupling mechanism, and the removable lens assembly can be removably coupled to the display module, The mechanical coupling mechanism engages with the corresponding mechanical coupling mechanism to prevent the removable lens assembly with respect to the head-mounted display unit from moving laterally, along, and around the optical axis of the corrective lens element, The removable lens assembly further includes a magnetic coupling mechanism spaced apart from the mechanical coupling mechanism, whereby the removable lens assembly can be magnetically coupled to the head-mounted display unit. The display system according to claim 12.

14. The display system according to claim 12 or 13, further comprising a second display module and a second removable lens assembly, wherein the display module and the removable lens assembly are for association with a first eye of a user, and the second display module and the second removable lens assembly are for association with a second eye of the user.

Citation Information

Patent Citations

  • System for providing and diagnosing contact lens

    JP2003228623A

  • Photographing system

    JP2007328156A

  • Dyeing inspection method of spectacle lens, dyeing inspection apparatus of spectacle lens, and method of manufacturing spectacle lens

    JP2009109442A

  • Work-piece processor

    JP2011233080A

  • Sales system of contact lens and sales method

    JP2014102860A