Mixed reality device and system

Abstract

Mixed reality devices and systems are disclosed. The disclosed mixed reality displays can include an optical system sized to project a mixed reality image to a user such that a projection angle determines an area hidden from a peripheral view of the user. The mixed reality displays can also include one or more hardware components electrically coupled to the optical system and sized to fit within the area such that the one or more hardware components are hidden from the user. Further, the mixed reality displays can include a frame coupled to hold the optical system and the one or more hardware components, where edges of the frame are sized to fit within the area. Various other devices, systems, and methods are also disclosed.

Description

Cross-reference to related applications

[0001] This application claims the benefit of U.S. Provisional Application No. 63 / 727,597, filed December 3, 2024, and U.S. Non-Provisional Patent Application No. 19 / 397,348, filed November 21, 2025, the disclosures of which are incorporated herein by reference in their entirety. Technical Field

[0002] This disclosure generally relates to apparatus, systems, and methods for manufacturing mixed reality displays that reduce visual boundaries. Background Technology

[0003] Virtual reality (VR) uses computer-generated environments to simulate immersive environments for users through devices such as VR headsets. Some head-mounted devices may also include occluders such as goggles, which intentionally block light to keep the user focused on the digital image. In particular, augmented reality (AR) and mixed reality (MR) technologies can incorporate virtual elements into real-world imaging to create augmented environments for users that still allow them to interact with the real world, rather than replacing it. Summary of the Invention

[0004] Embodiments of this disclosure can improve the seamless transition between virtual optics and the real world by constructing mixed reality devices with reduced bezels. By integrating an optical system that projects digital images at an angle, the apparatus, systems, and methods described herein can determine a cone or region (e.g., the field of view of a display) where digital content is visible but real-world elements are not. The disclosed apparatus, systems, and methods can then arrange other computing components (e.g., cameras, sensors, image processors, or other hardware) within the cone and behind the projected digital image. Furthermore, the disclosed apparatus, systems, and methods can reduce the bezel of the frame by thinning the edges of the glasses so that the frame's bezel aligns with the angle of the cone. By ensuring that the shape and components of the device are within the hidden region of the cone, the apparatus, systems, and methods described herein can improve the transition between digital images and the real-world environment visible from the user's peripheral vision. The disclosed apparatus, systems, and methods can also incorporate dimmable windows around the digital projection to provide flexibility for immersive virtual reality or open mixed reality. For example, by utilizing electrochromic glass, the transparent window can be arbitrarily colored to switch between digital immersion and integration with reality. By utilizing a relatively small field-of-view display, the disclosed apparatus, systems, and methods can provide a better immersive experience using virtually borderless devices. Using magnified projection with more angled digital light from the projected image, the apparatus, systems, and methods described herein can achieve a larger field of view from a smaller display, thereby creating more space to add other components to the device. Therefore, the disclosed apparatus, systems, and methods can improve upon the conventional design of mixed reality devices and systems. Attached Figure Description

[0005] The accompanying drawings illustrate several exemplary embodiments and are part of the specification. These drawings, together with the following description, illustrate and explain various principles of this disclosure.

[0006] Figure 1 This is a flowchart of an exemplary method for manufacturing mixed reality devices and systems.

[0007] Figure 2 This is an illustration of example components and optics for a mixed reality display.

[0008] Figure 3 This is a block diagram of an example construction of a mixed reality image.

[0009] Figure 4 This is an illustration of an example mixed reality system displaying mixed reality images.

[0010] Figure 5 This is an illustration of an example mixed reality system, where the example area is hidden from the user's peripheral view.

[0011] Figure 6This is an illustration of another example mixed reality system with an example dimmable window.

[0012] Figure 7 This is an illustration of an example artificial reality system according to some embodiments of the present disclosure.

[0013] Figure 8 This is an illustration of an example artificial reality system with a handheld device according to some embodiments of the present disclosure.

[0014] Figure 9A These are illustrations of example user interactions within an artificial reality system according to some embodiments of the present disclosure.

[0015] Figure 9B These are illustrations of example user interactions within an artificial reality system according to some embodiments of the present disclosure.

[0016] Figure 10A These are illustrations of example user interactions within an artificial reality system according to some embodiments of the present disclosure.

[0017] Figure 10B These are illustrations of example user interactions within an artificial reality system according to some embodiments of the present disclosure.

[0018] Figure 11 This is an illustration of an example wrist-worn wearable device of an artificial reality system according to some embodiments of the present disclosure.

[0019] Figure 12 This is an illustration of an example wearable artificial reality system according to some embodiments of the present disclosure.

[0020] Figure 13 This is an illustration of an example augmented reality system according to some embodiments of the present disclosure.

[0021] Figure 14A This is an illustration of an example virtual reality system according to some embodiments of the present disclosure.

[0022] Figure 14B yes Figure 14A The illustration shows another perspective of the virtual reality system.

[0023] Figure 15 It is a block diagram showing the system components of an example artificial reality system and a virtual reality system.

[0024] Throughout the accompanying drawings, the same reference numerals and descriptions indicate similar but not necessarily identical elements. While the exemplary embodiments described herein are readily adaptable and have alternative forms, specific embodiments have been shown by way of example in the drawings and will be described in detail herein. However, the exemplary embodiments described herein are not intended to be limited to the specific forms disclosed. Rather, this disclosure covers all modifications, equivalents, and alternatives falling within the scope of the appended claims. Detailed Implementation

[0025] Virtual reality (VR) uses computer-generated environments to simulate immersive environments for users through devices such as VR headsets. Some head-mounted devices may also include occluders such as goggles, which intentionally block light to keep the user focused on the digital image. In particular, augmented reality (AR) and mixed reality (MR) technologies can incorporate virtual elements into real-world imaging to create augmented environments for users that still allow them to interact with the real world, rather than replacing it.

[0026] To enable users to experience the real world while wearing MR devices, some traditional solutions utilize a facial interface that creates a greater distance between the device and the user's face to increase the space for peripheral vision. Other traditional devices can use more open shape elements, such as glasses, to allow users to see content beyond the digital display. For example, MR glasses allow users to see the physical environment around their eyes while providing overlay of digital content within the lenses. However, MR glasses typically integrate a large number of computing components into the frame, resulting in a thick frame that can partially obstruct peripheral vision and disrupt the user's immersion. This boundary disrupts the transition between the image generated by the glasses and the peripheral vision of the real-world environment. Therefore, better methods for manufacturing and designing MR devices are needed to provide users with a more seamless visual experience.

[0027] This disclosure generally relates to apparatus, systems, and methods for manufacturing mixed reality displays with reduced visual boundaries. As will be described in more detail below, embodiments of this disclosure can improve the seamless transition between virtual optics and the real world by constructing mixed reality devices with reduced bezels. By integrating an optical system that projects digital images at an angle, the apparatus, systems, and methods described herein can determine a cone or region (e.g., the display's field of view) where digital content is visible but real-world elements are not. The disclosed apparatus, systems, and methods can then arrange other computing components (e.g., cameras, sensors, image processors, or other hardware) within the cone and behind the projected digital image. Furthermore, the disclosed apparatus, systems, and methods can reduce the frame's bezel by thinning the edges of the glasses so that the frame's bezel aligns with the angle of the cone. By ensuring that the shape and components of the device are within the hidden region of the cone, the apparatus, systems, and methods described herein can improve the transition between digital images and the real-world environment visible from the user's peripheral vision. The disclosed apparatus, systems, and methods can also incorporate dimmable windows around the digital projection to provide flexibility for immersive virtual reality or open mixed reality. For example, by utilizing electrochromic glass, transparent windows can be tinted at will to switch between digital immersion and integration with reality. Using a relatively small field-of-view display, the disclosed apparatus, systems, and methods can provide a better immersive experience with virtually borderless devices. Using magnified projections of digital light with more tilt from the projected image, the apparatus, systems, and methods described herein can achieve a larger field of view from a smaller display, thereby creating more space to add other components to the device. Therefore, the disclosed apparatus, systems, and methods can improve upon the conventional design of mixed reality devices and systems.

[0028] Based on the general principles described herein, multiple features from any of the various embodiments described herein can be combined with each other. These and other embodiments, features, and advantages will be more fully understood when reading the following detailed description in conjunction with the accompanying drawings and claims.

[0029] refer to Figure 1 The following section provides a detailed description of an exemplary method for manufacturing a mixed reality display with reduced boundaries. This will be combined with... Figure 2 This will describe in detail the example components and optics of a mixed reality display. (The description will be combined with...) Figure 3 This will provide a detailed description of example constructions for mixed reality images. Furthermore, it will combine... Figure 4 A detailed description of an example mixed reality system for displaying mixed reality images is provided. Furthermore, it will be combined with... Figure 5 Provides a detailed description of an example mixed reality system with an example area hidden from the user's peripheral view. Finally, it will be combined with... Figure 6Provides a detailed description of another example mixed reality system with an example dimmable window.

[0030] Figure 1 Example methods are shown for manufacturing, assembling, using, adjusting, or otherwise configuring or creating the systems and apparatuses presented herein. Figure 1 The steps shown can be performed by any individual and / or by any suitable type or form of manual and / or automated device. In particular, Figure 1 A flowchart of an exemplary method 100 for manufacturing is shown. In one example, Figure 1 Each of the multiple steps shown can represent an algorithm whose structure includes and / or is represented by multiple sub-steps, examples of which will be provided in more detail below.

[0031] like Figure 1 As shown, in step 110, one or more of the systems described herein can be sized to project a mixed reality image onto the user, such that the projection angle determines the area hidden from the user's peripheral view. For example, as Figure 2 As shown, the mixed reality display 200 may include an optical system 202 sized to project a mixed reality image onto a user 214, such that the projection angle 204 determines the area 206 hidden from the user 214's peripheral view.

[0032] The system described herein can perform step 110 in a variety of ways. As used herein, the terms “artificial reality” and “virtual reality” broadly refer to any form of system that creates digitally augmented content for a three-dimensional environment. As used herein, the terms “augmented reality” and “mixed reality” broadly refer to any form of virtual reality system that combines digital content with a real-world environment.

[0033] In some embodiments, the optical system 202 is sized to project a mixed reality image to the user 214 by magnifying the mixed reality image, wherein the projection angle 204 increases with the magnification. In some examples, for example Figure 2For example, optical system 202 may include digital pass-through display 210 configured to display mixed reality images as a mixture of real-world images and one or more virtual elements. As used herein, the term "digital pass-through display" broadly refers to a method of displaying digital images to replicate a view behind the display as if the display were transparent. In these examples, optical system 202 may also include a projector 212 positioned near the digital pass-through display 210 to project mixed reality images to user 214 using pancake optics. As used herein, the term "pancake optics" broadly refers to an optical imaging method that uses folded optical paths (e.g., back-and-forth reflections) for compact and high-quality imaging. For example, pancake optics may include a combination of reflective polarizing films, waveplates, and semi-reflective mirrors to fold the optical path of the digital pass-through display, thereby forming a thinner overall optical system 202. Figure 2 In the example, the folded light path is tilted and magnified by the pancake optics and directed to the position of the user 214's eye 216. The image reaching the pupil 218 of the eye 216 is magnified from the image displayed on the digital pass-through display 210, and the projection angle 204 creates a field of view (FOV) diameter for the mixed reality image that is wider than the original diameter of the digital pass-through display 210. As used herein, the term "field of view" broadly refers to a measurement of the visible range from a particular point, such as the arc around the focal point measured in degrees. In one example, the FOV could extend to a 200-degree arc around the eye 216.

[0034] In some examples, the projection angle 204 can be adjusted to achieve a specific field of view (FOV) for the mixed reality image. For example, the design of the optical system 202 can be varied based on eye relief, eye frame, gaze angle, and / or other factors to allow virtual elements to blend with the real-world image and be projected at various distances. For example, the optical system 202 can project virtual elements to appear closer to the user 214 than real-world elements. In these examples, the term "eye relief" broadly refers to the distance from the rear lens and pupil 218 of the optical system 202, the term "eye frame" broadly refers to the area where the eye 216 can move while still being able to view the mixed reality image, and the term "gaze angle" broadly refers to the angle between the line of sight of the eye 216 and the line between the eye 216 and the optical system 202.

[0035] In other embodiments, the optical system 202 may utilize alternative methods to project mixed reality images. For example, the optical system 202 may use a light field display that projects three-dimensional holographic images. As another example, the optical system 202 may use a method of multiple folding of the line of sight. In these embodiments, the optical system 202 may combine any form of image projection that results in a field of view (FOV) larger than the physical display, such that components within the FOV and behind the projected mixed reality image appear hidden to the user 214.

[0036] In step 120, one or more systems of the plurality of systems described herein may electrically couple one or more hardware components to the optical system and sized the one or more hardware components to fit within the region, such that the one or more hardware components are hidden from the user. For example, as Figure 2 As shown, the mixed reality display 200 may include a hardware component 208 electrically coupled to the optical system 202, and its size is configured to fit within the region 206 such that the hardware component 208 is hidden from the user 214.

[0037] The system described herein can perform step 120 in a variety of ways. In one example, hardware component 208 may include one or more cameras that acquire real-world images and transmit them to an image processing component. Additionally or alternatively, hardware component 208 may include one or more image processing components electrically coupled to one or more cameras and optical system 202 to convert real-world images into mixed reality images. In some examples, the image processing component may be configured to convert real-world images by: adjusting the real-world images to blend with the peripheral view of user 214; combining the real-world images with one or more virtual elements; and transmitting the mixed reality images to optical system 202.

[0038] exist Figure 3In one example, the mixed reality system 300 may include a camera 302 representing hardware component 208 (1), which captures a real-world image 304 representing the real world that is obscured by optical system 202 and cannot be seen. In this example, camera 302 may transmit the real-world image 304 to an image processing component 306 representing hardware component 208 (2). In this example, image processing component 306 may combine the real-world image 304 with virtual elements 308, and / or may generate virtual elements 308 to combine with image processing component 306. In this example, image processing component 306 may then create a mixed reality image 310 and transmit the mixed reality image 310 to optical system 202, which may then project the mixed reality image 310 to user 214. In some examples, image processing component 306 may process the real-world image 304 and virtual elements 308 separately and send them to optical system 202 for projection at varying distances.

[0039] like Figure 4 As shown, the mixed reality system 300 may include a digital pass-through display 210 that displays a mixed reality image 310. In this example, the mixed reality image 310 may include a real-world image 304 captured by a camera, which is then adjusted to match the position and size of the peripheral view 402. In this example, the camera may capture the real-world image 304 based on the field of view (FOV) of the projected mixed reality image 310 to ensure a match with the peripheral view 402, making the mixed reality image 310 appear naturally adjacent to the peripheral view 402. In other examples, the real-world image 304 may be adjusted based on preferred effects. Figure 4 In one example, the virtual element 308 of the digital menu can be overlaid on the real-world image 304 to create a mixed reality image 310. In some examples, the virtual element 308 and the real-world image 304 can first be combined into a single image and then projected to the user 214. In other examples, the virtual element 308 and the real-world image 304 can be projected to the user 214 separately.

[0040] In some examples, camera 302 may be designed to capture the real-world environment that user 214 will see in real time, thereby creating a seamless transition between the mixed reality image 310 from digital pass-through display 210 and the peripheral view 402. In these examples, image processing unit 306 may adjust the real-world image 304 to visually fit the position of pupil 218. In these examples, camera 302 may be positioned along the edge of the frame or at another location, and image processing unit 306 may correct any distortion so that the real-world image 304 appears to be captured from the position of pupil 218. For example, placing camera 302 on the same axis as pupil 218 and closer to pupil 218 may require less distortion correction than placing camera 302 away from pupil 218. In some examples, image processing unit 306 may use calculations and / or any other suitable calculations based on the position of pupil 218, the position of camera 302, the position of digital pass-through display 210, the position of projector 212, and so on. Furthermore, multiple cameras at different locations can be combined to generate a more accurate real-world image 304 from the perspective of the pupil 218. Various other algorithms and / or optical solutions can also be used to achieve a more accurate real-world image 304.

[0041] like Figure 2 As shown, hardware component 208 and similar Figure 5 Hardware components 208(1) and 208(2) may be positioned along the top bar of the mixed reality system 300 and remain hidden within region 206. In these embodiments, hardware components 208, 208(1), and 208(2) are positioned between the edge of the FOV of the mixed reality image and the edge of the digital pass-through display 210. In these embodiments, the FOV of the mixed reality image may obscure other components of the mixed reality system 300. In other embodiments, various numbers of hardware components may be positioned within the FOV such that all components are hidden and not visible. In various examples, hardware components may include integrated circuits, sensors, aggregators, and / or any other suitable components having a physical form. In the above embodiments, region 206 may typically form a cone extending outward from eye 216 to surround the projected mixed reality image. Although in Figure 2 and Figure 5 Various hardware components are shown positioned along the top of the mixed reality system 300, but these components may be distributed throughout the mixed reality system 300, for example, along the bottom or sides or behind other components, within region 206.

[0042] In one embodiment, Figure 2The projection angle 204 can be adjusted based on the magnification of the optical system 202. For example, organic light-emitting diodes (OLEDs) can increase the pixel density of the display, while micro-OLEDs can further increase the pixel density. Due to the high pixel density, the optical system 202 can utilize a larger projection angle 204, which further increases the size of the cone representing region 206. Additionally or alternatively, technologies such as tethered computing or cloud computing can be used to reduce the number of hardware components integrated with the mixed reality system 300, thereby reducing the total footprint required by the hardware components. Furthermore, reducing the number of hardware components also reduces the inner diameter of the optical system 202, resulting in a more compact device. These embodiments make it easier to include all hardware components within region 206.

[0043] In step 130, one or more of the systems described herein can couple a frame to hold the optical system and one or more hardware components, wherein the dimensions of the frame's edges are set to fit within the region. For example, as Figure 5 As shown, the mixed reality system 300 may include a frame 502 coupled to the optical system 202 and hardware components 208(1), 208(2) to hold the optical system 202 and hardware components 208(1), 208(2), wherein the dimensions of the edge 504 of the frame 502 are set to fit within the region 206.

[0044] The system described herein can perform step 130 in several ways. In one embodiment, the edge 504 of frame 502 can be tilted to minimize the visible border of frame 502. As used herein, the term "border" broadly refers to a frame or ring surrounding a display to hold it in place, wherein the border may have a visible edge surrounding the display. For example, the border can be reduced to conform to... Figure 2 The projection angle is 204, where the edge material outside region 206 is removed. Although in Figure 5 While shown as mixed reality glasses or goggles, the mixed reality system 300 can represent other shape elements, such as a head-mounted viewer or alternative display system that holds hardware and optical components in place. Furthermore, the mixed reality system 300 can be a larger or smaller shape element.

[0045] In other embodiments, such as in Figure 5 In one example, the mixed reality system 300 may include a dimmable window 506 coupled to a frame 502, such that the dimmable window 506 extends beyond the optical system 202 to cover at least a portion of the user 214’s peripheral view 402, as... Figure 4As shown. In these embodiments, the dimmable window 506 may include electrochromic glass that changes its hue in response to an electrical signal from the frame. As used herein, the term "electrochromic glass" broadly refers to glass or plastic whose hue can be electrically changed to transparent or opaque by applying a voltage to the glass or plastic. In these embodiments, the electrical signal may affect electrons in the dimmable window 506 to change the way the material reflects and transmits light, thereby changing its hue. In these embodiments, the hue of the dimmable window 506 may include a transparent hue, a partial hue, a gradient hue, an opaque hue, and / or any other adjustable form of hue. For example, the dimmable window 506 may include a darker hue at the top and a gradient towards a transparent hue along the bottom edge. In the above embodiments, individual dimmable windows may be paired with each eye, and the hue of each dimmable window may be set to the same hue or different hues.

[0046] exist Figure 6 In one example, the dimmable window 506 may be located behind and around the digital pass-through display 210. In this example, the dimmable window 506 may optionally be tinted to provide a more immersive experience for the user 214 focusing on the mixed reality image 310. In other examples, the dimmable window 506 may be set to a transparent tint so that the user 214 can see the mixed reality image 310 seamlessly transition to the peripheral view 402. In one example, the dimmable window 506 may be set to opaque to block light from the user's environment, such as for a virtual cinema experience focused on a display projected by the optical system 202. Therefore, in addition to digital dimming from the digital pass-through display 210, the dimmable window 506 also provides mechanical dimming for the mixed reality system 300.

[0047] Although described primarily for mixed reality systems, the disclosed systems and methods can be applied to other forms of optics, such as VR optics, see-through optics, and / or other types of devices. In one example, the disclosed mixed reality system can be combined with other borderless or open-periphery systems, for example, by combining see-through and transmission optics. In some examples, the disclosed system can use a zoom camera and / or a zoom display to enable adjustment of the lens distance, for example, to take into account the user's eye focusing distance. In other examples, in addition to electrochromic windows, the disclosed system can be combined with other low-resolution displays or other optics.

[0048] As described above Figure 1As described in method 100, the disclosed system and method can identify an area extending from the field of view of the digital display, where hardware and optical components can be placed outside the field of view of the user wearing the mixed reality device. By ensuring that all components and the frame of the device are within the conical area, the disclosed system and method can improve the experience of seamlessly viewing the mixed reality display and the real-world environment visible from the periphery. Furthermore, the disclosed system and method can improve the quality of the device by reducing the frame border. Additionally, the disclosed system and method achieve a flexible choice between seamless mixed reality and immersive virtual reality by adding an electrochromic window around the digital display. Therefore, the system and method described herein can improve upon conventional methods of creating mixed reality experiences by reducing the boundaries around the digital image and improving the transition between the digital and real worlds.

[0049] Example Implementation Example 1: A mixed reality display may include: an optical system sized to project a mixed reality image to a user such that the projection angle determines an area hidden from the user's peripheral view; at least one hardware component electrically coupled to the optical system and sized to fit within the area such that the at least one hardware component is hidden from the user; and a frame coupled to hold the optical system and the at least one hardware component, wherein the dimensions of the edges of the frame are sized to fit within the area.

[0050] Example 2: According to the mixed reality display of Example 1, the optical system can project a mixed reality image to a user by magnifying the mixed reality image, wherein the projection angle increases with the increase of magnification.

[0051] Example 3: A mixed reality display according to any of Examples 1 and 2, wherein the optical system may include: a digital pass-through display configured to display a mixed reality image as a mixture of a real-world image and at least one virtual element; and a projector disposed near the digital pass-through display to project the mixed reality image to a user using pancake optics.

[0052] Example 4: According to the mixed reality display of Example 3, at least one hardware component may include at least one of the following: a camera that captures a real-world image and transmits the real-world image to an image processing component; and / or an image processing component electrically coupled to the camera and an optical system to convert the real-world image into a mixed reality image.

[0053] Example 5: According to the mixed reality display of Example 4, the image processing unit can transform a real-world image by: adjusting the real-world image to blend with the user's peripheral view; combining the real-world image with at least one virtual element; and transmitting the mixed reality image to an optical system.

[0054] Example 6: A mixed reality display according to any of Examples 1 to 5, wherein the edges of the frame can be tilted to minimize the visible border of the frame.

[0055] Example 7: A mixed reality system may include a mixed reality display, which may include: an optical system sized to project a mixed reality image onto a user such that the projection angle determines an area hidden from the user's peripheral view; at least one hardware component electrically coupled to the optical system and sized to fit within the area such that the at least one hardware component is hidden from the user; and a frame coupled to hold the optical system and the at least one hardware component, wherein the dimensions of the edges of the frame are sized to fit within the area. The mixed reality display may further include a dimmable window coupled to the frame such that the dimmable window extends beyond the optical system to cover at least a portion of the user's peripheral view.

[0056] Example 8: According to the mixed reality system of Example 7, the optical system projects a mixed reality image to a user by magnifying the mixed reality image, wherein the projection angle increases with the increase of magnification.

[0057] Example 9: A mixed reality system according to any of Examples 7 and 8, wherein the optical system may include: a digital pass-through display configured to display a mixed reality image as a mixture of a real-world image and at least one virtual element; and a projector disposed near the digital pass-through display to project the mixed reality image to a user using pancake optics.

[0058] Example 10: In the mixed reality system according to Example 9, at least one hardware component may include at least one of the following: a camera that acquires a real-world image and transmits the real-world image to an image processing component; and / or an image processing component electrically coupled to the camera and the optical system to convert the real-world image into a mixed reality image.

[0059] Example 11: According to the mixed reality system of Example 10, the image processing unit can transform a real-world image by: adjusting the real-world image to blend with the user's peripheral view; combining the real-world image with at least one virtual element; and transmitting the mixed reality image to an optical system.

[0060] Example 12: A mixed reality system according to any of Examples 7 to 11, wherein the edges of the frame can be tilted to minimize the visible border of the frame.

[0061] Example 13: A mixed reality system according to any of Examples 7 to 12, wherein the dimmable window may include electrochromic glass that changes the hue of the dimmable window in response to an electrical signal from a frame.

[0062] Example 14: In the mixed reality system according to Example 13, the hue of the dimmable window may include at least one of the following: a transparent hue; a local hue; a gradient hue; and / or an opaque hue.

[0063] Example 15: A method of manufacturing a mixed reality display may include: sizing an optical system to project a mixed reality image onto a user, such that the projection angle determines an area hidden from the user's peripheral view; electrically coupling at least one hardware component to the optical system and sizing the at least one hardware component to fit within the area, such that the at least one hardware component is hidden from the user; and coupling a frame to hold the optical system and the at least one hardware component, wherein the dimensions of the edges of the frame are sizing to fit within the area.

[0064] Example 16: According to the method of Example 15, the size of the optical system can be set to project a mixed reality image to a user by magnifying the mixed reality image, wherein the projection angle increases with the increase of magnification.

[0065] Example 17: The method according to any of Examples 15 and 16, wherein the optical system may include: a digital pass-through display configured to display a mixed reality image as a mixture of a real-world image and at least one virtual element; and a projector disposed near the digital pass-through display to project the mixed reality image to a user using pancake optics.

[0066] Example 18: According to the method of Example 15, at least one hardware component may include at least one of the following: a camera that acquires a real-world image and transmits the real-world image to an image processing component; and / or an image processing component electrically coupled to the camera and an optical system to convert the real-world image into a mixed reality image.

[0067] Example 19: According to the method of Example 18, the image processing component can be configured to transform a real-world image by: adjusting the real-world image to blend with the user's peripheral view; combining the real-world image with at least one virtual element; and transmitting the mixed reality image to an optical system.

[0068] Example 20: The method described according to any of Examples 15 to 19 may further include: tilting the edges of the frame to minimize the visible border of the frame.

[0069] The embodiments of this disclosure may include various types of Artificial-Reality (AR) systems, or combinations thereof. AR can be any overlay of functionality and / or sensorily detectable content presented by an AR system within the user's physical environment. In other words, AR is a form of reality that has been adjusted in some way before being presented to the user. AR may include and / or represent virtual reality (VR), augmented reality, mixed AR (MAR), or some combination and / or variation of these types of reality. Similarly, AR environments may include VR environments (including non-immersive VR environments, semi-immersive VR environments, and fully immersive VR environments), augmented reality environments (including marked augmented reality environments, unmarked augmented reality environments, location-based augmented reality environments, and projection-based augmented reality environments), mixed reality environments, and / or any other type or form of mixed reality environment or alternative reality environment.

[0070] AR content can include entirely computer-generated content or computer-generated content combined with acquired (e.g., real-world) content. Such AR content can include video, audio, haptic feedback, or some combination thereof, any of which can be presented in a single channel or multiple channels (e.g., stereoscopic video that produces a three-dimensional (3D) effect for the viewer). Additionally, in some embodiments, AR can also be associated with applications, products, accessories, services, or some combination thereof, which are used, for example, to create content in artificial reality and / or otherwise for use in artificial reality (e.g., to perform activities in artificial reality).

[0071] AR systems can be implemented in a variety of different shapes and configurations. Some AR systems can be designed to operate without a near-eye display (NED). Other AR systems may include NEDs that also provide visibility into the real world (e.g., Figure 13Augmented reality systems (1300) or NEDs that visually immerse users in artificial reality (e.g., Figure 14A and Figure 14B (Virtual Reality System 1400). While some AR devices may be standalone systems, others may communicate with and / or collaborate with external devices to provide an AR experience to the user. Examples of such external devices include handheld controllers, mobile devices, desktop computers, devices worn by the user, devices worn by one or more other users, and / or any other suitable external system.

[0072] Figures 7 to 10B An example artificial reality (AR) system according to some embodiments is shown. Figure 7 The first AR system 700 and a first example user interaction are shown, which uses a wrist wearable device 702, a head wearable device (e.g., AR glasses 704) and / or a handheld intermediary processing device (HIPD) 706. Figure 8 A second AR system 800 and a second example user interaction are shown, which use a wrist wearable device 802, AR glasses 804 and / or HIPD 806. Figure 9A and Figure 9B The interaction between a third AR system 900 and a third example user 908 is shown, which uses a wrist wearable device 902, a head wearable device (e.g., a VR headset 950) and / or a HIPD 906. Figure 10A and Figure 10B The interaction between a fourth AR system 1000 and a fourth example user 1008 is shown, the fourth example user 1008 interacting using a wrist wearable device 1030, a VR head-mounted viewer 1020 and / or a haptic device 1060 (e.g., wearable gloves).

[0073] The following is for reference. Figure 11 and Figure 12 To describe a wrist-worn wearable device 1100 that can be used as a wrist-worn wearable device 702, 802, 902, 1030 and one or more of its components; see below for reference. Figures 13 to 15 Describe head-worn wearable devices 1300 and 1400 that can be used as AR glasses 704, 804 or VR head-mounted viewers 950, 1020, respectively, and one or more of their components.

[0074] refer to Figure 7The wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706 can be communicatively coupled via a network 725 (e.g., cellular, near-field, Wi-Fi, personal area network, wireless local area network (LAN), etc.). Furthermore, the wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706 can also be communicatively coupled via the network 725 (e.g., cellular, near-field, Wi-Fi, personal area network, wireless local area network, etc.) to one or more servers 730, one or more computers 740 (e.g., laptops, computers, etc.), one or more mobile devices 750 (e.g., smartphones, tablets, etc.), and / or other electronic devices.

[0075] exist Figure 7 The image shows a user 708 wearing a wrist-worn wearable device 702 and AR glasses 704, with a HIPD 706 placed on their table. The wrist-worn wearable device 702, AR glasses 704, and HIPD 706 facilitate the user's interaction with the AR environment. Specifically, as shown in the first AR system 700, the wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706 enable the presentation of one or more avatars 710, digital representations 712 of one or more contacts, and one or more virtual objects 714. As discussed below, the user 708 can interact with the one or more avatars 710, the digital representations 712 of one or more contacts, and the one or more virtual objects 714 through the wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706.

[0076] User 708 can use any of the wrist wearable device 702, AR glasses 704, and / or HIPD 706 to provide user input. For example, user 708 can perform actions by the wrist wearable device 702 (e.g., using the reference below). Figure 11 and Figure 12 One or more EMG sensors and / or IMUs described) and / or AR glasses 704 (e.g., using the reference below) Figures 13 to 15This describes one or more gestures detected by one or more image sensors or cameras to provide user input. Alternatively or additionally, user 708 may provide user input via one or more touch surfaces of the wrist wearable device 702, AR glasses 704, or HIPD 706; and / or voice commands acquired by the microphones of the wrist wearable device 702, AR glasses 704, and / or HIPD 706. In some embodiments, the wrist wearable device 702, AR glasses 704, and / or HIPD 706 includes a digital assistant to assist user 708 in providing user input (e.g., completing a sequence of actions, suggesting different actions or commands, providing reminders, confirming commands, etc.). In some embodiments, user 708 may provide user input via one or more facial gestures and / or facial expressions. For example, the cameras of the wrist wearable device 702, AR glasses 704, and / or HIPD 706 may track the eyes of user 708 for navigating the user interface.

[0077] The wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706 can operate independently or in combination to allow user 708 to interact with the AR environment. In some embodiments, HIPD 706 is configured to operate as a central hub or control center for the following devices: wrist-worn wearable device 702; AR glasses 704; and / or another communication-coupled device. For example, user 708 can provide input at any of the wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706 to interact with the AR environment, and HIPD 706 can identify one or more backend and frontend tasks to perform the requested interaction and distribute instructions to execute the one or more backend and frontend tasks at the wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706. In some embodiments, backend tasks are user-insensible background processing tasks (e.g., rendering content, decompressing, compressing, etc.), and frontend tasks are user-insensible user-facing tasks (e.g., presenting information to the user, providing feedback to the user, etc.). HIPD 706 can perform backend tasks and provide operational data corresponding to the backend tasks to the wrist wearable device 702 and / or AR glasses 704, enabling the wrist wearable device 702 and / or AR glasses 704 to perform frontend tasks. In this way, HIPD 706 (which has more computing resources and greater thermal headroom than the wrist wearable device 702 and / or AR glasses 704) performs computationally intensive tasks and reduces the computing resource utilization and / or power consumption of the wrist wearable device 702 and / or AR glasses 704.

[0078] In the example shown in the first AR system 700, HIPD 706 identifies one or more backend and frontend tasks associated with a user request initiating an AR video call with one or more other users (represented by avatar 710 and digital representations of contacts 712), and issues instructions to execute the one or more backend and frontend tasks. Specifically, HIPD 706 performs backend tasks for processing and / or rendering image data (and other data) associated with the AR video call, and provides AR glasses 704 with operational data associated with the performed backend tasks, causing AR glasses 704 to perform frontend tasks for presenting the AR video call (e.g., presenting avatar 710 and digital representations of contacts 712).

[0079] In some embodiments, HIPD 706 can function as a focal point or anchor point for presenting information. This allows user 708 to generally know where the information is presented. For example, as shown in the first AR system 700, avatar 710 and digital representations 712 of contacts are presented above HIPD 706. Specifically, HIPD 706 and AR glasses 704 work together to determine the location for presenting avatar 710 and digital representations 712 of contacts. In some embodiments, information can be presented at a predetermined distance from HIPD 706 (e.g., within 5 meters). For example, as shown in the first AR system 700, virtual object 714 is presented on a table at a distance from HIPD 706. Similar to the examples above, HIPD 706 and AR glasses 704 can work together to determine the location for presenting virtual object 714. Alternatively, in some embodiments, the presentation of information is not constrained by HIPD 706. More specifically, the avatar 710, the digital representation of the contact 712, and the virtual object 714 do not need to be presented within the predetermined distance of the HIPD 706.

[0080] The user input provided at the wrist wearable device 702, AR glasses 704, and / or HIPD 706 is coordinated to enable the user to initiate, continue, and / or complete an operation using any device. For example, user 708 may provide user input to AR glasses 704 to cause AR glasses 704 to present a virtual object 714, and when the virtual object 714 is presented by AR glasses 704, user 708 may provide one or more gestures via wrist wearable device 702 to interact with and / or manipulate the virtual object 714.

[0081] Figure 8The image shows user 808 wearing wrist-worn wearable device 802 and AR glasses 804, and holding HIPD 806. In the second AR system 800, wrist-worn wearable device 802, AR glasses 804, and / or HIPD 806 are used to receive one or more messages and / or provide one or more messages to user 808's contacts. Specifically, wrist-worn wearable device 802, AR glasses 804, and / or HIPD 806 detect and coordinate one or more user inputs to initiate a messaging application and prepare to respond to messages received through the messaging application.

[0082] In some embodiments, user 808 launches an application on wrist wearable device 802, AR glasses 804, and / or HIPD 806 via user input, causing the application to launch on at least one device. For example, in a second AR system 800, user 808 performs a gesture associated with a command to launch a messaging application (represented by messaging user interface 816); wrist wearable device 802 detects the gesture; and based on determining that user 808 is wearing AR glasses 804, wrist wearable device 802 causes AR glasses 804 to present the messaging user interface 816 of the messaging application. AR glasses 804 may present the messaging user interface 816 to user 808 through its display (e.g., as shown in user 808's field of view 818). In some embodiments, the application launches and runs on a device (e.g., wrist wearable device 802, AR glasses 804, and / or HIPD 806) that detects user input to launch the application, and that device provides operational data to another device to cause the messaging application to be presented. For example, the wrist-worn wearable device 802 can detect user input to launch a messaging application, launch and run the messaging application, and provide operational data to the AR glasses 804 and / or HIPD 806 to enable the presentation of the messaging application. Alternatively, the application can be launched and run on a different device than the one that detected the user input. For example, the wrist-worn wearable device 802 can detect gestures associated with launching the messaging application and enable the HIPD 806 to run the messaging application and coordinate its presentation.

[0083] Furthermore, user 808 can provide user input at the wrist wearable device 802, AR glasses 804, and / or HIPD 806 to continue and / or complete an operation initiated on another device. For example, after launching a messaging application via the wrist wearable device 802, and while the messaging user interface 816 is presented on the AR glasses 804, user 808 can provide input at the HIPD 806 to prepare a reply (e.g., as indicated by a swipe gesture performed on the HIPD 806). The gesture performed by user 808 on the HIPD 806 can be provided and / or displayed on another device. For example, a swipe gesture performed on the HIPD 806 is displayed on the virtual keyboard of the messaging user interface 816 displayed by the AR glasses 804.

[0084] In some embodiments, the wrist wearable device 802, AR glasses 804, HIPD 806, and / or other communication-coupled devices may present one or more notifications to the user 808. The notification may be an indication of a new message, incoming call, application update, status update, etc. The user 808 may select the notification via the wrist wearable device 802, AR glasses 804, and / or HIPD 806, and may cause the application or action associated with the notification to be presented on at least one device. For example, the user 808 may receive a notification of receiving a message at the wrist wearable device 802, AR glasses 804, HIPD 806, and / or other communication-coupled devices, and provide user input at the wrist wearable device 802, AR glasses 804, and / or HIPD 806 to view the notification. The device that detects the user input may cause the application associated with the notification to be launched and / or the application associated with the notification to be presented on the wrist wearable device 802, AR glasses 804, and / or HIPD 806.

[0085] While the examples above describe coordinated input for interaction with messaging applications, user input can be coordinated to interact with any number of applications, including but not limited to gaming applications, social media applications, camera applications, web-based applications, and financial applications. For example, AR glasses 804 can present game application data to user 808, and HIPD 806 can be used as a controller to provide input to the game. Similarly, user 808 can use wrist wearable device 802 to activate the camera of AR glasses 804, and user 808 can use wrist wearable device 802, AR glasses 804, and / or HIPD 806 to manipulate image acquisition (e.g., zoom in or zoom out, apply filters, etc.) and acquire image data.

[0086] Users can interact with the devices disclosed herein in various ways. For example, such as Figure 9A and Figure 9B As shown, user 908 can interact with AR system 900 by wearing VR headset 950 while holding HIPD 906 and wearing wrist wearable device 902. In this example, AR system 900 allows the user to interact with game 910 by waving their arm. One or more of VR headset 950, HIPD 906, and wrist wearable device 902 can detect this gesture and, in response, can display sword fighting in game 910. Similarly, in Figure 10A and Figure 10B In this example, user 1008 can interact with AR system 1000 by wearing VR headset 1020 while wearing haptic device 1060 and wrist wearable device 1030. In this example, AR system 1000 allows the user to interact with game 1010 by waving their arm. One or more of VR headset 1020, haptic device 1060, and wrist wearable device 1030 can detect this gesture and, in response, can display a spell being cast in game 1010.

[0087] The following will now be discussed in more detail: the example AR systems already discussed more generally, devices for interacting with such AR systems, and other computing systems. For ease of reference, some descriptions are provided herein of devices and components that may be included in some or all of the example devices discussed below. Certain types of components described below may be more suitable for a particular set of devices and less suitable for different sets of devices. However, subsequent references to components described herein should be considered as being covered by the description provided.

[0088] In some of the embodiments discussed below, several example devices and systems, including electronic devices and systems, will be discussed. These example devices and systems are not intended to be limiting, and those skilled in the art will understand that alternative devices and systems to the example devices and systems described herein can be used to perform the various operations and construct the systems and devices described herein.

[0089] An electronic device can be a device that uses electrical energy to perform a specific function. An electronic device can be any physical object that contains electronic components, such as transistors, resistors, capacitors, diodes, and integrated circuits. Examples of electronic devices include smartphones, laptops, digital cameras, televisions, game consoles, and music players, as well as the example electronic devices discussed herein. As described herein, an intermediate electronic device can be a device located between two other electronic devices, and / or a subset of components of one or more electronic devices, and the intermediate electronic device facilitates communication, data processing, and / or data transfer between the respective electronic devices and / or electronic components.

[0090] An integrated circuit (IC) can be an electronic device composed of multiple interconnected electronic components, such as transistors, resistors, and capacitors. These components can be etched onto a small piece of semiconductor material, such as silicon. ICs can include analog ICs, digital ICs, mixed-signal ICs, and / or any other suitable type or form of IC. Examples of ICs include application-specific integrated circuits (ASICs), processing units, central processing units (CPUs), coprocessors, and accelerators.

[0091] Analog integrated circuits (e.g., sensors, power management circuits, and operational amplifiers) can process continuous signals and perform analog functions such as amplification, active filtering, demodulation, and mixing. Examples of analog integrated circuits include linear integrated circuits and radio frequency circuits.

[0092] Digital integrated circuits, which may be referred to as logic integrated circuits, may include microprocessors, microcontrollers, memory chips, interfaces, power management circuits, programmable devices, and / or any other suitable type or form of integrated circuit. In some embodiments, an example of an integrated circuit includes a central processing unit (CPU).

[0093] Processing units, such as CPUs, can be electronic components responsible for executing instructions and controlling the operation of electronic devices (e.g., computers). Various types of processors exist, which can be used interchangeably or specifically required by the embodiments described herein. For example, a processor can be: (i) a general-purpose processor designed to perform a wide range of tasks, such as running software applications, managing operating systems, and performing arithmetic and logical operations; (ii) a microcontroller designed for specific tasks, such as controlling electronic devices, sensors, and motors; (iii) an accelerator, such as a graphics processing unit (GPU), designed to accelerate the creation and rendering of images, videos, and animations (e.g., virtual reality animations such as 3D modeling); (iv) a field-programmable gate array (FPGA) that can be programmed and reconfigured post-manufacturing and / or customized to perform specific tasks, such as signal processing, encryption, and machine learning; and / or (v) a digital signal processor (DSP) designed to perform mathematical operations on signals (e.g., audio, video, and radio waves). One or more processors of one or more electronic devices can be used in the various embodiments described herein.

[0094] Memory generally refers to electronic components in a computer or electronic device that store data and instructions for access and manipulation by a processor. Examples of memory may include: (i) random access memory (RAM) configured to temporarily store data and instructions; (ii) read-only memory (ROM) configured to permanently and / or semi-permanently store data and instructions (e.g., one or more portions of system firmware and / or bootloader); (iii) flash memory (e.g., USB drives, memory cards, and / or solid-state drives (SSDs)) configured to store data in an electronic device; and / or (iv) cache memory configured to temporarily store frequently accessed data and instructions. As described herein, memory may store structured data (e.g., Structured Query Language (SQL) databases, MongoDB databases, GraphQL data, JSON data, etc.). Other examples of data stored in memory may include: (i) data data, including user account data, user settings, and / or other user data stored by the user; (ii) sensor data detected by one or more sensors and / or otherwise acquired; (iii) media content data, including stored image data, audio data, and documents; (iv) application data, which may include data collected and / or otherwise acquired and stored during use of the application; and / or any other type of data described herein.

[0095] A controller can be an electronic component that manages and coordinates the operation of other components within an electronic device (e.g., controlling inputs, processing data, and / or generating outputs). Examples of controllers may include: (i) microcontrollers, which include small, low-power controllers commonly used in embedded systems and Internet of Things (IoT) devices; (ii) programmable logic controllers (PLCs), which can be configured for use in industrial automation systems to control and monitor manufacturing processes; (iii) system-on-a-chip (SoC) controllers, which integrate multiple components (e.g., processors, memory, I / O interfaces, and other peripherals) into a single chip; and / or (iv) DSPs.

[0096] The power system of an electronic device can be configured to convert input power into a form usable for operating the device. The power system may include various components, such as: (i) a power source, which may be an alternating current (AC) adapter power source or a direct current (DC) adapter power source; (ii) a charger input, which may be configured to use wired and / or wireless connections (which may be part of a peripheral interface, such as USB, microUSB, near-field magnetic coupling, magnetic induction and magnetic resonance charging, and / or radio frequency (RF) charging); (iii) a power management integrated circuit configured to distribute power to various components of the device and ensure that the device operates within safety limits (e.g., regulating voltage, controlling current, and / or managing heat dissipation); and / or (iv) a battery configured to store power to provide usable power to components of one or more electronic devices.

[0097] Peripheral interfaces can be (e.g., of electronic devices) electronic components that allow the electronic device to communicate with other devices or peripheral devices and can provide the ability to input and output data and signals. Examples of peripheral interfaces may include: (i) Universal Serial Bus (USB) and / or MicroUSB interfaces configured to connect devices to electronic devices; (ii) Bluetooth interfaces configured to allow devices to communicate with each other, including Bluetooth Low Energy (BLE); (iii) Near Field Communication (NFC) interfaces configured as short-range wireless interfaces for operations such as access control; (iv) POGO pins, which may be small, spring-loaded pins configured to provide a charging interface; (v) Wireless charging interfaces; (vi) Global Positioning System (GPS) interfaces; (vii) Wi-Fi interfaces for providing connectivity between devices and wireless networks; and / or (viii) sensor interfaces.

[0098] A sensor is an electronic component configured to detect physical and environmental changes and generate electrical signals (e.g., electronic components in electronic devices (e.g., wearable devices) and / or electronic components that otherwise communicate electronically with electronic devices). Examples of sensors may include: (i) imaging sensors for collecting imaging data (e.g., including one or more cameras disposed on a corresponding electronic device); (ii) biopotential signal sensors; (iii) inertial measurement units (e.g., IMUs) for detecting changes in, for example, angular velocity, force, magnetic field, and / or acceleration; (iv) heart rate sensors for measuring a user's heart rate; (v) SpO2 sensors for measuring a user's blood oxygen saturation (SpO2) and / or other biometric data; (vi) capacitive sensors (e.g., sensor-skin interfaces) for detecting potential changes at a part of a user's body; and / or (vii) light sensors (e.g., time-of-flight sensors, infrared sensors, visible light sensors, etc.), etc.

[0099] Biopotential signal sensing components can be devices used to measure electrical activity within the body (e.g., biopotential signal sensors). Some types of biopotential signal sensors include: (i) electroencephalography (EEG) sensors configured to measure electrical activity in the brain to diagnose neurological disorders; (ii) electrocardiography (ECG or EKG) sensors configured to measure electrical activity in the heart to diagnose heart problems; (iii) electromyography (EMG) sensors configured to measure electrical activity in muscles and diagnose neuromuscular disorders; and (iv) electrooculography (EOG) sensors configured to measure electrical activity in eye muscles to detect eye movements and diagnose eye disorders.

[0100] Applications (e.g., software) stored in the memory of an electronic device may include instructions stored in the memory. Examples of such applications include: (i) games, (ii) word processors, (iii) messaging applications, (iv) media streaming applications, (v) financial applications, (vi) calendars, (vii) clocks, and (viii) communication interface modules (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART or MiWi, custom or standard wired protocols (e.g., Ethernet or HomePlug), and / or any other suitable communication protocol) for enabling wired and / or wireless connections between different corresponding electronic devices.

[0101] A communication interface can be a mechanism that enables different systems or devices to exchange information and data with each other, including hardware, software, or a combination of both. For example, a communication interface can refer to a physical connector and / or port on a device that enables communication with other devices (e.g., USB, Ethernet, HDMI, Bluetooth). In some embodiments, a communication interface can refer to a software layer that enables different software programs to communicate with each other (e.g., an application programming interface (API), protocols such as HTTP and TCP / IP, etc.).

[0102] A graphics module can be a component or software module designed to handle graphics operations and / or graphical processes, and the graphics module may include hardware modules and / or software modules.

[0103] Non-transitory computer-readable storage media can be physical devices or storage media that can be used to store electronic data in a non-transitory form (e.g., such that the data is permanently stored until it is intentionally deleted or modified).

[0104] Figure 11 and Figure 12 An example wrist-worn wearable device 1100 and an example computing system 1200 are illustrated according to some embodiments. The wrist-worn wearable device 1100 is described herein. Figure 7 The example of wrist wearable device 702 described herein is such that wrist wearable device 702 should be understood as having the characteristics of wrist wearable device 1100, and vice versa. Figure 12 Components of a wrist-worn wearable device 1100 are shown, which can be used individually or in combination, including combinations that include other electronic devices and / or electronic components.

[0105] Figure 11 The wearable strap 1110 and the watch body 1120 (or capsule) are coupled as described below to form a wrist-worn wearable device 1100. The wrist-worn wearable device 1100 can perform various functions and / or operations associated with browsing the user interface and selectively opening applications, as well as those described above. Figures 7 to 10B The described functions and / or operations.

[0106] As will be described in more detail below, the operations performed by the wrist-worn wearable device 1100 may include: (i) presenting content to a user (e.g., displaying visual content via display 1105); (ii) detecting (e.g., sensing) user input (e.g., sensing touches on peripheral buttons 1123 and / or touches at the touchscreen of display 1105, gestures detected by sensors (e.g., biopotential sensors); (iii) sensing biometric data (e.g., neuromuscular signals, heart rate, temperature, sleep, etc.) via one or more sensors 1113; sending and receiving messages (e.g., text, voice, video, etc.); image acquisition via one or more imaging devices or cameras 1125; wireless communication (e.g., cellular, near-field, Wi-Fi, personal area network, etc.); location determination; financial transactions; providing haptic feedback; providing warnings; providing notifications; providing biometric authentication; providing health monitoring; providing sleep monitoring, etc.

[0107] The above-described example functions can be performed independently in the watch body 1120, independently in the wearable band 1110, and / or via electronic communication between the watch body 1120 and the wearable band 1110. In some embodiments, the functions can be performed on the wrist-worn wearable device 1100 when an AR environment is presented (e.g., via one of AR systems 700 to 1000). The wearable device described herein can also be used with other types of AR environments.

[0108] The wearable band 1110 can be configured to be worn by a user such that the inner surface of the wearable structure 1111 of the wearable band 1110 contacts the user's skin. In this example, the sensor 1113 can contact the user's skin when worn by the user. In some examples, one or more sensors 1113 can sense biometric data, such as the user's heart rate, saturated oxygen level, temperature, sweat level, neuromuscular signals, or combinations thereof. One or more sensors 1113 can also sense data about the user's environment, including the user's motion, height, location, orientation, gait, acceleration, position, or combinations thereof. In some embodiments, one or more sensors 13 can be configured to track the position and / or motion of the wearable band 1110. One or more sensors 1113 can include those defined above and / or referenced below. Figure 11 Any sensor discussed.

[0109] One or more sensors 1113 may be distributed on the inner and / or outer surface of the wearable band 1110. In some embodiments, the one or more sensors 1113 are evenly spaced along the wearable band 1110. Alternatively, in some embodiments, the one or more sensors 1113 are positioned at different points along the wearable band 1110. Figure 11As shown, one or more sensors 1113 may be the same or different. For example, in some embodiments, one or more sensors 1113 may be shaped as a pill (e.g., sensor 1113a), an egg, a circle, a square, an ellipse (e.g., sensor 1113c), and / or any other shape that remains in contact with the user's skin (e.g., so that neuromuscular signals and / or other biometric data can be accurately measured at the user's skin). In some embodiments, one or more sensors 1113 are aligned to form sensor pairs (e.g., for sensing neuromuscular signals based on differential sensing within each respective sensor). For example, sensor 1113b may be aligned with an adjacent sensor to form sensor pair 1114a, and sensor 1113d may be aligned with an adjacent sensor to form sensor pair 1114b. In some embodiments, the wearable band 1110 does not have sensor pairs. Alternatively, in some embodiments, the wearable band 1110 has a predetermined number of sensor pairs (one pair, three pairs, four pairs, six pairs, sixteen pairs, etc.).

[0110] The wearable band 1110 may include any suitable number of sensors 1113. In some embodiments, the number and arrangement of the sensors 1113 depend on the specific application using the wearable band 1110. For example, the wearable band 1110, which may be configured as an armband, wristband, or chest band, may include multiple sensors 1113 with different numbers of sensors 1113, various types of individual sensors with multiple sensors 1113, and different arrangements for various use cases (e.g., medical use cases compared to gaming or general everyday use cases).

[0111] According to some embodiments, the wearable band 1110 also includes an electrically grounding electrode and a shielding electrode. Similar to sensor 1113, the electrically grounding electrode and shielding electrode may be distributed on the inner surface of the wearable band 1110 such that they contact a portion of the user's skin. For example, the electrically grounding electrode and shielding electrode may be located on the inner surface of coupling mechanism 1116 or the inner surface of wearable structure 1111. The electrically grounding electrode and shielding electrode may be formed of and / or use the same components as sensor 1113. In some embodiments, the wearable band 1110 includes more than one electrically grounding electrode and more than one shielding electrode.

[0112] Sensor 1113 may be formed as part of the wearable structure 1111 of the wearable band 1110. In some embodiments, sensor 1113 is flush or substantially flush with the wearable structure 1111, such that these sensors do not extend beyond the surface of the wearable structure 1111. Although flush with the wearable structure 1111, sensor 1113 is still configured to contact the user's skin (e.g., through a skin contact surface). Alternatively, in some embodiments, sensor 1113 extends beyond the wearable structure 1111 by a predetermined distance (e.g., 0.1 mm to 2 mm) to contact and press into the user's skin. In some embodiments, sensor 1113 is coupled to an actuator (not shown) configured to adjust the extension height of sensor 1113 (e.g., the distance from the surface of the wearable structure 1111) such that sensor 1113 contacts and presses into the user's skin. In some embodiments, the actuator adjusts the extension height between 0.01 mm and 1.2 mm. This allows users to customize the position of the sensor 1113 to improve the overall comfort of the wearable band 1110 when worn, while still allowing the sensor 1113 to contact the user's skin. In some embodiments, the sensor 1113 is not distinguishable from the wearable structure 1111 when worn by the user.

[0113] The wearable structure 1111 may be formed of an elastic material, elastomer, etc., which is configured to be stretched and adapted for wear by a user. In some embodiments, the wearable structure 1111 is a textile or woven fabric. As described above, the sensor 1113 may be formed as part of the wearable structure 1111. For example, the sensor 1113 may be molded into the wearable structure 1111 or integrated into the woven fabric (e.g., the sensor 1113 may be sewn into the fabric and simulate the flexibility of the fabric, and may and / or may be composed of a series of woven fabric threads).

[0114] Wearable structure 1111 may include a flexible electronic connector that encapsulates sensor 1113, electronic circuitry, and / or other electronic components (see below) within wearable band 1110. Figure 12 (Description) Interconnection. In some embodiments, the flexible electronic connector is configured to interconnect the sensor 1113, electronic circuitry, and / or other electronic components of the wearable band 1110 with corresponding sensors and / or other electronic components of another electronic device (e.g., the watch body 1120). The flexible electronic connector is configured to move with the wearable structure 1111 such that adjustments made by the user to the wearable structure 1111 (e.g., resizing, pulling, folding, etc.) do not exert pressure or tension on the electrical coupling of the components of the wearable band 1110.

[0115] As described above, the wearable band 1110 is configured to be worn by a user. Specifically, the wearable band 1110 may be shaped or otherwise manipulated for wear by a user. For example, the wearable band 1110 may be shaped to have a generally circular shape, such that the wearable band can be configured to be worn on the user's forearm or wrist. Alternatively, the wearable band 1110 may be shaped to be worn on another part of the user's body (e.g., the upper arm (e.g., around the biceps), forearm, chest, leg, etc.). The wearable band 1110 may include a retaining mechanism 1112 (e.g., a buckle, hook-and-loop fastener, etc.) for securing the wearable band 1110 to the user's wrist or other body part. While the wearable band 1110 is worn by the user, the sensor 1113 senses data from the user's skin (referred to as sensor data). In some examples, the sensor 1113 of the wearable band 1110 acquires (e.g., senses and records) neuromuscular signals. Sensed data (e.g., sensed neuromuscular signals) can be used to detect and / or determine a user's intention to perform certain motor actions. In some examples, sensor 1113 can sense and record neuromuscular signals from the user when the user performs muscle activation (e.g., movement, gestures, etc.). Detected and / or determined motor actions (e.g., phalanges (or fingers) movement, wrist movement, hand movement, and / or other muscular intentions) can be used to determine control commands or control information (instructions to execute certain commands after the data is sensed) for causing the computing device to execute one or more input commands. For example, sensed neuromuscular signals can be used to control certain user interfaces displayed on display 1105 of the wrist-worn wearable device 1100, and / or can be sent to a device responsible for rendering an artificial reality environment (e.g., a head-mounted display) to perform actions in the associated artificial reality environment, such as controlling the movement of a virtual device displayed to the user. Muscle activation performed by a user can include: static gestures, such as placing the user's palm down on a table; dynamic gestures, such as grasping a physical or virtual object; and covert gestures that are imperceptible to another person, such as slightly tensing a joint by coordinating the contraction of opposing muscles or using submuscular activation. Muscle activation performed by a user can also include symbolic gestures (e.g., gestures that are mapped to other gestures, interactions, or commands based on a gesture vocabulary that specifies a gesture as a command).

[0116] Sensor data sensed by sensor 1113 can be used to provide users with enhanced interaction with physical objects (e.g., devices communicatively coupled to wearable belt 1110) and / or virtual objects in artificial reality applications generated by artificial reality systems (e.g., user interface objects presented on display 1105 or another computing device (e.g., smartphones)).

[0117] In some embodiments, the wearable band 1110 includes one or more tactile devices 1246 (e.g., vibratory tactile actuators) configured to provide tactile feedback (e.g., skin sensation and / or kinesthetic sensation) to the user's skin. Sensors 1113 and / or tactile devices 1246 (such as...) Figure 12 (As shown) can be configured to run in conjunction with a variety of applications, including but not limited to health monitoring, social media, games and artificial reality (e.g., applications associated with artificial reality).

[0118] The wearable band 1110 may also include a coupling mechanism 1116 for detachably coupling a pod (e.g., a computing unit) or a watch body 1120 (via a coupling surface of the watch body 1120) to the wearable band 1110. For example, the bracket or shape of the coupling mechanism 1116 may correspond to the shape of the watch body 1120 of the wrist wearable device 1100. In particular, the coupling mechanism 1116 may be configured to receive a coupling surface of the watch body 1120 near the bottom side (e.g., the side opposite the front side where the display 1105 of the watch body 1120 is located), allowing a user to push the watch body 1120 down into the coupling mechanism 1116 to attach the watch body 1120 to the coupling mechanism 1116. In some embodiments, the coupling mechanism 1116 may be configured to receive the top side of the watch body 1120 (e.g., the side near the front of the display 1105 of the watch body 1120) which is pushed upward into the bracket rather than downward into the coupling mechanism 1116. In some embodiments, the coupling mechanism 1116 is an integrated component of the wearable strap 1110, such that the wearable strap 1110 and the coupling mechanism 1116 are a single unified structure. In some embodiments, the coupling mechanism 1116 is a frame or housing that allows the coupling surface of the watch body 1120 to be held within or on the coupling mechanism 1116 of the wearable strap 1110 (e.g., bracket, tracking strap, support base, or buckle).

[0119] The coupling mechanism 1116 allows the watch body 1120 to be detachably coupled to the wearable strap 1110 via friction engagement, magnetic coupling, a rotation-based connector, a shear pin coupler, a retaining spring, one or more magnets, a clamp, a pin, a hook-and-loop fastener, or a combination thereof. A user can perform any type of action to couple the watch body 1120 to and detach it from the wearable strap 1110. For example, a user can twist, slide, rotate, push, pull, or rotate the watch body 1120 relative to the wearable strap 1110, or a combination thereof, to attach the watch body 1120 to and detach it from the wearable strap 1110. Alternatively, as discussed below, in some embodiments, the watch body 1120 can be detached from the wearable strap 1110 by actuation of the release mechanism 1129.

[0120] The wearable strap 1110 can be coupled to the watch body 1120 to enhance the functionality of the wearable strap 1110 (e.g., converting the wearable strap 1110 into a wrist-worn wearable device 1100, adding additional computing units and / or batteries to increase the computing resources and / or battery life of the wearable strap 1110, adding additional sensors to improve sensed data, etc.). As described above, the wearable strap 1110 and coupling mechanism 1116 are configured to operate independently of the watch body 1120 (e.g., perform functions independently of the watch body). For example, the coupling mechanism 1116 may include one or more sensors 1113 that contact the user's skin when the user wears the wearable strap 1110 (with or without the watch body 1120) and provide sensor data for determining control commands.

[0121] Users can detach the watch body 1120 from the wearable strap 1110 to reduce the burden on the user from the wrist wearable device 1100. In embodiments where the watch body 1120 is detachable, the watch body 1120 may be referred to as a detachable structure, such that in these embodiments, the wrist wearable device 1100 includes a wearable portion (e.g., the wearable strap 1110) and a detachable structure (watch body 1120).

[0122] Turning to the watch body 1120, in some examples, the watch body 1120 may have a generally rectangular or circular shape. The watch body 1120 is configured to be worn by a user on their wrist or on another body part. More specifically, the watch body 1120 is sized for easy carrying by a user, easy attachment to a part of a user's clothing, and / or easy coupling to a wearable strap 1110 (thus forming a wrist wearable device 1100). As described above, the watch body 1120 may have a shape corresponding to the coupling mechanism 1116 of the wearable strap 1110. In some embodiments, the watch body 1120 includes a single release mechanism 1129 or multiple release mechanisms (e.g., two release mechanisms 1129 positioned on opposite sides of the watch body 1120, such as spring-supported buttons) to detach the watch body 1120 from the wearable strap 1110. The release mechanism 1129 may include, but is not limited to, buttons, knobs, plugs, handles, levers, fasteners, buckles, dials, latches, or combinations thereof.

[0123] The user can actuate the release mechanism 1129 by pushing, rotating, lifting, pressing, moving, or performing other actions on it. Actuation of the release mechanism 1129 can release (e.g., detach) the watch body 1120 from the coupling mechanism 1116 of the wearable band 1110, thereby allowing the user to use the watch body 1120 independently of the wearable band 1110, and vice versa. For example, detaching the watch body 1120 from the wearable band 1110 allows the user to use the rear camera 1125b to capture images. Although the release mechanism 1129 is shown as being located at a corner of the watch body 1120, it can be located anywhere on the watch body 1120 that is convenient for user actuation. Additionally, in some embodiments, the wearable band 1110 may also include a corresponding release mechanism for detaching the watch body 1120 from the coupling mechanism 1116. In some embodiments, the release mechanism 1129 is optional, and the body 1120 can be separated from the coupling mechanism 1116 as described above (e.g., by twisting, rotating, etc.).

[0124] The watch body 1120 may include one or more peripheral buttons 1123 and 1127 for performing various operations at the watch body 1120. For example, peripheral buttons 1123 and 1127 may be used to turn on or wake (e.g., switch from a sleep state to an active state) the display 1105, unlock the watch body 1120, increase or decrease the volume, increase or decrease the brightness, interact with one or more applications, interact with one or more user interfaces, etc. Additionally or alternatively, in some embodiments, the display 1105 acts as a touchscreen and allows the user to provide one or more inputs for interacting with the watch body 1120.

[0125] In some embodiments, the watch body 1120 includes one or more sensors 1121. The sensors 1121 of the watch body 1120 may be the same as or different from the sensors 1113 of the wearable band 1110. The sensors 1121 of the watch body 1120 may be distributed on the inner and / or outer surfaces of the watch body 1120. In some embodiments, the sensors 1121 are configured to contact the user's skin when the user wears the watch body 1120. For example, the sensors 1121 may be placed on the underside of the watch body 1120, and the coupling mechanism 1116 may be a bracket with an opening that allows the underside of the watch body 1120 to directly contact the user's skin. Alternatively, in some embodiments, the watch body 1120 does not include sensors configured to contact the user's skin (e.g., sensors including those inside and / or outside the watch body 1120, configured to sense data from the watch body 1120 and data from the surrounding environment of the watch body 1120). In some embodiments, the sensors 1121 are configured to track the position and / or movement of the watch body 1120.

[0126] The watch body 1120 and the wearable band 1110 can share data using wired communication methods (e.g., Universal Asynchronous Receiver / Transmitter (UART), USB transceiver, etc.) and / or wireless communication methods (e.g., Near Field Communication, Bluetooth, etc.). For example, the watch body 1120 and the wearable band 1110 can share data sensed by sensors 1113 and 1121, as well as application and device-specific information (e.g., active and / or available applications, output devices (e.g., display, speaker, etc.), input devices (e.g., touchscreen, microphone, imaging sensor, etc.)).

[0127] In some embodiments, the watch body 1120 may include, but is not limited to, a front-facing camera 1125a and / or a rear-facing camera 1125b, sensors 1121 (e.g., biometric sensors, IMU sensors, heart rate sensors, saturated oxygen sensors, neuromuscular signal sensors, altimeter sensors, temperature sensors, bioimpedance sensors, pedometer sensors, optical sensors (e.g., imaging sensors 1263), touch sensors, sweat sensors, etc.). In some embodiments, the watch body 1120 may include one or more tactile devices 1276 (e.g., vibratory tactile actuators) configured to provide tactile feedback to the user (e.g., skin sensation and / or kinesthetic sensation, etc.). Sensors 1221 and / or tactile devices 1276 may also be configured to operate in conjunction with multiple applications, including but not limited to health monitoring applications, social media applications, gaming applications, and artificial reality applications (e.g., applications associated with artificial reality).

[0128] As described above, the watch body 1120 and the wearable strap 1110, when coupled, can form a wrist wearable device 1100. The watch body 1120 and the wearable strap 1110, when coupled, function as a single device to perform the functions described herein (operation, detection, communication, etc.). In some embodiments, each device is provided with specific instructions for performing one or more operations of the wrist wearable device 1100. For example, if it is determined that the watch body 1120 does not include a neuromuscular signal sensor, the wearable strap 1110 may include alternative instructions for performing the associated instructions (e.g., providing sensed neuromuscular signal data to the watch body 1120 via another electronic device). The operations of the wrist wearable device 1100 can be performed by the watch body 1120 alone or by the watch body in conjunction with the wearable strap 1110 (e.g., via a corresponding processor and / or hardware component), or vice versa. In some embodiments, the operation of the wrist wearable device 1100, the watch body 1120, and / or the wearable strap 1110 can be performed in conjunction with one or more processors and / or hardware components.

[0129] See below for reference Figure 12 As described in the block diagram, the wearable band 1110 and / or the watch body 1120 may each include independent resources required to perform functions independently. For example, the wearable band 1110 and / or the watch body 1120 may each include a power source (e.g., a battery), memory, data storage device, processor (e.g., a central processing unit (CPU)), communication, light source, and / or input / output devices.

[0130] Figure 12 Block diagrams are shown of a computing system 1230 corresponding to a wearable strap 1110 and a computing system 1260 corresponding to a watch body 1120, according to some embodiments. The computing system 1200 of the wrist wearable device 1100 may include a combination of components of the computing system 1230 of the wearable strap and components of the computing system 1260 of the watch body.

[0131] The watch body 1120 and / or wearable strap 1110 may include one or more components shown in the watch body's computing system 1260. In some embodiments, a single integrated circuit may include all or most of the components of the watch body's computing system 1260, which are included in a single integrated circuit. Alternatively, in some embodiments, the components of the watch body's computing system 1260 are included in multiple communication-coupled integrated circuits. In some embodiments, the watch body's computing system 1260 may be configured (e.g., via a wired or wireless connection) to couple with the wearable strap's computing system 1230, which allows the two computing systems to share components, distribute tasks, and / or (individually or as a single device) perform other operations described herein.

[0132] The computing system 1260 of the table may include one or more processors 1279, controllers 1277, peripheral interfaces 1261, power systems 1295, and memory (e.g., memory 1280).

[0133] The power system 1295 may include a charger input 1296, a power-management integrated circuit (PMIC) 1297, and a battery 1298. In some embodiments, the watch body 1120 and the wearable strap 1110 may have their own batteries (e.g., batteries 1298 and 1259) and may share power with each other. The watch body 1120 and the strap 1110 may use various technologies to receive charge. In some embodiments, the watch body 1120 and the strap 1110 may use wired charging components (e.g., a power cord) to receive charge. Alternatively or additionally, the watch body 1120 and / or the strap 1110 may be configured for wireless charging. For example, a portable charging device may be designed to mate with a portion of the watch body 1120 and / or a portion of the wearable strap 1110 and wirelessly deliver available power to the battery 1298 of the watch body 1120 and / or the battery 1259 of the wearable strap 1110. The watch body 1120 and the wearable band 1110 may have independent power systems (e.g., power systems 1295 and 1256) to enable each to operate independently. The watch body 1120 and the wearable band 1110 may also share power through their respective PMICs (e.g., PMICs 1297 and 1258) (e.g., one can charge the other), which can share power through power conductors and ground conductors and / or through wireless charging antennas.

[0134] In some embodiments, peripheral interface 1261 may include one or more sensors 1221. Sensor 1221 may include one or more coupling sensors 1262 for detecting when the watch body 1120 is coupled to another electronic device (e.g., wearable band 1110). Each sensor 1221 may include one or more imaging sensors 1263 (one or more of a camera 1225 and / or a separate imaging sensor 1263 (e.g., a thermal imaging sensor)). In some embodiments, sensor 1221 may include one or more SpO2 sensors 1264. In some embodiments, each sensor 1221 may include one or more bioelectric potential signal sensors (e.g., an EMG sensor 1265, which may be disposed on the user-facing portion of the watch body 1120 and / or wearable band 1110). In some embodiments, sensor 1221 may include one or more capacitive sensors 1266. In some embodiments, sensor 1221 may include one or more heart rate sensors 1267. In some embodiments, sensor 1221 may include one or more IMU sensors 1268. In some embodiments, one or more IMU sensors 1268 may be configured to detect movement of the user's hand, or other positions where the watch body 1120 is placed or held.

[0135] In some embodiments, one or more sensors 1221 may provide an example human-machine interface. For example, a set of neuromuscular sensors (e.g., EMG sensors 1265) may be arranged circumferentially around the wearable band 1110, with the inner surface of the EMG sensors 1265 configured to contact the user's skin. Any suitable number of neuromuscular sensors can be used (e.g., 2 to 20 sensors). The number and arrangement of the neuromuscular sensors may depend on the specific application for which the wearable device is used. For example, the wearable band 1110 may be used to generate control information for controlling augmented reality systems, robots, vehicles, scrolling text, controlling avatars, or any other suitable control task.

[0136] In some embodiments, neuromuscular sensors may be coupled together using flexible electronics incorporated into a wireless device, and hardware signal processing circuitry may optionally be used to process the outputs of one or more of the multiple sensing elements (e.g., to perform amplification, filtering, and / or rectification). In other embodiments, at least some of the signal processing on the outputs of the multiple sensing elements may be performed in software (e.g., processor 1279). Therefore, signal processing on signals sampled by sensors may be performed in hardware, software, or by any suitable combination of hardware and software, as the aspects of the techniques described herein are not limited in this respect. Neuromuscular signals can be processed in various ways. For example, the output of the EMG sensor 1265 can be provided to an analog front end, which can be configured to perform analog processing (e.g., amplification, noise reduction, filtering, etc.) on the recorded signal. The processed analog signal can then be provided to an analog-to-digital converter (ADC), which can convert the analog signal into a digital signal, which can be processed by one or more computer processors. Furthermore, although this example is discussed in the context of an interface with an EMG sensor, the embodiments described herein can also be implemented in wearable interfaces with other types of sensors, including but not limited to mechanomyography (MMG) sensors, sonomyography (SMG) sensors, and electrical impedance tomography (EIT) sensors.

[0137] In some embodiments, each peripheral interface 1261 includes a near-field communication (NFC) component 1269, a global-position system (GPS) component 1270, a long-term evolution (LTE) component 1271, and / or a Wi-Fi and / or Bluetooth communication component 1272. In some embodiments, the peripheral interface 1261 includes one or more buttons 1273 (e.g., Figure 11 The peripheral interface 1261 includes peripheral buttons 1123 and 1127, which, when selected by the user, cause an operation to be performed on the body 1120. In some embodiments, the peripheral interface 1261 includes one or more indicators (e.g., light-emitting diodes, LEDs) to provide the user with visual indicators (e.g., received messages, low battery, activated microphone and / or camera, etc.).

[0138] The watch body 1120 may include at least one display 1105 to show a user a visual representation of information or data, including user interface elements and / or three-dimensional virtual objects. The display may also include a touchscreen for inputting user input, such as touch gestures and swipe gestures. The watch body 1120 may include at least one speaker 1274 and at least one microphone 1275 for providing audio signals to the user and receiving audio input from the user. The user may provide user input through the microphone 1275 and may also receive audio output from the speaker 1274 as part of a haptic event provided by the haptic controller 1278. The watch body 1120 may include at least one camera 1225, including a front-facing camera 1225a and a rear-facing camera 1225b. The camera 1225 may include an ultra-wide-angle camera, a wide-angle camera, a fisheye camera, a spherical camera, a telephoto camera, a depth-sensing camera, or other types of cameras.

[0139] The computing system 1260 of the watch body may include one or more haptic controllers 1278 and associated components (e.g., haptic devices 1276) for providing haptic events (e.g., a vibrational sensation or audio output responding to an event at the watch body 1120) at the watch body 1120. The haptic controllers 1278 may communicate with one or more haptic devices 1276 (e.g., electroacoustic devices), including: speakers in one or more speakers 1274; and / or other audio components; and / or electromechanical devices that convert energy into linear motion (e.g., motors, electromagnetic coils, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert electrical signals into haptic outputs on the device)). The haptic controllers 1278 can provide haptic events that a user of the watch body 1120 can sense. In some embodiments, the one or more haptic controllers 1278 may receive input signals from an application in application 1282.

[0140] In some embodiments, the computing system 1230 of the wearable strap and / or the computing system 1260 of the watch body may include a memory 1280, which may be controlled by one or more storage controllers of the controller 1277. In some embodiments, software components stored in the memory 1280 include one or more applications 1282 configured to perform operations at the watch body 1120. In some embodiments, the one or more applications 1282 may include games, word processors, messaging applications, calling applications, web browsers, social media applications, media streaming applications, financial applications, calendars, clocks, etc. In some embodiments, software components stored in the memory 1280 include one or more communication interface modules 1283 as defined above. In some embodiments, software components stored in the memory 1280 include: one or more graphics modules 1284 for rendering, encoding, and / or decoding audio data and / or video data; and one or more data management modules 1285 for collecting and organizing data 1287 stored in the memory 1280 and / or providing access to the data 1287 stored in the memory 1280. In some embodiments, one or more applications and / or one or more modules in application 1282 may work together to perform various tasks at table body 1120.

[0141] In some embodiments, the software components stored in the memory 1280 may include one or more operating systems 1281 (e.g., a Linux-based operating system, an Android operating system, etc.). The memory 1280 may also include data 1287. The data 1287 may include data 1288A, sensor data 1289A, media content data 1390, and application data 1291.

[0142] It should be recognized that the computing system 1260 of the table body is an example of a computing system within the table body 1120, and the table body 1120 may have more or fewer components than those shown in the computing system 1260 of the table body, may combine two or more components, and / or may have different configurations and / or arrangements of these components. The various components shown in the computing system 1260 of the table body are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application-specific integrated circuits (ASICs).

[0143] Turning to the computing system 1230 of the wearable strap, one or more components that may be included in the wearable strap 1110 are shown. The computing system 1230 of the wearable strap may include more or fewer components than those shown in the computing system 1260 of the watch body, may combine two or more components, and / or may have different configurations and / or arrangements of some or all of these components. In some embodiments, all or most of the components of the multiple components of the computing system 1230 of the wearable strap are included in a single integrated circuit. Alternatively, in some embodiments, the multiple components of the computing system 1230 of the wearable strap are included in multiple communication-coupled integrated circuits. As described above, in some embodiments, the computing system 1230 of the wearable strap is configured to be coupled to the computing system 1260 of the watch body (e.g., via a wired or wireless connection), which allows the two computing systems to share components, assign tasks, and / or (individually or as a single device) perform other operations described herein.

[0144] Similar to the computing system 1260 of the watch body, the computing system 1230 of the wearable band may include: one or more processors 1249; one or more controllers 1247 (including one or more haptic controllers 1248); a peripheral interface 1231, which may include one or more sensors 1213 and other peripheral devices; a power supply (e.g., a power system 1256); and a memory (e.g., a memory 1250), which includes an operating system (e.g., an operating system 1251), data (e.g., data 1254, which includes data 1288B, sensor data 1289B, etc.) and one or more modules (e.g., a communication interface module 1252, a data management module 1253, etc.).

[0145] One or more sensors 1213 may be similar to sensor 1221 of the computing system 1260 of the watch body. For example, sensor 1213 may include one or more coupling sensors 1232, one or more SpO2 sensors 1234, one or more EMG sensors 1235, one or more capacitive sensors 1236, one or more heart rate sensors 1237, and one or more IMU sensors 1238.

[0146] Peripheral interface 1231 may also include other components similar to those included in peripheral interface 1261 of the computing system 1260 of the watch body, as described above with reference to peripheral interface 1261. These other components include NFC component 1239, GPS component 1240, LTE component 1241, Wi-Fi and / or Bluetooth communication component 1242 and / or one or more tactile devices 1246. In some embodiments, peripheral interface 1231 includes one or more buttons 1243, a display 1233, a speaker 1244, a microphone 1245, and a camera 1255. In some embodiments, peripheral interface 1231 includes one or more indicators, such as LEDs.

[0147] It should be recognized that the computing system 1230 of the wearable band is an example of a computing system within the wearable band 1110, and the wearable band 1110 may have more or fewer components than those shown in the computing system 1230 of the wearable band, may combine two or more components, and / or may have different configurations and / or arrangements of these components. The various components shown in the computing system 1230 of the wearable band can be implemented in one or a combination of hardware, software, and firmware (including one or more signal processing and / or application-specific integrated circuits).

[0148] refer to Figure 11 The wrist wearable device 1100 is an example of a wearable strap 1110 and a watch body 1120 coupled together, and therefore the wrist wearable device 1100 will be understood to include components shown and described for a computing system 1230 for the wearable strap and a computing system 1260 for the watch body. In some embodiments, the wrist wearable device 1100 has a split architecture (e.g., a split mechanical architecture, a split electrical architecture) between the watch body 1120 and the wearable strap 1110. In other words, all components shown in the computing system 1230 of the wearable strap and the computing system 1260 of the watch body can be accommodated or otherwise disposed in the combined wrist wearable device 1100, or in individual components within the watch body 1120, the wearable strap 1110 and / or portions thereof (e.g., the coupling mechanism 1116 of the wearable strap 1110).

[0149] The above technology can be used with any device for sensing neuromuscular signals, but it can also be used with other types of wearable devices for sensing neuromuscular signals, such as body wearables or head wearables that may have neuromuscular sensors closer to the brain or spine.

[0150] In some embodiments, the wrist wearable device 1100 may be used in conjunction with a head wearable device (e.g., AR system 1300 and VR system 1400) and / or HIPD; and the wrist wearable device 1100 may also be configured to allow a user to control any aspect of the artificial reality (e.g., by controlling user interface objects in the artificial reality using EMG-based gestures, and / or by allowing a user to interact with a touchscreen on the wrist wearable device to also control aspects of the artificial reality). Having described the example wrist wearable device thus, attention now turns to example head wearable devices, such as AR system 1300 and VR system 1400.

[0151] Figures 13 to 15 Example artificial reality systems are shown that can be used as or in conjunction with the wrist wearable device 1100. In some embodiments, the AR system 1300 includes, for example... Figure 13 The illustrated glasses device 1302. In some embodiments, the VR system 1400 includes a head-mounted display (HMD) 1412, such as... Figure 14A and Figure 14B As shown. In some embodiments, the AR system 1300 and VR system 1400 may include one or more similar components (e.g., components for presenting an interactive artificial reality environment, such as processors, memory, and / or presentation devices, including one or more displays and / or one or more waveguides), regarding Figure 15 Some of these components are described in more detail. As described herein, a head-mounted wearable device may include components of glasses device 1302 and / or head-mounted display 1412. Some embodiments of the head-mounted wearable device do not include any display (these displays include any displays described with respect to AR system 1300 and / or VR system 1400). Although the various example artificial reality systems are described herein as AR system 1300 and VR system 1400 respectively, any one or both of the various example AR systems described herein may be configured to present a fully immersive virtual reality scene within substantially the entire user's field of view, or a smaller augmented reality scene within a smaller portion of the user's field of view than the entire field of view.

[0152] Figure 13 An example visual depiction of an AR system 1300 is shown, including eyewear device 1302 (which may also be described herein as augmented reality glasses and / or smart glasses). The AR system 1300 may include… Figure 13Additional electronic components, such as wearable accessory devices and / or intermediate processing devices not shown, are configured to communicate electronically with or otherwise be used in conjunction with the eyewear device 1302. In some embodiments, the wearable accessory device and / or intermediate processing device may be configured to communicate electronically with or / or be used in conjunction with the coupling sensor 1524. Figure 15 The electronic communication coupling mechanism is coupled to the eyewear device 1302, wherein the coupling sensor 1524 can detect when the electronic device becomes physically or electronically coupled to the eyewear device 1302. In some embodiments, the eyewear device 1302 may be configured to be coupled to the housing 1590. Figure 15 The housing 1590 may include one or more additional coupling mechanisms configured to couple with additional accessory devices. Figure 13 The components shown can be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing components and / or application-specific integrated circuits (ASICs).

[0153] The eyewear device 1302 includes mechanical eyewear components, including a frame 1304 configured to hold one or more lenses (e.g., one or two lenses 1306-1 and 1306-2). Those skilled in the art will recognize that the eyewear device 1302 may include additional mechanical components, such as hinges configured to allow multiple portions of the frame 1304 of the eyewear device 1302 to fold and unfold, a bridge configured to span the gap between lenses 1306-1 and 1306-2 and rest on the user's nose, a nose pad configured to rest on the bridge of the nose and provide support for the eyewear device 1302, earpieces configured to rest on the user's ears and provide additional support for the eyewear device 1302, and temples configured to extend from the hinges of the eyewear device 1302 to the earpieces, etc. Those skilled in the art will further recognize that some examples of the AR system 1300 may not include the mechanical components described herein. For example, a smart contact lens configured to present an artificial reality to a user may not include any components of the eyewear device 1302.

[0154] Eyeglasses device 1302 includes electronic components, many of which will be described in the following reference. Figure 15 To provide a more detailed description. Figure 13The diagram shows some example electronic components, including acoustic sensors 1325-1, 1325-2, 1325-3, 1325-4, 1325-5, and 1325-6, which may be distributed along a large portion of the frame 1304 of the eyeglasses device 1302. The eyeglasses device 1302 also includes a left camera 1339A and a right camera 1339B located on different sides of the frame 1304. The eyeglasses device 1302 also includes a processor 1348 (or any other suitable type or form of integrated circuit) embedded in a portion of the frame 1304.

[0155] Figure 14A and Figure 14B A head-mounted display (HMD) 1412 according to some embodiments is shown (e.g., also referred to herein as an artificial reality head-mounted viewer, a head-wearable device, or a VR head-mounted viewer). As described above, some artificial reality systems (e.g., AR system 1300) can substantially replace one or more of a user's visual and / or other sensory perceptions of the real world with a virtual experience (e.g., AR systems 900 and 1000), rather than mixing artificial reality with actual reality.

[0156] The HMD 1412 includes a front body 1414 and a frame 1416 (e.g., a strip or strap) shaped to fit the user's head. In some embodiments, the front body 1414 and / or frame 1416 include one or more electronic components (e.g., a display, IMU, tracking transmitter, or detector) that facilitate the presentation and / or interaction with AR and / or VR systems. In some embodiments, such as Figure 14B As shown, HMD 1412 includes an output audio transducer (e.g., audio transducer 1418). In some embodiments, one or more components (e.g., one or more output audio transducers 1418 and frame 1416) can be configured to be attached (e.g., detachably attached) to HMD 1412 (e.g., part or all of frame 1416, and / or audio transducer 1418) and detached from HMD 1412, as shown. Figure 14B As shown. In some embodiments, coupling the removable component to the HMD 1412 enables the removable component to enter into electronic communication with the HMD 1412.

[0157] Figure 14A and Figure 14BThe VR system 1400 is also shown to include one or more cameras, such as a left camera 1439A and a right camera 1439B, which may resemble the left camera 1339A and right camera 1339B on the frame 1304 of the glasses device 1302. In some embodiments, the VR system 1400 includes one or more additional cameras (e.g., cameras 1439C and 1439D) that can be configured to enhance the image data acquired by the left camera 1439A and right camera 1439B by providing more information. For example, camera 1439C may be used to provide color information not identified by cameras 1439A and 1439B. In some embodiments, one or more of the cameras 1439A to 1439D may include an optional IR cutoff filter configured to remove IR light from the light received from the respective camera sensor.

[0158] Figure 15 A computing system 1520 and an optional housing 1590 are shown, each of which illustrates components that may be included in the AR system 1300 and / or the VR system 1400. In some embodiments, depending on the actual constraints of the respective AR system described, more or fewer components may be included in the optional housing 1590.

[0159] In some embodiments, computing system 1520 may include one or more peripheral interfaces 1522A, and / or optional housing 1590 may include one or more peripheral interfaces 1522B. Each of computing system 1520 and optional housing 1590 may also include one or more power systems 1542A and 1542B, one or more controllers 1546 (including one or more haptic controllers 1547), one or more processors 1548A and 1548B (as defined above, including any examples provided), and memories 1550A and 1550B, all of which may communicate electronically with each other. For example, one or more processors 1548A and 1548B may be configured to execute instructions stored in memories 1550A and / or 1550B, which may cause one of the one or more controllers 1546 to perform multiple operations at one or more peripheral devices connected to peripheral interfaces 1522A and / or 1522B. In some embodiments, each of the described operations may occur via power supplied by power systems 1542A and / or 1542B.

[0160] In some embodiments, peripheral interface 1522A may include one or more devices configured as part of computing system 1520, some of which have been defined and / or referenced above. Figure 11 and Figure 12 The wrist-worn wearable device shown is described. For example, peripheral interface 1522A may include one or more sensors 1523A. Some example sensors 1523A include: one or more coupling sensors 1524, one or more acoustic sensors 1525, one or more imaging sensors 1526, one or more EMG sensors 1527, one or more capacitive sensors 1528, one or more IMU sensors 1529; and / or any other type of sensor described above or with respect to any other embodiments discussed herein.

[0161] In some embodiments, peripheral interfaces 1522A and 1522B may include one or more additional peripheral devices, including: one or more NFC devices 1530, one or more GPS devices 1531, one or more LTE devices 1532, one or more Wi-Fi and / or Bluetooth devices 1533, one or more buttons 1534 (e.g., including slide-on or otherwise adjustable buttons), one or more displays 1535A and 1535B, one or more speakers 1536A and 1536B, one or more microphones 1537, one or more cameras 1538A and 1538B (e.g., including left camera 1539A and / or right camera 1539B), and / or one or more haptic devices 1540; and / or any other type of peripheral device as defined above or described with respect to any other embodiments discussed herein.

[0162] AR systems can include various types of visual feedback mechanisms (e.g., presentation devices). For example, the display device in AR system 1300 and / or VR system 1400 can include one or more liquid-crystal displays (LCDs), light-emitting diode (LED) displays, organic LED (OLED) displays, and / or any other suitable type of display. An AR system can include a single display (e.g., configured to be seen by both eyes), and / or can provide a separate display for each eye, which can provide additional flexibility for zoom adjustment and / or for correcting refractive errors associated with the user's vision. Some embodiments of AR systems also include an optical subsystem with one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user views the display.

[0163] For example, corresponding displays 1535A and 1535B may be coupled to each of lenses 1306-1 and 1306-2 of the AR system 1300. Displays 1535A and 1535B may be coupled to each of lenses 1306-1 and 1306-2, which may work collaboratively or independently to present an image or series of images to a user. In some embodiments, the AR system 1300 includes a single display 1535A or 1535B (e.g., a near-eye display) or more than two displays 1535A and 1535B. In some embodiments, one or more displays 1535A and 1535B from a first group may be used to present an augmented reality environment, and one or more display devices 1535A and 1535B from a second group may be used to present a virtual reality environment. In some embodiments, one or more waveguides (e.g., as a means of delivering light from one or more displays 1535A and 1535B to the user's eyes) are used in conjunction with presenting artificial reality content to a user of the AR system 1300. In some embodiments, one or more waveguides are wholly or partially integrated into the eyewear device 1302. As a supplement to or alternative to the display screen, some artificial reality systems include one or more projection systems. For example, the display device in AR system 1300 and / or the display device in VR system 1400 may include a microLED projector (e.g., using waveguides) that projects light onto the display device (e.g., clear combiner lenses that allow ambient light to pass through). The display device can refract the projected light into the user's pupil, allowing the user to simultaneously view both artificial reality content and the real world. Artificial reality systems can also be configured with any other suitable type or form of image projection system. In some embodiments, one or more waveguides are provided to supplement or replace one or more displays 1535A and 1535B.

[0164] The computing system 1520 of the AR system 1300 or VR system 1400 and / or optional housing 1590 may include some or all components of the power systems 1542A and 1542B. The power systems 1542A and 1542B may include one or more charger inputs 1543, one or more PMICs 1544 and / or one or more batteries 1545A and 1544B.

[0165] Memory 1550A and 1550B may include instructions and data, some or all of which may be stored in memory 1550A and 1550B as a non-transitory computer-readable storage medium. For example, memory 1550A and 1550B may include one or more operating systems 1551, one or more applications 1552, one or more communication interface applications 1553A and 1553B, one or more graphics applications 1554A and 1554B, one or more AR processing applications 1555A and 1555B, and / or any other type of data as defined above or described with respect to any other embodiments discussed herein.

[0166] Memory 1550A and 1550B also include data 1560A and 1560B, which can be used in conjunction with one or more of the applications discussed above. Data 1560A and 1560B may include data 1561, sensor data 1562A and 1562B, media content data 1563A, AR application data 1564A and 1564B, and / or any other type of data as defined above or described with respect to any other embodiments discussed herein.

[0167] In some embodiments, the controller 1546 of the glasses device 1302 can process information generated by sensors 1523A and / or 1523B on the glasses device 1302 and / or another electronic device within the AR system 1300. For example, the controller 1546 can process information from acoustic sensors 1325-1 and 1325-2. For each detected sound, the controller 1546 can perform direction of arrival (DOA) estimation to estimate the direction in which the detected sound arrives at the glasses device 1302 of the AR system 1300. When one or more of the multiple acoustic sensors 1525 (e.g., acoustic sensors 1325-1, 1325-2) detect sound, the controller 1546 can use this information to populate an audio dataset (e.g., in...). Figure 15 (represented as sensor data 1562A and 1562B).

[0168] In some embodiments, physical electronic connectors can transmit information between the eyewear device 1302 and another electronic device and / or between one or more processors 1348, 1548A, 1548B and controller 1546 in the AR system 1300 or VR system 1400. This information can be in the following forms: optical data; electrical data; wireless data; or any other transmissible data form. Moving the processing of information generated by the eyewear device 1302 to an intermediate processing device can reduce the weight and heat of the eyewear device, making it more comfortable and safer for the user. In some embodiments, optional wearable accessory devices (e.g., electronic ties) are coupled to the eyewear device 1302 via one or more connectors. Each connector can be a wired or wireless connector and can include electronic and / or non-electronic components (e.g., structural components). In some embodiments, the eyewear device 1302 and the wearable accessory device can operate independently without any wired or wireless connection between them.

[0169] In some cases, external devices such as intermediate processing devices (e.g., HIPD 706, HIPD 806, HIPD 906) are paired with glasses devices 1302 (e.g., as part of AR system 1300) to enable glasses devices 1302 to achieve similar shape features to a pair of glasses while still providing sufficient battery and computing power for the extended capabilities. Some or all of the battery power, computing resources, and / or additional features of AR system 1300 may be provided by the paired device or shared between the paired device and glasses devices 1302, thus reducing the overall weight, heat profile, and shape features of glasses devices 1302 while allowing glasses devices 1302 to maintain their desired functionality. For example, wearable accessory devices may allow components that are otherwise included on glasses devices 1302 to be included in the wearable accessory device and / or intermediate processing device, thereby transferring the weight load from the user's head and neck to one or more other parts of the user's body. In some embodiments, the intermediate processing device has a large surface area to diffuse and disperse heat to the surrounding environment through this large surface area. Therefore, the intermediate processing device can allow for a larger battery and computing power than is possible on the glasses device 1302 alone. Because the weight carried in the wearable accessory device may have a smaller impact on the user than the weight carried in the glasses device 1302, users can tolerate wearing a lighter glasses device for a longer period of time while carrying or wearing paired devices, allowing the artificial reality environment to be more fully integrated into the user's daily activities, compared to tolerating wearing a heavier glasses device alone.

[0170] AR systems can include various types of computer vision components and subsystems. For example, AR system 1300 and / or VR system 1400 can include one or more optical sensors, such as two-dimensional (2D) or three-dimensional (3D) cameras, time-of-flight depth sensors, structured light emitters and detectors, single-beam or scanning laser rangefinders, 3D LiDAR sensors, and / or any other suitable type or form of optical sensor. AR systems can process data from one or more of these sensors to identify the user's location and / or multiple aspects of the user's real-world physical environment, including the location of real-world objects within the real-world physical environment. In some embodiments, the methods described herein are used to map the real world, provide the user with context about the real-world environment, and / or generate digital twins (e.g., interactive virtual objects), and various other functions. For example, Figure 14A and Figure 14B A VR system 1400 with cameras 1439A to 1439D is shown. The cameras 1439A to 1439D can be used to provide depth information, which is used to create a voxel field and a two-dimensional mesh to provide the user with object information to avoid collisions.

[0171] In some embodiments, the AR system 1300 and / or VR system 1400 may include haptic feedback systems that can be integrated into headwear, gloves, bodysuits, handheld controllers, environmental devices (e.g., chairs or footrests), and / or any other type of device or system (e.g., wearable devices discussed herein). Haptic feedback systems can provide various types of skin feedback, including vibration, force, tension, shear, texture, and / or temperature. Haptic feedback systems can also provide various types of kinematic feedback, such as motion and compliance. Haptic feedback can be implemented using motors, piezoelectric actuators, fluid systems, and / or various other types of feedback mechanisms. Haptic feedback systems can be implemented independently of other artificial reality devices, within other artificial reality devices, and / or in conjunction with other artificial reality devices.

[0172] In some embodiments of artificial reality systems such as AR system 1300 and / or VR system 1400, ambient light (e.g., a live feed of the user's normally perceived surroundings) can pass through the display elements of the corresponding head-mounted wearable device that is presenting multiple aspects of the AR system. In some embodiments, ambient light can pass through a portion of the AR environment presented within the user's field of view that is less than the entire AR environment (e.g., a portion of the AR environment that is located in the same place as a physical object in the user's real-world environment, the physical object being located within a specified boundary (e.g., a monitoring boundary) configured for use by the user when interacting with the AR environment). For example, visual user interface elements (e.g., notification user interface elements) can be presented on the head-mounted wearable device, and a certain amount of ambient light (e.g., 15% to 50% of the ambient light) can pass through the user interface element, allowing the user to distinguish the portion of the physical environment on which the user interface element is displayed.

[0173] The process parameters and order of steps described and / or illustrated herein are given by way of example only and may be changed as desired. For example, while the steps shown and / or described herein may be shown or discussed in a particular order, these steps do not necessarily need to be performed in the shown or discussed order. The various exemplary methods described and / or illustrated herein may omit one or more of the steps described or illustrated herein, or may include additional steps in addition to those disclosed.

[0174] The preceding description has been provided to enable those skilled in the art to best utilize aspects of the exemplary embodiments disclosed herein. This exemplary description is not intended to be exhaustive or limited to any precise form disclosed. Many modifications and variations are possible without departing from the spirit and scope of this disclosure. The embodiments disclosed herein should be considered illustrative rather than restrictive in all respects. Reference should be made to the appended claims and their equivalents in determining the scope of this disclosure.

[0175] Unless otherwise stated, the terms “connected to” and “coupled to” (and their derivatives) as used in this specification and claims shall be interpreted as allowing direct and indirect (i.e., via other elements or components) connections. Additionally, the terms “a” or “an” as used in this specification and claims shall be interpreted as meaning “at least one of…”. Finally, for ease of use, the terms “comprising” and “having” (and their derivatives) as used in this specification and claims may be used interchangeably with the word “including” and have the same meaning as the word “comprising”.

Claims

1. A mixed reality display, comprising: An optical system, the size of which is configured to project a mixed reality image to the user, such that the projection angle determines the area where the user's peripheral view is hidden; At least one hardware component electrically coupled to the optical system and sized to fit within the region, such that the at least one hardware component is hidden from the user; as well as A frame, which is coupled to hold the optical system and the at least one hardware component, wherein the dimensions of the edges of the frame are set to fit within the region.

2. The mixed reality display according to claim 1, wherein, The optical system projects the mixed reality image to the user by magnifying the mixed reality image, wherein the projection angle increases with increasing magnification.

3. The mixed reality display according to claim 1, wherein, The optical system includes: A digital pass-through display configured to display the mixed reality image as a mixture of a real-world image and at least one virtual element; and A projector, positioned near the digital pass-through display, projects the mixed reality image to the user using pancake optics.

4. The mixed reality display according to claim 3, wherein, The at least one hardware component includes at least one of the following: A camera that captures real-world images and transmits the real-world images to an image processing unit; or The image processing unit, electrically coupled to the camera and the optical system, converts the real-world image into the mixed reality image.

5. The mixed reality display according to claim 4, wherein, The image processing component transforms the real-world image in the following manner: Adjust the real-world image to blend it with the user's peripheral view; Combine the real-world image with the at least one virtual element; as well as The mixed reality image is transmitted to the optical system.

6. The mixed reality display according to claim 1, wherein, The edges of the frame are angled to minimize the visible border of the frame.

7. A mixed reality system, comprising: A mixed reality display, the mixed reality display comprising: An optical system, the size of which is configured to project a mixed reality image to the user, such that the projection angle determines the area hidden from the user's peripheral view; At least one hardware component electrically coupled to the optical system and sized to fit within the region, such that the at least one hardware component is hidden from the user; and A frame, coupled to hold the optical system and the at least one hardware component, wherein the dimensions of the edges of the frame are configured to fit within the region; and An adjustable light window, coupled to the frame, extends beyond the optical system to cover at least a portion of the user's peripheral view.

8. The mixed reality system according to claim 7, wherein, The optical system projects the mixed reality image to the user by magnifying the mixed reality image, wherein the projection angle increases with the magnification.

9. The mixed reality system according to claim 7, wherein, The optical system includes: A digital pass-through display configured to display the mixed reality image as a mixture of a real-world image and at least one virtual element; and A projector, positioned near the digital pass-through display, projects the mixed reality image to the user using pancake optics.

10. The mixed reality system according to claim 9, wherein, The at least one hardware component includes at least one of the following: A camera that captures real-world images and transmits the real-world images to an image processing unit; or The image processing unit, electrically coupled to the camera and the optical system, converts the real-world image into the mixed reality image.

11. The mixed reality system according to claim 10, wherein, The image processing component transforms the real-world image in the following manner: Adjust the real-world image to blend it with the user's peripheral view; Combine the real-world image with the at least one virtual element; as well as The mixed reality image is transmitted to the optical system.

12. The mixed reality system according to claim 7, wherein, The edges of the frame are slanted to minimize the visible border of the frame.

13. The mixed reality system according to claim 7, wherein, The dimmable window includes electrochromic glass that changes the hue of the dimmable window in response to an electrical signal from the frame.

14. The mixed reality system according to claim 13, wherein, The color tone of the dimmable window includes at least one of the following: Transparent and translucent tone; Local color tone; Gradient colors; or Opaque hue.

15. A method for manufacturing a mixed reality display, comprising: The size of the optical system is set to project a mixed reality image to the user, such that the projection angle determines the area hidden from the user's peripheral view; At least one hardware component is electrically coupled to the optical system, and the size of the at least one hardware component is set to fit within the region, such that the at least one hardware component is hidden from the user; as well as A coupling frame is used to hold the optical system and the at least one hardware component, wherein the dimensions of the edges of the frame are set to fit within the region.

16. The manufacturing method according to claim 15, wherein, The optical system is configured to project the mixed reality image to the user by magnifying the mixed reality image, wherein the projection angle increases with increasing magnification.

17. The manufacturing method according to claim 15, wherein, The optical system includes: A digital pass-through display configured to display the mixed reality image as a mixture of a real-world image and at least one virtual element; and A projector, positioned near the digital pass-through display, projects the mixed reality image to the user using pancake optics.

18. The manufacturing method according to claim 17, wherein, The at least one hardware component includes at least one of the following: A camera that captures real-world images and transmits the real-world images to an image processing unit; or The image processing unit, electrically coupled to the camera and the optical system, converts the real-world image into the mixed reality image.

19. The manufacturing method according to claim 18, wherein, The image processing unit is configured to transform the real-world image in the following manner: Adjust the real-world image to blend it with the user's peripheral view; Combine the real-world image with the at least one virtual element; as well as The mixed reality image is transmitted to the optical system.

20. The manufacturing method according to claim 15, further comprising: The edges of the frame are tilted to minimize the visible border of the frame.

Images