266 results about "Artificial reality" patented technology

Aspects of the present disclosure are directed to providing assisted scene capture for an artificial reality (XR) environment. Some implementations can obtain an XR space model corresponding to a real-world space, including walls, the ceiling, and the floor, using an XR system. Some implementations can then scan the real-world space and display a mesh corresponding to the scanned area overlaid onto a view of the real-world space. Some implementations can perform post-processing on the displayed mesh, which can include A) collapsing variations in the mesh corresponding to the walls, ceiling, or floor onto the XR space model; B) clipping the mesh to the XR space model for open doorways, windows, etc.; C) simplifying the mesh corresponding to the walls, ceiling, or floor; D) determining that the mesh is complete by identifying that a threshold percentage of the XR space model is covered by the mesh; or any combination thereof.

Aspects of the present disclosure provide a quick actions menu in an artificial reality (XR) environment that can be accessed by performing a hand gesture detected by an XR device which, in some implementations, can be detected without the use of controllers. Once the menu is open, the user can move her hand while performing the gesture to highlight a particular quick action and can release the gesture on a highlighted action to select the action. In some implementations, the user can drill down into an action on the menu by highlighting the action, then dragging the gesture off of the action away from the menu. To close the quick actions menu, the user can either A) move the gesture off the menu and release the gesture, B) rotate the wrist, or C) explicitly dismiss the menu, such as by using a voice command detected by the XR device.

Aspects of the present disclosure are directed to group travel between artificial reality (XR) destinations. Currently, users in an artificial reality (XR) experience cannot travel with a group to a specific destination or between destinations (e.g., to and from virtual worlds, levels, applications, etc.). Thus, some implementations assign users within a group in a multiplayer XR experience (e.g., a virtual lobby) a same session identifier. When the users select a destination, some implementations can provide a computing system hosting the destination with the session identifier associated with the users, such that the hosting computing system can ensure that the users travel to the same instance of the destination together. If a user does not already have the destination installed, some implementations can allow the user to acquire access rights to the destination, then travel to the same instance of the destination as the other users.

Systems and methods are provided for facilitating an interactive artificial-reality activity. A method includes, after a user of a head-wearable device has opted-in to using an artificial-reality application to facilitate connecting with other participating users, determining, based on user-specific suggestion criteria, that a suggested user is located in an approved common space with the user and has opted-in to use the artificial-reality application. The method includes causing the head-wearable device to present an user interface (UI) element for linking the suggested user and the user. Upon the user selecting the UI element for linking the suggested user with the user, the method includes automatically causing the head-wearable device to provide visual-guidance UI elements to navigate the user to an interactive-activity location where the user and the suggested user will perform an artificial-reality activity while also displaying information about the artificial-reality activity to be performed.

Aspects of the present disclosure are directed to a two-dimensional (2D) user interface (UI) content overlay for an artificial reality (XR) environment. In some implementations, the content overlay can be a default home screen when a user launches into an immersive XR application that helps the user navigate and control immersive destinations, and complete relevant and frequent actions related to the XR application. In some implementations, the content overlay can serve dynamic content based on the user's context to help them, e.g., A) find and play with other users, B) learn relevant actions that can be taken, C) quickly travel to a destination, D) see relevant content, etc. The content overlay can provide these functions 2D cards in the XR environment, which can be specific to the executing XR application, or can be system-level for multiple providing content XR applications.

This disclosure describes an artificial reality system that presents artificial reality content or artificial reality effects based on, or in response to, interactions with one or more physical objects within a physical environment. In one example, this disclosure describes a method that includes determining that a user has performed a trigger action on a trigger object; responsive to determining that the user has performed the trigger action, generating artificial reality content; presenting the artificial reality content on a display associated with a head-mounted display; determining that the user has performed a de-trigger action; and responsive to determining that the user has performed the de-trigger action, discontinuing presentation of the artificial reality content.

Example implementations are directed to recapturing or realigning a room or scene in an artificial reality (XR) environment as a three dimensional (3D) space. To initially capture a room, a user manually annotates, using an XR system, one or more walls around the XR system. The XR system then aligns or localizes itself relative to the room. Once a room is captured and stored, and the user in the future enters the room again, the XR system may not be able to align itself in the room due to, for example, lighting conditions. Rather than require the user to manually recapture every wall captured during the initial room capture, the XR system can select one wall for recapture and, after receiving an annotation or marking of the one wall from the user, use the selection to realign the XR system relative to the room.

This disclosure describes an artificial reality system that presents artificial reality content or artificial reality effects based on, or in response to, interactions with one or more physical objects within a physical environment. In one example, this disclosure describes a method that includes determining that a user has performed a trigger action on a trigger object; responsive to determining that the user has performed the trigger action, generating artificial reality content; presenting the artificial reality content on a display associated with a head-mounted display; determining that the user has performed a de-trigger action; and responsive to determining that the user has performed the de-trigger action, discontinuing presentation of the artificial reality content.

A method of performing input gestures to control user interface elements is described. The method includes, at a first point in time while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset, detecting a first input via an input device of the at least two input devices and performing an action at the artificial-reality headset. In response to detecting a second input via another input device of the at least two input devices, performing another action within a user interface presented via the artificial-reality headset. The method further includes, at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset, detecting the first input via the input device of the at least two input devices.

A genealogy system includes a server with memory and processors storing code that instructs the processors to store genealogy data and user profiles, providing a research platform for users. A remote client device, equipped with an image sensor and display, communicates with the server. The client device displays the genealogy research platform, allowing users to select a genealogy item for an artificial reality experience. Upon user command, the client device presents continually updating artificial reality images of an environment, overlaying a digital representation of the selected genealogy item on the artificial reality experience. This system seamlessly integrates genealogical research with artificial reality technology for an immersive user experience.

Aspects of the present disclosure are directed to applying voice controls to a target virtual object in an artificial reality environment. User controls in an artificial reality environment can take many forms. Some user controls, such as ray casting or gaze tracking, can incorporate selection mechanics to select the artificial reality environment element (e.g., virtual object) that the user is targeting for interaction. Other forms of user controls, such as voice controls, may not include such selection mechanics. Implementations disambiguate user voice input to select a target virtual object and control the target virtual object based on the voice input. For example, a disambiguation and control layer can select the virtual object the user intends to target with voice input, format input for the target virtual object using the voice input, and control the target virtual object via execution of one or more applications that manage the virtual object.

Implementations described herein can share scene data between multiple artificial reality (XR) devices, such as head-mounted displays (HMDs). A first XR device can retrieve stored spatial anchors associated with a scene, and align a coordinate frame with coordinate frames for a second XR device using the spatial anchors. The second XR device can have identified physical objects in the scene with corresponding object types defined in a scene lexicon (e.g., with a camera on the second XR device capturing images of physical objects and performing object recognition or through manual tagging of objects with object types), and store the object types and locations of the physical objects as scene data. The first XR device can obtain the scene data based on associations between the scene data and the spatial anchors and render virtual objects using the scene data, without having to rescan the scene for the physical objects.

Systems, methods, and devices authenticate processor instructions stored by a read-only memory (ROM). In one example, a ROM stores a block of register words. The block of register words includes a first register word specifying an authentication tag and one or more register words that each specify an instruction. A security controller identifies the first register word as specifying the authentication tag and performs authentication of the authentication tag. Upon successfully authenticating the authentication tag, the security controller forwards the register words that each specify instructions to a processor for execution. Upon unsuccessfully authenticating the authentication tag, the security controller blocks the register words that each specify instructions from execution by the processor.

A computer implemented method for facilitating system user interface (UI) interactions in an artificial reality (XR) environment is provided. The method includes rendering the system UI in the XR environment as a 3D virtual element. The method further includes tracking a position of a hand of a user and a pre-defined stable point on the user. The method further includes identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI around the grasped portion of the system UI such that a line, between the stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI via the grasped portion.

Aspects of the present disclosure are directed to application multitasking in a shell with a three-dimensional environment. Implementations immerse a user in a three-dimensional environment via an artificial reality system, such as a display environment for a system shell. The system shell can execute applications (e.g., system shell applications, remoted applications, etc.). An executing application can correspond to a displayed virtual object (e.g., panel). The system shell can concurrently execute two, three, or more applications and the three-dimensional environment can concurrently display two, three, or more corresponding virtual objects that display contents for the executing applications. Implementations of a mode manager can manage a mode for the three-dimensional environment / system shell. Example modes include cooperative mode and exclusive mode. Implementations of cooperative mode permit concurrent display of multiple virtual objects from different applications while the exclusive mode permits display of virtual objects only from the executing application entering exclusive mode.

Aspects of the present disclosure can trigger an action based on a motion detected by an artificial reality (XR) device, such as a head-mounted display (HMD). The XR device can display an XR experience to a user. While displaying the XR experience, the XR device can detect a physical interaction with the XR device using one of more sensors (e.g., sensors of an inertial measurement unit (IMU)). The physical interaction can generate a movement profile captured by the one or more sensors. The XR device can identify the physical interaction as a particular motion (e.g., one or more taps on the XR device) by applying a machine learning model to the movement profile. In response to identifying the particular motion, the XR device can trigger an action on the XR device (e.g., activating pass-through on the XR device).

A computer implemented method for location-based interaction in an artificial reality (XR) environment comprises determining an indication of a location. A historical state of the location is retrieved in the XR environment. One or more inputs specifying a command related to the historical state of the location, are received on an XR device. The command indicates either to retrieve information of virtual entities that previously existed at the location or to undo a modification of one or more features at the location. One or more virtual entities are matched to the location in the XR environment for a given timeframe and an indication of the matched one or more virtual entities, is displayed.

Aspects of the present disclosure are directed to operating an artificial reality system in single-handed mode. Artificial reality systems receive user input via several channels, however conventional systems lack functionality that helps diverse users operate these systems. Some types of input, such as input that requires movement of two hands and / or two hand-held controllers, may be more challenging for some diverse individuals to provide or may not be possible in certain situations, e.g., where one controller is disabled. Implementations operate artificial reality systems in single-handed mode, such as by translating instances of single-handed input into two-handed input. For example, the translated two-handed input can cause application functionality at the artificial reality system that would otherwise pose a challenge for some diverse individual.

Aspects of the present disclosure are directed to triggering object transitions between near-field and far-field regions in an artificial reality environment. For example, the near-field region can be within arm's length for the user, while the far-field region can be greater than arm's length from the user. Objects can be displayed within these regions such that the user can interact with the objects in the artificial reality environment. A field manager can cause a displayed object to transition from the near-field region to the far-field region and / or from the far-field region to the near-field region. The field manager can compare sensed user movements to one or more trigger criteria (e.g., distance threshold(s), velocity threshold(s), etc.) to trigger transition of an object between field regions.

Artificial-reality devices may include left and right eyecups for respectively viewing left and right images. A flexible shroud membrane may be connected to the left and right eyecups. The artificial-reality devices may also include an interpupillary distance adjustment mechanism for adjusting a distance between the left and right eyecups and a force-offsetting mechanism configured to augment a force applied to adjust the distance between the left and right eyecups. Various other devices, systems, and methods are also disclosed.

When a notification is to be shown, an artificial reality notification system can add the notification to a pre-defined location in the user's field of view (e.g., top, side, or bottom) where it stays as a head leashed virtual object until the user's gaze is direct to the notification. When the user's gaze is directed at the notification, the artificial reality notification system can make the notification world locked, allowing the user to move her head to bring the notification to the center of her field of view, move closer to the notification to make it larger, move around the notification to see aspects from different angles, etc. The notification can be dismissed if the user never directs her gaze at it for a first threshold amount of time or when the user looks away from the world-locked version for a second threshold amount of time.

An artificial reality system performs local user adaptation of machine learning models and global improvement of the machine learning models while ensuring data security and privacy. An artificial reality headset uses smart sensors and a system on chip (SoC). The smart sensor extracts features from sensor data, encrypts them and transmits the encrypted features to the SoC of the headset. The SoC provides the encrypted features to a server, for example, a server in a cloud platform. The server updates a base model with collected features and sends the updated base model parameters to headsets. The smart sensors of a headset receiving the updated model parameters, balance the model parameters with locally stored feature data, for example, user calibration features to perform user customization of the machine learning model.

A first device includes one or more processors configured to determine a frequency of channel sounding based at least on a movement characteristic of the first device. The one or more processors can generate a first frame requesting a second device in a wireless local area network (WLAN) to perform channel sounding with the first device using the determined frequency of channel sounding. The one or more processors can wirelessly transmit, via a transceiver, the generated first frame to the second device.

The disclosed system may include an antenna feed that has various electronic components. The system may also include a lens that has one or more layers, and an antenna embedded on at least a portion of the layers of the lens. The antenna may be electrically connected to at least one of the electronic components of the antenna feed. Various other apparatuses, wearable electronic devices, and methods of manufacturing are also disclosed.

A method of using time-of-flight sensors for gesture detection and content-rendering determinations in an artificial reality environment is provided. The method includes receiving data, from one or more time-of-flight sensors communicatively-coupled with a wrist-wearable device, about a physical surface, wherein the wrist-wearable device is communicatively-coupled with a head-wearable device that is configured to display a virtual object within an artificial-reality environment presented by the head-wearable device. The method also includes, in accordance with a determination, based on the data, that the physical surface has a curved surface portion, causing display of at least a portion of the virtual object at the curved surface portion, including updating the display of the virtual object in accordance with the curved surface portion.

Aspects of the present disclosure are directed to generating media element(s) using a multimodal scene graph. A scene manager can process visual information, such as video, images, and / or a recorded artificial relay scene, and generate a multimodal scene graph that comprises components and metadata generated via the processing. The scene manager can utilize the multimodal scene graph to generate social media elements, such as images, video, and / or artificial reality scenes. For example, a video of a user can be converted to a multimodal scene graph, which can be used to generate one or more images (e.g., memes, animated images, stickers, etc.), such as an image that represents the user via an avatar of the user. This generated media can be shared with other social platform users, and the stored multimodal scene graph can be accessed by the others to generate variations of the media.

A package charging station is disclosed. The packaging charging station may include an outer portion, an inner portion, a receiving portion, and a connecting portion. The inner portion may include a molding corresponding to an artificial reality device. The receiving portion may be included in the molding at a position corresponding to a charging port of the artificial reality device. The connecting portion may be included in the outer portion and may be configured to connect to external power for charging the artificial reality device when the artificial reality device is placed in the inner portion.

The invention discloses automatic boundary creation and relocation. Aspects of the present disclosure relate to instant boundary creation for virtual reality (VR) experiences. An artificial reality (XR) system may scan and collect visual feature data of a user's real-world environment in the background while rendering an augmented reality (AR) environment or a mixed reality (MR) environment. When the XR system detects an intent to enter a VR mode (e.g., by launching a VR application), the XR system may generate a recommendation to a boundary of a real-world space, which may include a type of interaction mode (e.g., a movable mode or a stationary mode). Based on the user's response to the recommendation, the XR system may prompt the user to further scan the real-world space and / or manually adjust the boundaries while continuing to scan and collect visual feature data in the background. Alternatively or additionally, some embodiments may automatically relocate the real-world space based on the generated boundaries.