53 results about "Cross reality" patented technology

A cross reality system that renders virtual content generated by executing native mode applications may be configured to render web-based content using components that render content from native applications. The system may include a Prism manager that provides Prisms in which content from executing native applications is rendered. For rendering web based content, a browser, accessing the web based content, may be associated with a Prism and may render content into its associated Prism, creating the same immersive experience for the user as when content is generated by a native application. The user may access the web application from the same program launcher menu as native applications. The system may have tools that enable a user to access these capabilities, including by creating for a web location an installable entity that, when processed by the system, results in an icon for the web content in a program launcher menu.

A portable electronic system receives a set of one or more canonical maps and determines the sparse map based at least in part upon one or more anchors pertaining to the physical environment. The sparse map is localized to at least one canonical map in the set of one or more canonical maps, and a new canonical map is created at least by merging sparse map data of the sparse map into the at least one canonical map. The set of one or more canonical maps may be determined from a universe of canonical maps comprising a plurality of canonical maps by applying a hierarchical filtering scheme to the universe. The sparse map may be localized to the at least one canonical map at least by splitting the sparse map into a plurality of connected components and by one or more merger operations.

Provided is a technology that is for using cross reality (XR) to teach a robot while verifying the effects of a light source. A device (100) comprises an XR screen generation unit that is for generating an XR screen that blends a real space and a virtual space, an XR event unit that is for detecting events related to the XR screen (12), a placement unit that is for updating the position of a light source (146) that is provided to the tip of a robot (150) that is in the virtual space, and a teaching point storage unit that is for storing teaching points for the robot (150). The XR screen generation unit displays a workpiece and the light source (146) that are in the virtual space on the XR screen (12). The placement unit moves the light source (146) on the XR screen (12) on the basis of detection of a movement event for the light source (146). The teaching point storage unit stores teaching points for the robot (150) as moving in association with the light source (146).

The present technology pertains to an information processing apparatus, an information processing method, and an input device that enable a contact state of a virtual object in an XR (cross reality) space to be presented to a user. The information processing apparatus includes: an identification unit configured to identify a state of each virtual object in an XR space; a space control unit for calculating a contact condition between the virtual objects in the XR space based on the state of each virtual object and the design data of each virtual object; and a presentation control unit for controlling presentation of contact condition feedback indicating a contact condition between the virtual objects. This technology is applicable to, for example, an XR system.

A cross reality system enables any of multiple devices to efficiently and accurately access previously stored maps and render virtual content specified in relation to those maps. The cross reality system may include a cloud-based localization service that responds to requests from devices to localize with respect to a stored map. The request may include one or more sets of feature descriptors extracted from an image of the physical world around the device. Those features may be posed relative to a coordinate frame used by the local device. The localization service may identify one or more stored maps with a matching set of features. Based on a transformation required to align the features from the device with the matching set of features, the localization service may compute and return to the device a transformation to relate its local coordinate frame to a coordinate frame of the stored map.

The design article in this case is an image for a calibration operation used to calibrate each user's position information, position information and / or time information for displaying content in a space formed by images provided by XR (cross reality) in a simple, low-cost, functional, quick, and immersive manner. When each user viewing images related to the space provided by XR wears a head-mounted display capable of displaying images and places their hand in a position corresponding to a pattern displayed on a screen installed in any location, the head-mounted display detects the placed hand and executes processing to calibrate each user's position information, position information and / or time information for displaying content in the space provided by XR.

An information processing apparatus capable of promoting utilization of an input device used for operations in the XR. The information processing apparatus includes a memory device that stores a set of instructions, and at least one processor that executes the set of instructions to: detect an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality, and determine the holding hand based on the re-holding action detected.

This document describes scene understanding for cross reality systems using occupancy grids. In one aspect, a method includes recognizing one or more objects in a model of a physical environment generated using images of the physical environment. For each object, a bounding box is fit around the object. An occupancy grid that includes a multiple cells is generated within the bounding box around the object. A value is assigned to each cell of the occupancy grid based on whether the cell includes a portion of the object. An object representation that includes information describing the occupancy grid for the object is generated. The object representations are sent to one or more devices.

This product is a head-mounted communication terminal that is worn on the head as shown in the "Reference Diagram Showing Usage," and projects images and other data onto the user's retina from a light source. This product can be used for various purposes, such as information verification and communication within XR (Cross Reality) spaces, which is a technology that merges the real world and virtual world to make non-existent things perceptible.

The present technology relates to a control system and a control method that make it possible to prevent detraction from a sense of immersion. Control is carried out with respect to display of an assistance guide for assisting spatial recognition which is performed by a user in a real space and performed in a virtual space displayed on a real object that is an object in the real space, such control being in accordance with the state of the user or the state of content reproduced in the virtual space. The present technology can be applied to, for example, an XR (cross reality) experience providing system that provides an XR experience.

This product is a head-mounted communication information terminal that is worn on the head, as shown in "Reference Figure 1 showing the state of use," and projects images and other data onto the user's retina from a light source. This product can be used for various purposes, such as information verification and communication in XR (cross-reality) spaces, which is a technology that merges the real world and the virtual world to make things that do not exist in reality perceptible. As shown in "Front view of the changed state," "Left side view of the changed state," "Front side perspective view of the changed state," and "Reference Figure 1 showing the state of use" and "Reference Figure 2 showing the state of use," the entire frame can be moved up and down depending on whether projection is required or not.

A cross reality system enables any of multiple devices to efficiently access previously stored maps. Both stored maps and tracking maps used by portable devices may have any of multiple types of location metadata associated with them. The location metadata may be used to select a set of candidate maps for operations, such as localization or map merge, that involve finding a match between a location defined by location information from a portable device and any of a number of previously stored maps. The types of location metadata may prioritized for use in selecting the subset. To aid in selection of candidate maps, a universe of stored maps may be indexed based on geo-location information. A cross reality platform may update that index as it interacts with devices that supply geo-location information in connection with location information and may propagate that geo-location information to devices that do not supply it.

A cross reality system enables any of multiple devices to efficiently and accurately access previously persisted maps, even maps of very large environments, and render virtual content specified in relation to those maps. The cross reality system may quickly process a batch of images acquired with a portable device to determine whether there is sufficient consistency across the batch in the computed localization. Processing on at least one image from the batch may determine a rough localization of the device to the map. This rough localization result may be used in a refined localization process for the image for which it was generated. The rough localization result may also be selectively propagated to a refined localization process for other images in the batch, enabling rough localization processing to be skipped for the other images.

A video output method produces, in an augmented reality space provided by augmenting a real space, a display about one space in a facility including a plurality of spaces in the real space, and includes: acquiring status information indicating a status of each of the plurality of spaces; identifying, among the plurality of spaces in the real space, a first space where a user is currently present; determining, based on the status information of each of the plurality of spaces, as a second space to which the first space is to be coupled, a space that is currently in a predetermined status among the plurality of spaces in the real space; and outputting presentation information for presenting, to the user, via a cross reality (XR) device worn by the user, a video in which the second space determined is coupled to the first space in the augmented reality space.

The content of the training provided to participants should reflect at least one of the region and climate. [Solution] The information providing device is a virtual space or cross-reality device for providing a target space for training on maintenance of maintenance targets to a training target, and has an acquisition unit, a training data acquisition unit, and a provision unit. The acquisition unit acquires environmental information. The environmental information includes at least one of regional information that can identify the area to which the trainee is responsible and climate information concerning the climate in the area. The training data acquisition unit uses the environmental information to acquire training data relating to maintenance targets that should be reflected in the target space. The provision unit performs processing to provide the target space reflecting the training data to a communication device used by the trainee.

The purpose of the present invention is to provide a temple pad which is detachable from a glasses-type terminal and improves wearability. The temple pad comprises: a first portion that rests on the ears of a wearer of a cross-reality terminal; a second portion that presses a portion of the head of the wearer behind the ears; and a coupling portion that is connected to the first portion and the second portion and is coupled to the temples of the cross-reality terminal.

According to one embodiment, a cross-reality comprises an imaging device, a display device, and a processing device. The imaging device is configured to acquire an image. The display device is configured to display a virtual space. The processing device is configured to detect a hand of a human from the image. the processing device is configured to generate an object in the virtual space in response to a command input by the human, and change a position and a size of the generated object in accordance with a movement of the hand.

Systems and method for tracking multi-user engagement across real-world and digital environments are provided. A user account associated with gameplay may be linked to a code, which may further be embedded or presented on a physical collectible item. The user may digitally check into real-world events by having their code scanned or otherwise detected at a real-world location. Geolocation data associated with multiple different users may be used to track interactive group activities of the users in the real-world environment, as well as to prompt interactive group activities by notifying the users that they are within a real-world proximity of other users with whom they may have interacted with in digital environment (e.g., played games together, spectated each other's games).

To provide a lightweight cross reality device with passive depth extraction.SOLUTION: There is disclosed a wearable display system including multiple cameras and a processor. A grey scale camera and a color camera can be arranged so as to provide a central view field associated with both cameras and a peripheral view field associated with one of the two cameras. One or more of the two cameras may be a plenoptic camera. The wearable display system may acquire light field information using the at least one plenoptic camera, and create a world model using the first light field information and first depth information stereoscopically determined from images acquired by the grey scale camera and the color camera.SELECTED DRAWING: Figure 21

A cross reality system enables any of multiple devices to efficiently and accurately access previously persisted maps of very large scale environments and render virtual content specified in relation to those maps. The cross reality system may quickly determine whether a 2D set of features derived from images acquired with a portable device match a set of 3D features of an environment map and, if so, determine the relative pose of the feature sets. The pose may be used in quickly and accurately localizing the portable device to the environment map. Pairs of features in the 2D and 3D features sets may be identified based on matching feature descriptors and may be scored in a neural network trained to assess the quality of the match. Poses may be identified based on subsets of the matching features weighted towards pairs of features with high quality.

Cross-Reality systems enable any of various types of devices to effectively and accurately access previously stored maps and render virtual content specified in relation to those maps. Cross-Reality systems may include cloud-based location services that respond to requests from devices to locate themselves relative to stored maps. Any type of device with native hardware and software configured for augmented reality operation can be configured to work with a cross-Reality system by incorporating components that interface between the device's native AR framework and the cloud-based location services. These components can present location information about the device in a format recognized by the location services. Furthermore, these components can filter or otherwise process perceptual data provided by the native AR framework to improve location accuracy.

A wearable display system for a cross reality (XR) system may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR function being performed. For tracking an object, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. The object may be tracked based on asynchronously acquired events indicating changes within the patches. Stereoscopic or other types of image information may be used when event-based object tacking yields an inadequate quality metric. The tracked object may be a user's hand or a stationary object in the physical world, enabling calculation of the pose of the wearable display system and of the wearer's head.

To provide a lightweight and low power cross reality device with high temporal resolution.SOLUTION: A wearable display system for a cross reality (XR) system may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR function being performed. For tracking an object, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. The object may be tracked based on asynchronously acquired events indicating changes within the patches.SELECTED DRAWING: Figure 21

Cross reality (XR) display devices, such as augmented reality devices, with enhanced state control for anchor-based augmented reality applications are disclosed. In some embodiments, the devices are configured to obtain information identifying applications with respective anchor locations located within a first threshold distance metric of an XR device, with an anchor location corresponding to a real-world location at which virtual content is to be presented; determining respective states, selected from a multitude of states, to be assigned to the applications, the states being determined based on a proximity of the anchor locations to the XR device; implementing the states, with a first application being assigned a state to render virtual content, and with the first application presenting virtual content via the XR device; and in response to movement of the XR device, determining updated states of the one or more applications.

Creating scent models and using scent models in cross-reality environments can include capturing experience data identifying a scent detected and a context in which the scent was detected. The experience data can be provided to a scent modeling service to generate a scent model that can represent perceived scents and perceived scent intensities for a user. The scent model can be used to generate cross-reality session data to be used in a cross-reality session presented by a cross-reality device. The cross-reality device can include a scent generator and can generate the cross-reality session using data obtained from the user device. The cross-reality device can generate a further scent during the cross-reality session based on the scent model.

A wearable device system for a cross-reality vision, including a virtual reality image, an augmented reality image, a real-world image, and a mixed reality image, includes an optical combiner configured to receive a virtual reality content from an outside electricity device; a supporting frame where the optical combiner is supported thereon; a wearable band coupled to the supporting frame; wherein the supporting frame comprises an adjustable frame angledly and pivotally coupled to the wearable band; wherein the optical combiner is configured to partially cover eyes of an observer and includes a first free-form optical component, a second free-form optical element overlappedly arranged with the first free-form optical component, and a microdisplay arranged adjacent to the first free-form optical component.

The present technology relates to an information processing apparatus and an information processing method that improve workability in a cross reality (XR) space. An information processing apparatus includes: a recognition unit that recognizes a state of an element related to XR; and a space control unit that controls physical laws applied to a virtual object in an XR space on the basis of the state of the element related to XR. The present technology can be applied to, for example, an XR system.