1552 results about "Head worn display" patented technology

The present invention includes a three-dimensional (3D) image display device and a head-mounted display featuring a light-field image display comprising a display panel with a group of element pixels composed of multiple pixels displaying light field information, and a light shutter array panel capable of forming an aperture by opening and closing multiple light shutters. In the present invention, to address vergence-accommodation conflict (VAC), reduce crosstalk, improve viewing angles, and enhance 3D resolution, the light-field image display has a light field ray group with multiple radiation angles formed by the element pixel group and the aperture, wherein the resolution of the radiation angles of the light field ray group is 0.3° or less. It further comprises a padding pixel group with one or more pixels not displaying light field information around the element pixel group, and the light field ray group is output only within a central viewing angle range, while a two-dimensional image is output in angular ranges outside the central viewing angle.

Head-mounted displays with waveguides comprising superimposed diffractive gratings and methods for fabricating said waveguides are described herein. In an embodiment, a head-mounted display comprises an optical element and an image source that provides an image beam to an optical element. The optical element comprises two gratings superimposed over each other, at least one of which comprising a buried diffractive grating. The buried diffractive grating comprises a high-refractive index material interspersed with a low-refractive index material or non-solid pockets, such as gas, air or vacuum. Light diffracted by a first of the two gratings is further diffracted by a second of the two gratings without interacting with a surface of the optical element between diffractions.

A surgical microscope lighting control system comprising a controller configured to: estimate or determine a lighting need of a surgeon during at least part of a surgical procedure based at least on a viewing status of a region of illumination, wherein the viewing status of the region of illumination is estimated or determined (a) based at least on whether or not the region of illumination is being displayed, or (b) based at least on tracking data of the surgeon or a head-mounted display; determine an adjustment to be made to an illumination provided by a lighting unit of a surgical microscope based on the lighting need; and in response to determining the adjustment, send a first signal to the lighting unit to change the illumination according to the adjustment.

An apparatus includes a waveguide and one or more partially reflective surfaces embedded inside the waveguide, wherein each of the one or more partially reflective surfaces includes a multi-layer coating structure, wherein a first portion of the multi-layer coating structure induces an overall phase shift of light propagating through the first portion of the multi-layer coating structure and wherein a second portion of the multi-layer coating structure is selected to decrease the overall phase shift.

According to examples, an optical lens assembly for head-mount display (HMD) devices may include an optical lens configuration with a first optical element and a second optical element. The first optical element and the second optical element may be affixed together along a peripheral edge to form a gap between the two optical elements and may compensate chromatic dispersion characteristics. The optical lens configuration may also include a reflective polarizer layer, a quarter wave layer, and a semi-transparent mirror provided on selected surfaces of the optical elements. In some examples, the gap may be filled with air or an inert gas.

This disclosure describes an artificial reality system that presents artificial reality content or artificial reality effects based on, or in response to, interactions with one or more physical objects within a physical environment. In one example, this disclosure describes a method that includes determining that a user has performed a trigger action on a trigger object; responsive to determining that the user has performed the trigger action, generating artificial reality content; presenting the artificial reality content on a display associated with a head-mounted display; determining that the user has performed a de-trigger action; and responsive to determining that the user has performed the de-trigger action, discontinuing presentation of the artificial reality content.

A head-mountable display device can include a structural frame, where a first mounting bracket can be coupled to a first side of the structural frame. In some examples, the first mounting structure can include a cantilever arm. A second mounting bracket can be coupled to a second side of the structural frame opposite the first side, where the second mounting bracket can include a mounting arm, a sensor coupled to the cantilever arm, and a display assemble slidably coupled to the mounting arm.

A viewpoint setting unit of an image data generation device sets a reference viewpoint on a basis of position and orientation information regarding a head-mounted display, and a reference image drawing unit generates a reference image in a field of view corresponding to the reference viewpoint. An additional data generation unit acquires color information regarding an occluded part not represented in the reference image from a different viewpoint as additional sampling data. A reprojection unit of the head-mounted display transforms the reference image into an image from a latest viewpoint and determines a pixel value of the hidden part using the additional sampling data.

A head-mounted display includes a display unit and a facial interface. The display unit includes a display for displaying graphical content to a user. The facial interface is coupled to the display unit and configured to engage a face of the user to support the display unit thereon. The facial interface includes an upper portion that engages a forehead of the user and side portions that engage temple regions of the user. The facial interface converts forward force applied to the upper portion by the forehead into inward force applied by side portions to the temple regions.

Baseline blendshapes are identified from a captured facial image of a neutral facial expression of a user. For each of a number of facial expressions, blendshape weights are identified from a captured facial image of the facial expression of the user, and a blendshape model is generated by applying the blendshape weights to the baseline blendshapes. For each facial expression, an avatar is rendered from the blendshape model and avatar training images are simulated from the avatar in correspondence with facial images capturable by a head-mountable display (HMD). A machine learning model is trained based on the avatar training images for each facial expression.

Wearable head-mounted displays, such as virtual reality systems, present immersive experiences and environments to a wearer. However, the head-mounted displays, as well as the immersive environments that they produce, limit the wearer's ability to interact with outside observers. For example, a wearer may not be able to see outside observers, and outside observers may not have any insight to what the wearer is experiencing or where the wearer's attention is directed. Accordingly, a wearable electronic device may include an outward-facing display configured to display information to outside observers, such as images of the wearer's face or images that represent or indicate the state of the wearer and / or the head mounted display.

A head-mounted display compares a brightness in a surrounding environment based on a result of measurement by a surrounding light sensor with a surrounding light threshold predetermined for providing a user with a warning, and when the brightness in the surrounding environment is equal to or less than the surrounding light threshold and also when detecting that the user wearing the head-mounted display has performed a surrounding-environment-recognition-preparation-action for switching an action of viewing the display to an action of viewing the surrounding environment, executes control of outputting notification information for letting the user know that a visibility in the surrounding environment reduces, or executes control of outputting a control signal for a lighting fixture.

According to the multi-gesture interaction method and system based on the human-computer interaction technology, a user wears a head-mounted display, gesture actions of the user are captured through a camera or a depth sensor of the head-mounted display, and the captured gesture actions are analyzed into interaction instructions; and the head-mounted display sends the interaction instruction to the equipment, and the equipment identifies the interaction instruction and executes corresponding operation on the model according to the interaction instruction. Through multi-gesture recognition and interaction control, all-around functions of model grabbing, rotating, zooming, disassembling, resetting and menu management are achieved. The method is smooth in operation and easy to use, and supports seamless switching of various scenes. Through the compatibility with the head-mounted display device and various input devices, the user can freely control the virtual content in a single-person or multi-person cooperation mode, and the interaction efficiency and immersion are improved.

According to examples, a head-mounted display (HMD) headset may include at least two exterior-facing color cameras mounted on the front face of the HMD and in the same visual plane as the user's eyes. The at least two exterior-facing color cameras may collect images for stereo view synthesis. The HMD may include a processor, and a memory storing instructions, which when executed by the processor, cause the processor to perform stereo view synthesis with a machine-learning (ML) based technique including at least one of depth estimation, imaging sharpening, forward splatting, disocclusion filtering, or fusion.

Disclosed is method of image processing for three-dimensional reconstruction in an extended reality environment. The method includes defining a set of visual-attributes derived from reference images; identifying presence of at least one visual-attribute in a displayable content of target images to be used for the three-dimensional reconstruction; and modifying the displayable content of the target images, by concealing or displaying the identified at least one visual-attribute, for the three-dimensional reconstruction in the extended reality environment.

A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.

A system for generating an extended-reality environment may include a head-mounted display configured to be worn by a user, a non-transitory computer memory, and a processor configured to execute computer-readable instructions. The processor may be configured to generate a floorplan of the extended-reality environment. The processor may also be configured to customize the extended-reality environment based on user input. The processor may also be configured to receive input from a user indicating a selection of a product within the extended-reality environment, whereupon the processor may be configured to generate one or more display options in the extended-reality environment.

A head-mounted display system includes a left display assembly configured to provide left-side display light. A first left inertial measurement unit (IMU) is configured to measure an orientation of the left display assembly. A right display assembly is configured to provide right-side display light. A first right IMU is configured to measure an orientation of the right display assembly. A communication interface is configured to receive a left-side orientation of a head-tracking system as measured by a second left IMU, and a right-side orientation of a head-tracking system as measured by a second right IMU. A logic machine is configured to assess an alignment of the head-mounted display system based at least in part on the orientation of the left display assembly, the orientation of the right display assembly, the left-side orientation of the head-tracking system, and the right-side orientation of the head-tracking system.

A protective case for a device includes a cover portion configured to fit over the device, and a latch mechanism to secure the cover portion to the device. The latch mechanism has a latch rotatable about a first axis, and a ring spring rotatable about a second axis different from the first axis. Rotation of the latch about the first axis causes a deformation of the ring spring to generate a variable latch closing force that varies with rotation of the latch. In some embodiments, rotation of the latch compresses the ring spring to generate the variable latch closing force which increases to a maximum at a maximum compression point of the ring spring at a predetermined latch rotation angle. The ring spring then biases the latch open or closed depending on direction of rotation. The variable latch closing force is sufficient to adhere the cover portion to the device upon an impact. The protective case provides secure impact protection for augmented reality glasses, head-mounted displays, and other devices, with smooth latch operation.

A method for motion synchronization-based head pose estimation, by a head mounted display (HMD) device and an HMD device for performing the same are provided. The method includes receiving, by the HMD device, motion data from a plurality of motion sensors of the HMD device, receiving, by the HMD device, a plurality of image frames from at least one simultaneous localization and mapping SLAM camera of the HMD device, estimating, by the HMD device, a plurality of motion parameters of head movements of a user from the plurality of image frames received from memory, generating, by the HMD device, a filtered subset of the motion data received from the plurality of motion sensors based on the plurality of motion parameters of the head movements, synchronizing, by the HMD device, the plurality of image frames received from the memory and filtered subset of motion data, and estimating, by the HMD device, the head pose based on the synchronized plurality of image frames and motion data.

Calibration for eye tracking calibration in a head-mounted display can refined during use by tracking head rotation of a user during a time period while the head-mounted display is worn by the user, tracking eye rotation of the user during the time period, comparing the eye rotation of the user to the head rotation of the user during the time period, and refining a calibration state of eye tracking for the head-mounted display based on comparing the eye rotation of the user to the head rotation of the user during the time period.

There is provided an information processing apparatus, an information processing method, and a program capable of displaying an effect image indicating a situation of tactile presentation caused by an object. The information processing apparatus according to one aspect of the present technology acquires information regarding a situation of tactile presentation to at least a part of a user's body, and generates an effect image indicating the situation of the tactile presentation. The present technology can be applied to, for example, a transmissive head-mounted display (HMD).

A head-mounted display system includes a left display assembly configured to provide left-side display light and left-side test light. A left waveguide incouples the left-side display light and outcouples the left-side display light for viewing. A left optical sensor is positioned to measure the left-side test light. A left inertial measurement unit (IMU) is configured to measure an orientation of the left display assembly. A right display assembly is configured to provide right-side display light and right-side test light. A right waveguide incouples the right-side display light and outcouples the right-side display light for viewing. A right optical sensor is positioned to measure the right-side test light. A right IMU is configured to measure an orientation of the right display assembly. A logic machine is configured to assess a stereo alignment for the left- and right-side display light.

A head mounted display for use in a virtual reality, mixed reality or augmented reality system comprises a display device configured to display an image, a tracking system configured to determine a gaze direction of a user's eye and an optical system configured to project the image into the user's eye, the optical system comprising an adjustable optical device; and processing circuitry configured to control the adjustable optical device based on the gaze direction of the user's eye such that a position of the image projected into the user's eye is unchanged, when the gaze direction of the user's eye changes.

The present disclosure relates to systems and methods of facilitating a virtual reality (VR) ecommerce transaction, such as an immersive VR ecommerce transaction. The system can include a head-mounted display designed for rendering a virtual environment. The display can receive inputs through a variety of user interface mechanisms. The system can include an input device, either integrated with the head-mounted display or operable within the virtual environment, for capturing user interactions related to the ecommerce checkout process. The system can include a processor communicatively coupled to the head-mounted display and the at least one input device. The processor can dynamically generate a virtual environment representative of a checkout interface that is adaptable to multiple ecommerce platforms. Optionally, the system can process user interactions within the virtual checkout interface, for example, including product selection, payment information entry, and shipping details confirmation, to complete real-world transactions.

The invention provides an engine virtual simulation training system based on a mixed reality technology, and the system comprises a central processing unit which is used for executing a simulation algorithm and storing simulation data; the at least one head-mounted display is used for providing immersive visual experience; the handles are used for user interaction and operation; the at least two displays are used for displaying simulation results and operation interfaces; and the at least one tablet device is used for assisting display and control. According to the invention, a comprehensive immersive engine virtual simulation training system can be provided, the training efficiency and skill level of maintenance personnel are improved, and the risk and cost in actual operation are reduced.

In some implementations, there is a method provided that detects a physical object in a video stream provided by a camera of an extended reality device providing an extended reality environment; extracts context information from at least a portion of the video stream associated with the physical object; queries, using the extracted context information, a system including a database to obtain at least one task and / or at least one document object that are associated with the extracted context information; receives the at least one task and / or the at least one document object that are associated with the extracted context information; and provides to the head-mounted display the at least one task and / or the at least one document object to cause the extended reality device to augment, based on the extracted context information from the physical object, the extended reality environment. Related systems, methods, and articles of manufacture are also disclosed.

A virtual image display device and a stereoscopic image establishing method are provided. The virtual image display device includes a head-mounted display and an accessory. The head-mounted display performs an image capturing operation on a first region of an object to obtain first image information. The accessory has a first image capturing device for performing an image capturing operation on a second region of the object to obtain second image information. The head-mounted display establishes stereoscopic image information of the object based on the first image information and the second image information.