1292 results about "Head worn display" patented technology

Head-mounted displays with waveguides comprising superimposed diffractive gratings and methods for fabricating said waveguides are described herein. In an embodiment, a head-mounted display comprises an optical element and an image source that provides an image beam to an optical element. The optical element comprises two gratings superimposed over each other, at least one of which comprising a buried diffractive grating. The buried diffractive grating comprises a high-refractive index material interspersed with a low-refractive index material or non-solid pockets, such as gas, air or vacuum. Light diffracted by a first of the two gratings is further diffracted by a second of the two gratings without interacting with a surface of the optical element between diffractions.

A surgical microscope lighting control system comprising a controller configured to: estimate or determine a lighting need of a surgeon during at least part of a surgical procedure based at least on a viewing status of a region of illumination, wherein the viewing status of the region of illumination is estimated or determined (a) based at least on whether or not the region of illumination is being displayed, or (b) based at least on tracking data of the surgeon or a head-mounted display; determine an adjustment to be made to an illumination provided by a lighting unit of a surgical microscope based on the lighting need; and in response to determining the adjustment, send a first signal to the lighting unit to change the illumination according to the adjustment.

An apparatus includes a waveguide and one or more partially reflective surfaces embedded inside the waveguide, wherein each of the one or more partially reflective surfaces includes a multi-layer coating structure, wherein a first portion of the multi-layer coating structure induces an overall phase shift of light propagating through the first portion of the multi-layer coating structure and wherein a second portion of the multi-layer coating structure is selected to decrease the overall phase shift.

According to examples, an optical lens assembly for head-mount display (HMD) devices may include an optical lens configuration with a first optical element and a second optical element. The first optical element and the second optical element may be affixed together along a peripheral edge to form a gap between the two optical elements and may compensate chromatic dispersion characteristics. The optical lens configuration may also include a reflective polarizer layer, a quarter wave layer, and a semi-transparent mirror provided on selected surfaces of the optical elements. In some examples, the gap may be filled with air or an inert gas.

A viewpoint setting unit of an image data generation device sets a reference viewpoint on a basis of position and orientation information regarding a head-mounted display, and a reference image drawing unit generates a reference image in a field of view corresponding to the reference viewpoint. An additional data generation unit acquires color information regarding an occluded part not represented in the reference image from a different viewpoint as additional sampling data. A reprojection unit of the head-mounted display transforms the reference image into an image from a latest viewpoint and determines a pixel value of the hidden part using the additional sampling data.

Baseline blendshapes are identified from a captured facial image of a neutral facial expression of a user. For each of a number of facial expressions, blendshape weights are identified from a captured facial image of the facial expression of the user, and a blendshape model is generated by applying the blendshape weights to the baseline blendshapes. For each facial expression, an avatar is rendered from the blendshape model and avatar training images are simulated from the avatar in correspondence with facial images capturable by a head-mountable display (HMD). A machine learning model is trained based on the avatar training images for each facial expression.

A head-mounted display compares a brightness in a surrounding environment based on a result of measurement by a surrounding light sensor with a surrounding light threshold predetermined for providing a user with a warning, and when the brightness in the surrounding environment is equal to or less than the surrounding light threshold and also when detecting that the user wearing the head-mounted display has performed a surrounding-environment-recognition-preparation-action for switching an action of viewing the display to an action of viewing the surrounding environment, executes control of outputting notification information for letting the user know that a visibility in the surrounding environment reduces, or executes control of outputting a control signal for a lighting fixture.

Disclosed is method of image processing for three-dimensional reconstruction in an extended reality environment. The method includes defining a set of visual-attributes derived from reference images; identifying presence of at least one visual-attribute in a displayable content of target images to be used for the three-dimensional reconstruction; and modifying the displayable content of the target images, by concealing or displaying the identified at least one visual-attribute, for the three-dimensional reconstruction in the extended reality environment.

A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.

A system for generating an extended-reality environment may include a head-mounted display configured to be worn by a user, a non-transitory computer memory, and a processor configured to execute computer-readable instructions. The processor may be configured to generate a floorplan of the extended-reality environment. The processor may also be configured to customize the extended-reality environment based on user input. The processor may also be configured to receive input from a user indicating a selection of a product within the extended-reality environment, whereupon the processor may be configured to generate one or more display options in the extended-reality environment.

A head-mounted display system includes a left display assembly configured to provide left-side display light. A first left inertial measurement unit (IMU) is configured to measure an orientation of the left display assembly. A right display assembly is configured to provide right-side display light. A first right IMU is configured to measure an orientation of the right display assembly. A communication interface is configured to receive a left-side orientation of a head-tracking system as measured by a second left IMU, and a right-side orientation of a head-tracking system as measured by a second right IMU. A logic machine is configured to assess an alignment of the head-mounted display system based at least in part on the orientation of the left display assembly, the orientation of the right display assembly, the left-side orientation of the head-tracking system, and the right-side orientation of the head-tracking system.

A protective case for a device includes a cover portion configured to fit over the device, and a latch mechanism to secure the cover portion to the device. The latch mechanism has a latch rotatable about a first axis, and a ring spring rotatable about a second axis different from the first axis. Rotation of the latch about the first axis causes a deformation of the ring spring to generate a variable latch closing force that varies with rotation of the latch. In some embodiments, rotation of the latch compresses the ring spring to generate the variable latch closing force which increases to a maximum at a maximum compression point of the ring spring at a predetermined latch rotation angle. The ring spring then biases the latch open or closed depending on direction of rotation. The variable latch closing force is sufficient to adhere the cover portion to the device upon an impact. The protective case provides secure impact protection for augmented reality glasses, head-mounted displays, and other devices, with smooth latch operation.

A method for motion synchronization-based head pose estimation, by a head mounted display (HMD) device and an HMD device for performing the same are provided. The method includes receiving, by the HMD device, motion data from a plurality of motion sensors of the HMD device, receiving, by the HMD device, a plurality of image frames from at least one simultaneous localization and mapping SLAM camera of the HMD device, estimating, by the HMD device, a plurality of motion parameters of head movements of a user from the plurality of image frames received from memory, generating, by the HMD device, a filtered subset of the motion data received from the plurality of motion sensors based on the plurality of motion parameters of the head movements, synchronizing, by the HMD device, the plurality of image frames received from the memory and filtered subset of motion data, and estimating, by the HMD device, the head pose based on the synchronized plurality of image frames and motion data.

Calibration for eye tracking calibration in a head-mounted display can refined during use by tracking head rotation of a user during a time period while the head-mounted display is worn by the user, tracking eye rotation of the user during the time period, comparing the eye rotation of the user to the head rotation of the user during the time period, and refining a calibration state of eye tracking for the head-mounted display based on comparing the eye rotation of the user to the head rotation of the user during the time period.

There is provided an information processing apparatus, an information processing method, and a program capable of displaying an effect image indicating a situation of tactile presentation caused by an object. The information processing apparatus according to one aspect of the present technology acquires information regarding a situation of tactile presentation to at least a part of a user's body, and generates an effect image indicating the situation of the tactile presentation. The present technology can be applied to, for example, a transmissive head-mounted display (HMD).

A head-mounted display system includes a left display assembly configured to provide left-side display light and left-side test light. A left waveguide incouples the left-side display light and outcouples the left-side display light for viewing. A left optical sensor is positioned to measure the left-side test light. A left inertial measurement unit (IMU) is configured to measure an orientation of the left display assembly. A right display assembly is configured to provide right-side display light and right-side test light. A right waveguide incouples the right-side display light and outcouples the right-side display light for viewing. A right optical sensor is positioned to measure the right-side test light. A right IMU is configured to measure an orientation of the right display assembly. A logic machine is configured to assess a stereo alignment for the left- and right-side display light.

A head mounted display for use in a virtual reality, mixed reality or augmented reality system comprises a display device configured to display an image, a tracking system configured to determine a gaze direction of a user's eye and an optical system configured to project the image into the user's eye, the optical system comprising an adjustable optical device; and processing circuitry configured to control the adjustable optical device based on the gaze direction of the user's eye such that a position of the image projected into the user's eye is unchanged, when the gaze direction of the user's eye changes.

The present disclosure relates to systems and methods of facilitating a virtual reality (VR) ecommerce transaction, such as an immersive VR ecommerce transaction. The system can include a head-mounted display designed for rendering a virtual environment. The display can receive inputs through a variety of user interface mechanisms. The system can include an input device, either integrated with the head-mounted display or operable within the virtual environment, for capturing user interactions related to the ecommerce checkout process. The system can include a processor communicatively coupled to the head-mounted display and the at least one input device. The processor can dynamically generate a virtual environment representative of a checkout interface that is adaptable to multiple ecommerce platforms. Optionally, the system can process user interactions within the virtual checkout interface, for example, including product selection, payment information entry, and shipping details confirmation, to complete real-world transactions.

The invention provides an engine virtual simulation training system based on a mixed reality technology, and the system comprises a central processing unit which is used for executing a simulation algorithm and storing simulation data; the at least one head-mounted display is used for providing immersive visual experience; the handles are used for user interaction and operation; the at least two displays are used for displaying simulation results and operation interfaces; and the at least one tablet device is used for assisting display and control. According to the invention, a comprehensive immersive engine virtual simulation training system can be provided, the training efficiency and skill level of maintenance personnel are improved, and the risk and cost in actual operation are reduced.

In some implementations, there is a method provided that detects a physical object in a video stream provided by a camera of an extended reality device providing an extended reality environment; extracts context information from at least a portion of the video stream associated with the physical object; queries, using the extracted context information, a system including a database to obtain at least one task and / or at least one document object that are associated with the extracted context information; receives the at least one task and / or the at least one document object that are associated with the extracted context information; and provides to the head-mounted display the at least one task and / or the at least one document object to cause the extended reality device to augment, based on the extracted context information from the physical object, the extended reality environment. Related systems, methods, and articles of manufacture are also disclosed.

A virtual image display device and a stereoscopic image establishing method are provided. The virtual image display device includes a head-mounted display and an accessory. The head-mounted display performs an image capturing operation on a first region of an object to obtain first image information. The accessory has a first image capturing device for performing an image capturing operation on a second region of the object to obtain second image information. The head-mounted display establishes stereoscopic image information of the object based on the first image information and the second image information.

Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.

Users exploiting near-to-eye (NR2I) displays for augmented reality and / or correction of low vision are typically wearing these NR2I displays for specific tasks or for extended periods of time, potentially all their time awake. Conflicting tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics should be concurrently balanced with providing an optical vision system that provides the user with a wide field of view, high image resolution, and a large exit pupil for eye placement with sufficient eye clearance. Accordingly, embodiments of the invention provide NR2I displays meeting these conflicts whilst also addressing the inherent variations between user in respect of their head dimensions, head and eye geometry, as well as adapting the displayed content to reflect the user's task at-hand, visual defects or degradations, visual focus and intent upon various regions-of-interest within their field of view. Such HMDs providing enhanced user experiences.

A program executed by a head-mounted display or an information processing device connected to the head-mounted display to provide virtual reality on the head-mounted display, the program causing the head-mounted display or the information processing device to function as: a determination unit that determines a capture range in a virtual space using a hand gesture by a hand of a user in a real space or a hand gesture by an object of a hand in a virtual space; and a capture unit that acquires, as image data, content displayed in the capture range determined in the virtual space.

A light generation device (LGD) includes an attachment configured to couple the LDG to a surface of an interior of a vehicle, a sensor configured to capture motion data of the LGD, a plurality of light projectors configured to generate a plurality of light patterns within the interior, a memory, and a processor operatively coupled to the sensor and the memory. The processor is configured to cause the plurality of light patterns to be generated within the interior via the plurality of light projectors, and send the motion data to a head mounted display (HMD) that determines a pose associated with the HMD after receiving the motion data based on at least one of the motion data or image data (1) that is captured by the HMD and (2) that includes a representation of at least some patterns from the plurality of light patterns.

A vision test can be implemented in a virtual reality (VR) environment using a computer device that includes a head-mounted display (HMD). The computer device can obtain historical vision data of a patient user. Based on the historical vision data, the computer device determines an ordered sequence of vision tests including a first vision test for the patient user. The first vision test is followed by a set of one or more subsequent vision tests of the ordered sequence of vision tests. The computer device executes a user application configured to enable the ordered sequence of vision tests by rendering a user interface on the display. A first visual stimulus of the first vision test is displayed on the user interface. The computer device obtains a user response to the first visual stimulus, and dynamically adjusts one or more subsequent visual stimuli based on the user response.

An image processing method and apparatus is provided that includes receiving two consecutive image frames captured live by an image capture apparatus, each of the two image frames including a subject wearing a head mount display device, generate a first bounding box surrounding the head mount display device using orientation information obtained from the head mount display, generate a second bounding box surrounding the head mount display using an object detection model trained to identify the head mount display, calculate a difference indicator by comparing differences, on a pixel by pixel basis between the generated first and second bounding boxes, select the first bounding box when it is determined that the difference indicator exceeds a predetermined threshold, provide coordinates representing the first bounding box to identify a region within the images to be replaced by a region of a precaptured image that is occluded by the head mount display device.

Systems include three optical elements arranged along an optical axis each having a different cylinder axis and a variable cylinder refractive power. Collectively, the three elements form a compound optical element having an overall spherical refractive power (SPH), cylinder refractive power (CYL), and cylinder axis (Axis) that can be varied according to a prescription (Rx).

The invention discloses an intelligent packaging table based on counting and classification of surgical instruments, relates to the technical field of augmented reality, and aims at solving the technical problems that after existing surgical instruments are disinfected and cleaned, manual counting, classification and packaging efficiency is low, and accuracy is difficult to guarantee. Comprising a head-mounted display and a plurality of image acquisition modules, the plurality of image acquisition modules are dispersedly arranged on the head-mounted display and are used for acquiring images of surgical instruments and surroundings on a packaging table and displaying the image information acquired by the image acquisition modules, and meanwhile, a display screen is arranged in the head-mounted display to display the image information of the surgical instruments and the surroundings. The names and the number of the corresponding surgical instruments are projected at the position of each counting, classifying and packaging box, and the number is updated in an inverted order along with placement of the surgical instruments; and the identification module is connected to the image acquisition module and is used for identifying various surgical instruments acquired by the image acquisition module. The method has the advantages that the working efficiency is improved, and the counting and classification accuracy is improved.