130 results about "Head tracking" patented technology

A system includes a head-up display (HUD) system including a display; a combiner; and at least one processor communicatively coupled to at least one image sensor of at least one tracking system and to the display. The at least one processor configured to: receive image data from one or more of the at least one image sensor, wherein the image data is (i) for performing eye tracking and / or head tracking operations and (ii) for monitoring the displayed images; and detect the at least one malfunction of the HUD system.

The invention discloses a cradle head tracking method, system and device, a storage medium and a program product, and relates to the technical field of cradle heads, and the method comprises the steps: obtaining the target position information of a tracking target in continuous multi-frame image frames collected by an image sensor, and the size of a detection frame, determining a pan-tilt rotation angle of a target pan-tilt carrying an image sensor when multiple image frames are acquired; determining a target position offset between the target position and the center of the image based on the target position information, and mapping the size of the detection frame into a target distance between the tracking target and the image sensor; inputting the target position offset and the holder rotation angle corresponding to the multiple image frames into a motion estimation model to obtain a predicted position; and determining a pan-tilt angle value of the target pan-tilt based on the predicted position and the target distance, and driving the target pan-tilt to rotate based on the pan-tilt angle value. According to the invention, the cradle head keeps stable tracking while quickly responding to target movement, so that the stability and reliability of cradle head tracking control are improved.

A multi-arm robotic surgical system having an endoscopic camera (C) coupled to a robotic arm and a plurality of surgical instruments each detachably coupled to a robotic arm. The multi-arm robotic surgical system further comprises of a surgeon console having a master controller, a left-hand controller and a right-hand controller, a three-dimensional (3D) HD monitor, a two-dimensional (2D) touch screen monitor, a pair of trackable 3D glasses to be worn by the surgeon, a head tracking camera, a foot pedal controller, a control panel for performing emergency system functions, an electrosurgical unit interface, an image processor configured to process a 3D image data received from the endoscopic camera (C), a digital device configured to prepare an image data by using the processed 3D image data received from the image processor and superimposing it with a 2D overlay including a status of the plurality of surgical instruments and display on the 3D HD monitor and a patient side staff 3D monitor.

The invention provides AR glasses based on integrated imaging three-dimensional display. According to the AR glasses, the integrated imaging technology is adopted, a three-dimensional light field is reconstructed through the micro-lens array, and multi-view three-dimensional image display is achieved. The display module adopts a Micro-LED display screen and is combined with a micro-lens array to realize superposition of a virtual image and a real scene. The optical waveguide system uses a holographic waveguide or a free-form surface optical device to guide virtual image light to the visual field of a user, so that the equipment is light and the display definition is ensured. Meanwhile, the system is provided with a head tracking and parallax adjusting module, and an inertial measurement unit (IMU) and an external camera are used for tracking the head movement of a user in real time, dynamically adjusting three-dimensional image display and ensuring the consistency of a virtual image and a real scene. According to the design, through precise matching of the display screen and the micro lens array, high-quality reconstruction of a three-dimensional image is ensured, and the cruising ability of equipment is improved by optimizing power consumption management.

A head-mounted display system includes a left display assembly configured to provide left-side display light. A first left inertial measurement unit (IMU) is configured to measure an orientation of the left display assembly. A right display assembly is configured to provide right-side display light. A first right IMU is configured to measure an orientation of the right display assembly. A communication interface is configured to receive a left-side orientation of a head-tracking system as measured by a second left IMU, and a right-side orientation of a head-tracking system as measured by a second right IMU. A logic machine is configured to assess an alignment of the head-mounted display system based at least in part on the orientation of the left display assembly, the orientation of the right display assembly, the left-side orientation of the head-tracking system, and the right-side orientation of the head-tracking system.

Embodiments are disclosed for head tracking state detection based on correlated motion of a source device and a headset communicatively coupled to the source device. In an embodiment, a method comprises: obtaining, using one or more processors of a source device, source device motion data from a source device and headset motion data from a headset; determining, using the one or more processors, correlation measures using the source device motion data and the headset motion data; updating, using the one or more processors, a motion tracking state based on the determined correlation measures; and initiating head pose tracking in accordance with the updated motion tracking state.

A controlling system of an endoscopic surgical robot based on head tracking is disclosed. The system includes a host, the robot and a complex camera. The robot holds an endoscope at a specific position through a specific gesture. The complex camera includes a 2D camera for obtaining facial features of a doctor to identify whether the doctor is a registered user. The complex camera includes a 3D camera for obtaining depth information of the doctor's head. The host estimates a 2D space information and a 3D space information of the doctor's head according to the facial features and the depth information, and transforms the 2D space information and 3D space information to a robot moving information by a transformation matrix to control the robot to move.

A head-tracking multi-view display includes a multi-beam backlight that provides a plurality of light beams having different principal angular directions corresponding to different view directions of a multi-view image. A processor receives a plurality of provisional views of the multi-view image. The provisional views correspond to different view directions. The processor receives information regarding a tracking position of a user. The processor shifts the provisional views with respect to the view directions to form a plurality of shifted views corresponding to different view directions. The shifted views vary as a function of the tracking position of the user and are shifted by a shift value that varies across the field of view of the multi-view image. A light valve array modulates the plurality of light beams to provide the plurality of shifted views of the multi-view image in the view directions as the multi-view image.

The present disclosure relates to head tracking for parameterized binaural output systems and methods. A method for encoding channel-based or object-based input audio for playback comprises the following steps: (a) first rendering the channel-based or object-based input audio into an initial output representation; (b) determining an estimate of a dominant audio component from the channel-based or object-based input audio and determining a series of dominant audio component weighting factors for mapping the initial output representation to the dominant audio component; (c) determining an estimate of the direction or position of the dominant audio component; and (d) encoding the initial output representation, the dominant audio component weighting factors, and the dominant audio component direction or position into an encoded signal for playback.

In some embodiments, a method comprises executing, by a head-tracked audio system, a first algorithm configured to dynamically update a forward head angle and a spatial orientation in response to a detected head movement, and a second algorithm configured to adjust a recentering filter based on the detected head movements, and maintaining, by the head-tracked audio system through execution of the first algorithm and the second algorithm, a spatial audio placement relative to a wearer during the detected head movements.

Described herein are methods and systems for a vehicle system which provide inbuilt road noise cancellation in the vehicle. In one or more embodiments, a method for road noise cancellation comprises using a head-tracking device to monitor an occupant ear position, capturing airborne noise using a feedforward microphone and a headrest microphone of a zone in which the occupant ear is positioned, updating acoustic path information according to the occupant ear position(s) and speaker position(s) within the zone, generating a noise cancellation signal using sampling rate greater than 2 kHz, and outputting the noise cancellation signal via a headrest speaker located near the zone in which the occupant ear is positioned to at least partially reduce a road noise sound level in the zone.

One example method includes joining, from a client device, a virtual meeting hosted by a virtual meeting provider, the virtual meeting comprising a plurality of participants, displaying the virtual meeting on the display of the client device, receiving a head tracking signal from an head tracking sensor, the head tracking signal associated with a first user of the client device, determining, based at least in part on the head tracking signal, a location and a position of the of user's head in relation to the display on which the first user is focused, and varying the volume of a first audio stream of a plurality of audio streams associated with the virtual meeting based at least in part on the position of the user's head.

The invention discloses a pedestrian cross-border head tracking method and system based on multi-modal dynamic feature fusion, belongs to the technical field of computer vision, and aims to solve the technical problem of how to improve the accuracy and efficiency of pedestrian detection and the stability of cross-border head tracking. By adopting an advanced backbone network, a self-adaptive anchor frame mechanism, cross-scale feature fusion and other technologies, the detection capability of small targets and high-shielding-rate pedestrian targets is improved; an intelligent caching strategy and a model fusion method are adopted, so that repeated calculation of instance segmentation is reduced, and the efficiency of dynamic pedestrian segmentation is improved; through combination of multiple feature extraction and enhancement technologies, including optimized Mama, Transform and multi-granularity feature fusion, the purity and discrimination of the features and the adaptability to shielding and view angle changes are enhanced.

A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.

A user interface for enabling and controlling functions of a surgical system, comprising: a foot-operated function switch configured to be switched to any one of multiple discrete states by the user's foot; a head tracker configured to track the user's head motions; and a processor coupled to the function switch and head tracker, and configured to: obtain an association between a plurality of sequences comprising at least one of the multiple discrete states, and a plurality of corresponding system functions of the surgical system, receive an indication of at least one of the discrete states from the function switch, identify a system function based on the indication and the association, receive a head motion from the head tracker, and apply the head motion to control the identified system function of the surgical system.

The invention relates to the technical field of smart park equipment, and discloses an interactive multifunctional park guide device which comprises an intelligent interactive screen, augmented reality glasses, an intelligent voice assistant, a mobile positioning and navigation module and an intelligent help system. The intelligent interaction screen comprises a touch screen, 3D projection and gesture recognition. The touch screen supports a user to inquire scenic spot information, the 3D projection is used for stereoscopically displaying images, and the gesture recognition module executes operation through gesture instructions. The augmented reality glasses have AR display and head tracking functions, render virtual images in real time and track head actions of a user. The intelligent voice assistant receives a user instruction through voice recognition and voice synthesis and gives reply or operation guidance. And the mobile positioning and navigation module positions the user position and displays the current position and surrounding scenic spot information. The interactive multifunctional park guide device provided by the invention not only improves the guide experience of the user, but also enables the management and service of the park to be more efficient and humanized through an intelligent means.

Techniques for separating binaural downmixing and head tracking processing between a source device and an output device are described. Embodiments include receiving, by a source device, an audio signal comprising a plurality of channels and selecting a first subset of the plurality of channels as head-tracked channels. Embodiments include performing, by the source device, binaural downmixing on a second subset of the plurality of channels that is different than the first subset of the plurality of channels to produce a downmixed second subset of the plurality of channels. Embodiments include transmitting, by the source device, the first subset of the plurality of channels and the downmixed second subset of the plurality of channels to an output device. Embodiments include performing, by the output device, binaural downmixing on the first subset of the plurality of channels based on positional data captured via one or more sensors associated with the output device.

Example technologies described herein relate to spatial audio on wearable playback devices, such as headphone and earbuds. Such technologies may include forms of binaural rendering of audio, which is played back on the wearable playback devices. These technologies may create or enhance an immersive listening experience which, to the listener, does not sound like you are listening on a wearable device, but are instead listening to a well-tuned, well-place, three-dimensional audio system of loudspeakers in a particular listening environment, such as the listener's actual living room.

The invention relates to the technical field of self-adaptive spatial audio rendering methods, in particular to a self-adaptive spatial audio rendering method based on head tracking, which comprises the following steps of: S1, acquiring the head orientation of a user based on head tracking equipment, and calculating a current binaural transfer function of the user; s2, based on a deep neural network, training a binaural transfer function for each user according to the user feature information, and generating a personalized binaural transfer function and an audio rendering parameter; s3, inputting spatial audio data, and rendering the spatial audio data into left and right sound channel audio signals; s4, performing audio time delay correction on the rendered left and right sound channel audio signals, and outputting the rendered sound effect; s5, the audio signals are input into the TWS earphone through the ear canal model, spatial audio rendering is completed, and by means of the deep learning model and the optimized signal processing algorithm, high-quality audio output is successfully guaranteed, and meanwhile the millisecond-level response speed is achieved.

1. The name of the design product: unmanned aerial vehicle head tracking (Scorpio). 2. The use of the design product: for unmanned aerial vehicle head tracking. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view 1.

A system and method for spatial tracking is disclosed. The method may include initializing a tracking of light sources. This initialization may involve determining modulation patterns that are mapped to light sources in a spatial arrangement over a time period, where each of the modulation patterns includes a sequence of planned states. The method may include directing an adjustment of a state of the light sources based on the modulation patterns, receiving images over the time period via optical sensors, identifying features based on the images, and correlating the features to the light sources based on the features and the modulation pattern over the time period. The pose may be determined based on at least the correlation, the feature positions, and the spatial arrangement of the light sources, where the pose includes a direction and a position in three-dimensional space.

The invention provides a target position positioning device and method. In the device, a display unit is configured to be in a transparent mode and is located right in front of the eyes of an operator; when the to-be-rescued target is located in the center of the display unit, the marking assembly marks and confirms the to-be-rescued target and sends a distance measurement instruction to the head tracker; a head tracker is worn on the head of the operator, and when the head tracker receives a distance measurement instruction, the direction of a to-be-rescued target is determined based on the rotation direction of the head of the operator, the distance between the to-be-rescued target and the head tracker is measured, and the direction and the distance are sent to a signal processing unit; the signal processing unit determines the position of the to-be-rescued target according to the orientation and the distance sent by the head tracker, and sends the position of the to-be-rescued target to the display unit; the display unit displays the position of the to-be-rescued target and the area where the to-be-rescued target is located, and positioning and indicating of the position of the to-be-rescued target can be achieved on ocean ships, rescue airplanes, lifeboats and the like.

The invention relates to a bar continuous rolling mill area blank information tracking method, and belongs to the technical field of metallurgical production control methods. According to the technical scheme, blank information is stored with rolling numbers as indexes, a rolling area is divided into tracking areas, and rolling number information of the head of a rolled piece is tracked and memorized; and the actual tracking area crossing time of the rolled piece is compared with a crossing time threshold value, and when the actual tracking area crossing time of the rolled piece is larger than or equal to the crossing time threshold value, an abnormal rolling condition is judged, and rolling number information of an abnormal rolling area is deleted. According to the method, automatic and accurate tracking of the key information of the blank in the area is realized by utilizing the characteristic that the running direction of the continuous rolling blank of the bar is single and adopting a rolled piece head tracking memory, abnormal state information deletion and affiliated information table look-up method which takes the blank information rolling plan number as an index, and the method has extremely high popularization and application value in the industry.

The invention discloses a method and device for processing a three-dimensional image, a computer readable storage medium and computing equipment. According to the method for processing the three-dimensional image, the three-dimensional image is a parallax image which is shot by a virtual camera and then displayed on a display device, and the method comprises the steps that under the condition that it is detected that the position of human eyes is updated through a head tracking device, coordinates of a virtual screen point on a virtual display screen in a camera space are obtained; the virtual display screen is a region of interest watched by a user; determining a near cutting plane based on the coordinates of the virtual screen point in the camera space; changing a near cutting plane into an inclined cutting plane; the inclined cutting plane is a plane which is used for cutting off pixel points outside the virtual display screen and is parallel to the virtual display screen; changing the projection matrix, and adjusting the virtual display screen to be parallel to the display screen of the display equipment by using the changed projection matrix to obtain a front view of the virtual display screen; and rendering the front view, and outputting a rendering result to a display device.

The invention discloses an image seeker tracking performance test method based on a simulated moving target, which comprises the following steps of: generating a simulated target and a moving track through a target simulation computer, projecting the simulated target and the moving track to a curtain, and tracking the simulated target on the curtain by an image seeker to realize the tracking speed precision and the maximum tracking speed test; then the size of the target under the tracking distance is obtained through calculation, the target simulation computer generates a simulation target and a motion trail and projects the simulation target and the motion trail to the curtain, the image seeker tracks the simulation target on the curtain through the reflective collimator, and tracking distance testing is achieved. A dynamic simulation target is provided for image seeker tracking, meanwhile, external field environment factors such as target definition, light intensity and target shielding are introduced, and the method has the advantages that the testing method is simple, the testing environment is easy to build, and online tracking debugging and synchronous testing are facilitated.

A system and method of projecting augmentation imagery in a head-mounted display are disclosed. The system includes an eye tracking system configured to generate eye tracking data at an eye-tracking rate in response to a position of a pupil of a user, a head tracking system configured to estimate a change in orientation of the user's head at a head tracking rate and generate jitter data at a jitter sensing rate, a controller configured generate a field mapping in response to render data at a projector update rate, a light generator configured to generate a color encoded light associated with the augmentation imagery, the light generator includes a 2D pixelated display and an optical system configured to image the color encoded light into a field of view of the user, wherein the optical system includes a foveated optical system.

A head tracking system HTS (100, 200) and associated method and head worn assembly, configured to determine a head position and / or a head orientation of a user, the HTS comprising: one or more optical sensors (112) producing optical measurements; and one or more inertial sensors (104) producing inertial measurements; a processor configured, when the optical sensors fail to provide optical measurements to determine the head location and the head orientation of a user, to operate in a coasting mode using the inertial measurements from the one or more inertial sensors to determine the head location and the head orientation of a user, the processor configured to further: determine a figure of merit FOM (346) for coasting errors based on a combination of one or more of errors in an estimated inertial sensor bias, a random drift and noise of the inertial sensor and the inertial sensor gain and alignment errors; compare (348) the FOM with a threshold to determine whether the inertial measurements provide a valid or invalid head location and / or head orientation; and determine a subsequent operation from a plurality of possible subsequent operations of the HTS based on whether the head location and / or head orientation is valid or invalid.

An apparatus and method for providing spatialized audio implemented with dynamic head tracking, the apparatus and method comprising: in a static phase, providing a spatialized acoustic signal to a user, the spatialized acoustic signal being perceived as originating from a virtual sound field at a first location; and upon determining that one or more predetermined conditions are satisfied, rotating the virtual sound field to track movement of the user's head, the one or more predetermined conditions may include whether the user's head has exceeded an angular limit.

A method of rendering a stereoscopic image of an object is described. The stereoscopic image comprises a left image and a right image. The method comprises initialising a computer model of the object (200) and a texture mapping for rendering the computer model with a texture. The method comprises the steps of receiving a first image of the object from a first image sensor (14a), receiving a second image of the object from a second image sensor (14b), receiving head tracking data of the observer (360), determining one or more render camera viewpoints relative to the computer model based on the head tracking data, and rendering the stereoscopic image based on the computer model and the texture mapping using the one or more render camera viewpoints, wherein the left image of the stereoscopic image is rendered using the first image as the texture and the right image of the stereoscopic image is rendered using the second image as the texture.

The application relates to a rolling piece head tracking method for a hot rolling and coiling production line, the hot rolling and coiling production line comprising a rolling channel for conveying a rolling piece, pinch rolls matched with the rolling channel, and detection elements arranged directly above the rolling channel, and the method comprises the following steps: acquiring a head signal of the rolling piece, starting tracking and recording first tracking data S1; acquiring a signal that the rolling piece reaches the pinch rolls, stopping tracking; acquiring a horizontal installation interval L between the detection elements and the pinch rolls, and correcting the first tracking data S1 to S1=L; the method does not need to additionally increase the detection elements, reduces the cost of rolling piece head tracking, can reduce error correction caused by error signals of the increased detection elements, and guarantees the accuracy and reliability of rolling piece head position tracking; the correction means is not referenced by light signals, and can effectively avoid the influence of interference sources such as water vapor, fog, light pollution and the like in the field environment.