105 results about "Head tracking" patented technology

The invention discloses a cradle head tracking method, system and device, a storage medium and a program product, and relates to the technical field of cradle heads, and the method comprises the steps: obtaining the target position information of a tracking target in continuous multi-frame image frames collected by an image sensor, and the size of a detection frame, determining a pan-tilt rotation angle of a target pan-tilt carrying an image sensor when multiple image frames are acquired; determining a target position offset between the target position and the center of the image based on the target position information, and mapping the size of the detection frame into a target distance between the tracking target and the image sensor; inputting the target position offset and the holder rotation angle corresponding to the multiple image frames into a motion estimation model to obtain a predicted position; and determining a pan-tilt angle value of the target pan-tilt based on the predicted position and the target distance, and driving the target pan-tilt to rotate based on the pan-tilt angle value. According to the invention, the cradle head keeps stable tracking while quickly responding to target movement, so that the stability and reliability of cradle head tracking control are improved.

A head-mounted display system includes a left display assembly configured to provide left-side display light. A first left inertial measurement unit (IMU) is configured to measure an orientation of the left display assembly. A right display assembly is configured to provide right-side display light. A first right IMU is configured to measure an orientation of the right display assembly. A communication interface is configured to receive a left-side orientation of a head-tracking system as measured by a second left IMU, and a right-side orientation of a head-tracking system as measured by a second right IMU. A logic machine is configured to assess an alignment of the head-mounted display system based at least in part on the orientation of the left display assembly, the orientation of the right display assembly, the left-side orientation of the head-tracking system, and the right-side orientation of the head-tracking system.

The present disclosure relates to head tracking for parameterized binaural output systems and methods. A method for encoding channel-based or object-based input audio for playback comprises the following steps: (a) first rendering the channel-based or object-based input audio into an initial output representation; (b) determining an estimate of a dominant audio component from the channel-based or object-based input audio and determining a series of dominant audio component weighting factors for mapping the initial output representation to the dominant audio component; (c) determining an estimate of the direction or position of the dominant audio component; and (d) encoding the initial output representation, the dominant audio component weighting factors, and the dominant audio component direction or position into an encoded signal for playback.

In some embodiments, a method comprises executing, by a head-tracked audio system, a first algorithm configured to dynamically update a forward head angle and a spatial orientation in response to a detected head movement, and a second algorithm configured to adjust a recentering filter based on the detected head movements, and maintaining, by the head-tracked audio system through execution of the first algorithm and the second algorithm, a spatial audio placement relative to a wearer during the detected head movements.

Described herein are methods and systems for a vehicle system which provide inbuilt road noise cancellation in the vehicle. In one or more embodiments, a method for road noise cancellation comprises using a head-tracking device to monitor an occupant ear position, capturing airborne noise using a feedforward microphone and a headrest microphone of a zone in which the occupant ear is positioned, updating acoustic path information according to the occupant ear position(s) and speaker position(s) within the zone, generating a noise cancellation signal using sampling rate greater than 2 kHz, and outputting the noise cancellation signal via a headrest speaker located near the zone in which the occupant ear is positioned to at least partially reduce a road noise sound level in the zone.

One example method includes joining, from a client device, a virtual meeting hosted by a virtual meeting provider, the virtual meeting comprising a plurality of participants, displaying the virtual meeting on the display of the client device, receiving a head tracking signal from an head tracking sensor, the head tracking signal associated with a first user of the client device, determining, based at least in part on the head tracking signal, a location and a position of the of user's head in relation to the display on which the first user is focused, and varying the volume of a first audio stream of a plurality of audio streams associated with the virtual meeting based at least in part on the position of the user's head.

The invention discloses a pedestrian cross-border head tracking method and system based on multi-modal dynamic feature fusion, belongs to the technical field of computer vision, and aims to solve the technical problem of how to improve the accuracy and efficiency of pedestrian detection and the stability of cross-border head tracking. By adopting an advanced backbone network, a self-adaptive anchor frame mechanism, cross-scale feature fusion and other technologies, the detection capability of small targets and high-shielding-rate pedestrian targets is improved; an intelligent caching strategy and a model fusion method are adopted, so that repeated calculation of instance segmentation is reduced, and the efficiency of dynamic pedestrian segmentation is improved; through combination of multiple feature extraction and enhancement technologies, including optimized Mama, Transform and multi-granularity feature fusion, the purity and discrimination of the features and the adaptability to shielding and view angle changes are enhanced.

A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.

A user interface for enabling and controlling functions of a surgical system, comprising: a foot-operated function switch configured to be switched to any one of multiple discrete states by the user's foot; a head tracker configured to track the user's head motions; and a processor coupled to the function switch and head tracker, and configured to: obtain an association between a plurality of sequences comprising at least one of the multiple discrete states, and a plurality of corresponding system functions of the surgical system, receive an indication of at least one of the discrete states from the function switch, identify a system function based on the indication and the association, receive a head motion from the head tracker, and apply the head motion to control the identified system function of the surgical system.

Techniques for separating binaural downmixing and head tracking processing between a source device and an output device are described. Embodiments include receiving, by a source device, an audio signal comprising a plurality of channels and selecting a first subset of the plurality of channels as head-tracked channels. Embodiments include performing, by the source device, binaural downmixing on a second subset of the plurality of channels that is different than the first subset of the plurality of channels to produce a downmixed second subset of the plurality of channels. Embodiments include transmitting, by the source device, the first subset of the plurality of channels and the downmixed second subset of the plurality of channels to an output device. Embodiments include performing, by the output device, binaural downmixing on the first subset of the plurality of channels based on positional data captured via one or more sensors associated with the output device.

Example technologies described herein relate to spatial audio on wearable playback devices, such as headphone and earbuds. Such technologies may include forms of binaural rendering of audio, which is played back on the wearable playback devices. These technologies may create or enhance an immersive listening experience which, to the listener, does not sound like you are listening on a wearable device, but are instead listening to a well-tuned, well-place, three-dimensional audio system of loudspeakers in a particular listening environment, such as the listener's actual living room.

The invention relates to the technical field of self-adaptive spatial audio rendering methods, in particular to a self-adaptive spatial audio rendering method based on head tracking, which comprises the following steps of: S1, acquiring the head orientation of a user based on head tracking equipment, and calculating a current binaural transfer function of the user; s2, based on a deep neural network, training a binaural transfer function for each user according to the user feature information, and generating a personalized binaural transfer function and an audio rendering parameter; s3, inputting spatial audio data, and rendering the spatial audio data into left and right sound channel audio signals; s4, performing audio time delay correction on the rendered left and right sound channel audio signals, and outputting the rendered sound effect; s5, the audio signals are input into the TWS earphone through the ear canal model, spatial audio rendering is completed, and by means of the deep learning model and the optimized signal processing algorithm, high-quality audio output is successfully guaranteed, and meanwhile the millisecond-level response speed is achieved.

A system and method for spatial tracking is disclosed. The method may include initializing a tracking of light sources. This initialization may involve determining modulation patterns that are mapped to light sources in a spatial arrangement over a time period, where each of the modulation patterns includes a sequence of planned states. The method may include directing an adjustment of a state of the light sources based on the modulation patterns, receiving images over the time period via optical sensors, identifying features based on the images, and correlating the features to the light sources based on the features and the modulation pattern over the time period. The pose may be determined based on at least the correlation, the feature positions, and the spatial arrangement of the light sources, where the pose includes a direction and a position in three-dimensional space.

The invention provides a target position positioning device and method. In the device, a display unit is configured to be in a transparent mode and is located right in front of the eyes of an operator; when the to-be-rescued target is located in the center of the display unit, the marking assembly marks and confirms the to-be-rescued target and sends a distance measurement instruction to the head tracker; a head tracker is worn on the head of the operator, and when the head tracker receives a distance measurement instruction, the direction of a to-be-rescued target is determined based on the rotation direction of the head of the operator, the distance between the to-be-rescued target and the head tracker is measured, and the direction and the distance are sent to a signal processing unit; the signal processing unit determines the position of the to-be-rescued target according to the orientation and the distance sent by the head tracker, and sends the position of the to-be-rescued target to the display unit; the display unit displays the position of the to-be-rescued target and the area where the to-be-rescued target is located, and positioning and indicating of the position of the to-be-rescued target can be achieved on ocean ships, rescue airplanes, lifeboats and the like.

The invention relates to a bar continuous rolling mill area blank information tracking method, and belongs to the technical field of metallurgical production control methods. According to the technical scheme, blank information is stored with rolling numbers as indexes, a rolling area is divided into tracking areas, and rolling number information of the head of a rolled piece is tracked and memorized; and the actual tracking area crossing time of the rolled piece is compared with a crossing time threshold value, and when the actual tracking area crossing time of the rolled piece is larger than or equal to the crossing time threshold value, an abnormal rolling condition is judged, and rolling number information of an abnormal rolling area is deleted. According to the method, automatic and accurate tracking of the key information of the blank in the area is realized by utilizing the characteristic that the running direction of the continuous rolling blank of the bar is single and adopting a rolled piece head tracking memory, abnormal state information deletion and affiliated information table look-up method which takes the blank information rolling plan number as an index, and the method has extremely high popularization and application value in the industry.

The invention discloses a method and device for processing a three-dimensional image, a computer readable storage medium and computing equipment. According to the method for processing the three-dimensional image, the three-dimensional image is a parallax image which is shot by a virtual camera and then displayed on a display device, and the method comprises the steps that under the condition that it is detected that the position of human eyes is updated through a head tracking device, coordinates of a virtual screen point on a virtual display screen in a camera space are obtained; the virtual display screen is a region of interest watched by a user; determining a near cutting plane based on the coordinates of the virtual screen point in the camera space; changing a near cutting plane into an inclined cutting plane; the inclined cutting plane is a plane which is used for cutting off pixel points outside the virtual display screen and is parallel to the virtual display screen; changing the projection matrix, and adjusting the virtual display screen to be parallel to the display screen of the display equipment by using the changed projection matrix to obtain a front view of the virtual display screen; and rendering the front view, and outputting a rendering result to a display device.

The invention discloses an image seeker tracking performance test method based on a simulated moving target, which comprises the following steps of: generating a simulated target and a moving track through a target simulation computer, projecting the simulated target and the moving track to a curtain, and tracking the simulated target on the curtain by an image seeker to realize the tracking speed precision and the maximum tracking speed test; then the size of the target under the tracking distance is obtained through calculation, the target simulation computer generates a simulation target and a motion trail and projects the simulation target and the motion trail to the curtain, the image seeker tracks the simulation target on the curtain through the reflective collimator, and tracking distance testing is achieved. A dynamic simulation target is provided for image seeker tracking, meanwhile, external field environment factors such as target definition, light intensity and target shielding are introduced, and the method has the advantages that the testing method is simple, the testing environment is easy to build, and online tracking debugging and synchronous testing are facilitated.

A system and method of projecting augmentation imagery in a head-mounted display are disclosed. The system includes an eye tracking system configured to generate eye tracking data at an eye-tracking rate in response to a position of a pupil of a user, a head tracking system configured to estimate a change in orientation of the user's head at a head tracking rate and generate jitter data at a jitter sensing rate, a controller configured generate a field mapping in response to render data at a projector update rate, a light generator configured to generate a color encoded light associated with the augmentation imagery, the light generator includes a 2D pixelated display and an optical system configured to image the color encoded light into a field of view of the user, wherein the optical system includes a foveated optical system.

An apparatus and method for providing spatialized audio implemented with dynamic head tracking, the apparatus and method comprising: in a static phase, providing a spatialized acoustic signal to a user, the spatialized acoustic signal being perceived as originating from a virtual sound field at a first location; and upon determining that one or more predetermined conditions are satisfied, rotating the virtual sound field to track movement of the user's head, the one or more predetermined conditions may include whether the user's head has exceeded an angular limit.

A method of rendering a stereoscopic image of an object is described. The stereoscopic image comprises a left image and a right image. The method comprises initialising a computer model of the object (200) and a texture mapping for rendering the computer model with a texture. The method comprises the steps of receiving a first image of the object from a first image sensor (14a), receiving a second image of the object from a second image sensor (14b), receiving head tracking data of the observer (360), determining one or more render camera viewpoints relative to the computer model based on the head tracking data, and rendering the stereoscopic image based on the computer model and the texture mapping using the one or more render camera viewpoints, wherein the left image of the stereoscopic image is rendered using the first image as the texture and the right image of the stereoscopic image is rendered using the second image as the texture.

The application relates to a rolling piece head tracking method for a hot rolling and coiling production line, the hot rolling and coiling production line comprising a rolling channel for conveying a rolling piece, pinch rolls matched with the rolling channel, and detection elements arranged directly above the rolling channel, and the method comprises the following steps: acquiring a head signal of the rolling piece, starting tracking and recording first tracking data S1; acquiring a signal that the rolling piece reaches the pinch rolls, stopping tracking; acquiring a horizontal installation interval L between the detection elements and the pinch rolls, and correcting the first tracking data S1 to S1=L; the method does not need to additionally increase the detection elements, reduces the cost of rolling piece head tracking, can reduce error correction caused by error signals of the increased detection elements, and guarantees the accuracy and reliability of rolling piece head position tracking; the correction means is not referenced by light signals, and can effectively avoid the influence of interference sources such as water vapor, fog, light pollution and the like in the field environment.

A control device for spatial sound effect of a headphone and a control method thereof are provided. The control device includes a receiving unit, a head tracking unit, at least three equalizers, a switch and a controller. The at least three equalizers are configured to process an original sound signal according to a head direction to obtain at least a first adjusted sound signal, a second adjusted sound signal, and a third adjusted sound signal. The switch is configured to output the first adjusted sound signal according to the head direction. If the head direction has changed to a first expected rotation direction, the controller controls the switch to output the second adjusted sound signal; and if the head direction has changed to a second expected rotation direction, the controller controls the switch to output the third adjusted sound signal.

A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.

One example method includes joining, from a client device, a virtual meeting hosted by a virtual meeting provider, the virtual meeting comprising a plurality of participants, displaying the virtual meeting on the display of the client device, receiving a plurality of head tracking signals from a head tracking sensor, the head tracking signals associated with a first user of the client device; determining, based at least in part on the head tracking signals, a movement of the of first user's head in relation to the display on which the first user is focused; and varying the volume of a first audio stream of a plurality of audio streams associated with the virtual meeting based at least in part on the movement of the first user's head.

A device and a system includes a head-up display intended to be used to display projected images on surface such as an interior surface of a vehicle windshield. The device and system more particularly relates to a holographic head-up display device, a light module comprising a light source, together with a spatial light modulator displaying a computer-generated hologram once unmodulated beams are filtered using an optical filter. Said HUD device further comprises a head-tracking system for measurement of and adjustment according to interpupillary distance, a processor circuitry for said adjustment and processing pertaining thereto to be undertaken, as well as an optical steering apparatus.

An audio processing method includes: performing spatial analysis on binaural signals to estimate the level difference and phase difference of binaural filters characterizing the binaural signals; and performing object extraction on the binaural audio signals using the estimated level difference and phase difference to generate left / right principal component signals and left / right residual component signals. The system can perform different processing on the left / right principal components and left / right residual components using different object processing parameters, such as repositioning, equalization, compression, upmixing, channel remapping, or storage, to generate processed binaural signals, thereby providing an improved listening experience. Repositioning can be based on head-tracking sensor data.

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for head tracking for video communications in a virtual environment. The system may provide a video conference session in a virtual environment. The system may provide a digital representation of the video conference participant in the virtual environment. The system may display one or more views of the virtual environment in the video conference. The system may track movement of the video conference participant to generate user movement information and may display movement of the video conference participant on the digital representation.

A head tracking system HTS, configured to determine a head position and a head orientation of a user to which display images are configured to align with the outside world scene and are configured to be presented, the HTS comprising: one or more optical sensors generating an optical measurement; and a number of inertial sensors generating an inertial measurement; a processor configured to determine the head position and the head orientation from one or both of the one or more optical sensors and the number of inertial sensors and configured to: determine an optical tracking state from the optical measurement and an inertial tracking state from the inertial measurement; when both the optical tracking state and the inertial tracking state are valid, flagging / asserting HTS operation as normal; when both the optical tracking state and the inertial tracking state are invalid, flagging / asserting HTS failure; when the optical tracking state and the inertial tracking state are valid comparing the optical measurement and the inertial measurement to determine if the HTS can operate safely based on a predetermined tracking performance required by the system.

Described herein are methods and systems for a vehicle system which provide inbuilt road noise cancellation in the vehicle. In one or more embodiments, a method for road noise cancellation comprises using a head-tracking device to monitor an occupant ear position, capturing airborne noise using a feedforward microphone and a headrest microphone of a zone in which the occupant ear is positioned, updating acoustic path information according to the occupant ear position(s) and speaker position(s) within the zone, generating a noise cancellation signal using sampling rate greater than 2kHz, and outputting the noise cancellation signal via a headrest speaker located near the zone in which the occupant ear is positioned to at least partially reduce a road noise sound level in the zone.

Example technologies described herein relate to spatial audio on wearable playback devices, such as headphone and earbuds. Such technologies may include forms of binaural rendering of audio, which is played back on the wearable playback devices. These technologies may create or enhance an immersive listening experience which, to the listener, does not sound like you are listening on a wearable device, but are instead listening to a well-tuned, well-place, three-dimensional audio system of loudspeakers in a particular listening environment, such as the listener's actual living room.