83 results about "Head-related transfer function" patented technology

A system and method of targeting spatialized audio to ears of a listener, comprising sensing characteristics of an environment comprising at least one human by receiving radio frequency signals with a radio receiver; using the sensed characteristics in at least one automated processor to analyze at least one human dynamic physiological pattern of each human and estimate a body pose and head position within the environment of each human based on the sensed characteristics and the at least one human dynamic physiological pattern; and using an estimated position of the ears of each human in conjunction with a head-related transfer function in a spatial audio system to generate spatialized audio.

A head-related transfer function is calculated using features of the person, detected via cameras. The features are detected temporally at least partially in succession by several cameras. At least one of the cameras is arranged so that it detects the person when approaching and opening the vehicle in the area external to the vehicle.

A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.

A device may include a plurality of microphones, and a processor configured to extract a sound and a sound field from microphone signals of the plurality of microphones. The sound may be treated as near-field sound and the sound field may be treated as far-field sound. The device may adjust a strength of the sound based on a strength of the sound field and apply near-field head related transfer functions (HRTFs) to the sound. The device may apply far-field HRTFs to the sound field. The device may combine the near-field applied sound with the far-field applied sound field to generate spatial audio for playback through a plurality of speakers.

The present technology relates to an information processing method, an information processing system, and a program that make it possible to easily perform personal optimization of sound reproduction parameters relating to sound reproduction. A determination unit determines a recommendation parameter that is a sound reproduction parameter to be recommended to a user on the basis of the user's evaluation responses to a plurality of test sounds obtained by respectively applying a plurality of sound reproduction parameters related to sound reproduction to a predetermined sound source. The present technology can be applied to a case of, for example, performing personal optimization of sound reproduction parameters relating to sound reproduction such as a head-related transfer function (HRTF).

A system for synchronizing and spatializing media, comprising client device and server device. A method for operation includes: tracking the real-time spatial coordinates of both devices via wireless sensors; synchronizing media playback using a timestamp-based protocol that compensates for network latency and clock offset; and applying directional audio filters, such as Head-Related Transfer Functions (HRTF), on the client device to render audio appearing to originate from server device's physical location. The method is further characterized by compensating for acoustic propagation and signal processing delays to ensure accurate spatiotemporal alignment. The system may be enhanced by a multimodal Al configured to perform operations such as real-time voice-preserving translation and the generation of synchronized, spatialized haptic feedback based on semantic event markers.

This invention is entitled "Arrangement for Generating a Head-Related Transfer Function Filter". The invention discloses an arrangement for acquiring images used to generate a head-related transfer function filter. In this arrangement, the camera of a mobile phone or similar portable device is adjusted to take an image. All acquired images are analyzed, and only suitable images are further sent for generating the head-related transfer function filter. The arrangement is further configured to provide instructions to the user to adequately cover the entire head and other relevant body parts.

Embodiments of the invention relate to a method and device for adaptive Head Related Transfer Function (HRTF) individualization for binaural rendering through headphones, earphones or crosstalk-cancelled speakers. The Adaptive HRTF individualizer (AHI) can simplify the complicated problem of custom tailoring an HRTF to a user via a GUI (graphical user interface), and can incorporate a single controller (e.g. a slider) that controls the selection of filters that allow the listener to virtualize sound sources at desired locations through any binaural rendering system. The slider allows cycling through processed HRTFs that are a composite of deconstructed measured filters with reconstructed cues such as interaural time difference (ITD) and interaural level difference (ILD). The deconstructed filters are analyzed and pre-processed enabling a smooth interpolation of the filters in the time domain prior to the addition or reconstruction of cues into the filter itself. Expanding this procedure for a single location into multiple locations enables a customized and accurate listening experience for multichannel content virtualized through any binaural rendering system. This can be done for a multitude of speaker locations to customize and render any surround sound content.

Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a source location corresponding to the audio signal is identified. For each of the respective left and right ear of the user, a virtual speaker position, of a virtual speaker array, is determined, the virtual speaker position collinear with the source location and with a position of the respective ear. For each of the respective left and right ear of the user, a head-related transfer function (HRTF) corresponding to the virtual speaker position and to the respective ear is determined; and the output audio signal is presented to the respective ear of the user via one or more speakers associated with the wearable head device. Processing the audio signal includes applying the HRTF to the audio signal.

According to the present invention, an acoustic signal is emitted from a sound emission unit that does not seal the external auditory canal of a user, and an observation signal based on the acoustic signal is collected by a sound collection unit disposed at the position of a head that is neither the external auditory canal nor an open end of the external auditory canal. The observation signal is used for setting a head-related transfer function of the user.

To provide an "audio signal processor" for down-mixing a surround audio signal so as to obtain an excellent sound image feeling.SOLUTION: This device is provided with a pseudo surround audio signal generating part 1 for generating a surround audio signal SigA of 7.1. 2ch from an inputted audio stereo signal SigIN of 4ch, a signal processing part 2 for processing the surround audio signal SigA and outputting it as a signal SigB for down mix, and a down mix part 3 for synthesizing the signal SigB for down mix and outputting a stereo audio signal SigOUT of 2ch. The signal processing unit 2 combines the input audio signal of each channel of the SigA with the audio signal obtained by convolving the head-related transfer function from the speaker corresponding to the audio signal to the listener at a ratio corresponding to the position of the speaker, and outputs the combined signal as the audio signal of the SigB.SELECTED DRAWING: Figure 1

An audio personalisation method for a first user includes: testing a first user on a calibration test, the calibration test comprising requiring a user to match a test sound to a test location, either by controlling the position of the presented sound or controlling the position of the presented location, for a sequence of test matches, each test sound being presented at a position using a default head related transfer function ‘HRTF’, receiving an estimate of each matching location from the first user, and calculating a respective error for each estimate, to generate a sequence of location estimate errors for the first user; and comparing at least some of the location estimate errors for the first user with estimate errors of the same locations previously generated for at least a subset of a corpus of reference individuals; identifying a reference individual with the closest match of compared location estimation errors to those of the first user; and using an HRTF, previously obtained for the identified reference individual, for the first user.

Systems, methods, and computer program products are described for direction of arrival (DOA)-based head tracking split rendering and head related transfer function (HRTF) personalization. Head tracking audio rendering is performed separately by two devices. A first device receives a primary bitstream representation of encoded audio. The second device tracks head pose information. The first device decodes the primary bitstream using a primary decoder and encodes the decoded bitstream into a pre-rendered binaural signal and post-rendered metadata. The second device decodes the pre-rendered binaural signal and the post-rendered metadata from the intermediate bitstream, and provides the decoded pre-rendered binaural signal and post-rendered metadata to a lightweight renderer. A lightweight renderer renders the pre-rendered binaural signal into binaural audio based on the post-rendered metadata, the head pose information, the generic HRTF, and the personalized HRTF.

There is provided a method for generating a personalized Head Related Transfer Function (HRTF). The method can include capturing an image of an ear using a portable device, auto-scaling the captured image to determine physical geometries of the ear and obtaining a personalized HRTF based on the determined physical geometries of the ear.

A head related transfer function (HRTF) generation method and apparatus, relating to the technical field of audio processing. The method comprises: an electronic device outputting first prompt information, the first prompt information being used for instructing a target individual wearing a head-mounted device to perform a first operation, and the first operation causing relative movement between the electronic device and the head-mounted device; playing test audio signals during the first operation, and receiving feedback audio signals and position information from the head-mounted device, wherein the feedback audio signals are test audio signals received by the head-mounted device at a plurality of different spatial positions, the spatial positions are the spatial positions of the electronic device relative to the head-mounted device, and the position information is used for determining the spatial positions; and on the basis of the test audio signals, the feedback audio signals and the position information, determining an HRTF corresponding to the target individual.

Generating a personalised Head-Related Transfer Function (HRTF) for a user, the system comprising: a sound source at a first position; a user device comprising: a left microphone arranged to be at a l

An audio signal processor includes a harmonic signal generator to generate a harmonic signal that includes a signal generated by frequency scaling components of a target audio signal by a factor of k, a left audio signal generator to generate a left audio signal by convolving a head-related transfer function from a target localization position of the target audio signal to a left ear of a listener with the target audio signal, a right audio signal generator to generate a right audio signal by convolving a head-related transfer function from the target localization position to a right ear of the listener with the target audio signal, a left synthesizer to generate a left channel audio signal by synthesizing the left audio signal and the harmonic signal, and a right synthesizer to generate a right channel audio signal by synthesizing the right audio signal and the harmonic signal.

An audio personalisation method for generating a personalised Head-Related Transfer Function, HRTF, the method comprising the steps of: obtaining a base HRTF model comprising a first set of parameters; outputting a sound from a virtual sound source according to the base HRTF model, the virtual sound source having an intended virtual position; receiving at least one user indication corresponding to a user virtual position of the virtual sound source, wherein the intended virtual position is different to the user virtual position; updating the first set of parameters to a second set of parameters based on the at least one indication from the user so as to update the user virtual location; and generating a personalised HRTF model comprising the second set of parameters, wherein the difference between the intended virtual position and the user virtual position according to the personalised HRTF model is less than the difference between the intended virtual position and the user virtual position according to the base HRTF model.

A computer-implemented method of synthesising an HRTF is disclosed. The method comprising: providing the HRTF of a subject measured at a particular measurement angle; processing the HRTF to remove localisation perception features of the HRTF, where the processing comprises: removing spectral notches from the measured HRTF, the resulting processed HRTF referred to as the HRTF'; and calculating a subject's HRTF timbre by subtracting a baseline HRTF at the measurement angle from the subject's HRTF', the baseline HRTF comprising a generalised response component such that the HRTF timbre comprises subject-specific variations in the HRTF. The method further comprises using the HRTF timbre to synthesise an HRTF. The method allows for generating a personalised timbre component of an HRTF to provide better personalisation of an HRTF, thereby providing improved binaural audio.

A head-related transfer function (HRTF) generation system includes one or more processors configured to retrieve first image data of a first ear of a subject, compare the first image data with second image data of a plurality of second ears to identify a particular second ear of the plurality of second ears matching the first ear, identify a template HRTF associated with the particular second ear, and assign an HRTF to the subject based on the template HRTF.

An audio customization system operates to enhance a user's audio environment. A user may wear headphones and specify what portion the ambient audio and / or source audio will be transmitted to the headphones or the personal speaker system. The audio signal may be enhanced by application of a spatialized transformation using a spatialization engine such as head-related transfer functions so that at least a portion of the audio presented to the personal speaker system will appear to originate from a particular direction. The direction may be modified in response to movement of the personal speaker system.

An audio system and method of using the audio system to augment spatial audio rendition is described. The audio system can include a device to receive user inputs designating positions on an augmented reality view of a listening environment. Sound source icons can be presented in the augmented reality view at the designated positions. The sound source icons can visually represent sound sources at locations in the listening environment that correspond to, but are different than, the positions. One or more processors of the audio system can apply head-related transfer functions, which correspond to the locations in the listening environment, to audio input signals to generate binaural audio signals. The audio system can include a headset that uses the binaural audio signals to render spatialized audio localizing sounds to the locations in the listening environment. Other aspects are also described and claimed.

Images of a user's head are acquired at a plurality of different orientational angles through image sensors operating in conjunction with a media consumption system. The acquired images of the user's head are used to select or predict a specific personalized head related transfer function for the user. Spatial audio rendered by audio speakers operating in conjunction with the media consumption system is adjusted or modified based at least in part on the specific personalized HRTF selected for the user.

An audio signal processing device for downmixing surround audio signals so as to obtain a good sound image includes a pseudo surround audio signal generator for generating surround audio signals SigA of 7.1.4 channels from input 2-channel stereo audio signals SigIN, a signal processor for signal-processing the surround audio signals SigA and outputting results as downmixing signals SigB, and a downmixer for synthesizing the downmixing signals SigB and outputting 2-channel stereo audio signals SigOUT. For an input audio signal SigA of each channel, the signal processor synthesizes the audio signal and an audio signal obtained by convolving a head-related transfer function from a loudspeaker corresponding to the audio signal to a listener into the audio signal, at a ratio matching the position of the loudspeaker, and outputs the result as an audio signal SigB.

To locate sound sources in space so called Head Related Transfer Functions (HRTF) are commonly applied. Typically, Head Related Frequency Responses (HRFRs) for hundreds of individuals are averaged to produce average HRFR for each location. The averaged HRFR data is then used for location coding of audio sources in recordings and playback. The presented invention solves the location coding by breaking down the localization process in a novel manner introducing a new time domain focused approach. The approach is called Multiple Order HRTF according to the present invention. The approach allows averaging across individuals and with its time domain coding provides more stable localization of sound sources that is clearly positioned outside of the listener's head through headphones. It is also possible to create virtual surround sound sources around a listening room using only two stereo speakers by embedding coded position information into the direct sound from the stereo speaker pair.

An information processing device (101) uses an information processing method which is executed by a computer, the method including: a step (S101) for acquiring sound information that includes an acoustic signal and information as to the position of a sound source object in a three-dimensional sound field; a step (S107) for generating a first sound signal by using the acoustic signal and a head transfer function corresponding to an arrival direction based on the position of the sound source object and the position of a user in the three-dimensional sound field; a step (S106) for generating a second sound signal by using the acoustic signal and a head transfer function corresponding to a representative direction based on the position of a representative point set in the three-dimensional sound field and the position of the user; and a step (S109) for synthesizing the generated first sound signal and second sound signal to generate an output sound signal.

A system for synchronizing and spatializing media, comprising client device and server device. A method for operation includes: tracking the real-time spatial coordinates of both devices via wireless sensors; synchronizing media playback using a timestamp-based protocol that compensates for network latency and clock offset; and applying directional audio filters, such as Head-Related Transfer Functions (HRTF), on the client device to render audio appearing to originate from server device's physical location. The method is further characterized by compensating for acoustic propagation and signal processing delays to ensure accurate spatiotemporal alignment. The system may be enhanced by a multimodal Al configured to perform operations such as real-time voice-preserving translation and the generation of synchronized, spatialized haptic feedback based on semantic event markers.

In an audio device that includes a plurality of input controls, mixing circuitry, a left speaker, and a right speaker, a desired balance, between a first audio signal and a second audio signal, may be determined according to the plurality of input controls. A desired volume, of the first audio signal and the second audio signal, may be determined according to the plurality of input controls. A virtualization, of one or both of the first audio signal and the second audio signal, may be determined according to a head related transfer function. A stereo signal may be generated by combining the first audio signal and the second audio signal according to the desired balance, the desired volume, and the virtualization. A left channel of the stereo signal may be outputted to the left speaker and a right channel of the stereo signal may be outputted to the right speaker.

Systems and techniques are provided for processing audio data. For example, a process can include determining a set of near-field Head-Related Transfer Functions (HRTFs) corresponding to a user, based on a plurality of audio measurements each obtained using a respective measurement position at a near-field measurement distance. A set of far-field HRTFs corresponding to the user can be generated based on the set of near-field HRTFs. The set of far-field HRTFs can be compared to one or more candidate far-field HRTFs obtained based on anthropometric features corresponding to the user. An individualized HRTF can be determined for the user as a candidate far-field HRTF of the one or more candidate far-field HRTFs having minimum spectral differences from the set of far-field HRTFs at corresponding measurement positions.

An audio personalisation method for simulating perception of a vertical displacement of a sound source, the method comprising the steps of: obtaining an input head related transfer function, HRTF, associated with a user; determining an intended vertical displacement for the sound source; selecting at least one frequency region in the input HRTF; and adjusting the amplitude of the selected frequency region(s) to simulate the intended vertical displacement for the sound source. This provides improvements to the generation and / or manipulation of HRTFs to allow adjustment of the perceived location of a sound source.