Apparatus and method for binaural pose correction

Description

APPARATUS AND METHOD FOR BINAURAL POSE CORRECTION Description

[001] The present invention relates to binaural pose correction and, in particular, to an apparatus and a method for binaural pose correction.

[002] In Augmented Reality (AR) and Virtual Reality (VR), one of the main objectives is to provide a sensation that resembles reality or a plausible alternative to reality, which is often not possible due to unrealistic sensations, such as mediocre media quality and media that is not accurate when a user moves, but the media corresponds to an outdated pose.

[003] To avoid delays between obtaining pose data and performing a pose update, low-complexity and low-latency solutions have been provided, which can be used directly in a lightweight device to perform a pose update and compensate for any deviation in head pose. Solutions from the previous technique utilize frequency domain processing, for example, the Dynamic Binaural Signal Adaptation method of Nagel and Jax, [1]: Nagel, S., & Jax, P. Dynamic binaural cue adaptation, in 2018, 16th International Workshop on Acoustic Signal Enhancement (IWAENC), pp. 96-100, IEEE, September 2018) or the CLDFB domain covariance approach, contributed by Dolby to the IVAS Codec Public Collaboration, [2]: https: / / forge.3gpp.org / rep / ivas-codec-pc / ivas-codec / / wikis / Contributions / 21-Split-Rendering).

[004] Bilinear interpolation on a set of impulse responses to obtain an interpolated response for a missing position is described, for example, in [3], Freeland, FP, Biscainho, LW, & Diniz, PS (2004, September). Interpolation of head-related transfer functions Petition 870250089362, dated 10 / 01 / 2025, p. 9 / 121 2 / 54 (HRTFs): A multisource approach. In 2004, 12th European Conference on Signal Processing (pp. 1761-1764).IEEE).

[005] The object of the present invention is to provide improved concepts for binaural pose correction. The object of the present invention is solved by an apparatus according to claim 1, by an apparatus according to claim 29, by a method according to claim 47, by a method according to claim 48 and by a computer program according to claim 49, by an apparatus according to claim 50, by an apparatus according to claim 66, by a method according to claim 87, by a method according to claim 88 and by a computer program according to claim 89.

[006] An apparatus for processing two or more binaural first signals, according to one embodiment, is provided. The apparatus comprises an audio processor configured to conduct a weighted mix of two or more binaural first signals to obtain a combined binaural signal. The two or more binaural first signals are two or more binaural audio signals for different rotations of the same audio scene.

[007] In addition, a device for generating two or more binaural signals, according to a modality, is provided. The device is configured to generate the two or more binaural signals, being two or more binaural audio signals for different rotations of the same audio scene.

[008] In addition, a method for processing two or more binaural first signals, according to an embodiment, is provided. The method comprises conducting a weighted mixture of two or more binaural first signals to obtain a combined binaural signal. The two or more binaural first signals are two or more binaural signals. Petition 870250089362, dated 10 / 01 / 2025, page 10 / 121 3 / 54 binaural beats for different rotations of the same audio scene.

[009] In addition, a method for generating two or more binaural signals, according to a modality, is provided. The method comprises the generation of two or more binaural signals, being two or more binaural audio signals for different rotations of the same audio scene.

[0010] In addition, a computer program to implement one of the methods described above when run on a computer or signal processor is provided.

[0011] According to one embodiment, an audio processor is provided to deliver a binaural signal, where the binaural signal is generated by a weighted mixture of two or more binaural signals, which comprise / relate to a spatial scene in different rotations (e.g., in the same scene, a different head pose can, for example, be applied during rendering). In the context of AR / VR, rendering media based on the user's pose is crucial to achieving high-quality immersion. Depending on the system configuration, a lightweight wearable device can transfer tracked rendering to another device by transmitting a user pose. In this scenario, the round-trip link delay can result in a rendered scene arriving with an outdated user pose, degrading the quality of the immersive experience.

[0012] The modalities achieve the correction / improvement of an outdated pose through pose correction.

[0013] According to the modalities, a low-complexity method for pose correction is provided, which can be applied directly to the lightweight device to mitigate this effect. The lightweight device can, for example, dynamically determine the pose displacement and can, for example, be able to dynamically determine the Petition 870250089362, dated 10 / 01 / 2025, page 11 / 121 4 / 54 signals transmitted by a capable device via a rear channel. The pose correction capability in the lightweight device allows for an increase in the quality of the immersive experience.

[0014] According to the modalities, two binaural rendering properties and binaurally rendered signals can, for example, be employed to obtain a signal that approximates the binaural scene at different rotations, for example, using time-domain-only processing.

[0015] According to the embodiments of the present application, the device is configured to determine, for example, as part of the information about the user's head pose, yaw angle information, for example, an angle value or a rotation matrix or a quaternion, describing an angle between a frontal direction of the user's head and the frontal direction of the coordinate system used by the audio processor that performs the binaural rendering of the first binaural signals; and / or tilt angle information, for example, an angle value or a rotation matrix or a quaternion, describing a tilt angle of the user's head, for example, with respect to a horizontal alignment; and / or rotation angle information, for example, an angle value or a rotation matrix or a quaternion describing a rotation angle of the user's head, for example, with respect to a vertical direction, for example, with respect to a direction of gravity.

[0016] According to another embodiment, a device for generating signal prediction information is provided. The device is configured to receive pose information and / or rotational displacement information. In addition, the device is configured to generate a first binaural signal for a first rotation of an audio scene. Furthermore, the device is configured to generate signal prediction information depending on the pose information and / or the Petition 870250089362, dated 10 / 01 / 2025, page 12 / 121 5 / 54 rotational displacement information, so that one or more additional binaural signals for one or more additional rotations, being different from the first rotation, can be generated using the first binaural signal and the signal prediction information.

[0017] According to a further embodiment, an apparatus is provided for generating one or more additional binaural signals from a first binaural signal using signal prediction information. The apparatus is configured to receive the first binaural signal for a first rotation of an audio scene. Furthermore, the apparatus is configured to receive signal prediction information that depends on pose information and / or that depends on rotational displacement information. In addition, the apparatus is configured to generate one or more additional binaural signals for one or more additional rotations, different from the first rotation, using the first binaural signal and using the signal prediction information.

[0018] According to another embodiment, a method for generating signal prediction information is provided. The method comprises: - Receive pose information and / or rotational displacement information. - Generate a first binaural signal for the first rotation of an audio scene.

[0019] The generation of signal prediction information is performed depending on pose information and / or rotational displacement information, so that one or more additional binaural signals for one or more additional rotations, being different from the first rotation, can be generated using the first binaural signal and using the signal prediction information.

[0020] In another embodiment, a method for generating one or more additional binaural signals from a first binaural signal using signal prediction information is provided. The method comprises Petition 870250089362, dated 10 / 01 / 2025, page 13 / 121 6 / 54 of: - Receive the first binaural signal for the first rotation of an audio scene. - Receive signal prediction information that depends on pose information and / or rotational displacement information. - generate one or more additional binaural signals for one or more additional rotations, being different from the first rotation using the first binaural signal and using the signal prediction information.

[0021] In addition, a computer program to implement one of the methods described above running on a computer or signal processor is provided.

[0022] The embodiments of the present invention are described in more detail below with reference to the figures, in which:

[0023] Figure 1 illustrates a device for processing two or more binaural first signals according to a modality.

[0024] Figure 2 illustrates a system with a delay in the transmission of head pose between a light device and a capable device.

[0025] Figure 3 illustrates a system with a delay in the transmission of the head pose through a link between a lightweight device with an audio decoder and a capable device with an audio encoder.

[0026] Figure 4 illustrates a 180° rotation approximation by means of a binaural channel switch.

[0027] Figure 5 illustrates a system for pose correction using multiple time-domain signals according to a modality.

[0028] Figure 6 illustrates a system for pose correction using multiple time-domain signals, wherein the capable device of the system comprises an audio encoder and wherein the lightweight device of the system comprises an audio decoder. Petition 870250089362, dated 10 / 01 / 2025, page 14 / 121 7 / 54

[0029] Figure 7 illustrates a top-down view of a scene with a yaw angle for the case of 0 = 30° according to one embodiment.

[0030] Figure 8 illustrates a yaw axis pose correction device implementing a pose correction algorithm according to a modality.

[0031] Figure 9 illustrates a device for complete pose correction implementing a pose correction algorithm for the generic case according to a modality.

[0032] Figure 10 illustrates a device according to a yaw correction modality.

[0033] Figure 11 illustrates a yaw correction device according to an embodiment comprising an audio decoder.

[0034] Figure 12 illustrates a device for complete pose correction according to a modality.

[0035] Figure 13 illustrates a device according to a modality for complete pose correction with an audio decoder.

[0036] Figure 14 illustrates a flowchart that describes a communication flow between a capable device and a light device according to a specific mode, in which the capable device receives a data stream or a signal, for example, from a network entity.

[0037] Figure 15 illustrates the initial results of the hearing test, indicating the means and 95% confidence intervals for twelve items.

[0038] Figure 16 illustrates a head with yaw, pitch and roll axes represented.

[0039] Figure 17 illustrates a system comprising an apparatus for generating signal prediction information according to Petition 870250089362, dated 10 / 01 / 2025, page 15 / 121 8 / 54 a modality, and a device for generating one or more additional binaural signals from a first binaural signal.

[0040] Figure 1 illustrates a device 210 for processing two or more binaural first signals according to a modality.

[0041] Device 210 comprises an audio processor 815 configured to conduct a weighted mix of two or more binaural first signals to obtain a combined binaural signal.

[0042] The first two or more binaural signals are two or more binaural audio signals for different rotations of the same audio scene.

[0043] According to one modality, the different rotations can, for example, indicate different head poses of a head within the audio scene, so that the first two or more binaural signals are associated with the different head poses of the head.

[0044] In one embodiment, the different head positions may, for example, be defined with respect to one or more Euler angles. And / or, the different head positions may, for example, be defined with respect to at least one of a yaw angle, a tilt angle and a roll angle. And / or, the different head positions may, for example, be defined with respect to a rotation matrix. And / or, the different head positions may, for example, be defined with respect to one or more quaternions.

[0045] According to one modality, each of two or more first binaural signals is associated with an associated absolute pose P'i...P'n that is different from the associated absolute pose P'i...P'n of any other two or more first binaural signals. And / or, each of two or more first binaural signals may, for example, be associated with an associated relative rotational displacement k1...kN that is different from the associated relative rotational displacement k1...kN of Petition 870250089362, dated 10 / 01 / 2025, p. 16 / 121 9 / 54 any other of two or more first binaural signals. In modalities, the associated relative rotational displacements k1...kN may, for example, depend on θ.

[0046] An example of associated relative rotational displacements defined for a single axis of rotation is, for example, k1 = 50°; k2 = -25°; k3 = 0°; k4 = 25°; k5 = 50°. A corresponding example of associated absolute poses defined for the aforementioned single axis of rotation is, for example, P'i = 30°; P'2 = 55°; P'3 = 80°; P'4 = 105°; P'5 = 130°.

[0047] It should be noted that associated relative rotational displacements k1...kN and / or associated absolute poses can, for example, also be defined for two or more axes of rotation, for example, three axes of rotation. In such cases, an associated relative rotational displacement k1...kN and / or an associated absolute pose can, for example, be defined as an angle vector, as a rotation matrix, or as a quaternion.

[0048] Regarding the associated relative rotational displacement k1...kN, a value θ (a rotational displacement parameter) will be described later. In some embodiments, the associated relative rotational displacement may, for example, depend on said value. In the examples below, for instance, the transmission of the value θ from a lightweight device 210 to a compatible device 220 may, for instance, cause the compatible device 220 to generate, for instance, three binaural signals, the first being associated with the associated relative rotational displacement θ, the second being associated with the associated relative rotational displacement 0, and the third being associated with the associated relative rotational displacement - θ.

[0049] Any other number of binaural signals can, for example, be generated in response to the reception of θ. Furthermore, in response to the reception of θ, additional binaural signals can, for example, Petition 870250089362, dated 10 / 01 / 2025, p. 17 / 121 10 / 54 can be generated by the enabled device, for example, five binaural signals associated with the relative rotational displacements, -3 θ; -1.5 θ; 0; +1.5 θ; and 3 θ. Any other examples are also possible. In some modes, for a value θ, a number of binaural signals associated with ^(Θ)..^ν(Θ) can, for example, be received by the device 210, with ki being a function that maps θ to a value.

[0050] According to one embodiment, device 210 can, for example, be configured to receive information about the absolute pose associated P'i...P'n of two or more first binaural signals and / or information about the relative rotational displacement associated k1...kN of two or more first binaural signals, for example, from another device 220.

[0051] In a modality, the associated absolute pose P'i...P'n may, for example, be associated with each of two or more first binaural signals indicating the head pose, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions. Or, the associated relative rotational displacement k1...kN may, for example, be associated with each of two or more first binaural signals indicating a difference of a second head pose in relation to a first head pose, being defined depending on one or more Euler angles and / or yaw angle and / or tilt angle and / or rotation angle and / or rotation matrix and / or one or more quaternions.

[0052] According to one modality, the absolute pose associated with P'i...P'n, each of two or more first binaural signals, can, for example, indicate a head posture, being defined depending on at least one of the yaw, tilt, and rotation axes of the head. The rotational displacement associates Petition 870250089362, dated 10 / 01 / 2025, page 18 / 121 11 / 54 of each of two or more first binaural signals can, for example, indicate a difference between a second head pose and a first head pose, being defined depending on at least one of the yaw, tilt, and head roll axes.

[0053] In one embodiment, the audio processor 815 can, for example, be configured to drive the weighted mix depending on one or more weights g1...gN. The audio processor 815 can, for example, be configured to determine one or more weights g1...gN depending on the associated absolute position P'i...P'n or the associated relative rotational displacement k1...kN being associated with each of two or more first binaural signals, and depending on a current rotational displacement ΔP between a current position P and a previous position P', wherein the current rotational displacement ΔP indicates at least one difference between the current rotation angle and the previous rotation angle with respect to an axis of rotation (e.g., with respect to the yaw axis, the pitch axis, or an axis of rotation).

[0054] Note that the 815 audio processor can, for example, determine that one or some of the g1...gN weights should be set to 0.

[0055] According to one embodiment, the audio processor 815 can, for example, be configured to determine one or more weights g1...gN, determining a weight g1...gN for each binaural signal from two or more first binaural signals, such that the weight for the binaural signal depends on a difference between the actual rotational displacement ΔΡ and the associated relative rotational displacement k1...kN being associated with the binaural signal.

[0056] In one embodiment, the 815 audio processor can, for example, be configured to receive three or more binaural input signals, each of which is associated with an absolute pose. Petition 870250089362, dated 10 / 01 / 2025, page 19 / 121 12 / 54 of P'i...P'n or an associated relative rotational displacement ki...kN. To obtain two or more binaural audio signals, the 815 audio processor can, for example, be configured to select at least two binaural signals from among the three or more binaural input signals, depending on the current rotational displacement ΔP and depending on the associated absolute position P'i...P'n or the associated relative rotational displacement k1...kN of each of the three or more binaural input signals.

[0057] According to one embodiment, the audio signal processor 815 can, for example, be configured to determine whether the two audio channels of a binaural signal from at least two selected binaural signals should be swapped with each other, depending on the current rotational displacement ΔP and the associated absolute position P'i...P'n or the relative rotational displacement k1...kN being associated with the binaural signal. The audio signal processor 815 can, for example, be configured to, if it is determined that the two audio channels should be swapped, swap the two audio channels of the binaural signal with each other to obtain one of two or more first binaural signals.

[0058] In one embodiment, a first signal processor and a second signal processor can, for example, together form the audio signal processor 815. The first signal processor can, for example, be configured to receive a first channel from three or more binaural input signals, each of which is associated with an absolute position P'i...P'n or a relative rotational displacement k1...kN. To obtain a first channel from each of two or more binaural audio first signals, the first signal processor can, for example, be configured to select at least two binaural signals selected from the three or more binaural input signals, depending on the current rotational displacement ΔP and depending Petition 870250089362, dated 10 / 01 / 2025, page 20 / 121 13 / 54 of the associated absolute position P'i...P'n or the relative rotational displacement k1...kN of each of the three or more binaural input signals; wherein the first signal processor is configured to conduct a weighted mix of the first channel of each of two or more first binaural signals to obtain a first channel of the combined binaural signal. To obtain a second channel from each of two or more first binaural audio signals, the second signal processor is configured to select at least two binaural signals selected from the three or more binaural input signals, depending on the current rotational displacement ΔP and depending on the associated absolute position P'i...P'n or the associated relative rotational displacement k1...kN of each of the three or more binaural input signals; wherein the second signal processor is configured to conduct a weighted mix of the second channel of each of the two or more first binaural signals to obtain a second channel of the combined binaural signal.

[0059] In one embodiment, the first signal processor and the second signal processor may, for example, be spaced apart from each other.

[0060] According to one embodiment, device 210 may, for example, comprise a pair of two earphones, wherein the first signal processor may, for example, be implemented in the first of the two earphones, and wherein the second signal processor may, for example, be implemented in the second of the two earphones.

[0061] In one embodiment, device 210 can, for example, be configured to receive two or more binaural input signals from one or more transmissions from another device 220.

[0062] Depending on the mode, the transmission may, for example, comprise two or more binaural input signals re Petition 870250089362, dated 10 / 01 / 2025, page 21 / 121 14 / 54 presented in a time domain. Or, the transmission may, for example, comprise the two or more binaural input signals represented in a frequency domain. Or, the transmission may, for example, comprise an encoding of two or more binaural input signals represented in the time domain or in the frequency domain.

[0063] According to one embodiment, device 210 and the other device 220 can, for example, be connected by means of a delayed link, for example, a wireless link.

[0064] In one embodiment, at least one of two or more binaural input signals may, for example, depend on a rotational displacement parameter θ and is associated with an associated absolute pose P'i...P'n or an associated relative rotational displacement k1...kN, which depends on the rotational displacement parameter θ. Each of two or more first binaural signals may, for example, correspond to one of two or more binaural input signals or be derived from one of two or more binaural input signals.

[0065] In one embodiment, the apparatus may, for example, be configured to transmit the rotational displacement parameter θ to another apparatus 220. The apparatus 210 may, for example, be configured to receive the transmission from the other apparatus 220 comprising the two or more binaural input signals or an encoding thereof.

[0066] According to one embodiment, device 210 can, for example, be configured to determine the rotational offset parameter θ depending on the current rotational offset ΔΡ; and / or device 210 can, for example, be configured to determine the rotational offset parameter θ depending on a link latency.

[0067] In general, according to a specific modality, if the Petition 870250089362, dated 10 / 01 / 2025, page 22 / 121 15 / 54 If the link latency is greater, normally θ will be set to greater, because due to the greater latency, it can be expected that, during the transmission latency, a greater displacement of movement / rotation will occur, for example, of a head, compared to a situation where the latency is lower.

[0068] In one embodiment, device 210 can, for example, be configured to receive or (for example, dynamically) determine information about the transmission link latency. In addition, device 210 can, for example, be configured to perform pose prediction depending on the link latency.

[0069] In one embodiment, device 210 may, for example, be configured to transmit the current rotational displacement ΔP and / or one or more poses P'i...P'n and / or upstream metadata to another device 220.

[0070] In one embodiment, device 210 can, for example, be configured to receive the transmission from the other device 220, which comprises two or more binaural input signals or an encoding thereof. Device 210 can, for example, be configured to receive the rotational displacement parameter θ from the other device 220. Device 210 can, for example, be configured to determine the first two or more binaural signals from two or more binaural input signals, depending on the current rotational displacement ΔΡ, or it can, for example, be configured to determine one or more weights g1...gN, depending on the current rotational displacement ΔΡ.

[0071] According to one embodiment, the 210 apparatus may, for example, be configured to determine the first two or more binaural signals from two or more binaural input signals or is configured to determine one or more g1...gN weights when using a linear pan or when using a tangent pan or when using Petition 870250089362, dated 10 / 01 / 2025, page 23 / 121 16 / 54 a vector-based amplitude pan or when using an edge-fade amplitude pan or when using an ambisonic pan or quaternion-based pan.

[0072] According to one embodiment, device 210 can, for example, be configured to receive the transmission from another device 220, which comprises a number of one or more transmitted binaural signals or an encoding thereof and metadata, the number being less than the number of two or more binaural input signals. Device 210 can, for example, be configured to obtain two or more binaural input signals from the transmission by reconstructing the two or more binaural input signals from one or more transmitted binaural signals using the metadata.

[0073] In one embodiment, the transmission comprises one or more head-related, parametric or model-based transfer functions and / or acoustic parameters, or an encoding thereof. The 210 device can, for example, be configured to obtain two or more binaural input signals using one or more head-related, parametric or model-based transfer functions and / or acoustic parameters.

[0074] According to one embodiment, the audio processor 815 can, for example, be configured to obtain one or more additional binaural signals from two or more binaural input signals by modifying the binaural tracks of at least one of two or more binaural input signals. The audio processor 815 can, for example, be configured to obtain two or more first binaural signals from two or more binaural input signals and one or more additional binaural signals.

[0075] In one embodiment, apparatus 210 may, for example, comprise a pose displacement module 810 to determine the actual rotational displacement ΔP between the current pose P and the pose Petition 870250089362, dated 10 / 01 / 2025, page 24 / 121 17 / 54 previous P', where the current rotational displacement ΔP indicates at least one difference between the current rotation angle and the previous rotation angle with respect to an axis of rotation.

[0076] According to one embodiment, the 815 audio processor can, for example, be configured to conduct weighted mixing of two or more binaural first signals in a time domain. Or, the 815 audio processor can, for example, be configured to conduct weighted mixing of two or more binaural first signals in the frequency domain.

[0077] In addition, a 220 device is provided to generate two or more binaural signals according to a mode (see, for example, figure 2, figure 5 or figure 6).

[0078] The 220 device is configured to generate two or more binaural signals, being two or more binaural audio signals for different rotations of the same audio scene.

[0079] According to one modality, the different rotations can, for example, indicate different head poses of a head within the audio scene, so that the two or more binaural signals are associated with the different head poses of the head.

[0080] In a modality, the different head positions can, for example, be defined in relation to one or more Euler angles. And / or, the different head positions can, for example, be defined in relation to at least one of a yaw angle, a tilt angle and a roll angle. And / or, the different head positions can, for example, be defined in relation to a rotation matrix. And / or, the different head poses can, for example, be defined in relation to one or more quaternions.

[0081] According to a modality, each of two or more binaural signals can, for example, be associated with an associated absolute pose Ρ'ι.,.Ρ'ν being different from the associated absolute pose Petition 870250089362, dated 10 / 01 / 2025, p. 25 / 121 18 / 54 P'i...P'n of any other two or more binaural signals. And / or, each of two or more binaural signals can, for example, be associated with an associated relative rotational displacement k1...kN that is different from the associated relative rotational displacement k1...kN of any other two or more binaural signals.

[0082] In one embodiment, device 220 can, for example, be configured to transmit information about the associated absolute pose P'i...P'n of two or more binaural signals and / or information about the associated relative rotational displacement k1...kN of two or more binaural signals, for example, to another device 210.

[0083] According to a modality, the absolute pose associated P'i...P'n being associated with each of two or more binaural signals may, for example, indicate the head pose, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions. And / or, the relative rotational displacement associated k1...kN being associated with each of two or more binaural signals may, for example, indicate a difference of a second head pose in relation to a first head pose, being defined depending on one or more Euler angles and / or yaw angle and / or tilt angle and / or rotation angle and / or rotation matrix and / or one or more quaternions.

[0084] In one embodiment, device 220 can, for example, be configured to conduct one or more transmissions to transmit the two or more binaural signals to another device 210.

[0085] Depending on the mode, the transmission may, for example, comprise two or more binaural input signals represented in a time domain. Or, the transmission may, for example, comprise two or more binaural input signals represented in a frequency domain. Or, the transmission may, Petition 870250089362, dated 10 / 01 / 2025, page 26 / 121 19 / 54 for example, understanding the encoding of two or more binaural input signals represented in the time domain or frequency domain.

[0086] According to one embodiment, device 220 and the other device 210 can, for example, be connected by means of a delayed link, for example, a wireless link.

[0087] In one modality, at least one of two or more binaural signals may, for example, depend on a rotational displacement parameter 6 and is associated with an associated absolute pose P'i...P'n or with an associated relative rotational displacement k1...kN, which depends on the rotational displacement parameter θ.

[0088] According to one embodiment, device 220 can, for example, be configured to receive the rotational displacement parameter θ from another device 210. Device 220 can, for example, be configured to transmit the two or more binaural signals or an encoding thereof to the other device 210.

[0089] In one embodiment, the rotational displacement parameter θ may, for example, depend on an actual rotational displacement ΔΡ.

[0090] In one embodiment, the 220 device can, for example, be configured to receive or, for example, dynamically determine information about the link latency of the transmission. The 220 device can, for example, be configured to perform pose prediction depending on the link latency. Pose prediction can, for example, be used to minimize ΔP.

[0091] According to one embodiment, device 220 may, for example, be configured to receive a current rotational displacement ΔP and / or one or more poses P'i...P'n and / or upstream metadata from another device 210. Furthermore, device 220 may, for example, be configured to determine the rotational displacement parameter. Petition 870250089362, dated 10 / 01 / 2025, page 27 / 121 20 / 54 onal θ using the current rotational displacement ΔΡ and / or using one or more poses P'i...P'n and / or using the upstream metadata.

[0092] According to one embodiment, device 220 can, for example, be configured to transmit two or more binaural signals or an encoding thereof to the other device 210. Device 220 can, for example, be configured to transmit the rotational displacement parameter θ to the other device 210.

[0093] In addition, a system is provided. The system comprises one or more devices 210 according to one of the embodiments described above, for example, the lightweight device, and the device 220 of one of the embodiments described above, for example, the capable device.

[0094] Next, some basic considerations for some of the modalities are described.

[0095] Current Augmented Reality / Virtual Reality devices, for example in the form of glasses or headphones, aim for compact forms and reduced weight to be comfortable to use. However, this presents limitations regarding processing power and battery capacity. A possible solution to this problem is to divide the processing between two devices:

[0096] The first 210 device may, for example, be called a 210 light device, for example, a battery-powered device worn by a user (e.g., AR glasses, headphones), where pose tracking (e.g., by means of head tracking data) and only low-complexity processing are performed.

[0097] The second 220 device may, for example, be termed a 220-capable device, for example, a smartphone or an edge device, where highly complex processing is performed. This typically includes media decoding (audio, video) and content pose adaptation (e.g., rotation of Petition 870250089362, dated 10 / 01 / 2025, page 28 / 121 21 / 54 scene).

[0098] For example, Figure 2, Figure 3, Figure 5 and Figure 6 illustrate a system comprising a first device 210 (e.g., a lightweight device) and a second device 220 (e.g., a capable device).

[0099] Both devices, the first device 210 (for example, the lightweight device) and the second device (for example, the capable device) are connected by means of a link, for example, a delayed link, for example, by means of a wireless link which may, for example, be limited in bit rate and, in addition, includes transmission delay.

[00100] This configuration introduces a latency between pose tracking on the lightweight device 210 and pose adaptation on the capable device 220. One way to deal with this problem, for example, for audio and / or video signals, could be as follows:

[00101] An estimate of the pose latency on the lightweight device 210 can, for example, be made by measuring the motion latency relative to the sound or the round-trip delay of sending the pose from the lightweight device 210 to the compatible device 220 and, for example, by analyzing the pose actually used to render the current media. This round-trip delay can, for example, be in the range of 50 ms to 200 ms.

[00102] Another way to estimate pose latency on the 210 lightweight device can, for example, be done by attaching a timestamp or identifier to the pose, which is also transmitted back (with the audio rendered binaurally) to the lightweight device.

[00103] A predicted pose can, for example, be estimated in the 210 light device based on the actual pose, where the predicted pose depends on / corresponds to the return time delay. Petition 870250089362, dated 10 / 01 / 2025, page 29 / 121 22 / 54

[00104] On the capable device 220, media decoding and content pose adaptation to the predicted pose (e.g., referred to as pre-rendering) can, for example, be performed.

[00105] Pre-rendered data / pre-rendered scene can, for example, be transmitted to the lightweight device 210.

[00106] On the 210 light device, the pose can then, for example, be corrected according to the actual pose at the time of playback.

[00107] Some modes are related to audio aspects and may, for example, be related to rendering an immersive scene in stereo headphones.

[00108] According to some embodiments, an immersive audio signal (e.g., binaural audio and / or, e.g., audio objects and / or, e.g., multichannel audio and / or, e.g., Ambisonics audio) may, for example, be considered binaurally rendered according to a head pose, for example, estimated on the lightweight device 210 and / or, for example, transmitted from the compatible device 220 to the lightweight device 210.

[00109] Possible connections may, for example, include Wi-Fi and Bluetooth and corresponding audio codecs such as LC3. Other wireless technologies may, for example, be used to connect the compatible device 220 and the lightweight device 210, such as 5G, including 5G Sidelink, UWB (Ultra Wideband), LTE, etc.

[00110] The predicted head pose information can, for example, be sent via a backlink to the 220-enabled device, which can, for example, render the binaural signal. Both the binaural signal transmission and the head pose data transmission have a transmission delay that includes wireless connection delay, such as propagation times, and other sources of delay, such as audio codec delay. It is known to those skilled in the art that audio codecs typically exhibit some delay. Petition 870250089362, dated 10 / 01 / 2025, page 30 / 121 23 / 54 rhythmic pattern inherent to the codec algorithm.

[00111] Figure 2 illustrates a system with a delay in the transmission of head pose between a lightweight device 210 and a capable device 220.

[00112] Figure 3 illustrates a system with a delay in the transmission of the head pose by means of a link between a lightweight device 210 with an audio decoder 212 and a compatible device 220 with an audio encoder 222.

[00113] Because the rendering device uses the pose data transmitted over the backlink to render a binaural signal, by the time that signal reaches the light device 210, the user's head pose will likely have already changed, resulting in incorrect binaural signals. In practice, this delay is expected to be between 50 ms and 200 ms.

[00114] This evokes the need for a low-complexity, low-latency solution that can be used directly on the lightweight 210 device to perform a pose update and compensate for any deviation in head pose. The prior art solutions in [1] and [2] presented above rely on a filter bank or transform to obtain a frequency domain representation to enable in-band processing that allows either a codebook application for direction indication to be applied, as in [1], or covariance-based processing, as in [2]. In the prior art, the requirement for a frequency domain representation introduces a certain framing delay, in addition to the computational complexity to perform the transform and inverse transform.

[00115] One option for a time-domain approach would be to transmit two signals in, for example, two poses spanning the expected deviation of a pose during link latency and perform an interpolation between them. Such an approach should allow interpolation. Petition 870250089362, dated 10 / 01 / 2025, page 31 / 121 24 / 54 tion on a vector that joins the two poses. If the two poses are on either side of the rendered delayed pose, a linear interpolation in the center would average both. With a large pose offset, this averaging can lead to spatial collapse, where two signals with effectively mirrored binaural tracks are calculated. This can degrade quality significantly, and thus delayed pose transmission is necessary to maintain quality. With a smaller pose offset, the two-signal approach can be of reasonable quality.

[00116] Furthermore, another alternative approach would be to use a covariance-based approach. Using such a concept, for example, for the yaw axis, the signal can, for instance, be rendered with poses of P' + 15° and P' - 15°, that is, with relative rotational displacements of ±15° on the yaw axis. The signal can, for example, also be rendered in the delayed pose P', as would be the case without pose correction. This can, for example, be followed by a calculation of a prediction matrix per band for each pair of signals, i.e., P', P'±15° and P'-15°. This prediction matrix estimates the signal in each band at P'±15° given the signal at P'.

[00117] Figure 16 illustrates a head, in which the yaw axis 1610, the pitch axis 1620 and the rotation axis 1630 are represented.

[00118] The binaural signal rendering in P' can, for example, be transmitted along with two sets of band prediction matrices as metadata to the lightweight device 210 which determines the actual pose offset between the delayed and most recent pose ΔP = P - P' and applies an interpolation factor to the relevant set of band matrices to obtain an approximation of the most recent pose P. This approach works very well when the pose offset ΔP is within the expected range, but can produce undesirable artifacts. Petition 870250089362, dated 10 / 01 / 2025, page 32 / 121 25 / 54 when moving outside of that range, even leading to degradations in quality compared to the absence of pose correction.

[00119] Regarding bilinear interpolation on a set of impulse responses to obtain an interpolated response for a missing position, see, for example, [3], mentioned above.

[00120] Specific modalities are described below.

[00121] First, HRTF interpolation and binaural rendering via convolution according to the modalities is described.

[00122] The weights for such bilinear interpolation can also be determined by loudspeaker panning methods, such as vector basis amplitude panning, VBAP (for example, as used in Matlab's interpolateHRTFQ() function), edge fade amplitude panning, EFAP, or tangent law panning for the linear case, etc.

[00123] According to the modalities, considering the linear case of a pair of impulse responses in and ir2, an interpolated impulse response irinterp along a line connecting the origin positions of the two true responses in and ir2 can, for example, be determined using panning gains and wi and W2: irinterp (t) = w1ir1(t) + w2ir2(t)

[00124] A binaural rendering of a source signal x(t) using this (interpolated) impulse response irinterp can, for example, be described by the equation: yinterp(t) = x(t) O iHinterp(t) where O is the convolution operation. Substituting irinterp(t) on the right-hand side of the first equation results in: yinterp(t) = x(t) O (Wiiri(t) + w2ir2(t))

[00125] Furthermore, using the distributivity and linearity properties of convolution, the equation can be rearranged to: yinterp(t) = Wi[x(t) O ir (t)] + W2[x(t) O ir2(t)] Petition 870250089362, dated 10 / 01 / 2025, p. 33 / 121 26 / 54

[00126] Thus, a convolution of a signal with a weighted sum of impulse responses is equivalent to a weighted sum of the same signal convolved independently with the two impulse responses.

[00127] Considering a multi-source binaural signal y(t) = Σn Xn(t) O irn (t), an interpolated rotation can also be approximated by a weighted sum of this multi-source signal at two different rotations.

[00128] Next, an approximation of a 180° rotation in the horizontal plane according to the modalities is described.

[00129] A binaural representation of a sound scene comprises directional cues that aid in locating the sources. If the two channels of a binaural signal are swapped, the resulting signal will have swapped localization cues for both ears. This mimics the scenario where the head is rotated 180° facing the opposite direction of the original scene. However, since the swap does not account for changes in spectral cues due to the shading (or lack thereof, depending on the direction of arrival of the source) of the auricle, the timbre of this approximation differs from basic reality.

[00130] Figure 4 illustrates a 180° rotation approximation via a binaural channel switch.

[00131] In Figure 4, it can be observed that, in the case where the head is rotated 180°, the auditory signals are essentially swapped. The only asymmetry is due to the filtering of the auricle; furthermore, the interaural level and time difference cues would be preserved with a channel swap. Thus, for a binaural signal y(t), it is known that y180°(t) ~ swap(y(t)). In other modalities, the channel swap of a binaural signal for a given pose can, for example, be used to approximate a binaural signal for another pose, not necessarily rotated 180° in yaw. Petition 870250089362, dated 10 / 01 / 2025, page 34 / 121 27 / 54

[00132] Specific modalities are described in more detail below.

[00133] Although the following explanations are given with respect to θyaw°, it should be noted that the explanations also apply to inclination, rotation, other Euler angles, and a rotation matrix and to (one or more) quaternions.

[00134] When transmitting a set of, for example, three pairs of binaural signals, any rotation in the yaw axis can be approximated by determining the displacement of the most recent pose relative to the delayed pose and performing an interpolation using one of the techniques above.

[00135] To accomplish this, the capable device 220 uses the delayed pose P' received from a head tracker (e.g., in the lightweight device 210) and performs a rendering for three different head poses P', P' + θ°yaw and P' - θ°yaw (where |θ| < 90°, e.g., 30°) (For example, the selected offset of θ° can be adaptively determined based on the recent head movement. In a specific mode, the signal with the scene rotated to - θ° can, for example, be replaced by a signal with the scene rotated to (180 - θ°).

[00136] Figure 5 illustrates a system for pose correction using multiple time-domain signals according to a modality.

[00137] Figure 6 illustrates a system for pose correction using multiple time-domain signals, wherein the capable device 220 of the system comprises an audio encoder 222 and wherein the lightweight device 210 of the system comprises an audio decoder 212.

[00138] These three signals can, for example, be used in the split rendering device to perform, for example, a signal pair selection and, for example, an optional channel switch with Petition 870250089362, dated 10 / 01 / 2025, page 35 / 121 28 / 54 based on the actual displacement ΔPyaw between the most recent pose P and the delayed pose P'. This is visualized in Figure 7.

[00139] Figure 7 illustrates a top-down view of a scene with a yaw angle for the case of θ = 30° according to one embodiment.

[00140] Based on the value of ΔPyaw, the pan gains are calculated between the corresponding pair of signals, using the unmodified transmitted signals at P', (P' + θ°yaw) and (P' - θ°yaw) or the channel-swapped versions at poses of (P' + 180°), P' + (180° - θ°yaw) and P' + (180° + θ°yaw).

[00141] For a yaw-only pose correction, the gain calculation is performed in only one dimension, so a simple tangent panning law is sufficient. This may include, for example, selecting the pair of signals where ΔP lies and the corresponding pan aperture of 0 or 180° - 2θ.

[00142] Figure 8 illustrates a yaw axis pose correction device implementing a pose correction algorithm according to a modality.

[00143] For example, three binaural signals can be received by the 820 selection module, for example, a first binaural signal for the delayed pose, P', a second binaural signal for P' + 9° of yaw and a third binaural signal for P' - 9° of yaw. For example, with 9° of yaw = 30°, a first binaural signal is received for P', a second binaural signal is received for P' + 30° and a third binaural signal is received for P' - 30°.

[00144] In this context, P' - θyaw°, P', P' + θyaw° can, for example, be referred to as the associated absolute poses of the three binaural signals, and - θyaw°, 0, θyaw° can, for example, be referred to as the associated relative rotational displacements k1...kN of the three binaural signals. Petition 870250089362, dated 10 / 01 / 2025, p. 36 / 121 29 / 54

[00145] A pose displacement ΔP can, for example, indicate a displacement between the most recent pose P and the latest pose P': ΔP = P - P'. If only the yaw axis is considered, ΔP can, for example, indicate a difference for the yaw axis. If the pitch axis and / or the roll axis are also considered, ΔP can, for example, indicate a difference for each of these axes. For example, ΔP can, in these cases, be a vector comprising two or three components.

[00146] In this context, P can, for example, be referred to as a current pose, P' can, for example, be referred to as a previous pose, and ΔP can, for example, be referred to as a current rotational displacement.

[00147] Depending on the pose shift ΔΡ, a pair of binaural signals can, for example, be selected by the selection module 820.

[00148] For example, the two binaural signals for pose shifts closest to the calculated pose shift ΔΡ can, for example, be deselected. For example, if ΔΡ = -20°, the binaural signals for P' and P' - 30° can, for example, be selected, but not the binaural signal for P' + 30°.

[00149] Or, for example, the (here: three) channel-swapped versions of the received binaural signals can, for example, also be considered for selection. For example, a first binaural signal swapped for (P' + 180°) can, for example, be associated with the first binaural signal for P'; a second binaural signal swapped for P' + (180° - 30°) = P' + 150° can, for example, be associated with the second binaural signal for P' + 30°; and a third binaural signal swapped for P' + (180° + 30°) = P' + 210° can, for example, be associated with the third binaural signal for P' - 30°.

[00150] For example, if ΔΡ = +160°, the binaural signals for P' and Petition 870250089362, dated 10 / 01 / 2025, p. 37 / 121 30 / 54 For example, P' + 30° can be selected, but not the binaural signal for P' - 30°, and then a switching of the two channels of each of the two selected binaural signals can, for example, be conducted by the 825 channel switching module. However, if ΔP + 20°, the binaural signals for P' and P' + 30° can, for example, also be selected, but no channel switching is conducted in the 825 channel switching module.

[00151] Optionally, a mapping module 822 can, for example, map the current pose displacement to the coordinate system of the pose displacements of the selected binaural signals. If the current pose displacement is (always) represented in the same coordinate system as the pose displacements of the two selected binaural signals, this, for example, is not necessary. For example, a mapping from one coordinate system to another can, for example, be performed by the mapping module 822, if necessary. For example, a yaw-tilt-turn mapping to quaternions (or, in other embodiments, vice versa) can, for example, be conducted by the mapping module 822.

[00152] Depending on the selected binaural signal pair, the 830 gain calculation module can, for example, be configured to calculate the panning gains gi and g2 for the two selected binaural signals (the binaural signal pair). For example, g2 can be defined as g2 = g - gi. Linear interpolation, tangent panning, ambisonic panning, or panning based on VBAP or EFAP or quaternions can, for example, be employed to determine gi and / or g2.

[00153] For example, if the two binaural signals for a pose shift of 0oe and 0yaw° were selected, then, for example: S 2j Λ C· ji ^y™ ; gi = 1 - g2. Petition 870250089362, dated 10 / 01 / 2025, page 38 / 121 31 / 54

[00154] Or, for example, if the two binaural signals for a pose shift of 0oe - 0yaw° are selected, then, by —ΔPexample:32g1 = 1 - g2.

[00155] The 840 combination module can, for example, be configured to apply weights to the two binaural signals to obtain two weighted binaural signals and can, for example, be configured to combine the two weighted binaural signals, for example, by summing the two weighted binaural signals. Thus, the 840 combination module can, for example, conduct a combination, for example, a linear combination of the two binaural signals depending on the two weights.

[00156] In other modes, more than three binaural signals can, for example, be received by the 820 selection module.

[00157] The above explanations for yaw axis pose correction are equally applicable to pitch and / or roll axis pose correction. In this case, the combination module 840 can, for example, be configured to combine the binaural signal interpellated for the yaw axis and the binaural signal interpellated for the roll axis and / or the binaural signal interpellated for the roll axis, for example, by determining a linear combination of the binaural signals, for example, with equal weight, for example, 1 / 3 (or 1 / 2) for each of the three (or two) binaural signals.

[00158] Furthermore, the above explanations for pose correction are equally applicable to more than one sound source. In this case, illustrated by figure 9, the combination module 840 can, for example, be configured to combine the binaural signals interpellated for two or more sound sources, for example, by summing the binaural signals for two or more sound sources.

[00159] Figure 9 illustrates a device for complete pose correction implementing a pose correction algorithm for the case Petition 870250089362, dated 10 / 01 / 2025, page 39 / 121 32 / 54 generic according to a modality.

[00160] The complete solution, including pose correction on all rotational axes (yaw, pitch, and roll), can, for example, be employed in conjunction with a more sophisticated version with 3D amplitude panning, such as VBAP, EFAP, or ambisonic panning or quaternion-based panning. The additional signals can, for example, be employed as a basis for 3D amplitude panning, along with the projection of the individual ears on the vertical and horizontal axes to compensate for roll.

[00161] Figure 10 illustrates a device according to a yaw correction modality.

[00162] The device in Figure 10 can, for example, be implemented as a lightweight device 210. However, it should be noted that the embodiment in Figure 10 is not limited to a lightweight device 210, but can, for example, be implemented as a different type of other device.

[00163] Figure 10 further illustrates an audio processor 815. The audio processor 815 in Figure 10 is configured to conduct pose correction. The audio processor 815 may, for example, comprise the selection module 820, the gain calculation module 830 and the combination module 840 (and optionally the modules 822 and / or 825) and / or may, for example, implement the functionality of modules 820, 830 and 840 (and optionally implement the functionality of modules 822 and / or 825).

[00164] The embodiment of figure 10 comprises a pose shift module 810, which can, for example, be configured to calculate the pose shift ΔΡ between the most recent pose P and the delayed pose P': ΔΡ = P - P'.

[00165] Figure 11 illustrates a yaw correction device according to an embodiment comprising a decoder of Petition 870250089362, dated 10 / 01 / 2025, page 40 / 121 33 / 54 audio 1112. The audio decoder 1112 of Figure 11 may, for example, comprise three decoding units, as illustrated in Figure 11. The device of Figure 11 may, for example, be implemented as a lightweight device 210. It should be noted that the embodiment of Figure 11 is not limited to a lightweight device 210, but may, for example, be implemented as a different type of other device.

[00166] Figure 12 illustrates a device for complete pose correction, according to one embodiment. The device in Figure 12 can, for example, be implemented as a lightweight device 210. However, it should be noted that the embodiment in Figure 12 is not limited to a lightweight device 210, but can, for example, be implemented as a different type of device.

[00167] Figure 13 illustrates an apparatus, according to an embodiment, for complete pose correction with an audio decoder 1312. The audio decoder 1312 of Figure 13 may, for example, comprise a plurality of decoding units. The apparatus of Figure 13 may, for example, be implemented as a lightweight device 210. However, it should be noted that the embodiment of Figure 13 is not limited to a lightweight device 210, but may, for example, be implemented as a different type of device.

[00168] Regarding the pose shift module 810 in figures 10, 11, 12 and 13, it should be noted that, instead of determining the current pose and the pose shift ΔP by the respective device in figures 10, 11, 12 and 13, in alternative modes, the pose shift can, for example, be received by another device or module. The pose shift module 810 of the respective device in figures 10, 11, 12 and 13 is therefore not a mandatory module, but rather an optional module of the respective device.

[00169] Furthermore, in alternative modalities of figures 8, 10 and Petition 870250089362, dated 10 / 01 / 2025, page 41 / 121 34 / 54 11, only two binaural signals can, for example, be received by the device in Figure 8, so the selection module can, for example, become obsolete, in particular if channel switching is not employed. In such a mode, the two received binaural signals can always be considered as the two selected binaural signals. Such alternative modes are equally applicable to the modes in Figures 9, 12 and 13.

[00170] Figure 14 illustrates a flowchart describing a communication flow between a compliant device 220 and a lightweight device 210 according to a specific mode, where the compliant device receives a data stream, for example, a bit stream, or a signal, for example, a PCM signal, for example, from a network entity.

[00171] Adaptive pre-rendering according to modalities is described below.

[00172] Since the delays between the capable device 220 and the lightweight device 210 depend heavily on the wireless connection, the offsets to be corrected are generally smaller for lower round-trip delays. This allows choosing the value 0 to create the binaural renderings in P', (P' + θyaw ) and (P' - θyaw ) for adaptive values ​​based on the observed offsets to be corrected.

[00173] To enable adaptive θ, in one mode, θ can, for example, be transmitted (e.g., as a rotational displacement parameter) from the lightweight device 210 to the compatible device 220 (e.g., another device), for example, via a downlink channel. In a specific mode, each binaural signal can, for example, comprise the pose P' used for rendering, for example, to calculate weights depending on a variable θ. The choice of the aperture angle θ is a trade-off between the pre Petition 870250089362, dated 10 / 01 / 2025, page 42 / 121 35 / 54 rendering splitting when the pose offset is small versus the ability to interpolate over a wider range of angles to compensate for larger offsets.

[00174] In other modalities, instead of transmitting θ, multiple poses, for which binaural signals are requested, may, for example, be transmitted. For example, when a user moves their head to the left, binaural signals may, for example, be requested for a current head position, and for a current head position extrapolated further to the left, and for a current head position extrapolated further to the left and upward.

[00175] To reduce the bit rate of the given concepts (for example, in case of reduced link capacity), the center signal in P' can, for example, be omitted. This has the positive side effect of avoiding the pre-rendering of a binaural signal, but should only be selected if the offsets are small.

[00176] However, as mentioned earlier, this method is not preferred due to the potential for spatial collapse of the signal.

[00177] If the value of θ is set to 0, only the single binaural signal at P' will be sent.

[00178] Similarly, if pre-rendering complexity is of secondary importance, the additional signals P'i, P'2,..., P''n can, for example, be generated on the 220-capable device. This would generally reduce panning error, as closer positions based on displacement would be available and, especially, would provide a benefit in a one-to-many scenario (where a 220-capable device serves many 210-capable light devices with the same content, but different head poses per light device, leading to large displacements that need to be compensated depending on each light device user's pose). The selection of signals can, for example, be done by Petition 870250089362, dated 10 / 01 / 2025, page 43 / 121 36 / 54 lightweight device 210, selecting the signals that are likely closest to the user's actual pose, or by another intermediate device between the pre-rendering-capable device and the lightweight device 210, where the intermediate device can, for example, conduct selective routing of the relevant pose offsets.

[00179] Some modes have very low complexity, can be applied in the time domain, may require the absence of transformation, for example, and such modes may be codec independent.

[00180] Indeed, no delay or very low delay can, for example, occur in such modes, and a high temporal resolution can, for example, be achieved. For example, the weighting can, for example, be calculated by sampling in the time domain.

[00181] Other modalities may, for example, be applied alternatively or additionally in a frequency domain.

[00182] Some methods may, for example, be able to compensate for any displacement, where a worst-case quality may, for example, be significantly better than according to the previous technique.

[00183] In some modes, incorrect spectral cues can, for example, be attenuated by filtering.

[00184] According to some modalities, adaptive displacement selection can, for example, be employed to reduce spatial image reduction.

[00185] In some modes, the reduction of the spatial image can, for example, be mitigated by transmitting additional signals in the horizontal plane.

[00186] Figure 15 illustrates the results of the first hearing test, indicating means and 95% confidence intervals for Petition 870250089362, dated 10 / 01 / 2025, p. 44 / 121 37 / 54 twelve items.

[00187] In other embodiments, one or more of the following implementations are provided:

[00188] According to one embodiment, an audio processor is configured to generate a binaural signal, wherein the device is configured to generate the binaural signal by means of a weighted mixture of two or more binaural signals, wherein the two or more binaural signals comprise a spatial scene in different rotations (e.g., same scene, different head pose applied during rendering).

[00189] In one embodiment, the mix weights can, for example, be derived depending on the actual rotational displacement of the binaural signals to be mixed.

[00190] According to one embodiment, a channel change of a binaural signal is used as an approximation of a 180° scene rotation.

[00191] In one embodiment, the associated relative rotational displacement k1...kN can, for example, be variably defined by means of a posterior channel.

[00192] Depending on the modality, the associated rotation angle θ or multiple requested poses may, for example, be defined depending on the current rotational displacement ΔΡ.

[00193] In one embodiment, the associated rotation angle used in pre-rendering can, for example, be provided as part of the information received, for example, by a lightweight device.

[00194] According to one embodiment, a prerendering device can, for example, create a pair of binaural signals for different associated relative rotational displacements k1...kN.

[00195] In one embodiment, the different relative rotational displacements associated with k1...kN can be applied and can, therefore Petition 870250089362, dated 10 / 01 / 2025, page 45 / 121 38 / 54 example, to be incorporated as described above.

[00196] Depending on the modality, an adaptive selection of channels may, for example, be dictated by the lightweight device.

[00197] In one modality, adaptive selection can, for example, be based on the current rotational displacement ΔP.

[00198] According to one embodiment, a mapping of the actual rotational displacement ΔP to the coordinate system of the transmitted binaural signals can, for example, be conducted.

[00199] In one modality, the mapping can, for example, be used with an amplitude or ambisonic panning scheme.

[00200] According to one embodiment, a system for audio rendering is provided, comprising a capable device and a lightweight device, for example, wherein delayed head poses can, for example, be compensated by the transmission of at least two binaural signals corresponding to different associated relative rotational displacements k1...kN, for example, wherein the capable device can, for example, perform pre-rendering, wherein the lightweight device performs pose correction, for example, wherein the transmitted binaural audio signals can, for example, be compressed using an audio encoder and an audio decoder.

[00201] According to one embodiment, the processing can, for example, be performed in a time domain.

[00202] In one embodiment, the processing can, for example, be performed on a filter bank or similar frequency domain.

[00203] According to one embodiment, the encoded binaural signals can, for example, be transmitted in the form of a smaller number of transport channels plus metadata. The metadata can, for example, comprise information about the covariance or Petition 870250089362, dated 10 / 01 / 2025, page 46 / 121 39 / 54 correlation of binaural signals corresponding to different scene rotations.

[00204] In one embodiment, binaural signals can, for example, be generated in the lightweight device using transport audio channels and parametric or model-based HRTFs or acoustic parameters.

[00205] According to one embodiment, additional binaural signals can, for example, be estimated by modifying binaural cues, such as ILD and ITD, from the original binaural signals.

[00206] Other modalities are described below.

[00207] Figure 17 illustrates a system comprising a device 1720 for generating signal prediction information according to a mode, and a device 1710 for generating one or more additional binaural signals from a first binaural signal.

[00208] According to one embodiment, the 1720 device in Figure 17 is provided for generating signal prediction information.

[00209] The 1720 device is configured to receive pose information, for example, P'i...P'n, and / or rotational displacement information, for example, θ.

[00210] In addition, the 1720 device is configured to generate a first binaural signal for a first rotation of an audio scene, and

[00211] Furthermore, the 1720 device is configured to generate signal prediction information depending on pose information, for example, P'i...P'n, and / or rotational displacement information, for example, θ, so that one or more additional binaural signals for one or more additional rotations, being different from the first rotation, can be generated using the first binaural signal and using the signal prediction information.

[00212] According to one modality, the 1720 device can, Petition 870250089362, dated 10 / 01 / 2025, page 47 / 121 40 / 54 for example, be configured to transmit the first binaural signal or its encoding and the signal prediction information or its encoding to another 1710 device.

[00213] In one embodiment, apparatus 1720 can, for example, be configured to receive pose information P'i...P'n and / or rotational displacement information θ from another apparatus 1710.

[00214] According to one embodiment, the 1720 device can, for example, be configured to determine one or more absolute poses P'i...P'n depending on the pose information and / or depending on the rotational displacement information θ; and wherein the 1720 device can, for example, be configured to generate the signal prediction information by generating pose-specific signal prediction information for each of the one or more absolute poses P'i...P'n, so that each binaural signal of one or more additional binaural signals can, for example, be associated with an associated absolute pose P'i...P'n of the one or more absolute poses P'i...P'n and can be generated using the first binaural signal and using the pose-specific signal prediction information for said absolute pose. And / or, the 1720 device can, for example, be configured to determine one or more relative rotational displacements k1...kN depending on pose information and / or depending on rotational displacement information θ; and wherein the 1720 device can, for example, be configured to generate signal prediction information by generating specific rotational displacement signal prediction information for each one or more relative rotational displacements k1...kN, so that each binaural signal of one or more additional binaural signals can, for example, be associated with an associated relative rotational displacement k1...kN of one or more relative rotational displacements k1...kN and can be generated using the first binaural signal and using the specific signal prediction information. Petition 870250089362, dated 10 / 01 / 2025, page 48 / 121 41 / 54 cas of rotational displacement for the relative rotational displacement ki...kN.

[00215] According to one modality, one or more additional binaural signals that can be generated from the signal prediction information are two or more additional binaural signals.

[00216] The 1720 device can, for example, be configured to determine two or more absolute poses P'i...P'n depending on the pose information and / or depending on the rotational displacement information θ; and wherein the 1720 device can, for example, be configured to generate the signal prediction information when generating pose-specific signal prediction information for each of the two or more absolute poses P'i...P'n, so that each binaural signal of two or more additional binaural signals can, for example, be associated with an associated absolute pose P'i...P'n of the two or more absolute poses P'i...P'n and can be generated using the first binaural signal and using the pose-specific signal prediction information for said absolute pose. And / or, the 1720 device can, for example, be configured to determine two or more relative rotational displacements k1...kN depending on pose information and / or depending on rotational displacement information θ; and wherein the 1720 device can, for example, be configured to generate signal prediction information by generating rotational displacement-specific signal prediction information for each of two or more relative rotational displacements k1...kN, so that each binaural signal of two or more additional binaural signals can, for example, be associated with an associated relative rotational displacement k1...kN of two or more relative rotational displacements k1...kN and can be generated using the first binaural signal and using the rotational displacement-specific signal prediction information for the relative rotational displacement k1...kN. Petition 870250089362, dated 10 / 01 / 2025, page 49 / 121 42 / 54

[00217] In one mode, the first rotation and one or more additional rotations indicate different head poses of a head within the audio scene, such that the first binaural signal and one or more additional binaural signals are associated with the different head poses of the head.

[00218] According to one embodiment, the different head positions are defined with respect to one or more Euler angles. And / or, the different head positions are defined with respect to at least one of a yaw angle, a tilt angle, and a roll angle. And / or, the different head positions are defined with respect to a rotation matrix. And / or, the different head positions are defined with respect to one or more quaternions.

[00219] In one embodiment, the 1720 device may, for example, be configured to transmit information about the absolute pose P'i...P'n of one or more additional binaural signals and / or information about the associated relative rotational displacement k1...kN of one or more binaural signals, for example, to another 1710 device.

[00220] According to a modality, the absolute pose associated P'i...P'n, being associated with each of two or more binaural signals and / or being associated with prediction information, indicates the head pose being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions. And / or, the relative rotational displacement associated k1...kN, being associated with each of two or more binaural signals and / or being associated with prediction information, indicates a difference of a second head pose in relation to a first head pose, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions. Petition 870250089362, dated 10 / 01 / 2025, p. 50 / 121 43 / 54

[00221] In one embodiment, apparatus 1720 may, for example, be configured to conduct one or more transmissions to another apparatus 1710. The transmission comprises the first binaural signal being represented in a time domain, or the transmission comprises the first binaural signal being represented in a frequency domain, or the transmission comprises an encoding of the first binaural signal being represented in the time domain or in the frequency domain.

[00222] According to one embodiment, device 1720 and the other device 1710 are connected by means of a link with a delay.

[00223] In one embodiment, device 1720 can, for example, be configured to receive a rotational displacement parameter θ as rotational displacement information θ from the other device 1710.

[00224] According to one embodiment, the rotational offset parameter θ depends on a current rotational offset ΔP and / or depends on a link latency.

[00225] In one embodiment, the 1720 device can, for example, be configured to receive or (for example, dynamically) determine information about the transmission link latency. The 1720 device can, for example, be configured to perform pose prediction depending on the link latency.

[00226] According to one embodiment, device 1720 can, for example, be configured to receive a current rotational displacement ΔΡ and / or one or more poses P'i...P'n and / or upstream metadata from the other device 1710. Device 1720 can, for example, be configured to determine the rotational displacement parameter θ using the current rotational displacement ΔΡ and / or using one or more poses P'i...P'n and / or using upstream metadata.

[00227] In one modality, the 1720 apparatus can, for example, Petition 870250089362, dated 10 / 01 / 2025, page 51 / 121 44 / 54 be configured to transmit a rotational displacement parameter θ as rotational displacement information θ to the other device 1710.

[00228] In another embodiment, the 1710 apparatus of figure 17 is provided for generating one or more additional binaural signals from a first binaural signal using signal prediction information.

[00229] Device 1710 is configured to receive the first binaural signal for a first rotation of an audio scene.

[00230] In addition, the 1710 device is configured to receive signal prediction information that depends on pose information, for example, P'i...P'n, and / or that depends on rotational displacement information, for example, θ.

[00231] In addition, the 1710 device is configured to generate one or more additional binaural signals for one or more additional rotations, differing from the first rotation using the first binaural signal and using the signal prediction information.

[00232] According to one embodiment, the 1710 device can, for example, be configured to receive the first binaural signal or its encoding and the signal prediction information or its encoding from another 1720 device.

[00233] In one embodiment, device 1710 can, for example, be configured to transmit pose information and / or rotational displacement θ information to the other device 1720.

[00234] According to a modality, one or more absolute poses P'i...P'n depend on pose information and / or depend on rotational displacement information θ; and the signal prediction information depends on specific pose prediction information for each one or more absolute poses P'i...P'n, so that each binaural signal of one or more additional binaural signals can, for example, be associated with an associated absolute pose. Petition 870250089362, dated 10 / 01 / 2025, p. 52 / 121 45 / 54 P'i...P'n of one or more absolute poses P'i...P'n, wherein the 1710 device may, for example, be configured to generate said binaural signal using the first binaural signal and using the pose-specific signal prediction information for said absolute pose. And / or, one or more relative rotational displacements k1...kN depend on the pose information and / or depend on the rotational displacement information θ, and the signal prediction information depends on rotational displacement-specific signal prediction information for each one or more relative rotational displacements k1...kN, so that each binaural signal of one or more additional binaural signals may, for example, be associated with an associated relative rotational displacement k1...kN of one or more relative rotational displacements k1...kN, wherein the 1710 device may, for example, be configured to generate said binaural signal using the first binaural signal and using the specific signal prediction information of the rotational displacement for said relative rotational displacement k1...kN.

[00235] In one embodiment, the 1710 device may, for example, be configured to generate two or more additional binaural signals as one or more additional binaural signals. Two or more absolute poses P'i...P'n depend on the pose information and / or depend on the rotational displacement information θ; and the signal prediction information depends on specific signal prediction information for each of the two or more absolute poses P'i...P'n, so that each binaural signal of two or more additional binaural signals may, for example, be associated with an associated absolute pose P'i...P'n of the two or more absolute poses P'i...P'n, where the 1710 device can, for example, be configured to generate said binaural signal using the first binaural signal and using the specific pose-based signal prediction information for said absolute pose. And / or two or more relative rotational displacements k1...kN of. Petition 870250089362, dated 10 / 01 / 2025, page 53 / 121 46 / 54 depend on pose information and / or depend on rotational displacement information θ; and the signal prediction information depends on specific rotational displacement signal prediction information for each of two or more relative rotational displacements k1...kN, so that each binaural signal of two or more additional binaural signals can, for example, be associated with an associated relative rotational displacement k1...kN of two or more relative rotational displacements k1...kN, wherein the device 1710 can, for example, be configured to generate said binaural signal using the first binaural signal and using the specific rotational displacement signal prediction information for said relative rotational displacement k1...kN.

[00236] In another embodiment, the 1710 device can, for example, be configured to generate two or more additional binaural signals as one or more additional binaural signals.

[00237] Two or more absolute poses P'i...P'n depend on pose information and / or depend on rotational displacement information θ; and the signal prediction information depends on pose-specific signal prediction information for each of the two or more absolute poses P'i...P'n, such that each binaural signal of two or more additional binaural signals is associated with an associated absolute pose P'i...P'n of the two or more absolute poses P'i...P'n. The 1710 device can, for example, be configured to generate a binaural signal for another absolute pose, for example, for the current pose P, by interpolating or extrapolating the pose-specific signal prediction information for at least two of the two or more absolute poses P'i...P'n depends on the other absolute pose to obtain specific interpolated or extrapolated pose signal prediction information, and when generating the binaural signal for the other absolute pose, it uses the first binaural signal and the prediction information. Petition 870250089362, dated 10 / 01 / 2025, page 54 / 121 47 / 54 specific sign of pose interpolated or extrapolated.

[00238] And / or, two or more relative rotational displacements k1...kN depend on pose information and / or depend on rotational displacement information θ; and the signal prediction information depends on specific rotational displacement signal prediction information for each of two or more relative rotational displacements k1...kN, such that each binaural signal of two or more additional binaural signals is associated with an associated relative rotational displacement k1...kN, of two or more relative rotational displacements k1...kN, wherein the 1710 device can, for example, be configured to generate a binaural signal for another relative rotational displacement by interpolating or extrapolating the specific rotational displacement signal prediction information for at least two of two or more relative rotational displacements k1...kNkN depending on the other relative rotational displacement to obtain specific rotational displacement signal prediction information interpolated or extrapolated, and when generating the binaural signal for the other relative rotational displacement, for example, for a current relative rotational displacement, using the first binaural signal and using the specific rotational displacement signal prediction information interpolated or extrapolated.

[00239] According to one embodiment, the pose-specific signal prediction information for each absolute pose of one or more absolute poses P'i...P'n may, for example, be a pose-specific prediction matrix for said absolute pose, wherein the 1710 device may, for example, be configured to generate the binaural signal associated with said absolute pose P'i...P'n by applying the pose-specific prediction matrix to the first binaural signal.

[00240] And / or, the specific signal prediction information for a pose interpolated or extrapolated to the other absolute pose may, Petition 870250089362, dated 10 / 01 / 2025, page 55 / 121 48 / 54, for example, could be a pose-specific prediction matrix for the other absolute pose, where the 1710 device could, for example, be configured to generate the binaural signal associated with the other absolute pose by applying the pose-specific prediction matrix to the first binaural signal.

[00241] Or, the specific signal prediction information for each relative rotational displacement k1...kN of one or more relative rotational displacements k1...kN may, for example, be a specific displacement prediction matrix for the relative rotational displacement k1...kN, wherein the 1710 device may, for example, be configured to generate the binaural signal associated with the relative rotational displacement k1...kN by applying the specific displacement prediction matrix to the first binaural signal.

[00242] Or, the specific rotational displacement signal prediction information interpolated or extrapolated to the other relative rotational displacement may, for example, be a specific displacement prediction matrix for the other relative rotational displacement, where the 1710 device may, for example, be configured to generate the binaural signal being associated with the other relative rotational displacement by applying the specific displacement prediction matrix to the first binaural signal.

[00243] In one embodiment, the specific pose prediction matrix for said absolute pose P'i...P'n may, for example, be a 2 x 2 matrix, wherein the 1710 device may, for example, be configured to apply the specific pose prediction matrix to a first channel and a second channel of the first binaural signal to generate a first channel and a second channel of the binaural signal associated with said absolute pose P'i...P'n. And / or, the specific displacement prediction matrix for said relative rotational displacement k1...kN may, for example, be a 2 x 2 matrix, wherein the 1710 device po Petition 870250089362, dated 10 / 01 / 2025, page 56 / 121 49 / 54, for example, can be configured to apply the specific displacement prediction matrix to a first channel and a second channel of the first binaural signal to generate a first channel and a second channel of the binaural signal associated with said relative rotational displacement k1...kN.

[00244] According to one modality, the first rotation and one or more additional rotations indicate different head poses of a head within the audio scene, such that the first binaural signal and one or more additional binaural signals are associated with the different head poses of the head.

[00245] In one embodiment, the different head positions are defined with respect to one or more Euler angles. And / or, the different head positions are defined with respect to at least one of a yaw angle, a tilt angle, and a roll angle. And / or, the different head positions are defined with respect to a rotation matrix. And / or, the different head positions are defined with respect to one or more quaternions.

[00246] According to one embodiment, the 1710 device can, for example, be configured to receive information about the absolute pose P'i...P'n of one or more additional binaural signals and / or information about the associated relative rotational displacement k1...kN of one or more binaural signals, for example, from another 1720 device.

[00247] In one modality, the absolute pose associated P'i...P'n, being associated with each of two or more binaural signals and / or associated with prediction information, indicates the head pose, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions. And / or, the relative rotational displacement associated k1...kN, being associated with each of two or more binaural signals and / or associated with prediction information. Petition 870250089362, dated 10 / 01 / 2025, p. 57 / 121 50 / 54 prediction indicates a difference between a second head pose and a first head pose, defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the roll angle and / or the rotation matrix and / or one or more quaternions.

[00248] According to one embodiment, device 1710 can, for example, be configured to receive one or more transmissions from another device 1720. The transmission comprises the first binaural signal being represented in a time domain, or the transmission comprises the first binaural signal being represented in a frequency domain, or the transmission comprises an encoding of the first binaural signal being represented in the time domain or in the frequency domain.

[00249] In one embodiment, device 1710 and the other device 1720 are connected by means of a link with a delay.

[00250] According to one embodiment, device 1710 can, for example, be configured to transmit a rotational displacement parameter θ as rotational displacement information θ to the other device 1720.

[00251] In one embodiment, the rotational offset parameter θ depends on a current rotational offset ΔP and / or depends on a link latency.

[00252] In general, as described above, according to a specific modality, if the link latency is greater, normally θ will be defined as greater, because due to the greater / greater latency, it can be expected that, during the transmission latency, a greater displacement of movement / rotation will occur, for example, of a head, compared to a situation where the latency is lower.

[00253] According to one embodiment, the 1710 apparatus may, for example, be configured to transmit or (for example, dynamite) Petition 870250089362, dated 10 / 01 / 2025, page 58 / 121 51 / 54 (commente) determine information about a transmission link latency.

[00254] In one embodiment, the 1710 device can, for example, be configured to receive or (for example, dynamically) determine information about the transmission link latency. The 1710 device can, for example, be configured to perform pose prediction depending on the link latency.

[00255] In one embodiment, device 1710 can, for example, be configured to transmit a current rotational displacement ΔΡ and / or one or more poses P'i...P'n and / or upstream metadata to determine the rotational displacement parameter θ to the other device 1720.

[00256] According to one embodiment, device 1710 can, for example, be configured to receive a rotational displacement parameter θ as rotational displacement information θ from the other device 1720.

[00257] In an additional embodiment, a system comprising apparatus 1710 and apparatus 1720 is provided.

[00258] Although some aspects have been described in the context of an apparatus, it is evident that these aspects also represent a description of the corresponding method, where a block or device corresponds to a step of the method or to a feature of a step of the method. Analogously, the aspects described in the context of a step of the method also represent a description of a corresponding block, item, or feature of a corresponding apparatus. Some or all of the steps of the method may be performed by (or using) a hardware apparatus, such as, for example, a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, one or more of the most important steps of the method may be performed by such an apparatus. Petition 870250089362, dated 10 / 01 / 2025, page 59 / 121 52 / 54

[00259] Depending on certain implementation requirements, embodiments of the invention may be implemented in hardware or software, or at least partially in hardware or at least partially in software. Implementation may be carried out using a digital storage medium, for example, a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, containing electronically stored readable control signals, which cooperate (or are capable of cooperating) with a programmable computer system, so that the respective method is executed. Therefore, the digital storage medium may be computer-readable.

[00260] Some embodiments of the invention comprise a data carrier with electronically readable control signals, which are capable of cooperating with a programmable computer system, so that one of the methods described herein is carried out.

[00261] In general, embodiments of the present invention can be implemented as a computer program product with program code, the program code being operational to perform one of the methods when the computer program product is run on a computer. The program code can, for example, be stored on a machine-readable medium.

[00262] Other embodiments include the computer program for performing one of the methods described herein, stored on a machine-readable medium.

[00263] In other words, an embodiment of the invention's method is therefore a computer program that has program code to perform one of the methods described herein, when the computer program is run on a computer. Petition 870250089362, dated 10 / 01 / 2025, pp. 60 / 121 53 / 54

[00264] Another embodiment of the invention's methods is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the computer program for carrying out one of the methods described herein. The data carrier, the digital storage medium or the recorded medium are typically tangible and / or non-transitory.

[00265] Another embodiment of the invention's method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or sequence of signals may, for example, be configured to be transferred via a data communication connection, for example, via the Internet.

[00266] Another embodiment comprises a means of processing, for example, a computer or a programmable logic device, configured or adapted to perform one of the methods described herein.

[00267] Another embodiment comprises a computer that has installed on it the computer program to perform one of the methods described herein.

[00268] Another embodiment of the invention comprises an apparatus or system configured to transfer (e.g., electronically or optically) a computer program to perform one of the methods described herein to a receiver. The receiver may, for example, be a computer, a mobile device, a memory device, or the like. The apparatus or system may, for example, comprise a file server for transferring the computer program to the receiver.

[00269] In some embodiments, a programmable logic device (for example, a field-programmable gate array) can be used to perform some or all of the functions of the mé Petition 870250089362, dated 10 / 01 / 2025, page 61 / 121 54 / 54 all described herein. In some embodiments, an array of field-programmable gates may cooperate with a microprocessor to perform one of the methods described herein. Generally, the methods are preferably performed by any hardware device.

[00270] The apparatus described herein may be implemented using a hardware device, or using a computer, or using a combination of a hardware device and a computer.

[00271] The methods described here can be performed using a hardware device, or using a computer, or using a combination of a hardware device and a computer.

[00272] The embodiments described above are merely illustrative of the principles of the present invention. It is understood that modifications and variations of the arrangements and details described herein will be evident to others skilled in the art. Therefore, the intention is to limit oneself only to the scope of the pending patent claims and not to the specific details presented by way of description and explanation of the embodiments described herein.

Claims

1. Apparatus (210) for processing two or more binaural first signals, characterized in that the apparatus (210) comprises: an audio processor (815) configured to conduct a weighted mixture of two or more binaural first signals to obtain a combined binaural signal, wherein the two or more binaural first signals are two or more binaural audio signals for different rotations of the same audio scene.

2. Device (210), according to claim 1, characterized in that the different rotations indicate different head poses of a head within the audio scene, such that the first two or more binaural signals are associated with the different head poses of the head.

3. Apparatus (210), according to claim 2, characterized in that the different head poses are defined in relation to one or more Euler angles and / or in that the different head poses of the head are defined in relation to at least one yaw angle, one tilt angle and one rotation angle, and / or in that the different head poses of the head are defined in relation to a rotation matrix and / or in that the different head poses of the head are defined in relation to one or more quaternions.

4. Apparatus (210), according to any of the preceding claims, characterized in that each of two or more first binaural signals is associated with an associated absolute pose (P'i...P'n) being different from the associated absolute pose (P'i...P'n) of any other two or more first binaural signals, Petition 870250089362, 10 / 01 / 2025, p. 63 / 121 2 / 28 and / or where each of two or more first binaural signals is associated with an associated relative rotational displacement (ki...kN) being different from the associated relative rotational displacement (k1...kN) of any other two or more first binaural signals.

5. Apparatus (210), according to claim 4, characterized in that the apparatus (210) is configured to receive information about the associated absolute pose (P'i...P'n) of the first two or more binaural signals and / or information about the associated relative rotational displacement (k1...kN) of the first two or more binaural signals, for example, from another apparatus (220).

6. Apparatus (210), according to claim 4 or 5, depending further on claim 3, characterized in that the associated absolute pose (P'i...P'n) associated with each of the first two or more binaural signals indicates the head pose of the head, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions; and / or where the associated relative rotational displacement (k1...kN) associated with each of the first two or more binaural signals indicates a difference of a second head pose of the head in relation to a first head pose of the head, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions.

7. Apparatus (210), according to any one of claims 4 to 6, characterized in that the audio processor (815) is configured to conduct weighted mixing depending on Petition 870250089362, dated 10 / 01 / 2025, page. 64 / 121 3 / 28 of one or more weights (gi...gN), wherein the audio processor (815) is configured to determine one or more weights (g1...gN) depending on the associated absolute pose (P'i...P'n) or the associated relative rotational displacement (k1...kN) being associated with each of the first two or more binaural signals, and depending on a current rotational displacement (ΔΡ) between a current pose (P) and a previous pose (P'), wherein the current rotational displacement (ΔΡ) indicates at least one difference between the current rotation angle and the previous rotation angle with respect to a rotation axis (for example, with respect to the yaw axis or the pitch axis or a rotation axis of claim 2).

8. Apparatus (210), according to claim 7, characterized in that the audio processor (815) is configured to determine one or more weights (g1...gN) determining a weight (g1...gN) for each binaural signal of the first two or more binaural signals, such that the weight for the binaural signal depends on a difference between the actual rotational displacement (ΔΡ) and the associated relative rotational displacement (k1...kN) being associated with the binaural signal.

9. Apparatus (210), according to claim 7 or 8, characterized in that the audio processor (815) is configured to receive three or more binaural input signals, each of which is associated with an associated absolute pose (P'1...P'N) or an associated relative rotational displacement (k1...kN), and wherein, to obtain the first two or more binaural audio signals, the audio processor (815) is configured to select at least two binaural signals selected from the three or more binaural input signals depending on the current rotational displacement (ΔP) and depending on the associated absolute pose (P'i...P'n) or the associated relative rotational displacement (ki...kN) of each of the three or more binaural input signals.

10. Apparatus (210), according to claim 9, characterized in that the audio signal processor (815) is configured to determine whether to swap the two audio channels of a binaural signal of at least two selected binaural signals with each other, depending on the current rotational offset (ΔΡ) and depending on the associated absolute pose (P'i...P'n), the associated relative rotational offset (k1...kN) being associated with the binaural signal, and wherein the audio signal processor (815) is configured, if it has been determined that the two audio channels should be swapped, the audio signal processor (815) is configured to swap the two audio channels of the binaural signal with each other to obtain one of the first two or more binaural signals.

11. Apparatus (210), according to claim 7 or 8, characterized in that a first signal processor and a second signal processor together form the audio signal processor (815), wherein the first signal processor is configured to receive a first channel from three or more binaural input signals, each of which is associated with an associated absolute pose (P'i...P'n) or an associated relative rotational displacement (k1...kN), and wherein, to obtain a first channel from each of the two or more first binaural audio signals, the first signal processor is configured to select at least two selected binaural signals from the three or more binaural input signals depending on the current rotational displacement (ΔP) and depending on the associated absolute pose (P'i...P'n) or the associated relative rotational displacement (k1...kN) of each of the three or more binaural input signals; in Petition 870250089362, dated 10 / 01 / 2025, page.66 / 121 5 / 28 wherein the first signal processor is configured to conduct a weighted mix of the first channel of each of two or more first binaural signals to obtain a first channel of the combined binaural signal; wherein, to obtain a second channel of each of the two or more first binaural audio signals, the second signal processor is configured to select at least two binaural signals selected from the three or more binaural input signals depending on the current rotational offset (ΔΡ) and depending on the associated absolute pose (P'i...P'n) or the associated relative rotational offset (k1...kN) of each of the three or more binaural input signals; wherein the second signal processor is configured to conduct a weighted mix of the second channel of each of two or more first binaural signals to obtain a second channel of the combined binaural signal.

12. Apparatus (210), according to claim 11, characterized in that the first signal processor and the second signal processor are spaced apart from each other.

13. Apparatus (210), according to claim 12, characterized in that the apparatus (210) comprises a pair of two earphones, wherein the first signal processor is implemented in the first of the two earphones, and wherein the second signal processor is implemented in the second of the two earphones.

14. Apparatus (210), according to any of the preceding claims, characterized in that the apparatus (210) is configured to obtain two or more binaural input signals from one or more transmissions of another apparatus (220).

15. Apparatus (210), according to claim 14, ca Petition 870250089362, dated 10 / 01 / 2025, page 67 / 121 6 / 28 characterized in that the transmission comprises two or more binaural input signals represented in a time domain, or in that the transmission comprises two or more binaural input signals represented in a frequency domain, or in that the transmission comprises an encoding of the two or more binaural input signals being represented in the time domain or in the frequency domain.

16. Apparatus (210), according to claim 14 or 15, characterized in that the apparatus (210) and the other apparatus (220) are connected by means of a link with a delay.

17. Apparatus (210), according to any one of claims 14 to 16, further depending on any one of claims 7 to 13, characterized in that at least one of the two or more binaural input signals depends on a rotational displacement parameter (θ) and is associated with an associated absolute pose (P'i...P'n) or an associated relative rotational displacement (k1...kN), which depends on the rotational displacement parameter (θ), wherein each of the first two or more binaural signals corresponds to one of the two or more binaural input signals or is derived from one of the two or more binaural input signals.

18. Apparatus (210), according to claim 17, characterized in that the apparatus (210) is configured to transmit the rotational displacement parameter (θ) to another apparatus (220), and in that the apparatus (210) is configured to receive the transmission from the other apparatus (220) comprising two or more binaural input signals or an encoding thereof.

19. Device (210), according to claim 18, characterized in that the device (210) is configured to determine the rotational offset parameter (θ) depending on the current rotational offset (ΔΡ); and / or in that the device (210) is configured to determine the rotational offset parameter (θ) depending on a link latency.

20. Apparatus (210), according to any one of claims 14 to 19, characterized in that the apparatus (210) is configured to receive or (for example, dynamically) determine information about the link latency of the transmission, wherein the apparatus (210) is configured to perform pose prediction depending on the link latency.

21. Apparatus (210), according to claim 17, characterized in that the apparatus (210) is configured to transmit the current rotational displacement (ΔΡ) and / or one or more poses (Pi...Pn) and / or metadata upstream to another apparatus (220).

22. Apparatus (210), according to claim 17, characterized in that the apparatus (210) is configured to receive the transmission from the other apparatus (220) comprising two or more binaural input signals or an encoding thereof, wherein the apparatus (210) is configured to receive the rotational displacement parameter (θ) from the other apparatus (220), and wherein the apparatus (210) is configured to determine the first two or more binaural signals from the two or more binaural input signals depending on the current rotational displacement (ΔΡ); or is configured to determine one or more weights (g1...gN) depending on the current rotational displacement (ΔΡ).

23. Apparatus (210), according to claim 22, characterized in that the apparatus (210) is configured to determine the first two or more binaural signals from the two or more binaural input signals or is configured to determine one or more weights (gi...gN) when using a linear pan or when using a tangent pan or when using a Vector Base Amplitude Pan or when using an Edge Fade Amplitude Pan or when using an ambisonic pan or quaternion-based pan.

24. Apparatus (210), according to any one of the preceding claims, further depending on any one of claims 14 to 23, characterized in that the apparatus (210) is configured to receive the transmission from the other apparatus (220) comprising a number of one or more transmitted binaural signals or an encoding thereof and metadata, the number being less than the number of the two or more binaural input signals, and in that the apparatus (210) is configured to obtain the two or more binaural input signals from the transmission by reconstructing the two or more binaural input signals from the one or more transmitted binaural signals using the metadata.

25. Apparatus (210), according to any one of the preceding claims, further depending on any one of claims 14 to 23, characterized in that the transmission comprises one or more parametric or model-based transfer functions related to the head and / or acoustic parameters, or an encoding thereof, and wherein the apparatus (210) is configured to obtain the two or more binaural input signals using one or more head-related transfer functions based on parametric models and / or acoustic parameters.

26. Apparatus (210), according to any of the preceding claims, characterized in that the audio processor (815) is configured to obtain one or more additional binaural signals from the two or more binaural input signals, by modifying the binaural tracks of at least one of the two or more binaural input signals, and wherein the audio processor (815) is configured to obtain the first two or more binaural signals from the two or more binaural input signals and one or more additional binaural signals.

27. Apparatus (210), according to any one of the preceding claims, further depending on claim 7, characterized in that the apparatus (210) comprises a pose displacement module (810) for determining the current rotational displacement (ΔΡ) between the current pose (P) and the previous pose (P'), wherein the current rotational displacement (ΔΡ) indicates at least one difference between the current rotation angle and the previous rotation angle with respect to an axis of rotation.

28. Apparatus (210), according to any of the preceding claims, characterized in that the audio processor (815) is configured to conduct weighted mixing of the first two or more binaural signals in a time domain, or in that the audio processor (815) is configured to conduct weighted mixing of the first two or more binaural signals in the frequency domain.

29. Device (220) for generating two or more binaural signals, characterized in that the device (220) is configured to generate the two or more binaural signals being two or more binaural audio signals for different rotations of the same audio scene.

30. Apparatus (220), according to claim 29, characterized in that the different rotations indicate different head poses of a head within the audio scene, so that the two or more binaural signals are associated with the different head poses of the head.

31. Apparatus (220), according to claim 30, characterized in that the different head poses of the head are defined in relation to one or more Euler angles and / or in that the different head poses of the head are defined in relation to at least one yaw angle, one tilt angle and one rotation angle, and / or in that the different head poses of the head are defined in relation to a rotation matrix and / or in that the different head poses of the head are defined in relation to one or more quaternions.

32. Apparatus (220), according to any one of claims 29 to 31, characterized in that each of the two or more binaural signals is associated with an associated absolute pose (P'i...P'n) being different from the associated absolute pose (P'i...P'n) of any other of the two or more binaural signals, and / or in that each of the two or more binaural signals is associated with an associated relative rotational displacement (k1...kN) being different from the associated relative rotational displacement (k1...kN) of any other of the two or more binaural signals.

33. Apparatus (220), according to claim 32, characterized in that the apparatus (220) is configured to transmit information about the associated absolute pose (P'1...P'N) of two or more binaural signals and / or information about the associated relative rotational displacement (k1...kN) of two or more binaural signals, for example, to another apparatus (210).

34. Apparatus (220), according to claim 32 or 33, depending further on claim 31, characterized in that the associated absolute pose (P'i...P'n) being associated with each of the two or more binaural signals, indicates the head pose of the head, Petition 870250089362, dated 10 / 01 / 2025, p. 72 / 121 11 / 28 being defined depending on one or more Euler angles and / or yaw angle and / or tilt angle and / or rotation angle and / or rotation matrix and / or one or more quaternions; and / or where the associated relative rotational displacement (k1...kN) associated with each of the two or more binaural signals indicates a difference of a second head pose from the head in relation to a first head pose, being defined depending on one or more Euler angles and / or yaw angle and / or tilt angle and / or rotation angle and / or rotation matrix and / or one or more quaternions.

35. Apparatus (220), according to any one of claims 29 to 34, characterized in that the apparatus (220) is configured to conduct one or more transmissions to transmit the two or more binaural signals to another apparatus (210).

36. Apparatus (220), according to claim 35, characterized in that the transmission comprises the two or more binaural input signals represented in a time domain, or in that the transmission comprises the two or more binaural input signals represented in a frequency domain, or in that the transmission comprises an encoding of the two or more binaural input signals being represented in the time domain or in the frequency domain.

37. Apparatus (220), according to claim 35 or 36, characterized in that the apparatus (220) and the other apparatus (210) are connected by means of a link with a delay.

38. Apparatus (220), according to any one of claims 29 to 37, also depending on claim 32, characterized in that at least one of the two or more binaural signals depends on a rotational displacement parameter (θ) and is associated with an associated absolute pose (P'i...P'n) or a relative rotational displacement (k1...kN), which depends on the rotational displacement parameter (Θ).

39. Apparatus (220), according to claim 38, characterized in that the apparatus (220) is configured to receive the rotational displacement parameter (θ) from another apparatus (210), and in that the apparatus (220) is configured to transmit two or more binaural signals or an encoding thereof to the other apparatus (210).

40. Apparatus (220), according to claim 39, characterized in that the rotational displacement parameter (Θ) depends on an actual rotational displacement (ΔΡ).

41. Apparatus (220), according to any one of claims 35 to 40, characterized in that the apparatus (220) is configured to receive or (for example, dynamically) determine information about the transmission link latency, wherein the apparatus (220) is configured to perform pose prediction depending on the link latency.

42. Apparatus (220), according to claim 38, characterized in that the apparatus (220) is configured to receive a current rotational displacement (ΔΡ) and / or one or more poses (P'i...P'n) and / or upstream metadata from another apparatus (210), and wherein the apparatus (220) is configured to determine the rotational displacement parameter (θ) using the current rotational displacement (ΔΡ) and / or using one or more poses (P'i...P'n) and / or using upstream metadata.

43. Apparatus (220), according to claim 38, characterized in that the apparatus (220) is configured to transmit two or more binaural signals or an encoding thereof to the other apparatus (210), and in that the apparatus (220) is configured to transmit the rotational displacement parameter (θ) to the other apparatus (210).

44. Apparatus (220), according to any one of claims 29 to 43, further depending on any one of claims 35 to 37, characterized in that the apparatus (220) is configured to transmit a number of one or more binaural transmission signals or an encoding thereof and metadata, the number being less than the number of the two or more binaural signals.

45. Apparatus (220), according to any one of claims 29 to 44, further depending on any one of claims 35 to 37, characterized in that the apparatus (220) is configured to transmit one or more head-related parametric or model-based transfer functions and / or acoustic parameters, or an encoding thereof.

46. ​​System, characterized in that it comprises one or more apparatuses (210), as defined in any one of claims 1 to 28, and the apparatus (220), as defined in any one of claims 29 to 45.

47. A method for processing two or more binaural first signals, characterized in that the method comprises: conducting a weighted mixture of the two or more binaural first signals to obtain a combined binaural signal, wherein the two or more binaural first signals are two or more binaural audio signals for different rotations of the same audio scene.

48. Method for generating two or more binaural signals, characterized in that the method comprises generating the two or more binaural signals being two or more binaural audio signals for different rotations of the same audio scene.

49. Computer program, characterized in that it is for implementing the method as defined in claim 47 or 48 when it is being executed on a computer or signal processor.

50. Apparatus (1720) for generating signal prediction information, characterized in that the apparatus (1720) is configured to receive pose information and / or rotational displacement information (θ), wherein the apparatus (1720) is configured to generate a first binaural signal for a first rotation of an audio scene, and wherein the apparatus (1720) is configured to generate the signal prediction information depending on the pose information (P'i...P'n) and / or the rotational displacement information (θ), such that one or more additional binaural signals for one or more additional rotations, being different from the first rotation, can be generated using the first binaural signal and using the signal prediction information.

51. Apparatus (1720), according to claim 50, characterized in that the apparatus (1720) is configured to transmit the first binaural signal or its encoding and the signal prediction information or its encoding to another apparatus (1710).

52. Apparatus (1720), according to claim 51, characterized in that the apparatus (1720) is configured to receive pose information (P'i...P'n) and / or rotational displacement information (θ) from another apparatus (1710).

53. Apparatus (1720), according to any one of claims 50 to 52, characterized in that the apparatus (1720) is configured to determine one or more absolute poses (P'i...P'n) Petition 870250089362, dated 10 / 01 / 2025, page 76 / 121 15 / 28 depending on pose information and / or depending on rotational displacement information (θ); and wherein the device (1720) is configured to generate signal prediction information by generating pose-specific signal prediction information for each of one or more absolute poses (P'i...P'n), such that each binaural signal of one or more additional binaural signals is associated with an associated absolute pose (P'i...P'n) of one or more absolute poses (P'i...P'n) and can be generated using the first binaural signal and using the pose-specific signal prediction information for said absolute pose; and / or wherein the device (1720) is configured to determine one or more relative rotational displacements (k1...kN) depending on pose information and / or depending on rotational displacement information (θ); and wherein the device (1720) is configured to generate signal prediction information by generating rotational displacement-specific signal prediction information for each of the one or more relative rotational displacements (k1...kN), such that each binaural signal of the one or more additional binaural signals is associated with an associated relative rotational displacement (k1...kN) of the one or more relative rotational displacements (k1...kN) and can be generated using the first binaural signal and using the rotational displacement-specific signal prediction information for said relative rotational displacement (k1...kN).

54. Apparatus (1720), according to any one of claims 50 to 53, characterized in that the one or more additional binaural signals that can be generated from the signal prediction information are two or more additional binaural signals; wherein the apparatus (1720) is configured to determine two or more absolute poses (P'i...P'n) depending on the pose information and / or depending on the rotational displacement information (θ); and wherein the device (1720) is configured to generate signal prediction information by generating pose-specific signal prediction information for each of the two or more absolute poses (P'i...P'n), such that each binaural signal of the two or more additional binaural signals is associated with an associated absolute pose (P'i...P'n) of the two or more absolute poses (P'i...P'n) and can be generated using the first binaural signal and using the specific signal prediction information for the said absolute pose; and / or wherein the device (1720) is configured to determine two or more relative rotational displacements (k1...kN) depending on the pose information and / or depending on the rotational displacement information (θ); and wherein the device (1720) is configured to generate the signal prediction information by generating specific rotational displacement signal prediction information for each of the two or more relative rotational displacements (k1...kN), such that each binaural signal of the two or more additional binaural signals is associated with an associated relative rotational displacement of the two or more relative rotational displacements (k1...kN).kN) and can be generated using the first binaural signal and using the specific signal prediction information of the rotational displacement for said relative rotational displacement (k1...kN).

55. Apparatus (1720), according to any one of claims 50 to 54, characterized in that the first rotation and one or more additional rotations indicate different head poses of a head within the audio scene, such that the first binaural signal and the one or more additional binaural signals are associated with the different head poses of the head.

56. Apparatus (1720), according to claim 55, characterized in that the different head poses of the head Petition 870250089362, 01 / 10 / 2025, p. 78 / 121 17 / 28 are defined in relation to one or more Euler angles and / or in that the different head poses of the head are defined in relation to at least one of a yaw angle, a tilt angle and a rotation angle, and / or in that the different head poses are defined in relation to a rotation matrix and / or in that the different head poses are defined in relation to one or more quaternions.

57. Apparatus (1720), according to any one of claims 50 to 56, depending further on claim 53 or 54, characterized in that the apparatus (1720) is configured to transmit information about the absolute pose (P'i...P'n) of one or more additional binaural signals and / or information about the associated relative rotational displacement (k1...kN) of one or more binaural signals, for example, to another apparatus (1710).

58. Apparatus (1720), according to claim 53 or 54 or 57, depending further on claim 56, characterized in that the associated absolute pose (P'i...P'n), being associated with each of two or more binaural signals and / or being associated with prediction information, indicates the head pose, being defined depending on one or more Euler angles and / or yaw angle and / or tilt angle and / or rotation angle and / or rotation matrix and / or one or more quaternions; and / or where the associated relative rotational displacement (k1...kN), being associated with each of the two or more binaural signals and / or being associated with the prediction information, indicates a difference of a second head pose from the head in relation to a first head pose from the head, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or Petition 870250089362, of 01 / 10 / 2025, page 79 / 121 18 / 28 one or more quaternions.

59. Apparatus (1720), according to any one of claims 50 to 58, depending further on claim 51, characterized in that the apparatus (1720) is configured to conduct one or more transmissions to the other apparatus (1710), wherein the transmission comprises the first binaural signal being represented in a time domain, or wherein the transmission comprises the first binaural signal being represented in a frequency domain, or wherein the transmission comprises an encoding of the first binaural signal being represented in the time domain or in the frequency domain.

60. Apparatus (1720), according to any one of claims 50 to 59, depending further on claim 51, characterized in that the apparatus (1720) and the other apparatus (1710) are connected by means of a link with a delay.

61. Apparatus (1720), according to any one of claims 50 to 60, depending further on claim 51, characterized in that the apparatus (1720) is configured to receive a rotational displacement parameter (θ) as the rotational displacement information (θ) from the other apparatus (1710).

62. Apparatus (1720), according to claim 61, characterized in that the rotational displacement parameter (θ) depends on a current rotational displacement (ΔΡ) and / or depends on a link latency.

63. Apparatus (1720), according to any one of claims 50 to 62, depending further on claim 51, characterized in that the apparatus (1720) is configured to receive or (for example, dynamically) determine information about the transmission link latency, Petition 870250089362, dated 10 / 01 / 2025, page 80 / 121 19 / 28 wherein the apparatus (1720) is configured to perform pose prediction depending on the link latency.

64. Apparatus (1720), according to any one of claims 50 to 63, depending further on claim 51, characterized in that the apparatus (1720) is configured to receive a current rotational displacement (ΔΡ) and / or one or more poses (P'i...P'n) and / or upstream metadata from the other apparatus (1710), and in that the apparatus (1720) is configured to determine the rotational displacement parameter (θ) using the current rotational displacement (ΔΡ) and / or using one or more poses (P'i...P'n) and / or using the upstream metadata.

65. Apparatus (1720), according to any one of claims 50 to 60, depending further on claim 51, characterized in that the apparatus (1720) is configured to transmit a rotational displacement parameter (θ) as rotational displacement information (θ) to the other apparatus (1710).

66. Apparatus (1710) for generating one or more additional binaural signals from a first binaural signal using signal prediction information, characterized in that the apparatus (1710) is configured to receive the first binaural signal for a first rotation of an audio scene, wherein the apparatus (1710) is configured to receive signal prediction information that depends on pose information (P'i...P'n) and / or that depends on rotational displacement information (θ), and wherein the apparatus (1710) is configured to generate one or more additional binaural signals for one or more additional rotations, different from the first rotation, using the first binaural signal and using the signal prediction information.

67. Apparatus (1710), according to claim 66, ca Petition 870250089362, of 01 / 10 / 2025, p. 81 / 121 20 / 28 characterized by the fact that the apparatus (1710) is configured to receive the first binaural signal or its encoding and the signal prediction information or its encoding from another apparatus (1720).

68. Apparatus (1710), according to claim 67, characterized in that the apparatus (1710) is configured to transmit pose information and / or rotational displacement (θ) information to the other apparatus (1720).

69. Apparatus (1710), according to any one of claims 66 to 68, characterized in that one or more absolute poses (P'i...P'n) depend on pose information and / or depend on rotational displacement information (θ); and the signal prediction information depends on pose-specific signal prediction information for each of the one or more absolute poses (P'i...P'n), such that each binaural signal of the one or more additional binaural signals is associated with an associated absolute pose (P'i...P'n) of the one or more absolute poses (P'i...P'n), wherein the apparatus (1710) is configured to generate said binaural signal using the first binaural signal and using the pose-specific signal prediction information for said absolute pose; and / or wherein one or more relative rotational displacements (k1...kN) depend on pose information and / or depend on rotational displacement information (θ); and the signal prediction information depends on specific rotational displacement signal prediction information for each of the one or more relative rotational displacements (k1...kN), such that each binaural signal of the one or more additional binaural signals is associated with an associated relative rotational displacement (k1...kN) of the one or more relative rotational displacements (k1...kN), wherein the device (1710) is configured to generate said binaural signal using the first binaural signal and using the specific rotational displacement signal prediction information for said relative rotational displacement (ki...kN).

70. Apparatus (1710), according to any one of claims 66 to 69, characterized in that the apparatus (1710) is configured to generate two or more additional binaural signals as one or more additional binaural signals; wherein two or more absolute poses (P'i...P'n) depend on pose information and / or depend on rotational displacement information (θ); and the signal prediction information depends on pose-specific signal prediction information for each of the two or more absolute poses (P'i...P'n), such that each binaural signal of the two or more additional binaural signals is associated with an associated absolute pose (P'i...P'n) of the one or more absolute poses (P'i...P'n), wherein the apparatus (1710) is configured to generate said binaural signal using the first binaural signal and using the pose-specific signal prediction information for said absolute pose; and / or in which two or more relative rotational displacements (k1...kN) depend on pose information and / or depend on rotational displacement (θ) information; and the signal prediction information depends on specific rotational displacement signal prediction information for each of the two or more relative rotational displacements (k1...kN), such that each binaural signal of the two or more additional binaural signals is associated with an associated relative rotational displacement (k1...kN) of the two or more relative rotational displacements (k1...kN), wherein the device (1710) is configured to generate said binaural signal using the first binaural signal and using the specific rotational displacement signal prediction information for said relative rotational displacement (k1...kN). Petition 870250089362, dated 10 / 01 / 2025, page 83 / 121 22 / 28.

71. Apparatus (1710), according to any one of claims 66 to 69, characterized in that the apparatus (1710) is configured to generate two or more additional binaural signals as one or more additional binaural signals; wherein two or more absolute poses (P'i...P'n) depend on pose information and / or depend on rotational displacement information (θ); and the signal prediction information depends on specific signal prediction information for each of the two or more absolute poses (P'i...P'n), such that each binaural signal of two or more additional binaural signals is associated with an associated absolute pose (P'i...P'n) of the two or more absolute poses (P'i...P'n), wherein the device (1710) is configured to generate a binaural signal for another absolute pose by interpolating or extrapolating the specific signal prediction information for at least two of the two or more absolute poses (P'i...P'n) depending on the other absolute pose to obtain interpolated or extrapolated pose-specific signal prediction information, and when generating the binaural signal for the other absolute pose using the first binaural signal and using the interpolated or extrapolated pose-specific signal prediction information; and / or wherein two or more relative rotational displacements (k1...kN) depend on the pose information and / or depend on the rotational displacement information (θ); and the signal prediction information depends on rotational displacement-specific signal prediction information for each of the two or more relative rotational displacements (k1...kN), such that each binaural signal of the two or more additional binaural signals is associated with an associated relative rotational displacement (k1...kN) of the two or more relative rotational displacements (k1...kN), wherein the device (1710) Petition 870250089362, dated 10 / 01 / 2025, page.84 / 121 23 / 28 is configured to generate a binaural signal for another relative rotational displacement by interpolating or extrapolating the rotational displacement-specific signal prediction information for at least two of the two or more relative rotational displacements (k1...kN) depending on the other relative rotational displacement to obtain interpolated or extrapolated rotational displacement-specific signal prediction information, and by generating the binaural signal for the other relative rotational displacement using the first binaural signal and using the interpolated or extrapolated rotational displacement-specific signal prediction information.

72. Apparatus (1710), according to any one of claims 69 to 71, characterized in that the pose-specific signal prediction information for each absolute pose of one or more absolute poses (P'i... P'n) is a pose-specific prediction matrix for said absolute pose, wherein the apparatus (1710) is configured to generate the binaural signal associated with said absolute pose (P'i... P'n) by applying the pose-specific prediction matrix to the first binaural signal; and / or wherein the interpolated or extrapolated pose-specific signal prediction information for the other absolute pose is a pose-specific prediction matrix for the other absolute pose, wherein the apparatus (1710) is configured to generate the binaural signal being associated with said other absolute pose by applying the pose-specific prediction matrix to the first binaural signal; and / or wherein the displacement-specific signal prediction information for each relative rotational displacement (k1...kN) of one or more relative rotational displacements (k1...kN) is a displacement-specific prediction matrix for said relative rotational displacement (k1...kN), wherein the device (1710) is configured to generate the binaural signal associated with said relative rotational displacement Petition 870250089362, of 01 / 10 / 2025, page 85 / 121 24 / 28 vo (k1...kN) when applying the displacement-specific prediction matrix to the first binaural signal and / or wherein the rotational displacement-specific signal prediction information interpolated or extrapolated to the other relative rotational displacement is a displacement-specific prediction matrix for the other relative rotational displacement, wherein the device (1710) is configured to generate the binaural signal associated with the other relative rotational displacement when applying the displacement-specific prediction matrix to the first binaural signal.

73. Apparatus (1710), according to claim 72, characterized in that the specific pose prediction matrix for said absolute pose (P'i...P'n) is a 2 x 2 matrix, wherein the apparatus (1710) is configured to apply the specific pose prediction matrix to a first channel and a second channel of the first binaural signal to generate a first channel and a second channel of the binaural signal associated with said absolute pose (P'i...P'n), and / or wherein the specific displacement prediction matrix for the relative rotational displacement (k1...kN) is a 2 x 2 matrix, wherein the apparatus (1710) is configured to apply the specific displacement prediction matrix to a first channel and a second channel of the first binaural signal to generate a first channel and a second channel of the binaural signal being associated with the relative rotational displacement (k1...kN).

74. Apparatus (1710), according to any one of claims 66 to 73, characterized in that the first rotation and one or more additional rotations indicate different head poses of a head within the audio scene, such that the first binaural signal and the one or more additional binaural signals are associated with the different head poses of the head.

75. Apparatus (1710), according to claim 74, Petition 870250089362, dated 10 / 01 / 2025, page 86 / 121 25 / 28 characterized in that the different head poses of the head are defined in relation to one or more Euler angles and / or in that the different head poses of the head are defined in relation to at least one yaw angle, one tilt angle and one rotation angle, and / or in that the different head poses of the head are defined in relation to a rotation matrix and / or in that the different head poses of the head are defined in relation to one or more quaternions.

76. Apparatus (1710), according to any one of claims 66 to 75, further depending on one of claims 69 to 71, characterized in that the apparatus (1710) is configured to receive information about the absolute pose (P'i...P'n) of one or more additional binaural signals and / or information about the associated relative rotational displacement (k1...kN) of one or more binaural signals, for example, from another apparatus (1720).

77. Apparatus (1710), according to claim 69 or 70 or 71 or 76, depending further on claim 75, characterized in that the associated absolute pose (P'i...P'n), being associated with each of the two or more binaural signals and / or being associated with the prediction information, indicates the head pose of the head, being defined depending on one or more Euler angles and / or the yaw angle and / or the tilt angle and / or the rotation angle and / or the rotation matrix and / or one or more quaternions; and / or wherein the associated relative rotational displacement (k1...kN), being associated with each of the two or more binaural signals and / or being associated with the prediction information, indicates a difference of a second head pose from the head in relation to a first head pose from the head, being defined depending on one or more Euler angles and / or the yaw angle and / or the angle Petition 870250089362, of 01 / 10 / 2025, page.87 / 121 26 / 28 of inclination and / or rotation angle and / or rotation matrix and / or one or more quaternions.

78. Apparatus (1710), according to any one of claims 66 to 77, depending further on claim 67, characterized in that the apparatus (1710) is configured to receive one or more transmissions from the other apparatus (1720), wherein the transmission comprises the first binaural signal being represented in a time domain, or wherein the transmission comprises the first binaural signal being represented in a frequency domain, or wherein the transmission comprises an encoding of the first binaural signal being represented in the time domain or in the frequency domain.

79. Apparatus (1710), according to any one of claims 66 to 78, depending further on claim 67, characterized in that the apparatus (1710) and the other apparatus (1720) are connected by means of a link with a delay.

80. Apparatus (1710), according to any one of claims 66 to 79, depending further on claim 67, characterized in that the apparatus (1710) is configured to transmit a rotational displacement parameter (θ) as rotational displacement information (θ) to the other apparatus (1720).

81. Apparatus (1710), according to claim 80, characterized in that the rotational offset parameter (θ) depends on a current rotational offset (ΔΡ) and / or depends on a link latency.

82. Apparatus (1710), according to any one of claims 66 to 81, depending further on claim 67, characterized in that the apparatus (1710) is configured to transmit or (for example, dynamically) determine information about a link latency of the transmission.

83. Apparatus (1710), according to any one of claims 66 to 82, depending further on claim 67, characterized in that the apparatus (1710) is configured to receive or (for example, dynamically) determine information about the transmission link latency, wherein the apparatus (1710) is configured to perform pose prediction depending on the link latency.

84. Apparatus (1710), according to any one of claims 66 to 83, depending further on claim 67, characterized in that the apparatus (1710) is configured to transmit a current rotational displacement (ΔΡ) and / or one or more poses (Pi...Pn) and / or upstream metadata to determine the rotational displacement parameter (θ) to the other apparatus (1720).

85. Apparatus (1710), according to any one of claims 66 to 79, depending further on claim 67, characterized in that the apparatus (1710) is configured to receive a rotational displacement parameter (θ) as rotational displacement information (θ) from the other apparatus (1720).

86. System, characterized in that it comprises one or more apparatuses (1710) as defined in any one of claims 66 to 85, and the apparatus (1720), as defined in any one of claims 50 to 65.

87. Method for generating signal prediction information, characterized in that the method comprises: receiving pose information and / or rotational displacement information (θ), and generating a first binaural signal for a first rotation of an audio scene, Petition 870250089362, dated 10 / 01 / 2025, page 89 / 121 28 / 28 wherein the generation of signal prediction information is conducted depending on the pose information (P'i...P'n) and / or the rotational displacement information (θ), such that one or more additional binaural signals for one or more additional rotations, being different from the first rotation, can be generated using the first binaural signal and using the signal prediction information.

88. Method for generating one or more additional binaural signals from a first binaural signal using signal prediction information, characterized in that the method comprises: receiving the first binaural signal for a first rotation of an audio scene, receiving signal prediction information that depends on pose information (P'i...P'n) and / or that depends on rotational displacement information (θ), and generating one or more additional binaural signals for one or more additional rotations, different from the first rotation, using the first binaural signal and using the signal prediction information.

89. Computer program, characterized in that it is for implementing the method as defined in claim 87 or 88 when it is being executed on a computer or signal processor.

Images