In-vehicle earphone audio processing method, device and equipment and storage medium
By obtaining vehicle-mounted sensor data and headphone motion information, correcting the position of the virtual sound source, solving the head tracking error of the headphones in the car during vehicle movement, and improving the spatial audio experience.
Patent Information
- Application Number
- CN202411048184.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2024-11-15
AI Technical Summary
When the vehicle moves, the headsets in the car cannot accurately distinguish the changes in inertial sensor data caused by head rotation and vehicle movement, resulting in false movement of virtual sound sources and affecting the spatial audio experience.
By obtaining vehicle-mounted sensor data and headphone motion information, the target user's head rotation angular velocity is determined, and the position of the virtual sound source is corrected based on this information, so as to avoid misidentifying the headphone motion caused by vehicle movement as head rotation.
It improves the head tracking accuracy of the headphones in the car, enhances the user's satisfaction with spatial audio, and solves the error problem of head tracking function.
Smart Images

Figure CN118972774A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of audio processing technology, and in particular, relates to a method, device, equipment and storage medium for processing in-vehicle headphone audio. Background Art
[0002] The audio mode of in-car headphones is a mode that uses spatial audio technology to provide passengers with a more three-dimensional, immersive and positioning audio experience through headphones in the car or headphones carried by passengers. Among them, spatial audio technology uses the sound transmission path in different positions and directions, and uses the head-related transfer function (HRTF) to make the sound heard by the user's two ears have a certain time difference (ITD) and sound level difference (ILD). When passengers wear headphones in the car, they feel that the sound seems to come from all directions, creating an immersive auditory experience for users.
[0003] At present, the in-car headphone system collects and analyzes changes in data from inertial sensors such as gyroscopes on the headphones, so that the virtual sound source rotates relative to the human head when the head turns, thereby realizing the head tracking function.
[0004] However, when a user watches a video with spatial audio while riding in a vehicle, the movement of the vehicle turning or bumping up and down will also cause changes in the data of inertial sensors such as the gyroscope on the headset. The headset in the car cannot accurately distinguish whether the change in inertial sensor data is caused by the rotation of the user's head. As a result, the headset in the car easily identifies the change in inertial sensor data caused by the movement of the vehicle as the passenger's head rotation, causing the virtual sound source to rotate without the user's head rotating, resulting in large errors in the head tracking function of the headset in the car, affecting the passengers' actual experience of spatial audio. Summary of the invention
[0005] The embodiments of the present application provide a method, device, equipment and storage medium for processing in-car headphone audio, which can solve the problem that the head tracking function of in-car headphones has large errors, affecting the user's actual experience of spatial audio.
[0006] In a first aspect, an embodiment of the present application provides a method for processing in-vehicle headphone audio, comprising:
[0007] Acquire vehicle-mounted sensor data generated during driving of the vehicle and headphone movement information of headphones in the vehicle;
[0008] Determine the target user's head rotation angular velocity according to the vehicle-mounted sensor data and the headset motion information;
[0009] Determining correction information of a virtual sound source of the in-vehicle earphone according to the head rotation angular velocity of the target user;
[0010] The position of the virtual sound source is corrected according to the correction information of the virtual sound source of the in-vehicle earphone.
[0011] In a possible implementation manner of the first aspect, the vehicle-mounted sensor data includes: screen posture information, seat back tilt information, and vehicle motion information of a vehicle-mounted gyroscope position, and determining the head rotation angular velocity of the target user according to the vehicle-mounted sensor data and the headphone motion information includes:
[0012] Determining adjustment information of a human torso coordinate system according to the posture information and the backrest tilt information, wherein the human torso coordinate system is pre-constructed according to the orientation of the seat;
[0013] Converting the vehicle motion information according to the adjustment information of the human body trunk coordinate system to obtain converted vehicle motion information;
[0014] The head rotation angular velocity of the target user is determined according to the converted vehicle motion information and the earphone motion information.
[0015] In a possible implementation manner of the first aspect, the posture information of the screen includes a screen position and a screen tilt angle of the screen;
[0016] The seat back tilt information includes the seat back tilt angle;
[0017] The step of determining adjustment information of a human body trunk coordinate system according to the posture information of the screen and the backrest tilt information of the seat comprises:
[0018] Determining a first rotation angle of the human body trunk coordinate system according to the screen position;
[0019] Determining a second rotation angle of the human body trunk coordinate system according to the screen tilt angle;
[0020] Determining a third rotation angle of the human body trunk coordinate system according to the backrest inclination angle;
[0021] Adjustment information of the human body trunk coordinate system is determined according to the first rotation angle of the human body trunk coordinate system, the second rotation angle of the human body trunk coordinate system, and the third rotation angle of the human body trunk coordinate system.
[0022] In a possible implementation manner of the first aspect, converting the vehicle motion information according to the adjustment information of the human body trunk coordinate system to obtain the converted vehicle motion information includes:
[0023] Determining a rotation matrix of the human body trunk coordinate system according to the adjustment information of the human body trunk coordinate system;
[0024] The vehicle motion information is transformed according to the rotation matrix of the human body trunk coordinate system to obtain the transformed vehicle motion information.
[0025] In a possible implementation manner of the first aspect, the vehicle motion information includes a vehicle rotation angular velocity;
[0026] The step of converting the vehicle motion information according to the rotation matrix of the human body trunk coordinate system to obtain the converted vehicle motion information includes:
[0027] The rotation matrix of the human body trunk coordinate system is multiplied by the vehicle rotation angular velocity to obtain the converted vehicle rotation angular velocity.
[0028] In a possible implementation manner of the first aspect, the earphone motion information includes an earphone rotation angular velocity, and determining the head rotation angular velocity of the target user according to the converted vehicle motion information and the earphone motion information includes:
[0029] The converted vehicle rotation angular velocity is subtracted from the headset rotation angular velocity to obtain the head rotation angular velocity of the target user.
[0030] In a possible implementation manner of the first aspect, determining, according to the head rotation angular velocity of the target user, correction information of the virtual sound source of the in-vehicle headset includes:
[0031] Determining a current head rotation angle and a current head rotation direction of the target user according to the head rotation angular velocity of the target user;
[0032] The correction information of the virtual sound source of the in-vehicle earphone is determined according to the current head rotation angle and the current head rotation direction of the user.
[0033] In a second aspect, an embodiment of the present application provides a device for processing in-vehicle headphone audio, comprising:
[0034] An information acquisition module, used to acquire vehicle-mounted sensor data generated during driving of the vehicle and headphone motion information of headphones in the vehicle;
[0035] A head rotation information correction module, used to determine the head rotation angular velocity of the target user according to the vehicle-mounted sensor data and the headset motion information;
[0036] A virtual sound source position determination module, used to determine correction information of the virtual sound source of the in-vehicle earphone according to the head rotation angular velocity of the target user;
[0037] The virtual sound source position adjustment module is used to correct the position of the virtual sound source according to the correction information of the virtual sound source of the in-vehicle earphone.
[0038] In a third aspect, an embodiment of the present application provides a device for processing in-vehicle headphone audio, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the above-described methods when executing the computer program.
[0039] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements any of the methods described above.
[0040] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on a device for processing in-vehicle headphone audio, the device for processing in-vehicle headphone audio executes any of the methods described above.
[0041] Compared with the prior art, the embodiments of the present application have the following beneficial effects: by acquiring the on-board sensor data and the headphone motion information of the in-car headphones generated during the driving of the vehicle, the headphone motion caused by the on-board sensor data generated during the driving of the vehicle is taken into account, and the correction information of the virtual sound source of the in-car headphones is determined according to the angular rotation velocity of the target user's head, and the headphone motion caused by the on-board sensor data generated during the driving of the vehicle is also taken into account, thereby avoiding identifying the headphone motion information changes caused by the vehicle movement as the user's head rotation, so that when the position of the virtual sound source is corrected according to the correction information of the virtual sound source of the in-car headphones, the corrected position of the virtual sound source is more consistent with the actual head rotation of the user, and the head tracking of the in-car headphones is more accurate, which effectively improves the user's satisfaction with the spatial audio of the in-car headphones, thereby solving the problem that the head tracking function of the in-car headphones has a large error, affecting the user's actual experience of the spatial audio. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0043] Figure 1 It is a schematic diagram of the position of a virtual sound source of headphones in a vehicle during driving provided by the prior art;
[0044] Figure 2 It is a flowchart of a method for processing in-vehicle headphone audio provided by an embodiment of the present application;
[0045] Figure 3 This is a schematic diagram of the position of a virtual sound source of headphones in a vehicle during a left turn provided by an embodiment of the present application;
[0046] Figure 4 This is a schematic diagram of the position of a vehicle-mounted gyroscope provided in one embodiment of the present application;
[0047] Figure 5 This is a schematic diagram of adjusting a human body trunk coordinate system when watching a side window video screen provided by an embodiment of the present application;
[0048] Figure 6 This is a schematic diagram of adjusting a human body trunk coordinate system when a screen is tilted, provided by an embodiment of the present application;
[0049] Figure 7 It is a schematic diagram of adjusting the human body trunk coordinate system when the backrest is tilted, provided by an embodiment of the present application;
[0050] Figure 8 It is a structural schematic diagram of a device for processing in-vehicle headphone audio provided by an embodiment of the present application. DETAILED DESCRIPTION
[0051] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0052] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0053] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0054] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.
[0055] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0056] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0057] Some vehicles have video players installed in front of the seats. Figure 1 , Figure 1 This is a schematic diagram of the position of a virtual sound source of headphones in a vehicle during driving provided by the prior art. When a user wears headphones and sits in the back seat of a vehicle to watch a video played by a video player, the headphones play the spatial audio in the video in the vehicle. The headphones are in-vehicle headphones, which are headphones used by users in the vehicle. They can be in-vehicle headphones or headphones carried by the user and connected to the video player.
[0058] The in-car headphones have a head tracking spatial audio function. When the user wears the in-car headphones to watch a video with spatial audio played on the video screen, the in-car headphones automatically switch to the in-car headphones spatial audio mode and turn on the head tracking spatial audio function. The head tracking function is realized by collecting and analyzing the rotation signals emitted by the gyroscope on the headphones and other on-board sensor data. When the user's head turns, the position of the sound source (such as a video player) in the virtual space remains unchanged, and the virtual sound source of the headphones moves with the user's head, allowing the user to achieve better hearing effects.
[0059] However, when the vehicle is driving, if the user does not turn his head and the vehicle makes a quick left turn, such as Figure 1 As shown in the figure, the rotation signal sent by the gyroscope on the headset also changes. The headset in the car adjusts the position of the virtual sound source of the headset according to the rotation signal sent by the gyroscope, and changes the original position of the virtual sound source to the position of the virtual sound source. Figure 1 The position of the virtual sound source at virtual sound image position 1 in the video is mistakenly moved to virtual sound image position 2. This kind of head tracking function error caused by vehicle movement is large, and the position of the virtual sound source is wrong and changed, affecting the actual experience of spatial audio for the headphone wearer in the car.
[0060] The present application embodiment provides a method for processing in-vehicle headphone audio, see Figure 2 , Figure 2 1 is a flow chart of a method for processing in-vehicle headphone audio provided by an embodiment of the present application, including:
[0061] Step S11, acquiring vehicle-mounted sensor data generated during the driving of the vehicle and headphone movement information of the headphone in the vehicle;
[0062] Step S12, determining the target user's head rotation angular velocity according to the vehicle-mounted sensor data and the headset motion information;
[0063] Step S13, determining correction information of the virtual sound source of the in-car earphone according to the head rotation angular velocity of the target user;
[0064] Step S14, correcting the position of the virtual sound source according to the correction information of the virtual sound source of the in-car earphone.
[0065] Specifically, when the in-car headset with head tracking spatial audio function plays spatial audio in a moving vehicle, it automatically switches to the in-car headset spatial audio mode. At this time, the audio played in the in-car headset is the audio played by the video player that is communicatively connected to the in-car headset. The in-car headset is a headset with head tracking spatial audio function used by the user in the car, which can be an in-car headset or other headset carried by the user.
[0066] Among them, the on-board sensor data includes: screen posture information, seat back tilt information and vehicle motion information. The vehicle motion information is determined based on the position of the on-board gyroscope.
[0067] It should be noted that the headset is provided with a headset gyroscope to measure the motion information of the headset in the car and obtain the headset motion information, such as measuring the three-axis rotation signal of the headset. Inertial sensors can be provided at multiple locations of the vehicle, refer to Figure 4 , Figure 4 This is a schematic diagram of the position of the vehicle-mounted gyroscope provided in an embodiment of the present application. A vehicle-mounted gyroscope is set at each seat of the vehicle to measure the three-axis rotation signal at the vehicle-mounted gyroscope to obtain the vehicle motion information at the location of each vehicle-mounted gyroscope. For example: Figure 4 In the vehicle-mounted gyroscope 1, vehicle-mounted gyroscope 2, vehicle-mounted gyroscope 3 and vehicle-mounted gyroscope 4. Sensors (such as gyroscopes, accelerometers, angle detection sensors, etc.) are arranged at the backrest rotation axis of each vehicle seat, the bottom of the seat, the rotation axis of the video player, etc., to measure the inclination angle information, position information, etc. of the seat, the backrest of the seat, and the screen of the video player.
[0068] In an optional example, the screen position of the video player can be calculated by combining the seat position information and the output data of the angle detection sensor at the bottom of the seat; the screen tilt angle can be obtained by the angle detection sensor at the hinge of the video player; and the seat back tilt angle can be obtained by the angle detection sensor at the hinge of the seat back.
[0069] It should be noted that a pressure sensor may also be provided at each seat of the vehicle to detect the pressure on the seat. The vehicle components may also be provided with locators to transmit wireless signals to locate the position of the components. A camera may also be provided in the vehicle to identify the acquired image to obtain the position of the headphones in the vehicle, the position of the screen or the position of the user, etc. An intelligent voice device (such as an intelligent microphone) may also be provided in the vehicle to determine the actual position of the target user by collecting and analyzing sound signals. The number, type and position of the inertial sensor may be set according to actual needs, and this embodiment does not specifically limit this.
[0070] The vehicle's multiple inertial sensors, cameras, smart voice devices, video players and other devices all maintain communication connections with the headphones in the vehicle, where the communication connection methods include but are not limited to Bluetooth, WIFI (Wireless communication), UWB (Ultra Wide Band) and other communication methods.
[0071] Specifically, when a user rides in a vehicle and uses in-vehicle headphones to play spatial audio in a moving vehicle, the user is a target user, and a human torso coordinate system O-XYZ is established at the target user according to the seat the target user sits in. Figure 3 FIG. 1 is a schematic diagram of the position of a virtual sound source of headphones in a vehicle during a left turn provided by an embodiment of the present application. Figure 3 In the human body trunk coordinate system shown in FIG. 1 , the rotation of the target user's head is a rotation relative to the human body trunk coordinate system O-XYZ.
[0072] When the vehicle is driving, when the target user turns on the spatial audio mode function of the in-vehicle headset, the in-vehicle headset receives signal data sent by multiple inertial sensors in the vehicle, and obtains the vehicle's onboard sensor data and headset motion information of the in-vehicle headset. The headset motion information of the in-vehicle headset is the headset motion information of the in-vehicle headset used by the target user, and the headset motion information includes three-axis rotation information of the headset, such as the rotation angular velocity of the headset.
[0073] The vehicle's on-board sensor data includes signal data emitted by various inertial sensors that are connected to the in-car headset used by the target user, such as screen posture information, seat back tilt information, target user's location information, and vehicle motion information of the on-board gyroscope position.
[0074] The screen is the screen of the video player that the target user is using and corresponds to the in-car headset used by the target user. Figure 5 , Figure 5 This is a schematic diagram of adjusting the human body coordinate system when watching a side window video screen provided by an embodiment of the present application. A side window video screen is also provided on the left side of the car seat. The posture information of the screen may include the position of the screen and the tilt angle of the screen, etc., which may affect the user's body posture. The seat is a seat in the car where the target user is sitting, for example Figure 4 The target user is seated in the left rear seat of the vehicle, and the seat back tilt information may include the tilt angle and rotation angle of the seat back. The target user's location information may be the location coordinates of the target user. The vehicle gyroscope location is the location of the vehicle gyroscope closest to the target user among multiple vehicle gyroscopes. For example, the vehicle gyroscope location is Figure 4 The vehicle motion information of the vehicle gyroscope position may include three-axis rotation information sent by the vehicle gyroscope 3, such as the rotation angular velocity of the vehicle output by the vehicle gyroscope 3.
[0075] It is understandable that selecting the position of the vehicle-mounted gyroscope closest to the target user can more accurately and in real time reflect the rotation signal of the human body coordinate system O-XYZ itself caused by the movement of the vehicle. Figure 4As shown, when the target user wears an in-car headset and sits in the left rear seat of the vehicle, the actual position of the target user can be obtained according to the position of the in-car video screen to which the in-car headset communicates, the seat pressure sensor, the wireless signal positioning, the image sensor signal, the microphone sound signal, etc., and the position of the in-car gyroscope 3 closest to the target user is selected as the position of the in-car gyroscope.
[0076] The position of the vehicle-mounted gyroscope closest to the target user can be obtained by any of the following methods: when there is only one passenger, the seat used by the target user is judged according to the pressure of the seat, and the position of the vehicle-mounted gyroscope at the seat is used as the position of the vehicle-mounted gyroscope closest to the target user; the seat corresponding to the video player currently being used by the target user is used as the seat used by the target user, and the position of the vehicle-mounted gyroscope at the seat is used as the position of the vehicle-mounted gyroscope closest to the target user; according to the wireless signal emitted by UWB, etc., the positioning technology (Time Difference of The method comprises the following steps: determining the time of arrival and departure of the target user from the vehicle, determining the position of the in-car headset used by the target user according to the flight time, and taking the position of the in-car gyroscope closest to the position of the in-car headset as the position of the in-car gyroscope closest to the target user; recognizing the image according to the image obtained by the in-car camera, obtaining the position of the in-car headset used by the target user, and taking the position of the in-car gyroscope closest to the position of the in-car headset as the position of the in-car gyroscope closest to the target user; and identifying the position where the target user utters a voice according to an intelligent voice device (such as a multi-channel microphone array), taking the position of the in-car gyroscope closest to the position where the target user utters the voice as the position of the in-car gyroscope closest to the target user.
[0077] It should be noted that the vehicle-mounted gyroscope may be located under each seat, at each seat headrest, or at a fixed location such as the vehicle body or frame, and this embodiment does not specifically limit this.
[0078] Specifically, when the vehicle is driving, the human body trunk coordinate system O-XYZ is not in a static state because the vehicle is moving. According to the acquired vehicle sensor data, such as the vehicle motion information output by the vehicle gyroscope 3, the screen posture information output by the video player, and the backrest tilt information output by the sensor at the backrest, the rotation signal of the human body trunk coordinate system O-XYZ caused by the vehicle motion information can be determined. The rotation signal of the human body trunk coordinate system O-XYZ caused by the vehicle motion information can be the actual rotation angular velocity of the vehicle.
[0079] If the headphone motion information of the headphone in the car is obtained at this time, the headphone motion information includes the headphone rotation angular velocity. The headphone rotation angular velocity of the headphone in the car is divided by the actual rotation angular velocity of the vehicle to obtain the head rotation angular velocity of the target user. The head rotation angular velocity of the target user indicates the angular velocity of the target user's head when it rotates, moves, etc.
[0080] Through methods such as Head Related Transfer Functions (HRTF) or direction mapping, the relationship between the position of the virtual sound source and the angular velocity of the head rotation can be obtained according to the angular velocity of the target user's head rotation, and the correction information of the virtual sound source of the in-car headphones can be determined. According to the correction information of the virtual sound source of the in-car headphones, the position of the virtual sound source is corrected to obtain the corrected position of the virtual sound source, so that the position of the virtual sound source of the in-car headphones changes accordingly with the movement of the target user's head, realizing a true head tracking function, and realizing a head tracking spatial audio function for binaural rendering of multi-channel or object-based 3D audio signals.
[0081] In an alternative example, reference Figure 3 , the position of the virtual sound source of the in-car earphone is the virtual sound image position 1, the rotation signal of the human body trunk coordinate system O-XYZ caused by the vehicle motion information during the vehicle driving process is the rotation angular velocity R0_X, R0_Y and R0_Z of different rotation axes (X, Y, Z rotation axes), and the earphone motion information obtained from the gyroscope of the in-car earphone is the rotation angular velocity R1_X, R1_Y and R1_Z of different rotation axes (X, Y, Z rotation axes). When the target user's head does not move or rotate, the rotation signals R0_X, R0_Y and R0_Z of the human body trunk coordinate system O-XYZ caused by the vehicle motion information are completely consistent with the earphone motion information R1_X, R1_Y and R1_Z respectively, and the subtraction is 0. The virtual sound source originally at the virtual sound image position 1 can remain at the virtual sound image position 1 even when the vehicle is turning, that is, when the target user does not turn his head and the vehicle is turning left, the position of the virtual sound source remains unchanged, and the user can get a more realistic spatial audio experience.
[0082] Based on the vehicle sensor data and headset motion information, the angular velocity of the target user's head rotation can be determined, thereby correcting the false head rotation caused by different vehicle movements. For example: the false left and right head rotation caused by the vehicle turning left and right on a flat road along the vertical axis Z; the false up and down nodding movement caused by the vehicle going up and down a slope along the horizontal axis X; the false left and right head shaking movement caused by the road tilting left and right along the horizontal axis Y.
[0083] It can be understood that the technical solution provided by the present embodiment takes into account the headphone movement caused by the on-board sensor data generated during the driving of the vehicle and the headphone motion information of the in-car headphones, and determines the head rotation angular velocity of the target user according to the on-board sensor data and the headphone motion information. The correction information of the virtual sound source of the in-car headphones determined according to the head rotation angular velocity of the target user also takes into account the headphone movement caused by the on-board sensor data generated during the driving of the vehicle, thereby avoiding identifying the headphone motion information change caused by the vehicle movement as the user's head rotation, so that when the position of the virtual sound source is corrected according to the correction information of the virtual sound source of the in-car headphones, the corrected position of the virtual sound source is more consistent with the actual head rotation of the user, and the head tracking of the in-car headphones is more accurate, which effectively improves the user's satisfaction with the spatial audio of the in-car headphones, thereby solving the problem that the head tracking function of the in-car headphones has a large error, affecting the user's actual experience of the spatial audio.
[0084] In a possible implementation, the vehicle-mounted sensor data includes: screen posture information, seat back tilt information, and vehicle motion information of the vehicle-mounted gyroscope position. In step S12, the head rotation angular velocity of the target user is determined according to the vehicle-mounted sensor data and the headphone motion information, including:
[0085] Step S121, determining adjustment information of a human body trunk coordinate system according to the posture information and the backrest tilt information, wherein the human body trunk coordinate system is pre-constructed according to the orientation of the seat;
[0086] Step S122, converting the vehicle motion information according to the adjustment information of the human body trunk coordinate system to obtain converted vehicle motion information;
[0087] Step S123, determining the head rotation angular velocity of the target user according to the converted vehicle motion information and earphone motion information.
[0088] Specifically, according to the vehicle-mounted sensor data and the headset motion information, the head rotation angular velocity of the target user is determined, including:
[0089] Generally, the screen used by the target user in the in-car headset is assumed to be the screen of the video player in front of the vehicle, and the screen is suspended vertically, perpendicular to the vehicle. The target user's sitting posture is also perpendicular to the vehicle, that is, the target user's head is looking directly at the screen, and its orientation is consistent with the orientation of the screen. The direction of the human body coordinate system O-XYZ is consistent with the vehicle coordinate system O ′ -X ′ Y ′ Z ′ The direction is consistent. Figure 3As shown in , the human body trunk coordinate system is pre-constructed according to the orientation of the seat, that is, the human body trunk coordinate system is consistent with the vehicle coordinate system.
[0090] When there is a video player or a video player screen at other locations of the target user in the vehicle (such as the left side or right side of the seat), the target user can also select the screen at other locations. In addition, the screen can be tilted or rotated. When the backrest of the seat that the target user is using in the vehicle can be tilted, the target user can also adjust the tilt angle of the seat backrest to make the ride more comfortable. The posture information of the screen that the target user is using and the seat back tilt information may cause the orientation of the human body torso coordinate system O-XYZ to be different from the vehicle coordinate system O-XYZ. ′ -X ′ Y ′ Z ′ However, the orientation of the on-board gyroscope does not change with the orientation of the human body's torso coordinate system. The vehicle motion information of the on-board gyroscope is consistent with the orientation of the vehicle coordinate system, which may result in the vehicle motion information of the on-board gyroscope being inconsistent with the orientation of the human body's torso coordinate system O-XYZ.
[0091] According to the screen posture information and the seat back tilt information in the received vehicle-mounted sensor data, the change information of the human body trunk coordinate system can be determined, that is, the adjustment information of the human body trunk coordinate system can be determined.
[0092] According to the adjustment information of the human body trunk coordinate system, the vehicle motion information at the vehicle-mounted gyroscope is converted to obtain the converted vehicle motion information, wherein the converted vehicle motion information represents the vehicle motion information relative to the adjusted human body trunk coordinate system.
[0093] The headphone motion information is removed from the converted vehicle motion information to determine the head motion information of the target user. The headphone motion information includes the headphone rotation angular velocity. Since the vehicle motion information at the vehicle gyroscope position includes the vehicle rotation angular velocity at the vehicle gyroscope position, and the converted vehicle motion information includes the converted vehicle rotation angular velocity, the head rotation angular velocity of the target user can be determined based on the headphone rotation angular velocity and the vehicle rotation angular velocity.
[0094] In an optional example, if Figure 5 As shown in FIG. 1 , the target user uses the screen on the left side of the seat. At this time, in order to watch the video more clearly, the target user's head is oriented in the same direction as the screen. At this time, the direction of the human body coordinate system O-XYZ is consistent with the vehicle coordinate system O ′ -X ′ Y ′ Z ′The orientation is inconsistent, and the orientation of the human torso coordinate system O-XYZ needs to be adjusted. According to the position of the screen on the left side of the seat, the adjustment information of the human torso coordinate system is determined, and the vehicle motion information is converted according to the adjustment information of the human torso coordinate system to obtain the converted vehicle motion information, that is, the rotation signals R0_X_NEW, R0_Y_NEW and R0_Z_NEW caused by the vehicle motion relative to the adjusted human torso coordinate system O-XYZ. The headphone motion information obtained is R1_X, R1_Y and R1_Z. The headphone motion information R1_X, R1_Y and R1_Z are respectively subtracted from the converted vehicle motion information R0_X_NEW, R0_Y_NEW and R0_Z_NEW to obtain the target user's head rotation angular velocity.
[0095] It can be understood that through the position of the screen selected by the target user, the orientation of the human body trunk coordinate system can be adjusted to achieve the correction function of head tracking and the integration of the video screen of the associated video player in the spatial audio mode of the in-car headphones, thereby further enhancing the target user's actual experience of spatial audio in different seats, different postures and different viewing directions in the car.
[0096] In a possible implementation, the posture information includes a screen position and a screen tilt angle of the screen;
[0097] The backrest tilt information includes the seat back tilt angle;
[0098] In step S121, the adjustment information of the human body trunk coordinate system is determined according to the posture information and the backrest tilt information, including:
[0099] Determine a first rotation angle of a human body trunk coordinate system according to the screen position;
[0100] Determine a second rotation angle of the human body trunk coordinate system according to the screen tilt angle;
[0101] Determine the third rotation angle of the human body trunk coordinate system according to the backrest tilt angle;
[0102] Adjustment information of the human body trunk coordinate system is determined according to the first rotation angle of the human body trunk coordinate system, the second rotation angle of the human body trunk coordinate system, and the third rotation angle of the human body trunk coordinate system.
[0103] Specifically, the screen posture information includes the screen position and screen tilt angle of the screen, and the seat back tilt information includes the seat back tilt angle. According to the screen posture information and the seat back tilt information, the adjustment information of the human body trunk coordinate system is determined, including:
[0104] refer to Figure 4 and Figure 5,The screen posture information includes the screen position, Figure 4 The screen position in is the position of the screen in front of the target user. At this time, the human body coordinate system is the default human body coordinate system O-XYZ, and its orientation is the same as the vehicle coordinate system O ′ -X ′ Y ′ Z ′ The orientation is consistent. Figure 5 The screen position in the figure is the screen position on the left side of the seat. Figure 4 The orientation of the human body coordinate system is different when the screen position is different. When the orientation of the human body coordinate system is adjusted according to the screen position of the screen being used by the target user, the first rotation angle of the human body coordinate system can be determined.
[0105] In an alternative example, reference Figure 5 The screen position of the screen that the target user is using is the position of the screen on the left side of the seat. In order to make the Y-axis of the rotated human torso coordinate system continue to be vertically aligned with the screen, the human torso coordinate system needs to be rotated 90 degrees counterclockwise along the Z axis. The first rotation angle of the human torso coordinate system is 90 degrees counterclockwise along the Z axis.
[0106] Specifically, refer to Figure 6 , Figure 6 1 is a schematic diagram of adjusting the human body coordinate system when the screen is tilted, provided by an embodiment of the present application. The screen is located behind the front seats of the car, and the target user is in the back seat of the car. The screen posture information also includes the screen tilt angle. Generally, the screen is in a vertical hanging state by default. At this time, the orientation of the human body coordinate system O-XYZ is different from that of the vehicle coordinate system O-XYZ. ′ -X ′ Y ′ Z ′ The orientation of the human torso coordinate system is consistent. The human torso coordinate system is generally the default coordinate system of the vehicle. ′ -X ′ Y ′ Z ′ The screen is tilted at a 0 degree angle and is perpendicular to the ground. However, when the target user chooses to watch the video in a semi-lying position and clicks a button on the vehicle to rotate and tilt the screen synchronously, Figure 6 The screen in the image has a certain inclination angle relative to the ground, and the inclination angle is used as the screen inclination angle of the screen. At this time, the orientation of the human body trunk coordinate system is different from the orientation of the default human body trunk coordinate system.
[0107] In an alternative example, reference Figure 6The screen tilt angle of the screen that the target user is using is α degrees counterclockwise along the X-axis. In order to make the Z axis of the rotated human body coordinate system continue to be parallel to the screen, the human body coordinate system needs to be rotated α degrees counterclockwise along the X-axis. The second rotation angle of the human body coordinate system is α degrees counterclockwise along the X-axis.
[0108] Specifically, refer to Figure 7 , Figure 7 1 is a schematic diagram of adjusting the human body coordinate system when the backrest is tilted provided by an embodiment of the present application. The rear seat of the car is the position of the target user. The backrest tilt information of the seat includes the backrest tilt angle of the seat, which is generally set to a state vertical to the ground by default. At this time, the orientation of the human body coordinate system O-XYZ is the same as the vehicle coordinate system O ′ -X ′ Y ′ Z ′ The orientation is consistent, and the human body coordinate system is generally the default with the vehicle coordinate system O ′ -X ′ Y ′ Z ′ However, when the target user chooses to watch the video in a semi-lying position and rotates and tilts the backrest synchronously, Figure 7 In the rear seat of the car, when the user sits in the rear seat of the car, the seat back has a certain inclination angle relative to the ground, and the inclination angle is used as the seat back inclination angle. At this time, the orientation of the human body trunk coordinate system is different from the default orientation of the human body trunk coordinate system.
[0109] In an alternative example, reference Figure 7 The backrest inclination angle of the seat that the target user is using is β degrees counterclockwise along the X-axis. In order to make the Z axis of the rotated human torso coordinate system continue to be parallel to the backrest of the seat, the human torso coordinate system needs to be rotated β degrees counterclockwise along the X-axis. The third rotation angle of the human torso coordinate system is β degrees counterclockwise along the X-axis.
[0110] Specifically, when the second rotation angle of the human body trunk coordinate system and the third rotation angle of the human body trunk coordinate system are not 0, at least one of the second rotation angle or the third rotation angle of the human body trunk coordinate system can be selected and combined with the first rotation angle of the human body trunk coordinate system as the rotation angle of the human body trunk coordinate system, and the adjustment information of the human body trunk coordinate system is determined according to the rotation angle of the human body trunk coordinate system. For example, when the third rotation angle is β degrees counterclockwise rotation along the X axis and the first rotation angle is 90 degrees counterclockwise rotation along the Z axis, the adjustment information of the human body trunk coordinate system is 90 degrees counterclockwise rotation along the Z axis and β degrees counterclockwise rotation along the X axis.
[0111] In a possible implementation, step S122, converting the vehicle motion information according to the adjustment information of the human body trunk coordinate system to obtain the converted vehicle motion information, includes:
[0112] Step S1221, determining a rotation matrix of the human body trunk coordinate system according to the adjustment information of the human body trunk coordinate system;
[0113] Step S1222, transforming the vehicle motion information according to the rotation matrix of the human body trunk coordinate system, and determining the transformed vehicle motion information.
[0114] Specifically, the vehicle motion information is converted according to the adjustment information of the human body trunk coordinate system to obtain the converted vehicle motion information, including:
[0115] According to the adjustment information of the human body trunk coordinate system, the rotation matrix of the human body trunk coordinate system can be determined, wherein the rotation matrix of the human body trunk coordinate system represents the matrix data formed according to the adjustment information when the human body trunk coordinate system needs to be adjusted.
[0116] In an optional example, when the adjustment information of the human body trunk coordinate system is a counterclockwise rotation of α degrees along the Z axis, the rotation matrix for a counterclockwise rotation of α degrees along the Z axis is R=[cosα, sinα, 0; -sinα, cosα, 0; 0, 0, 1].
[0117] Specifically, the vehicle motion information includes the vehicle rotation angular velocity. According to the rotation matrix of the human body trunk coordinate system, the vehicle rotation angular velocity in the vehicle motion information is converted to obtain the converted vehicle motion information. The converted vehicle motion information can be converted to the vehicle rotation angular velocity.
[0118] In a possible implementation, the vehicle motion information includes the vehicle rotation angular velocity;
[0119] In step S1222, the vehicle motion information is transformed according to the rotation matrix of the human body coordinate system to obtain the transformed vehicle motion information, including:
[0120] The rotation matrix of the human body coordinate system is multiplied by the vehicle rotation angular velocity to obtain the converted vehicle rotation angular velocity.
[0121] Specifically, the vehicle motion information includes the vehicle rotation angular velocity, which is the three-axis rotation angular velocity output by the vehicle-mounted gyroscope. For example, the vehicle motion information is [R0_X, R0_Y, R0_Z].
[0122] According to the rotation matrix of the human body coordinate system, the vehicle motion information is transformed to obtain the transformed vehicle motion information, including:
[0123] The rotation matrix of the human body coordinate system is multiplied by the vehicle rotation angular velocity to obtain the converted vehicle rotation angular velocity.
[0124] In an optional example, the converted vehicle rotation angular velocity [R0_X_NEW, R0_Y_NEW, R0_Z_NEW] = R*[R0_X, R0_Y, R0_Z], where R is the rotation matrix of the human body trunk coordinate system.
[0125] In a possible implementation, the earphone motion information includes an earphone rotation angular velocity. Step S123, determining the target user's head rotation angular velocity according to the converted vehicle motion information and the earphone motion information, includes:
[0126] Subtract the converted vehicle rotation angular velocity from the headset rotation angular velocity to obtain the target user's head rotation angular velocity.
[0127] Specifically, the headphone motion information includes the headphone rotation angular velocity, wherein the headphone rotation angular velocity is a three-axis rotation angular velocity output by the headphone gyroscope, for example, the headphone rotation angular velocity is R1_X, R1_Y and R1_Z.
[0128] According to the converted vehicle motion information and headset motion information, the head rotation angular velocity of the target user is determined, including:
[0129] Subtract the converted vehicle rotation angular velocity from the headset rotation angular velocity to obtain the target user's head rotation angular velocity.
[0130] In an optional example, the headphone rotation angular velocity is R1_X, R1_Y and R1_Z, the converted vehicle motion information is R0_X_NEW, R0_Y_NEW and R0_Z_NEW, and R1_X, R1_Y and R1_Z are respectively subtracted from R0_X_NEW, R0_Y_NEW and R0_Z_NEW to obtain the target user's head rotation angular velocity.
[0131] It can be understood that by automatically adjusting the orientation of the human torso coordinate system through the screen position, screen tilt information and seat back tilt information of the screen selected by the target user, and determining the converted vehicle rotation angular velocity based on the adjustment information of the human torso coordinate system, the head tracking function of the in-car headphones in the spatial audio mode and the fusion of the video images can be achieved, further enhancing the user's actual experience of spatial audio in different seats and viewing directions in the car.
[0132] In a possible implementation, in step S13, determining correction information of a virtual sound source of the in-car earphone according to the head rotation angular velocity of the target user includes:
[0133] Determine the current head rotation angle and the current head rotation direction of the target user according to the head rotation angular velocity of the target user;
[0134] According to the current head rotation angle and the current head rotation direction of the user, correction information of the virtual sound source of the in-vehicle earphone is determined.
[0135] Specifically, according to the rotation angular velocity of the head of the target user, the correction information of the virtual sound source of the in-car earphone is determined, including:
[0136] According to the angular rotation velocity of the target user's head, the angular rotation velocities around the X-axis, Y-axis and Z-axis are considered respectively, and the current head rotation direction of the target user is determined by the positive and negative signs of the angular velocity, wherein the current head rotation direction includes the rotation direction of the head on the X-axis, Y-axis and Z-axis. The current head rotation angle of the target user is calculated by the integral method or other methods, wherein the current head rotation angle includes the rotation angle of the head on the X-axis, Y-axis and Z-axis.
[0137] Through the head-related transfer function or other technologies, the correction information of the virtual sound source of the in-car earphone is determined according to the current head rotation angle and the current head rotation direction of the user.
[0138] It can be understood that the technical solution provided by this embodiment obtains the vehicle-mounted sensor data and the headphone motion information of the in-vehicle headphones generated during the driving of the vehicle. Since the vehicle-mounted sensor data includes the posture information of the screen, the backrest tilt information of the seat, and the vehicle motion information of the position of the vehicle-mounted gyroscope, the head rotation angular velocity of the target user determined according to the vehicle-mounted sensor data and the headphone motion information takes into account the headphone motion caused by the vehicle-mounted sensor data generated during the driving of the vehicle. The correction information of the virtual sound source of the in-vehicle headphones determined according to the head rotation angular velocity of the target user also takes into account the headphone motion caused by the vehicle-mounted sensor data generated during the driving of the vehicle, thereby avoiding identifying the headphone motion information change caused by the vehicle motion as the user's head rotation, so that when the position of the virtual sound source is corrected according to the correction information of the virtual sound source of the in-vehicle headphones, the corrected position of the virtual sound source is more consistent with the actual head rotation of the user, and the head tracking of the in-vehicle headphones is more accurate, which effectively improves the user's satisfaction with the spatial audio of the in-vehicle headphones, thereby solving the problem that the head tracking function of the in-vehicle headphones has a large error and affects the user's actual experience of the spatial audio.
[0139] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0140] Corresponding to the method described in the above embodiment, Figure 8A schematic diagram of the structure of a device for processing in-vehicle headphone audio provided by an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.
[0141] Reference Figure 8 , the device comprises:
[0142] The information acquisition module 81 is used to acquire the vehicle sensor data and the headphone motion information of the headphone in the vehicle generated during the driving process;
[0143] A head rotation information correction module 82 is used to determine the head rotation angular velocity of the target user based on the vehicle-mounted sensor data and the headset motion information;
[0144] A virtual sound source position determination module 83, used to determine correction information of the virtual sound source of the in-car earphone according to the angular velocity of the head rotation of the target user;
[0145] The virtual sound source position adjustment module 84 is used to correct the position of the virtual sound source according to the correction information of the virtual sound source of the in-vehicle earphone.
[0146] In one possible implementation, the vehicle-mounted sensor data includes: screen posture information, seat back tilt information and vehicle motion information of the vehicle-mounted gyroscope position. When determining the target user's head rotation angular velocity based on the vehicle-mounted sensor data and the headphone motion information, the head rotation information correction module 82 is specifically used to determine the adjustment information of the human torso coordinate system based on the posture information and the seat back tilt information, wherein the human torso coordinate system is pre-constructed based on the position of the vehicle; convert the vehicle motion information based on the adjustment information of the human torso coordinate system to obtain the converted vehicle motion information; determine the target user's head rotation angular velocity based on the converted vehicle motion information and the headphone motion information.
[0147] In a possible implementation, the position information of the screen includes the screen position and the screen tilt angle of the screen.
[0148] The seat back tilt information includes the seat back tilt angle.
[0149] When determining the adjustment information of the human torso coordinate system based on the screen posture information and the seat back tilt information, the head rotation information correction module 82 is specifically used to determine the first rotation angle of the human torso coordinate system based on the screen position; determine the second rotation angle of the human torso coordinate system based on the screen tilt angle; determine the third rotation angle of the human torso coordinate system based on the backrest tilt angle; determine the adjustment information of the human torso coordinate system based on the first rotation angle of the human torso coordinate system, the second rotation angle of the human torso coordinate system and the third rotation angle of the human torso coordinate system.
[0150] In a possible implementation, the vehicle motion information is converted according to the adjustment information of the human body trunk coordinate system to obtain the converted vehicle motion information. The head rotation information correction module 82 is specifically used to determine the rotation matrix of the human body trunk coordinate system according to the adjustment information of the human body trunk coordinate system; the vehicle motion information is converted according to the rotation matrix of the human body trunk coordinate system to obtain the converted vehicle motion information.
[0151] In a possible implementation, the vehicle motion information includes the vehicle rotation angular velocity.
[0152] The vehicle motion information is converted according to the rotation matrix of the human body trunk coordinate system to obtain the converted vehicle motion information. The head rotation information correction module 82 is specifically used to multiply the rotation matrix of the human body trunk coordinate system by the vehicle rotation angular velocity to obtain the converted vehicle rotation angular velocity.
[0153] In one possible implementation, the headphone motion information includes the headphone rotation angular velocity. When determining the target user's head rotation angular velocity based on the converted vehicle motion information and the headphone motion information, the head rotation information correction module 82 is specifically used to subtract the converted vehicle rotation angular velocity from the headphone rotation angular velocity to obtain the target user's head rotation angular velocity.
[0154] In one possible implementation, when determining the correction information of the virtual sound source of the in-car earphone according to the target user's head rotation angular velocity, the virtual sound source position determination module 83 is specifically used to determine the target user's current head rotation angle and current head rotation direction according to the target user's head rotation angular velocity; and determine the correction information of the virtual sound source of the in-car earphone according to the user's current head rotation angle and current head rotation direction.
[0155] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.
[0156] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0157] An embodiment of the present application also provides an in-vehicle headphone audio processing device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the computer program.
[0158] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.
[0159] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.
[0160] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0161] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0162] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0163] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0164] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0165] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A method for processing in-vehicle headphone audio, characterized in that: include: Acquire vehicle-mounted sensor data generated during driving of the vehicle and headphone movement information of headphones in the vehicle; Determine the target user's head rotation angular velocity according to the vehicle-mounted sensor data and the headset motion information; Determining correction information of the virtual sound source of the in-vehicle earphone according to the head rotation angular velocity of the target user; The position of the virtual sound source is corrected according to the correction information of the virtual sound source of the in-vehicle earphone.
2. The method for processing in-vehicle earphone audio according to claim 1, characterized in that: The vehicle-mounted sensor data includes: screen posture information, seat back tilt information and vehicle motion information. The step of determining the head rotation angular velocity of the target user according to the vehicle-mounted sensor data and the headphone motion information includes: Determining adjustment information of a human torso coordinate system according to the posture information and the backrest tilt information, wherein the human torso coordinate system is pre-constructed according to the orientation of the seat; Converting the vehicle motion information according to the adjustment information of the human body trunk coordinate system to obtain converted vehicle motion information; The head rotation angular velocity of the target user is determined according to the converted vehicle motion information and the earphone motion information.
3. The method for processing in-vehicle earphone audio according to claim 2, characterized in that: The posture information includes the screen position and screen tilt angle of the screen; the backrest tilt information includes the backrest tilt angle of the seat; The step of determining adjustment information of a human body trunk coordinate system according to the posture information and the backrest tilt information comprises: Determining a first rotation angle of the human body trunk coordinate system according to the screen position; Determining a second rotation angle of the human body trunk coordinate system according to the screen tilt angle; Determining a third rotation angle of the human body trunk coordinate system according to the backrest inclination angle; Adjustment information of the human body trunk coordinate system is determined according to the first rotation angle of the human body trunk coordinate system, the second rotation angle of the human body trunk coordinate system, and the third rotation angle of the human body trunk coordinate system.
4. The method for processing in-vehicle earphone audio according to claim 2, characterized in that: The step of converting the vehicle motion information according to the adjustment information of the human body trunk coordinate system to obtain the converted vehicle motion information includes: Determining a rotation matrix of the human body trunk coordinate system according to the adjustment information of the human body trunk coordinate system; The vehicle motion information is transformed according to the rotation matrix of the human body trunk coordinate system to obtain the transformed vehicle motion information.
5. The method for processing in-vehicle earphone audio according to claim 4, characterized in that: The vehicle motion information includes the vehicle rotation angular velocity; The step of converting the vehicle motion information according to the rotation matrix of the human body trunk coordinate system to obtain the converted vehicle motion information includes: The rotation matrix of the human body trunk coordinate system is multiplied by the vehicle rotation angular velocity to obtain the converted vehicle rotation angular velocity.
6. The method for processing in-vehicle earphone audio according to claim 5, characterized in that: The headphone motion information includes a headphone rotation angular velocity, and determining the head rotation angular velocity of the target user according to the converted vehicle motion information and the headphone motion information includes: The converted vehicle rotation angular velocity is subtracted from the headset rotation angular velocity to obtain the head rotation angular velocity of the target user.
7. The method for processing in-vehicle earphone audio according to claim 1, characterized in that: The determining, according to the head rotation angular velocity of the target user, correction information of the virtual sound source of the in-vehicle earphone comprises: Determining a current head rotation angle and a current head rotation direction of the target user according to the head rotation angular velocity of the target user; The correction information of the virtual sound source of the in-vehicle earphone is determined according to the current head rotation angle and the current head rotation direction of the user.
8. A device for processing in-vehicle headphone audio, characterized in that: include: An information acquisition module, used to acquire vehicle-mounted sensor data generated during driving of the vehicle and headphone motion information of headphones in the vehicle; A head rotation information correction module, used to determine the head rotation angular velocity of the target user according to the vehicle-mounted sensor data and the headset motion information; A virtual sound source position determination module, used to determine correction information of the virtual sound source of the in-vehicle earphone according to the head rotation angular velocity of the target user; The virtual sound source position adjustment module is used to correct the position of the virtual sound source according to the correction information of the virtual sound source of the in-vehicle earphone.
9. A device for processing in-vehicle headphone audio, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
Citation Information
Cited By
A TDOA positioning apparatus and method based on LTE downlink signals
CN122846386A
