Vehicle audio playing method and device, equipment and storage medium

Abstract

A method, apparatus, device, and storage medium for playing audio in a vehicle are disclosed. The method includes determining a target object and the audio to be played within the vehicle; determining the audio propagation trajectory based on the array arrangement direction of the speaker array in the vehicle and the position of the target object; determining the delay parameters of the target speaker units in the speaker array based on the propagation trajectory; and determining the time point at which the target speaker units play the audio based on the delay parameters, so that the sound energy of the audio propagates along the propagation trajectory. The technical solution of this disclosure first determines the audio propagation trajectory based on the array arrangement direction of the speaker array and the position of the target object; then, based on the propagation trajectory, determines the delay parameters of multiple target speaker units. In this way, the audio played by multiple target speaker units can be phase-modulated separately, so that the sound energy of each target speaker unit propagates along the propagation trajectory, thereby forming an independent sound zone for the target object in space.

Description

Technical Field

[0001] This disclosure relates to the field of audio processing technology, and in particular to a method, apparatus, device and storage medium for playing audio in a vehicle. Background Technology

[0002] With the increasing demand for in-vehicle infotainment systems and personalized cabin experiences, there is a need to provide relatively independent audio content for different people within the limited vehicle space. For example, if the driver is listening to navigation while the front passenger is listening to music, separate audio content needs to be provided for both the driver and passenger to ensure privacy and sound quality.

[0003] Currently, the main technology used in this field is the sound field reproduction technology of speaker arrays to provide relatively independent audio content for different users. However, this technology requires the arrangement of speaker units in three-dimensional space, and the algorithm is complex. Summary of the Invention

[0004] To address the aforementioned technical problems, this disclosure provides a vehicle audio playback method, apparatus, device, and storage medium that can solve the problems of high requirements for speaker array layout and complex algorithms in related technologies.

[0005] The first aspect of this disclosure provides a vehicle audio playback method, comprising: determining a target object inside the vehicle and audio information to be played; determining a propagation trajectory corresponding to the audio information based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object; determining delay parameters of multiple target speaker units in the speaker array based on the propagation trajectory; and determining the time point at which the multiple target speaker units play the audio information based on the delay parameters, so that the sound energy of the audio information propagates along the propagation trajectory.

[0006] A second aspect of this disclosure provides a vehicle audio playback device, comprising: an information determination module for determining a target object inside the vehicle and audio information to be played; a trajectory determination module for determining a propagation trajectory corresponding to the audio information based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object; a parameter determination module for determining delay parameters of multiple target speaker units in the speaker array based on the propagation trajectory; and a time point determination module for determining the time point at which the multiple target speaker units play the audio information based on the delay parameters, so that the sound energy of the audio information propagates along the propagation trajectory.

[0007] A third aspect of this disclosure provides a computer-readable storage medium storing a computer program for performing the vehicle audio playback method provided in the first aspect embodiment.

[0008] A fourth aspect of this disclosure provides an electronic device comprising: a processor; a memory for storing processor-executable instructions; and a processor for reading executable instructions from the memory and executing the instructions to implement the vehicle audio playback method provided in the first aspect embodiment above.

[0009] A fifth aspect of this disclosure provides a computer program product that, when instructions in the computer program product are executed by a processor, performs the vehicle audio playback method provided in the first aspect of the present invention.

[0010] The vehicle audio playback method disclosed herein first determines the propagation trajectory of audio information based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object; then, based on the propagation trajectory of the audio information, it determines the delay parameters of multiple target speaker units in the speaker array; thus, it can perform phase modulation on the audio information played by multiple target speaker units respectively, so that the sound energy of the audio information played by each target speaker unit propagates along the propagation trajectory, thereby forming an independent sound zone of the target object in space, and thus allowing different target objects to correspond to different sound zones without interfering with each other. Attached Figure Description

[0011] Figure 1 This is a schematic diagram of a speaker array in a vehicle provided as an exemplary embodiment of the present disclosure.

[0012] Figure 2 This is a schematic flowchart of a vehicle audio playback method provided as an exemplary embodiment of the present disclosure.

[0013] Figure 3A A flowchart illustrating a vehicle audio playback method provided as another exemplary embodiment of this disclosure.

[0014] Figure 3B A schematic diagram of the trajectory of audio information to be propagated, provided as an exemplary embodiment of this disclosure.

[0015] Figure 4 A schematic flowchart of a vehicle audio playback method provided as another exemplary embodiment of this disclosure.

[0016] Figure 5 This is a schematic flowchart of a vehicle audio playback method provided as yet another exemplary embodiment of this disclosure.

[0017] Figure 6 A schematic flowchart of a vehicle audio playback method provided as another exemplary embodiment of this disclosure.

[0018] Figure 7 This is a schematic flowchart of a vehicle audio playback method provided as yet another exemplary embodiment of this disclosure.

[0019] Figure 8A This is a schematic diagram of the sound field distribution of audio information provided for an exemplary embodiment of the present disclosure.

[0020] Figure 8B A schematic diagram of the sound field distribution of audio information provided for another exemplary embodiment of this disclosure.

[0021] Figure 9 This is a schematic diagram of the structure of a vehicle audio playback device provided as an exemplary embodiment of the present disclosure.

[0022] Figure 10 A schematic diagram of the structure of a vehicle audio playback device provided as another exemplary embodiment of this disclosure.

[0023] Figure 11 A schematic diagram of the structure of a vehicle audio playback device provided as another exemplary embodiment of this disclosure.

[0024] Figure 12 A schematic diagram of the structure of an electronic device provided for an exemplary embodiment of this disclosure. Detailed Implementation

[0025] To explain this disclosure, exemplary embodiments of the disclosure will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the disclosure, and not all of them. It should be understood that the disclosure is not limited to exemplary embodiments.

[0026] It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of this disclosure.

[0027] Application Overview

[0028] like Figure 1 As shown, a speaker array 11 is provided in the vehicle 10. The speaker array 11 includes multiple speaker units 12, which can play audio information. Furthermore, multiple target speaker units can be determined from the multiple speaker units 12 by the vehicle audio playback method provided in this embodiment of the present disclosure, and the same audio information played by the multiple target speaker units is phase-modulated (i.e., the playback time point of the audio information is controlled) so that the sound energy of the audio information played by each target speaker unit propagates along a set trajectory, thereby forming independent sound zones in space for each person (such as the driver, passengers in different positions). In this way, the sound zones corresponding to different people are different and do not interfere with each other.

[0029] It should be noted that, Figure 1 For illustrative purposes only, the array spatial configuration of the speaker array 11 in the vehicle, in addition to... Figure 1Besides the linear array shown, it may also include planar arrays, three-dimensional arrays, etc.; wherein, a linear array is a one-dimensional array formed by arranging speaker units along a one-dimensional direction; a planar array is a two-dimensional array formed by arranging speaker units in a two-dimensional plane; and a three-dimensional array is a three-dimensional array formed by arranging speaker units in three-dimensional space. That is to say, the embodiments of this disclosure... Figure 1 The number, array spatial configuration, and position of the loudspeaker array 11 are not limited. Similarly, the embodiments of this disclosure do not limit the number or type of loudspeaker units in the loudspeaker array 11.

[0030] Among related technologies, there are two main methods to provide independent audio content for different occupants in a vehicle. One method is to use headrest speakers. However, since this method only considers the sound at the corresponding headrest position, it often results in significant sound leakage. The other method is sound field reproduction technology based on speaker arrays. This technology requires arranging speaker units in three-dimensional space, and its algorithm is complex and has certain robustness issues.

[0031] To address the aforementioned issues, this disclosure provides a vehicle audio playback method. First, based on the array arrangement direction of the speaker array in the vehicle and the location information of the target object, the propagation trajectory of the audio information is determined. Then, based on the propagation trajectory of the audio information, the delay parameters of multiple target speaker units in the speaker array are determined. In this way, the same audio information played by multiple target speaker units can be phase-modulated separately, causing the sound energy of the audio information played by each target speaker unit to propagate along the propagation trajectory, thereby forming an independent sound zone for the target object in space. This allows different target objects to correspond to different sound zones without interfering with each other.

[0032] Exemplary methods

[0033] Figure 2 This is a schematic flowchart illustrating a vehicle audio playback method provided as an exemplary embodiment of the present disclosure. The method of this embodiment can be applied to electronic devices, such as... Figure 2 As shown, the method includes steps S21-S24.

[0034] Step S21: Determine the target object inside the vehicle and the audio information to be played.

[0035] For example, the target audience within the vehicle refers to the occupants who are inside the vehicle and currently require audio information playback. For instance, this target audience could be the driver who needs to listen to navigation information, or a rear-seat passenger who needs to listen to entertainment information. Furthermore, the audio information to be played refers to the audio content that the target audience currently needs to listen to. Examples include various types of audio content such as navigation voice prompts, music, telephone voice messages, podcasts, and audiobooks.

[0036] In some examples, the target object can be identified using sensors built into the vehicle, such as infrared sensors, cameras combined with facial recognition technology, and seat pressure sensors, to accurately locate the position of objects within the vehicle. The audio information to be played can be determined based on user commands (such as selecting music via the vehicle's central control screen or receiving navigation instructions) or system preset rules (such as automatically playing news information based on time). Furthermore, after identifying the target object within the vehicle and the audio information to be played for that target object, the playback time of the audio information in each target speaker unit can be determined using the methods in steps S22-S24, thereby achieving the effect that the sound energy of the audio information can propagate along the trajectory of the target object.

[0037] It should be noted that the embodiments disclosed herein do not limit the method of determining the location of the target object. Those skilled in the art can choose an appropriate method to determine the location of the target object and the corresponding audio information based on the actual scenario.

[0038] Step S22: Based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object, determine the trajectory to be propagated corresponding to the audio information.

[0039] For example, in this embodiment of the disclosure, a speaker array refers to a generating structure composed of multiple speaker units arranged according to a preset rule inside a vehicle; and each speaker unit is an independent minimum sound-producing unit. The array arrangement direction of the speaker array refers to the spatial orientation of the speaker array. For example, the array arrangement direction of the speaker array can be the transverse direction of the vehicle, i.e., along the width of the dashboard; or the array arrangement direction of the speaker array can be the longitudinal direction, i.e., along the front-to-back direction of the vehicle. Of course, the array arrangement direction of the speaker array can also be other specific directions, and this embodiment of the disclosure does not limit this.

[0040] In some examples, the location information of the target object can be accurately represented by two-dimensional coordinate values ​​(such as coordinate values ​​in a two-dimensional coordinate system determined by the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin). These coordinate values ​​can be detected by sensors on the vehicle and calculated. The trajectory to be propagated corresponding to the audio information refers to the path followed by the sound energy of the audio information when propagating in space. In this embodiment of the present disclosure, the purpose of determining the trajectory to be propagated corresponding to the audio information is to enable the sound energy of the audio information to propagate along the trajectory to be propagated where the target object is located, thereby forming a clear, independent, and concentrated sound field on the trajectory to be propagated where the target object is located. That is to say, in this embodiment of the present disclosure, the target object is located on the trajectory to be propagated, that is, the coordinate point of the target object in the above-mentioned two-dimensional coordinate system is located on the coordinate trajectory corresponding to the trajectory to be propagated.

[0041] Furthermore, embodiments of this disclosure can determine the trajectory to be propagated for audio information based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object.

[0042] Step S23: Based on the trajectory to be propagated, determine the delay parameters of multiple target loudspeaker units in the loudspeaker array.

[0043] For example, multiple target speaker units can be identified from the speaker units included in the speaker array first, and then the delay parameters corresponding to each of the multiple target speaker units can be determined based on the propagation trajectory corresponding to the audio information.

[0044] In some examples, multiple target speaker units can be determined from the speaker array based on the arrangement characteristics of the speaker array and the trajectory shape of the path to be propagated. For example, a two-dimensional coordinate system can be first determined using the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin. Then, a first coordinate point on the path to be propagated is determined, and the tangent line of the path to be propagated at the first coordinate point is determined; further, the intersection point of the tangent line and the first coordinate axis is determined, and the speaker unit at the intersection point is determined as the target speaker unit; wherein, the first coordinate point can be any coordinate point on the path to be propagated, thereby determining multiple target speaker units.

[0045] In some examples, the delay parameters corresponding to each of the multiple target speaker units refer to the time offset of the target speaker unit relative to a preset reference time point. These parameters control the triggering sequence of the corresponding target speaker unit's audio information playback, thereby enabling the sound waves emitted by the multiple target speaker units to effectively superimpose during propagation to form a sound beam propagating along the trajectory to be propagated. In this embodiment, the delay parameters corresponding to each of the multiple target speaker units can be determined based on the trajectory to be propagated. For example, the tangent to the trajectory to be propagated can be determined first, then the correlation between the tangent and the target speaker units can be determined, and finally the delay parameters of the target speaker units can be determined based on this correlation.

[0046] Step S24: Based on the delay parameters, determine the time points at which multiple target loudspeaker units play audio information so that the sound energy of the audio information propagates along the trajectory to be propagated.

[0047] For example, after determining the delay parameters corresponding to each of the multiple target speaker units, the audio information playback time point of each target speaker unit can be calculated based on the preset reference playback time point and the delay parameters of each target speaker unit, so that the sound energy of the audio information propagates along the trajectory to be propagated.

[0048] For example, if the preset reference time point is t0, and the delay parameter of target speaker unit 1 is Δt1, then the time point at which target speaker unit 1 plays audio information is t0 + Δt1; similarly, if the delay parameter of target speaker unit 2 is Δt2, then the time point at which target speaker unit 2 plays audio information is t0 + Δt2, and so on. Furthermore, by precisely controlling different target speaker units to play the same audio information at different time points, the sound energy of the audio information forms a directional sound beam that propagates along the trajectory to be propagated where the target object is located, thus creating an independent and clear sound zone for the target object.

[0049] Those skilled in the art will know that controlling the timing of the audio signal played by each target speaker unit is equivalent to modulating the phase of multiple target speaker units. Therefore, the vehicle audio playback method provided in this embodiment can perform phase modulation on the same audio information played by multiple target speaker units respectively, so that the sound energy of the audio information played by each target speaker unit propagates along the trajectory to be propagated, thereby forming an independent sound zone of the target object in space, and thus making different target objects correspond to different sound zones without interfering with each other.

[0050] like Figure 3A As shown above, in the above Figure 2 Based on the illustrated embodiment, step S22 may include steps S221-S223.

[0051] Step S221: Determine the trajectory function of the preset type.

[0052] For example, the trajectory functions of the preset type in this disclosure include, but are not limited to: convex trajectory functions, such as circular arcs, elliptical arcs, parabolas, Bézier convex curves, involutes, etc., and concave trajectory functions. For example, the trajectory function of the preset type can be... .

[0053] Step S222: Determine the parameter values ​​of the trajectory function based on the array arrangement direction of the speaker array and the position information of the target object.

[0054] For example, Figure 3B This is a schematic diagram of the trajectory of audio information to be propagated, provided in an embodiment of this disclosure. Figure 3B As shown, the speaker array in the vehicle is arranged laterally (i.e., parallel to the rear axle). Therefore, a two-dimensional coordinate system ZX is constructed using the vehicle's top view as the coordinate plane, the speaker array's arrangement direction as the X-axis, and the center of the speaker array as the origin. The target object's coordinates in this two-dimensional coordinate system are... This refers to the location information of the target object. Furthermore, it can be based on the origin of the two-dimensional coordinate system and the coordinates of the target object. Determine the trajectory function The parameter values ​​are used to determine the trajectory function. The complete expression.

[0055] It should be noted that, Figure 3B The convex trajectory function and the position information of the target object in the example are only examples. Those skilled in the art can determine the propagation trajectory of the target object according to the actual situation.

[0056] Step S223: Determine the trajectory to be propagated based on the trajectory function and the parameter values ​​of the trajectory function.

[0057] For example, the trajectory function of the preset type is The determined parameter values ​​of the trajectory function The trajectory to be propagated is .

[0058] The vehicle audio playback method provided in this disclosure determines a trajectory function of a preset type; determines the parameter values ​​of the trajectory function based on the array arrangement direction of the speaker array and the position information of the target object; and determines the trajectory to be propagated based on the trajectory function and the parameter values ​​of the trajectory function. In this way, the trajectory to be propagated where the target object is located can be determined, thereby laying the foundation for subsequently determining the delay parameters of each target speaker based on the trajectory to be propagated.

[0059] like Figure 4 As shown above, in the above Figure 3ABased on the illustrated embodiment, step S222 may include steps S2221-S2222.

[0060] Step S2221: Using the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin, determine a two-dimensional coordinate system.

[0061] For example, such as Figure 3B As shown, a two-dimensional coordinate system ZX can be determined by taking the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the X-axis, and the center of the speaker array as the origin.

[0062] Step S2222: Determine the parameter values ​​of the trajectory function based on the two-dimensional coordinate system and the position information of the target object; wherein, the target object is located on the trajectory to be propagated.

[0063] For example, suppose the location information of the target object is represented by a specific coordinate point in a two-dimensional coordinate system. The coordinate point needs to satisfy the expression of the trajectory function. For example, if the preset trajectory function is... ,in These are the parameter values ​​to be determined. Since the target object is located on the trajectory to be propagated, its coordinates... Must be satisfied At this point, the parameter values ​​in the trajectory function can be further determined by combining the coordinate system characteristics constructed by the array arrangement direction of the loudspeaker array (such as the coordinate values ​​of the origin, the direction of the coordinate axes, etc.) and other possible constraints.

[0064] The vehicle audio playback method provided in this embodiment determines a two-dimensional coordinate system by using the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin. Based on the two-dimensional coordinate system and the position information of the target object, the parameter values ​​of the trajectory function are determined. The target object is located on the trajectory to be propagated. In this way, the specific parameter values ​​of the trajectory function can be determined quickly and accurately, thereby obtaining the trajectory to be propagated.

[0065] like Figure 5 As shown above, in the above Figure 2 Based on the illustrated embodiment, step S23 may include steps S231-S233.

[0066] Step S231: Based on multiple coordinate points on the trajectory to be propagated, determine the tangent line of the trajectory at each coordinate point.

[0067] For example, the multiple coordinate points in this embodiment can be any coordinate point on the propagation trajectory. For instance, the coordinate point can be the coordinate point where the target object is located, or it can be any other coordinate point on the propagation trajectory besides the location of the target object. Furthermore, the tangent lines of the propagation trajectory at each coordinate point can be determined. Further, multiple target speaker units can be determined through multiple tangent lines; wherein each tangent line corresponds to one target speaker unit.

[0068] Step S232: Based on the tangent and the speaker array, identify multiple target speaker units from the speaker array.

[0069] For example, a two-dimensional coordinate system can be determined first by taking the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin of the coordinate system; then, based on the tangents corresponding to each coordinate point and the trajectory to be propagated, the intersection points of each tangent with the first coordinate axis can be determined; and then, the speaker units at the locations of each intersection point can be determined as the target speaker units.

[0070] Step S233: Determine the relationship between the tangent and the target speaker unit, and based on the relationship, determine the delay parameters of the target speaker unit.

[0071] For example, such as Figure 3B As shown, taking the coordinate point in step S231 as the coordinate position of the target object as an example, the coordinate point at this time... The corresponding coordinates of the target speaker unit are coordinates The slope of the tangent at point is The intercept of the tangent on the X-axis is ,in, Therefore, the intercept can be determined based on the above three formulas. The relationship with the slope of the tangent is: This relationship is the correlation between the tangent and the target loudspeaker unit in step S233. Furthermore, the phase of the target loudspeaker unit can be determined according to Fermat's principle. Modulation is performed so that ;in, The wavenumber is the number of the audio information. The wavenumber represents the complete waveform contained within a unit of space, and the unit is radians per meter. Frequency-related , λ is the wavelength.

[0072] Therefore, the phase of the target loudspeaker unit It can be determined by the following formula (1): (1); in, This refers to the minimum value of the target loudspeaker on the X-axis. It is the standard integral formula. Since this embodiment calculates the phase difference, therefore... The phase of the target loudspeaker unit at the coordinate position is integrated as a reference phase, so that... The audio information played by the target speaker unit at the coordinate position and other target speaker units forms a delayed summation wavenumber (phase aligned at the tangent point).

[0073] At the same time, the delay of the target speaker unit can be adjusted. To adjust the phase of the target speaker unit Therefore, delay It can be determined by the following formula (2): (2); in, Let be the speed of sound for audio information. From formula (2), we can see that the delay of the target loudspeaker unit... It is a parameter independent of the frequency of the audio information. Therefore, the delay parameter of the target loudspeaker unit can be determined using formula (2). Thus, for any convex trajectory function... The phase of the target speaker unit mounted on the X-axis can be adjusted. This causes the acoustic energy of the audio information played by the target loudspeaker unit to follow a convex trajectory. spread.

[0074] The vehicle audio playback method provided in this disclosure determines the tangent of the trajectory to be propagated at each coordinate point based on multiple coordinate points on the trajectory to be propagated; determines multiple target speaker units from the speaker array based on the tangent and the speaker array; determines the correlation between the tangent and the target speaker units, and determines the delay parameters of the target speaker units based on the correlation; thus, it is possible to determine the target speaker units corresponding to each coordinate point on the trajectory to be propagated, and determine the delay parameters of the target speaker units through the correlation between the tangent of the trajectory to be propagated at the coordinate points and the target speaker units, thereby ensuring that the sound energy of the audio information played by each target speaker unit propagates along the trajectory to be propagated.

[0075] like Figure 6 As shown above, in the above Figure 5 Based on the illustrated embodiment, step S233 may include steps S2331-S2333.

[0076] Step S2331: Determine the relationship between the tangent and the target speaker unit.

[0077] For example, in Figure 3B Based on this, assuming the trajectory function of the preset type is ;in, This is a constant, representing the parameter value of the trajectory function. At this point, the coordinates of the point... The slope of the tangent at point is The intercept of the tangent on the X-axis is ,in, Therefore, based on the above three formulas, the following can be eliminated. and ,get Furthermore, the result is... This refers to the relationship between the tangent and the target speaker unit in step S2331.

[0078] Step S2332: Determine the sound velocity of the audio information and the position information of the target speaker unit.

[0079] For example, the speed of sound of audio information refers to the speed at which audio information travels through the air inside the vehicle. Its value is affected by environmental factors such as the temperature and humidity inside the vehicle. In practical applications, it can be measured according to specific environmental parameters or a standard reference value can be used. The position information of the target speaker unit refers to the coordinate position of the target speaker unit in a preset coordinate system. For example, the position information of the target speaker unit can be the coordinate position of the target speaker unit in the aforementioned two-dimensional coordinate system. .

[0080] Step S2333: Determine the delay parameters of the target loudspeaker based on the correlation, sound velocity, and the position information of the target loudspeaker unit.

[0081] For example, as can be seen from the above formula (2), the delay of the target loudspeaker unit is... It is a parameter independent of the frequency of the audio information. Therefore, in this embodiment of the disclosure, the delay parameter of the target loudspeaker can be determined based on the correlation, the sound velocity of the audio information, and the coordinate position of the target loudspeaker unit.

[0082] In some examples, Figure 3B Based on this, assuming the trajectory function of the preset type is At this point, due to the trajectory function The intersection of the tangent at any coordinate point with the X-axis lies on the negative half of the X-axis. Therefore, the speaker unit located on the negative half of the X-axis can be considered the target speaker unit. Furthermore, the phase of the target speaker unit can be determined using the following formula (3): (3); Furthermore, the delay corresponding to the target loudspeaker unit is determined using the following formula (4): (4); As can be seen from the above formula (4), the determination of the delay parameter in step S2333 is related to the sound velocity of the audio information and the coordinate position of the target speaker unit. and related relationships Related.

[0083] The vehicle audio playback method provided in this disclosure determines the correlation between the tangent and the target speaker unit; determines the sound speed of the audio information and the position information of the target speaker unit; and determines the delay parameters of the target speaker based on the correlation, sound speed, and position information of the target speaker unit. In this way, the delay parameters of the target speaker unit can be determined simply and accurately, thereby controlling the output of the speaker array so that the synthesized sound waves interfere and superimpose in space, and the sound energy is concentrated and propagates along the trajectory to be propagated.

[0084] like Figure 7 As shown above, in the above Figure 5 Based on the illustrated embodiment, step S232 may include steps S2321-S2323.

[0085] Step S2321: Using the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin, determine a two-dimensional coordinate system.

[0086] For example, such as Figure 3B As shown, a two-dimensional coordinate system ZX can be determined by taking the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the X-axis, and the center of the speaker array as the origin.

[0087] Step S2322: Determine the intersection points of each tangent line with the first coordinate axis.

[0088] For example, since there are multiple coordinate points on the propagation trajectory, the tangents of the propagation trajectory at each coordinate point can be determined first, and then the intersection points of each tangent with the coordinate axis of the speaker array can be determined.

[0089] Step S2323: Based on multiple intersection points, determine multiple target speaker units from the speaker array.

[0090] For example, after determining the intersection points of each tangent line with the coordinate axis of the speaker array, it is necessary to determine whether a speaker unit exists at that intersection point. Since the speaker array is arranged according to a certain pattern on the first coordinate axis, each speaker unit has a fixed coordinate position on that axis. Therefore, the coordinates corresponding to the intersection points can be matched with the coordinate positions of each speaker unit in the speaker array. If the coordinate position of a speaker unit coincides with or is close to the coordinates of the intersection point (considering possible slight deviations in actual installation), then that speaker unit is identified as the target speaker unit. In this way, tangent lines at multiple coordinate points on the propagation trajectory can be matched to corresponding target speaker units.

[0091] The vehicle audio playback method provided in this embodiment of the present disclosure determines a two-dimensional coordinate system by using the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin of the coordinate system; determining the intersection points of each tangent line with the first coordinate axis; and determining multiple target speaker units from the speaker array based on multiple intersection points. In this way, multiple target speaker units can be determined from the speaker array based on the trajectory to be propagated, and then the audio information of the target object can be played using these target speaker units based on delay parameters.

[0092] In some embodiments, the vehicle audio playback method further includes: performing real-time detection of the target object to determine the real-time position of the target object; and adjusting the target trajectory based on the real-time position of the target object.

[0093] For example, the location information of a target object (such as a driver or passenger) can be detected in real time using sensors built into the vehicle, such as cameras, radar or infrared sensors, seat pressure sensors, and microphone arrays. For instance, a camera can use facial recognition technology to track the facial feature points of the target object and then calculate its real-time three-dimensional coordinates in the vehicle coordinate system. When the movement of the target object's face is detected, such as the driver's head shifting or changing seats, the shape or parameters of the propagation trajectory can be dynamically adjusted based on the new real-time location information. The multiple target speaker units under the adjusted propagation trajectory, as well as the phase delay parameters corresponding to each target speaker unit, can then be redefined to ensure good sound coverage even when the target object moves or changes posture.

[0094] For example, if the target object moves from the passenger seat to the back seat of the vehicle, the starting point, ending point, or overall direction of the propagation trajectory needs to be changed accordingly to ensure that the adjusted trajectory always covers the real-time position of the target object, thereby ensuring that the sound energy of the audio information can be continuously and accurately propagated along the propagation trajectory where the target object is located.

[0095] Figure 8AThis is a schematic diagram of the sound field distribution of audio information provided in an embodiment of the present disclosure, such as... Figure 8A As shown, there are target object A and target object B inside the vehicle. The dashed line 81 represents the trajectory to be propagated for target object A. The data expression for this trajectory is: When the audio frequency is 500 Hz, a sound contrast ratio of over 10 dB can be achieved. Sound contrast ratio is a core indicator for measuring the effectiveness of sound field zoning control; it refers to the ratio of sound energy (sound pressure squared) between the target listening area (bright area) and the non-target area (dark area).

[0096] Figure 8B This is another schematic diagram of the sound field distribution of audio information provided in an embodiment of this disclosure, such as... Figure 8B As shown, similarly, there are target object A and target object B within the vehicle. The dashed line 81 represents the trajectory to be propagated for target object A, and the data expression for this trajectory is: When the audio frequency is 1000 Hz, a sound contrast ratio exceeding 20 dB can be achieved. Figure 8A and Figure 8B The horizontal axis in the middle (e.g.) Figure 3B The Z-axis in the diagram represents the propagation distance of the sound wave, in meters; the ordinate axis (e.g., ...) represents the distance the sound wave travels. Figure 3B The X-axis represents the horizontal spatial position, with the unit being meters; the unit of the color bar on the right is decibels (dB), used to represent the normalized sound pressure level.

[0097] This shows that within the effective operating frequency band of the loudspeaker array, the higher the frequency, the stronger the directivity of the sound wave, the narrower the main lobe width of the bright area (the area where the target object A is located), the clearer the spatial boundary between the bright area and the dark area (the area where the target object B is located), and the more obvious the zone focusing effect.

[0098] Of course, if target object A and target object B need to play different audio information simultaneously, different propagation trajectories can be designed based on the respective positions of target object A and target object B. Different propagation trajectories correspond to the different audio ranges of the target objects, and the trajectories do not overlap or minimize overlap in space. Furthermore, different audio information is assigned to different propagation trajectories, covering different audio ranges of the target objects respectively. The sound energy between each audio range is separated and phase optimized to prevent interference.

[0099] Exemplary device

[0100] Figure 9 A vehicle audio playback device provided in this disclosure embodiment, such as Figure 9As shown, the vehicle audio playback device 90 includes an information determination module 91, a trajectory determination module 92, a parameter determination module 93, and a time point determination module 94.

[0101] The information determination module 91 is used to determine the target object inside the vehicle and the audio information to be played. The trajectory determination module 92 is used to determine the trajectory to be propagated corresponding to the audio information based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object; The parameter determination module 93 is used to determine the delay parameters of multiple target loudspeaker units in the loudspeaker array based on the trajectory to be propagated. The timing determination module 94 is used to determine the timing of audio information playback by multiple target loudspeaker units based on delay parameters, so that the sound energy of the audio information propagates along the trajectory to be propagated.

[0102] In some embodiments, such as Figure 10 As shown, the trajectory determination module 92 includes a function determination unit 921, a parameter value determination unit 922, and a trajectory determination unit 923.

[0103] Function determination unit 921 is used to determine a trajectory function of a preset type; The parameter value determination unit 922 is used to determine the parameter values ​​of the trajectory function based on the array arrangement direction of the speaker array and the position information of the target object. The trajectory determination unit 923 is used to determine the trajectory to be propagated based on the trajectory function and the parameter values ​​of the trajectory function.

[0104] In some embodiments, the parameter value determination unit 922 is specifically used to determine a two-dimensional coordinate system with the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin of the coordinate system; and to determine the parameter values ​​of the trajectory function based on the two-dimensional coordinate system and the position information of the target object; wherein the target object is located on the trajectory to be propagated.

[0105] In some embodiments, such as Figure 11 As shown, the parameter determination module 93 includes a tangent determination unit 931, a target loudspeaker determination unit 932, and a delay parameter determination unit 933.

[0106] Tangent determination unit 931 is used to determine the tangent of the trajectory to be propagated at each coordinate point based on multiple coordinate points on the trajectory to be propagated; The target loudspeaker determination unit 932 is used to determine a plurality of target loudspeaker units from the loudspeaker array based on tangent and loudspeaker array; The delay parameter determination unit 933 is used to determine the correlation between the tangent and the target speaker unit, and to determine the delay parameter of the target speaker unit based on the correlation.

[0107] In some embodiments, the delay parameter determination unit 933 is specifically used to determine the association between the tangent and the target speaker unit, and to determine the sound velocity of the audio information and the position information of the target speaker unit; based on the association, the sound velocity and the position information of the target speaker unit, the delay parameter of the target speaker is determined.

[0108] In some embodiments, the target loudspeaker determining unit 932 is specifically configured to determine a two-dimensional coordinate system with the top view of the vehicle as the coordinate plane, the array arrangement direction of the loudspeaker array as the first coordinate axis, and the center of the loudspeaker array as the origin of the coordinate system; determine the intersection points of each tangent with the first coordinate axis; and determine multiple target loudspeaker units from the loudspeaker array based on the multiple intersection points.

[0109] In some embodiments, the audio playback device 90 further includes: a real-time update module for real-time detection of the target object to determine the real-time position of the target object; and for adjusting the target trajectory based on the real-time position of the target object.

[0110] The beneficial technical effects corresponding to the above-described exemplary embodiment of the vehicle audio playback device 90 can be found in the corresponding beneficial technical effects in the above-described exemplary method section, and will not be repeated here.

[0111] Exemplary electronic devices

[0112] Figure 12 This is a structural diagram of an electronic device 120 provided in an embodiment of the present disclosure. The electronic device 120 includes at least one processor 121 and a memory 122.

[0113] The processor 121 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 120 to perform desired functions.

[0114] The memory 122 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 121 may execute one or more computer program instructions to implement the vehicle audio playback methods and / or other desired functions of the various embodiments of this disclosure described above.

[0115] In one example, the electronic device 120 may also include an input device 123 and an output device 124, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0116] The input device 123 may also include, for example, a keyboard, a mouse, etc.

[0117] The output device 124 can output various information to the outside, including, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0118] Of course, for the sake of simplicity, Figure 12 Only some of the components of the electronic device 120 relevant to this disclosure are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 120 may include any other suitable components depending on the specific application.

[0119] Exemplary computer program products and computer-readable storage media

[0120] In addition to the methods and apparatus described above, embodiments of this disclosure may also provide a computer program product, including computer program instructions that, when executed by a processor, cause the processor to perform the steps of the vehicle audio playback methods of various embodiments of this disclosure described in the "Exemplary Methods" section above.

[0121] Computer program products can be written in any combination of one or more programming languages ​​to perform the operations of embodiments of this disclosure. These programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on a user's computing device, partially on a user's computing device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0122] Furthermore, embodiments of this disclosure may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps in the vehicle audio playback methods of various embodiments of this disclosure described in the "Exemplary Methods" section above.

[0123] Computer-readable storage media may take the form of any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, but is not limited to, systems, apparatuses, or devices that are electrical, magnetic, optical, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0124] The basic principles of this disclosure have been described above with reference to specific embodiments. However, the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0125] Various modifications and variations can be made to this disclosure without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include such modifications and variations.

Claims

1. A method for playing vehicle audio, comprising: Identify the target objects inside the vehicle and the audio information to be played; Based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object, the trajectory to be propagated corresponding to the audio information is determined; Based on the propagation trajectory, the delay parameters of multiple target speaker units in the speaker array are determined; Based on the delay parameters, the timing point at which the plurality of target loudspeaker units play the audio information is determined so that the acoustic energy of the audio information propagates along the trajectory to be propagated.

2. The method according to claim 1, wherein, The step of determining the propagation trajectory corresponding to the audio information based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object includes: Determine the trajectory function of the preset type; Based on the array arrangement direction of the speaker array and the position information of the target object, the parameter values ​​of the trajectory function are determined; The trajectory to be propagated is determined based on the trajectory function and the parameter values ​​of the trajectory function.

3. The method according to claim 2, wherein, The determination of the parameter values ​​of the trajectory function based on the array arrangement direction of the speaker array and the position information of the target object includes: A two-dimensional coordinate system is determined with the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin. Based on the two-dimensional coordinate system and the position information of the target object, the parameter values ​​of the trajectory function are determined; The target object is located on the trajectory to be propagated.

4. The method according to claim 1, wherein, The step of determining the delay parameters of multiple target speaker units in the speaker array based on the propagation trajectory includes: Based on multiple coordinate points on the trajectory to be propagated, determine the tangent line of the trajectory to be propagated at each of the coordinate points; Based on the tangent and the speaker array, a plurality of target speaker units are determined from the speaker array; The correlation between the tangent and the target speaker unit is determined, and the delay parameters of the target speaker unit are determined based on the correlation.

5. The method according to claim 4, wherein, Determining the delay parameters of the target speaker unit based on the aforementioned correlation includes: Determine the sound speed of the audio information and the position information of the target speaker unit; Based on the correlation, the sound speed, and the position information of the target loudspeaker unit, the delay parameters of the target loudspeaker are determined.

6. The method according to claim 4, wherein, The step of determining multiple target speaker units from the speaker array based on the tangent and the speaker array includes: A two-dimensional coordinate system is determined with the top view of the vehicle as the coordinate plane, the array arrangement direction of the speaker array as the first coordinate axis, and the center of the speaker array as the origin. Determine the intersection points of each tangent line with the first coordinate axis; Based on the multiple intersection points, multiple target speaker units are determined from the speaker array.

7. The method according to any one of claims 1-6, further comprising: The target object is detected in real time to determine its real-time location; The trajectory of the target object is adjusted based on its real-time location.

8. A vehicle audio playback device, comprising: The information determination module is used to determine the target objects inside the vehicle and the audio information to be played. The trajectory determination module is used to determine the trajectory to be propagated corresponding to the audio information based on the array arrangement direction of the speaker array in the vehicle and the position information of the target object; The parameter determination module is used to determine the delay parameters of multiple target speaker units in the speaker array based on the propagation trajectory. The timing determination module is used to determine the timing of the playback of the audio information by the plurality of target speaker units based on the delay parameters, so that the sound energy of the audio information propagates along the trajectory to be propagated.

9. A computer-readable storage medium storing a computer program for performing the vehicle audio playback method according to any one of claims 1-7.

10. An electronic device, the electronic device comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the vehicle audio playback method according to any one of claims 1-7.

Images