Audio playing method, electronic equipment, system and vehicle

Abstract

The invention relates to the technical field of vehicle-mounted audio, in particular to an audio playing method, electronic equipment, a system and a vehicle. The method can obtain target audio data; under the condition that the target audio data is selected to be played in a spatial audio mode, a spatial track corresponding to the target audio data is obtained, and the spatial track is used for representing a moving track of the sound image in a preset space in the process of playing the target audio data; rendering the target audio data according to the spatial trajectory to obtain rendering data corresponding to the target audio data; and finally performing audio playing based on the rendering data. Therefore, spatial audio playing can be performed on the target audio data corresponding to the spatial trajectory, and the spatial effects of controlling the playing area of the target audio data and simulating movement and circulation of the target audio data among different directions can be achieved.

Description

Technical Field

[0001] The present application relates to the field of vehicle audio technology, and in particular to an audio playback method, electronic equipment, system and vehicle. Background Art

[0002] With the development of Internet of Vehicles and driverless technology, vehicles have gradually evolved from basic means of transportation to terminals that can be used to provide mobile entertainment services. For example, some vehicles can be equipped with an in-car KTV system to provide users with in-car karaoke functions to increase the fun of users on the road. Traditional in-car KTV systems can generate karaoke audio data by mixing human voice and accompaniment, and play karaoke audio through various speakers.

[0003] However, the traditional in-car KTV system has poor interactivity with users, and the playback effect of the generated karaoke audio is relatively simple, so the user's in-car karaoke experience is poor. Summary of the invention

[0004] In view of this, embodiments of the present application provide an audio playback method, electronic device, system and vehicle.

[0005] Specifically, in the first aspect, the present application provides an audio playback method, including: obtaining target audio data; when the target audio data is selected to be played as spatial audio, obtaining the spatial trajectory corresponding to the target audio data, the spatial trajectory is used to characterize the movement trajectory of the sound and image in a preset space during the playback of the target audio data; rendering the target audio data according to the spatial trajectory to obtain the rendering data corresponding to the target audio data; and playing audio based on the rendering data. In this way, the spatial audio playback of the target audio data corresponding to the spatial trajectory can be performed, which can achieve the spatial effect of controlling the playback area of ​​the target audio data and simulating the movement and flow of the target audio data between different directions.

[0006] In a possible implementation of the first aspect above, the method further includes: the target audio data includes first audio data and second audio data, and the spatial track includes a first spatial track corresponding to the first audio data and a second spatial track corresponding to the second audio data.

[0007] For example, the first audio data may be audio data input by a microphone (eg, human voice audio data), and the second audio data may be accompaniment audio data.

[0008] In a possible implementation of the first aspect above, the method further includes: the first audio data includes at least one first audio sub-data, and the first spatial track includes a first spatial sub-track corresponding to the first audio sub-data.

[0009] For example, the first audio sub-data may be one channel of human voice audio data among multiple channels of human voice audio data received by a microphone. For related content, reference may be made to the following description and will not be elaborated herein.

[0010] In a possible implementation of the first aspect above, the method also includes: when the target audio data is selected to be played as spatial audio, obtaining the spatial trajectory corresponding to the target audio data, including: when the target audio data is selected to be played as spatial audio, displaying a trajectory drawing interface; receiving a trajectory input by the user on the trajectory drawing interface; and using the trajectory input by the user as the spatial trajectory corresponding to the target audio data.

[0011] It can be understood that in other embodiments, the trajectory input by the user may be a single point. Please refer to the following description for details, which will not be elaborated here.

[0012] In a possible implementation of the first aspect above, the method also includes: when the target audio data is selected to be played in spatial audio, obtaining the spatial trajectory corresponding to the audio data, and also includes: when the target audio data is selected to be played in spatial audio, obtaining audio information of the target audio data; determining a preset trajectory matching the audio information in a preset trajectory library; and using the preset trajectory as the spatial trajectory corresponding to the target audio data.

[0013] For example, the audio information may be user information (eg, gender, age) corresponding to vocal audio data, or song information (eg, song type) corresponding to accompaniment audio data.

[0014] In a possible implementation of the first aspect above, the method also includes: when the target audio data is selected to be played as spatial audio, obtaining the spatial trajectory corresponding to the audio data, and also includes: when the target audio data is selected to be played as spatial audio, determining the user position of the target user in a preset space; obtaining a default trajectory corresponding to the user position; and using the default trajectory as the spatial trajectory corresponding to the target audio data.

[0015] In a possible implementation of the first aspect above, the method also includes: a preset number of speakers are arranged in a preset space, and the target audio data is rendered according to the spatial trajectory to obtain rendering data corresponding to the target audio data, including: based on a preset sampling rule, determining a first number of trajectory sampling points in the spatial trajectory; determining the output data of each speaker when playing the target audio data according to the positional relationship between the trajectory sampling points and each speaker; and using the output data of each speaker as the rendering data corresponding to the target audio data.

[0016] In this way, by obtaining the trajectory sampling points in the spatial trajectory, the sound and image during audio playback can be located, thereby controlling the karaoke audio playback area and simulating the spatial effect of the karaoke audio moving between different directions, creating a more immersive in-car karaoke experience that can meet the user's personalized needs.

[0017] In a second aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors; one or more memories; one or more memories storing one or more programs, and when one or more programs are executed by one or more processors, the device executes the audio playback method provided in the above-mentioned first aspect and various possible implementations.

[0018] In a third aspect, an embodiment of the present application provides a vehicle-mounted audio system, which includes: an electronic device, a speaker, and a microphone; wherein the electronic device is the electronic device provided in the second aspect above.

[0019] In a fourth aspect, an embodiment of the present application provides a vehicle, which includes the vehicle audio system provided in the third aspect above.

[0020] The beneficial effects of the second and fourth aspects mentioned above can be found in the relevant descriptions of the first aspect and various possible implementations of the first aspect, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 Shown is a schematic diagram of areas for dividing the interior space of a vehicle provided in an embodiment of the present application.

[0022] Figure 2 The figure shows the playback effect of karaoke audio in a traditional car KTV system.

[0023] Figure 3a The figure shows a schematic diagram of a spatial trajectory for rendering human voice audio data provided by an embodiment of the present application.

[0024] Figure 3b The figure shows a schematic diagram of a spatial trajectory for rendering accompaniment audio data provided by an embodiment of the present application.

[0025] Figure 3c The figure shows a schematic diagram of different spatial trajectories for rendering multiple channels of human voice audio data respectively provided by an embodiment of the present application.

[0026] Figure 4a Shown is a schematic diagram of a spatial audio playback effect provided in an embodiment of the present application.

[0027] Figure 4b Shown is another schematic diagram of spatial audio playback effect provided in an embodiment of the present application.

[0028] Figure 4c Shown is another schematic diagram of spatial audio playback effect provided in an embodiment of the present application.

[0029] Figure 5 The figure is a schematic diagram of an implementation flow of an audio playback method provided in an embodiment of the present application.

[0030] Figure 6 The figure is a schematic diagram of the processing flow of an audio playback method provided in an embodiment of the present application.

[0031] Figure 7 The figure is a schematic diagram of the processing flow of another audio playback method provided in an embodiment of the present application.

[0032] Figure 8 Shown is a schematic diagram of an implementation environment of an audio playback method provided in an embodiment of the present application.

[0033] Fig. 9 Shown is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0034] Fig.10 Shown is a schematic block diagram of a vehicle 10 ′ provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0036] In order to facilitate those skilled in the art to understand the solutions in the embodiments of the present application, some concepts and terms involved in the embodiments of the present application are explained below.

[0037] (1) Panning: Also known as virtual sound source or perceived sound source, panning can be described as the virtual position point of the sound source in the sound field perceived by the listener, that is, the virtual sound direction. In the embodiment of the present application, the amplitude of the audio signal output by each speaker can be controlled to control the loudness of the sound output by each speaker, so as to achieve the purpose of positioning the sound image. At the same time, the dynamic change of the sound image, that is, the movement of the sound image, can be achieved by adjusting the amplitude of the audio signal output by each speaker, thereby achieving the spatial effect of the audio moving and flowing along a certain trajectory in the space.

[0038] (2) Vector-base amplitude panning (VBAP): VBAP is a sound spatialization technology that can determine the amplitude ratio of the audio signal allocated to each speaker (hereinafter referred to as the signal amplitude ratio) by establishing a coordinate system for defining the sound image and the position of each speaker, and performing vector calculation based on the sound image and the speaker position. Among them, the signal amplitude ratio allocated to the speaker closer to the sound image is higher, and the signal amplitude ratio allocated to the speaker farther from the sound image is lower. For example, in a two-channel (left and right) system, the left speaker position can be (-2,0) and the right speaker position can be (2,0). If the target sound image position is (1,0), it can be concluded according to the vector calculation that the signal amplitude ratio allocated to the right speaker is higher than the signal amplitude ratio allocated to the left speaker.

[0039] It is understood that when a user sings karaoke in a closed preset space, the karaoke audio can be played in various areas of the preset space through various speakers set in the preset space. The closed preset space can be, for example, the interior of a vehicle, a KTV room, a movie theater, a bedroom, etc., without limitation.

[0040] For the convenience of description, the following takes a vehicle with two rows of seats as an example to divide the space areas inside the vehicle. Figure 1 , the interior area of ​​the vehicle 10 is divided into the main driving area M (front left area), the passenger driving area (front right area) S, the rear area L (rear left area) and the rear area R (rear right area). That is, the main driving area M, the passenger driving area S, the rear area L and the rear area R together constitute the entire area inside the vehicle 10. In addition, a preset number of speakers can be set inside the vehicle 10. For example, 4 speakers can be preset inside the vehicle 10, which are respectively set in the main driving area M, the passenger driving area S, the rear area L and the rear area R. Figure 1 The speakers shown are M1, S1, L1 and R1.

[0041] As mentioned above, the traditional car KTV system has poor interactivity with users, and the playback effect of the generated K song audio is relatively simple. Figure 2 As shown, when four users in vehicle 10 select songs to sing together, the traditional in-vehicle KTV system mixes the voices V1, V2, V3, and V4 of the four users with the current accompaniment A, and then plays the karaoke audio in all areas inside vehicle 10 through each speaker. It is impossible to achieve personalized control of the karaoke audio playback area by the users, and the interactivity with the users needs to be improved. At the same time, the sound and image positions perceived by the four users are fixed, for example, Figure 1The middle position of the interior area of ​​the vehicle 10 shown makes the karaoke audio playback effect relatively simple and cannot provide the user with a rich auditory experience.

[0042] In order to solve the above problems, the present application provides an audio playback method, which can obtain the spatial trajectory of rendering the karaoke audio based on user information, song information and user input, and the spatial trajectory corresponds to the movement trajectory of the sound and image in the preset space, and obtain the first number of trajectory sampling points in the spatial trajectory based on the preset sampling rules, and determine the signal amplitude ratio allocated to each speaker according to the positional relationship between the trajectory sampling points and the positions of each speaker, and obtain the rendered karaoke audio. In this way, by obtaining the trajectory sampling points in the spatial trajectory, the sound and image during audio playback can be located, thereby achieving the spatial effect of controlling the karaoke audio playback area and simulating the movement and flow of karaoke audio between different directions, creating a more immersive in-car karaoke experience.

[0043] Wherein, the above-mentioned karaoke audio may include first audio data and second audio data. Wherein, the first audio data may be audio data corresponding to the audio signal picked up by the microphone, such as vocal audio data when the user is singing, and the first audio data may include at least one sub-audio data of the first audio data (hereinafter referred to as the first audio sub-data), that is, the vocal audio data may include multiple vocal audio data corresponding to different audio objects. The second audio data may be, for example, the accompaniment audio data of the song. Accordingly, the above-mentioned spatial trajectory for rendering the karaoke audio may include a first spatial trajectory for rendering the vocal audio data, and a second spatial trajectory for rendering the accompaniment audio data. Wherein, the first spatial trajectory includes at least one sub-space trajectory of the first spatial trajectory (hereinafter referred to as the first spatial sub-trajectory).

[0044] Among them, the first spatial trajectory can be a trajectory input by the user, or a preset trajectory obtained from a preset trajectory library based on user information (such as gender, age, etc.) and song information (such as style, etc.), or it can be a default trajectory determined based on the user's location. Among them, the preset trajectory library can be deployed in the cloud for users to download and upload spatial trajectories, or it can be deployed locally, without limitation here. Similarly, the second spatial trajectory can be a trajectory input by the user, or it can be a preset trajectory obtained from a preset trajectory library based on song information, or it can be a default trajectory determined based on the user's location, without limitation here.

[0045] Specifically, refer to Figure 3aAs shown, the electronic device of the vehicle 10′ (such as the vehicle computer C1, etc.) can be installed with a karaoke application, and the karaoke application can provide a track drawing function. In some embodiments, the track drawing function can also be provided by a separate track drawing application. The karaoke application can display a track drawing interface corresponding to the top view layout of the interior of the vehicle 10′, referring to Figure 3a The trajectory drawing interface 100 shown in FIG. 1 receives a personalized trajectory (i.e., a trajectory input by the user) for rendering target audio data, referring to FIG. Figure 3a The first spatial trajectory t1 for rendering the human voice audio data V1 input by the central driving user P1 is used to support the generation of a spatial effect corresponding to the movement and flow of the spatial trajectory during audio playback.

[0046] In some embodiments, the electronic device such as the vehicle computer C1 can obtain a spatial track that matches the target audio data based on the current song information and / or user information. For example, the user's gender and age information can be obtained by parsing the human voice audio data and according to the timbre corresponding to the human voice audio data, thereby obtaining a preset track that matches the user's gender and age. For another example, the preset track that matches the song type corresponding to the accompaniment audio data can be obtained by identifying the song type corresponding to the accompaniment audio data, which is not limited here.

[0047] In some embodiments, the electronic device such as the vehicle computer C1 can obtain a default track corresponding to the user position based on the user position. For example, the default track starting from the main driving area M can be obtained based on the position of the user P1 (such as the main driving position M), which is not limited here.

[0048] It can be understood that the electronic devices such as the vehicle computer C1 can render the target audio data based on the above-mentioned spatial trajectory to obtain rendering data corresponding to the target audio data.

[0049] Specifically, the vehicle-mounted electronic devices such as the vehicle computer C1 can obtain the first number of trajectory sampling points in the first spatial trajectory t1 based on a preset sampling rule, for example, sampling once every 10 ms, referring to Figure 3a The trajectory sampling points a, b, c, d and e shown in FIG. 1 , and the trajectory sampling points may correspond to the positions of the sound images in the moving trajectory, with reference to FIG. Figure 3a The sound image position A, sound image position B, sound image position C, sound image position D and sound image position E are shown.

[0050] It can be understood that the above-mentioned preset sampling rules can be jointly affected by factors such as the duration of the audio, the length of the spatial trajectory, and the current computing power resources of the vehicle-mounted electronic devices such as the vehicle C1. For example, the longer the duration of the audio, the more trajectory sampling points the electronic device may collect. For another example, the shorter the length of the spatial trajectory, the fewer the number of trajectory sampling points collected by the electronic device may be, which is not limited here.

[0051] Furthermore, electronic devices such as the vehicle computer C1 can determine the signal amplitude ratio allocated to each speaker within each preset time interval (for example, 100ms) through vector calculation according to the distance relationship between each trajectory sampling point and each speaker position in the order from the starting point of the spatial trajectory (for example, trajectory sampling point a) to the end point of the spatial trajectory (for example, trajectory sampling point e), for example, trajectory sampling point a→trajectory sampling point b→trajectory sampling point c→trajectory sampling point d→trajectory sampling point e, and then determine the output data of each speaker when playing the target audio data based on the signal amplitude ratio, and finally obtain the rendering data corresponding to the target audio data.

[0052] It can be understood that by adjusting the amplitude ratio of the audio signal allocated to each speaker within a preset time interval, the user can perceive the movement of the sound image during the audio playback process. For example, corresponding to the adjustment sequence of the above-mentioned trajectory sampling point a→trajectory sampling point b→trajectory sampling point c→trajectory sampling point d→trajectory sampling point e, the user can perceive the movement of the sound image from the sound image position A→the sound image position B→the sound image position C→the sound image position D→the sound image position E, that is, the spatial effect corresponding to the movement and flow of the first spatial trajectory t1 is achieved during the playback of the karaoke audio.

[0053] As an example, the distance relationship between the track sampling point a and the speakers M1, S1, L1, and R1 can be obtained based on the VBAP technology, where the speaker S1 is relatively close to the track sampling point a (corresponding to the sound image position A), while the speakers M1, L1, and R1 are relatively far from the track sampling point a. Therefore, a relatively high signal amplitude ratio can be assigned to the speaker S1, that is, the amplitude of the audio signal output by the speaker S1 is relatively large, and a relatively low signal amplitude ratio is assigned to the speakers M1, L1, and R1, so that the sound image can be controlled to be located at the sound image position A.

[0054] Similarly, after a preset time interval, the distance relationship between the trajectory sampling point b and the speakers M1, S1, L1, and R1 can be obtained, where the speaker M1 is relatively close to the trajectory sampling point b (corresponding to the sound image position B), while the speakers S1, L1, and R1 are relatively far from the trajectory sampling point b. Therefore, a relatively high signal amplitude ratio can be allocated to the speaker M1, that is, the amplitude of the audio signal output by the speaker M1 is relatively large, and a relatively low signal amplitude ratio is allocated to the speakers S1, L1, and R1, so that the sound image can be controlled to be located at the sound image position B.

[0055] Similarly, after a preset time interval, the distance relationship between the trajectory sampling point c and the speakers M1, S1, L1, R1 can be obtained, wherein the distances between the speakers M1, S1, L1, R1 and the trajectory sampling point c (corresponding to the sound image position C) are substantially the same. Therefore, the same signal amplitude ratio can be assigned to the speakers M1, S1, L1, R1, that is, the amplitudes of the audio signals output by the speakers M1, S1, L1, R1 are substantially the same, so that the sound image position can be controlled to be located at the sound image position C.

[0056] Similarly, after a preset time interval, the distance relationship between the trajectory sampling point d and the speakers M1, S1, L1, and R1 can be obtained, where the speaker L1 is relatively close to the trajectory sampling point d (corresponding to the sound image position D), while the speakers M1, S1, and R1 are relatively far from the trajectory sampling point d. Therefore, a relatively high signal amplitude ratio can be allocated to the speaker L1, that is, the amplitude of the audio signal output by the speaker M1 is relatively large, and a relatively low signal amplitude ratio is allocated to the speakers M1, S1, and R1, so that the sound image can be controlled to be located at the sound image position D.

[0057] Similarly, after a preset time interval, the distance relationship between the trajectory sampling point e and the speakers M1, S1, L1, R1 can be obtained, where speaker R1 is relatively close to the trajectory sampling point e (corresponding to the sound image position E), while speakers M1, S1, L1 are relatively far from the trajectory sampling point e. Therefore, a relatively high signal amplitude ratio can be assigned to speaker R1, that is, the amplitude of the audio signal output by speaker M1 is relatively large, while a relatively low signal amplitude ratio is assigned to speakers M1, S1, L1, so that the sound image can be controlled to be located at the sound image position E.

[0058] In this way, by dynamically adjusting the signal amplitude ratio allocated to each speaker, the output data of each speaker when playing the target audio can be determined, and finally the rendering data corresponding to the target audio data can be obtained, thereby realizing the rendering processing of the karaoke audio, so that the karaoke audio can produce a spatial effect corresponding to the movement and flow of the spatial trajectory during the playback process.

[0059] In some embodiments, if the spatial trajectory is a single point, for example Figure 3a The first spatial trajectory t1 shown only includes the trajectory sampling point a, and the sound image is fixed at the sound image position A of the passenger area S during audio playback. In this way, the effect of controlling the karaoke audio to play only in the specified area can be achieved, which meets the user's personalized needs for audio playback effects and improves the user's sense of interaction and experience during in-car karaoke.

[0060] As mentioned above, the spatial trajectory corresponds to the moving trajectory of the sound image in the preset space (hereinafter referred to as the sound image moving trajectory). For the convenience of description, the sound image moving trajectory shown inside the vehicle 10' in the following figures can correspond to the spatial trajectory obtained by the electronic equipment such as the vehicle computer C1, which is explained here.

[0061] Figure 3b A schematic diagram of a spatial trajectory for rendering accompaniment audio data provided by an embodiment of the present application is shown.

[0062] refer to Figure 3b As shown, the electronic device such as the vehicle computer C1 can render the accompaniment audio data A according to the second spatial trajectory t2, so that the accompaniment audio data produces a spatial effect corresponding to the movement and flow of the spatial trajectory t2 during the playback process. As mentioned above, the second spatial trajectory t2 can be a personalized trajectory input by the user on the trajectory drawing interface 100, or a preset trajectory obtained from a preset trajectory library, or a default trajectory obtained based on the user's position, which is not limited here. It can be understood that the process of rendering the accompaniment audio data according to the second spatial trajectory t2 can refer to the relevant description above, and will not be repeated here.

[0063] In some embodiments, when multiple users participate in the chorus, the electronic device such as the car computer C1 can control the multi-channel human voice audio data to play according to different effects. For example, the electronic device such as the car computer C1 can render the human voice audio data corresponding to different users according to different spatial trajectories.

[0064] As an example, refer to Figure 3c The first spatial sub-track t3 and the first spatial sub-track t4 are shown. The first spatial sub-track t3 is used to render the vocal audio data V1, so that the vocal audio data V1 generates a spatial effect corresponding to the movement and flow of the first spatial sub-track t3 during playback. Similarly, the first spatial sub-track t4 is used to render the vocal audio data V2, so that the vocal audio data V2 generates a spatial effect corresponding to the movement and flow of the first spatial sub-track t4 during playback. In this way, electronic devices such as the car computer C1 can render and process multiple channels of vocal audio data corresponding to different spatial tracks, which improves the fun of users in the process of singing karaoke in the car.

[0065] Figure 4a A schematic diagram of a spatial audio playback effect provided by an embodiment of the present application is shown.

[0066] refer to Figure 4aAs shown, the electronic device such as the vehicle computer C1 can render the human voice audio data V1 and the accompaniment audio data A corresponding to different spatial trajectories to achieve the effect of playing the human voice audio data V1 and the accompaniment audio data A in spatial audio. For example, the human voice audio data V1 can be rendered according to the first spatial trajectory t5, so that the human voice audio data V1 produces the effect of moving and flowing corresponding to the first spatial trajectory t5 during the playback process. The accompaniment audio data A is rendered according to the second spatial trajectory t6, so that the accompaniment audio data A produces the effect of moving and flowing corresponding to the second spatial trajectory t6 during the playback process.

[0067] Figure 4b A schematic diagram of another spatial audio playback effect provided by an embodiment of the present application is shown.

[0068] refer to Figure 4b As shown, the electronic device such as the vehicle computer C1 can render the human voice audio data V1, but not the accompaniment audio data A, to achieve the effect of playing the human voice audio data V1 as spatial audio and the accompaniment audio data not as spatial audio. For example, the human voice audio data V1 can be rendered according to the first spatial trajectory t7, so that the human voice audio data V1 produces the effect of moving and flowing corresponding to the first spatial trajectory t7 during the playback process. Without rendering the accompaniment audio data A, the accompaniment audio data A can maintain a single playback effect in all areas of the vehicle 10', for example, the sound image is always located in the middle position inside the vehicle 10'.

[0069] Figure 4c A schematic diagram of another spatial audio playback effect provided by an embodiment of the present application is shown.

[0070] refer to Figure 4c As shown, when multiple users participate in the chorus, electronic devices such as the car computer C1 can meet the personalized needs of users and control the playback of multiple channels of vocal audio data and accompaniment audio data with different effects.

[0071] For example, the electronic device such as the vehicle computer C1 can render the human voice audio data V1 and the human voice audio data V4 according to the first spatial sub-trajectory t11 and the first spatial sub-trajectory t22, respectively, so that the human voice audio data V1 and the human voice audio data V4 produce the effect of moving and flowing corresponding to the first spatial sub-trajectory t11 and the first spatial sub-trajectory t22 respectively during the playback process. The accompaniment audio data A is rendered according to the second spatial trajectory t33, so that the accompaniment audio data A produces the effect of moving and flowing corresponding to the second spatial trajectory t33 during the playback process. In addition, the electronic device such as the vehicle computer C1 can render the human voice audio data V2 by obtaining a single point input by the user, so that the sound and image of the human voice audio data V2 during the playback process is always fixed in the co-pilot area S. In addition, the human voice audio data V3 can also be played without spatial audio, that is, the human voice audio data V3 is not rendered, so that the human voice audio data V3 maintains a single playback effect in all areas of the vehicle 10', for example, the sound and image is always located in the middle position inside the vehicle 10'.

[0072] It is understandable that the above Figures 4a to 4c The relevant content describes several playback effects achieved by the audio playback method provided in the embodiment of the present application. In practical applications, the audio processing method provided in the embodiment of the present application can meet the personalized needs of users and achieve other playback effects including but not limited to the above-mentioned playback effects, which are not limited here.

[0073] The specific implementation process of the audio playback method provided in the embodiment of the present application is introduced below in conjunction with the accompanying drawings.

[0074] Specifically, Figure 5 According to an embodiment of the present application, a flowchart of an implementation method of an audio playback method is shown.

[0075] Understandably, Figure 5 The execution subject of the implementation process shown can be the vehicle computer C1. To simplify the description, the execution subject of each step will not be repeated when the steps of the implementation process are specifically introduced below. In other embodiments, Figure 5 The execution subject of each step in the illustrated implementation process may also be other electronic devices with audio processing capabilities, such as a car-mounted tablet computer, etc., which is not limited here.

[0076] like Figure 5 As shown, the implementation process may include the following steps:

[0077] S501: Acquire target audio data.

[0078] Exemplarily, the target audio data is audio data without spatial audio effects, such as accompaniment audio data provided by a karaoke application, or audio data corresponding to an audio signal received by a car microphone, such as the human voice audio data.

[0079] S502: When the target audio data is selected to be played in spatial audio format, obtain a spatial trajectory corresponding to the target audio data.

[0080] For example, the vehicle computer C1 may obtain the spatial track corresponding to the target audio data in response to the user's instruction to play the target audio data with the spatial audio effect, and then continue to execute the following S503, rendering the audio data without the spatial audio effect into the corresponding audio data with the spatial audio effect (i.e., the rendering data) according to the spatial track, so that the target audio data is played with the spatial audio effect.

[0081] Among them, the operation of the user instructing to play the above-mentioned target audio data with a spatial audio effect may include, for example, the user clicking on a related control (such as a "turn on spatial audio" control) on a related application (such as a karaoke application) interface displayed on an electronic device such as the car computer C1, performing a preset gesture operation, issuing a voice command, etc., and is not limited here.

[0082] In some embodiments, the vehicle computer C1 can respond to the user's instruction to play multiple audio data in spatial audio, for example, play multiple vocal audio data and accompaniment audio data in spatial audio, and respectively obtain different spatial tracks corresponding to the multiple vocal audio data and accompaniment audio data. As mentioned above, the above spatial track can be, for example, a personalized track input by the user, or a preset track matching the song information corresponding to the accompaniment audio data, or a default track determined based on the user's location, which is not limited here.

[0083] In some embodiments, the vehicle computer C1 may display a trajectory drawing interface in response to the user's instruction to play the target audio data in spatial audio. Figure 3aThe trajectory drawing interface 100 shown receives the trajectory input by the user as the spatial trajectory corresponding to the target audio data. If the vehicle computer C1 does not detect the trajectory input by the user, the preset trajectory corresponding to the target audio data can be obtained from the preset trajectory library based on the audio information corresponding to the target audio data. As an example, the vehicle computer C1 can obtain a preset trajectory matching the song ID from the preset trajectory library based on the song identifier (identifier, ID) of the song corresponding to the current accompaniment audio data, or it can obtain a preset trajectory matching the song type (such as folk song) corresponding to the current accompaniment audio data from the preset trajectory library as the spatial trajectory corresponding to the target audio data, and there is no limitation here. If the vehicle computer C1 does not obtain a preset trajectory matching the audio information corresponding to the target audio data, it can obtain the default trajectory corresponding to the user position by determining the user position of the target user in the vehicle. For related content, please refer to the following Figure 7 The relevant description in will not be repeated here.

[0084] S503: Render the target audio data according to the spatial trajectory to obtain rendering data corresponding to the target audio data.

[0085] Exemplarily, electronic devices such as the vehicle computer C1 can render the target audio data based on the above-mentioned spatial trajectory to obtain the signal amplitude ratio allocated to each speaker to determine the output data of each speaker when playing the target audio data, thereby obtaining the rendering data corresponding to the target audio data.

[0086] As mentioned above, the vehicle computer C1 can respond to the user's instruction to play multiple channels of audio data in spatial audio, for example, play multiple channels of vocal audio data and accompaniment audio data in spatial audio, and obtain different spatial tracks corresponding to the multiple channels of vocal audio data and accompaniment audio data. Based on this, the vehicle computer C1 and other electronic devices can render the multiple channels of vocal audio data and accompaniment audio data in real time corresponding to different spatial tracks, obtain multiple rendering data corresponding to the multiple channels of vocal audio data and accompaniment data, and continue to execute the relevant content of the following S504 based on the multiple rendering data.

[0087] S504: Play audio based on the rendering data.

[0088] Exemplarily, electronic devices such as the vehicle computer C1 can perform audio playback based on the rendering data obtained in the above S503 to achieve the effect of playing the target audio data in spatial audio.

[0089] As mentioned above, the vehicle computer C1 can render multiple channels of human voice audio data and accompaniment audio data in real time corresponding to different spatial trajectories, and obtain multiple rendering data corresponding to the multiple channels of human voice audio data and accompaniment data. Based on this, the vehicle computer C1 can mix the multiple rendering data and play the mixed rendering data through the speaker.

[0090] Figure 6 According to an embodiment of the present application, a processing flow diagram of an audio playback method is shown.

[0091] Understandably, Figure 6 The execution subject of the implementation process shown can be the vehicle computer C1 or other electronic devices with audio processing capabilities, which will not be described in detail here. Figure 6 As shown, the vehicle audio system may include a data input terminal, an information input terminal, a data processing terminal, and a data output terminal.

[0092] In the audio playback method provided in the embodiment of the present application, target audio data (such as accompaniment audio data, vocal audio data) can be transmitted from the data input end to the data processing end.

[0093] At the same time, the information input end can determine the spatial trajectory for rendering the target audio data through the trajectory input module, the information perception module, and the cloud preset trajectory module, and transmit the determined spatial trajectory to the data processing end. Among them, the trajectory input module can enable the user to input the trajectory in the trajectory drawing interface corresponding to the trajectory drawing application, and obtain the spatial trajectory based on the trajectory input by the user. The information perception module can obtain user information, song information, user location, etc. The cloud trajectory module can store preset trajectories corresponding to user information and / or song information.

[0094] Based on the input from the data input terminal and the information input terminal, the data processing terminal renders the target audio data corresponding to the spatial trajectory through the audio rendering module and the audio stream control arbitration module, and transmits the rendered rendering data to the data output terminal. Among them, the spatial audio rendering module is implemented based on VBAP technology, which can support rendering the target audio data corresponding to the spatial trajectory with a flow effect and controlling the playback area corresponding to the target audio data. The audio stream control arbitration module can determine the direction of the data flow and the spatial trajectory used to render the target audio data based on whether it is played in spatial audio, whether the user inputs the trajectory, whether there is a matching preset trajectory in the cloud, and other results.

[0095] Based on the input of the data processing end, the data output end can play the target audio data with spatial audio effects through the mixing output module, the power amplifier and the speaker. Among them, the mixing output module can mix the rendered accompaniment audio data and / or vocal audio data with the unrendered accompaniment audio data and / or vocal audio data and output them to the power amplifier and the speaker for audio playback.

[0096] In order to understand the above Figure 6 The processing flow diagram shown in FIG. Figure 7 A schematic diagram of the processing flow of another audio playback method provided in an embodiment of the present application is shown.

[0097] As mentioned above, the audio data input by the microphone may be, for example, vocal audio data generated during a user's singing process. For ease of understanding, the audio data input by the microphone is referred to as vocal audio data below.

[0098] It can be understood that in the process of executing the program of the audio playback method provided by the embodiment of the present application, the program flow can be divided into a data flow and a control flow. Among them, the data flow can be used to indicate the flow direction of the audio data, and the control flow can be used to determine the spatial trajectory of rendering the audio data, or the control flow can control the specific rendering method of rendering the audio data.

[0099] Specifically, refer to Figure 7 In the data flow shown, the car computer C1 can respond to the user's instruction to play the accompaniment audio data with a spatial audio effect, and can render the accompaniment audio data based on the spatial trajectory to obtain the rendered accompaniment audio data (i.e., the above-mentioned rendering data). Similarly, the car computer C1 can respond to the user's instruction to play the vocal audio data with a spatial audio effect, and can render the vocal audio data based on the spatial trajectory to obtain the rendered vocal audio data. Finally, the rendered accompaniment audio data and the rendered vocal audio data are mixed and processed and then output.

[0100] As described above, the spatial trajectory for rendering the audio data may be determined based on the trajectory input by the user, the song information and / or the user information.

[0101] refer to Figure 7According to the control flow shown, the car computer C1 can first display the trajectory drawing interface and detect whether the user inputs the trajectory. If the detection result is yes, the trajectory input by the user is obtained, and a spatial trajectory is generated based on the trajectory input by the user, and the accompaniment audio data is rendered. If the detection result is no, the car computer C1 can further query the cloud (i.e., the above-mentioned preset trajectory library) whether there is a preset trajectory matching the song category based on the song information corresponding to the accompaniment audio data (such as song category, etc.). If the query result is yes, the preset trajectory is used as the spatial trajectory to render the accompaniment audio data. If the query result is no, the car computer C1 can use the default trajectory corresponding to the user's position as the spatial trajectory to render the accompaniment audio data.

[0102] Similarly, the car computer C1 can first display the trajectory drawing interface to detect whether the user inputs the trajectory. If the detection result is yes, the trajectory input by the user is obtained, and a spatial trajectory is generated based on the trajectory input by the user, and the vocal audio data is rendered. If the detection result is no, the car computer C1 can further query the cloud (i.e., the above-mentioned preset trajectory library) whether there is a preset trajectory matching the user information based on the user information corresponding to the vocal audio data (such as gender, age, etc.). If the query result is yes, the preset trajectory is used as the spatial trajectory to render the accompaniment audio data. If the query result is no, the car computer C1 can use the default trajectory corresponding to the user position as the spatial trajectory to render the vocal audio data.

[0103] In some embodiments, the vehicle computer C1 may also first query whether there is a preset track matching the song information and / or user information in the cloud. When there is no preset track matching the song information and / or user information in the cloud, it will display the track drawing interface and detect whether the user has entered the track. There is no limitation here.

[0104] Based on the processing flow diagram of the above audio playback method, Figure 8 According to an embodiment of the present application, a schematic diagram of an implementation environment of an audio playback method is shown.

[0105] refer to Figure 8 As shown, the implementation environment diagram includes a cloud 20 and a vehicle 10'. The cloud 20 can support functions such as spatial trajectory access, over the air (OTA) and user information management. OTA can support the installation and update of applications such as karaoke applications on the vehicle side.

[0106] The vehicle 10′ can be deployed with a preset number of microphones, a preset number of speakers, an occupancy monitoring system (OMS) and on-board electronic devices (such as the above-mentioned vehicle computer C1). The on-board electronic devices can be divided into an application layer 101, a hardware abstraction layer (HAL), a kernel layer, etc. according to a layered architecture, and the on-board electronic devices can integrate a digital signal processor (DSP) and a power amplifier (AMP).

[0107] In some embodiments, the DSP and AMP may also be deployed as independent modules on the vehicle side without being integrated with the on-board electronic equipment, which is not limited here.

[0108] Among them, the application layer 101 can run a karaoke application, and an information perception application and a trajectory drawing application that support the karaoke application. Among them, the karaoke application can provide the accompaniment audio data corresponding to the song. The information perception application can obtain user information (such as gender, age, etc.) and user location through the OMS, and then query the preset trajectory matching the target audio data from the cloud 200 based on the obtained user information, and can determine the default trajectory corresponding to the user location based on the obtained user location. The trajectory drawing application can display a trajectory drawing interface for users to draw personalized trajectories, and receive trajectories input by users.

[0109] The hardware abstraction layer may include an audio HAL 102, which may implement audio control flow arbitration and output switching control. For example, the direction of the data flow and the spatial trajectory used to render the target audio data may be determined based on whether the spatial audio is played, whether the user inputs a trajectory, whether there is a matching preset trajectory in the cloud, and other results.

[0110] The kernel layer may include an audio driver 103, which can implement signal transmission and format conversion, and transmit the target audio data (signal) to the DSP after format conversion.

[0111] The digital signal processor 104 can support noise reduction, amplification, spatial audio rendering, sound effect adjustment, and mixing of target audio data, etc. The spatial audio rendering is implemented based on VBAP technology, and the relevant content can be referred to the relevant description above, which will not be repeated here.

[0112] The power amplifier 105 can amplify the weak audio signal voltage and send the mixed rendering data to the speaker, and finally play the target audio data in spatial audio.

[0113] Fig. 9 A schematic diagram of the structure of an electronic device is provided according to an embodiment of the present application.

[0114] The following takes the car computer C1 as an example. Fig. 9 As shown, in some embodiments, the vehicle computer C1 may include one or more processors 904, a system control logic 908 connected to at least one of the processors 904, a system memory 912 connected to the system control logic 908, a non-volatile memory (NVM) 916 connected to the system control logic 908, and a network interface 920 connected to the system control logic 908.

[0115] In some embodiments, the processor 904 may include one or more single-core or multi-core processors. In some embodiments, the processor 904 may include any combination of a general-purpose processor and a dedicated processor (eg, a graphics processor, an application processor, a baseband processor, etc.).

[0116] In some embodiments, system control logic 908 may include any suitable interface controller to provide any suitable interface to at least one of processors 904 and / or any suitable device or component in communication with system control logic 908 .

[0117] In some embodiments, the system control logic 908 may include one or more memory controllers to provide an interface to the system memory 912. The system memory 912 may be used to load and store data and / or instructions. In some embodiments, the memory 912 of the vehicle computer C1 may include any suitable volatile memory, such as a suitable dynamic random access memory (DRAM).

[0118] The non-volatile memory 916 may include one or more tangible, non-transitory readable storage media for storing data and / or instructions. In some embodiments, the non-volatile memory 916 may include any suitable non-volatile memory such as flash memory and / or any suitable non-volatile storage device, such as a hard disk drive (HDD), a compact disc (CD) drive, and a digital versatile disc (DVD) drive.

[0119] The non-volatile memory 916 may include a portion of storage resources on a device installed with the vehicle computer C1 , or it may be accessible by the device but is not necessarily a portion of the device. For example, the non-volatile memory 916 may be accessed through a network via the network interface 920 .

[0120] In particular, the system memory 912 and the non-volatile memory 916 may include: a temporary copy and a permanent copy of the instruction 924, respectively. The instruction 924 may include: an instruction that causes the vehicle C1 to implement the method shown in FIG. 3 when executed by at least one of the processors 904. In some embodiments, the instruction 924, hardware, firmware and / or software components thereof may be additionally / alternatively placed in the system control logic 908, the network interface 920 and / or the processor 904.

[0121] The network interface 920 may include a transceiver for providing a radio interface for the vehicle computer C1, thereby communicating with any other suitable device (such as a front-end module, an antenna, etc.) through one or more networks. In some embodiments, the network interface 920 may be integrated with other components of the vehicle computer C1.

[0122] The network interface 920 may further include any suitable hardware and / or firmware to provide a multiple-input multiple-output radio interface. For example, the network interface 920 may be a network adapter, a wireless network adapter, a telephone modem and / or a wireless modem.

[0123] In one embodiment, at least one of the processors 904 may be packaged with logic for one or more controllers of the system control logic 908 to form a system in package (session initiation protocol, SiP). In one embodiment, at least one of the processors 904 may be integrated with logic for one or more controllers of the system control logic 908 on the same die to form a system on chip (SoC).

[0124] The vehicle computer C1 may further include: an input / output (I / O) device 932. The I / O device 932 may include a user interface to enable a user to interact with the vehicle computer C1; the design of the peripheral component interface enables the peripheral component to interact with the vehicle computer C1. In some embodiments, the vehicle computer C1 also includes a sensor for determining at least one of an environmental condition and location information related to the vehicle computer C1.

[0125] In some embodiments, the user interface may include, but is not limited to, a display (e.g., an LCD display, a touch screen display, etc.), a speaker, a microphone, one or more cameras (e.g., a still image camera and / or a video camera), a flashlight (e.g., an LED flash), and a keyboard.

[0126] In some embodiments, the peripheral component interface may include, but is not limited to, a non-volatile memory port, an audio jack, and a power interface.

[0127] Fig.10A schematic block diagram of a vehicle 10 ′ provided in an embodiment of the present application is shown.

[0128] It is understood that the vehicle 10' can be a new energy vehicle, such as a pure electric vehicle, a hybrid vehicle, a plug-in hybrid vehicle, a hydrogen fuel cell vehicle, etc., or a fuel vehicle, such as a gasoline vehicle, a diesel vehicle, etc., and the embodiment of the present invention does not make any special restrictions. It is also understood that the vehicle 10' can be a car, a truck, a bus, a flying car, an entertainment vehicle, a golf cart, a train, etc., and the embodiment of the present invention does not make any special restrictions.

[0129] like Fig.10 As shown, the vehicle 10' may include various subsystems, such as a travel system 102, a sensor system 104, a control system 106, one or more peripheral devices 108, and a power source 110, a computer system 112, and a user interface 116. Optionally, the vehicle 10' may include more or fewer subsystems, and each subsystem may include multiple elements. In addition, each subsystem and element of the vehicle 10' may be interconnected by wire or wirelessly.

[0130] The travel system 102 may include components that provide powered movement for the vehicle 10'. In some embodiments, the travel system 102 may include an engine 118, an energy source 119, a transmission 120, and wheels / tires 121. The engine 118 may be an internal combustion engine, an electric motor, an air compression engine, or other types of engine combinations, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air compression engine. The engine 118 converts the energy source 119 into mechanical energy. Examples of the energy source 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. The energy source 119 may also provide energy for other systems of the vehicle 10'. The transmission 120 may transmit mechanical power from the engine 118 to the wheels 121. The transmission 120 may include a gearbox, a differential, and a drive shaft. In some embodiments, the transmission 120 may also include other devices, such as a clutch. Among them, the drive shaft may include one or more shafts that can be coupled to one or more wheels 121.

[0131] In some embodiments, the modules in the traveling system 102 are also provided with corresponding sensors, and the one or more sensors are used to collect data from each module in the traveling system 102, so that the traveling system 102 or other modules can obtain the movement information of the vehicle 10' based on the collected data.

[0132] The sensor system 104 may include several sensors that sense information about the environment around the vehicle 10'. For example, the sensor system 104 may include a positioning system 122 (the positioning system may be a GPS system, or a Beidou system or other positioning systems), an inertial measurement unit (IMU) 124, a radar 126, a laser rangefinder 128, and a camera 130. The sensor system 104 may also include sensors of the internal systems of the monitored vehicle 10' (e.g., an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge). For example, one or more sensors in the sensor system 104 may be used to collect the aforementioned motion information of the vehicle 10', and environmental information in the vehicle 10' (e.g., the placement of items, brightness, contrast, color temperature, etc. in the vehicle).

[0133] It is understandable that in other embodiments, the sensor system 104 may further include more sensors, such as ultrasonic sensors, etc., which are not limited here.

[0134] The control system 106 can be used to control the operation of the vehicle 10' and its components. The control system 106 can include various components, including a steering system 132, a throttle 134, a brake unit 136, a computer vision system 140, a route control system 142, and an obstacle avoidance system 144. The steering system 132 can be operated to adjust the forward direction of the vehicle 10'. For example, in some embodiments, it can be a steering wheel system. The throttle 134 is used to control the operating speed of the engine 118 and thus control the speed of the vehicle 10'. The brake unit 136 is used to control the deceleration of the vehicle 10'. The brake unit 136 can use friction to slow down the wheel 121. In other embodiments, the brake unit 136 can convert the kinetic energy of the wheel 121 into an electric current. The brake unit 136 can also take other forms to slow down the rotation speed of the wheel 121 to control the speed of the vehicle 10'. The computer vision system 140 can be operated to process and analyze the images captured by the camera 130 in order to identify objects and / or features in the surrounding environment of the vehicle 10'. The route control system 142 is used to determine the driving route of the vehicle 10'. In some embodiments, route control system 142 may combine data from sensors, positioning system 122, and one or more predetermined maps to determine a driving route for vehicle 10'.Obstacle avoidance system 144 is used to identify, evaluate, and avoid or otherwise negotiate potential obstacles in the environment of vehicle 10'.

[0135] Each component in the control system 106 may also include one or more sensors for collecting data from each module in the control system 106, so that the control system 106 or other modules can obtain movement information of the vehicle 10' based on the collected data.

[0136] In some examples, the control system 106 may include additional or alternative components other than those shown and described, or may include fewer than some of the components shown.

[0137] The vehicle 10 ′ interacts with external sensors, other vehicles, other computer systems or users through the peripherals 108 . The peripherals 108 may include a wireless communication system 146 , an onboard electronic device 148 (eg, the aforementioned vehicle computer C1 ), a microphone 150 and / or a speaker 152 .

[0138] In some embodiments, the user may interact with the vehicle 10 ′ through the user interface 116 so that the vehicle 10 ′ may determine which seats have passengers that are target users and which seats have passengers that are non-target users.

[0139] The wireless communication system 146 can communicate wirelessly with one or more devices directly or via a communication network. For example, the wireless communication system 146 can use 3G cellular communication, such as code division multiple access (CDMA), global system for mobile communications (GSM) / general packet radio service (GPRS), or 4G cellular communication, such as LTE. Or 5G cellular communication. The wireless communication system 146 can communicate with a wireless local area network (WLAN) using wireless fidelity (Wi-Fi). In some embodiments, the wireless communication system 146 can communicate directly with the device using an infrared link, Bluetooth or Zig Bee protocol. Other wireless protocols, such as various vehicle communication systems, for example, the wireless communication system 146 may include one or more dedicated short range communications (DSRC) devices, which may include public and / or private data communications between vehicles and / or roadside stations.

[0140] The power source 110 can provide power to various components of the vehicle 10'. In some embodiments, the power source 110 can be a rechargeable lithium-ion or lead-acid battery. One or more battery packs of such batteries can be configured as a power source to provide power to various components of the vehicle 10'. In some embodiments, the power source 110 and the energy source 119 can be implemented together, such as in some all-electric vehicles.

[0141] Some or all functions of the vehicle 10' are controlled by a computer system 112. The computer system 112 may include at least one processor 113 that executes instructions 115 stored in a non-transitory computer-readable medium such as a data storage device 114 (or memory). The computer system 112 may also be a plurality of computing devices that control individual components or subsystems of the vehicle 10' in a distributed manner.

[0142] Processor 113 can be any conventional processor, such as a commercially available central processing unit (CPU). Alternatively, the processor can be a dedicated device such as an integrated circuit (ASIC) for a specific application or other hardware-based processor. Those of ordinary skill in the art will appreciate that the processor, computer, or memory can actually include multiple processors, computers, or memories that may or may not be stored in the same physical housing. For example, the memory can be a hard drive or other storage medium located in a housing different from the computer. Therefore, references to processors or computers will be understood to include references to a collection of processors or computers or memories that may or may not operate in parallel. Different from using a single processor to perform the steps described herein, some components such as steering components and deceleration components can each have their own processors that only perform calculations related to component-specific functions.

[0143] In some embodiments, the data storage device 114 may include instructions 115 (e.g., program logic), which may be executed by the processor 113 to perform various functions of the vehicle 10', including those described above. The data storage device 114 may also include additional instructions, including instructions to send data to, receive data from, interact with, and / or control one or more of the propulsion system 102, the sensor system 104, the control system 106, and the peripheral device 108. For example, in some implementations, the instructions 115 may include instructions corresponding to the audio playback method provided in each embodiment of the present application. Furthermore, when the processor 113 executes the instructions 115, it can obtain the spatial trajectory corresponding to the target audio data based on the audio playback method provided in the embodiment of the present application, render the target audio data based on the spatial trajectory, and control the speaker 152 or other audio playback device to play the target audio data in spatial audio.

[0144] In addition to the instructions 115 , the data storage device 114 may store data such as road maps, route information, the vehicle's location, direction, speed, and other such vehicle data, as well as other information, etc. Such information may be used by the vehicle 10 ′ and the computer system 112 during operation of the vehicle 10 ′ in autonomous, semi-autonomous, and / or manual modes.

[0145] The user interface 116 is used to provide information to or receive information from a user of the vehicle 10 ′. Optionally, the user interface 116 may include one or more input / output devices within the set of peripherals 108 , such as a wireless communication system 146 , onboard electronics 148 , a microphone 150 , and a speaker 152 .

[0146] Alternatively, one or more of the above components may be installed or associated separately from the vehicle 10 ′. For example, the data storage device 114 may be partially or completely separate from the vehicle 10 ′. The above components may be communicatively coupled together in a wired and / or wireless manner.

[0147] Optionally, the above components are only examples. In actual applications, the components in the above modules may be added or deleted according to actual needs. Fig. 9 It should not be understood as limiting the embodiments of the present application.

[0148] References to "one embodiment" or "an embodiment" in the specification mean that the specific features, structures, or characteristics described in conjunction with the embodiment are included in at least one exemplary implementation or technology disclosed according to the embodiment of the present application. The appearance of the phrase "in one embodiment" in various places in the specification does not necessarily all refer to the same embodiment.

[0149] The disclosure of the embodiment of the present application also relates to an operating device for executing the text. The device can be constructed specifically for the required purpose or it can include a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program can be stored in a readable storage medium, such as, but not limited to any type of disk, including a floppy disk, an optical disk, a CD-ROM, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic or optical card, an application-specific integrated circuit (ASIC) or any type of medium suitable for storing electronic instructions, and each can be coupled to a computer system bus. In addition, the computer mentioned in the specification may include a single processor or may be an architecture involving multiple processors for increased computing power.

[0150] In addition, the language used in this specification has been primarily selected for readability and instructional purposes and may not be selected to describe or limit the disclosed subject matter. Therefore, the present application embodiment disclosure is intended to illustrate rather than limit the scope of the concepts discussed herein.

Claims

1. An audio playback method, characterized in that: The method comprises: Get target audio data; When the target audio data is selected to be played as spatial audio, obtaining a spatial trajectory corresponding to the target audio data, the spatial trajectory being used to represent a movement trajectory of an audio image in a preset space during the playing of the target audio data; Rendering the target audio data according to the spatial trajectory to obtain rendering data corresponding to the target audio data; Audio playback is performed based on the rendering data.

2. The method according to claim 1, characterized in that The target audio data includes first audio data and second audio data, and, The spatial track includes a first spatial track corresponding to the first audio data and a second spatial track corresponding to the second audio data.

3. The method according to claim 2, characterized in that The first audio data includes at least one first audio sub-data, and the first spatial track includes a first spatial sub-track corresponding to the first audio sub-data.

4. The method according to claim 2, characterized in that: When the target audio data is selected to be played in spatial audio, obtaining a spatial trajectory corresponding to the target audio data includes: In the case where the target audio data is selected to be played in spatial audio, displaying a trajectory drawing interface; Receiving a trajectory input by a user on the trajectory drawing interface; The trajectory input by the user is used as the spatial trajectory corresponding to the target audio data.

5. The method according to claim 2, characterized in that: When the target audio data is selected to be played as spatial audio, obtaining the spatial trajectory corresponding to the audio data further includes: When the target audio data is selected to be played in spatial audio, acquiring audio information of the target audio data; Determining a preset track matching the audio information in a preset track library; The preset trajectory is used as the spatial trajectory corresponding to the target audio data.

6. The method according to claim 2, characterized in that When the target audio data is selected to be played as spatial audio, obtaining the spatial trajectory corresponding to the audio data further includes: In a case where the target audio data is selected to be played in spatial audio, determining a user position of a target user in the preset space; Obtaining a default track corresponding to the user's location; The default track is used as the spatial track corresponding to the target audio data.

7. The method according to any one of claims 1 to 6, characterized in that: A preset number of loudspeakers are arranged in the preset space, and the rendering of the target audio data according to the spatial trajectory to obtain rendering data corresponding to the target audio data includes: Based on a preset sampling rule, determining a first number of trajectory sampling points in the spatial trajectory; Determining output data of each of the speakers when playing the target audio data according to a positional relationship between the trajectory sampling point and each of the speakers; The output data of each of the speakers is used as rendering data corresponding to the target audio data.

8. An electronic device, characterized in that: The device comprises one or more processors; one or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the device executes the audio playback method described in any one of claims 1 to 7.

9. A car audio system, characterized in that: include: An electronic device, a speaker and a microphone; wherein the electronic device is the electronic device described in claim 8.

10. A vehicle, characterized in that: The vehicle audio system comprising the vehicle audio system according to claim 9.

Images