A method, device, electronic device and storage medium for sound field adjustment

Abstract

The present disclosure relates to a sound field adjustment method, apparatus, electronic device, and storage medium. The method is applied to a vehicle, which includes a plurality of audio devices. The method specifically includes: obtaining the ear positions of users inside the vehicle, fusing the audio data corresponding to each of the plurality of audio devices to obtain a plurality of audio fusion results, then determining, among the plurality of audio fusion results, the target audio fusion result corresponding to the ear positions of the users. The target audio fusion result can be understood as the best audio fusion result. After determining the target audio fusion result, controlling the plurality of audio devices to play audio based on the target parameters corresponding to the target audio fusion result, so as to form an optimal sound field at the ear positions of the users, enabling the users inside the vehicle to hear clear audio, improving the user experience, and the method is relatively flexible.

Description

Technical Field

[0001] The present disclosure relates to the technical field of data processing, and particularly to a sound field adjustment method, device, electronic device, and storage medium. Background Art

[0002] Currently, with the widespread use of vehicles, it has become very common to install speakers in vehicles, and people can play music through the speakers while driving to relax. However, the music emitted by numerous speakers inside the vehicle reaches the sound field positions of the in-vehicle users out of sync. That is, the speakers play music with fixed parameters, and the music heard by in-vehicle users at different positions is different, resulting in situations where users cannot clearly hear the music. The method is not flexible, and the music effect heard by users is not ideal, and the user experience is relatively poor. Summary of the Invention

[0003] To solve the above technical problems, the present disclosure provides a sound field adjustment method, device, electronic device, and storage medium, which can form an optimal sound field at the position of the user's ear, enabling the user to clearly hear the audio and improving the user experience.

[0004] In a first aspect, an embodiment of the present disclosure provides a sound field adjustment method applied to a vehicle, where the vehicle includes multiple audio devices, and the method includes:

[0005] Obtain the ear position of a user inside the vehicle;

[0006] Fuse the audio data corresponding to each audio device among the multiple audio devices to obtain multiple audio fusion results;

[0007] Determine the target audio fusion result corresponding to the ear position among the multiple audio fusion results, and control the multiple audio devices to play audio based on the target parameters corresponding to the target audio fusion result.

[0008] Optionally, obtaining the ear position of a user inside the vehicle includes:

[0009] Obtain a target image including user information captured by a camera device of the vehicle;

[0010] Obtain the induction data generated by the seat corresponding to the user;

[0011] Determine the ear position of the user inside the vehicle according to the target image and the induction data.

[0012] Optionally, determining the ear position of the user inside the vehicle according to the target image and the induction data includes:

[0013] Based on the calibration points in the target image, determine the height information of the user's ear inside the vehicle;

[0014] Determine the ear position of the user in the vehicle based on the height information and the position information of the seat in the sensing data.

[0015] Optionally, before fusing the audio data corresponding to each audio device among multiple audio devices, the method further includes:

[0016] Construct a three-dimensional model of the vehicle and divide the three-dimensional model into multiple sub-regions;

[0017] Determine the audio data of each audio device among multiple audio devices in the multiple sub-regions.

[0018] Optionally, determining the audio data of each audio device among multiple audio devices in the multiple sub-regions includes:

[0019] Obtain the playback data generated when each audio device among multiple audio devices plays with different playback parameters;

[0020] Map the playback data to multiple sub-regions of the three-dimensional model, and determine the audio data corresponding to each sub-region among the multiple sub-regions.

[0021] Optionally, fusing the audio data corresponding to each audio device among multiple audio devices to obtain multiple audio fusion results includes:

[0022] Determine at least one sub-region occupied by the ear position in the three-dimensional model;

[0023] Fuse the audio data corresponding to each sub-region among the at least one sub-region to obtain multiple audio fusion results.

[0024] Optionally, determining the target audio fusion result corresponding to the ear position among multiple audio fusion results includes:

[0025] Obtain the waveform of the audio to be played;

[0026] If the deviation between the waveform of the audio to be played and the waveform corresponding to any one of the multiple audio fusion results is less than a preset threshold, determine any one of the multiple audio fusion results as the target audio fusion result corresponding to the ear position.

[0027] In a second aspect, an embodiment of the present disclosure provides an acoustic field adjustment device, which is characterized in that it is applied to a vehicle, the vehicle includes at least one audio device, and the device includes:

[0028] An acquisition unit, configured to acquire the ear position of the user in the vehicle;

[0029] A fusion unit, configured to fuse the audio data corresponding to each audio device among multiple audio devices to obtain multiple fusion results;

[0030] A control unit for determining a target audio fusion result corresponding to the ear position among multiple audio fusion results, and controlling multiple audio devices to play audio based on the target parameters corresponding to the target audio fusion result.

[0031] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

[0032] A memory;

[0033] A processor; and

[0034] A computer program;

[0035] wherein the computer program is stored in the memory and is configured to be executed by the processor to implement the sound field adjustment method as described above.

[0036] In a fourth aspect, a computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the sound field adjustment method as described above are implemented.

[0037] An embodiment of the present disclosure provides a sound field adjustment method, apparatus, electronic device, and storage medium. The method is applied to a vehicle, which includes multiple audio devices. The method specifically includes: obtaining the ear position of a user inside the vehicle, fusing the audio data corresponding to each audio device among the multiple audio devices to obtain multiple audio fusion results, then determining the target audio fusion result corresponding to the ear position among the multiple audio fusion results. The target audio fusion result can be understood as the best audio fusion result. After determining the target audio fusion result, controlling the multiple audio devices to play audio based on the target parameters corresponding to the target audio fusion result, so as to form the best sound field at the user's ear position. The user inside the vehicle can clearly hear the audio, improving the user experience, and the method is relatively flexible. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.

[0039] To more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0040] Figure 1 A schematic structural diagram of a vehicle provided by an embodiment of the present disclosure;

[0041] Figure 2 A schematic flowchart of a sound field adjustment method provided by an embodiment of the present disclosure;

[0042] Figure 3 A schematic flowchart of a sound field adjustment method provided by an embodiment of the present disclosure;

[0043] Figure 4 A schematic structural diagram of a sound field adjustment device provided by an embodiment of the present disclosure;

[0044] Figure 5 A schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Detailed implementation manners

[0045] In order to more clearly understand the above objects, features, and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, without conflict, the embodiments of the present disclosure and the features in the embodiments may be combined with each other.

[0046] Many specific details are set forth in the following description in order to fully understand the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only a part of the embodiments of the present disclosure, rather than all the embodiments.

[0047] In response to the above technical problems, the present disclosure provides a sound field adjustment method applied to a vehicle. The vehicle includes a control unit and a plurality of audio devices. The control unit is configured to perform data analysis and control the audio devices. The audio devices may be speakers for playing audio, such as a stereo. The control unit obtains the ear positions of the users inside the vehicle, where the ear positions refer to the positions of the users' two ears inside the cabin. Subsequently, at the determined ear positions of the users, the control unit fuses the audio data corresponding to each audio device among the plurality of audio devices to obtain a plurality of audio fusion results, determines a target audio fusion result among the plurality of audio fusion results, that is, determines the best audio fusion result, and controls the plurality of audio devices to play audio based on the target parameters corresponding to the target audio fusion result. For example, the control unit controls the plurality of speakers to play audio with respective different playing parameters such as intensity, frequency, delay, etc., determines the best sound field of the users' ears, so that the users can clearly hear the audio, and the played audio has a better effect, improving the user experience. The sound field can be adjusted automatically in real time according to the positions of the users inside the cabin to obtain a good playing effect, and the method is relatively flexible. Specifically, the sound field adjustment method provided by the present disclosure can be described by one or more of the following embodiments.

[0048] Figure 1 A schematic structural diagram of a vehicle provided by an embodiment of the present disclosure, Figure 1It includes a vehicle 100. Inside the vehicle cabin of the vehicle 100, there are a seat 110, a seat 120, a control unit 130, and four speakers 140 to 143. The position of the control unit 130 inside the vehicle 100 is not limited. The control unit 130 can execute the sound field adjustment method by itself, or receive the target audio fusion result and the corresponding target parameters transmitted by other devices, and control the four speakers to play based on the target parameters. The other device can be a server. The four speakers can be distributed around the roof of the vehicle 100, for example, at the four intersection points of the roof, and the four speakers cannot rotate. The control unit 130 can adjust the playing parameters of the four players through digital signal processing. The playing parameters include intensity, delay, phase, etc. The following embodiments will be described in detail with an application scenario where the user is sitting on the seat 110 and the control unit 130 can execute the sound field adjustment method by itself. It can be understood that the sound field adjustment method provided by the present disclosure can be applied not only in the Figure 1 vehicle shown, but also in other scenarios, which is not limited herein.

[0049] Figure 2 The following is a schematic flowchart of a sound field adjustment method provided by an embodiment of the present disclosure, which is applied to the above Figure 1 vehicle 100 shown. The user is sitting on the seat 110 in the vehicle 100. In this application scenario, the sound field adjustment method specifically includes the following steps S210 to S230 as shown in Figure 2 the following:

[0050] S210. Obtain the ear position of the user inside the vehicle.

[0051] It can be understood that when the control unit obtains the ear position of the user inside the vehicle, it means the positions of the user's two ears inside the vehicle when the user is sitting on the seat 110.

[0052] Optionally, in the above S210, obtaining the ear position of the user inside the vehicle specifically includes: obtaining a target image including user information captured by a camera device of the vehicle; obtaining induction data generated by the seat corresponding to the user; and determining the ear position of the user inside the vehicle according to the target image and the induction data.

[0053] It is understandable that the above control unit obtains the ear positions of users inside the vehicle, which specifically includes the following processes: There is at least one imaging device inside the vehicle. The imaging device can be a camera, which is used to capture images inside the vehicle. When the user is sitting on the seat, the target image including user information is obtained. The user information includes at least the entire head of the user, and the positions of the user's two ears can be clearly identified. Subsequently, the sensing data generated by the seat on which the user is sitting is obtained. Each seat inside the vehicle can be pre-set with a sensing device. The sensing device can specifically be a pressure sensor, which is used to determine which seat the user is sitting on. The position of each seat inside the vehicle is known, and the seat and its position inside the vehicle can be determined according to the sensing data. Subsequently, the ear positions of the user inside the vehicle are determined based on the position of the seat inside the vehicle and the target image.

[0054] Optionally, the above determining the ear positions of users inside the vehicle according to the target image and the sensing data specifically includes: Based on the calibration points in the target image, the height information of the ears of the users inside the vehicle is determined; According to the height information and the position information of the seat in the sensing data, the ear positions of the users inside the vehicle are determined.

[0055] It is understandable that determining the ear positions of the user inside the vehicle according to the position of the seat inside the vehicle and the target image specifically includes the following processes: A plurality of marking points are pre-set inside the vehicle. The marking points are points that are easy to identify, and the position of each marking point inside the vehicle is known, and the height inside the vehicle is also known. The height inside the vehicle refers to the distance between the marking point and the vehicle floor. When the imaging device captures the user to generate a target image, at least one marking point will also be captured. Based on at least one marking point in the target image, the height information of the user's ears inside the vehicle is determined, that is, the distance between the user's ears and the vehicle floor. Subsequently, according to the height information of the user's ears inside the vehicle and the position of the seat inside the vehicle in the sensing information, the ear positions of the user inside the vehicle are determined. The ear positions can be understood as three-dimensional coordinates. The position of the seat inside the vehicle is denoted as two-dimensional coordinates x and y, and the height information of the ears inside the vehicle is denoted as z, obtaining the three-dimensional coordinates (x, y, z) of the ears inside the vehicle. It is understandable that the ear positions are composed of at least one set of three-dimensional coordinates.

[0056] S220. Fuse the audio data corresponding to each audio device among the multiple audio devices to obtain multiple audio fusion results.

[0057] Understandably, based on the above S210, after determining the position of the user's ear in the vehicle, that is, after determining at least one three-dimensional coordinate of the ear in the vehicle, it is possible to fuse only the audio data corresponding to each audio device among the multiple audio devices at the ear position, or it is also possible to fuse the audio data corresponding to each audio device at all positions in the vehicle to obtain multiple audio fusion results. For example, for each of the above 4 speakers, there is corresponding audio data. The audio data refers to the sound data generated in each area divided in the vehicle when the speaker is playing. The 4 speakers are respectively denoted as s1 (upper left corner of the roof), s2 (lower left corner of the roof), s3 (upper right corner of the roof), and s4 (lower right corner of the roof). The sound data corresponding to the 4 speakers are denoted as database1, database2, database3, and database4. The sound data is the data generated when each speaker plays with different playback parameters, and this sound data can be adjusted according to the user's needs later; during the acquisition process of the sound data, the sound data generated by each speaker in the vehicle is collected separately. For example, the speaker S1 is played alone, and the sound data database1 generated by the speaker S1 in the cabin is collected, and so on. The sound data generated by the remaining 3 speakers in the cabin is collected and saved in turn. Understandably, fusing the sound data database1, database2, database3, and database4 corresponding to the 4 speakers respectively can obtain multiple audio fusion results, such as 14 groups of fusion results. Specifically, every two of the 4 sound data can be fused. For example, fusing database1 and database2 generates a group of audio fusion results, that is, superimposing the sound waves of database1 and database2 in the vehicle space. It is also possible to fuse every three of the 4 sound data, or fuse all 4 sound data. Specifically, a fusion algorithm can be used to fuse the sound data. It is also possible to control 2 speakers to play the same audio simultaneously during the acquisition of the sound data, and collect the sound data in the vehicle at this time. This sound data is the data after the fusion of the 2 speakers. For example, the sound data collected by controlling S1 and S2 to play the audio simultaneously is the same as the audio fusion result generated by fusing database1 and database2 through the algorithm above. The specific fusion method can be set according to the user's needs and will not be elaborated here.

[0058] S230. Determine the target audio fusion result corresponding to the ear position among the multiple audio fusion results, and control the multiple audio devices to play audio based on the target parameters corresponding to the target audio fusion result.

[0059] It is understandable that, based on the above S220, after obtaining multiple audio fusion results, the target audio fusion result corresponding to the ear position is determined among the multiple audio fusion results. The target audio fusion result can be understood as the best audio fusion result corresponding to the ear position, that is, when the target audio fusion result is played at the ear position, the user can hear the best audio effect. After determining the target audio fusion result, the control unit controls multiple audio devices to play the audio with the playback parameters of each speaker corresponding to the target audio fusion result. Taking 4 speakers as an example, the playback parameters corresponding to the target audio fusion result may only involve playing the audio by speaker S1 and speaker S2. That is, the sound data fusion result of S1 and S2 is the target audio fusion result, S3 and S4 do not play audio, and the respective playback parameters of S1 and S2 may be different. The delay of S2 may be longer than the delay time of S1 to achieve the best audio playback effect at the ear position.

[0060] Optionally, determining the target audio fusion result among the multiple audio fusion results specifically includes: obtaining the waveform of the audio to be played; if the deviation between the waveform of the audio to be played and the waveform corresponding to any one of the multiple audio fusion results is less than a preset threshold, then determining any one of the multiple audio fusion results as the target audio fusion result corresponding to the ear position.

[0061] It is understandable that determining the target audio fusion result corresponding to the ear position among the multiple audio fusion results specifically includes the following process: obtaining the waveform of the audio to be played. The audio data corresponding to the above audio devices can be generated when the audio devices play the audio to be played. The waveform of the audio to be played refers to the waveform of the audio data itself, without the waveform during propagation, which can be understood as a standard waveform and has the best audio effect; obtaining the waveform corresponding to each fusion result among the multiple audio fusion results obtained by fusion above. If the deviation between the waveform of the audio to be played and the waveform corresponding to any one of the multiple audio fusion results is less than a preset threshold, then determining any one of the fusion results as the target audio fusion result, that is, screening out the best sound field at the human ear position. Among them, the preset threshold can be set to 1%, that is, if the deviation between the two waveforms is within 1%, it means that any one of the multiple audio fusion results above is the best audio fusion result, which can ensure that the sound knot point at the ear position reaches the best effect, that is, the user can hear the audio with the best effect. It can be understood that when the audio device plays with the playback parameters corresponding to the target audio fusion result, the playback effect at other positions except the ear position may not reach the best effect.

[0062] An embodiment of the present disclosure provides an acoustic field adjustment method, which is applied to a vehicle. The vehicle includes multiple audio devices. The method specifically includes: obtaining the ear position of a user in the vehicle, fusing the audio data corresponding to each audio device among the multiple audio devices to obtain multiple audio fusion results, and then determining a target audio fusion result corresponding to the ear position among the multiple audio fusion results. The target audio fusion result can be understood as the best audio fusion result. After determining the target audio fusion result, controlling the multiple audio devices to play audio based on the target parameters corresponding to the target audio fusion result can adjust the acoustic field of the ear in real time according to the position of the user's ear in the vehicle, form the best acoustic field at the position of the user's ear, the method is relatively flexible and easy to implement, enabling the user in the vehicle to clearly hear the best-quality audio regardless of where they are in the vehicle, and improving the user experience.

[0063] Based on the above embodiment, Figure 3 is a flowchart of an acoustic field adjustment method provided by an embodiment of the present disclosure. Optionally, before fusing the audio data corresponding to each audio device among the multiple audio devices, the method specifically further includes the following steps S310 to S320 as Figure 3 shown:

[0064] S310. Construct a three-dimensional model of the vehicle and divide the three-dimensional model into multiple sub-regions.

[0065] It can be understood that before fusing the audio data corresponding to each audio device among the multiple audio devices, vehicle data needs to be obtained, and a three-dimensional model of the vehicle is constructed according to the vehicle data. The three-dimensional model is mainly a model of the cabin, and the modeling data can be divided to the centimeter (cm) level; after completing the modeling of the cabin, the three-dimensional model is divided into multiple sub-regions. Each sub-region can be a cube, and the three-dimensional model after dividing into multiple sub-regions can be regarded as composed of multiple small grids.

[0066] S320. Determine the audio data of each audio device among the multiple audio devices in the multiple sub-regions.

[0067] It is understandable that, based on the above S310, after dividing the 3D model into multiple sub-regions, the audio data of each audio device among the multiple audio devices within the multiple sub-regions is determined. When the speaker plays audio, there is corresponding audio data for each sub-region. That is, when the speaker S1 plays audio with intensity w1, phase p1, and delay t1, a set of sound data can be drawn in this modeling space. By dividing the sound data distributed in the cabin, the audio data (database1) corresponding to each sub-region (small grid) can be obtained. The method for determining the audio data of other speakers within each sub-region is the same as that of speaker S1 and will not be elaborated here. It is understandable that when the audio played by the speaker propagates in the cabin, there are different sound data at each position in the cabin. That is, users at different positions in the cabin can hear the sound of the played audio. However, due to the propagation of sound, the sounds heard at different positions are different, resulting in different audio data corresponding to each sub-region. The audio data corresponding to each sub-region can be understood as the sounds that can be heard at different positions in the cabin. For example, the sound heard near the speaker is clearer and has a better effect.

[0068] Optionally, the determination of the audio data of each audio device among the multiple audio devices within the multiple sub-regions specifically includes: obtaining the playback data generated when each audio device among the multiple audio devices plays with different playback parameters; mapping the playback data to the multiple sub-regions of the 3D model to determine the audio data corresponding to each sub-region among the multiple sub-regions.

[0069] It is understandable that the determination of the audio data of each audio device among the multiple audio devices within the multiple sub-regions specifically includes the following process: obtaining the playback data generated when each audio device among the multiple audio devices plays with different playback parameters. The data generated when the above speakers s1 to s4 play with different playback parameters is recorded as playback data. For example, when the above speaker s1 plays the above audio to be played with playback parameter 1, playback data 1 is generated in the cabin, and when it plays the above audio to be played with playback parameter 2, playback data 2 is generated in the cabin. Among them, the playback parameters include intensity, phase, and delay, etc.; after determining the playback data corresponding to the speaker, map the playback data to the multiple sub-regions divided by the 3D model. Each sub-region corresponds to a partial data of the playback data. That is, the playback data is divided according to the divided sub-regions, and there is corresponding audio data for each sub-region.

[0070] Optionally, in the above S220, the fusion of the audio data corresponding to each audio device among the multiple audio devices to obtain multiple audio fusion results specifically includes: determining at least one sub-region occupied by the ear position in the 3D model; fusing the audio data corresponding to each sub-region among the at least one sub-region to obtain multiple audio fusion results.

[0071] It is understandable that the above S220 fuses multiple audio data to obtain multiple audio fusion results, which specifically includes the following processes: Obtain the corresponding audio data in each sub-region. Taking the example of 4 playback devices playing audio based on the same playback parameter, each sub-region corresponds to 4 audio data respectively, which are generated when playing audio from s1 to s4. Determine the number of sub-regions occupied by the ear positions in the three-dimensional model and the positions of each occupied sub-region in the three-dimensional model. Each ear of the user may occupy at least one sub-region, and two ears will occupy multiple sub-regions. Fuse the audio data corresponding to each sub-region in the multiple occupied sub-regions to obtain multiple audio fusion results. For example, the user's two ears occupy a total of 4 sub-regions, each ear occupies 2 sub-regions, each sub-region corresponds to 4 audio data, and the 8 audio data corresponding to the 2 occupied sub-regions are superimposed and fused to obtain multiple audio fusion results. The other ear will also obtain multiple audio fusion results in the same way, and then fuse the multiple audio results corresponding to the two ears to obtain the final multiple audio fusion results. Subsequently, determine the target audio fusion result among the final multiple audio fusion results to ensure that both ears can hear the best audio effect. Another implementation method includes: After determining the user's ear positions, determine the number of sub-regions occupied by the line connecting the two ears and the positions of each occupied sub-region in the three-dimensional model, and fuse the audio data corresponding to each sub-region in the occupied sub-regions to obtain multiple audio fusion results. There is also a feasible implementation method including: Construct a circle with a preset radius centered on the user's head, and the circle should wrap the user's ears. The preset radius can be 5 cm. Determine the number of sub-regions occupied by the circle and the positions of each occupied sub-region in the three-dimensional model, and fuse the audio data corresponding to each sub-region in the occupied sub-regions to obtain multiple audio fusion results.

[0072] The embodiments of the present disclosure provide a sound field adjustment method. Before fusing the audio data corresponding to each audio device among multiple audio devices, a three-dimensional model of the vehicle is pre-constructed. Specifically, a three-dimensional model of the vehicle cabin is constructed and divided into multiple sub-regions. The sub-regions can be understood as three-dimensional small grids, and the three-dimensional model is composed of multiple small grids. Subsequently, determine the audio data of each audio device among the multiple audio devices in the multiple sub-regions, that is, when the audio device plays audio, a set of playback data is drawn in the three-dimensional model, and there is corresponding audio data in each sub-region. The audio data refers to the data where the playback data is distributed in this sub-region. By determining the audio data corresponding to each sub-region, it is convenient to perform audio data fusion at the ear position later to obtain the best audio fusion result.

[0073] Figure 4Schematic structural diagram of the sound field adjustment device provided by an embodiment of the present disclosure. The sound field adjustment device provided by the embodiment of the present disclosure can execute the processing flow provided by the above-mentioned sound field adjustment method embodiment, and is applied to a vehicle. The vehicle includes at least one audio device, such as Figure 4 As shown, the sound field adjustment device 400 includes:

[0074] An acquisition unit 410, configured to acquire the ear position of a user in the vehicle;

[0075] A fusion unit 420, configured to fuse the audio data corresponding to each audio device among multiple audio devices to obtain multiple fusion results;

[0076] A control unit 430, configured to determine a target audio fusion result corresponding to the ear position among multiple audio fusion results, and control the multiple audio devices to play audio based on the target parameters corresponding to the target audio fusion result.

[0077] Optionally, for the acquisition unit 410 to acquire the ear position of a user in the vehicle, specifically:

[0078] Acquire a target image including user information captured by a camera device of the vehicle;

[0079] Acquire induction data generated by the seat corresponding to the user;

[0080] Determine the ear position of the user in the vehicle according to the target image and the induction data.

[0081] Optionally, for the acquisition unit 410 to determine the ear position of the user in the vehicle according to the target image and the induction data, specifically:

[0082] Based on the calibration points in the target image, determine the height information of the user's ears in the vehicle;

[0083] Determine the ear position of the user in the vehicle according to the height information and the position information of the seat in the induction data.

[0084] Optionally, the device 400 further includes a construction unit, and the construction unit is specifically configured to: before fusing the audio data corresponding to each audio device among multiple audio devices

[0085] Construct a three-dimensional model of the vehicle and divide the three-dimensional model into multiple sub-regions;

[0086] Determine the audio data of each audio device among multiple audio devices in multiple sub-regions.

[0087] Optionally, for the construction unit to determine the audio data of each audio device among multiple audio devices in multiple sub-regions, specifically:

[0088] Obtain the playback data generated when each of multiple audio devices plays with different playback parameters;

[0089] Map the playback data to multiple sub-regions of the three-dimensional model, and determine the audio data corresponding to each sub-region among the multiple sub-regions.

[0090] Optionally, in the fusion unit 420, fuse the audio data corresponding to each of the multiple audio devices to obtain multiple audio fusion results, specifically used for:

[0091] Determine at least one sub-region occupied by the ear position in the three-dimensional model;

[0092] Fuse the audio data corresponding to each sub-region among the at least one sub-region to obtain multiple audio fusion results.

[0093] Optionally, in the control unit 430, determine the target audio fusion result among the multiple audio fusion results, specifically used for:

[0094] Obtain the waveform of the audio to be played;

[0095] If the deviation between the waveform of the audio to be played and the waveform corresponding to any one of the multiple audio fusion results is less than a preset threshold, then determine any one of the multiple audio fusion results as the target audio fusion result corresponding to the ear position.

[0096] Figure 4 The sound field adjustment device in the illustrated embodiment can be used to execute the technical solutions in the above method embodiments, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0097] Figure 5 It is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Specifically refer to the following Figure 5 , which shows a schematic structural diagram of an electronic device 500 suitable for implementing the present disclosure. The electronic device 500 in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), vehicle terminals (such as vehicle navigation terminals), wearable electronic devices, etc., and fixed terminals such as digital TVs, desktop computers, smart home devices, etc. Figure 5 The electronic device shown is only an example and should not bring any limitation to the functions and usage scope of the embodiments of the present disclosure.

[0098] Such as Figure 5As shown, the electronic device 500 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 501, which may perform various appropriate actions and processes according to a program stored in the read-only memory (ROM) 502 or a program loaded from the storage device 508 into the random access memory (RAM) 503 to implement the multimedia information processing method as in the embodiments of the present disclosure. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. The input / output (I / O) interface 505 is also connected to the bus 504.

[0099] Generally, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 5 the electronic device 500 with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. Instead, more or fewer devices may be implemented or had.

[0100] Specifically, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program codes for executing the methods shown in the flowcharts, so as to implement the multimedia information processing method as above. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above functions defined in the methods of the embodiments of the present disclosure are executed.

[0101] It should be noted that the computer-readable medium described above in the present disclosure can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of a computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0102] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0103] The above computer-readable medium can be included in the above electronic device; or it can exist separately without being assembled into the electronic device.

[0104] Optionally, when the above one or more programs are executed by the electronic device, the electronic device can also perform the other steps of the above embodiments.

[0105] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or alternatively, may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0106] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0107] The units described in the embodiments of the present disclosure may be implemented in software or in hardware. In some cases, the name of the unit does not constitute a limitation on the unit itself.

[0108] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and the like.

[0109] In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0110] It should be noted that, in this document, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0111] The above are only specific embodiments of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but rather to the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. A sound field adjustment method, characterized in that, Applied to a vehicle, the vehicle including a plurality of audio devices, the method includes: Obtain the ear position of a user inside the vehicle; Fuse the audio data corresponding to each audio device among the plurality of audio devices to obtain a plurality of audio fusion results at the ear position; Determine a target audio fusion result corresponding to the ear position among the plurality of audio fusion results, and control the plurality of audio devices to play audio based on the target parameters corresponding to the target audio fusion result; Wherein, the determining a target audio fusion result corresponding to the ear position among the plurality of audio fusion results includes: Obtain the waveform of the audio to be played; If the deviation between the waveform of the audio to be played and the waveform corresponding to any one of the audio fusion results among the plurality of audio fusion results is less than a preset threshold, determine any one of the audio fusion results among the plurality of audio fusion results as the target audio fusion result corresponding to the ear position.

2. The method according to claim 1, characterized in that, The obtaining the ear position of a user inside the vehicle includes: Obtain a target image including user information captured by a camera device of the vehicle; Obtain induction data generated by the seat corresponding to the user; Determine the ear position of the user inside the vehicle according to the target image and the induction data.

3. The method according to claim 2, characterized in that, The determining the ear position of the user inside the vehicle according to the target image and the induction data includes: Based on the calibration points in the target image, determine the height information of the user's ears inside the vehicle; Determine the ear position of the user inside the vehicle according to the height information and the position information of the seat in the induction data.

4. The method according to claim 1, characterized in that, Before fusing the audio data corresponding to each audio device among the plurality of audio devices, the method further includes: Construct a three-dimensional model of the vehicle and divide the three-dimensional model into a plurality of sub-regions; Determine the audio data of each audio device among the plurality of audio devices in the plurality of sub-regions.

5. The method according to claim 4, characterized in that, The determining the audio data of each audio device among the plurality of audio devices in the plurality of sub-regions includes: Obtain the playback data generated when each audio device among the plurality of audio devices plays with different playback parameters; Map the playback data into the plurality of sub-regions of the three-dimensional model to determine the audio data corresponding to each sub-region among the plurality of sub-regions.

6. The method according to claim 4, characterized in that, The fusing the audio data corresponding to each audio device among the plurality of audio devices to obtain a plurality of audio fusion results includes: Determine at least one sub-region occupied by the ear position in the three-dimensional model; Fuse the audio data corresponding to each sub-region among the at least one sub-region to obtain a plurality of audio fusion results.

7. A sound field adjustment device, characterized in that, Applied to a vehicle, the vehicle including a plurality of audio devices, the device includes: An obtaining unit, configured to obtain the ear position of a user inside the vehicle; A fusing unit, configured to fuse the audio data corresponding to each audio device among the plurality of audio devices to obtain a plurality of audio fusion results at the ear position; A control unit for determining a target audio fusion result corresponding to the ear position among the multiple audio fusion results, and controlling the multiple audio devices to play audio based on a target parameter corresponding to the target audio fusion result; Wherein, the control unit is configured to: Obtain the waveform of the audio to be played; if the deviation between the waveform of the audio to be played and the waveform corresponding to any one of the multiple audio fusion results is less than a preset threshold, determine any one of the multiple audio fusion results as the target audio fusion result corresponding to the ear position.

8. An electronic device, characterized in that, Comprising: A memory; A processor; And A computer program; Wherein, the computer program is stored in the memory and is configured to be executed by the processor to implement the sound field adjustment method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the sound field adjustment method according to any one of claims 1 to 6.

Images