In-vehicle adaptive sound reproduction method, audio system and domain controller

By acquiring cabin environment data in real time through domain controllers and sensor modules, and analyzing and adjusting speaker status, the system solves the problem of poor adaptability of the vehicle audio system in different cabin environments, realizes adaptive sound playback, and improves user experience and intelligence.

WO2025217751A1PCT designated stage Publication Date: 2025-10-23AAC MICROTECH (CHANGZHOU) CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/087694
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-15
Publication Date
2025-10-23

AI Technical Summary

Technical Problem

The car audio system is cumbersome when switching sound playback modes and has poor adaptability to different cabin environments, resulting in cumbersome user operations and low intelligence.

Method used

A domain controller is used in combination with a sensor module and a speaker module to obtain cabin environment data in real time, analyze adaptive sound parameters, and regulate the physical state of the speaker for adaptive sound reproduction.

Benefits of technology

It achieves high-quality sound reproduction effects that are adaptive to different cabin environments without the need for manual adjustment by the user, thereby improving the intelligence level of the entire vehicle and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024087694_23102025_PF_FP_ABST
    Figure CN2024087694_23102025_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of sound reproduction. Provided are an in-vehicle adaptive sound reproduction method, an audio system and a domain controller. In the present application, a domain controller is utilized to acquire environmental data indicating a cabin environment, analyze sound reproduction parameters (audio effect parameters and physical state parameters of each loudspeaker) adapted to the environmental data, then regulate and control a physical state of each loudspeaker on the basis of the physical state parameters, process, on the basis of the audio effect parameters, an audio signal to be subjected to sound reproduction, and finally transmit, to each loudspeaker subjected to physical state regulation and control, a target audio signal obtained by means of the processing; and sound reproduction of the target audio signal is performed by the loudspeakers in a cabin. It can be understood that when the environment of a cabin changes, sound reproduction parameters also change accordingly, i.e., sound reproduction in the present application exhibits strong adaptability to different cabin environments, and can thus achieve optimal sound reproduction effects and provide better acoustic experience for users in different cabin environments.
Need to check novelty before this filing date? Find Prior Art

Description

In-vehicle adaptive sound playback method, audio system and domain controller TECHNICAL FIELD

[0001] The present application relates to the technical field of sound playback, and in particular to an in-vehicle adaptive sound playback method, an audio system and a domain controller. BACKGROUND

[0002] A vehicle audio system is an important part of in-vehicle entertainment facilities, which can perform sound playback in a vehicle cabin, thereby providing users with excellent and immersive driving experience. Generally, the cabin environment is not constant, which is related to the acoustic characteristics (such as background noise, direct sound, reflected sound, etc.) in the vehicle and the driving conditions (such as driving speed, number of passengers, seating position, opening and closing of windows and doors, etc.) of the vehicle, that is, when the acoustic characteristics in the vehicle and / or the driving conditions of the vehicle change, the cabin environment is also different from before. In this case, if the vehicle audio system only has a fixed sound playback mode, it cannot adapt to all cabin environments, that is, it cannot achieve optimal sound playback effect in multiple cabin environments, and the acoustic experience of passengers is poor.

[0003] In related technologies, the vehicle audio system can be configured with several different sound playback modes, such as a driver mode, a full-car mode, a rear seat mode, etc. Users can manually / voice select different sound playback modes to adapt to different cabin environments, but this requires users to judge the cabin environment and select the sound playback mode independently, which not only brings users cumbersome operations, but also reduces the intelligent degree of the vehicle. Moreover, when switching the sound playback mode, it is mostly switching the sound effect parameters of the software layer of the vehicle audio system, which cannot better adapt to different cabin environments, that is, the adaptability to different cabin environments is poor, so it is necessary to improve the existing sound playback scheme in the vehicle. TECHNICAL PROBLEM

[0004] The present application provides an in-vehicle adaptive sound playback method, an audio system and a domain controller, which aims to solve the problem of complicated process of switching sound playback mode of the vehicle audio system and poor adaptability to different cabin environments in related technologies. TECHNICAL SOLUTION

[0005] To solve the above technical problems in the related art, the first aspect of the present application provides an in-vehicle adaptive sound playback method, which is applied to a sound system of a vehicle. The sound system comprises a domain controller in communication connection with a bus of the vehicle, a loudspeaker module arranged in a cabin of the vehicle and in communication connection with the domain controller, and a sensor module arranged in the cabin and in communication connection with the domain controller. The loudspeaker module comprises a plurality of loudspeakers respectively located at different positions in the cabin. The sensor module is configured to detect occupancy data of the cabin and internal acoustic characteristic data. The in-vehicle adaptive sound playback method is specifically applied to the domain controller and comprises the following steps: obtaining environmental data of the cabin, wherein the environmental data comprises the acoustic characteristic data, the occupancy data, and public data of the vehicle shared by the bus; analyzing sound playback parameters of the sound system adapted to the environmental data, wherein the sound playback parameters comprise sound effect parameters and physical state parameters of each loudspeaker; regulating the physical state of each loudspeaker according to the physical state parameters, wherein the physical state comprises a start-up state and a shutdown state; obtaining an audio signal to be played back, and processing the audio signal based on the sound effect parameters to obtain a target audio signal; and transmitting the target audio signal to each loudspeaker in the start-up state to play back the target audio signal in the cabin.

[0006] The second aspect of the present application provides a sound system applied to a vehicle, which comprises a domain controller in communication connection with a bus of the vehicle, a loudspeaker module arranged in a cabin of the vehicle and in communication connection with the domain controller, and a sensor module arranged in the cabin and in communication connection with the domain controller. The loudspeaker module comprises a plurality of loudspeakers respectively located at different positions in the cabin. The sensor module is configured to detect occupancy data of the cabin and internal acoustic characteristic data. Specifically, the domain controller is configured to: obtain environmental data of the cabin, wherein the environmental data comprises the acoustic characteristic data, the occupancy data, and public data of the vehicle shared by the bus; analyze sound playback parameters of the sound system adapted to the environmental data, wherein the sound playback parameters comprise sound effect parameters and physical state parameters of each loudspeaker; regulate the physical state of each loudspeaker according to the physical state parameters, wherein the physical state comprises a start-up state and a shutdown state; obtain an audio signal to be played back, and process the audio signal based on the sound effect parameters to obtain a target audio signal; and transmit the target audio signal to each loudspeaker in the start-up state to play back the target audio signal in the cabin.

[0007] The third aspect of the present application provides a domain controller, which comprises a memory and a processor in communication connection with the memory. The memory stores a computer program. The processor is configured to call the computer program to implement the in-vehicle adaptive sound playback method mentioned in the first aspect of the present application. Advantages

[0008] By implementation of the above technical solutions of the present application, the environment data capable of indicating the cabin environment is acquired by using the domain controller, and the sound playback parameters (i.e. the sound effect parameters and the physical state parameters of each loudspeaker) adapted to the environment data are analyzed, then the physical state of each loudspeaker is regulated according to the physical state parameters, and the target audio signal is obtained by processing the audio signal to be sound played according to the sound effect parameters, finally the target audio signal is transmitted to each loudspeaker which has been regulated in physical state, and the sound playback of the target audio signal is performed in the cabin by these loudspeakers. It can be understood that, since the sound playback parameters used in the sound playback process are adapted to the environment parameters of the cabin, the sound playback performed in the cabin is also adapted to the environment of the cabin, and when the environment of the cabin changes, the sound playback parameters used in the sound playback process will also change accordingly, that is, the sound playback in the present application has strong adaptability to different cabin environments, and the optimal sound playback effect can be obtained in different cabin environments, and the user can have a better acoustic experience, and when the environment of the cabin changes, the change of the sound playback parameters is spontaneous, and the user does not need to manually / voice adjust the sound playback parameters, which not only ensures the intelligent degree of the whole vehicle, but also reduces the complexity of the user in operation. BRIEF DESCRIPTION OF DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the related art or the embodiments of the present application, the drawings required to be used in the description of the related art or the embodiments of the present application will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and not all embodiments, and other drawings can be obtained by those skilled in the art without creative labor.

[0010] Fig. 1 is a module block diagram of the sound system provided by the embodiments of the present application;

[0011] Fig. 2 is a layout schematic diagram of a plurality of loudspeakers in a cabin provided by the embodiments of the present application;

[0012] Fig. 3 is a physical state diagram of a plurality of loudspeakers in a cabin provided by the embodiments of the present application;

[0013] Fig. 4 is another physical state diagram of a plurality of loudspeakers in a cabin provided by the embodiments of the present application;

[0014] Fig. 5 is a layout schematic diagram of a plurality of acoustic sensors in a cabin provided by the embodiments of the present application;

[0015] Fig. 6 is a layout schematic diagram of a plurality of optical sensors in a cabin provided by the embodiments of the present application;

[0016] Fig. 7 is a layout schematic diagram of a plurality of mechanical sensors in a cabin provided by the embodiments of the present application;

[0017] Fig. 8 is a schematic view of the layout of several temperature sensors in the cabin according to an embodiment of the present application;

[0018] Fig. 9 is a schematic view of the assembly of a loudspeaker in the cabin according to an embodiment of the present application;

[0019] Fig. 10 is an enlarged view of A in Fig. 9 according to an embodiment of the present application;

[0020] Fig. 11 is an example of acoustic response data detection according to an embodiment of the present application;

[0021] Fig. 12 is another example of acoustic response data detection according to an embodiment of the present application;

[0022] Fig. 13 is a block diagram of a domain controller according to an embodiment of the present application;

[0023] Fig. 14 is a flowchart of a method for adaptive sound playback in a vehicle according to an embodiment of the present application. Embodiments of the present application

[0024] In order to make the objects, technical solutions and advantages of the present application more obvious, easy to understand, the present application will be described in detail below in conjunction with the embodiments of the present application and the corresponding drawings, wherein the same or similar reference signs represent the same or similar elements or elements with the same or similar functions throughout. It should be understood that the embodiments of the present application described below are only used to explain the present application and do not limit the present application, i.e. based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application. In addition, the technical features involved in the embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0025] In the related art, when the vehicle audio system switches the sound playback mode, the user needs to judge the cabin environment and select the sound playback mode by himself, which not only brings the user cumbersome operation, but also reduces the intelligent degree of the vehicle, and when switching the sound playback mode, the sound effect parameters of the software layer of the vehicle audio system are mostly switched, which cannot better adapt to different cabin environments, i.e. the adaptability to different cabin environments is poor. Therefore, the present application proposes a method for adaptive sound playback in a vehicle and an audio system applying the method in the embodiments below, to avoid the above-mentioned drawbacks in the related art.

[0026] Fig. 1 is a module block diagram of a sound system, in some embodiments, the sound system 100 is applied in a car, which comprises a domain controller 120 communicatively connected with a bus 110 of the car, a speaker module 130 disposed in a cabin of the car and communicatively connected with the domain controller 120, and a sensor module 140 disposed in the cabin and communicatively connected with the domain controller 120, the speaker module 130 comprises a plurality of speakers 131 respectively located at different positions in the cabin, and the sensor module 140 is used to detect occupancy data and internal acoustic characteristic data of the cabin. The occupancy data can include but is not limited to the number of passengers in the cabin and the seating position of each passenger; the acoustic characteristic data can include but is not limited to background noise characteristics, reverberation characteristics, direct sound characteristics, and reflected sound characteristics; the bus 110 of the car is used to share public data of the car, which can include but is not limited to data related to the state of the vehicle speed, gear, seat, window, sunroof, and door.

[0027] Specifically, the domain controller 120 stores a computer program, which is essentially the in-vehicle adaptive sound playback method of the present application, that is, the domain controller 120 realizes the in-vehicle adaptive sound playback method of the present application by executing the computer program stored therein. In the actual sound playback process, the domain controller 120 can obtain environmental data (including acoustic characteristic data, occupancy data, and public data of the car shared by the bus 110) that can indicate the cabin environment in real time, analyze sound playback parameters (including sound effect parameters and physical state parameters of each speaker 131) of the sound system 100 that are adapted to the environmental data, then obtain an audio signal to be sound played, process the audio signal based on the sound effect parameters to obtain a target audio signal, and regulate the physical state of each speaker 131 according to the physical state parameters of each speaker 131, and finally transmit the target audio signal obtained by processing to each speaker 131 whose physical state is regulated, and the speakers 131 perform sound playback of the target audio signal in the cabin. It should be noted that in the present application, the sound effect parameters are, for example, audio software architecture, mixing matrix, signal flow, equalizer, delay, gain adjustment, phase calibration, reverberation adjustment, dynamic control, etc.; the physical state parameters can include but are not limited to boot parameters for guiding the speakers 131 to enter a boot state, shutdown parameters for guiding the speakers 131 to enter a shutdown state, position parameters for adjusting the position of the speakers 131 in the cabin, and radiation angle parameters for adjusting the radiation angle of the speakers 131; accordingly, the physical state of the speakers 131 is, for example, the boot state, the shutdown state, the position in the cabin, and the radiation angle, etc.

[0028] Therefore, since the sound playback parameters used in the sound playback process are adapted to the environment parameters of the cabin, the sound playback in the cabin is also adapted to the environment of the cabin, and when the environment of the cabin changes, the sound playback parameters used in the sound playback process will also change accordingly, that is, the sound playback in the application has strong adaptability to different cabin environments, and optimal sound playback effects can be obtained in different cabin environments, and users can have a better acoustic experience. When the environment of the cabin changes, the change of the sound playback parameters is spontaneous, and the user does not need to actively adjust the sound playback parameters, which ensures the intelligent degree of the whole vehicle and reduces the complexity of the user in operation.

[0029] As one of the embodiments, FIG. 2 is a schematic diagram of the layout of a plurality of speakers of a speaker module in a cabin. The speaker module 130 includes nine speakers 131, which are respectively a first speaker 1311, a second speaker 1312, a third speaker 1313, a fourth speaker 1314, a fifth speaker 1315, a sixth speaker 1316, a seventh speaker 1317, an eighth speaker 1318, and a ninth speaker 1319. The cabin of the vehicle is usually provided with a center console near the front of the vehicle and a storage table near the rear of the vehicle. The first speaker 1311 is arranged at the middle position of the center console, the second speaker 1312 and the third speaker 1313 are respectively arranged at the opposite sides of the center console, the fourth speaker 1314 is arranged on the right front door, the fifth speaker 1315 is arranged on the left front door, the sixth speaker 1316 is arranged on the right rear door, the seventh speaker 1317 is arranged on the left rear door, and the eighth speaker 1318 and the ninth speaker 1319 are respectively arranged at the opposite sides of the storage table. It can be understood that the number of the speakers 131 included in the speaker module 130 and the layout of the speakers 131 in the cabin are determined according to actual needs, and the application does not make a unique limitation thereto.

[0030] In the embodiment, the nine loudspeakers 131 are all in communication connection with the domain controller 120, that is, their physical states can all be regulated by the domain controller 120, so that their physical states will be different in different cabin environments. Exemplarily, FIG. 3 shows a physical state diagram of some loudspeakers in the cabin, when the environment of the cabin is that the main driver B1 is seated on the main driver seat and the copilot B2 is seated on the copilot seat, the domain controller 120 controls the second loudspeaker 1312, the third loudspeaker 1313, the eighth loudspeaker 1318 and the ninth loudspeaker 1319 to all enter the start-up state through corresponding physical state parameters, and controls the second loudspeaker 1312 and the third loudspeaker 1313 to be located on the opposite sides of the center console respectively, and controls the eighth loudspeaker 1318 and the ninth loudspeaker 1319 to be located on the opposite sides of the storage table respectively, and further controls the radiation angles of the second loudspeaker 1312, the third loudspeaker 1313, the eighth loudspeaker 1318 and the ninth loudspeaker 1319 to all point to the central position between the main driver B1 and the copilot B2 (the process of radiation of the loudspeaker 131 is essentially the process of sound playback), so as to achieve the purpose of uniformly radiating the main driver B1 and the copilot B2; FIG. 4 is another physical state diagram of some loudspeakers in the cabin, when the environment of the cabin is that only the main driver B1 is seated on the main driver seat, the domain controller 120 controls the second loudspeaker 1312, the third loudspeaker 1313, the eighth loudspeaker 1318 and the ninth loudspeaker 1319 to all enter the start-up state through corresponding physical state parameters, and controls the second loudspeaker 1312 and the third loudspeaker 1313 to be located on the center console and symmetrical relative to the main driver B1, and controls the eighth loudspeaker 1318 and the ninth loudspeaker 1319 to be located on the storage table and symmetrical relative to the main driver B1, and further controls the radiation angles of the second loudspeaker 1312 and the eighth loudspeaker 1318 to both point to the right ear of the main driver B1, and controls the radiation angles of the third loudspeaker 1313 and the ninth loudspeaker 1319 to both point to the left ear of the main driver B1, so as to achieve the purpose of symmetrically radiating the main driver B1.

[0031] As one of the embodiments, the sensor module 140 includes a plurality of sensors, which are respectively located at different positions in the cabin, through which the occupancy data and the acoustic characteristic data in the cabin can be detected in real time. In some implementations of the embodiment, the plurality of sensors included in the sensor module 140 are all acoustic sensors such as microphones, and the basic function of the acoustic sensors is the sound receiving function, so the acoustic sensors can detect the acoustic characteristic data in the cabin. In addition, a transmitter and a receiver such as an ultrasonic wave can be configured for each acoustic sensor, and through the transmission and reception of the ultrasonic wave, it can be easily detected which seats in the cabin are occupied by passengers, so as to obtain the number of passengers in the cabin and the seating positions of the passengers, i.e., the occupancy data of the cabin. As one of the implementations, FIG. 5 is a schematic diagram of the layout of a plurality of acoustic sensors in the cabin, and the sensor module 140 includes four acoustic sensors, which are respectively a first acoustic sensor 1411, a second acoustic sensor 1412, a third acoustic sensor 1413, and a fourth acoustic sensor 1414. The first acoustic sensor 1411 is arranged on the side of the co-pilot seat close to the right front door, the second acoustic sensor 1412 is arranged on the side of the rear right seat close to the right rear door, the third acoustic sensor 1413 is arranged on the side of the driver seat close to the left front door, and the fourth acoustic sensor 1414 is arranged on the side of the rear left seat close to the left rear door. The four acoustic sensors can detect the occupancy data and the acoustic characteristic data in the cabin in real time, and transmit the detected acoustic characteristic data and occupancy data to the domain controller 120.

[0032] In some other implementations of the embodiment, the sensor module 140 includes at least one of an acoustic sensor for detecting acoustic characteristic data in the cabin in real time, an optical sensor such as an optical lens for detecting occupancy data of the cabin in real time, a pressure sensor for detecting occupancy data of the cabin in real time, and an acceleration sensor for detecting occupancy data of the cabin in real time. It can be understood that when the optical sensor is used to detect the occupancy data of the cabin, the optical sensor emits and receives light beams through technologies such as TOF (Time Of Flight), so as to easily detect which seats in the cabin are occupied by passengers, and thus obtain the number of passengers in the cabin and the seating positions of the passengers, i.e., the occupancy data of the cabin. When the mechanical sensor is used to detect the occupancy data of the cabin, the mechanical sensor can be arranged on the seats in the cabin. When no passenger is seated on the seat, the pressure detected by the mechanical sensor is less than or equal to a preset pressure threshold. When a passenger is seated on the seat, the pressure detected by the mechanical sensor is greater than the preset pressure threshold. That is, once the pressure detected by the mechanical sensor is greater than the preset pressure threshold, it can be determined that a passenger is seated on the seat. In this way, it can be easily detected which seats in the cabin are occupied by passengers, and thus the number of passengers in the cabin and the seating positions of the passengers can be obtained, i.e., the occupancy data of the cabin. When the temperature sensor is used to detect the occupancy data of the cabin, the temperature sensor can be arranged on the seats in the cabin. When no passenger is seated on the seat, the temperature detected by the temperature sensor is less than or equal to a preset temperature threshold. When a passenger is seated on the seat, the temperature detected by the temperature sensor is greater than the preset temperature threshold. That is, once the temperature detected by the temperature sensor is greater than the preset temperature threshold, it can be determined that a passenger is seated on the seat. In this way, it can be easily detected which seats in the cabin are occupied by passengers, and thus the number of passengers in the cabin and the seating positions of the passengers can be obtained, i.e., the occupancy data of the cabin.

[0033] As one of the implementation manners, FIG. 6 is a schematic diagram of the layout of a plurality of optical sensors in the cabin. When the optical sensors are used to detect the occupancy data of the cabin, the sensor module 140 includes four optical sensors, i.e., a first optical sensor 1421, a second optical sensor 1422, a third optical sensor 1423, and a fourth optical sensor 1424. The four optical sensors are all arranged on the canopy. The first optical sensor 1421 and the second optical sensor 1422 are respectively arranged at positions close to the front of the vehicle and are spaced apart from each other. The third optical sensor 1423 and the fourth optical sensor 1424 are respectively arranged at positions close to the rear of the vehicle and are spaced apart from each other. The four optical sensors can all detect the occupancy data of the cabin in real time and transmit the detected occupancy data to the domain controller 120. As another implementation manner, FIG. 7 is a schematic diagram of the layout of a plurality of mechanical sensors in the cabin. When the mechanical sensors are used to detect the occupancy data of the cabin, the sensor module 140 includes four mechanical sensors, i.e., a first mechanical sensor 1431, a second mechanical sensor 1432, a third mechanical sensor 1433, and a fourth mechanical sensor 1434. The first mechanical sensor 1431 is arranged on the co-pilot seat. The second mechanical sensor 1432 is arranged on the main driver seat. The third mechanical sensor 1433 is arranged on the right rear seat. The fourth mechanical sensor 1434 is arranged on the left rear seat. The four mechanical sensors can all detect the occupancy data of the cabin in real time and transmit the detected occupancy data to the domain controller 120. As still another implementation manner, FIG. 8 is a schematic diagram of the layout of a plurality of temperature sensors in the cabin. When the temperature sensors are used to detect the occupancy data of the cabin, the sensor module 140 includes four temperature sensors, i.e., a first temperature sensor 1441, a second temperature sensor 1442, a third temperature sensor 1443, and a fourth temperature sensor 1444. The first temperature sensor 1441 is arranged on the co-pilot seat. The second temperature sensor 1442 is arranged on the main driver seat. The third temperature sensor 1443 is arranged on the right rear seat. The fourth temperature sensor 1444 is arranged on the left rear seat. The four temperature sensors can all detect the occupancy data of the cabin in real time and transmit the detected occupancy data to the domain controller 120.

[0034] As one of the embodiments, Fig. 9 is a schematic diagram of the assembly of the loudspeaker in the cabin, and Fig. 10 is an enlarged view of the part A in Fig. 9. Each loudspeaker 131 in the loudspeaker module 130 is in sliding fit with the wall of the cabin through a sliding piece 150 (for example, a sliding groove 160 is formed on the wall of the cabin, and the sliding piece 150 is arranged in the sliding groove 160). In addition to the structures listed above, the audio system 100 further comprises a plurality of sliding drivers 180 in communication with the domain controller 120, and each sliding driver 180 is in driving connection with a loudspeaker 131. Based on this, when regulating the physical state of each loudspeaker 131, the domain controller 120 can send a start-up instruction for guiding each loudspeaker 131 to enter the start-up state or a shutdown instruction for guiding each loudspeaker 131 to enter the shutdown state according to the corresponding physical state parameter, and send a sliding instruction to the sliding driver 180 of each loudspeaker 131 receiving the start-up instruction. Then, each sliding driver 180 receiving the sliding instruction can drive the corresponding loudspeaker 131 to slide on the wall of the cabin according to the corresponding sliding instruction, so as to adjust the position of each loudspeaker 131 receiving the start-up instruction in the cabin.

[0035] Further, each loudspeaker 131 in the loudspeaker module 130 is in rotational fit with the corresponding sliding piece 150 (for example, each loudspeaker 131 is connected with the corresponding sliding piece 150 through a rotating shaft 170). The audio system 100 further comprises a plurality of rotating drivers 190 in communication with the domain controller 120, and each rotating driver 190 is in driving connection with a loudspeaker 131. Based on this, when regulating the physical state of each loudspeaker 131, the domain controller 120 can also send a rotating instruction to the rotating driver 190 of each loudspeaker 131 in the start-up state according to the corresponding physical state parameter. Then, each rotating driver 190 receiving the rotating instruction can drive the corresponding loudspeaker 131 to rotate according to the corresponding rotating instruction, so as to adjust the radiation angle of each loudspeaker 131 in the start-up state.

[0036] As one of the embodiments, when the domain controller 120 analyzes the sound playback parameters suitable for the environment of the cabin, and regulates the physical state of each loudspeaker 131 in the loudspeaker module 130 according to the sound playback parameters, and processes the audio signal to be sound played according to the sound playback parameters to obtain the target audio signal, the sound playback of the target audio signal in the cabin can be performed through each loudspeaker 131 in the loudspeaker module 130 in the powered-on state at this time. The sound playback effect in the cabin is optimal and suitable for the environment of the cabin, but the passengers in the cabin cannot be motionless for a long time. The passengers will inevitably move their bodies to make themselves comfortable during the ride. At this time, the number of passengers in the cabin and the riding position of each passenger do not change, that is, the environment of the cabin does not change, so the sound playback parameters used in the sound playback process will not change, that is, the sound playback effect in the cabin does not change. However, the passengers have moved their bodies in the original riding position, which will change the relative position between the passengers and each loudspeaker 131 in the cabin. At this time, the listening effect of the passengers will inevitably deviate from the optimal listening effect before the body movement, that is, the sound playback effect in the cabin will deviate from the optimal sound playback effect before the body movement. In view of this situation, the embodiment can adjust the sound playback parameters used in the sound playback process in real time on the premise that the environment of the cabin does not change, so that even if the passengers move their bodies in the original riding position, the optimal listening effect can be obtained on the premise that the environment of the cabin does not change, that is, the sound playback effect in the cabin can always be optimal.

[0037] Specifically, the sensor module 140 of the embodiment can not only detect the riding data and the internal acoustic characteristic data of the cabin in real time, but also detect the acoustic response data at each passenger in the cabin in real time. Since the acoustic response data around the ears of the passengers can best represent the listening effect of the passengers, the sensor module 140 of the embodiment preferably detects the acoustic response data around the ears of each passenger in the cabin in real time. For example, FIG. 11 is an example diagram of acoustic response data detection. When the environment of the cabin is that the main driver B1 is seated on the main driver seat and the copilot B2 is seated on the copilot seat, the acoustic response data around the ears of the copilot B2 can be detected in real time by the first acoustic sensor 1411, and the acoustic response data around the ears of the main driver B1 can be detected in real time by the third acoustic sensor 1413. FIG. 12 is another example diagram of acoustic response data detection. When the environment of the cabin is that only the main driver B1 is seated on the main driver seat, the acoustic response data around the ears of the main driver B1 can be detected in real time by the third acoustic sensor 1413.

[0038] Based on this, in the actual sound playback process, when the domain controller 120 regulates the physical state of each loudspeaker 131 in the loudspeaker module 130 according to the sound playback parameters adapted to the environment of the cabin, and processes the audio signal to be sound played to obtain a target audio signal according to the sound playback parameters, and after the sound playback of the target audio signal in the cabin through each loudspeaker 131 in the loudspeaker module 130 in the powered-on state, the domain controller 120 can also obtain the acoustic response data at the ears of each passenger in the cabin in real time, and compare the acoustic response data at the ears of each passenger with the preset expected acoustic response data. Thus, the sound playback parameters can be dynamically adjusted according to the difference between the two, so that the acoustic response data at the ears of each passenger conforms to the expected acoustic response data. In this way, under the premise that the cabin environment does not change, even if the passengers move their bodies in the original positions, they can also obtain the optimal listening effect.

[0039] As one of the embodiments, FIG. 13 is a module block diagram of the domain controller, the domain controller 120 includes a memory 121 and a processor 122, the memory 121 is in communication connection with the processor 122, and the memory 121 stores a computer program, which is the in-vehicle adaptive sound playback method of the present application, that is, the processor 122 can call the computer program stored in the memory 121 to realize the in-vehicle adaptive sound playback method. In addition, it should be noted that in addition to the memory 121 and the processor 122, the domain controller 120 can also include other structures commonly used in the art, such as a communication line 123 for realizing the communication connection between the memory 121 and the processor 122, etc., which will not be enumerated one by one in the present application.

[0040] In some implementations of the present embodiment, the processor 122 is composed of an integrated circuit, which can be composed of a single packaged integrated circuit, or composed of multiple packaged integrated circuits with the same function or different functions. The processor 122 can include any one or a combination of a central processing unit (CPU), a microprocessor, a neural network chip, a digital processing chip, a graphics processor, and various control chips. It can be understood that the processor 122 is the control core of the domain controller 120, and the processor 122 connects all components of the domain controller 120 through various interfaces and lines, and realizes various functions and data processing of the domain controller 120 by running or executing computer programs or modules and calling data, such as the adaptive sound playback function of the present application.

[0041] In some implementations of the embodiment, the memory 121 at least includes one type of computer readable storage medium, which can include but is not limited to flash memory, mobile hard disk, multimedia card, card type memory (such as SD memory, DX memory, etc.), magnetic memory, disk and optical disk. In these implementations, the memory 121 can be an internal storage unit of the domain controller 120 (such as a mobile hard disk of the domain controller 120), or an external storage device of the domain controller 120, such as a plug-in mobile hard disk, a smart memory card (SMC), a secure digital (SD) card and a flash card equipped on the domain controller 120, or the memory 121 is both an internal storage unit and an external storage device of the domain controller 120; further, the memory 121 can be used not only to store application software, various data and computer programs (such as codes for implementing the adaptive sound playback function of the present application) installed on the domain controller 120, but also to temporarily store data that has been output or will be output; in the actual working process of the domain controller 120, the processor 122 can call and run the computer programs stored in the memory 121, thereby realizing the adaptive sound playback function of the present application.

[0042] The above embodiment is only a preferred implementation of the present application, and is not the only limitation on the related content of the sound system 100, the domain controller 120, etc. Therefore, those skilled in the art can flexibly set it according to the actual application scene on the basis of the above embodiment. In the following, the computer program (i.e. the in-vehicle adaptive sound playback method proposed in the present application) executed by the processor 122 in the domain controller 120 will be described in detail. FIG. 14 is a flowchart of the in-vehicle adaptive sound playback method, which in some embodiments includes steps 1401 to 1405 (abbreviated as S1401 to S1405), which are mainly used to spontaneously perform sound playback in the cabin of the car that is adapted to the environment of the cabin, so as to avoid the poor adaptability of sound playback to different cabin environments in the traditional scheme, and in the following steps, the present application will take the processor 122 in the domain controller 120 as the execution subject to describe.

[0043] S1401, obtaining environment data of the cabin.

[0044] In some embodiments, the sensor module 140 can detect the occupancy data and the internal acoustic characteristic data of the cabin in real time, the bus 110 of the car can share the public data of the car in real time, and the sensor module 140 and the bus 110 of the car are both in communication connection with the domain controller 120, so that the domain controller 120 can obtain the occupancy data, the acoustic characteristic data and the public data of the car in real time. The data obtained by the domain controller 120 can indicate the environment of the cabin, so these data are collectively referred to as the environment data of the cabin.

[0045] S1402, analyze the sound playback parameters of the sound system adapted to the environment data.

[0046] In some embodiments, after the domain controller 120 obtains the environment data of the cabin, it is necessary to analyze the sound playback parameters of the sound system 100 adapted to the environment data, i.e., to analyze the sound effect parameters adapted to the environment of the cabin and the physical state parameters of each loudspeaker 131 in the loudspeaker module 130. As one of the embodiments, the process of analyzing the sound playback parameters adapted to the environment data by the domain controller 120 includes: obtaining a preset lookup table indicating the correspondence between the environment data and the sound playback parameters of the sound system 100; and searching for the sound playback parameters adapted to the environment data in the lookup table based on the environment data. As another embodiment, the process of analyzing the sound playback parameters adapted to the environment data by the domain controller 120 includes: obtaining a preset mapping function indicating the correspondence between the environment data and the sound playback parameters of the sound system 100; inputting the environment data into the mapping function, and obtaining the sound playback parameters adapted to the environment data output by the mapping function.

[0047] S1403, according to the physical state parameters, adjust the physical state of each loudspeaker.

[0048] In some embodiments, after the domain controller 120 analyzes the sound effect parameters adapted to the environment of the cabin and the physical state parameters of each loudspeaker 131 in the loudspeaker module 130, it can adjust the physical state of each loudspeaker 131 according to the physical state parameters of each loudspeaker 131, such as adjusting the on or off state, the position in the cabin, and the radiation angle, so that the physical state of each loudspeaker 131 is adapted to the environment of the cabin, and the subsequent sound playback of each loudspeaker 131 is adapted to the environment of the cabin. As one of the embodiments, the process of adjusting the physical state of each loudspeaker 131 according to the physical state parameters of each loudspeaker 131 by the domain controller 120 includes: sending an on or off instruction to each loudspeaker 131 according to the physical state parameters of each loudspeaker 131, to guide each loudspeaker 131 to enter an on or off state; sending a sliding instruction to the sliding driver 180 of each loudspeaker 131 receiving the on instruction, to guide each sliding driver 180 receiving the sliding instruction to drive the corresponding loudspeaker 131 to slide on the wall of the cabin according to the corresponding sliding instruction, thereby adjusting the position of each loudspeaker 131 receiving the on instruction in the cabin; and sending a rotating instruction to the rotating driver 190 of each loudspeaker 131 in the on state, to guide each rotating driver 190 receiving the rotating instruction to drive the corresponding loudspeaker 131 to rotate according to the respective rotating instruction, thereby adjusting the radiation angle of each loudspeaker 131 in the on state.

[0049] S1404, acquire an audio signal to be sound-replayed, and process the audio signal based on the sound effect parameter to obtain a target audio signal.

[0050] In some embodiments, after the domain controller 120 regulates the physical state of each loudspeaker 131 according to the physical state parameter of each loudspeaker 131, it is also necessary to acquire an audio signal to be sound-replayed, and process the audio signal based on the sound effect parameter suitable for the environment of the cabin to obtain a target audio signal. It should be noted that there is no explicit execution order between regulating the physical state of each loudspeaker 131 according to the physical state parameter of each loudspeaker 131 and processing the audio signal based on the sound effect parameter, that is, between S1403 and S1404. Either of the two can be executed first, and the two can also be executed simultaneously. The present application does not make a unique limitation on this.

[0051] S1405, transmit the target audio signal to each loudspeaker in the powered-on state to perform sound-replay of the target audio signal in the cabin.

[0052] In some embodiments, after the domain controller 120 processes the audio signal based on the sound effect parameter suitable for the environment of the cabin to obtain a target audio signal, it can transmit the target audio signal to each loudspeaker 131 in the powered-on state, the purpose being to perform sound-replay of the target audio signal in the cabin through these loudspeakers 131, at this time the sound-replay performed is suitable for the environment of the cabin. As one of the embodiments, the process of the domain controller 120 transmitting the target audio signal to each loudspeaker 131 in the powered-on state includes: digital-to-analog conversion of the target audio signal; power amplification of the target audio signal after digital-to-analog conversion; and transmission of the target audio signal after power amplification to each loudspeaker 131 in the powered-on state. It can be understood that the audio signal to be sound-replayed and the target audio signal after processing both belong to digital signals, that is, the processing of the audio signal based on the sound effect parameter is also digital signal processing, and after digital-to-analog conversion of the target audio signal, the obtained target audio signal belongs to an analog signal, that is, the domain controller 120 transmits to each loudspeaker 131 is the target audio signal in the form of an analog signal.

[0053] As one of the embodiments, also mentioned in the foregoing, if the passengers make physical movements on the originally occupied positions, the listening effect of the passengers will also be affected, i.e., the listening effect of the passengers deviates from the optimal listening effect before the physical movements, and therefore, after S1405, the method further includes: acquiring the acoustic response data at the ears of the passengers in the cabin; comparing the acoustic response data at the ears of the passengers with the preset expected acoustic response data, and dynamically adjusting the sound playback parameters according to the difference between the two, so that the acoustic response data at the ears of each passenger conforms to the expected acoustic response data. Thus, under the premise that the cabin environment does not change, even if the passengers make physical movements on the originally occupied positions, the optimal listening effect can also be obtained. In addition, it should be noted that for the unfinished parts in the description of the in-vehicle adaptive sound playback method, please refer to the related description of the sound system 100 in the foregoing, which will not be described here.

[0054] The above embodiments are only preferred implementations of the present application, and are not the only limitations of the related content of the in-vehicle adaptive sound playback method; based on the above embodiments, those skilled in the art can flexibly set according to actual application scenarios. It can be understood that through the implementation of the above embodiments of the present application, the domain controller 120 is used to acquire the environment data indicating the cabin environment, and analyze the sound playback parameters (i.e., the sound effect parameters and the physical state parameters of the speakers 131) suitable for the environment data, then adjust the physical state of the speakers 131 according to the physical state parameters, and process the audio signal to be sound played to obtain a target audio signal according to the sound effect parameters, and finally transmit the target audio signal to the speakers 131 whose physical state has been adjusted, so as to perform sound playback of the target audio signal in the cabin through the speakers 131. As can be seen, because the sound playback parameters used in the sound playback process are suitable for the environment parameters of the cabin, the sound playback performed in the cabin is also suitable for the environment of the cabin, and when the environment of the cabin changes, the sound playback parameters used in the sound playback process will also change accordingly, i.e., the sound playback in the present application is very suitable for different cabin environments, and can obtain the optimal sound playback effect in different cabin environments, and can bring better acoustic experience to the user, and when the environment of the cabin changes, the change of the sound playback parameters is spontaneous, and the user does not need to manually / voice adjust the sound playback parameters, which not only ensures the intelligent degree of the whole vehicle, but also reduces the complexity of the user in operation.

[0055] The steps of a method or algorithm described in connection with the embodiments disclosed herein can be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two, where the software module can be stored in a random access memory (RAM), a memory, a read only memory (ROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0056] In the foregoing embodiments, all or some of the steps can be implemented by using software, hardware, firmware or any combination thereof. When implemented by using software, the steps can be implemented by one or more computer programs. When implemented by using hardware, the steps can be implemented by using one or more specific hardware configurations. The computer program can be stored in a computer readable storage medium, which can be any available media that can be accessed by a computer. The computer readable storage medium can be a computer program product in the form of a volatile or non-volatile computer readable medium. The computer readable storage medium can be removable or non-removable and can be volatile or non-volatile. By way of example, and not limitation, computer readable storage media can include a random access memory (RAM), a read-only memory (ROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, or any other available memory or data storage medium that can be used to store and access computer readable instructions, data structures, program modules or other data. The computer readable storage medium can also be a computer program product that is in a form of a computer readable storage medium having computer readable instructions stored therein. The computer readable instructions can be executed by a computer processor to cause the computer processor to perform functions described in the embodiments of the present application.

[0057] It should be noted that each of the above-mentioned embodiments of the present application is described by using a progressive manner, and each embodiment focuses on the difference from other embodiments. Therefore, the same or similar parts among the embodiments can be understood by referring to each other. It should also be noted that the terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any actual relationship or order between the entities or operations. In addition, the terms "include", "contain" or any variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes the listed elements, but also can include other elements not explicitly listed or inherent to the process, method, article or device. Without further limitation, the elements defined by the statement "include" do not exclude the presence of other same elements in the process, method, article or device including the elements.

[0058] The previous description of the disclosed implementations is provided to enable any person skilled in the art to make or use the features of the present disclosure. Various modifications to these implementations will be readily apparent to those skilled in the art, and the generic principles defined herein can be applied to other implementations without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the described implementations but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An in-vehicle adaptive sound playback method applied to an audio system of a vehicle, the audio system comprising a domain controller in communication connection with a bus of the vehicle and a loudspeaker module arranged in a cabin of the vehicle and in communication connection with the domain controller, the loudspeaker module comprising a plurality of loudspeakers respectively located at different positions in the cabin, characterized in that, The sound system further comprises a sensor module arranged in the cabin and communicatively connected to the domain controller, the sensor module being configured to detect occupancy data and internal acoustic characteristic data of the cabin; The in-vehicle adaptive sound playback method is specifically applied to the domain controller and comprises the following steps: obtaining environmental data of the cabin, wherein the environmental data comprises the acoustic characteristic data, the occupancy data, and common data of the vehicle shared by the bus; analyzing sound playback parameters of the sound system that are adapted to the environmental data, wherein the sound playback parameters comprise sound effect parameters and physical state parameters of each loudspeaker; controlling the physical state of each loudspeaker according to the physical state parameters, wherein the physical state comprises a startup state and a shutdown state; obtaining an audio signal to be played back, and processing the audio signal based on the sound effect parameters to obtain a target audio signal; transmitting the target audio signal to each loudspeaker in the startup state to play back the target audio signal in the cabin.

2. The in-vehicle adaptive sound playback method of claim 1, wherein, The analysis of the sound playback parameters of the sound system that are adapted to the environmental data comprises: obtaining a preset lookup table, wherein the lookup table indicates the correspondence between the environmental data and the sound playback parameters of the sound system; using the environmental data as a lookup basis to find the sound playback parameters that are adapted to the environmental data in the lookup table.

3. The in-vehicle adaptive sound playback method of claim 1, wherein, The analysis of the sound playback parameters of the sound system that are adapted to the environmental data comprises: obtaining a preset mapping function, wherein the mapping function indicates the correspondence between the environmental data and the sound playback parameters of the sound system; inputting the environmental data into the mapping function and obtaining the sound playback parameters that are adapted to the environmental data output by the mapping function.

4. The in-vehicle adaptive sound playback method of claim 1, wherein, Each loudspeaker is slidably connected to the wall of the cabin through a sliding member, and the sound system further comprises a plurality of sliding drivers communicatively connected to the domain controller, each sliding driver being drivingly connected to one loudspeaker; the physical state further comprises the position of the loudspeaker in the cabin. The control of the physical state of each loudspeaker according to the physical state parameters comprises: sending a startup instruction or a shutdown instruction to each loudspeaker according to the physical state parameters, wherein the startup instruction is used to guide the loudspeaker to enter the startup state, and the shutdown instruction is used to guide the loudspeaker to enter the shutdown state; sending a sliding instruction to the sliding driver of each loudspeaker in the startup state according to the physical state parameters, wherein the sliding instruction is used to guide the sliding driver to drive the corresponding loudspeaker to slide on the wall of the cabin to adjust the position of the loudspeaker in the cabin.

5. The in-vehicle adaptive sound playback method of claim 4, wherein, Each of the loudspeakers is rotationally coupled with a corresponding sliding piece, and the sound system further comprises a plurality of rotary drivers communicatively connected to the domain controller, each of the rotary drivers being drivingly connected with one of the loudspeakers; the physical state further comprises a radiation angle of the loudspeakers; and the regulating the physical state of each of the loudspeakers according to the physical state parameter further comprises: sending a rotation instruction to the rotary driver of each of the loudspeakers in the powered-on state according to the physical state parameter, wherein the rotation instruction is used to guide the rotary driver to drive the corresponding loudspeaker to rotate, so as to adjust the radiation angle of the loudspeaker.

6. The in-vehicle adaptive sound playback method of claim 1, wherein, The sensor module is further configured to detect acoustic response data of each passenger in the cabin; After the target audio signal is transmitted to each of the loudspeakers in the powered-on state, the method further comprises: obtaining the acoustic response data; dynamically adjusting the sound playback parameter according to a difference between the acoustic response data and expected acoustic response data, so that the acoustic response data conforms to the expected acoustic response data.

7. The in-vehicle adaptive sound playback method of claim 1, wherein, The transmitting the target audio signal to each of the loudspeakers in the powered-on state comprises: digital-to-analog conversion of the target audio signal; power amplification of the target audio signal after the digital-to-analog conversion; transmission of the target audio signal after the power amplification to each of the loudspeakers in the powered-on state.

8. The in-vehicle adaptive sound playback method of claim 1, wherein, The sensor module comprises a plurality of sensors respectively located at different positions in the cabin, and each of the sensors is an acoustic sensor; and the obtaining the environmental data of the cabin comprises: obtaining public data of the vehicle shared by the bus; obtaining occupancy data of the cabin and acoustic feature data in the cabin detected by the acoustic sensor.

9. The in-vehicle adaptive sound playback method of claim 1, wherein, The sensor module comprises a plurality of sensors respectively located at different positions in the cabin, and the types of the sensors include at least one of an acoustic sensor, an optical sensor, a mechanical sensor, and a temperature sensor; and the obtaining the environmental data of the cabin comprises: obtaining public data of the vehicle shared by the bus; obtaining acoustic feature data in the cabin detected by the acoustic sensor; obtaining occupancy data of the cabin detected by at least one of the optical sensor, the mechanical sensor, and the temperature sensor.

10. A sound system, characterized by The in-vehicle adaptive sound playback method according to any one of claims 1 to 9 is applied to sound playback in a cabin of a vehicle.

11. A domain controller, characterized by comprises: a memory storing a computer program; a processor communicatively connected to the memory and configured to invoke the computer program to implement the in-vehicle adaptive sound playback method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Automatic tuning method, related equipment and readable storage medium

    CN110913325A

  • Vehicle-mounted three-dimensional loudspeaker and loudspeaker system

    CN117319883A

  • In-car audio system

    GB2569598A

  • Vehicular communication control method and radio communication system

    JP2019097067A

  • An vehicle automatic-calibration sound field device

    TW201442521A