Audio control method and system, storage medium, program product, electronic equipment and vehicle

Abstract

The invention discloses an audio control method, a storage medium, a program product, an electronic device and a vehicle, according to the scheme, an audio system is controlled to output audio responses to a plurality of first sound field areas, and the plurality of first sound field areas are formed based on position information of people in the vehicle. The problem that an existing automobile sound system is fixed in sound field and cannot adapt to dynamic changes of passengers, and consequently acoustic experience is poor is solved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent vehicle technology, and in particular to an audio control method and system, a storage medium, a program product, an electronic device, and a vehicle. Background Art

[0002] With the popularization of automobiles and the continuous improvement of people's requirements for driving experience, the optimization of the in-car acoustic environment has become an important research direction.

[0003] Traditional car audio systems typically use a fixed sound field pattern, configuring audio output according to the vehicle's pre-set seating layout. Regardless of the actual distribution of passengers, the sound produced by the speakers maintains a relatively fixed distribution within the vehicle's interior. However, in real-world scenarios, the number and position of passengers often change, and passengers in different positions have different sound needs and perceptions. For example, front-seat drivers may be more concerned with functional sounds like navigation voice prompts and traffic information, and require a clear hearing of the surrounding ambient sound while the vehicle is in motion. Rear-seat passengers, on the other hand, may prefer to enjoy the entertainment experience provided by music and videos while driving, requiring a highly immersive surround sound experience. Fixed sound field patterns cannot meet these diverse and dynamically changing needs, and can easily result in problems such as excessively loud or quiet sounds in certain areas, a poor listening experience, and even compromised driving safety. Summary of the Invention

[0004] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention proposes an audio control method and system, storage medium, program product, electronic device and vehicle. This solution forms multiple first sound field areas based on the position information of the occupants in the car, and controls the audio system to output audio responses to the multiple first sound field areas. In this way, the sound field areas of this solution are determined based on the positions of the occupants in the car. When the occupants in the car change, the corresponding sound field areas will also change. The audio system is controlled to output audio responses to multiple sound field areas, thereby meeting the diverse and dynamically changing needs of users and improving driving safety. This solves the problem that the existing car audio system has a fixed sound field and cannot adapt to the dynamic changes of the occupants, resulting in a poor acoustic experience.

[0005] To achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, the present application provides an audio control method, comprising: controlling an audio system to output audio responses to a plurality of first sound field areas, wherein the plurality of first sound field areas are formed based on position information of people in a vehicle.

[0007] In this way, the sound field area of ​​this solution is determined based on the position of the occupants in the vehicle. When the occupants change, the corresponding sound field area also changes. The audio system is controlled to output audio responses to multiple sound field areas, thus meeting the diverse and dynamic needs of users and improving driving safety. This solves the problem of existing car audio systems with a fixed sound field and inability to adapt to the dynamic changes of occupants, resulting in a poor acoustic experience.

[0008] In some embodiments of the present application, the method further includes: determining a plurality of second sound field areas, each area corresponding to at least one group of audio sound emitting units; the plurality of second sound field areas are obtained by dividing the interior space of the vehicle based on seat positions.

[0009] In some embodiments of the present application, the further step includes: determining a plurality of the first sound field areas, where the plurality of the first sound field areas are obtained by adjusting a plurality of the second sound field areas based on the position information of the occupants in the vehicle.

[0010] In some embodiments of the present application, the method further includes: obtaining location information of people in the vehicle.

[0011] In some embodiments of the present application, obtaining the position information of the person in the vehicle includes: detecting the position information of the person in the vehicle based on a combination of multiple sensors.

[0012] In some embodiments of the present application, determining the plurality of first sound field areas based on the information includes: generating a personnel matrix distribution based on position information of personnel in the vehicle; and forming the plurality of first sound field areas based on the personnel matrix distribution.

[0013] In some embodiments of the present application, the method further includes: determining the sound field parameter configuration of each area based on the behavior patterns and / or preference settings of the people in the vehicle.

[0014] In some embodiments of the present application, controlling the sound system to output audio responses to the multiple first sound field areas includes: controlling the sound system to output audio responses to the multiple first sound field areas according to the sound field parameter configuration of each area.

[0015] In some embodiments of the present application, determining the sound field parameter configuration of each area based on the behavior patterns and / or preference settings of the people in the car includes: determining the sound field type of each area based on the behavior patterns and / or preference settings of the people in the car; determining the sound field parameter configuration of each area according to the sound field type of each area.

[0016] In some embodiments of the present application, the method further includes: determining whether the person in the vehicle is moving based on the person's position and / or the noise information in the vehicle.

[0017] In some embodiments of the present application, determining the plurality of first sound field areas includes: when it is determined that a person in the vehicle is moving, adjusting boundaries of the plurality of second sound field areas based on the changed position information of the person to form the plurality of first sound field areas.

[0018] In a second aspect, an audio control system is provided, comprising: an audio system including a plurality of audio sound-generating units; a controller connected to the plurality of audio sound-generating units, for controlling the audio sound-generating units to output audio responses to a plurality of first sound field areas, wherein the plurality of first sound field areas are formed based on position information of people in the vehicle.

[0019] In some embodiments of the present application, the system further includes: a sensor module connected to the controller, and the controller is further used to detect position information of people in the vehicle based on the multiple sensor modules.

[0020] In some embodiments of the present application, the sensor module includes at least one of the following: an infrared sensor, a pressure sensor, and a camera.

[0021] In a third aspect, the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer implements the audio control method as described in the first aspect.

[0022] In a fourth aspect, the present application provides a computer program product, which stores instructions. When the instructions are executed by a computer, the computer implements the audio control method as described in the first aspect.

[0023] In a fifth aspect, the present application provides an electronic device comprising: a memory on which a computer program is stored; and a processor for executing the computer program in the memory to implement the audio control method as described in the first aspect.

[0024] In a sixth aspect, the present application provides a vehicle comprising: a control system as described in the second aspect; or, an electronic device as described in the fifth aspect; or, an audio system and a controller, the controller being configured to execute the audio control method as described in the first aspect.

[0025] The advantages and control methods of the vehicle, the electronic device, and the control system compared to the prior art are the same and will not be elaborated here.

[0026] Additional aspects and advantages of the present invention will be set forth in part in the description which follows and, in part, will be obvious from the description which follows, or may be learned by practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] To more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present application. Those skilled in the art can also derive other drawings based on these drawings without inventive effort.

[0028] In order to more completely understand the present application and its beneficial effects, the following description will be given in conjunction with the accompanying drawings, wherein the same drawing numbers represent the same parts in the following description.

[0029] Figure 1 is a structural diagram of an audio control system provided according to an embodiment of the present invention;

[0030] Figure 2 is a structural diagram of another audio control system provided according to an embodiment of the present invention;

[0031] Figure 3 is a flowchart of an audio control method provided according to an embodiment of the present invention;

[0032] Figure 4 Schematic diagram of initial sound field area division provided by an embodiment of the present invention;

[0033] Figure 5 is a schematic diagram of scene 1 of multiple first sound field areas provided by an embodiment of the present invention;

[0034] Figure 6 is a schematic diagram of scene 2 of multiple first sound field areas provided by an embodiment of the present invention;

[0035] Figure 7 is a schematic diagram of scene three of multiple first sound field areas provided by an embodiment of the present invention;

[0036] Figure 8 is a schematic diagram of scene 4 of multiple first sound field areas provided by an embodiment of the present invention;

[0037] Figure 9 is a schematic diagram of scene 5 of multiple first sound field areas provided by an embodiment of the present invention;

[0038] Figure 10 is a flow chart of another audio control method provided according to an embodiment of the present invention;

[0039] Figure 11 is a structural diagram of an electronic device provided according to an embodiment of the present invention. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0041] In order to facilitate understanding of the implementation scheme provided in the embodiment of the present application, the relevant application background of the audio processing method provided in the embodiment of the present application is first explained.

[0042] In today's automotive landscape, existing car audio systems generally adopt a fixed sound field mode. From a technical implementation perspective, this type of system sets the audio output according to the vehicle's preset seating layout. The audio sound units deliver sound to all directions in the car according to a predetermined program with a relatively fixed volume, channel balance, and frequency response. For example, regardless of where the passengers are actually sitting in the car or how many passengers there are, the front left and right channel speakers always output music or navigation voice with the same power distribution, and the rear speakers also create a surround feeling according to a unified standard. At the same time, some mid-to-high-end models may provide several fixed sound effect modes, such as "normal mode", "surround sound mode", "driver's seat priority mode", etc., but these modes also require manual switching by the driver, and after switching, they can only choose between a limited number of preset options and cannot adapt to dynamically changing personnel scenarios in real time.

[0043] This traditional approach has numerous drawbacks that severely impact the driving experience. First, it fails to adapt to the dynamics of passenger occupancy. In daily commutes, the number and location of passengers in a vehicle frequently change. On a commute, the driver and passenger seats may be occupied, leaving the back row empty. However, a fixed sound field still evenly distributes sound throughout the vehicle, wasting energy in the back row and reducing clarity in certain areas of the front row. On family outings, children may frequently switch seats in the back row, and a fixed sound field fails to accurately meet their hearing needs, resulting in excessively loud or quiet sound in certain areas, significantly compromising passenger comfort. Furthermore, passengers in different positions have varying requirements for sound functionality and perception, which a fixed sound field cannot accommodate. Drivers prioritize functional sounds like navigation and traffic warnings while driving, requiring clear discrimination of ambient ambient sounds. With the current fixed sound field, music and entertainment sounds often interfere with critical information, compromising driving safety. Backseat passengers, however, enjoy the pleasure of watching movies or listening to music, but the fixed sound field offers a lackluster experience, significantly compromising their entertainment experience.

[0044] To address the aforementioned issues, this solution forms multiple first sound field zones based on the position of occupants within the vehicle, and controls the audio system to output audio responses to these zones. This solution's sound field zones are determined based on the position of occupants within the vehicle. When the occupants change, the corresponding sound field zones also change. Controlling the audio system to output audio responses to these multiple sound field zones addresses the diverse and dynamically changing needs of users, improving driving safety. This addresses the problem of existing car audio systems, which suffer from a fixed sound field and an inability to adapt to the dynamic changes of occupants, resulting in a poor acoustic experience.

[0045] like Figure 1 , which is a structural diagram of an audio control system provided by an embodiment of the present invention.

[0046] An embodiment of the present invention provides an audio control system, which includes: an audio system 101 and a controller 102, wherein: the audio system 101 includes multiple audio sound-generating units; the controller 102 is connected to the multiple audio sound-generating units and is used to control the audio sound-generating units to output audio responses to multiple first sound field areas, and the multiple first sound field areas are formed based on the position information of the people in the vehicle.

[0047] Further optionally, the above system further includes a sensor module 103, which is connected to the controller 102. The controller 102 is also used to detect the position information of the people in the vehicle based on the multiple sensor modules.

[0048] Further optionally, the above-mentioned controller 102 is also used to determine multiple second sound field areas, each area corresponds to at least one group of audio sound units; the multiple second sound field areas are obtained by dividing the vehicle interior space based on the seat positions; the controller 102 is also used to determine multiple first sound field areas, and the multiple first sound field areas are obtained by adjusting the multiple second sound field areas based on the position information of the people in the vehicle.

[0049] As an optional implementation, the controller 102 is specifically configured to: generate a occupant matrix distribution based on position information of occupants in the vehicle; and form a plurality of first sound field regions based on the occupant matrix distribution.

[0050] As an optional implementation, the controller 102 is further configured to determine the sound field parameter configuration of each area based on the behavior patterns and / or preference settings of the occupants of the vehicle.

[0051] Further optionally, the controller 102 controls the sound system to output audio responses to the multiple first sound field areas by controlling the sound system to output audio responses to the multiple first sound field areas according to the sound field parameter configuration of each area.

[0052] As an optional implementation method, the above-mentioned controller 102 determines the sound field parameter configuration of each area based on the behavior patterns and / or preference settings of the people in the car, and is specifically used to: determine the sound field type of each area based on the behavior patterns and / or preference settings of the people in the car; determine the sound field parameter configuration of each area according to the sound field type of each area.

[0053] As an optional implementation, the controller 102 is further configured to determine whether a person in the vehicle is moving based on the person's position and / or in-vehicle noise information.

[0054] Further optionally, when determining the multiple first sound field areas, the controller is specifically configured to: when it is determined that a person in the vehicle is moving, adjust boundaries of the multiple second sound field areas based on the changed position information of the person to form the multiple first sound field areas.

[0055] This control system can control the audio system to output audio responses to multiple first sound field zones, each of which is determined based on the position of occupants within the vehicle. This solution determines the sound field zones based on the position of occupants within the vehicle. When the occupants change, the corresponding sound field zones also change. Controlling the audio system to output audio responses to multiple sound field zones meets the diverse and dynamic needs of users, improving driving safety. This addresses the problem of existing automotive audio systems, which suffer from a fixed sound field and an inability to adapt to the dynamic changes of occupants, resulting in a poor acoustic experience.

[0056] like Figure 2 FIG2 is a schematic diagram of a system architecture provided by an embodiment of the present invention.

[0057] As an optional embodiment, the controller 102 may be a central processing unit 1020, which includes the following: a multi-source data fusion module 1021, an acoustic region calculation engine 1022, a sound field parameter configuration optimization module 1023, and an ambient noise compensation module 1024. The multi-source data fusion module is used to receive and calibrate data from different sensors in real time to generate a occupant distribution matrix; the acoustic region calculation engine calculates the optimal acoustic region based on the occupant distribution matrix; the acoustic region parameter configuration optimization module determines the acoustic field requirements based on behavioral data and generates the acoustic field parameter configurations required for different regions; and the ambient noise compensation module generates anti-phase sound waves to offset noise in specific frequency bands and further determines the location of occupants based on the collected sound. These four modules complement each other, using sensor data to perform region division and parameter optimization, and finally the speaker outputs the audio response.

[0058] As an optional embodiment, the sensor module 103 includes at least one of the following: an infrared sensor 1033, a pressure sensor 1032, and a camera 1031. For example, the infrared sensor can be installed on the ceiling of the vehicle to collect infrared sensing signals from the human body; the pressure sensor can be installed under the seat to collect pressure data for each seat; and the camera can be installed on the rearview mirror inside the vehicle to collect coordinates and posture data of the occupants.

[0059] As an optional embodiment, the above-mentioned sound generating unit may be a speaker. For example, Figure 2 As shown, the audio system 101 includes a front left speaker 1011, which is located at the left front door of the vehicle; a center speaker 1012, which is located at the center console of the vehicle; a front right speaker 1013, which is located at the right front door of the vehicle; a rear speaker 11014, which is located at the left rear door of the vehicle; a subwoofer 1055, which is located under the middle rear seat of the vehicle; and a rear speaker 2 1016, which is located at the right rear door of the vehicle. The rear speakers 1 mentioned above include a rear left speaker and a rear left surround speaker, and the rear speakers 2 include a rear right speaker and a rear right surround speaker.

[0060] The system's implementation process is as follows: First, a sensor combination, including infrared sensors, pressure sensors, and a camera image recognition module, monitors the location and number of passengers within the vehicle. Infrared sensors determine the presence of passengers in corresponding areas. Pressure sensors, placed under seats, detect pressure exceeding a preset threshold and confirm that the seat is carrying a passenger. The camera module uses captured interior images to identify the detailed position and posture of passengers. Furthermore, different initial acoustic zones are set based on the vehicle's interior space structure and seat layout. Once passengers are seated, the acoustic zones are intelligently adjusted based on their seated position, ensuring that each passenger is positioned near the center of their personalized acoustic zone and avoiding energy loss in ineffective areas. Sound field parameters are dynamically configured based on passenger behavior. Throughout the vehicle's journey, sensors continuously collect information such as changes in passenger position and fluctuations in ambient noise levels. Based on this information, zones are redefined and sound field parameters are calibrated to ensure a favorable sound field environment for passengers.

[0061] The main advantages of the above scheme are as follows:

[0062] 1. A personalized sound field experience that can customize the acoustic environment based on the real-time position and needs of different passengers. Whether it is the driver's acquisition of functional sound or the rear passengers' immersive enjoyment of entertainment sound effects, both can be satisfied, improving driving comfort.

[0063] 2. Efficient use of energy: through personnel positioning and dynamic area adjustment, it ensures that sound energy is only delivered to areas with passengers, avoiding ineffective output to unmanned areas and reducing energy consumption.

[0064] 3. Improve driving safety by adapting to the special acoustic requirements of the driver's seat to ensure that key sounds such as navigation and warnings are clearer, allowing drivers to focus on driving operations without being distracted by unnecessary sounds, thereby reducing the risk of accidents.

[0065] like Figure 3 FIG. 1 is a flow chart of an audio control method provided by an embodiment of the present invention. The method includes:

[0066] 302 : Control the audio system to output audio responses to a plurality of first sound field areas, where the plurality of first sound field areas are formed based on position information of people in the vehicle.

[0067] As an optional implementation, before step 302, the method further includes:

[0068] 301. Determine multiple first sound field areas.

[0069] Wherein: the above-mentioned multiple first sound field areas are obtained by adjusting multiple second sound field areas based on the position information of the people in the vehicle.

[0070] As an optional implementation, before step 301 , the method further includes: 300 , determining a plurality of second sound field areas, each area corresponding to at least one group of sound emitting units.

[0071] Wherein: the above-mentioned multiple second sound field areas are obtained by dividing the vehicle interior space based on the seat positions.

[0072] like Figure 4 FIG. 1 is a schematic diagram of initial sound field area division provided by an embodiment of the present invention.

[0073] For example, the second sound field area in the above step 300 is Figure 4 Corresponding initial sound field area. This solution divides the interior space of the vehicle into multiple initial sound field areas in advance according to the interior space structure and seat layout of the vehicle. Each area corresponds to one or more groups of vehicle audio sound units. Common cars can be divided into the front driving area, the front passenger area, the rear left area, the rear middle area, and the rear right area. The division results of the initial sound field area are as follows: Figure 4As shown in the figure, ① Sound Field Zone 1: Primarily provides the driver with clear navigation and driving-related information, with the speaker layout emphasizing the clear transmission of sounds coming from the front. ② Sound Field Zone 2: Primarily provides the front passenger with an independent audio experience, with volume and sound effects adjustable to suit passenger needs. ③ Sound Field Zone 3: Provides surround sound for the left rear passenger, enhancing the music and entertainment experience. ④ Sound Field Zone 4: Corresponding to Sound Field Zone 3, it provides similar audio services for the right rear passenger. ⑤ Sound Field Zone 5: Located in the middle of the rear row, it balances the sound integration between the front and rear rows, providing a relatively balanced acoustic environment.

[0074] Exemplarily, based on the above step 300, the above step 301 specifically includes the following contents: 301a, adjusting boundaries of multiple second sound field areas based on position information of occupants in the vehicle to form multiple first sound field areas.

[0075] The specific implementation process of the above-mentioned step 301a will be explained below based on the positions of people in different situations in the car. Among them: the first sound field area is the adjusted sound field area, and the second sound field area is the original sound field area. The number of sub-sound field areas contained in the first sound field area and the second sound field area is the same. The first sound field area mainly includes: the main driver sound field area, the co-driver sound field area, the left rear sound field area, the middle row sound field area and the right rear sound field area, among which: the main driver sound field area and the co-driver sound field area are called the driving area, the left rear sound field area, the middle row sound field area and the right rear sound field area are called the rear row area. For details, please refer to Figures 5-9 The second sound field area mainly includes sound field area 1, sound field area 2, sound field area 3, sound field area 4 and sound field area 5 (see Figure 4 ). For different scenarios, the ranges of the sub-areas of the first sound field area and the second sound field area are different, as follows:

[0076] like Figure 5 The figure shows a schematic diagram of scenario 1 of multiple first sound field areas provided by an embodiment of the present invention. In the case of scenario 1, the occupants in the car only include the driver, and the adjusted sound field area formed by adjusting the boundaries of the second sound field area based on the position information of the occupants in the car is as follows: Figure 5As shown, the range of the main driver's sound field area is: the sound field area 1 extends forward to the windshield and covers the entire center console laterally; it extends backward, for example, it can extend 30-40cm to cover the space behind the driver's headrest; compared with the initial sound field area, the adjusted sound field area is expanded. The range of the co-driver's sound field area is: the range of the sound field area 2 is reduced, for example, the range is reduced to 40% of the original area. The range of the left rear sound field area is: the area formed by the sound field area 3 shrinking backward, for example, it can be reduced by 30-40cm. The range of the middle row sound field area is: the area formed by the sound field area 4 shrinking backward, for example, it can be reduced by 30-40cm. The range of the right rear sound field area is: the area corresponding to the original sound field area 5.

[0077] like Figure 6 The diagram shows a second scenario of multiple first sound field areas provided by an embodiment of the present invention. In the case of the second scenario, the occupants of the vehicle mainly include the driver and the passenger, and the adjusted sound field area formed by adjusting the boundaries of the original sound field area based on the position information of the occupants is shown in FIG. Figure 6 As shown, the driver's seat sound field area is defined as the area formed by the rearward extension of sound field area 1, which can extend by, for example, 30-40 cm. The passenger seat sound field area is defined as the area formed by the rearward extension of sound field area 2, which can extend by, for example, 30-40 cm. The left rear, middle row, and right rear sound fields are defined as the areas formed by the rearward reduction of sound field areas 3, 4, and 5, respectively. These areas can be reduced by, for example, 30-40 cm.

[0078] like Figure 7 The diagram shows a schematic diagram of scene 2 of multiple first sound field areas provided by an embodiment of the present invention. In the case of scene 3, the occupants in the car mainly include one person in the left rear seat, and the adjusted sound field area formed by adjusting the boundaries of the original sound field area based on the position information of the occupants in the car is shown as follows: Figure 7 As shown. Among them: the range of the main driver's sound field area and the co-driver's sound field area are respectively: the areas formed by sound field area 1 and sound field area 2. The range of the left rear sound field area is: covering a single seat extending 50cm, that is, the area formed by expanding the range of sound field area 3 in the initial sound field area, for example, it can be extended 50cm to the right. The range of the middle row sound field area is: the range formed by reducing the left side of sound field area 4, for example, it can be reduced by 50cm. The range of the right rear sound field area is: sound field area 5 in the original sound field area.

[0079] like Figure 8 The diagram shows a schematic diagram of scenario 2 of multiple first sound field areas provided by an embodiment of the present invention. In the case of scenario 4, the occupants in the car mainly include the driver and one person in the left rear seat, a total of two people. Accordingly, the adjusted sound field area formed by adjusting the boundaries of the original sound field area based on the position information of the occupants in the car is as follows: Figure 8As shown. Among them: the range of the main driver's sound field area is: the area extended forward to the windshield and laterally covered by the entire center console. The range of the co-pilot area is: the area formed by the reduction of the left side of the sound field area 2, for example, it can be reduced by 30cm. The range of the left rear sound field area is: the range formed by covering a single seat and extending to the right, for example, it can be extended by 50cm, that is, the range of the sound field area 3 in the original sound field area is expanded; the range of the middle row sound field area is: the left side of the sound field area 4 is reduced, for example, it can be reduced by 50cm. The range of the right rear sound field area is the range corresponding to the sound field area 5.

[0080] like Figure 9 The diagram shows a schematic diagram of scenario 2 of multiple first sound field areas provided by an embodiment of the present invention. In the case of scenario 5, the occupants in the car mainly include the driver, one person in the back row on the left, and one person in the back row on the right, a total of three people. The adjusted sound field area formed by adjusting the boundaries of the original sound field area based on the position information of the occupants in the car is shown as follows: Figure 9 As shown. The driver's seat sound field extends forward to the windshield and laterally covers the entire center console. The passenger seat sound field extends to the left of sound field area 2, which can be reduced by 30cm, for example. The left rear sound field extends to the right of sound field area 3. The center row sound field extends to the left and right of sound field area 4. The right rear sound field extends to the left of sound field area 5.

[0081] As an optional implementation, the above step 301 specifically includes the following contents: generating a occupant matrix distribution based on the position information of the occupants in the vehicle; and forming a plurality of first sound field areas based on the occupant matrix distribution.

[0082] As an optional implementation, the method further includes: 300a, obtaining position information of people in the vehicle.

[0083] For example, the method of obtaining the position information of the person in the vehicle in the above step 300a can be by receiving information sent by other devices or controllers, or can be obtained based on detection by the vehicle's own sensors.

[0084] Preferably, in order to improve the accuracy of the acquired personnel location information, the above-mentioned step 300a specifically includes the following contents: detecting the personnel location information in the vehicle based on a combination of multiple sensors.

[0085] Exemplarily, the above-mentioned multi-sensor combination includes at least one of the following: an infrared sensor, a pressure sensor, and a camera.

[0086] Specifically, multiple sensors installed in the vehicle can be used to monitor the location and number of passengers in real time. Infrared sensors detect occupants by sensing infrared light emitted by the human body. Pressure sensors, installed beneath seat cushions, determine if a passenger is in the seat when the pressure exceeds a preset threshold. The camera image recognition module uses a deep learning algorithm to analyze captured in-vehicle images to identify the specific location coordinates and posture information of the person. These multiple sensors work together to improve the accuracy and reliability of occupant detection.

[0087] As an optional implementation, before the above step 302, the method further includes the following: 302a, determining the sound field parameter configuration of each area based on the behavior pattern and / or preference setting of the occupants of the vehicle.

[0088] Exemplarily, the above step 302a specifically includes the following contents: 302a1, determining the sound field type of each area based on the behavior pattern and / or preference setting of the occupants of the vehicle; 302a2, determining the sound field parameter configuration of each area according to the sound field type of each area.

[0089] For example, the above-mentioned behavior patterns of the occupants of the vehicle include but are not limited to: head direction movements, touch screen operation movements, and voice commands.

[0090] Optionally, the sound field types of the above-mentioned regions may be determined only based on the behavior of the occupants of the vehicle, or only based on the user's preference settings, or based on both the behavior patterns and preference settings of the occupants of the vehicle.

[0091] For example, the system dynamically configures the sound field parameters for each acoustic zone based on the behavior and sound preferences of passengers within that zone. If the system determines that the front-seat driver is navigating, it automatically improves the clarity of the voice band output in that zone, enhancing functional driving-related sound effects while appropriately reducing the volume of background sounds such as music to ensure the driver can clearly receive key information. If a rear-seat passenger is detected watching the in-car video entertainment system, the system optimizes surround sound parameters for the rear-seat acoustic zone, adjusting channel delay and volume balance to create an immersive viewing experience and enhancing bass to enhance the atmosphere.

[0092] For example, the sound field types of the aforementioned areas include driving areas, entertainment areas, and unmanned areas. Different sound field parameters are configured accordingly for different sound field types. Tables 1, 2, and 3 below show the sound field parameter configurations for the driving area, entertainment area, and unmanned area, respectively.

[0093] Table 1 Sound field parameter configuration of driving area

[0094]

[0095]

[0096] Table 2 Sound field parameter configuration of entertainment area

[0097] Parameter Type Configuration Effect Surround Sound Width Virtual sound field expanded to 120° Simulated cinema sound field Low frequency enhancement +8dB below 80Hz Enhance low frequency impact Channel Delay Left and right surround delay 15-20ms Increase the sense of spatial surround Crosstalk suppression >20dB Reduce the impact on the driving area

[0098] Table 3 Sound field parameter configuration in uninhabited area

[0099] Parameter Type Configuration Effect Sound Pressure <30dB Below the ambient noise threshold Active noise reduction -3dB at 100-1kHz Opposite sound waves cancel the leakage sound waves of adjacent sound fields Power consumption limit Single sound field area ≤5W Reduce energy consumption

[0100] As an optional implementation, the above step 302 specifically includes the following contents: 302b, controlling the sound system to output audio responses to the multiple first sound field areas according to the sound field parameter configuration of each area.

[0101] Specifically, after determining the sound field parameter configuration of each area, it is necessary to control the audio system in the vehicle to output audio responses to each sound field area to meet the acoustic requirements of each area.

[0102] The following will illustrate the specific implementation process of the above step 302b based on different scenarios in the car. Figure 2 and related text description content.

[0103] based on Figure 5 Schematic diagram of scenario 1 of multiple first sound field areas shown. In scenario 1, the only occupant in the vehicle is the driver. The corresponding change indicators of each speaker in the audio system are as follows: the front left speaker 1011 is set to a full-frequency gain of +3dB compared to the initial state, the front right speaker 1013 is set to a full-frequency attenuation of -6dB compared to the initial state, the center speaker is set to a speech band enhancement of +4dB, the rear speakers 11014 and rear speakers 2 1016 are turned off, and the subwoofer 1015 is set to a low-frequency setting of -4dB compared to the initial state.

[0104] based on Figure 6 Schematic diagram of scenario 2 showing multiple first sound field areas. In this scenario, the vehicle occupants primarily consist of a driver and a front passenger. The corresponding speaker configurations in the audio system are as follows: the front left speaker 1011 is set to a full-frequency gain of +4dB compared to the initial setting; the front right speaker 1013 is set to a sound field width of +30% compared to the initial setting; the center speaker is set to dual-mode time-sharing multiplexing (navigation: voice band enhancement +4dB compared to the initial setting; music: sound field bridging); rear speakers 11014 and 11016 are turned off; and the subwoofer 1015 is set to a low-frequency gain of -4dB compared to the initial setting.

[0105] based on Figure 7Schematic diagram of scenario three of multiple first sound field areas shown. In the case of scenario three, the occupants mainly include one person in the rear left seat, and the corresponding change indicators of each speaker in the audio system are as follows: the front left speaker 1011 and the front right speaker 1013 are turned off, the center speaker is set to full frequency -15dB compared to the initial state, the rear left speaker in the rear speakers 11014 is set to full frequency +4dB compared to the initial state, and the rear left surround speaker is set to high frequency compensation (initial state +4dB when high frequency > 5kHz), the rear right speaker in the rear speakers 21016 is set to reverse sound wave cancellation and the rear right surround speaker is turned off, and the subwoofer 1015 is set to directional coupling mode (low-frequency vibration is transmitted through the seat structure, and the air-transmitted sound pressure is -6dB).

[0106] based on Figure 8 Schematic diagram of scenario 4 of multiple first sound field areas shown. In this scenario, the vehicle occupants mainly include the driver and one person in the left rear seat, a total of two people. The corresponding change indicators of each speaker in the audio system are as follows: the front left speaker 1011 is set to a mid-frequency gain of +4dB compared to the initial state, the front right speaker 1013 is turned off, the center speaker 1012 is set to dual-mode time-sharing multiplexing (navigation: voice band enhancement of +4dB compared to the initial state; music: sound field bridging), the rear left speaker in the rear speakers 11014 is set to a full-frequency gain of +5dB compared to the initial state, and the rear left surround speaker is set to a high frequency gain of +3dB compared to the initial state, the rear right speaker in the rear speakers 21016 is set to emit anti-phase sound waves to assist in noise reduction, and the rear right surround speaker is turned off, and the subwoofer 1015 is set to directional coupling mode (low-frequency vibrations are transmitted through the seat structure, and the air-conducted sound pressure is -6dB).

[0107] based on Figure 9 Schematic diagram of scenario 5 of multiple first sound field areas shown. In this scenario, the vehicle occupants mainly include the driver, a rear left passenger, and a rear right passenger, totaling three people. The corresponding change indicators of each speaker in the audio system are as follows: the front left speaker 1011 is set to a mid-frequency gain of +4dB compared to the initial state, the front right speaker 1013 is turned off, the center speaker 1012 is set to dual-mode time-sharing multiplexing (navigation: voice band enhancement of +4dB compared to the initial state; music: sound field bridging), the rear left speaker in the rear speakers 11014 is set to a full-frequency gain of +5dB compared to the initial state, and the rear left surround speaker is set to a high-frequency gain of +3dB compared to the initial state, the rear right speaker in the rear speakers 21016 is set to a full-frequency gain of +5dB compared to the initial state, and the rear right surround speaker is set to a high-frequency gain of +5dB compared to the initial state, and the subwoofer 1015 is set to directional coupling mode (low-frequency vibrations are transmitted through the seat structure, and the air-transmitted sound pressure is -6dB).

[0108] As an optional implementation, the above method further includes: 303, judging whether the person in the vehicle moves according to the person's position and / or the noise information in the vehicle.

[0109] Exemplarily, based on the above step 303, the above step 301a specifically includes the following contents: 301a1. When it is determined that the person in the car moves, adjust the boundaries of multiple second sound field areas based on the changed person position information to form multiple first sound field areas.

[0110] Optionally, the sound field types of the above-mentioned regions may be determined only based on the behavior of the occupants of the vehicle, or only based on the user's preference settings, or based on both the behavior patterns and preference settings of the occupants of the vehicle.

[0111] For example, while the vehicle is in motion, sensors continuously collect information such as changes in occupant position and ambient noise levels, and re-evaluate the rationality of the current sound field partitioning and parameter settings at regular intervals. If the camera detects occupant movement and the microphone captures changes in ambient noise levels (for example, a rear passenger moves from a side seat to a middle seat), the process of re-dividing the area and adjusting the sound field parameters is triggered, ensuring that the sound field always adapts to the distribution of occupants.

[0112] like Figure 10 FIG. 1 is a flow chart of another audio control method provided by an embodiment of the present invention. The method includes:

[0113] Step 1001: collect data from multiple sensors, including infrared sensors, pressure sensors, and cameras, and transmit the collected data to a central processing unit.

[0114] Step 1002: Perform human presence detection based on sensor data.

[0115] Step 1003: If the presence of a person is detected, step 1004 is executed; otherwise, the process loops and waits, continuously detecting whether a person is present.

[0116] Step 1004: Generate a personnel coordinate matrix.

[0117] Step 1005: Perform acoustic area division and generate a new sound field area with the person's coordinates as the center.

[0118] Step 1006 , analyzing the behavior patterns of people, thereby obtaining the functions of the sound field areas, such as the driving area, the entertainment area, and the no-man's land;

[0119] Step 1007: Dynamically configure the sound field parameters. Different areas require different parameters. For parameter settings, please refer to Table 1, Table 2, and Table 3 above.

[0120] Step 1008: The multi-channel audio system is executed, and according to the sound field parameter configuration of step 1004, the speaker parameters are changed to perform the final sound field output;

[0121] Step 1009: Personnel positioning and environmental noise monitoring, through which it is determined whether sound field optimization (ie, personnel movement) is required.

[0122] Step 1010: If it is determined that sound field optimization is required, execute step 1004; otherwise, execute step 1011 to maintain the current configuration.

[0123] Figure 11 This is a schematic diagram of the structure of an electronic device according to some embodiments of this specification. Figure 11 As shown, the electronic device 1100 includes a processor 1101 with one or more processing cores, a memory 1102 with one or more computer-readable storage media, and a computer program stored in the memory 1102 and executable on the processor. The processor 1101 is electrically connected to the memory 1102.

[0124] The processor 1101 is the control center of the electronic device 1100. It uses various interfaces and lines to connect the various parts of the entire electronic device 1100. By running or loading software programs and / or units stored in the memory 1102 and calling data stored in the memory 1102, it executes various functions of the electronic device 1100 and processes data, thereby monitoring the electronic device 1100 as a whole. The processor 1101 can be a processor CPU (Central Processing Unit), a graphics processor GPU (Graphics Processing Unit), a network processor (NP), etc., and can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of this application.

[0125] In an embodiment of the present application, the processor 1101 in the electronic device 1100 will load the computer program corresponding to the process of one or more applications into the memory 1102 according to the method or steps of the above embodiment, and the processor 1101 will run the application stored in the memory 1102 to execute the audio control method.

[0126] The electronic device according to the embodiment of the present invention can solve the problem of poor acoustic experience caused by the fixed sound field of the existing car audio system and the inability to adapt to the dynamic changes of passengers by executing the above-mentioned audio control method, thereby meeting the diverse and dynamically changing needs of users and improving driving safety.

[0127] Embodiments of the present invention further provide a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer implements the audio control method described above. For example, the computer-readable storage medium may be the aforementioned memory including program instructions. The program instructions may be executed by a processor of an electronic device to implement or execute the various methods, steps, and logic diagrams disclosed in the embodiments of this application.

[0128] Embodiments of the present invention further provide a computer program product that stores instructions that, when executed by a computer, cause the computer to implement the audio control method described above. For example, when executed by a computer, the instructions implement or execute the various methods, steps, and logic diagrams disclosed in the embodiments of this application.

[0129] An embodiment of the present invention further provides a vehicle comprising the electronic device described above, or the control system described above, or a ceiling screen and a controller, wherein the controller is configured to execute the audio control method described above. The vehicle may be a gasoline-powered vehicle, a plug-in hybrid vehicle, or a new energy vehicle, and this specification does not specifically limit this.

[0130] According to the vehicle of the embodiment of the present invention, the method of executing the above-mentioned audio control through an electronic device or a control system or a controller can solve the problem that the sound field of the existing automobile audio system is fixed and cannot adapt to the dynamic changes of the passengers, resulting in a poor acoustic experience, thereby meeting the diverse and dynamically changing needs of users and improving driving safety.

[0131] As described above, the above embodiments are only used to illustrate the technical solution of applying the above-mentioned audio control method to a vehicle, and are not intended to limit the same. Although the present application has been described in detail with reference to the above-mentioned embodiments, a person skilled in the art should understand that the control method can also be used for motor vehicles, trains, and ships, etc., and that the essence of the corresponding technical solution does not deviate from the scope of the technical solution of each embodiment of the present application.

[0132] In one embodiment, a vehicle can be configured for a fully or partially autonomous driving mode. For example, while in autonomous driving mode, the vehicle can control itself and, through human interaction, determine the current state of the vehicle and its surroundings, determine the possible behavior of at least one other vehicle in the surroundings, and determine a confidence level corresponding to the likelihood that the other vehicle will perform the possible behavior, and control the vehicle based on this information. While in autonomous driving mode, the vehicle can be configured to operate without human interaction.

[0133] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0134] The embodiments, implementation methods and related technical features of the present application can be combined and replaced with each other without conflict.

[0135] The above are only preferred embodiments of the present application and do not constitute any form of limitation to the present application. Although the descriptions of each embodiment in the embodiments of the present application have different focuses, for parts that are not described in detail in a certain embodiment, please refer to the relevant embodiments of other embodiments. However, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are still within the scope of the technical solution of the present application.

Claims

1. A method for audio control, characterized in that: include: The audio system is controlled to output audio responses to a plurality of first sound field areas, where the plurality of first sound field areas are formed based on position information of people in the vehicle.

2. The method according to claim 1, characterized in that Also includes: Determining a plurality of second sound field regions, each region corresponding to at least one group of sound emitting units; The plurality of second sound field areas are obtained by dividing the vehicle interior space based on seat positions.

3. The method according to claim 2, characterized in that Also includes: A plurality of first sound field areas are determined, where the plurality of first sound field areas are obtained by adjusting the plurality of second sound field areas based on position information of people in the vehicle.

4. The method according to claim 1, wherein Also includes: Get the location information of people in the car.

5. The method according to claim 4, characterized in that The obtaining of the position information of the person in the vehicle includes: Detect the location information of people in the car based on a combination of multiple sensors.

6. The method according to claim 3, characterized in that The determining of the plurality of first sound field regions includes: Generate a personnel matrix distribution based on the position information of the personnel in the vehicle; A plurality of first sound field areas are formed based on the personnel matrix distribution.

7. The method according to claim 1, characterized in that Also includes: The sound field parameter configuration for each area is determined based on the behavior patterns and / or preference settings of the occupants of the vehicle.

8. The method according to claim 7, characterized in that The controlling the sound system to output audio responses to the plurality of first sound field areas comprises: The sound system is controlled to output audio responses to the plurality of first sound field areas according to the sound field parameter configuration of each area.

9. The method according to claim 7, characterized in that The determining of the sound field parameter configuration of each area based on the behavior pattern and / or preference setting of the occupants of the vehicle includes: Determine the sound field type for each area based on the behavior patterns and / or preference settings of the occupants of the vehicle; The sound field parameter configuration of each area is determined according to the sound field type of each area.

10. The method according to claim 3, characterized in that The method further comprises: Determine whether a person in the vehicle is moving based on their location and / or in-vehicle noise information.

11. The method according to claim 10, characterized in that The determining of the plurality of first sound field regions includes: When it is determined that the person in the vehicle moves, the boundaries of the plurality of second sound field areas are adjusted based on the changed position information of the person to form a plurality of first sound field areas.

12. An audio control system, characterized in that: include: An audio system, comprising a plurality of audio sound generating units; The controller is connected to the plurality of sound generating units and is used to control the sound generating units to output audio responses to a plurality of first sound field areas, where the plurality of first sound field areas are formed based on position information of people in the vehicle.

13. The system according to claim 12, wherein: Also includes: The sensor module is connected to the controller, and the controller is also used to detect the position information of people in the vehicle based on the multi-sensor module.

14. The system according to claim 13, wherein: The sensor module includes at least one of the following: an infrared sensor, a pressure sensor, and a camera.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the computer implements the audio control method according to any one of claims 1 to 11.

16. A computer program product, characterized in that The computer program product stores instructions that, when executed by a computer, cause the computer to implement the audio control method according to any one of claims 1 to 11.

17. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the audio control method according to any one of claims 1 to 11.

18. A vehicle, characterized in that: include: The control system according to any one of claims 12 to 14; Or, the electronic device according to claim 17; Alternatively, a sound system and a controller, wherein the controller is configured to execute the audio control method according to any one of claims 1 to 11.

Images