A method for adaptively adjusting in-vehicle audio scene and an audio system
Through multimodal fusion analysis and processing, the sound zone mode of the car audio system is automatically adjusted, which solves the problem of cumbersome switching of the existing midrange mode, improves the user experience effect, and realizes intelligent adaptation of the audio scene.
Patent Information
- Application Number
- CN202210715268.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-22
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-06-22
AI Technical Summary
In existing automotive audio systems, switching of sound zone mode mainly relies on manual settings, and the operation is cumbersome and cannot intelligently adapt to the audio needs of different users in the car.
By obtaining vehicle information and user status information, multimodal fusion analysis processing is adopted to automatically adjust the audio scene to realize adaptive switching of the sound area mode.
It improves the user experience effect, realizes automatic adjustment of audio scenarios, meets the audio needs of different users, and simplifies the operation process.
Smart Images

Figure CN115297403B_ABST
Abstract
Description
Technical Field
[0001] One or more embodiments of the present specification relate to the field of automobile technology, and more particularly to an in-vehicle audio scene adaptive adjustment method and an audio system. Background Art
[0002] With the development of car audio technology, it has become possible to divide a car into multiple independent sound zones. The current multi-sound zones involve two concepts:
[0003] Input multiple sound zones: Each seat has an independent MIC to pick up the voice of the corresponding seat. The vehicle system locates the sound source to pick up the voice input of passengers in different seats.
[0004] Output multiple audio zones: Through the processing of audio post-processing algorithms, passengers in different seats in the car can hear different audio content without interfering with each other, or the interference is so small that the driver and passengers can basically not feel it.
[0005] Because multi-zone audio is still a relatively new technology, zone switching is currently mostly set manually, which is cumbersome to operate and not very smart. Summary of the invention
[0006] In view of this, an object of one or more embodiments of the present specification is to provide an in-vehicle audio scene adaptive adjustment method and an audio system to improve the user experience.
[0007] In a first aspect, a method for adaptively adjusting an in-vehicle audio scene is provided, the method comprising the following steps:
[0008] Obtain vehicle information in the current vehicle and all user status information in the vehicle;
[0009] Performing multimodal fusion analysis and processing according to the vehicle information in the current vehicle and the state information of all users, and obtaining a desired audio scene in the current vehicle;
[0010] Get the current audio scene in the vehicle;
[0011] The expected audio scene and the current audio scene are compared, and when the expected audio scene is different from the current audio scene, a sound zone mode of the audio output system is adjusted to switch to the expected audio scene.
[0012] In the above technical solution, by adopting the current audio scene in the vehicle, the vehicle information in the current vehicle, and the user status information, and determining the desired audio scene through multimodal analysis based on the vehicle information and the user status information, and adjusting the audio scene in the vehicle to the desired audio scene, automatic switching of the audio scene in the vehicle is achieved, thereby improving the user experience.
[0013] In a specific possible implementation scheme, the vehicle information in the current vehicle and the status information of all users in the vehicle are obtained by: obtaining the vehicle information through a camera, a button, a touch screen or a navigation module; obtaining the status information of each user through an independent sensor, a camera, and a MIC for each seat. The vehicle information and user status information are obtained in different ways.
[0014] In a specific implementation scheme, performing multimodal fusion analysis and processing according to the vehicle information in the current vehicle and the state information of all users, and obtaining the desired audio scene in the current vehicle, specifically includes:
[0015] According to the vehicle information in the current vehicle and the status information of each user obtained through the independent sensors, cameras, and MICs of each seat, the audio scene corresponding to each user is determined, and it is determined whether the audio scenes corresponding to all users are the same. If they are the same, the user areas corresponding to the same audio scenes are divided into a unified area; if they are different, the user areas corresponding to any different audio scenes are divided into independent areas.
[0016] In a specific possible implementation method, the audio scene corresponding to each user is determined based on the vehicle information in the current vehicle and the status information of each user obtained through the independent sensor, camera, and MIC of each seat, and it is determined whether the audio scenes corresponding to all users are the same. If they are the same, the user areas corresponding to the same audio scenes are divided into a unified area. If they are different, the user areas corresponding to any different audio scenes are divided into independent areas; specifically:
[0017] When one of the users actively initiates a new playback request through voice, button or touch screen, the desired audio scene obtained through multimodal fusion analysis and processing is to divide the area where the user is located into an independent area and divide other areas into a unified area.
[0018] In a specific embodiment, the method further comprises:
[0019] When the audio scene corresponding to any user is changed, it is first determined whether the changed audio scene is the same as the audio scenes in the area where other users are located; if they are the same, the same audio scenes are merged into one audio scene.
[0020] In a specific feasible implementation method, the method further includes: when the audio scene corresponding to any user is changed, first determining whether the changed audio scene is the same as the audio scene in the area where other users are located; if not, making the audio scene corresponding to the user independent as a separate audio scene.
[0021] In a specific possible implementation manner, the method further includes, when there are multiple audio scenes in the vehicle, adjusting the volume of the audio corresponding to the different audio scenes according to the priority levels of the audio scenes of different users.
[0022] In a specific possible implementation scheme, it also includes detecting the number of users in the vehicle. If the number of users is one, a global mode is adopted.
[0023] In a second aspect, an in-vehicle audio system is provided, the system comprising:
[0024] The vehicle information collection module is used to obtain the vehicle information in the current vehicle;
[0025] A user status information collection module is used to obtain all user status information in the vehicle;
[0026] Audio module, used to obtain the current audio scene in the vehicle;
[0027] A data processing module is used to perform multimodal fusion analysis and processing based on the vehicle information in the current vehicle and the information of all user states, and obtain an expected audio scene in the current vehicle; compare the expected audio scene with the current audio scene, and when the expected audio scene is different from the current audio scene, adjust the sound zone mode of the audio output system to switch to the expected audio scene.
[0028] In the above technical solution, by adopting the current audio scene in the vehicle, the vehicle information in the current vehicle, and the user status information, and determining the desired audio scene through multimodal analysis based on the vehicle information and the user status information, and adjusting the audio scene in the vehicle to the desired audio scene, automatic switching of the audio scene in the vehicle is achieved, thereby improving the user experience.
[0029] In a specific implementation scheme, the vehicle information collection module includes a camera, a button, a touch screen or a navigation module.
[0030] In a specific implementation scheme, the user status information collection module includes independent sensors, cameras, and MICs arranged at each seat.
[0031] In a specific feasible implementation scheme, the data processing module is also specifically used to determine the audio scene corresponding to each user based on the vehicle information in the current vehicle and the status information of each user obtained through independent sensors, cameras, and MICs for each seat, and determine whether the audio scenes corresponding to all users are the same. If they are the same, the user areas corresponding to the same audio scenes are divided into a unified area; if they are different, the user areas corresponding to any different audio scenes are divided into independent areas.
[0032] In a specific feasible implementation scheme, the data processing module is also specifically used to divide the area where the user is located into independent areas and other areas into unified areas when one of the users actively initiates a new playback request through voice, button or touch screen, and obtain the desired audio scene through multimodal fusion analysis and processing.
[0033] In a specific feasible implementation scheme, the data processing module is also specifically used to, when the audio scene corresponding to any user is changed, first determine whether the changed audio scene is the same as the audio scene in the area where other users are located; if not, the audio scene corresponding to the user is independent as a separate audio scene.
[0034] According to a third aspect, a car is provided, comprising a car body and any one of the above-mentioned audio systems arranged in the car body.
[0035] In the above technical solution, by adopting the current audio scene in the vehicle, the vehicle information in the current vehicle, and the user status information, and determining the desired audio scene through multimodal analysis based on the vehicle information and the user status information, and adjusting the audio scene in the vehicle to the desired audio scene, automatic switching of the audio scene in the vehicle is achieved, thereby improving the user experience.
[0036] In a fourth aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for executing the second aspect and any possible design in the second aspect is implemented.
[0037] In a fifth aspect, a non-transitory computer-readable storage medium is provided, wherein the non-transitory computer-readable storage medium stores computer instructions, wherein the computer instructions are used to cause the computer to execute the method of the second aspect and any possible design of the second aspect.
[0038] In a sixth aspect, a computer program product is also provided, comprising instructions, which, when executed on a computer, enables the computer to execute the method in the second aspect of the present application and any possible design in the second aspect.
[0039] In addition, the technical effects brought about by any possible design method in the fourth to sixth aspects can be referred to the effects brought about by different design methods in the method part, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate one or more embodiments of the present specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only one or more embodiments of the present specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0041] Figure 1 A schematic diagram of application hardware of the in-vehicle audio scene adaptive adjustment method provided in an embodiment of the present application;
[0042] Figure 2 A flowchart of adaptive adjustment of in-car audio scenes provided in an embodiment of the present application;
[0043] Figure 3 A structural block diagram of the in-car audio scene adaptive adjustment system provided in an embodiment of the present application
[0044] Figure 4 A flowchart of an audio system provided in an embodiment of the present application. DETAILED DESCRIPTION
[0045] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.
[0046] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of this specification should be understood by people with ordinary skills in the field to which this disclosure belongs. The "first", "second" and similar words used in one or more embodiments of this specification do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0047] The technical carriers of communication described in the embodiments of this specification may include, for example, near field communication (NFC), WIFI, 3G, 4G, 5G, Bluetooth, infrared, multimedia message service (MMS), etc.
[0048] To facilitate understanding of the in-vehicle audio scene adaptive adjustment method provided by the embodiment of the present application, its application scenario is first introduced. The above adjustment method is applied in a vehicle to adjust the audio scene of the vehicle. The occupants (users) in the vehicle have different usage requirements for audio. In order to meet the needs of different users as much as possible, independent sound zone technology has been proposed. However, the current switching of sound zone modes is generally done manually, which is not very intelligent and cannot meet the ever-changing usage requirements of the scene. For this reason, the embodiment of the present application provides a method for self-adjusting the audio scene in the vehicle, which is described in detail below in conjunction with specific drawings and embodiments.
[0049] In the embodiment of the present application, the audio scenes involved include global mode and independent sound zone mode. Global mode: the entire car is a sound zone, which is the usual mode of ordinary cockpits; independent sound zone mode: there will be multiple sound zone combination modes, for example: each seat is its own independent sound zone, or several seats may be combined into a joint sound zone.
[0050] The in-car audio scene self-adjustment method provided in the embodiment of the present application mainly collects the changes of the in-car audio scene in real time, and then adaptively adjusts the audio zone mode to meet the different needs of the passengers. It is described in detail below.
[0051] To facilitate understanding of the in-vehicle privacy adaptive adjustment method provided by the embodiment of the present application, the corresponding hardware structure is first described. The hardware structure based on which the adjustment method is based is as follows: Figure 1 As shown in , the corresponding hardware modules include an acquisition module 10, a data processing module 20 and an audio module 30. Among them, the acquisition module 10 is used to collect vehicle information and user status information, and serve as the original data in the method of the present application. The acquisition module 10 can be a navigation module, MIC, button, sensor and other components in the vehicle that can obtain different information. The data processing module 20 is used to process the data collected by the acquisition module 10, and through multimodal fusion analysis, the data is processed to obtain an audio scene that meets the expectations of the application in the vehicle, and control the audio module 30 to adjust. In combination with the above-mentioned hardware structure, the adjustment method provided in the embodiment of the present application is described in detail below.
[0052] refer to Figure 2 , Figure 2The flowchart of the adjustment method provided by the embodiment of the present application is shown. The adjustment method provided by the embodiment of the present application includes the following steps.
[0053] Step 001: Obtain vehicle information in the current vehicle and status information of all users in the vehicle;
[0054] When specifically acquiring the above-mentioned vehicle information and user status information, the above-mentioned different information is acquired through the above-mentioned acquisition module 10. Specifically, the vehicle information can be acquired through a camera, button, touch screen or navigation module; and each user status information can be acquired through independent sensors, cameras, and MICs (microphones) for each seat. When specifically acquiring information, the above-mentioned vehicle information refers to the status information of the audio module 30 in the vehicle. For example, the user's audio-related command operations can be acquired through a camera, button, or touch screen, and the user's voice information can be acquired through a microphone, thereby acquiring the user's corresponding information about the audio.
[0055] Step 002: Perform multimodal fusion analysis and processing based on vehicle information in the current vehicle and all user status information, and obtain the desired audio scene in the current vehicle;
[0056] Specifically, when performing multimodal fusion analysis and processing, the original data is obtained through different acquisition modules 10 such as cameras, buttons, and touch screens. Among them, multimodal fusion refers to multimodal machine learning MultiModal Machine Learning (MMML), which aims to understand and process multimodal information through machine learning. It includes multimodal representation learning Multimodal Representation, modal translation Translation, alignment Alignment, multimodal fusion Multimodal Fusion, collaborative learning Co-learning, etc.
[0057] Multimodal Fusion is also called Multi-source Information Fusion and Multi-sensor Fusion. Multimodal fusion refers to the process of combining information from two or more modalities for prediction. In the prediction process, a single modality usually cannot contain all the effective information required to produce accurate prediction results. The multimodal fusion process combines information from two or more modalities to achieve information supplementation, broaden the coverage of information contained in the input data, improve the accuracy of the prediction results, and improve the robustness of the prediction model.
[0058] Through the above multimodal fusion analysis, the expected audio scene for the current state can be obtained.
[0059] Step 003: Acquire the current audio scene in the vehicle;
[0060] Specifically, the current audio scene in the vehicle can be obtained through the play mode of the audio module 30. Specifically, the audio scene is a global mode, or an independent partition mode or other different modes.
[0061] Step 004: Compare the expected audio scene with the current audio scene. When the expected audio scene is different from the current audio scene, adjust the audio zone mode of the audio output system to switch to the expected audio scene.
[0062] Specifically, it should be understood that when switching audio scenes, the number of users in the vehicle must be considered first. Therefore, when switching audio scenes, the number of users in the vehicle is first detected. If the number of users is one, the global mode is used. That is, if the number of users is one, the global mode is used regardless of any vehicle information and user status information collected. If the number of users is multiple, the desired audio scene is adjusted as needed.
[0063] When switching the audio scene, the audio scene corresponding to each user can be determined through the vehicle information in the current vehicle and the status information of each user obtained through the independent sensors, cameras, and MICs of each seat. The determined audio scene corresponding to each user is the desired audio scene.
[0064] In addition, after determining the desired audio scene, it is necessary to determine whether the audio scenes corresponding to all users are the same. And according to the determined structure, select different switching methods. Exemplarily, if they are the same, the user areas corresponding to the same audio scene are divided into a unified area; if they are different, the user areas corresponding to any different audio scenes are divided into independent areas. That is, when dividing the audio scene, the user status of different users is divided, so as to determine which audio scene to use according to the user's current situation.
[0065] Specifically, when one of the users actively initiates a new playback request through voice, button or touch screen, the desired audio scene obtained through multimodal fusion analysis and processing is to divide the area where the user is located into an independent area, and divide other areas into a unified area. In other words, when a single user has a separate demand, the audio scene corresponding to the user is adjusted so that the user can obtain the matching scene demand. In addition, the scenes of other users are distinguished from that of this user to ensure the scene demands of other users.
[0066] Of course, in addition to the above methods, when the audio scene corresponding to any user is changed, it is first determined whether the changed audio scene is the same as the audio scene in the area where other users are located; if they are the same, the same audio scenes are merged into one audio scene. That is, when the user forms multiple identical audio scenes after switching audio scenes, the multiple audio scenes can be integrated into one audio scene to obtain a better audio experience.
[0067] It can be seen from this that when the audio scene is switched in the present application, when the audio scene corresponding to any user is changed, it is first determined whether the changed audio scene is the same as the audio scene in the area where other users are located; if not, the audio scene corresponding to the user is separated into a separate audio scene.
[0068] In addition, when there are multiple audio scenes in the vehicle, the volume of the audio corresponding to the different audio scenes is adjusted according to the priority of the audio scenes of different users. For example, when the user is navigating, the volume of other music is appropriately lowered to ensure that the navigation information can be clearly transmitted to the driver. Or when answering a call, the volume of the audio of other users is lowered to ensure the clarity of the user when making and receiving calls.
[0069] When specifically adjusting the audio state, it can be seen from the above method provided in the embodiment of the present application that the adjustment method provided in the embodiment of the present application can follow the following strategy for audio processing:
[0070] 1) Generally speaking, the audio effect of the global mode is much better than that of the independent sound zone mode. In order to obtain better audio effects, the default sound zone mode in the vehicle is the global mode, that is, the car is in the global mode when the car is just started.
[0071] 2) Once a passenger initiates a new playback request different from the current audio zone (combination) by voice, key, touch, etc. (for example, answering a call in global mode), the passenger is converted into a audio zone and the passenger's playback request (for example, making a call) is played; the rest are one audio zone and the previous playback continues. When the new playback (call) ends, the following can be done according to the configuration:
[0072] A. Maintain the current pitch mode;
[0073] B. Restore to the previous range (combination) status.
[0074] 3) In independent sound zone mode, it can actively merge with other sound zones (combinations) to form a new larger sound zone combination, for example: the rear left sound zone is added to the rear right sound zone to form a new rear row sound zone, so that the rear row can listen to the same music or watch the same video at the same time.
[0075] 4) For recommended playback (e.g. navigation), the change of audio zones is temporary. Once playback ends, the previous audio zone mode will be restored. For example, the same music is playing in the whole car in global mode, and then a navigation prompt tone comes. When there is only the driver in the car, the music and navigation prompt tone will continue to play in global mode, which is the same as the existing vehicle processing method. When there are multiple people in the car, the driver will be converted into one audio zone to play the navigation tone; the other seats will be converted into one audio zone to continue playing the current music. When the navigation prompt tone ends, the global mode will be restored.
[0076] When a passenger gets off the bus, if there are no other passengers in the sound zone combination where the passenger is located, it will be combined with the adjacent sound zones to form a larger sound zone (combination) until it merges into a global mode.
[0077] It can be seen from the above method that in the adjustment method provided in the embodiment of the present application, by adopting the audio scene in the vehicle currently in the vehicle, the vehicle information in the current vehicle, and the user status information, and determining the desired audio scene through multimodal analysis based on the vehicle information and the user status information, and adjusting the audio scene in the vehicle to the desired audio scene, automatic switching of the audio scene in the vehicle is achieved, thereby improving the user experience.
[0078] refer to Figure 3 The embodiment of the present application also provides an in-vehicle audio system, which includes: a vehicle information acquisition module 11, a user status information acquisition module 12, an audio module 30 and a data processing module 20. Among them, the vehicle information acquisition module 11, the user status information acquisition module 12, and the audio module 30 are used to obtain raw data and provide the raw data to the data processing module 20. The data processing module 20 is used to process the above data and determine the expected audio scene. In order to achieve the effect of improving user experience. They are described below.
[0079] First, the vehicle information collection module 11 is described. The vehicle information collection module 11 is used to obtain vehicle information in the current vehicle. Specifically, the vehicle information collection module 11 includes a camera, a button, a touch screen or a navigation module. When collecting information, if the user's audio instruction operation is obtained through the camera, the button, or the touch screen, the user's corresponding information about the audio can be obtained.
[0080] The user status information acquisition module 12 is used to obtain the status information of all users in the vehicle. The user status information acquisition module 12 includes independent sensors, cameras, and MICs arranged at each seat. The user's voice information can be obtained through the sensor, camera, and MIC, thereby obtaining the user's corresponding information on audio, and providing it to the data processing module 20 for further processing.
[0081] The audio module 30 is used to obtain the current audio scene in the vehicle. The audio module 30 can determine the current audio scene according to the status information of the audio device in the vehicle. For example, taking the speakers in the vehicle as an example, the playback status of different speakers can be used to determine whether the current vehicle is in global mode or independent mode.
[0082] The data processing module 20 is used to perform multimodal fusion analysis and processing based on the vehicle information in the current vehicle and all user status information, and obtain the expected audio scene in the current vehicle; compare the expected audio scene with the current audio scene, and when the expected audio scene is different from the current audio scene, adjust the sound zone mode of the audio output system to switch to the expected audio scene. For details, please refer to the detailed description in step 004. When switching, the switching can be executed by the audio module 30. The data processing module 20 can issue a switching instruction to control the audio module 30 to execute.
[0083] The data processing module 20 is also specifically used to determine the audio scene corresponding to each user based on the vehicle information in the current vehicle and the status information of each user obtained through the independent sensor, camera, and MIC of each seat, and determine whether the audio scenes corresponding to all users are the same. If they are the same, the user areas corresponding to the same audio scenes are divided into a unified area. If they are different, the user areas corresponding to any different audio scenes are divided into independent areas. For details, please refer to the detailed description in step 004.
[0084] The data processing module 20 is also specifically used for dividing the area where the user is located into independent areas and other areas into unified areas when one of the users actively initiates a new play request through voice, button or touch screen, and obtaining the desired audio scene through multimodal fusion analysis and processing. For details, please refer to the detailed description in step 004.
[0085] The data processing module 20 is also specifically used to determine whether the changed audio scene is the same as the audio scene in the area where other users are located when the audio scene corresponding to any user is changed; if not, the audio scene corresponding to the user is separated into a separate audio scene. For details, please refer to the detailed description in step 004.
[0086] It can be seen from the above description that the audio system provided in the embodiment of the present application can adopt the audio scene in the vehicle, the vehicle information in the vehicle, and the user status information, and determine the desired audio scene through multimodal analysis based on the vehicle information and the user status information, and adjust the audio scene in the vehicle to the desired audio scene, thereby realizing automatic switching of the audio scene in the vehicle and improving the user experience.
[0087] An embodiment of the present application further provides a car, comprising a car body and any one of the above-mentioned audio systems arranged in the car body.
[0088] In the above technical solution, by adopting the current audio scene in the vehicle, the vehicle information in the current vehicle, and the user status information, and determining the desired audio scene through multimodal analysis based on the vehicle information and the user status information, and adjusting the audio scene in the vehicle to the desired audio scene, automatic switching of the audio scene in the vehicle is achieved, thereby improving the user experience.
[0089] An embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for executing the second aspect and any possible design in the second aspect is implemented.
[0090] An embodiment of the present application also provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute the second aspect and any possible design method in the second aspect.
[0091] An embodiment of the present application further provides a computer program product, including instructions, which, when executed on a computer, enables the computer to execute the second aspect of the present application and any possible design method in the second aspect.
[0092] It should be noted that the method of one or more embodiments of this specification can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of one or more embodiments of this specification, and the multiple devices will interact with each other to complete the described method.
[0093] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0094] For the convenience of description, the above devices are described in terms of functions divided into various modules. Of course, when implementing one or more embodiments of this specification, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0095] The apparatus of the above-mentioned embodiment is used to implement the corresponding method in the above-mentioned embodiment, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0096] Figure 4 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0097] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0098] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0099] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0100] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0101] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0102] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0103] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0104] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. In line with the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of different aspects of one or more embodiments of the present specification as described above, which are not provided in detail for the sake of simplicity.
[0105] In addition, to simplify the description and discussion, and in order not to obscure one or more embodiments of the present specification, known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, the device may be shown in the form of a block diagram so as to avoid obscuring one or more embodiments of the present specification, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which one or more embodiments of the present specification will be implemented (i.e., these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it is apparent to those skilled in the art that one or more embodiments of the present specification may be implemented without these specific details or with variations in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.
[0106] Although the present disclosure has been described in conjunction with specific embodiments of the present disclosure, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0107] One or more embodiments of this specification are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of this specification should be included in the scope of protection of this disclosure.
Claims
1. A method for adaptively adjusting an in-vehicle audio scene, characterized in that: The following steps are involved: Obtain vehicle information in the current vehicle and all user status information in the vehicle; Performing multimodal fusion analysis and processing according to the vehicle information in the current vehicle and the state information of all users, and obtaining a desired audio scene in the current vehicle; The audio scene corresponding to each user is the desired audio scene; the audio scene corresponding to each user is determined according to the vehicle information in the current vehicle and the status information of each user obtained through the independent sensor, camera, and MIC of each seat, and whether the audio scenes corresponding to all users are the same, if they are the same, the user areas corresponding to the same audio scenes are divided into a unified area, if they are different, the user areas corresponding to any different audio scenes are divided into independent areas; Get the current audio scene in the vehicle; comparing the expected audio scene with the current audio scene, and when the expected audio scene is different from the current audio scene, adjusting a sound zone mode of an audio output system to switch to the expected audio scene; It also includes, when the audio scene corresponding to any user is changed, first determining whether the changed audio scene is the same as the audio scene in the area where other users are located; if they are the same, merging the same audio scenes into one audio scene.
2. The method for adaptively adjusting in-vehicle audio scenes according to claim 1, characterized in that: The acquisition of vehicle information in the current vehicle and all user status information in the vehicle is specifically as follows: Obtain vehicle information through cameras, buttons, touch screens or navigation modules; Each user's status information is obtained through independent sensors, cameras, and MICs at each seat.
3. The method for adaptively adjusting in-vehicle audio scenes according to claim 2, characterized in that: The method further comprises: determining the audio scene corresponding to each user according to the vehicle information in the current vehicle and the status information of each user obtained through the independent sensor, camera, and MIC of each seat, and determining whether the audio scenes corresponding to all users are the same; if they are the same, dividing the user areas corresponding to the same audio scenes into a unified area; if they are different, dividing the user areas corresponding to any different audio scenes into independent areas; specifically: When one of the users actively initiates a new playback request through voice, button or touch screen, the desired audio scene obtained through multimodal fusion analysis and processing is to divide the area where the user is located into an independent area and divide other areas into a unified area.
4. The method for adaptively adjusting in-vehicle audio scene according to claim 3, characterized in that: The method further includes: when the audio scene corresponding to any user is changed, firstly determining whether the changed audio scene is the same as the audio scene in the area where other users are located; if not, separating the audio scene corresponding to the user into a separate audio scene.
5. The method for adaptively adjusting in-vehicle audio scene according to claim 4, characterized in that: The method also includes, when there are multiple audio scenes in the vehicle, adjusting the volume of the audio corresponding to the different audio scenes according to the priority levels of the audio scenes of different users.
6. The method for adaptively adjusting in-vehicle audio scene according to claim 5, characterized in that: It also includes detecting the number of users in the vehicle. If the number of users is one, the global mode is adopted.
7. An in-car audio system, characterized in that: include: The vehicle information collection module is used to obtain the vehicle information in the current vehicle; A user status information collection module is used to obtain all user status information in the vehicle; Audio module, used to obtain the current audio scene in the vehicle; A data processing module, used to perform multimodal fusion analysis and processing according to the vehicle information in the current vehicle and the state information of all users, and obtain a desired audio scene in the current vehicle; The audio scene corresponding to each user is the desired audio scene; the audio scene corresponding to each user is determined according to the vehicle information in the current vehicle and the status information of each user obtained through the independent sensor, camera, and MIC of each seat, and whether the audio scenes corresponding to all users are the same, if they are the same, the user areas corresponding to the same audio scenes are divided into a unified area, if they are different, the user areas corresponding to any different audio scenes are divided into independent areas; Compare the expected audio scene with the current audio scene, and when the expected audio scene is different from the current audio scene, adjust the sound zone mode of the audio output system to switch to the expected audio scene; and also include when the audio scene corresponding to any user is changed, first determine whether the changed audio scene is the same as the audio scene in the area where other users are located; if they are the same, merge the same audio scenes into one audio scene.
8. The in-car audio system according to claim 7, characterized in that: The vehicle information collection module includes a camera, a button, a touch screen or a navigation module.
9. The audio system according to claim 8, characterized in that The user status information acquisition module includes independent sensors, cameras, and MICs arranged at each seat.
10. The audio system according to claim 9, characterized in that The data processing module is also specifically used to divide the area where one of the users is located into independent areas and other areas into unified areas when one of the users actively initiates a new playback request through voice, button or touch screen, and obtain the desired audio scene through multimodal fusion analysis and processing.
11. The audio system according to claim 10, characterized in that The data processing module is also specifically used to, when the audio scene corresponding to any user is changed, first determine whether the changed audio scene is the same as the audio scene in the area where other users are located; if not, then separate the audio scene corresponding to the user into a separate audio scene.
12. A car, characterized in that: It comprises a vehicle body and an audio system as described in any one of claims 7 to 11 arranged in the vehicle body.
13. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the in-vehicle audio scene adaptive adjustment method as described in any one of claims 1 to 6 is implemented.
14. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the in-vehicle audio scene adaptive adjustment method according to any one of claims 1 to 6.
