Intelligent cab audio channel management system and method based on external DSP

By placing the DSPCONTROL module as a plug -in on the hardware abstract layer HAL layer, the complexity and versatility of the APP development in the existing technology are solved, and the effect of simplifying audio channel management and reducing communication costs is achieved.

CN119376681APending Publication Date: 2025-01-28YANGZHOU HANGSHENG TECH CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411501260.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-25
Publication Date
2025-01-28

AI Technical Summary

Technical Problem

In the prior art, APPs need to integrate DSPControl modules to control DSPs, which increases the complexity of upper-level APP development, and importing third-party modules will cause APPs to be not universal.

Method used

Put the DSPControl module in the form of a hardware abstract layer HAL layer in the form of a plug -in, allowing the upper app to directly use the API interface in the system without adding any interfaces.

Benefits of technology

It greatly reduces the communication costs between the upper app and the vehicle manufacturer, improves the generality of the APP, and simplifies the audio channel management process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119376681A_ABST
    Figure CN119376681A_ABST
Patent Text Reader

Abstract

The invention discloses an intelligent driving cabin audio channel management system and method based on an external DSP. The intelligent driving cabin audio channel management system comprises an APP application layer, a Framework layer, a hardware abstraction layer, a DSP chip control processing module and a Hardware layer. In the Hardware layer, according to a selected DSP chip, DSP audio channel configuration, volume adjustment and sound effect functions are realized according to a protocol, and then an interface is provided for the hardware abstraction layer for use; designing a DSP chip control processing module in the hardware abstraction layer; the hardware abstraction layer selects different audio channels for playing, and according to music to be played by the APP at present, the hardware abstraction layer uses a configuration channel provided by the Hardware layer to adjust a volume interface to configure a DSP module channel before a sound card is opened, and then the rest process is completed. According to the method, the DSPCcontrol module is placed on the hal layer of the hardware abstraction layer in a plug-in mode, so that an upper-layer APP can directly use an API interface in a system without adding any interface, and the communication cost between the upper-layer APP and a vehicle manufacturer is greatly reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an audio channel management system and method, and in particular to an intelligent cockpit audio channel management system and method based on an external DSP. Background Art

[0002] In the prior art, before the upper-layer APP chooses to play, it needs to inform the DSP through the control processing module (DSPControl module) of the DSP chip which channel needs to be used to play the data; then the APP passes the audio data to the DSP module of the Hardware layer through the Framework and the hardware abstraction layer hal for processing and playback.

[0003] Since there are many APPs in the car computer, each APP that needs to make sound must integrate the DSPControl module to control the DSP. This increases the complexity of upper-level APP development. Some mainstream APP manufacturers are only willing to use the API interface provided by the native system for development. Importing third-party modules will cause the APP to be non-universal. Summary of the invention

[0004] The purpose of the present invention is to overcome the defects of the prior art and provide an intelligent cockpit audio channel management system and method based on an external DSP, and place the DSPControl module in the form of a plug-in in the hardware abstraction layer HAL layer, so that the upper-level APP can directly use the API interface provided in the system without adding any new interface, which greatly reduces the communication cost between the upper-level APP and the vehicle manufacturer.

[0005] The purpose of the present invention is achieved in one aspect as follows: an intelligent cockpit audio channel management system based on an external DSP, comprising an APP application layer, a Framework layer, a hardware abstraction layer, a DSP chip control processing module and a Hardward layer;

[0006] The Framework layer is used to process the audio data transmitted from the APP application layer. It is also the volume adjustment interface to achieve multi-channel audio mixing and priority arbitration between various audio sources.

[0007] The hardware abstraction layer is used to receive data transmitted from the Framework layer and match the appropriate hardware sound card to select output;

[0008] The DSP chip control processing module is placed in the hardware abstraction layer in the form of a plug-in, and the APP application layer directly uses the API interface provided by the system; according to the sound source to be played by the Framework layer, the DSP chip control processing module is used to first configure the internal path of the DSP module, and then the audio data is transmitted to the DSP module for broadcasting;

[0009] The Hardward layer is provided with a DSP module for driving the DSP module to perform broadcasting.

[0010] As a further limitation of the present invention, the APP application layer is connected to the Framework layer; the Framework layer is connected to the hardware abstraction layer.

[0011] As a further limitation of the present invention, a plug-in DSP chip control processing module is provided in the hardware abstraction layer; and the DSP chip control processing module is connected to the Hardward layer.

[0012] As a further limitation of the present invention, the DSP module includes three audio channels: Media, Navi and Phone; the DSP module is used to adjust the audio gain and sound effects in the audio path, and synthesize multiple channels into one mixed output.

[0013] As a further limitation of the present invention, the Media is a path for transmitting multimedia music in the DSP module; the Navi is a path for transmitting navigation audio in the DSP module; and the Phone is a path for transmitting telephone audio in the DSP module.

[0014] As a further limitation of the present invention, the Hardward layer is connected to the amplifier APM.

[0015] Another aspect of the present invention is to achieve the following: a smart cockpit audio channel management method based on an external DSP, comprising the following steps:

[0016] 1) In the Hardware layer, according to the selected DSP chip, the DSP audio channel configuration, volume adjustment and sound effect functions are implemented according to the protocol, and then the interface is provided to the hardware abstraction layer for use;

[0017] 2) Design the DSP chip control processing module in the hardware abstraction layer: configure the DSP path command in the hardware abstraction layer and send instructions to the DSP module through the tinymix control;

[0018] 3) The hardware abstraction layer selects different audio channels for playback: Based on the music that the APP is currently playing, the hardware abstraction layer uses the configuration channel provided by the Hardware layer before opening the sound card, adjusts the volume interface, configures the DSP module path, and then completes the remaining processes.

[0019] As a further limitation of the present invention, the step 1) specifically includes: using the SOC_SINGLE_EXT macro definition to configure the interface for implementing DSP audio path configuration, volume adjustment, and sound effects into the system native audio control tinymix;

[0020] 1-1) Register the DSP configuration audio path function in Tinymix;

[0021] 1-2) Register the function of adjusting the volume of multimedia channels in DSP in Tinymix;

[0022] 1-3) Register the volume adjustment function of the navigation channel in DSP to tinymix.

[0023] As a further limitation of the present invention, the step 2) specifically includes: using the mixer_ctl_set_value system general function in tinymix to directly pass the parameters to be set into the Hardware layer through the hardware abstraction layer; other setting commands are added in sequence in this way.

[0024] As a further limitation of the present invention, the step 3) specifically includes: start_output_stream is the main function to open the sound card playback, and the function of using the DSP chip control processing module to control the DSP module part is placed in the audio_extn_ext_hw_plugin_usecase_start function; before the hardware abstraction layer opens each audio source channel to play the sound, the channels in the DSP module are first configured through the audio_extn_ext_hw_plugin_usecase_start function.

[0025] The present invention adopts the above technical scheme, and has the following beneficial effects compared with the prior art: the DSPControl module is not provided to the upper-layer APP or framework control separately, but is placed in the hal layer as a plug-in, so that the upper-layer APP can directly use the API interface provided in the system without adding any new interface. For the DSP part, according to which sound source the upper layer wants to play, the DSPControl module can be used to configure the internal path of the DSP first, and then the audio data is passed to the DSP for broadcasting; the priority processing logic of the sound source can be placed in the Framework layer that provides the interface to the APP, so that according to the priority judgment, the APP without the playback permission is directly prohibited from playing (for example, if you are currently on a call, you will not have the permission to play multimedia music), so that the APP does not need to perform the next step of broadcasting; the entire audio solution is made into a universal system, and the upper-layer APP is developed using the native interface in the system, which greatly reduces the communication cost between the upper-layer APP and the car machine manufacturer; any third-party application, as long as it is developed according to the API provided in the system, can be fully compatible with the car machine; it is convenient to troubleshoot when problems occur. As long as the APP is developed according to the original interface, when problems occur, engineers only need to locate the problem on the car machine side, and do not need to pay attention to the processing flow of each APP, which greatly reduces the time cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 System block diagram of the present invention.

[0027] Figure 2 Block diagram of the DSP module of the present invention. DETAILED DESCRIPTION

[0028] like Figure 1 An intelligent cockpit audio channel management system based on an external DSP is shown, including an APP application layer, a Framework layer, a hardware abstraction layer (hal), a DSP chip control processing module (DSPControl) and a Hardward layer;

[0029] The Framework layer is used to process audio data transmitted from the APP application layer. It is also the volume adjustment interface to achieve multi-channel audio mixing and priority arbitration between various audio sources.

[0030] The hardware abstraction layer is used to receive data transmitted from the Framework layer and match the appropriate hardware sound card to select output;

[0031] The DSP chip control processing module is placed in the hardware abstraction layer in the form of a plug-in, and the APP application layer directly uses the system's built-in API interface; according to the sound source to be played by the Framework layer, the DSP chip control processing module is used to first configure the internal path of the DSP module, and then the audio data is transmitted to the DSP module for broadcasting;

[0032] The Hardward layer is provided with a DSP module for driving the DSP module for broadcasting.

[0033] The APP application layer is connected to the Framework layer; the Framework layer is connected to the hardware abstraction layer; a plug-in DSP chip control processing module is arranged in the hardware abstraction layer; the DSP chip control processing module is connected to the Hardward layer; the Hardward layer is connected to the amplifier APM.

[0034] like Figure 2 As shown, the DSP module includes three audio channels: Media, Navi and Phone; the DSP module is used to adjust the audio gain and sound effects in the audio path, and synthesize multiple channels into one mixed output; Media is used for the path for transmitting multimedia music in the DSP module; Navi is used for the path for transmitting navigation audio in the DSP module; and Phone is used for the path for transmitting telephone audio in the DSP module.

[0035] An intelligent cockpit audio channel management method based on an external DSP comprises the following steps:

[0036] 1) In the Hardware layer, according to the selected DSP chip, the DSP audio channel configuration, volume adjustment and sound effect functions are implemented according to the protocol, and then the interface is provided to the hardware abstraction layer for use;

[0037] Use SOC_SINGLE_EXT macro definition to configure the DSP audio path configuration, volume adjustment, and sound effect interface into the system native audio control tinymix;

[0038] SOC_SINGLE_EXT macro definition:

[0039]

[0040] The following are some DSP control commands:

[0041] Part of the code to configure the DSP path

[0042]

[0043] if(!hsaedsp_dev)

[0044] return -ENOMEM;

[0045] hsaedsp_dev->hsae_para->dsp_mode=ucontrol->value.integer.value[0];

[0046] switch(hsaedsp_dev->hsae_para->dsp_mode){

[0047] case Radio: / / Configure the radio channel in dsp

[0048] ret=hsaedsp_dev->hsaedsp_con_modeIndex(SA_INSRC_RA);

[0049] break;

[0050] Case Media: / / Configure multimedia channels in dsp

[0051] ret=hsaedsp_dev->hsaedsp_con_modeIndex(SA_INSRC_MEDIA);

[0052] break;

[0053] case KTV: / / Configure the special multimedia KTV channel in dsp

[0054] ret=hsaedsp_dev->hsaedsp_con_modeIndex(SA_INSRC_KTV);

[0055] break;

[0056] case Navi: / / Configure the navigation path in dsp

[0057] ret=hsaedsp_dev->hsaedsp_con_modeIndex(SA_INSRC_NAVI);

[0058] }

[0059] Set the volume of the media channel in DSP

[0060] static int meida_volume_put(struct snd_kcontrol*kcontrol,

[0061] struct snd_ctl_elem_value*ucontrol)

[0062] {

[0063] struct snd_soc_component*component=snd_soc_kcontrol_component(kcontrol);

[0064] struct hsaedsp_priv*hsaedsp_dev=snd_soc_component_get_drvdata(component);

[0065] if(!hsaedsp_dev)

[0066] return -ENOMEM;

[0067] mutex_lock(&hsaedsp_dev->hsaedsp_mutex);

[0068] hsaedsp_dev->hsae_para->media_vol=ucontrol->value.integer.value[0];

[0069] / / Adjust the volume of multimedia channel in dsp

[0070] hsaedsp_dev->hsaedsp_meida_vol_Index(hsaedsp_dev->hsae_para->media_vol);

[0071] mutex_unlock(&hsaedsp_dev->hsaedsp_mutex);

[0072] return 0;

[0073] }

[0074] After completing the above steps, you can use the tinymix command to operate the DSP function; all DSP related operations can be added in this way. For example, if you enter tinymix "Saf775c Media Volume" 20, it means that 20 is passed as a parameter to the saf775c_volume_put function, and the DSP is passed to set the volume to 20.

[0075] 2) Design the DSP chip control processing module in the hardware abstraction layer: configure the DSP path command in the hardware abstraction layer and send instructions to the DSP module through the tinymix control;

[0076] Use the mixer_ctl_set_value system general function in tinymix to directly pass the parameters to be set to the Hardware layer through the hardware abstraction layer; other setting commands are added in this way; the Hal layer configures the DSP path command as follows:

[0077]

[0078]

[0079] Hal layer sets multimedia volume command

[0080]

[0081] 3) The hardware abstraction layer selects different audio channels for playback: Based on the music that the APP is currently playing, the hardware abstraction layer uses the configuration channel provided by the Hardware layer before opening the sound card, adjusts the volume interface, configures the DSP module path, and then completes the remaining processes.

[0082] start_output_stream is the main function to open the sound card playback. The function of using DSPControl to control the DSP module can be placed in the function audio_extn_ext_hw_plugin_usecase_start:

[0083]

[0084]

[0085] The present invention provides an intelligent cockpit audio channel management system and method based on an external DSP, and places the DSPControl module in the hardware abstraction layer HAL layer in the form of a plug-in, so that the upper-level APP can directly use the API interface provided in the system without adding any new interface, which greatly reduces the communication cost between the upper-level APP and the vehicle manufacturer.

[0086] The present invention is not limited to the above-mentioned embodiments. On the basis of the technical solution disclosed in the present invention, technicians in this field can make some substitutions and deformations to some technical features therein according to the disclosed technical content without creative labor, and these substitutions and deformations are all within the protection scope of the present invention.

Claims

1. An intelligent cockpit audio channel management system based on an external DSP, characterized in that: Including APP application layer, Framework layer, hardware abstraction layer, DSP chip control processing module and Hardward layer; The Framework layer is used to process the audio data transmitted from the APP application layer. It is also the volume adjustment interface to achieve multi-channel audio mixing and priority arbitration between various audio sources. The hardware abstraction layer is used to receive data transmitted from the Framework layer and match the appropriate hardware sound card to select output; The DSP chip control processing module is placed in the hardware abstraction layer in the form of a plug-in, and the APP application layer directly uses the API interface provided by the system; according to the sound source to be played by the Framework layer, the DSP chip control processing module is used to first configure the internal path of the DSP module, and then the audio data is transmitted to the DSP module for broadcasting; The Hardward layer is provided with a DSP module for driving the DSP module to perform broadcasting.

2. According to claim 1, the intelligent cockpit audio channel management system based on external DSP is characterized in that: The APP application layer is connected to the Framework layer; the Framework layer is connected to the hardware abstraction layer.

3. The intelligent cockpit audio channel management system based on external DSP according to claim 1 is characterized in that: A plug-in DSP chip control processing module is arranged in the hardware abstraction layer; the DSP chip control processing module is connected to the Hardward layer.

4. The intelligent cockpit audio channel management system based on external DSP according to claim 1 is characterized in that: The DSP module includes three audio channels: Media, Navi and Phone; the DSP module is used to adjust the audio gain and sound effects in the audio path, and synthesize multiple channels into one mixed output.

5. The intelligent cockpit audio channel management system based on external DSP according to claim 4 is characterized in that: The Media is a channel for transmitting multimedia music in the DSP module; the Navi is a channel for transmitting navigation audio in the DSP module; and the Phone is a channel for transmitting telephone audio in the DSP module.

6. The intelligent cockpit audio channel management system based on external DSP according to claim 1 is characterized in that: The Hardward layer is connected to the amplifier APM.

7. An intelligent cockpit audio channel management method based on an external DSP, characterized in that: The following steps are involved: 1) In the Hardware layer, according to the selected DSP chip, the DSP audio path configuration, volume adjustment and sound effect functions are implemented according to the protocol, and then the interface is provided to the hardware abstraction layer for use; 2) Design the DSP chip control processing module in the hardware abstraction layer: configure the DSP path command in the hardware abstraction layer and send instructions to the DSP module through the tinymix control; 3) The hardware abstraction layer selects different audio channels for playback: According to the music that the APP is currently going to play, the hardware abstraction layer uses the configuration channel provided by the Hardware layer before turning on the sound card, adjusts the volume interface, configures the DSP module path, and then completes the remaining process.

8. The method for managing intelligent cockpit audio channels based on an external DSP according to claim 7, characterized in that: The step 1) specifically includes: using the SOC_SINGLE_EXT macro definition to configure the interface for implementing DSP audio path configuration, volume adjustment, and sound effects into the system native audio control tinymix; 1-1) Register the DSP configuration audio path function in Tinymix; 1-2) Register the function of adjusting the volume of multimedia channels in DSP in Tinymix; 1-3) Register the volume adjustment function of the navigation channel in DSP to tinymix.

9. The method for managing intelligent cockpit audio channels based on an external DSP according to claim 7, characterized in that: The step 2) specifically includes: using the mixer_ctl_set_value system general function in tinymix to directly pass the parameters to be set into the Hardware layer through the Hardware Abstraction Layer; other setting commands are added in sequence in this way.

10. The method for managing intelligent cockpit audio channels based on an external DSP according to claim 7, characterized in that: The step 3) specifically includes: start_output_stream is the main function to open the sound card playback, and the function of using the DSP chip control processing module to control the DSP module part is placed in the audio_extn_ext_hw_plugin_usecase_start function; before the hardware abstraction layer opens each audio source channel to play the sound, the channels in the DSP module are first configured through the audio_extn_ext_hw_plugin_usecase_start function.