Cabin multimedia system, control method thereof and vehicle

Abstract

The invention discloses a cabin multimedia system, a control method thereof and a vehicle. The system comprises a master control host, a slave host and a loudspeaker. The main control host comprises a plurality of audio modules used for processing different audios, and the main control host is connected with the loudspeaker; the slave host is connected with the main control host and shares at least one of the plurality of audio modules in the main control host; the main control host is used for acquiring an audio playing request; performing audio processing on audio stream data of the audio playing request; and according to the processing result, the loudspeaker is controlled to carry out audio playing. Wherein the audio stream data comprises slave audio stream data of the slave host. Therefore, all the slave hosts and the master control host share one loudspeaker, and all the slave hosts share at least one of the plurality of audio processing modules of the master control host, that is, at least one part of the audio processing links of the slave hosts are the same as the master control host, so that the audio processing links of the slave hosts are shortened, and the problem of audio playing delay of the slave hosts is solved.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent cockpits, and particularly to a cockpit multimedia system, a control method thereof, and a vehicle. Background Art

[0002] With the rapid development of vehicle intelligent cockpits, the intelligent cockpit audio playback system has evolved from simple radios and CD players to highly integrated and multi-functional digital human-machine interface platforms (Digital HMI Unit, abbreviated as DHU). In addition, with the increasing demand for in-vehicle entertainment from users, the configuration of multiple DHUs in the vehicle has become more and more common.

[0003] In the configuration of multiple DHUs, for example, in a scenario including two DHUs, namely a front-row DHU and a rear-row DHU, in order to avoid multiple speakers playing audio simultaneously and interfering with each other, and in order to reduce costs and save resources, usually a single speaker is commonly configured for different DHUs, and there is only one audio playback channel resource. When the rear-row DHU needs to play audio, it needs to first process the audio stream by itself, and then the front-row DHU processes the audio stream again before it can be played through the speaker. During this process, the two DHUs perform the same audio processing on the audio stream twice before playing through the speaker. The long audio processing link will cause serious delay problems in audio playback, thus affecting the user experience.

[0004] Therefore, how to solve the problem of audio playback delay in the configuration of multiple DHUs is an urgent problem to be solved by those skilled in the art. Summary of the Invention

[0005] In view of this, one aspect of the present application provides a cockpit multimedia system, the system comprising: a main control host, a slave host, and a speaker;

[0006] The main control host includes a plurality of audio modules for performing different audio processing on audio stream data, and the main control host is connected to the speaker;

[0007] The slave host is connected to the main control host, and the slave host shares at least one of the plurality of audio modules in the main control host;

[0008] The main control host is configured to obtain an audio playback request; perform audio processing on the audio stream data of the audio playback request; and control the speaker to play audio according to the processing result; wherein the audio stream data includes the slave audio stream data of the slave host.

[0009] Optionally, the plurality of audio modules include a main media module and a main audio processing unit including other modules, and the other modules include a plurality of;

[0010] The main media module is communicatively connected to the input end of the main audio processing unit, and the audio stream data includes the main audio stream data of the main media module;

[0011] The slave host is connected to a module in the main audio processing unit, and the output end of the main audio processing unit is connected to the speaker;

[0012] The main audio processing unit is configured to control the speaker to play audio after performing audio processing on the audio stream data.

[0013] Optionally, the main audio processing unit includes: a main audio processing module, a main audio hardware module, and a digital signal processing module;

[0014] The main audio processing module, the main audio hardware module, and the digital signal processing module are communicatively connected in sequence, and the input end of the main audio processing module is communicatively connected to the main media module, and the output end of the digital signal processing module is connected to the speaker;

[0015] The main audio processing module is configured to perform target audio processing on the main audio stream data; the target audio processing includes audio preprocessing and downmixing processing.

[0016] Optionally, the slave host includes a slave media module, a slave audio processing module, and a slave audio hardware module;

[0017] The slave media module, the slave audio processing module, and the slave audio hardware module are communicatively connected in sequence;

[0018] The slave audio processing module is configured to perform the target audio processing on the slave audio stream data.

[0019] Optionally, the connection of the slave host to a module in the main audio processing unit includes:

[0020] The slave audio hardware module is communicatively connected to the main audio processing module and is configured to transmit the slave audio stream data to the main audio processing module;

[0021] The main audio processing module is further configured for audio arbitration; and to generate an arbitration instruction according to the arbitration result; wherein, the audio arbitration includes determining whether the audio stream data is the target audio to be played through the speaker, and determining whether the speaker is currently playing audio.

[0022] Optionally, the main audio hardware module includes a main hardware channel module and a main time-division multiplexing module; the slave audio hardware module includes a slave hardware channel module and a slave time-division multiplexing module;

[0023] The main hardware channel module is communicatively connected to the main time-division multiplexing module; the slave hardware channel module is communicatively connected to the slave time-division multiplexing module.

[0024] Optionally, the slave host is connected to one module in the main audio processing unit, including:

[0025] The slave time-division multiplexing module is connected to the main time-division multiplexing module through an A2B audio bus.

[0026] Optionally, the slave host is connected to one module in the main audio processing unit, including:

[0027] The slave time-division multiplexing module is connected to the digital signal processing module through an audio twisted pair.

[0028] Optionally, the digital signal processing module is further configured for audio arbitration; and generate an arbitration instruction according to the arbitration result; wherein, the audio arbitration includes determining whether the audio stream data is the target audio to be played through the speaker, and determining whether the speaker is currently playing audio.

[0029] Another aspect of the present application provides a control method for a cockpit multimedia system, which is applied to the cockpit multimedia system, the system includes a main control host, a slave host and a speaker, and the method includes:

[0030] Obtain an audio playback request; wherein, the audio stream data includes the slave audio stream data of the slave host;

[0031] Perform audio processing on the audio stream data of the audio playback request.

[0032] Control the speaker to play audio according to the processing result.

[0033] Another aspect of the present application provides a vehicle, including the cockpit multimedia system.

[0034] The beneficial effects of the cockpit multimedia system, its control method and the vehicle provided by the present application are as follows: all slave hosts and the main control host share a speaker, avoiding the problem of multi-source mixed audio playback caused by different hosts using different speakers. On this basis, all slave hosts share at least one of multiple audio processing modules of the main control host, that is, at least a part of the audio processing link of the slave host is the same as that of the main control host. While reducing costs, the audio processing link of the slave host is shortened, solving the problem of audio playback delay caused by the long audio processing link of the slave host, thereby enhancing the user experience of multi-host audio playback in the cockpit multimedia. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 The structural schematic diagram of a cockpit multimedia system provided by an embodiment of the present application;

[0036] Figure 2 The structural schematic diagram of a cockpit multimedia system provided by another embodiment of the present application;

[0037] Figure 3 The schematic diagram of the audio playback principle of a cockpit multimedia system provided by an embodiment of the present application;

[0038] Figure 4 The structural schematic diagram of a cockpit multimedia system provided by still another embodiment of the present application;

[0039] Figure 5 The structural schematic diagram of a cockpit multimedia system provided by yet another embodiment of the present application;

[0040] Figure 6 The schematic diagram of the audio playback principle of a cockpit multimedia system provided by another embodiment of the present application;

[0041] Figure 7 The flowchart of the control method of a cockpit multimedia system provided by an embodiment of the present application.

[0042] The reference numerals are as follows: main control host 1, slave host 2, speaker 3, main media module 10, main audio processing unit 11, main audio processing module 12, main audio hardware module 13, digital signal processing module 14, main hardware channel module 15, main time division multiplexing module 16, slave media module 20, slave audio processing module 21, slave audio hardware module 22, slave hardware channel module 23, slave time division multiplexing module 24. Detailed implementation manners

[0043] The terms used in the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. The singular forms "a", "the" and "said" used in the present application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0044] It should be understood that although the terms first, second, third, etc. may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to a determination".

[0045] Figure 1 The following is a schematic structural diagram of a cockpit multimedia system provided by an embodiment of this application. As Figure 1 shown, the system includes: a main control host 1, a slave host 2, and a speaker 3.

[0046] In a specific embodiment, the main control host 1 includes multiple audio modules, and the multiple audio modules are used to perform different audio processes on the audio stream data. That is, each audio module in the main control host 1 is used to perform different audio processes on the audio stream data so that the speaker 3 can play it.

[0047] As Figure 1 shown, the output end of the main control host 1 is connected to the speaker 3. When the main control host 1 processes the audio stream data, it is played through the speaker 3. In addition, as Figure 1 can be seen, the cockpit multimedia system provided by this application includes multiple hosts. One of the hosts is used as the main control host 1, and the other hosts are used as slave hosts 2. That is, it can also be understood that the cockpit multimedia system includes multiple DUHs. Each host can issue an audio playback request.

[0048] As Figure 1 shown, in a specific embodiment, the slave host 2 is connected to the main control host 1, and the slave host 2 shares at least one of the multiple audio modules in the main control host 1. It can be understood that when the slave host 2 shares the same audio module with the main control host 1, the slave host 2 no longer includes the shared audio module. That is, the shared audio module in the main control host 1 is used as a part of its own audio module.

[0049] In fact, it can also be understood that a part of the total audio processing link of the slave host 2 is completed by the main control host 1, so as to avoid the slave host 2 and the main control host 1 performing the same audio processing link respectively, which may cause the problem of audio playback delay due to the overly long total audio processing link of the slave host 2.

[0050] It should be noted that in a specific embodiment, the slave host 2 can completely share all the audio processing links of the master host 1, or share a part of them. This application does not make any limitations in this regard. However, when sharing a part of the links of the master host 1, the slave host 2 itself includes a part of the audio processing link to ensure the integrity of the entire audio processing link, that is, to ensure that the audio stream data can be normally played after complete audio processing.

[0051] In a specific embodiment, the audio stream data of all hosts will be processed by the master host 1 at least partially and then played by the speaker 3. Therefore, in an optional embodiment, the master host 1 is used to obtain an audio playback request and perform audio processing on the audio stream data of the audio playback request. Further, according to the processing result, the speaker 3 is controlled to perform audio playback, where the audio stream data includes the slave audio stream data of the slave host 2.

[0052] It can be understood that the audio playback request can include both the request obtained by the master host 1 itself and the request obtained by the slave host 2. The corresponding audio stream data includes the main audio stream data of the master host 1 and the slave audio stream data of the slave host 2. In an optional embodiment, the processing of the audio stream data can include but is not limited to audio noise reduction, audio classification, mixing processing, audio arbitration, and format conversion. Among them, audio arbitration includes determining whether there is an audio being played on the current speaker 3. If so, determining whether to switch to a new audio.

[0053] It should be noted that the cockpit multimedia system provided by the embodiments of this application can be applied to vehicles, and the vehicles include but are not limited to sedans, sport utility vehicles (SUVs), multi-purpose vehicles (MPVs), off-road vehicles, pickup trucks, or other power-driven non-railborne vehicles.

[0054] In addition, it should also be noted that in a multi-host configuration scenario, there are usually multiple audio channel resources for in-vehicle speakers, so there will be no delay problem caused by a long audio link. Therefore, in an optional embodiment, the speaker provided by this application can be an out-of-vehicle speaker, and the out-of-vehicle speaker includes but is not limited to a low-speed warning speaker, a lock car prompt speaker, and a multimedia audio playback speaker. This application does not make any limitations on the types of speakers. In addition, in a specific embodiment, the slave host 2 can be one or multiple as shown in Figure 1 This application does not make any limitations on the number of slave hosts 2 either.

[0055] It should be noted that in a specific embodiment, the speaker 3 includes an in-vehicle speaker and an out-vehicle speaker. Since the in-vehicle speaker has multiple audio resource channels, in the specific embodiment, the main control host 1 is further configured to determine the speaker for audio playback, that is, to determine whether to play by the Figure 1 out-vehicle speaker shown. For ease of understanding, the following will be described by taking a slave host 2 as an example.

[0056] For example, in an alternative embodiment, the cockpit multimedia system includes a main control host 1, a slave host 2, and a speaker 3. Among them, the main control host 1 is arranged in the front row of the vehicle, that is, the front row DHU, and the slave host 2 is arranged in the rear row of the vehicle, that is, the rear row DHU. In a specific embodiment, when the slave host 2 has an audio playback requirement, after performing a part of the processing in its own host, it can transmit the audio stream data to the main control host 1, and the part of the shared audio module in the main control host 1 performs subsequent audio processing. After the processing is completed, it is played by the speaker 3.

[0057] It can be understood that in a specific embodiment, there is only one speaker 3. When the main control host 1 is currently playing audio, if the slave host 2 also has a playback requirement at this time, the main control host 1 needs to arbitrate the audio to determine whether to switch the audio playback. Specifically, in an alternative embodiment, if there is currently audio being played, the current audio is paused and switched to the audio corresponding to the new audio request for playback.

[0058] Therefore, in the cockpit multimedia system provided by the embodiments of the present application, all slave hosts 2 and the main control host 1 share a speaker 3, avoiding the problem of multi-source mixed audio playback caused by different hosts using different speakers 3. On this basis, all slave hosts 2 share at least one of the multiple audio processing modules of the main control host 1, that is, at least a part of the audio processing link of the slave host 2 is on the same link as the main control host 1, reducing costs while shortening the audio processing link of the slave host 2 and solving the problem of audio playback delay of the slave host 2 caused by the long audio processing link, thereby improving the user experience of multi-host audio playback in the cockpit multimedia.

[0059] Figure 2 FIG. is a schematic structural diagram of a cockpit multimedia system provided by another embodiment of the present application. The following embodiments will all be described by taking the slave host 2 as an example. In an alternative embodiment, as Figure 2 shown, the multiple audio modules in the main control host 1 include a main media module 10 and a main audio processing unit 11 including other modules, and there are multiple other modules. That is, the multiple audio modules in the main control host 1 are divided into two parts, and these two parts include the main media module 10 and the main audio processing unit 11 composed of other modules.

[0060] As shown Figure 2 in FIG. Figure 2 , the main media module 10 is communicatively connected to the input end of the main audio processing unit 11. In a specific embodiment, the audio playback request includes the main audio playback request when the main media module 10 is triggered. Correspondingly, the audio stream data includes the main audio stream data of the main media module 10.

[0061] In an alternative embodiment, as shown Figure 2 in FIG. Figure 2 , the slave host 2 is connected to a module in the main audio processing unit 11, and the output end of the main audio processing unit 11 is connected to the speaker 3. The main audio processing unit 11 is configured to perform audio processing on the audio stream data and then control the speaker 3 to play audio. It can be understood that in the embodiment of the present application, the slave host 2 and the main audio processing unit 11 share at least one module. Therefore, the slave host 2 is the same as the slave host 2 and both include a media module, that is, the slave host 2 includes a slave media module 20.

[0062] It should be noted that in an alternative embodiment, as shown Figure 2 in FIG. Figure 2 , the slave media module 20 of the slave host 2 can be communicatively connected to the main media module 10 of the master host 1. Thus, the slave host 2 completely shares all the audio processing links in the master host 1, that is, shares the entire audio link from the main media module 10 to the main audio processing unit 11 and then to the speaker 3.

[0063] However, in this embodiment, the slave media module 20 of the slave host 2 is directly communicatively connected to the master host 1 through a connection method such as Ethernet, and directly transmits the slave playback request to the master host 1. At this time, the master host 1 needs to add a media module, that is, the master host 1 includes two media modules. One media module is used to implement the main audio playback request of the master host, and the other media module is used to map the slave media module 20 of the slave host 2. In addition, the main audio processing unit 11 of the master host 1 needs to increase more computing resources to process the audio stream data, that is, it is necessary to increase the computing power of the CPU (Central Processing Unit) and the memory computing power, resulting in an increase in resource costs. It will also cause the processing duration of the audio stream data to become longer, and in the case of insufficient computing power, it will cause the situation of being unable to process or slowly process the audio data stream, and it will be necessary to increase the CPU and memory costs.

[0064] Therefore, in order to overcome the above technical problems, in an alternative embodiment, the slave host 2 is connected to a module of the main audio processing unit 11, that is, at least one module in the co-main audio processing unit 11, and the slave host 2 and the master host 1 respectively include different media modules. It should be noted that the main media module 10 includes but is not limited to system media (i.e., local media), storage medium media (e.g., USB media), Bluetooth media, and APP media.

[0065] In an alternative embodiment, as Figure 2 shown, the main audio processing unit 11 includes: a main audio processing module 12, a main audio hardware module 13, and a digital signal processing module 14. The main audio processing module 12, the main audio hardware module 13, and the digital signal processing module 14 are communicatively connected in sequence, and the input end of the main audio processing module 12 is communicatively connected to the main media module 10, and the output end of the digital signal processing module 14 is connected to the speaker 3.

[0066] In a specific embodiment, the main media module 10 is triggered by the user to generate a main audio playback request, and transmits the main audio stream data corresponding to the main audio playback request to the main audio processing module 12. In an alternative embodiment, the main audio processing module 12 is configured to perform target audio processing on the main audio stream data, where the target audio processing includes audio preprocessing and downmixing processing.

[0067] Among them, audio preprocessing (i.e., Track preprocessing) refers to a series of processing steps performed before the audio stream data is further processed or analyzed. Audio preprocessing may include but is not limited to noise removal, volume adjustment, format conversion, and feature extraction, etc. The purpose is to convert the original audio stream data into a format suitable for analysis and extract key information to reduce the computational complexity of subsequent processing. Specifically, in the PrepareTracks_l function, the main audio processing module 12 (AudioFlinger) will update the Track object in mAudioMixer, and if an Active Track does not exist in the AudioMixer, it will be created.

[0068] In a specific embodiment of the multi-host cockpit multimedia system, the mono output mode of the external speaker 3 cannot support multi-channel audio signals. For example, the master host 1 may output stereo or multi-channel audio, but the external speaker 3 can only process the signal of one channel, resulting in the loss of audio information of other channels.

[0069] Therefore, to solve the above technical problems, in an alternative embodiment, the main audio processing module 12 can perform downsampling and downmixing processing on the audio stream data. That is, in audio mixing (Mix), downmixing processing is performed. When processing, it is necessary to comprehensively consider the balance of multi-track audio, format conversion, and technical implementation. Therefore, in an alternative embodiment, when merging multi-channels (for example, 2.0 stereo or 7.14 Dolby Atmos) into mono or fewer channels, weighted summation is performed on the signals of each channel. For example, when converting stereo to mono, the left and right channels can be multiplied by 0.5 and then added (Mono = 0.5L + 0.5R) to avoid overflow. Thus, channel merging and level adjustment are achieved. In a specific embodiment, during downsampling and downmixing, in the ThreadLoop_mix function, the main audio processing module 12 will mix all audio Tracks into a buffer for subsequent output.

[0070] Thus, exporting multi-tracks to aligned audio files simplifies the mixing process, uses channel strip plugins to uniformly process the EQ (Equalization), compression, and routing of the tracks, and improves audio processing efficiency. In addition, through noise reduction and de-reverberation, background noise is eliminated to highlight the main track, the frequency band conflict is adjusted through EQ, the dynamics of each track are balanced through a compressor, and the volume and panning of the tracks are automatically adjusted using envelope automation to achieve dynamic balance.

[0071] In an alternative embodiment, the main audio hardware module 13 is used to transmit the audio stream data at the software level to a specific hardware device for playback, and the data signal processing module is used to perform analog-to-digital conversion on the audio stream data, that is, convert the digital audio signal into an analog audio signal and transmit the converted analog audio signal to the speaker 3 for playback.

[0072] In an alternative embodiment, when the main media module 10 of the main control host 1 is triggered to start playing multimedia audio (that is, the main audio playback request), the main audio stream data is passed into the main audio processing module 12. The main audio processing module 12 performs target audio processing and audio data classification to determine whether the audio playback request is directed to play through the in-vehicle media channel (that is, the in-vehicle speaker) or the out-of-vehicle media channel (that is, the out-of-vehicle speaker). When it is confirmed as an out-of-vehicle media playback behavior, the main audio stream data is sent to the main audio hardware module 13.

[0073] Further, after the main audio hardware module 13 transmits the main audio stream data to the digital signal processing module 14 for analog-to-digital conversion, it is played through the speaker 3. It should be noted that during the process of implementing the audio playback request, audio arbitration is required, that is, to determine whether other audio is being played in the current speaker 3. If so, the original audio is paused and the new audio is played. Among them, the audio arbitration can be implemented by the main audio processing module 12 of the main control host 1 or by the digital signal processing module 14. This application does not make any limitations in this regard.

[0074] In an alternative embodiment, as Figure 2 shown, the slave host 2 includes a slave media module 20, a slave audio processing module 21, and a slave audio hardware module 22. The slave media module 20, the slave audio processing module 21, and the slave audio hardware module 22 are communicatively connected in sequence.

[0075] It can be understood that the slave media module 20 in the slave host 2 has the same function as the main media module 10 in the main control host 1, and the slave audio processing module 21 has the same function as the main audio processing module 12, that is, the slave audio processing module 21 is used to perform target audio processing on the slave audio stream data, and the target audio processing includes audio preprocessing and downsampling and mixing processing. The slave audio hardware module 22 has the same function as the main audio hardware module 13, that is, it is used to transmit the audio stream data at the software level to the hardware level.

[0076] Based on the above embodiments, in an alternative embodiment, as Figure 2 shown, the slave host 2 is connected to one of the modules in the main audio processing unit 11, including: the slave audio hardware module 22 is communicatively connected to the main audio processing module 12. Therefore, the slave audio hardware module 22 is also used to transmit the slave audio stream data to the main audio processing module 12.

[0077] In an alternative embodiment, the slave audio processing module 21 can be communicatively connected to the main audio processing module 12, so that the slave host 2 shares the main audio processing module 12, the main audio hardware module 13, and the digital signal processing module 14 in the main control host 1. It should be noted that in a specific embodiment, the audio hardware module includes a hardware channel module, and the audio processing module and the audio hardware module cannot be used separately, that is, the audio processing module and the audio hardware module are in a one-to-one binding relationship. That is to say, the hardware channel module in the main audio hardware module 13 must receive the data transmitted by the main audio processing module 12, and the data of the slave audio processing module 21 cannot be directly transmitted to the main audio hardware module 13.

[0078] Therefore, in the embodiment where the slave audio processing module 21 is communicatively connected to the master audio processing module 12, after the slave audio processing module 21 in the slave host 2 performs target audio processing on the slave audio stream data once, the master audio processing module 12 in the master host 1 has to repeat the target audio processing once. This will cause the master audio processing module 12 to increase its CPU resource computing power and memory computing power to meet the processing requirements of the audio stream data. Similarly, in the case of insufficient computing power, situations of being unable to process or slow processing will occur, resulting in an increase in computing power costs and a poor solution effect for the latency problem of the slave host 2.

[0079] Therefore, to avoid the above technical problems, in an alternative embodiment, as Figure 2 shown, the slave audio hardware module 22 is communicatively connected to the master audio processing module 12 via Ethernet. Thus, after the slave audio processing module 21 in the slave host 2 performs target audio processing on the audio stream data, it is transmitted to the slave audio hardware module 22, and then transmitted from the slave audio hardware module 22 to the master audio processing module 12. In a specific embodiment, after the slave audio processing module 21 and the slave audio hardware module 22 process the slave audio stream data, the master audio processing module 12 and the master audio hardware module 13 in the master host 1 do not need to perform repeated audio processing actions and can directly transmit the audio stream data to the lower level. In fact, at this time, the master audio processing module 12 and the master audio hardware module 13 can be understood as an audio transmission channel without audio processing actions.

[0080] In the embodiment of the present application, although the master audio processing module 12 is not used for audio processing, it is used for arbitrating audio; and according to the arbitration result, an arbitration instruction is generated; wherein, audio arbitration includes determining whether the audio stream data is the target audio to be played through the speaker 3, and determining whether the speaker 3 is currently playing audio. For the sake of easy understanding, an example will be given below.

[0081] For example, as Figure 2 shown, the slave host 2 is triggered by the user to start the slave media module 20, and issues a command for playing out-of-vehicle multimedia (i.e., a slave audio playback request). At this time, the slave media module 20 transmits the slave audio stream data to the slave audio processing module 21 for target audio processing. In addition, the slave audio processing module 21 performs data classification. Specifically, it determines whether the current slave audio stream data is the target audio to be played through the speaker, that is, determines whether the slave audio stream data goes through the in-vehicle media channel (played by the in-vehicle speaker) or the out-of-vehicle media channel (out-of-vehicle speaker) for playback. When it is confirmed as an out-of-vehicle media playback behavior (i.e., it is determined that the slave audio stream data is the target audio to be played through the speaker), the slave audio stream data is sent to the slave audio hardware module 22.

[0082] Further, the slave audio hardware module 22 transmits the audio stream data to the master audio processing module 12. Similarly, the master audio processing module 12 needs to determine whether the slave audio stream data is played through the in-vehicle media channel (played by in-vehicle speakers) or the out-of-vehicle media channel (out-of-vehicle speakers). When it is confirmed as an out-of-vehicle media playback behavior (i.e., it is determined that the slave audio stream data is the target audio played through the speakers), the slave audio stream data is sent to the master audio hardware module 13.

[0083] Meanwhile, the audio arbitration also includes determining whether there is any other multimedia sound source playing on the out-of-vehicle speakers. If so, the original audio playback is paused, and a new arbitration instruction is generated, that is, an instruction to play the new command multimedia sound source is generated. Of course, if there is no other media sound source currently playing on the out-of-vehicle speakers, an instruction to play the new command multimedia sound source is normally generated to enable the audio playback of the slave host 2. Further, according to the generated arbitration instruction, the subsequent transmission and playback of the slave audio stream data are performed.

[0084] Figure 3 It is a schematic diagram of the audio playback principle of a cockpit multimedia system provided by an embodiment of the present application. In a specific embodiment where the slave audio hardware module 22 is communicatively connected to the master audio processing module 12, as Figure 3 shown, the main control host 1 is on the left and the slave host 2 is on the right. Both the main control host 1 and the slave host 2 include a media module, an audio processing module, and an audio hardware module. In addition, the main control host 1 further includes a digital signal processing module 14.

[0085] As Figure 3 shown, in a specific embodiment, the slave host 2 initiates an audio playback request from the media module (including the local media SystemMedia, the storage medium media USB Media, the Bluetooth media BT Media, and the APP media APP Media), and performs audio preprocessing, downmixing processing (Mixer), and channel selection (ChannelDeliver) through the audio processing module. Channel selection refers to selecting whether to play through the in-vehicle speakers or the out-of-vehicle speakers. Among them, the in-vehicle speakers follow the right-side Play_Inside and the downward path until reaching the Speaker to achieve in-vehicle speaker playback.

[0086] When the outside vehicle speaker plays, it follows the Play_Outside path and transmits the slave audio stream data to the audio hardware module (including Bus_Outside and Media Sender), and then the audio hardware module transmits it to the audio processing module of the master host 1. Among them, Bus_Outside is the audio transmission channel. In the audio field, "Bus" refers to the channel or path for audio signal transmission. It is used to connect multiple devices or components, transmit analog or digital audio signals, and thus realize functions such as mixing, distribution, and amplification of audio signals. It not only provides a centralized signal transmission channel, enabling multiple input sources to be connected to the same output device simultaneously, but also ensures the efficient and stable transmission of audio signals through functions such as mixing, distribution, and amplification. Media Sender is a module for sending audio stream data objects.

[0087] As Figure 3 shown, after the master host 1 receives the audio stream data transmitted by the audio hardware module of the slave host 2, it undergoes different audio processing in sequence through the audio processing module, audio hardware module, and digital signal processing module 14 of the master host 1, and then is played by the speaker 3. That is, the link through which the slave audio stream data passes is in sequence through Mixer, ChannelDeliver, Play_Outside, Bus_Outside (channel merging processing), TDM Allocator (TDM resource allocator), Channel Allocator (TDM resource selection), Media Playback Outside, TDM OUT, Speaker Outside (played by the outside vehicle speaker 3).

[0088] Among them, TDM Allocator refers to the resource allocator in the Time Division Multiplexing (TDM) technology. In an alternative embodiment, when it is confirmed as an outside vehicle media playback behavior, for the allocation of TDM in the output of the media channel, TDM injection of data is performed. After the injection is completed, the data is sent onto the A2B line for transmission. Determining how many channels of audio to transmit requires selecting the TDM interface according to how many channels of audio to transmit. The TDM interfaces include TDM2 / 4 / 8 / 12 / 16 / 32, and the specific TDM interface can be selected according to actual requirements. Further, configure the specific TDM type, bit depth, and sampling rate in the driver to obtain the exact bit clock data. For example, for TDM16, a sampling rate of 48 kilohertz (kHz) and a bit depth of 32 bit can be used. Thus, the frequency is 16 * 48 kHz * 32 bit = 24.576 MHz, where the frequencies of the transmitter and receiver are kept the same.

[0089] Similarly, asFigure 3 As shown, in the main control host 1, the right-side Play_Inside and the downward path until Speaker Inside are for realizing in-vehicle speaker playback, which will not be elaborated here for the moment.

[0090] Figure 4 This is a schematic structural diagram of a cockpit multimedia system provided by another embodiment of the present application. In an alternative embodiment, as Figure 4 shown, the main audio hardware module 13 includes a main hardware channel module 15 and a main time-division multiplexing module 16; the slave audio hardware module 22 includes a slave hardware channel module 23 and a slave time-division multiplexing module 24.

[0091] In the audio hardware module, the hardware channel module is mainly used to implement the transmission of audio stream data from the software level to the hardware level, while the time-division multiplexing module is used to allocate one or more resource channels to realize the transmission of audio stream data of the audio hardware module, so as to directly output the audio stream data to the A2B (Automotive Audio Bus) audio bus or the Ethernet access bus, and select according to the channel position correspondence table of the bus up and down. Correspondingly, the speaker 3 receives the converted analog audio signal, and transmits the data up and down according to the defined out-of-vehicle speaker 3 channel position correspondence table to the corresponding speaker 3 for sound production.

[0092] In an alternative embodiment, as Figure 4 shown, the slave host 2 is connected to a module in the main audio processing unit 11, including: the slave time-division multiplexing module 24 is connected to the main time-division multiplexing module 16 through the A2B audio bus. It can be understood that in the embodiment of the present application, after the slave time-division multiplexing module 24 of the slave host 2 is connected to the main time-division multiplexing module 16 of the main control host 1, the slave host 2 shares the digital signal processing module 14 of the main control host 1. At this time, the audio arbitration is implemented by the digital signal processing module 14, that is, it is determined by the data signal processing model whether the audio stream data is the target audio to be played through the speaker 3, and whether the speaker 3 is currently playing audio. And according to the arbitration result, an arbitration instruction is generated to realize the audio playback of the speaker 3.

[0093] In the embodiment of the present application, when the slave media module 20 of the slave host 2 initiates a slave audio playback request, the slave audio stream data is sequentially processed by the slave audio processing module 21, the slave audio hardware module 22 and the slave time-division multiplexing module 24, and then transmitted to the main time-division multiplexing module 16 of the main control host 1 through the A2B audio bus, and then transmitted by the main time-division multiplexing module 16 to the digital signal processing module 14 for analog-to-digital conversion and audio arbitration, and then played by the speaker 3.

[0094] Figure 5The structural schematic diagram of a cockpit multimedia system provided by another embodiment of the present application. In an alternative embodiment, as Figure 5 shown, the slave host 2 is connected to a module in the main audio processing unit 11, including: the slave time-division multiplexing module 24 is connected to the digital signal processing module 14 through an audio twisted pair.

[0095] In a specific embodiment, considering that the cost of the A2B audio bus is relatively high, therefore, in order to reduce the cost, the slave time-division multiplexing module 24 and the digital signal processing module 14 of the master host 1 can be connected through a twisted pair. In the embodiment of the present application, similarly, the slave host 2 and the master host 1 share the digital signal processing module 14, and the audio arbitration is also completed by the digital signal processing module 14.

[0096] Figure 6 The schematic diagram of the audio playback principle of a cockpit multimedia system provided by another embodiment of the present application. As Figure 6 shown, in a specific embodiment, when the slave media module 20 of the slave host 2 initiates an audio playback request for the external speaker 3, it sequentially passes through the target audio processing Mixer and channel selection ChannelDeliver of the audio processing module in the slave host 2. Then, it passes through Play_Outside, Bus_Outside (channel merging process), TDM Allocator (TDM resource allocator), Channel Allocator (TDM resource selection), Media Playback Outside and TDM OUT.

[0097] Further, after determining the TDM channel in the time-division multiplexing module of the slave host 2, the audio stream data is transmitted to the digital signal processing module 14 of the master host 1, so that after the digital signal processing module 14 performs analog-to-digital conversion, it is played on the external speaker Speaker Outside. It should be noted that the digital signal processing module 14 and the speaker 3 can be connected through an A2B audio bus or an Ethernet bus, and the present application does not limit this.

[0098] In the above embodiments, the cockpit multimedia system has been described in detail. The present application also provides an embodiment corresponding to a control method for the cockpit multimedia system. This method is applied to the cockpit multimedia system provided in any of the above embodiments, and the system includes a master host, a slave host, and a speaker.

[0099] Figure 7 The flowchart of a control method for a cockpit multimedia system provided by an embodiment of the present application. As Figure 7 shown, this method includes:

[0100] S70: Obtain an audio playback request; wherein, the audio stream data includes the slave audio stream data of the slave host.

[0101] S71: Perform audio processing on the audio stream data of the audio playback request.

[0102] S72: Control the speaker to play audio according to the processing result.

[0103] First of all, it should be noted that the execution subject of the control method provided by the embodiments of the present application is the master host. In a specific embodiment, the master host obtains an audio playback request and performs audio processing on the audio stream data of the audio playback request. Among them, audio processing includes, but is not limited to, audio classification, audio preprocessing, downsampling, audio denoising, audio arbitration, etc. Further, according to the audio processing result, control the speaker to play audio.

[0104] Among them, audio arbitration includes determining the target speaker corresponding to the current audio playback request, that is, determining whether to play the audio through the external speaker. In addition, it also judges whether the current speaker is playing other audio. If so, pause the original audio and switch to play the new audio. If not, directly play the audio of the current request.

[0105] The control method provided by the present application corresponds to the cockpit multimedia system provided by the above embodiments. For the detailed description, reference can be made to the above embodiments and will not be elaborated here.

[0106] Thus, the control method of the cockpit multimedia system provided by the embodiments of the present application avoids problems such as audio mixing errors, audio loss, or playback failure caused by multiple hosts jointly initiating audio requests when multiple hosts share a speaker to play audio, and improves the user's audio playback experience.

[0107] In the above embodiments, the cockpit multimedia system has been described in detail. The present application also provides an embodiment corresponding to a vehicle. In a specific embodiment, the vehicle includes the cockpit multimedia system provided by any of the above embodiments.

[0108] Thus, the vehicle provided by the present application corresponds to the cockpit multimedia system provided by the above embodiments. For the specific description, reference can be made to the above embodiments and will not be elaborated here.

[0109] Note that, although the operations are depicted in the drawings in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or sequentially, or that all illustrated operations be performed to achieve the desired result. In some cases, multitasking and parallel processing may be advantageous. Additionally, the separation of various system modules and components in the above-described embodiments should not be understood as required in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.

Claims

1. A cockpit multimedia system, characterized in that, The system includes: a master host, a slave host, and a speaker; The master host includes a plurality of audio modules for performing different audio processes on audio stream data, and the master host is connected to the speaker; The slave host is connected to the master host, and the slave host shares at least one of the plurality of audio modules in the master host; The master host is configured to obtain an audio playback request; perform audio processing on the audio stream data of the audio playback request; and control the speaker to perform audio playback according to the processing result, wherein the audio stream data includes the slave audio stream data of the slave host.

2. The cockpit multimedia system according to claim 1, wherein, The plurality of audio modules includes a main media module and a main audio processing unit including other modules, and there are a plurality of the other modules; The main media module is communicatively connected to the input end of the main audio processing unit, and the audio stream data includes the main audio stream data of the main media module; The slave host is connected to one of the modules in the main audio processing unit, and the output end of the main audio processing unit is connected to the speaker; The main audio processing unit is configured to control the speaker to perform audio playback after performing audio processing on the audio stream data.

3. The cockpit multimedia system according to claim 2, characterized in that, The main audio processing unit includes: a main audio processing module, a main audio hardware module, and a digital signal processing module; The main audio processing module, the main audio hardware module, and the digital signal processing module are communicatively connected in sequence, and the input end of the main audio processing module is communicatively connected to the main media module, and the output end of the digital signal processing module is connected to the speaker; The main audio processing module is configured to perform target audio processing on the main audio stream data; the target audio processing includes audio preprocessing and downsampling mixing processing.

4. The cockpit multimedia system according to claim 3, characterized in that: The slave host includes a slave media module, a slave audio processing module, and a slave audio hardware module; The slave media module, the slave audio processing module, and the slave audio hardware module are communicatively connected in sequence; The slave audio processing module is configured to perform the target audio processing on the slave audio stream data.

5. The cockpit multimedia system according to claim 4, characterized in that, The connection of the slave host to one of the modules in the main audio processing unit includes: The slave audio hardware module is communicatively connected to the main audio processing module for transmitting the slave audio stream data to the main audio processing module; The main audio processing module is further configured for audio arbitration; and generating an arbitration instruction according to the arbitration result, wherein the audio arbitration includes determining whether the audio stream data is the target audio to be played by the speaker and determining whether the speaker is currently playing audio.

6. The cockpit multimedia system according to claim 4, characterized in that, The main audio hardware module includes a main hardware channel module and a main time-division multiplexing module; the slave audio hardware module includes a slave hardware channel module and a slave time-division multiplexing module; The main hardware channel module is communicatively connected to the main time-division multiplexing module; the slave hardware channel module and the slave time-division multiplexing module are communicatively connected.

7. The cockpit multimedia system according to claim 6, characterized in that, The connection of the slave host to one of the modules in the main audio processing unit includes: The slave time-division multiplexing module is connected to the master time-division multiplexing module through the A2B audio bus.

8. The cockpit multimedia system according to claim 6, characterized in that The slave host is connected to a module in the master audio processing unit, including: The slave time-division multiplexing module is connected to the digital signal processing module through an audio twisted pair.

9. The cockpit multimedia system according to claim 7 or 8, characterized in that, The digital signal processing module is further configured for audio arbitration; and generating an arbitration instruction according to the arbitration result; wherein, the audio arbitration includes determining whether the audio stream data is the target audio to be played through the speaker, and determining whether the speaker is currently playing audio.

10. A control method for a cockpit multimedia system, characterized in that, Applied to the cockpit multimedia system according to any one of claims 1 to 9, the system includes a main control host, a slave host, and a speaker, and the method includes: Obtaining an audio playback request; wherein, the audio stream data includes the slave audio stream data of the slave host. Performing audio processing on the audio stream data of the audio playback request. Controlling the speaker to play audio according to the processing result.

11. A vehicle, characterized in that, Including the cockpit multimedia system according to any one of claims 1 to 9.

Images