Vehicle-mounted audio transmission and playing adjustment system and method, electronic equipment and storage medium

Abstract

The invention discloses a vehicle-mounted audio transmission and playing adjustment system and method, electronic equipment and a storage medium, and relates to the field of vehicle-mounted audio control. The CarAudio Service unit is used for acquiring a focus application of a host application and judging a priority; the front-row host computer and the rear-row host computer are used for sending out a focus application, sending audio original data and receiving a focus application result; the RtspClient unit is used for establishing a protocol connection and a stream pushing request with the RtspServer unit, receiving audio compression data of a back-row host application and pushing the audio compression data to the RtspServer unit; the RtspServer unit is used for establishing a protocol connection with the RtspClient unit, receiving a stream pushing request, and sending audio compression data pushed by the RtspClient unit to the Audio Decoder unit; the Audio Decoder unit is used for carrying out audio decoding processing and outputting audio original data; the Audio Track unit is used for receiving and managing audio original data; and the Audio Flinger / Audio Hal unit is used for receiving the original audio data processed by the Audio Track unit. The back-row host and the front-row host work cooperatively to process the audio focus, and both driving safety and entertainment experience are considered.

Description

Technical Field

[0001] The present application relates to the field of in-vehicle audio control, and in particular to an in-vehicle audio transmission and playback adjustment system, an in-vehicle audio transmission and playback adjustment method, an electronic device, and a storage medium. Background Art

[0002] Current electric vehicle entertainment cabin systems typically consist of a single host and amplifier system, catering only to the driver and front passenger. Rear passengers are unable to control the front host to watch videos, play games, or perform other activities. With the advancement of intelligent vehicles, passengers' demands for entertainment and information are increasing, requiring the diverse needs of the driver, front passenger, and rear passengers to be met simultaneously.

[0003] In order to meet the above new demands, the present invention designs a dual-host system consisting of a front host and a rear host. The front host is mainly responsible for processing various driving-related information, such as listening to navigation broadcasts or sounds from the driving assistance system, and the rear host is mainly responsible for allowing rear passengers to watch videos, play games or engage in other entertainment activities on the rear screen, allowing them to enjoy an independent entertainment space.

[0004] Since the design uses a dual-host system, the front and rear hosts are in the same car space and share a power amplifier system. "How to manage and coordinate the sound playback of the front and rear hosts" and "How can the front and rear hosts use a power amplifier system to play sound together" have become pain points in the current car system design. Summary of the Invention

[0005] In light of this, the present invention aims to provide an in-vehicle audio transmission and playback adjustment system, an electronic device, and a storage medium. This invention utilizes a dual-host strategy, enabling the rear-seat host to ensure smooth operation of the rear-seat entertainment system without interfering with the front-seat driving control system, thus avoiding the potential for lag and delay when a single host handles multiple tasks. The audio focus strategy typically prioritizes driving-related audio sources (such as navigation announcements and driver assistance system sounds), ensuring that these critical information is clearly and undisturbedly conveyed to the driver during driving, thereby improving driving safety. Furthermore, the front and rear hosts share a common amplifier system, saving costs and increasing economic benefits.

[0006] The present invention provides the following solutions:

[0007] According to one aspect of the present invention, a vehicle-mounted audio transmission and playback adjustment system is provided, comprising: a CarAudioService unit, a front-seat host application, a rear-seat host application, an RtspClient unit, an RtspServer unit, an AudioDecoder unit, an AudioTrack unit, and an AudioFlinger / AudioHal unit;

[0008] The CarAudioService unit is used to obtain focus requests from front and rear row host applications and determine their priorities;

[0009] The front-row host application is used to issue focus requests, send raw audio data, and receive focus request results;

[0010] The back-end host application is used to issue focus requests, send audio compression data, and receive focus request results;

[0011] The RtspClient unit is used to establish a protocol connection and push stream request with the RtspServer unit, receive the audio compression data applied by the back-end host and push it to the RtspServer unit;

[0012] The RtspServer unit is used to establish a protocol connection with the RtspClient unit and receive streaming requests, and send the audio compressed data pushed by the RtspClient unit to the AudioDecoder unit;

[0013] The AudioDecoder unit is used to decode the received audio compressed data and output the original audio data;

[0014] AudioTrack unit, used to receive and manage raw audio data;

[0015] The AudioFlinger / AudioHal unit is used to receive the original audio data processed by the AudioTrack unit.

[0016] Among them, the RtspClient unit belongs to the rear host;

[0017] The RtspServer unit, AudioDecoder unit, AudioTrack unit, and AudioFlinger / AudioHal unit belong to the front host.

[0018] Further, including:

[0019] Rear host applications include: multimedia applications;

[0020] Front host applications include: navigation applications and driver assistance systems;

[0021] The multimedia application sends a RequestAudioFocus message to the CarAudioService unit via Ethernet to request audio focus;

[0022] Navigation applications and driving assistance systems send the RequestAudioFocus message to the CarAudioService unit to request audio focus.

[0023] Furthermore, it also includes:

[0024] The CarAudioService unit sends the focus request result to the rear host application;

[0025] The back-end host application sends a start or resume audio playback command to the RtspClient unit;

[0026] The RtspClient unit establishes an rtsp protocol connection and a streaming request with the RtspServer unit;

[0027] The host application sends the compressed audio data to the RtspClient unit;

[0028] The RtspClient unit pushes the received audio compression data to the RtspServer unit;

[0029] The RtspServer unit sends the compressed audio data to the AudioDecoder unit, which performs audio decoding processing to generate original audio data;

[0030] The AudioDecoder unit sends the original audio data to the power amplifier system through the AudioTrack unit, AudioFlinger unit, and AudioHal unit.

[0031] Further, including:

[0032] The rear host application sends a ReleaseAudioFocus message to the CarAudioService unit via Ethernet;

[0033] The host application sends a playback stop command to the RtspClient unit;

[0034] The RtspClient unit stops pushing the stream to the RtspServer unit;

[0035] When the rear host application receives temporary loss of audio focus, it stops pushing compressed audio data;

[0036] After the rear host application receives the audio focus, it continues to push the audio compression data.

[0037] Further, including:

[0038] The CarAudioService unit sends the focus request result to the front host application;

[0039] The front host application sends the original audio data to the power amplifier system through the AudioTrack unit and AudioFlinger / AudioHal unit.

[0040] Further, including:

[0041] The front host application sends a ReleaseAudioFocus message to the CarAudioService unit.

[0042] Further, including:

[0043] The CarAudioService unit reduces the volume of the AudioTrack unit channel applied to the rear host;

[0044] The CarAudioService unit opens the AudioTrack channel of the front host application;

[0045] After the front host application is executed, the CarAudioService unit restores the normal volume of the AudioTrack channel of the rear host application.

[0046] According to two aspects of the present invention, a method for adjusting in-vehicle audio transmission and playback is provided, and the method for adjusting in-vehicle audio transmission and playback includes:

[0047] Obtain the usage of front and rear host applications and determine whether the rear host has enabled multimedia applications;

[0048] If yes, the rear host sends a focus request to the front host CarAudioService unit;

[0049] The CarAudioService unit receives the focus request sent by the rear host application and the focus request sent by the front host application;

[0050] Determine whether the priority of the front host application is higher than that of the back host application;

[0051] If,it is higher than, then a message about focus application failure is sent to the,backend host application;

[0052] Determine whether the front host application has no focus request;

[0053] If,yes, then the CarAudioService unit responds according to the focus request,sent by the rear host application;

[0054] Determine whether the back host application has no focus request;

[0055] If,yes, then the CarAudioService unit responds according to the focus request,sent by the front host application;

[0056] Determine whether the CarAudioService unit responds to the focus request of the rear host application and the front host application sends a focus request;

[0057] If yes, then lower the volume of the rear host application and mix it with the front application.

[0058] According to three aspects of the present invention, there is provided an electronic device, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0059] A computer program is stored in the memory. When the computer program is executed by the processor, the processor executes the steps of the vehicle-based audio transmission and playback adjustment method.

[0060] According to four aspects of the present invention, a computer-readable storage medium is provided, which stores a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of a method for adjusting vehicle audio transmission and playback.

[0061] Through the above solution, the following beneficial technical effects are achieved:

[0062] This application uses a method to process audio focus through the collaborative work of the rear host and the front host, and share a set of power amplifier systems. It can ensure that rear passengers can use the rear entertainment screen to watch movies or listen to music independently, and at the same time ensure that the front driver can hear the navigation broadcast or the sound of the driving assistance system, taking into account both driving safety and entertainment experience. When the rear passengers are watching a video at a high volume, if the front driver needs to urgently receive the navigation broadcast or the sound of the driving assistance system, the entire system will automatically lower the volume of the rear entertainment system or pause the sound playback of the rear entertainment system to ensure that the driver can clearly hear important information.

[0063] This application utilizes a dual-host strategy, enabling the rear-seat host to ensure smooth operation of the rear entertainment system without interfering with the front-seat driving control system, thus avoiding the potential for lag and delay when a single host handles multiple tasks. The audio focus strategy prioritizes driving-related audio sources (such as navigation announcements and driver assistance system sounds), ensuring that these critical information is clearly and undisturbed, thereby improving driving safety. Furthermore, the front and rear hosts share a common amplifier system, saving costs and increasing economic benefits.

[0064] In this application, the rear-seat multimedia sound data needs to be transmitted to the front-seat host in real time. The RTSP protocol supports real-time transmission and can achieve low-latency, high-reliability streaming media transmission to meet the real-time requirements of sound data. Multimedia sound data may have multiple media formats and encoding methods. The RTSP protocol supports multiple media formats and encoding methods, and can adapt to different multimedia sound data formats to ensure that the data can be transmitted and played correctly, and achieve low-latency real-time transmission, so that the front-seat host can receive the rear-seat multimedia sound data in time, so that when the passengers in the car operate the rear-seat multimedia devices, the front-seat host can respond quickly and provide a smooth audio playback experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 This is an architectural diagram of an in-vehicle audio transmission and playback adjustment system provided by one or more embodiments of the present invention.

[0066] Figure 2 This is a flow chart of a method for adjusting vehicle audio transmission and playback provided by one or more embodiments of the present invention.

[0067] Figure 3 This is an architecture diagram of an in-vehicle audio transmission and playback adjustment system provided by a specific embodiment of the present invention.

[0068] Figure 4 It is a flowchart of the process of the rear host applying for and releasing audio focus when the dual host system is currently silent, provided by a specific embodiment of the present invention.

[0069] Figure 5 It is a schematic diagram of the process of the front host applying for and releasing audio focus when the dual host system is currently silent, provided by a specific embodiment of the present invention.

[0070] Figure 6 The present invention provides a flow chart of a process in which a rear-row host plays multimedia sound while a front-row host plays navigation sound, according to a specific embodiment of the present invention.

[0071] Figure 7It is a schematic diagram of the processing flow of multimedia audio pressure of the rear host and navigation mixing of the front host provided by a specific embodiment of the present invention.

[0072] Figure 8 The present invention is a flowchart of pausing multimedia playback on rear-row hosts according to a specific embodiment of the present invention.

[0073] Figure 9 It is a flowchart of the back-row host resuming playback provided by a specific embodiment of the present invention.

[0074] Figure 10 A structural block diagram of an electronic device for a method for adjusting in-vehicle audio transmission and playback provided by one or more embodiments of the present invention. DETAILED DESCRIPTION

[0075] The technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0076] Figure 1 This is an architectural diagram of an in-vehicle audio transmission and playback adjustment system provided by one or more embodiments of the present invention.

[0077] like Figure 1 The vehicle-mounted audio transmission and playback adjustment system shown includes:

[0078] CarAudioService unit, front host application, rear host application, RtspClient unit, RtspServer unit, AudioDecoder unit, AudioTrack unit and AudioFlinger / AudioHal unit;

[0079] The CarAudioService unit is used to obtain focus requests from front and rear row host applications and determine their priorities;

[0080] The front-row host application is used to issue focus requests, send raw audio data, and receive focus request results;

[0081] The back-end host application is used to issue focus requests, send audio compression data, and receive focus request results;

[0082] The RtspClient unit is used to establish a protocol connection and push stream request with the RtspServer unit, receive the audio compression data applied by the back-end host and push it to the RtspServer unit;

[0083] The RtspServer unit is used to establish a protocol connection with the RtspClient unit and receive streaming requests, and send the audio compressed data pushed by the RtspClient unit to the AudioDecoder unit;

[0084] The AudioDecoder unit is used to decode the received audio compressed data and output the original audio data;

[0085] AudioTrack unit, used to receive and manage raw audio data;

[0086] The AudioFlinger / AudioHal unit is used to receive the original audio data processed by the AudioTrack unit.

[0087] Among them, the RtspClient unit belongs to the rear host;

[0088] The RtspServer unit, AudioDecoder unit, AudioTrack unit, and AudioFlinger / AudioHal unit belong to the front host.

[0089] Further, including:

[0090] Rear host applications include: multimedia applications;

[0091] Front host applications include: navigation applications and driver assistance systems;

[0092] The multimedia application sends a RequestAudioFocus message to the CarAudioService unit via Ethernet to request audio focus;

[0093] Navigation applications and driving assistance systems send the RequestAudioFocus message to the CarAudioService unit to request audio focus.

[0094] Furthermore, it also includes:

[0095] The CarAudioService unit sends the focus request result to the rear host application;

[0096] The back-end host application sends a start or resume audio playback command to the RtspClient unit;

[0097] The RtspClient unit establishes an rtsp protocol connection and a streaming request with the RtspServer unit;

[0098] The host application sends the compressed audio data to the RtspClient unit;

[0099] The RtspClient unit pushes the received audio compression data to the RtspServer unit;

[0100] The RtspServer unit sends the compressed audio data to the AudioDecoder unit, which performs audio decoding processing to generate original audio data;

[0101] The AudioDecoder unit sends the original audio data to the power amplifier system through the AudioTrack unit, AudioFlinger unit, and AudioHal unit.

[0102] Further, including:

[0103] The rear host application sends a ReleaseAudioFocus message to the CarAudioService unit via Ethernet;

[0104] The host application sends a playback stop command to the RtspClient unit;

[0105] The RtspClient unit stops pushing the stream to the RtspServer unit;

[0106] When the rear host application receives temporary loss of audio focus, it stops pushing compressed audio data;

[0107] After the rear host application receives the audio focus, it continues to push the audio compression data.

[0108] Further, including:

[0109] The CarAudioService unit sends the focus request result to the front host application;

[0110] The front host application sends the original audio data to the power amplifier system through the AudioTrack unit and AudioFlinger / AudioHal unit.

[0111] Further, including:

[0112] The front host application sends a ReleaseAudioFocus message to the CarAudioService unit.

[0113] Further, including:

[0114] The CarAudioService unit reduces the volume of the AudioTrack unit channel applied to the rear host;

[0115] The CarAudioService unit opens the AudioTrack channel of the front host application;

[0116] After the front host application is executed, the CarAudioService unit restores the normal volume of the AudioTrack channel of the rear host application.

[0117] Specifically, the rear host is connected to the front host via Ethernet, and the rear host application transmits focus request signaling to the front host CarAudioService unit via the some / ip protocol.

[0118] After the focus application is successful, the host application in the back row transmits the compressed audio data to the RtspClient unit via the rtsp protocol.

[0119] RtspClient unit: performs rtsp protocol with the front host RtspServer unit, and pushes the audio data stream to RtspServer after successful negotiation;

[0120] The CarAudioService unit arbitrates based on the current focus state (such as whether it is occupied by navigation, call, etc.) and priority rules (such as navigation > call > entertainment);

[0121] Allow: Returns a FocusGranted response and broadcasts the focus change through the SOME / IP event to notify all vehicle components (such as the front display and power amplifier module).

[0122] Reject: Returns a FocusDenied response (with a rejection reason, such as "Current focus is occupied by navigation").

[0123] When the focus application fails, the back-row host will not initiate RTSP streaming transmission to reduce invalid data interaction.

[0124] Through the priority field in SOME / IP signaling, such as setting the navigation focus priority to 100 and the music focus priority to 50, the CarAudioService unit can arbitrate focus conflicts in real time to ensure that key functions (such as emergency voice) occupy audio resources first.

[0125] This solution addresses the technical issue of multiple devices in the vehicle system, such as navigation, calls, and rear-seat entertainment, potentially competing for audio output simultaneously. Traditional fixed-priority or broadcast-based communications are unable to dynamically resolve conflicts. Traditional in-vehicle networks mix control signaling with large data streams, resulting in low bandwidth utilization and high latency, especially when processing audio streams. Key functions prioritize and seize focus in real time, ensuring that audio related to driving safety is not delayed or blocked. For example, while navigation audio is playing, requests for music playback in the rear seats are automatically rejected, preventing driver distraction. After navigation concludes, focus is automatically released, notifying the rear seats to resume playback.

[0126] Through SOME / IP event broadcasting, focus changes are notified to display screens, amplifiers and other components in real time to avoid "inconsistency between visual and auditory states" (such as the screen showing the rear row playing but the speakers still outputting front row audio).

[0127] Among them, SOME / IP's remote procedure call mechanism achieves a one-way delay of less than 10ms for focus request / response, meeting real-time interaction requirements (such as triggering a focus request immediately after a passenger presses the play button).

[0128] When the focus application fails, the RTSP stream is blocked to reduce bandwidth waste caused by invalid transmission (actual measurements show that 20%~30% of Ethernet bandwidth can be saved).

[0129] When users operate the rear-seat entertainment system, focus application and streaming are completed automatically, without the need to manually switch the audio output source, and the interactive fluency is improved by more than 40%.

[0130] It is worth noting that although this system only discloses the CarAudioService unit, the front host application, the rear host application, the rear host RtspClient unit, the front host RtspServer unit, the AudioDecoder unit, the AudioTrack unit and the AudioFlinger / AudioHal unit, it does not mean that this device is limited to the above basic functional modules. On the contrary, what the present invention means is that, based on the above basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with the existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. Just because this embodiment only discloses individual basic functional modules, it cannot be considered that the scope of protection of the claims of the present invention is limited to the above-mentioned basic functional modules.

[0131] Figure 2 This is a flow chart of a method for adjusting vehicle audio transmission and playback provided by one or more embodiments of the present invention.

[0132] like Figure 2A method for adjusting in-vehicle audio transmission and playback is shown, comprising:

[0133] Obtain the usage of front and rear host applications and determine whether the rear host has enabled multimedia applications;

[0134] If yes, the rear host sends a focus request to the front host CarAudioService unit;

[0135] The CarAudioService unit receives the focus request sent by the rear host application and the focus request sent by the front host application;

[0136] Determine whether the priority of the front host application is higher than that of the back host application;

[0137] If,it is higher than, then a message about focus application failure is sent to the,backend host application;

[0138] Determine whether the front host application has no focus request;

[0139] If,yes, then the CarAudioService unit responds according to the focus request,sent by the rear host application;

[0140] Determine whether the back host application has no focus request;

[0141] If,yes, then the CarAudioService unit responds according to the focus request,sent by the front host application;

[0142] Determine whether the CarAudioService unit responds to the focus request of the rear host application and the front host application sends a focus request;

[0143] If yes, then lower the volume of the rear host application and mix it with the front application.

[0144] Specifically, through the above method, the rear and front head units work together to handle audio focus and share a common amplifier system. This ensures that rear passengers can independently use the rear entertainment screen to watch movies or listen to music, while also ensuring that the front driver can hear navigation broadcasts or driver assistance system audio, thus balancing driving safety and entertainment experience. If a rear passenger is watching a video at a high volume and the front driver urgently needs to hear navigation broadcasts or driver assistance system audio, the entire system will automatically lower the volume of the rear entertainment system or pause the audio to ensure that the driver can clearly hear important information.

[0145] Figure 3 This is an architecture diagram of an in-vehicle audio transmission and playback adjustment system provided by a specific embodiment of the present invention.

[0146] like Figure 3In a specific embodiment shown, a vehicle-mounted audio transmission and playback adjustment system is disclosed, and the system operation architecture is as follows: Navigation App / Driving Assistance System: broadcasts navigation sound or driving assistance system sound.

[0147] CarAudioService: manages dual host audio focus and pressure;

[0148] AudioTrack: The channel for playing sound to the amplifier, which has navigation type (Navi / System) and media type (Media);

[0149] RtspServer: performs rtsp protocol negotiation with the rear host module RtspClient. After successful negotiation, it receives the network audio compression data sent by RtspClient.

[0150] AudioDecoder: decodes compressed audio data into PCM data;

[0151] AudioFlinger / AudioHal: Receives PCM data sent by AudioTack and sends it to the hardware amplifier system;

[0152] Multimedia application: Apply for focus from the front row host, and send audio compression data to RtspClient after successful application;

[0153] RtspClient: Communicates with the front-row host RtspServer through the rtsp protocol, and pushes the audio data stream to the RtspServer after successful negotiation;

[0154] Audio compression data is transmitted via RTSP protocol;

[0155] The rear host and the front host are connected via Ethernet;

[0156] Signaling messages are transmitted via the some / ip protocol;

[0157] Audio data is transmitted via rtsp protocol;

[0158] The front host is mainly responsible for navigation broadcast (or driving assistance system sound);

[0159] The rear host is mainly responsible for entertainment music / games and other media broadcasts;

[0160] Navigation announcement (or driving assistance system sound) priority > entertainment music media priority.

[0161] Figure 4 It is a schematic diagram of a multimedia sound processing flow of a rear host playing multimedia sound when a dual host system is currently silent, provided by a specific embodiment of the present invention.

[0162] like Figure 4 The following steps are used to process multimedia sound playback by the rear host in a dual host system when the system is currently silent:

[0163] The rear passenger starts a multimedia application (QQ Music / iQiyi) to play a song or video;

[0164] The multimedia application on the rear host sends a RequestAudioFocus message to the CarAudioService unit of the front host via Ethernet to request audio focus;

[0165] The RequestAudioFocus signal indicates: requesting audio focus;

[0166] When the front host determines that there is no higher priority audio source in the current system, it returns a success result to the background host multimedia application; the multimedia application sends a play command to the RtspClient unit;

[0167] The rear host RtspClient unit initiates an RTSP protocol connection and streaming request to the front host RtspServer unit. After the RTSP protocol connection and streaming request are accepted, the rear host multimedia application sends the compressed audio data to the rear host RtspClient unit. The rear host RtspClient unit then pushes the compressed audio data to the front host RtspServer unit via Ethernet.

[0168] The front host RtspServer unit sends the compressed audio data to the front host AudioDecoder unit; the front host AudioDecoder unit performs audio decoding processing and outputs the original audio data PCM;

[0169] The front host AudioDecoder unit sends the decoded Audio PCM data to the front host AudioTrack unit;

[0170] The front host AudioTrack unit sends the Audio PCM data to the AudioFlinger / AudioHal unit;

[0171] The front host AudioFlinger / AudioHal unit will eventually send the audio PCM data to the power amplifier system;

[0172] When rear passengers stop multimedia applications, end playing songs or videos;

[0173] The rear host multimedia application sends a ReleaseAudioFocus message to the front host CarAudioService unit via Ethernet to release the audio focus;

[0174] When the front host CarAudioService unit receives the ReleaseAudioFocus message, it sets the dual host system to be currently silent;

[0175] Among them, the ReleaseAudioFocus message represents the release of audio focus.

[0176] The rear host multimedia application sends a Stop command to the rear host RtspClient unit;

[0177] The RtspClient unit of the rear host stops pushing the stream to the RtspServer unit.

[0178] Figure 5 It is a schematic diagram of the process of the front host applying for and releasing audio focus when the dual host system is currently silent, provided by a specific embodiment of the present invention.

[0179] like Figure 5 The process flow for the front host to request and release audio focus when the dual host system is currently silent includes the following steps:

[0180] When the front host navigation app / driving assistance system needs to play navigation audio or system audio, it sends a RequestAudioFocus message to the front host CarAudioService unit to request audio focus;

[0181] When the front host determines that the current system sound is playing, it returns a success result to the navigation app / driving assistance system;

[0182] The navigation app / driving assistance system sends sound to the front head unit AudioTrack unit;

[0183] The front host AudioTrack unit sends the Audio PCM data to the AudioFlinger / AudioHal unit;

[0184] The front host AudioFlinger / AudioHal unit will eventually send the audio PCM data to the power amplifier system;

[0185] When the navigation app / driving assistance system audio playback is completed, a ReleaseAudioFocus message is sent to the front host CarAudioService unit to release the audio focus;

[0186] When the front host CarAudioService unit receives the ReleaseAudioFocus message, it sets the dual host system to be currently silent;

[0187] Figure 6 The present invention provides a flow chart of a process in which a rear-row host plays multimedia sound while a front-row host plays navigation sound, according to a specific embodiment of the present invention.

[0188] like Figure 6 When the front host plays the navigation sound, the rear host plays the multimedia sound processing, including the following steps:

[0189] When the front host determines that the current system has a higher priority audio source, it returns a failure result to the background host multimedia application, the audio focus request fails, and the multimedia application fails to play;

[0190] When the front driver needs to receive navigation broadcasts urgently, the front host system will automatically lower the volume of the rear entertainment system or pause playback to ensure that the driver can hear the navigation information clearly.

[0191] Figure 7 It is a schematic diagram of the processing flow of multimedia audio pressure of the rear host and navigation mixing of the front host provided by a specific embodiment of the present invention.

[0192] like Figure 7 The processing flow of multimedia audio pressure of the rear host and navigation audio mixing of the front host shown includes the following steps:

[0193] When the front-seat head unit needs to play navigation audio, the front-seat head unit's CarAudioService unit can lower the volume (mute) of the currently playing multimedia audio channel. The mute media music will be mixed with the navigation audio before playing. This way, the rear-seat multimedia audio volume is low, and the front-seat driver can hear the navigation audio without being affected, ensuring driving safety. The rear-seat multimedia audio can continue to play.

[0194] When the navigation sound (or driving assistance system sound) is finished playing, the CarAudioService unit stops suppressing the audio of the multimedia AudioTrack channel being played and restores the normal volume of the multimedia AudioTrack channel.

[0195] Figure 8 The present invention is a flowchart illustrating a process of pausing multimedia playback on a rear host according to a specific embodiment of the present invention.

[0196] like Figure 8 The process of pausing multimedia playback on the rear host shown includes the following steps:

[0197] When the front host needs to play navigation audio, the front host CarAudioService unit will send an "audio focus temporarily lost (AUDIOFOCUS_LOSS_TRANSIENT)" message to the rear host multimedia application;

[0198] After the rear host multimedia application receives the "audio focus temporarily lost" message, it will send a "pause" message to the rear RtspClient unit;

[0199] The "pause" message represents a pause.

[0200] After receiving the "pause" message, the RtspClient unit will stop pushing the audio data compression stream to the RtspServer unit;

[0201] Figure 9 This is a processing flow for resuming multimedia playback on rear-row hosts provided by a specific embodiment of the present invention.

[0202] like Figure 9 The process flow for resuming multimedia playback of the rear host shown includes the following steps:

[0203] When the front host finishes playing the navigation audio broadcast, the front host CarAudioService unit will send an "Audio Focus Gain (AUDIO_FOCUS_GAIN)" message to the rear host module multimedia application;

[0204] After receiving the "audio focus obtained" message, the rear host multimedia application will send a "resume" message to the RtspClient unit;

[0205] After receiving the "resume" message, the RtspClient unit will continue to push the audio compression data stream to the front host RtspServer unit according to the previous playback progress.

[0206] Among them, the "resume" message represents restarting.

[0207] Figure 9 This is a structural block diagram of an electronic device of a vehicle-mounted audio transmission and playback adjustment system provided by one or more embodiments of the present invention.

[0208] like Figure 9 As shown, the present application provides an electronic device, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0209] A computer program is stored in the memory. When the computer program is executed by the processor, the processor executes the steps of the vehicle audio transmission and playback adjustment method.

[0210] The present application also provides a computer-readable storage medium, which stores a computer program that can be executed by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of the vehicle audio transmission and playback adjustment method.

[0211] For simplicity of description, the method embodiments are described as a series of actions. However, those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because certain steps can be performed in other orders or simultaneously according to the embodiments of the present invention. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0212] Through the description of the above embodiments, it can be seen that those skilled in the art can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present application or certain parts of the embodiments.

[0213] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A vehicle-mounted audio transmission and playback adjustment system, characterized in that: include: CarAudioService unit, front host application, rear host application, RtspClient unit, RtspServer unit, AudioDecoder unit, AudioTrack unit and AudioFlinger / AudioHal unit; The CarAudioService unit is used to obtain focus requests from front and rear row host applications and determine their priorities; The front-row host application is used to issue focus requests, send raw audio data, and receive focus request results; The back-end host application is used to issue focus requests, send audio compression data, and receive focus request results; The RtspClient unit is used to establish a protocol connection and push stream request with the RtspServer unit, receive the audio compression data applied by the back-end host and push it to the RtspServer unit; The RtspServer unit is used to establish a protocol connection with the RtspClient unit and receive streaming requests, and send the audio compressed data pushed by the RtspClient unit to the AudioDecoder unit; The AudioDecoder unit is used to decode the received audio compressed data and output the original audio data; AudioTrack unit, used to receive and manage raw audio data; The AudioFlinger / AudioHal unit is used to receive the original audio data processed by the AudioTrack unit; Among them, the RtspClient unit belongs to the rear host; The RtspServer unit, AudioDecoder unit, AudioTrack unit, and AudioFlinger / AudioHal unit belong to the front host.

2. The vehicle-mounted audio transmission and playback adjustment system according to claim 1, characterized in that: The rear host applications include: multimedia applications; The front host applications include: navigation applications and driving assistance systems; The multimedia application sends a RequestAudioFocus message to the CarAudioService unit via Ethernet to request audio focus; The navigation application and the driving assistance system send a RequestAudioFocus message to the CarAudioService unit to request audio focus.

3. The vehicle-mounted audio transmission and playback adjustment system according to claim 1, characterized in that: The CarAudioService unit sends the focus request result to the rear host application; The back-end host application sends a start or resume audio playback command to the RtspClient unit; The RtspClient unit establishes an rtsp protocol connection and a streaming request with the RtspServer unit; The rear host application sends the audio compression data to the RtspClient unit; The RtspClient unit pushes the received audio compression data to the RtspServer unit; The RtspServer unit sends the compressed audio data to the AudioDecoder unit and performs audio decoding processing to generate original audio data; The AudioDecoder unit sends the original audio data to the power amplifier system via the AudioTrack unit, the AudioFlinger unit and the AudioHal unit.

4. The vehicle-mounted audio transmission and playback adjustment system according to claim 3, characterized in that: The rear host application sends a ReleaseAudioFocus message to the CarAudioService unit via Ethernet; The host application sends a playback stop command to the RtspClient unit; The RtspClient unit stops pushing the stream to the RtspServer unit; When the rear host application receives temporary loss of audio focus, it stops pushing compressed audio data; After the rear host application receives the audio focus, it continues to push the audio compression data.

5. The vehicle-mounted audio transmission and playback adjustment system according to claim 1, characterized in that: The CarAudioService unit sends the focus request result to the front host application; The front host application sends the original audio data to the power amplifier system via the AudioTrack unit and the AudioFlinger / AudioHal unit.

6. The vehicle-mounted audio transmission and playback adjustment system according to claim 5, characterized in that: include: The front host application sends a ReleaseAudioFocus message to the CarAudioService unit.

7. The vehicle-mounted audio transmission and playback adjustment system according to claim 1, characterized in that: include: The CarAudioService unit reduces the volume of the AudioTrack unit channel applied by the rear host; The CarAudioService unit opens the AudioTrack channel of the front host application; After the front host application is executed, the CarAudioService unit restores the normal volume of the AudioTrack channel of the rear host application.

8. A method for adjusting vehicle audio transmission and playback, characterized in that: The following steps are involved: Obtain the usage of front and rear host applications and determine whether the rear host has enabled multimedia applications; If yes, the rear host sends a focus request to the front host CarAudioService unit; The CarAudioService unit receives the focus request sent by the rear host application and the focus request sent by the front host application; Determine whether the priority of the front host application is higher than that of the back host application; If,it is higher than, then a message about focus application failure is sent to the,backend host application; Determine whether the front host application has no focus request; If,yes, then the CarAudioService unit responds according to the focus request,sent by the rear host application; Determine whether the back host application has no focus request; If,yes, then the CarAudioService unit responds according to the focus request,sent by the front host application; Determine whether the CarAudioService unit responds to the focus request of the rear host application and the front host application sends a focus request; If yes, then lower the volume of the rear host application and mix it with the front application.

9. An electronic device, characterized in that: include: A processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; The memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the in-vehicle audio transmission and playback adjustment method according to claim 8.

10. A computer-readable storage medium, characterized in that It stores a computer program that can be executed by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of the in-vehicle audio transmission and playback adjustment method described in claim 8.

Images