Audio playing method and device of audio system, equipment, medium and product

Abstract

The embodiment of the invention provides an audio playing method and device of an audio system, equipment, a medium and a product. The method comprises the following steps: in a main screen virtual machine system, acquiring an audio focus application request of a to-be-played application through a channel control module to generate an audio channel switching instruction, and sending the audio channel switching instruction to a channel switching module, so that the channel switching module switches the audio focus of the to-be-played application based on the audio channel switching instruction of a back-row screen application; and when the back-row screen application is a screen projection application, the audio data of the screen projection application is transmitted to a back-row audio control module in the back-row screen virtual machine system in a cross-domain manner through a cross-domain transmission module by a channel switching module. And the obtained audio data is output to the whole vehicle audio equipment through the back row audio control module. The method is used for providing a media playing function of various system applications for a user, realizing diversified audio playing scenes and enhancing the user experience.

Description

Technical Field

[0001] This application relates to the technical field of vehicle intelligent cockpits, and particularly to an audio playback method, device, equipment, medium and product for an audio system. Background Art

[0002] Currently, multiple screens are set in the intelligent cockpit to meet the various media playback needs of users. For example, when the front-row user in the cockpit plays navigation audio to the whole vehicle through the main screen, the rear-row user plays movie and television audio through the rear screen.

[0003] The existing technology is based on a cockpit with a single system and multiple screens. By configuring an audio policy dynamic routing mechanism for one system, relevant content of multiple applications running on this system is displayed on multiple screens in the cockpit and the corresponding audio is played. However, the existing technology is difficult to provide users with the media playback functions of multiple system applications, and the limitations of the usage scenarios are relatively large. Summary of the Invention

[0004] Embodiments of this application provide an audio playback method, device, equipment, medium and product for an audio system, so as to provide users with the media playback functions of multiple system applications, realize diversified audio playback scenarios, and enhance the user experience.

[0005] In a first aspect, embodiments of this application provide an audio playback method for an audio system. The audio system includes a main screen virtual machine system and a rear screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module, and a cross-domain transmission module. The rear screen virtual machine system includes a rear audio control module. The method includes:

[0006] Obtain a user instruction. When the user instruction indicates playing for the whole vehicle, obtain an audio focus application request of the application to be played through the channel control module, generate an audio channel switching instruction based on the audio focus application request, and send it to the channel switching module;

[0007] When the channel switching module receives an audio channel switching instruction corresponding to an application on the rear screen, switch the whole vehicle audio channel to the media playback channel of the rear screen virtual machine system; output the audio data of the application on the rear screen to the whole vehicle audio device through the rear audio control module; the application on the rear screen includes a projection application of the main screen virtual machine system on the rear screen and a system application of the rear screen virtual machine system;

[0008] Among them, the audio data of the projection application is routed by the channel switching module to the cross-domain transmission module and transmitted across domains to the rear audio control module by the cross-domain transmission module, and the audio data of the system application is obtained based on the rear screen virtual machine system.

[0009] Optionally, before obtaining the audio focus application request of the application to be played, it further includes:

[0010] If the application to be played is the rear - row screen application for vehicle - wide playback, the vehicle - wide playback information of the rear - row screen application is transmitted across domains to the audio arbitration module through the rear - row audio control module;

[0011] Based on the system application, the audio arbitration module generates an audio focus application request corresponding to the system application according to the vehicle - wide playback information and sends it to the channel control module.

[0012] Optionally, after transmitting the vehicle - wide playback information of the rear - row screen application across domains to the audio arbitration module, it further includes:

[0013] Based on the screen mirroring application, the audio arbitration module controls the screen mirroring application to generate a corresponding audio focus application request and send it to the channel control module according to the vehicle - wide playback information;

[0014] The audio arbitration module controls the screen mirroring application to route the corresponding audio data to the channel switching module, so that the channel switching module routes the audio data to the cross - domain transmission module.

[0015] Optionally, after outputting the audio data of the rear - row screen application to the vehicle - wide audio device through the media playback channel, the channel control module obtains the audio focus application request corresponding to the main - screen application, generates an audio channel switching instruction corresponding to the main - screen application and sends it to the channel switching module;

[0016] The channel switching module switches the vehicle - wide audio channel to the media playback channel of the main - screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main - screen application is output to the vehicle - wide audio device through the media playback channel. The audio focus application request corresponding to the main - screen application is sent by the main - screen application to the channel control module.

[0017] Optionally, when the application to be played is a system application, the audio arbitration module determines the connection status of the headphone audio device, and the connection status is monitored in real time by the rear - row audio control module and transmitted across domains to the audio arbitration module;

[0018] When it is determined that the headphone audio device is connected, the audio arbitration module transmits a headphone playback instruction across domains to the rear - row audio control module, so that the rear - row audio control module outputs the audio data of the system application to the headphone audio device through the headphone channel.

[0019] Optionally, the system types of the main - screen virtual machine system and the rear - row screen virtual machine system are different and they run on the same system - level chip.

[0020] Second aspect, an audio playback device of an audio system provided by an embodiment of the present application, the audio system includes a main screen virtual machine system and a rear screen virtual machine system, the main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module, and a cross-domain transmission module, the rear screen virtual machine system includes a rear audio control module, and the device includes:

[0021] An acquisition module, configured to acquire a user instruction. When the user instruction indicates vehicle-wide playback, obtain an audio focus application request of the application to be played through the channel control module, generate an audio channel switching instruction based on the audio focus application request, and send it to the channel switching module;

[0022] A processing module, configured to, when the channel switching module receives an audio channel switching instruction corresponding to a rear screen application, switch the vehicle-wide audio channel to the media playback channel of the rear screen virtual machine system; output the audio data of the rear screen application to the vehicle-wide audio device through the rear audio control module via the media playback channel; the rear screen applications include a screen mirroring application of the main screen virtual machine system on the rear screen and system applications of the rear screen virtual machine system;

[0023] Wherein, the audio data of the screen mirroring application is routed by the channel switching module to the cross-domain transmission module and cross-domain transmitted by the cross-domain transmission module to the rear audio control module, and the audio data of the system application is obtained based on the rear screen virtual machine system.

[0024] Optionally, the processing module is further configured to, before obtaining the audio focus application request of the application to be played, if the application to be played is a rear screen application for vehicle-wide playback, cross-domain transmit the vehicle-wide playback information of the rear screen application to the audio arbitration module through the rear audio control module;

[0025] Based on the system application, generate an audio focus application request corresponding to the system application according to the vehicle-wide playback information through the audio arbitration module, and send it to the channel control module.

[0026] Optionally, the processing module is further configured to, after cross-domain transmitting the vehicle-wide playback information of the rear screen application to the audio arbitration module, based on the screen mirroring application, control the screen mirroring application to generate a corresponding audio focus application request according to the vehicle-wide playback information through the audio arbitration module and send it to the channel control module;

[0027] Control the screen mirroring application to route the corresponding audio data to the channel switching module through the audio arbitration module, so that the channel switching module routes the audio data to the cross-domain transmission module.

[0028] Optionally, the processing module is further configured to, after outputting the audio data applied by the rear-row screen to the vehicle audio device through the media playback channel, obtain an audio focus application request corresponding to the main-screen application through the channel control module, generate an audio channel switching instruction corresponding to the main-screen application, and send the instruction to the channel switching module;

[0029] The channel switching module switches the vehicle audio channel to the media playback channel of the main-screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main-screen application is output to the vehicle audio device through the media playback channel. The audio focus application request corresponding to the main-screen application is sent from the main-screen application to the channel control module.

[0030] Optionally, when the application to be played is a system application, the processing module is further configured to determine the connection status of the headphone audio device through the audio arbitration module. The connection status is monitored in real time by the rear-row audio control module and transmitted across domains to the audio arbitration module;

[0031] When it is determined that the headphone audio device is connected, the audio arbitration module transmits a headphone playback instruction across domains to the rear-row audio control module, so that the rear-row audio control module outputs the audio data of the system application to the headphone audio device through the headphone channel.

[0032] Optionally, the system types of the main-screen virtual machine system and the rear-row screen virtual machine system are different. The processing module is further configured to run the main-screen virtual machine system and the rear-row screen virtual machine system in the same system-on-chip.

[0033] In a third aspect, an embodiment of the present application provides an electronic device, including: a memory and a processor;

[0034] The memory stores computer-executable instructions;

[0035] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the above first aspect and / or various possible implementation manners of the first aspect.

[0036] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the above first aspect and / or various possible implementation manners of the first aspect.

[0037] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the above first aspect and / or various possible implementation manners of the first aspect.

[0038] The audio playing method, device, equipment, medium and product of the audio system provided by the embodiments of the present application. The audio system includes a main screen virtual machine system and a rear screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module and a cross-domain transmission module. The rear screen virtual machine system includes a rear audio control module. When the user selects the application to be played and performs vehicle-wide playing, the channel control module obtains the audio focus application request of the currently selected application to be played, and determines the current audio channel switching instruction according to the audio focus application request and sends it to the channel switching module, so that the channel switching module switches the vehicle-wide audio channel to the media playing channel of the rear screen virtual machine system based on the audio channel switching instruction of the rear screen application. In addition, when the user selects the screen mirroring application of the rear screen, the channel switching module routes the audio data of the screen mirroring application in the main screen virtual machine system to the cross-domain transmission module, so as to transmit the audio data across domains to the rear audio control module through the cross-domain transmission module. When the user selects the system application of the rear screen, the corresponding audio data is obtained from the rear screen virtual machine system through the rear audio control module, and then the obtained audio data is output to the vehicle-wide audio device through the rear audio control module. The present application realizes the media playing functions of multiple system applications, meets diverse audio playing scenarios, and enhances the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present application and used together with the specification to explain the principles of the present application.

[0040] Figure 1 It is a schematic diagram of the prior art scenario provided by the present application;

[0041] Figure 2 It is a schematic flow chart of the audio playing method of the audio system provided by the present application Figure 1 ;

[0042] Figure 3 It is a schematic structural diagram of the audio system provided by the present application;

[0043] Figure 4 It is a schematic flow chart of the audio playing method of the audio system provided by the present application Figure 2 ;

[0044] Figure 5 It is a schematic flow chart of the audio playing method of the audio system provided by the present application Figure 3 ;

[0045] Figure 6 It is a schematic structural diagram of the audio playing device of the audio system provided by the present application;

[0046] Figure 7Schematic structural diagram of the electronic device provided by this application.

[0047] Through the above-mentioned drawings, specific embodiments of this application have been shown, and more detailed descriptions will be given later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. Detailed implementation manners

[0048] Here, exemplary embodiments will be described in detail, and examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with this application. On the contrary, they are merely examples of devices and methods consistent with some aspects of this application as detailed in the appended claims.

[0049] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Moreover, the processing of relevant data, such as collection, storage, use, processing, transmission, provision, disclosure, and application, complies with the relevant laws, regulations, and standards of the relevant regions, takes necessary confidentiality measures, does not violate public order and good customs, and provides corresponding operation entrances for users to choose to authorize or refuse.

[0050] Currently, there are many different usage scenarios for media playback in intelligent cockpits. For example, by clicking on an application on the main screen, the vehicle's speakers play the corresponding media audio independently; by clicking on an application on the rear seat screen, the vehicle's speakers play the corresponding media audio independently.

[0051] In order to expand the cockpit media entertainment scenarios, the prior art adopts an audio playback method with multiple systems and multiple display screens, such as Figure 1 As shown, the media applications displayed on the main screen run on System 1, and the media applications displayed on the rear seat screen run on System 2. When the user opens Media Application 1 on the main screen, System 1 transmits the audio data corresponding to Media Application 1 to Audio Channel 1 to play the corresponding audio independently; when the user opens Media Application 2 on the rear seat screen, System 2 transmits the audio data corresponding to Media Application 2 to Audio Channel 2 to play the corresponding audio independently.

[0052] However, in the prior art, the audio playback processes of the two screens are independent of each other. Therefore, it is difficult to provide users with the media playback functions of multiple system applications. Moreover, when the main screen and the rear screen play audio independently, multiple audio channels are required to achieve the independent playback of different audio data, increasing the occupation of audio channel resources. When the audio channel resources are insufficient, it is difficult to implement complex multi-system audio playback, reducing the user experience. In addition, when the user connects headphones to play audio, additional peripheral hardware devices are needed to transmit the audio data to the headphones, increasing the hardware cost.

[0053] The audio playback method of the audio system provided by this application. The audio system includes a main screen virtual machine system and a rear screen virtual machine system, and the system types of the main screen virtual machine system and the rear screen virtual machine system are different. When the user selects the application to be played and performs vehicle-wide playback, the channel control module obtains the audio focus application request of the current application to be played, determines the current audio channel switching instruction according to the audio focus application request, and sends it to the channel switching module, so that the channel switching module switches the vehicle-wide audio channel to the media playback channel of the rear screen virtual machine system based on the audio channel switching instruction of the rear screen application, and switches the vehicle-wide audio channel to the media playback channel of the main screen virtual machine system based on the audio channel switching instruction of the main screen application, realizing the vehicle-wide playback of corresponding audio at different positions in the cockpit. When the user selects the screen mirroring application on the rear screen, the channel switching module routes the audio data of the screen mirroring application in the main screen virtual machine system to the cross-domain transmission module, so as to transmit the audio data across domains to the rear audio control module through the cross-domain transmission module. When the user selects the system application on the rear screen, the rear audio control module obtains the corresponding audio data from the rear screen virtual machine system, and then outputs the obtained audio data to the vehicle-wide audio device through the rear audio control module, realizing the playback of application audio on different systems based on the rear screen, meeting diverse audio playback scenarios, and enhancing the user experience.

[0054] The following will specifically describe the technical solution of this application and how the technical solution of this application solves the above technical problems in detail. These specific embodiments below can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of this application will be described below with reference to the accompanying drawings.

[0055] Figure 2 Schematic diagram of the audio playback process of the audio system provided by this application Figure 1 , as Figure 2 shown, the method includes:

[0056] S201. Obtain a user instruction. When the user instruction indicates that the entire vehicle plays, obtain an audio focus application request of the application to be played through the channel control module, generate an audio channel switching instruction based on the audio focus application request, and send it to the channel switching module.

[0057] More specifically, the above audio system includes a main screen virtual machine system and a rear screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module, and a cross-domain transmission module. The rear screen virtual machine system includes a rear audio control module.

[0058] Optionally, the system types of the main screen virtual machine system and the rear screen virtual machine system are different and they run in the same system-on-chip.

[0059] Optionally, in this embodiment, the system applications displayed in the rear screen application run in the rear screen virtual machine system, and the screen mirroring applications displayed in the rear screen application are the screen mirroring results of the applications running in the main screen virtual machine system. The user clicks on any screen mirroring application in the rear screen to play the audio of the corresponding application running on the main screen virtual machine system. Therefore, the rear passengers can achieve the audio experience of multiple systems by operating the rear screen, enhancing the in-vehicle entertainment function and improving the user experience. Moreover, by running different systems in the same SOC (System on Chip), the chip resource occupancy is reduced and the cost is lowered.

[0060] Optionally, mirror the application running on the main screen virtual machine system to the rear screen, so as to obtain the screen mirroring application displayed in the rear screen application in the rear screen.

[0061] Optionally, the rear screen application in the rear screen includes the screen mirroring application of the main screen virtual machine system on the rear screen and the system application of the rear screen virtual machine system.

[0062] Optionally, before obtaining the audio focus application request of the application to be played, it further includes: if the application to be played is the rear screen application for the entire vehicle to play, transmit the entire vehicle play information of the rear screen application across domains to the audio arbitration module through the rear audio control module; based on the system application, generate an audio focus application request corresponding to the system application according to the entire vehicle play information through the audio arbitration module, and send it to the channel control module.

[0063] Optionally, after transmitting the entire vehicle play information of the rear screen application across domains to the audio arbitration module, based on the screen mirroring application, control the screen mirroring application to generate a corresponding audio focus application request according to the entire vehicle play information through the audio arbitration module and send it to the channel control module.

[0064] Optionally, when the user selects the main screen application for vehicle-wide playback, the main screen application running on the main screen virtual machine system generates a corresponding audio focus application request and sends it to the channel control module.

[0065] In a possible embodiment, Figure 3 is a schematic structural diagram of the audio system provided by this application. As Figure 3 shown, the audio system includes an Android system (i.e., the main screen virtual machine system) and a Windows system (i.e., the rear screen virtual machine system). The Android system and the Windows system run on the same SOC. Among them, the Android system includes an audio arbitration module, a channel control module, a channel switching module, a cross-domain transmission module, a transmission module, and an Android media application (i.e., a main screen application) and a screen mirroring Android media application (i.e., a screen mirroring application) running on the Android system. The interface of the Android media application is displayed on the main screen summary, and the interface of the screen mirroring Android media application is displayed on the rear screen. The Windows system includes a rear audio control module and a game application (i.e., a system application) running on the Windows system. The game application is displayed on the rear screen. Figure 3 The solid lines in [Figure] represent the control process in the audio system, and the dashed lines represent the audio data flow process in the audio system.

[0066] In a possible embodiment, as Figure 3 shown by the solid lines in [Figure], when the user selects the screen mirroring Android media application or the game application on the rear screen for vehicle-wide playback, the application communicates with the rear audio control module on the Windows system side, so that the rear audio control module on the Windows system side generates the vehicle-wide playback information of the application and transmits it to the audio arbitration module on the Android system side in a cross-domain transmission manner.

[0067] Exemplarily, if the selected application is the game application, when the audio arbitration module obtains the vehicle-wide playback information of the game application, it generates an audio focus application request corresponding to the game application and sends it to the channel control module.

[0068] Exemplarily, if the selected application is the screen mirroring Android media application, when the audio arbitration module obtains the vehicle-wide playback information of the screen mirroring Android media application, it controls the screen mirroring Android media application to generate a corresponding audio focus application request and send it to the channel control module by calling the setZoneidforUid function of the native AOSP (Android Open Source Project). Among them, AOSP is the core open source code of Android. The implementation principle and technical effect of the AOSP method are similar to those of the prior art, and will not be elaborated here in this embodiment.

[0069] Optionally, if the selected application is an Android media application, the Android media application running on the Android system side generates an audio focus application request corresponding to the Android media application and sends it to the channel control module.

[0070] Optionally, the channel control module determines the sound zones where the corresponding applications to be played are located according to the received audio focus application requests. Among them, the main screen application is in the main sound zone, and the rear screen application is in the rear sound zone. The channel control module determines the current target sound zone according to the preset audio playback priority policy, and generates a current audio channel switching instruction according to the target sound zone and sends it to the channel switching module.

[0071] In a possible embodiment, as Figure 3 shown by the solid line in the figure, when the channel control module only receives the audio focus application request of the game application sent by the audio arbitration module, it determines that the target sound zone is the rear sound zone, and generates an audio channel switching instruction corresponding to the game application and sends it to the channel switching module.

[0072] In a possible embodiment, as Figure 3 shown by the solid line in the figure, when the channel control module only receives the audio focus application request of the screen mirroring Android media application sent by the screen mirroring Android media application running on the Android system side, it determines that the target sound zone is the rear sound zone, and generates an audio channel switching instruction corresponding to the screen mirroring Android media application and sends it to the channel switching module.

[0073] In a possible embodiment, as Figure 3 shown by the solid line in the figure, when the channel control module only receives the audio focus application request of the Android media application sent by the Android media application running on the Android system side, it generates an audio channel switching instruction corresponding to the Android media application and sends it to the channel switching module.

[0074] In this embodiment, the vehicle-wide playback information initiated by the rear screen is transmitted across domains to the main screen virtual machine system, and further, a request for audio focus application is sent to the channel control module, so that the channel control module determines the audio path to be used currently according to the requests of applications in different systems, and generates a switching strategy for the audio channel, so as to perform logical control on the audio playback of applications in multiple systems, improve the stability and reliability of multi-system audio playback, and enhance the user experience.

[0075] S202. When the channel switching module receives the audio channel switching instruction corresponding to the rear screen application, switch the vehicle-wide audio channel to the media playback channel of the rear screen virtual machine system.

[0076] Optionally, in this embodiment, the vehicle-wide audio channel is a DSP audio channel. By controlling the DSP audio channel to switch between the media playback channel of the rear screen virtual machine system and the media playback channel of the main screen virtual machine system, the audio of applications in different systems can be played for the vehicle at different positions, and diverse audio playback scenarios can be realized, enhancing the user experience.

[0077] In a possible embodiment, as Figure 3 shown by the solid line, when the channel switching module only receives the audio channel switching instruction corresponding to the game application or the audio channel switching instruction corresponding to the screen mirroring Android media application sent by the channel control module, the channel switching module switches the DSP audio channel to the media playback channel on the Windows system side.

[0078] Optionally, after the channel switching is completed, the audio arbitration module sends a playback instruction to the rear audio control module to trigger the rear audio control module to enter the playback state. For example, play the audio of the above game application or the screen mirroring Android media application for the vehicle on the Windows system side.

[0079] In a possible embodiment, as Figure 3 shown by the solid line, when the channel switching module only receives the audio channel switching instruction corresponding to the Android media application, the channel switching module switches the DSP audio channel to the media playback channel on the Android system side.

[0080] S203. Output the audio data of the rear screen application to the vehicle-wide audio device through the media playback channel by the rear audio control module.

[0081] More specifically, the rear - row screen applications include the screen - mirroring application of the main - screen virtual machine system on the rear - row screen and the system application of the rear - row screen virtual machine system; among them, the audio data of the screen - mirroring application is routed by the channel - switching module to the cross - domain transmission module and cross - domain transmitted by the cross - domain transmission module to the rear - row audio control module, and the audio data of the system application is obtained based on the rear - row screen virtual machine system.

[0082] Optionally, after cross - domain transmitting the vehicle - wide playback information of the rear - row screen application to the audio arbitration module, based on the screen - mirroring application, the audio arbitration module is used to control the screen - mirroring application to route the corresponding audio data to the channel - switching module, so that the channel - switching module routes the audio data to the cross - domain transmission module.

[0083] In a possible embodiment, when the main - screen virtual machine system is an Android system, the rear - row audio control module cross - domain transmits the vehicle - wide playback information corresponding to any screen - mirroring Android application to the audio arbitration module, so that the audio arbitration module determines the above - mentioned screen - mirroring Android application running in the Android system, and thus controls the screen - mirroring Android application to route the corresponding audio data to the channel - switching module by calling the setZoneidforUid function of the native AOSP, and then the audio data flows to the cross - domain transmission module through the channel - switching module, and controls the screen - mirroring Android application to generate a corresponding audio focus request and send it to the channel control module. Among them, the above - mentioned screen - mirroring Android application runs in the main - screen virtual machine system, and the corresponding interface is presented on the rear - row screen.

[0084] In this embodiment, by cross - domain transmitting the vehicle - wide playback information initiated by the rear - row screen to the main - screen virtual machine system, the audio arbitration module in the main - screen virtual machine system issues a corresponding audio focus request. At the same time, it also controls the corresponding audio data to flow from the main - screen virtual machine system side to the cross - domain transmission module, so as to facilitate cross - domain transmission to the rear - row screen virtual machine system, thereby realizing the on - demand playback of the audio of the applications running on multiple systems on the rear - row screen and enhancing the user experience.

[0085] In a possible embodiment, as Figure 3 shown by the dashed line in the figure, when the rear - row audio control module obtains the playback instruction and audio data of the game application, it transmits the corresponding audio data to the vehicle - wide playback device based on the switched DSP audio channel to play the audio of the game application on the Windows system side. Among them, the vehicle - wide playback device is an AUD (Audio Device) audio device.

[0086] In a possible embodiment, as Figure 3As shown by the dashed line in the figure, when the rear-row audio control module obtains the play instruction and audio data of the screen-cast Android media application, it transmits the corresponding audio data to the vehicle-wide playback device based on the switched DSP audio channel, so as to play the audio of the screen-cast Android media application on the vehicle-wide side in the Windows system.

[0087] In a possible embodiment, as Figure 3 As shown by the dashed line in the figure, when the channel switching module obtains the audio data of the Android media application, it transmits the corresponding audio data to the vehicle-wide playback device based on the switched DSP audio channel, so as to play the audio of the Android media application on the vehicle-wide side in the Android system.

[0088] Optionally, based on the switched DSP audio channel, the audio data for vehicle-wide playback is output to the AUD audio device through the DSP module.

[0089] The audio playback method of the audio system provided by the embodiments of the present application realizes personalized and diverse audio playback scenarios when playing the application audio of different systems on the rear-row screen on the vehicle-wide side by adjudicating and switching the media playback channels of the vehicle-wide audio devices, thereby enhancing the user experience.

[0090] Optionally, after the audio data of the rear-row screen application is output to the vehicle-wide audio device through the media playback channel, the channel control module obtains the audio focus application request corresponding to the main screen application, generates the audio channel switching instruction corresponding to the main screen application and sends it to the channel switching module; the channel switching module switches the vehicle-wide audio channel to the media playback channel of the main screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main screen application is output to the vehicle-wide audio device through the media playback channel, and the audio focus application request corresponding to the main screen application is sent by the main screen application to the channel control module.

[0091] In a possible embodiment, as Figure 3As shown, the main screen virtual machine system is the Android system, and the rear screen virtual machine system is the Windows system. When playing the audio of the rear screen application on the vehicle side in the Windows system, if the user selects to play the main screen application on the vehicle side through the main screen, the channel control module determines to play on the vehicle side of the Android system according to the preset audio playback priority policy. At this time, the channel control module generates an audio channel switching instruction corresponding to the main screen application and sends it to the channel switching module, so that the channel switching module switches the DSP audio channel to the media playback channel of the Android system, and outputs the audio data through the switched DSP audio channel, so as to realize switching to playing the audio of the main screen application on the vehicle side of the Android system. In this embodiment, when playing the audio of the rear screen application on the vehicle side, the priority is assigned to the main screen application selected by the current user to trigger the switching of the audio channel, so as to realize the effective playback of the audio of the main screen application, the effective response to the user's operation of the main screen, and the effective management of the audio playback of multiple systems, enhancing the user experience.

[0092] Optionally, the rear audio control module on the rear screen virtual machine system side determines the playback mode, such as headphone playback or vehicle-side playback, by obtaining the playback device selected by the user.

[0093] Optionally, in the scenario where the user does not select a playback device, when the application to be played is a system application, the connection status of the headphone audio device is determined. The connection status is monitored in real time by the rear audio control module and transmitted across domains to the audio arbitration module; when it is determined that the headphone audio device is connected, the headphone playback instruction is transmitted across domains from the audio arbitration module to the rear audio control module, so that the rear audio control module outputs the audio data of the system application to the headphone audio device through the headphone channel. In this embodiment, when playing the rear screen application, by transmitting the headphone connection situation on the rear screen virtual machine system side across domains with the main screen virtual machine system, the convenience and reliability of the user using the headphone to play the rear screen application are improved, the audio playback scenario is extended, and the user experience is enhanced.

[0094] In a possible embodiment, based on Figure 3 the audio system, Figure 4 is the flow diagram of the audio playback method of the audio system provided in this application Figure 2 as Figure 4As shown, the driver in the cockpit selects the audio of the Android media application for vehicle-wide playback by operating the main screen, and switches the DSP audio channel to the media playback channel of the Android system through the channel control module, so as to realize the vehicle-wide playback of the audio of the Android media application. After that, if the rear-row user enters the game running interface by operating the rear screen, the audio arbitration module obtains the connection status of the rear headphones across domains from the rear audio control module of the Windows system, and determines whether the rear headphones are connected. If it is determined that they are connected, a headphone playback instruction is generated and sent across domains to the rear audio control module on the Windows system side, so that the rear audio control module outputs the audio data of the game application running in the Windows system to the headphone interface through the headphone channel, and further outputs it to the rear headphones connected to the headphone interface, so as to realize the playback of the audio of the game application by the rear headphones. Exemplarily, in this scenario, if it is determined that they are not connected, the audio arbitration module generates an audio focus application request for the game application, and sends the audio focus application request to the channel control module, so that the channel control module switches the DSP audio channel to the media playback channel of the Windows system. At this time, the audio arbitration module generates a vehicle-wide playback instruction and transmits it across domains to the rear audio control module of the Windows system, so that the rear audio control module transmits the game application audio to the switched DSP audio channel to play the game application audio vehicle-wide through the speaker.

[0095] In a possible embodiment, when playing the audio of an Android media application in the whole vehicle, the rear-row user plays the audio of the screen-cast Android media application by operating the rear-row screen, obtains the connection status of the rear-row headphones across domains from the rear-row audio control module of the Windows system through the audio arbitration module, and determines whether the rear-row headphones are connected. If it is determined that they are connected, the audio arbitration module generates a headphone playback instruction and sends it across domains to the rear-row audio control module of the Windows system. It also controls the screen-cast Android media application running in the Android system to transfer the corresponding audio data to the cross-domain transmission module through the channel switching module, so that the cross-domain transmission module transmits the audio data across domains to the rear-row audio control module of the Windows system. The rear-row audio control module outputs the obtained audio data to the rear-row headphones through the headphone channel according to the headphone playback instruction, realizing the playback of the audio of the screen-cast Android media application by the rear-row headphones. Exemplarily, if it is determined that they are not connected, the audio arbitration module controls the screen-cast Android media application to generate a corresponding audio focus application request and sends it to the channel control module, so that the channel control module switches the DSP audio channel to the media playback channel of the Windows system. At this time, the audio arbitration module generates a whole-vehicle playback instruction and transmits it across domains to the rear-row audio control module of the Windows system. It also controls the screen-cast Android media application running in the Android system to transfer the corresponding audio data to the cross-domain transmission module through the channel switching module, so that the cross-domain transmission module transmits the audio data across domains to the rear-row audio control module of the Windows system. The rear-row audio control module outputs the obtained audio data to the whole-vehicle speakers through the switched DSP audio channel according to the whole-vehicle playback instruction, realizing the whole-vehicle playback of the audio of the screen-cast Android media application by the whole-vehicle speakers.

[0096] In this embodiment, the audio data of the screen-cast application in the rear-row screen application is transmitted across domains to realize the playback of the application audio on multiple systems based on the rear-row screen. By transmitting the headphone connection status and playback instruction across domains, the effective playback of the application displayed on the rear-row screen through multiple playback methods is realized, expanding the entertainment scenario, and there is no need to add peripheral hardware devices to transmit the audio to the headphones, reducing the hardware cost and improving the user experience.

[0097] Optionally, in this embodiment, both the main-screen application and the screen-cast application in the rear-row screen application are applications running on the main-screen virtual machine system. Exemplarily, by operating the main screen, the whole-vehicle playback of application a on the main-screen virtual machine system can be realized. At the same time, by operating the rear-row screen, the headphone playback of application a on the main-screen virtual machine system can be realized.

[0098] In a possible embodiment, the user operates the rear-row screen to select the audio of any rear-row screen application for whole-vehicle playback (such asFigure 5 In state 1) in Figure 5 , the rear row audio control module generates the vehicle-wide playback information for the rear row screen application and sends it to the audio arbitration module, so that the audio arbitration module sends a request for audio focus application for the rear row screen application to the channel control module (such as Figure 5 in state 2). When the channel control module receives the request for audio focus application for the rear row screen application, if it determines that the audio of the main screen application is being played vehicle-wide, it generates an audio channel switching instruction for the rear row screen application based on a preset audio playback priority policy and sends it to the channel switching module. The DSP audio channel is switched to the media playback channel of the rear row screen virtual machine system through the channel switching module, so as to interrupt the playback of the audio of the main screen application by the vehicle speakers (such as Figure 5 in state 3), and play the audio of the rear row screen application (such as

[0099] In a possible embodiment, based on Figure 5 state 4, if the rear row user selects headphone playback by operating the rear row screen at this time (such as Figure 5 in state 5), the rear row audio control module in the rear row screen virtual machine system transmits the headphone playback information across domains to the audio arbitration module in the main screen virtual machine system, and the audio arbitration module generates a request for releasing the audio focus of the rear row screen application (such as Figure 5 in state 6), and sends it to the channel control module, so that the channel control module determines and generates an audio channel switching instruction for the main screen application based on the request for releasing the audio focus and the preset audio playback priority policy and sends it to the channel switching module. The DSP audio channel is switched to the media playback channel of the main screen virtual machine system through the channel switching module, so as to stop the vehicle speakers from playing the audio of the rear row screen application and resume the audio of the main screen application interrupted in state 3 (such as Figure 5 in state 7). This embodiment manages and controls the audio playback at different positions in the cockpit by obtaining the audio playback methods at different positions in the cockpit, so as to meet the personalized and diverse audio playback scenarios and improve the user experience.

[0100] In a possible embodiment, when playing the audio of the rear screen application in the whole vehicle, if the driver selects the audio of any main screen application for whole vehicle playback by operating the main screen, the above-mentioned main screen application running in the main screen virtual machine system will send a corresponding audio focus application request to the channel control module. The channel control module determines that the audio focus application request of the main screen application preempts the audio focus application request of the rear screen application according to the preset audio playback priority policy, thereby generating an audio channel switching instruction for the main screen application and sending it to the channel switching module. The DSP audio channel is switched to the media playback channel of the main screen virtual machine system through the channel switching module, so as to stop playing the audio of the rear screen application on the whole vehicle speakers and play the audio of the main screen application.

[0101] Figure 6 The figure is a schematic structural diagram of an audio playback device of the audio system provided by this application. The audio system includes a main screen virtual machine system and a rear screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module, and a cross-domain transmission module. The rear screen virtual machine system includes a rear audio control module, as Figure 6 shown, the audio playback device 60 of the audio system provided in this embodiment includes:

[0102] An acquisition module 601, configured to acquire a user instruction. When the user instruction indicates whole vehicle playback, acquire an audio focus application request of an application to be played through the channel control module, generate an audio channel switching instruction based on the audio focus application request, and send it to the channel switching module;

[0103] A processing module 602, configured to switch the whole vehicle audio channel to the media playback channel of the rear screen virtual machine system when the channel switching module receives an audio channel switching instruction corresponding to the rear screen application; output the audio data of the rear screen application to the whole vehicle audio device through the rear audio control module through the media playback channel; the rear screen application includes a screen mirroring application of the main screen virtual machine system on the rear screen and a system application of the rear screen virtual machine system;

[0104] Among them, the audio data of the screen mirroring application is routed to the cross-domain transmission module by the channel switching module and transmitted across domains to the rear audio control module by the cross-domain transmission module. The audio data of the system application is obtained based on the rear screen virtual machine system.

[0105] Optionally, the processing module 602 is further configured to, before acquiring the audio focus application request of the application to be played, if the application to be played is a rear screen application for whole vehicle playback, transmit the whole vehicle playback information of the rear screen application to the audio arbitration module across domains through the rear audio control module;

[0106] Based on the system application, the audio arbitration module generates an audio focus application request corresponding to the system application according to the vehicle-wide playback information and sends it to the channel control module.

[0107] Optionally, the processing module 602 is further configured to, after transmitting the vehicle-wide playback information of the rear-row screen application to the audio arbitration module across domains, based on the screen mirroring application, control the audio arbitration module to generate a corresponding audio focus application request according to the vehicle-wide playback information and send it to the channel control module;

[0108] The audio arbitration module controls the screen mirroring application to route the corresponding audio data to the channel switching module, so that the channel switching module routes the audio data to the cross-domain transmission module.

[0109] Optionally, the processing module 602 is further configured to, after outputting the audio data of the rear-row screen application to the vehicle-wide audio device through the media playback channel, obtain the audio focus application request corresponding to the main screen application through the channel control module, generate an audio channel switching instruction corresponding to the main screen application and send it to the channel switching module;

[0110] The channel switching module switches the vehicle-wide audio channel to the media playback channel of the main screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main screen application is output to the vehicle-wide audio device through the media playback channel. The audio focus application request corresponding to the main screen application is sent to the channel control module by the main screen application.

[0111] Optionally, when the application to be played is a system application, the processing module 602 determines the connection status of the headphone audio device through the audio arbitration module. The connection status is monitored in real time by the rear-row audio control module and transmitted across domains to the audio arbitration module;

[0112] When it is determined that the headphone audio device is connected, the audio arbitration module transmits a headphone playback instruction across domains to the rear-row audio control module, so that the rear-row audio control module outputs the audio data of the system application to the headphone audio device through the headphone channel.

[0113] Optionally, the system types of the main screen virtual machine system and the rear-row screen virtual machine system are different. The processing module 602 is further configured to run the main screen virtual machine system and the rear-row screen virtual machine system in the same system-on-chip.

[0114] The audio playback device of the audio system provided in this embodiment can execute the method provided in the above method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here in this embodiment.

[0115] Figure 7 It is a schematic structural diagram of the electronic device provided in this application. As Figure 7As shown in the figure, the electronic device 70 provided in this embodiment includes: at least one processor 701 and a memory 702. Optionally, the device 70 further includes a communication component 703. Among them, the processor 701, the memory 702, and the communication component 703 are connected through a bus 704.

[0116] In the specific implementation process, at least one processor 701 executes the computer-executable instructions stored in the memory 702, so that at least one processor 701 executes the above-mentioned method.

[0117] For the specific implementation process of the processor 701, reference can be made to the above method embodiment. The implementation principle and technical effect are similar, and will not be elaborated here in this embodiment.

[0118] In the above embodiment, it should be understood that the processor may be a central processing unit (English: Central Processing Unit, abbreviated: CPU), or other general-purpose processors, digital signal processors (English: Digital Signal Processor, abbreviated: DSP), application-specific integrated circuits (English: Application Specific Integrated Circuit, abbreviated: ASIC), etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in combination with the invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.

[0119] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-volatile Memory, NVM), such as at least one disk memory.

[0120] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, the bus in the drawings of this application is not limited to only one bus or one type of bus.

[0121] This application also provides a computer program product, including a computer program, which implements the above-mentioned method when executed by a processor.

[0122] The present application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the above method.

[0123] The above-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium accessible by a general-purpose or special-purpose computer.

[0124] An exemplary readable storage medium is coupled to the processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the readable storage medium can also exist as discrete components in a device.

[0125] The division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0126] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0127] In addition, in each embodiment of the present invention, the functional units can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.

[0128] If a function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or a part of this technical solution can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in various embodiments of the present invention. The aforementioned storage medium includes: USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs, etc., all kinds of media that can store program codes.

[0129] Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When this program is executed, it executes the steps including the above method embodiments; and the aforementioned storage medium includes: ROMs, RAMs, magnetic disks, or optical discs, etc., all kinds of media that can store program codes.

[0130] Finally, it should be noted that: After considering the specification and practicing the invention disclosed herein, those skilled in the art will easily think of other implementation manners of the present invention. The present invention is intended to cover any variations, uses, or adaptive changes of the present invention. These variations, uses, or adaptive changes follow the general principles of the present invention and include the common general knowledge or conventional technical means in the technical field of the present invention that are not disclosed in the present invention. It is not limited to the exact structure described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present invention is only limited by the appended claims.

Claims

1. An audio playing method of an audio system, characterized in that: The audio system includes a main screen virtual machine system and a rear screen virtual machine system, the main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module and a cross-domain transmission module, the rear screen virtual machine system includes a rear audio control module, and the method includes: Obtaining a user instruction, when the user instruction instructs the entire vehicle to play, obtaining an audio focus application request of the application to be played through the channel control module, generating an audio channel switching instruction based on the audio focus application request and sending it to the channel switching module; When the channel switching module receives the audio channel switching instruction corresponding to the rear screen application, the audio channel of the whole vehicle is switched to the media playback channel of the rear screen virtual machine system; the audio data of the rear screen application is output to the audio device of the whole vehicle through the media playback channel by the rear audio control module; the rear screen application includes the projection application of the main screen virtual machine system on the rear screen and the system application of the rear screen virtual machine system; Among them, the audio data of the screen projection application is routed to the cross-domain transmission module by the channel switching module, and cross-domain transmitted to the rear audio control module by the cross-domain transmission module, and the audio data of the system application is obtained based on the rear screen virtual machine system.

2. The method according to claim 1, characterized in that Before obtaining the audio focus request of the application to be played, it also includes: If the application to be played is a rear screen application played in the entire vehicle, the entire vehicle playback information of the rear screen application is transmitted to the audio arbitration module across domains through the rear audio control module; Based on the system application, the audio arbitration module generates an audio focus application request corresponding to the system application according to the vehicle playback information, and sends it to the channel control module.

3. The method according to claim 2, characterized in that After the whole vehicle playback information of the rear screen application is transmitted to the audio arbitration module across domains, the method further includes: Based on the screen projection application, the audio arbitration module controls the screen projection application to generate a corresponding audio focus application request according to the vehicle playback information and sends it to the channel control module; The screen projection application is controlled by the audio arbitration module to route the corresponding audio data to the channel switching module, so that the channel switching module routes the audio data to the cross-domain transmission module.

4. The method according to any one of claims 1 to 3, characterized in that: Also includes: After the audio data of the rear screen application is output to the vehicle audio device through the media playback channel, an audio focus application request corresponding to the main screen application is obtained through the channel control module, and an audio channel switching instruction corresponding to the main screen application is generated and sent to the channel switching module; The channel switching module switches the vehicle audio channel to the media playback channel of the main screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main screen application is output to the vehicle audio device through the media playback channel, and the audio focus application request corresponding to the main screen application is sent by the main screen application to the channel control module.

5. The method according to claim 1, characterized in that Also includes: When the application to be played is a system application, the connection status of the earphone audio device is determined by the audio arbitration module, and the connection status is monitored in real time by the rear audio control module and transmitted across domains to the audio arbitration module; When it is determined that the headphone audio device is connected, the headphone playback instruction is transmitted cross-domain to the rear audio control module through the audio arbitration module, so that the rear audio control module outputs the audio data of the system application to the headphone audio device through the headphone channel.

6. The method according to claim 1, characterized in that The main screen virtual machine system and the rear screen virtual machine system are of different system types and run in the same system-level chip.

7. An audio playback device of an audio system, characterized in that: The audio system includes a main screen virtual machine system and a rear screen virtual machine system, the main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module and a cross-domain transmission module, the rear screen virtual machine system includes a rear audio control module, and the device includes: an acquisition module, used to acquire a user instruction, and when the user instruction instructs the entire vehicle to play, acquire an audio focus application request of the application to be played through the channel control module, generate an audio channel switching instruction based on the audio focus application request, and send it to the channel switching module; A processing module, configured to switch the vehicle audio channel to the media playback channel of the rear screen virtual machine system when the channel switching module receives an audio channel switching instruction corresponding to the rear screen application; output the audio data of the rear screen application to the vehicle audio device through the media playback channel through the rear audio control module; the rear screen application includes a screen projection application of the main screen virtual machine system on the rear screen and a system application of the rear screen virtual machine system; Among them, the audio data of the screen projection application is routed to the cross-domain transmission module by the channel switching module, and cross-domain transmitted to the rear audio control module by the cross-domain transmission module, and the audio data of the system application is obtained based on the rear screen virtual machine system.

8. An electronic device, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 6 when executed by a processor.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 6 when being executed by a processor.

Images