Audio playing method, device, equipment, medium and product of audio system

Abstract

Embodiments of the present application provide an audio playing method and device of an audio system, equipment, medium and product. The method comprises: in a main screen virtual machine system, an audio focus application request of an application to be played is acquired through a channel control module to generate an audio channel switching instruction and send it to a channel switching module, so that the channel switching module switches the whole vehicle audio channel to the media playing channel of the rear screen virtual machine system based on the audio channel switching instruction of the rear screen application; when the rear screen application is a projection application, the audio data of the projection application is transmitted to the rear audio control module in the rear screen virtual machine system through the cross-domain transmission module through the channel switching module, so that the obtained audio data is output to the whole vehicle audio equipment through the rear audio control module. The method is used to provide the user with the media playing function of various system applications, realize diversified audio playing scenes, and enhance the effect of user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle intelligent cockpit, in particular to an audio playing method and device of an audio system, equipment, medium and product. BACKGROUND

[0002] At present, multiple screens are set in the intelligent cockpit to meet the media playing needs of users. For example, when the front-row user in the cockpit plays navigation audio to the whole vehicle through the main screen, the rear-row user plays video audio through the rear-row screen.

[0003] The prior art is based on a cockpit with multiple screens of a single system. An audio strategy dynamic routing mechanism is configured for the system to display the related content of multiple applications running on the system in multiple screens of the cockpit and play the corresponding audio. However, the prior art cannot provide the media playing function of multiple system applications to the user, and the use scene is limited. SUMMARY

[0004] The embodiments of the present application provide an audio playing method and device of an audio system, equipment, medium and product to provide the media playing function of multiple system applications to the user, realize diversified audio playing scenes, and enhance the user experience.

[0005] In a first aspect, the embodiments of the present application provide an audio playing method of an audio system. The audio system includes a main screen virtual machine system and a rear-row screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module and a cross-domain transmission module. The rear-row screen virtual machine system includes a rear-row audio control module. The method includes:

[0006] obtaining a user instruction, when the user instruction indicates playing to the whole vehicle, obtaining an audio focus application request of an application to be played through the channel control module, generating an audio channel switching instruction based on the audio focus application request and sending the audio channel switching instruction to the channel switching module;

[0007] when the channel switching module receives the audio channel switching instruction corresponding to the rear-row screen application, switching the audio channel of the whole vehicle to the media playing channel of the rear-row screen virtual machine system; outputting the audio data of the rear-row screen application to the audio equipment of the whole vehicle through the media playing channel through the rear-row audio control module; the rear-row screen application includes a screen mirroring application of the main screen virtual machine system on the rear-row screen and a system application of the rear-row screen virtual machine system;

[0008] wherein the audio data of the screen mirroring application is routed to the cross-domain transmission module by the channel switching module, and is cross-domain transmitted to the rear-row audio control module by the cross-domain transmission module, and the audio data of the system application is obtained based on the rear-row screen virtual machine system.

[0009] Optionally, before the audio focus application request of the to-be-played application is acquired, the method further comprises:

[0010] If the to-be-played application is a rear-row screen application for vehicle-wide playing, the rear-row screen application is transmitted to the audio arbitration module through the rear-row audio control module.

[0011] Based on the system application, the audio arbitration module generates an audio focus application request corresponding to the system application according to the vehicle-wide playing information, and sends the audio focus application request to the channel control module.

[0012] Optionally, after the vehicle-wide playing information of the rear-row screen application is transmitted to the audio arbitration module, the method further comprises:

[0013] Based on the screen projection application, the audio arbitration module controls the screen projection application to generate an audio focus application request corresponding to the screen projection application according to the vehicle-wide playing information, and sends the audio focus application request to the channel control module.

[0014] The audio arbitration module controls the screen projection application to route the audio data corresponding to the screen projection application to the channel switching module, so that the channel switching module routes the audio data to the cross-domain transmission module.

[0015] Optionally, after the audio data of the rear-row screen application is output to the vehicle-wide audio device through the media playing channel, the channel control module acquires an audio focus application request corresponding to the main screen application, generates an audio channel switching instruction corresponding to the main screen application, and sends the audio channel switching instruction to the channel switching module.

[0016] The channel switching module switches the vehicle-wide audio channel to the media playing channel of the main screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main screen application is output to the vehicle-wide audio device through the media playing channel. The audio focus application request corresponding to the main screen application is sent to the channel control module by the main screen application.

[0017] Optionally, when the to-be-played application is a system application, the audio arbitration module determines the connection state of the earphone audio device. The connection state is monitored by the rear-row audio control module in real time and transmitted to the audio arbitration module.

[0018] When the earphone audio device is connected, the audio arbitration module transmits an earphone playing instruction to the rear-row audio control module, so that the rear-row audio control module outputs the audio data of the system application to the earphone audio device through the earphone channel.

[0019] Optionally, the system types of the main screen virtual machine system and the rear-row screen virtual machine system are different, and the main screen virtual machine system and the rear-row screen virtual machine system are running in the same system-level chip.

[0020] Secondly, embodiments of this application provide an audio playback device for an audio system. The audio system includes a main screen virtual machine system and a rear screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module, and a cross-domain transmission module. The rear screen virtual machine system includes a rear audio control module. The device includes:

[0021] The acquisition module is used to acquire user instructions. When the user instruction instructs the whole vehicle to play, it acquires the audio focus request of the application to be played through the channel control module, generates an audio channel switching instruction based on the audio focus request, and sends it to the channel switching module.

[0022] The processing module is used to switch the vehicle's audio channel to the media playback channel of the rear screen virtual machine system when the channel switching module receives the audio channel switching instruction corresponding to the rear screen application; and to output the audio data of the rear screen application to the vehicle's audio equipment through the media playback channel via the rear audio control module; the rear screen application includes the projection application of the main screen virtual machine system on the rear screen and the system application of the rear screen virtual machine system;

[0023] The audio data for the screen mirroring application is routed from the channel switching module to the cross-domain transmission module, and then transmitted across domains by the cross-domain transmission module to the rear audio control module. The audio data for the system application is obtained based on the rear screen virtual machine system.

[0024] Optionally, the processing module is also used to transmit the whole-vehicle playback information of the rear-seat screen application to the audio arbitration module across domains through the rear-seat audio control module before obtaining the audio focus request of the application to be played.

[0025] Based on the system application, the audio arbitration module generates an audio focus request corresponding to the system application based on the vehicle playback information and sends it to the channel control module.

[0026] Optionally, the processing module is also used to, after transmitting the whole vehicle playback information of the rear screen application across domains to the audio arbitration module, control the screen projection application to generate a corresponding audio focus request based on the whole vehicle playback information through the audio arbitration module and send it to the channel control module.

[0027] The audio arbitration module controls the screen mirroring application to route the corresponding audio data to the channel switching module, so that the channel switching module routes the audio data to the cross-domain transmission module.

[0028] Optionally, the processing module is further configured to, after the audio data of the rear-row screen application is output to the vehicle audio device through the media playing channel, acquire an audio focus application request corresponding to the main screen application through the channel control module, generate an audio channel switching instruction corresponding to the main screen application, and send the audio channel switching instruction to the channel switching module.

[0029] The channel switching module switches the vehicle audio channel to the media playing channel of the main screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main screen application is output to the vehicle audio device through the media playing channel.

[0030] Optionally, when the to-be-played application is a system application, the processing module is further configured to determine a connection state of the earphone audio device through the audio arbitration module, the connection state being monitored in real time by the rear-row audio control module and transmitted to the audio arbitration module in a cross-domain manner.

[0031] When the earphone audio device is determined to be connected, the audio arbitration module transmits an earphone playing instruction to the rear-row audio control module in a cross-domain manner, so that the rear-row audio control module outputs the audio data of the system application to the earphone audio device through the earphone channel.

[0032] Optionally, the system types of the main screen virtual machine system and the rear-row screen virtual machine system are different, and the processing module is further configured to run the main screen virtual machine system and the rear-row screen virtual machine system in the same system-level chip.

[0033] In a third aspect, an electronic device is provided, including a memory and a processor.

[0034] The memory stores computer execution instructions.

[0035] The processor executes the computer execution instructions stored in the memory, so that the processor executes the first aspect and / or various possible implementation manners of the first aspect.

[0036] In a fourth aspect, a computer readable storage medium is provided, and the computer readable storage medium stores computer execution instructions. When the computer execution instructions are executed by a processor, the computer execution instructions are used to implement the first aspect and / or various possible implementation manners of the first aspect.

[0037] In a fifth aspect, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the computer program implements the first aspect and / or various possible implementation manners of the first aspect.

[0038] The audio playing method, device, equipment, medium and product of the audio system provided by the embodiments of the present application, the audio system comprising a main screen virtual machine system and a rear row screen virtual machine system, the main screen virtual machine system comprising an audio arbitration module, a channel control module, a channel switching module and a cross-domain transmission module, and the rear row screen virtual machine system comprising a rear row audio control module. When a user selects an application to be played and performs vehicle-wide playing, the channel control module obtains an audio focus application request of the current application to be played, and determines an audio channel switching instruction of the current application to be played according to the audio focus application request and sends the audio channel switching instruction to the channel switching module, so that the channel switching module switches the vehicle-wide audio channel to a media playing channel of the rear row screen virtual machine system based on the audio channel switching instruction of the rear row screen application. In addition, when the user selects a screen projection application of the rear row screen, the channel switching module routes audio data of the screen projection application in the main screen virtual machine system to the cross-domain transmission module, so as to transmit the audio data to the rear row audio control module through the cross-domain transmission module. When the user selects a system application of the rear row screen, the corresponding audio data is obtained from the rear row screen virtual machine system through the rear row audio control module, so as to output the obtained audio data to the vehicle-wide audio equipment through the rear row audio control module. The present application realizes the media playing function of multiple system applications, meets diversified audio playing scenes, and enhances user experience. BRIEF DESCRIPTION OF DRAWINGS

[0039] The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments consistent with the present application and, together with the description, further serve to explain the principles of the application.

[0040] Figure 1 A scene schematic diagram of prior art provided by the present application;

[0041] Figure 2 A flowchart of the audio playing method of the audio system provided by the present application Figure 1 ;

[0042] Figure 3 A structure schematic diagram of the audio system provided by the present application;

[0043] Figure 4 A flowchart of the audio playing method of the audio system provided by the present application Figure 2 ;

[0044] Figure 5 A flowchart of the audio playing method of the audio system provided by the present application Figure 3 ;

[0045] Figure 6 A structure schematic diagram of the audio playing device of the audio system provided by the present application;

[0046] Figure 7A structural schematic diagram of an electronic device is provided in the present application.

[0047] The specific embodiments of the present application have been shown by the above-mentioned drawings, and will be described in more detail hereinafter. These drawings and the written description are not intended to limit the scope of the present application concept in any way, but to illustrate the present application concept to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0048] The exemplary embodiments will be described in detail herein with reference to the attached drawings. In the following description, the same numbers are used to indicate the same or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not meant to represent all implementations consistent with the present application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present application as detailed in the appended claims.

[0049] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of related data comply with relevant laws, regulations and standards in relevant regions, necessary security measures are taken, do not violate public order and good customs, and provide corresponding operation portal for user to choose authorization or refusal.

[0050] At present, there are many different media playing scenarios in the intelligent cockpit, for example, by clicking the application in the main screen to make the whole vehicle speaker play the corresponding media audio alone; by clicking the application in the rear screen to make the whole vehicle speaker play the corresponding media audio alone.

[0051] The prior art uses a multi-system multi-display screen audio playing method to expand the cockpit media entertainment scene, as shown in Figure 1 The media application displayed on the main screen is run on system 1, and the media application displayed on the rear screen is run on system 2. When the user opens the media application 1 on the main screen, the system 1 transmits the audio data corresponding to the media application 1 to the audio channel 1 to play the corresponding audio independently; when the user opens the media application 2 on the rear screen, the system 2 transmits the audio data corresponding to the media application 2 to the audio channel 2 to play the corresponding audio independently.

[0052] However, in existing technologies, the audio playback processes on the two screens are independent, making it difficult to provide users with media playback functionality for multiple system applications. Furthermore, when the main screen and the rear screen play audio independently, multiple audio channels are required to achieve independent playback of different audio data, increasing the consumption of audio channel resources. When audio channel resources are insufficient, it is difficult to achieve complex multi-system audio playback, thus degrading the user experience. Additionally, when users connect headphones to play audio, external hardware is required to transmit audio data to the headphones, increasing hardware costs.

[0053] The audio playback method of the audio system provided in this application includes a main screen virtual machine system and a rear screen virtual machine system, which are of different system types. When the user selects an application to be played and starts playing it throughout the vehicle, the channel control module obtains the audio focus request of the application to be played, determines the current audio channel switching instruction based on the audio focus request, and sends it to the channel switching module. This causes the channel switching module to switch the vehicle's audio channels to the media playback channel of the rear screen virtual machine system based on the audio channel switching instruction of the rear screen application, and to switch the vehicle's audio channels to the main screen virtual machine system based on the audio channel switching instruction of the main screen application. The media playback channel of the virtual machine system enables the playback of corresponding audio across the entire vehicle from different locations in the cabin. When a user selects a projection application on the rear screen, the audio data of the projection application in the main screen virtual machine system is routed to the cross-domain transmission module via the channel switching module. This cross-domain transmission module then transmits the audio data to the rear audio control module. When the user selects a system application on the rear screen, the rear audio control module retrieves the corresponding audio data from the rear screen virtual machine system and outputs the obtained audio data to the vehicle's audio equipment. This enables the playback of application audio from different systems on the rear screen, meeting diverse audio playback scenarios and enhancing the user experience.

[0054] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0055] Figure 2 A schematic diagram of the audio playback process of the audio system provided in this application. Figure 1 ,like Figure 2 As shown, the method includes:

[0056] S201, acquire a user instruction, when the user instruction indicates whole vehicle playing, acquire an audio focus application request of an application to be played through a channel control module, generate an audio channel switching instruction based on the audio focus application request and send the audio channel switching instruction to a channel switching module.

[0057] More specifically, the audio system includes a main screen virtual machine system and a rear screen virtual machine system, the main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module and a cross-domain transmission module, and the rear screen virtual machine system includes a rear screen audio control module.

[0058] Optionally, the system types of the main screen virtual machine system and the rear screen virtual machine system are different, and the main screen virtual machine system and the rear screen virtual machine system run in the same system on chip (SOC).

[0059] Optionally, in the embodiment, a system application displayed in a rear screen application in the rear screen runs in the rear screen virtual machine system, and a screen mirroring application displayed in the rear screen application in the rear screen is a screen mirroring result of an application running in the main screen virtual machine system. A user clicks any screen mirroring application in the rear screen to play audio of the corresponding application running in the main screen virtual machine system. Therefore, the rear user can realize audio experience of multiple systems by operating the rear screen, enhance the cabin entertainment function, and improve the user experience. Moreover, by running different systems in the same SOC, chip resource occupation is reduced, and cost is reduced.

[0060] Optionally, the application running in the main screen virtual machine system is screen mirrored to the rear screen, so that the screen mirroring application displayed in the rear screen application in the rear screen is obtained.

[0061] Optionally, the rear screen application in the rear screen includes a screen mirroring application of the main screen virtual machine system in the rear screen and a system application of the rear screen virtual machine system.

[0062] Optionally, before acquiring the audio focus application request of the application to be played, the method further includes: if the application to be played is a rear screen application for whole vehicle playing, transmitting whole vehicle playing information of the rear screen application to the audio arbitration module through the rear screen audio control module; and based on the system application, generating an audio focus application request corresponding to the system application according to the whole vehicle playing information through the audio arbitration module, and sending the audio focus application request to the channel control module.

[0063] Optionally, after transmitting the whole vehicle playing information of the rear screen application to the audio arbitration module, based on the screen mirroring application, controlling the screen mirroring application to generate a corresponding audio focus application request according to the whole vehicle playing information through the audio arbitration module, and sending the audio focus application request to the channel control module.

[0064] Optionally, when the user selects the whole vehicle play home screen application, the home screen application running on the home screen virtual machine system generates a corresponding audio focus application request and sends it to the channel control module.

[0065] In a possible embodiment, Figure 3 The structure schematic diagram of the audio system provided in the present application is shown in Figure 3 As shown in the figure, the audio system includes an Android system (i.e. a home screen virtual machine system) and a Windows system (i.e. a rear screen virtual machine system), and the Android system and the Windows system run on the same SOC, wherein the Android system includes an audio arbitration module, a channel control module, a channel switching module, a cross-domain transmission module, a transmission module, an Android media application (i.e. a home screen application) running on the Android system and a screen projection Android media application (i.e. a screen projection application), the interface of the Android media application is displayed on the home screen, the interface of the screen projection Android media application is displayed on the rear screen, the Windows system includes a rear audio control module and a game application (i.e. a system application) running on the Windows system, and the game application is displayed on the rear screen. Figure 3 The solid line in the figure represents the control process in the audio system, and the dashed line represents the audio data flow process in the audio system.

[0066] In a possible embodiment, as shown by the solid line in Figure 3 When the user selects the screen projection Android media application or the game application in the rear screen for whole vehicle play, the application communicates with the rear audio control module on the Windows system side, so that the rear audio control module on the Windows system side generates the whole vehicle play information of the application and transmits it to the audio arbitration module on the Android system side in a cross-domain transmission manner.

[0067] For example, if the selected application is the game application, when the audio arbitration module obtains the whole vehicle play information of the game application, it generates an audio focus application request corresponding to the game application and sends it to the channel control module.

[0068] For example, if the selected application is an Android media application for screen mirroring, the audio arbitration module, upon obtaining the overall playback information of the Android media application, calls the native AOSP (Android Open Source Project) `setZoneidforUid` function to control the Android media application to generate the corresponding audio focus request and send it to the channel control module. AOSP is the core open source code of Android, and the implementation principle and technical effects of the AOSP method are similar to existing technologies; therefore, they will not be elaborated upon in this embodiment.

[0069] Optionally, if the selected application is an Android media application, the Android media application running on the Android system side generates an audio focus request corresponding to the Android media application and sends it to the channel control module.

[0070] Optionally, the channel control module determines the corresponding audio zone of each application to be played based on the received audio focus request, wherein the main screen application is in the main audio zone and the rear screen applications are in the rear audio zone. The channel control module determines the current target audio zone according to a preset audio playback priority strategy, and generates the current audio channel switching command based on the target audio zone and sends it to the channel switching module.

[0071] In one possible embodiment, such as Figure 3 As shown by the solid line, when the channel control module only receives the audio focus request from the game application sent by the audio arbitration module, it determines the target audio region as the back audio region, generates the audio channel switching instruction corresponding to the game application, and sends it to the channel switching module.

[0072] In one possible embodiment, such as Figure 3 As shown by the solid line, when the channel control module only receives an audio focus request from the Android media application running on the Android system side, it determines the target audio zone as the back audio zone, generates an audio channel switching instruction corresponding to the Android media application, and sends it to the channel switching module.

[0073] In one possible embodiment, such as Figure 3 As shown by the solid line, when the channel control module receives only the audio focus request from the Android media application running on the Android system side, it generates the corresponding audio channel switching instruction for the Android media application and sends it to the channel switching module.

[0074] The embodiment further issues an audio focus application request to the channel control module by transmitting the whole-vehicle playing information initiated by the rear-row screen to the main screen virtual machine system, so as to determine the audio channel to be used currently by the channel control module according to the request of the application of different systems, and generate a switching strategy of the audio channel, so as to logically control the audio playing of the application of multiple systems, improve the stability and reliability of the multi-system audio playing, and enhance the user experience.

[0075] S202, when the channel switching module receives the audio channel switching instruction corresponding to the application of the rear-row screen, the whole-vehicle audio channel is switched to the media playing channel of the rear-row screen virtual machine system.

[0076] Optionally, in the embodiment, the whole-vehicle audio channel is a DSP audio channel, and the DSP audio channel is switched between the media playing channel of the rear-row screen virtual machine system and the media playing channel of the main screen virtual machine system, so as to play the application audio of different systems at different positions, realize diversified audio playing scenes, and enhance the user experience.

[0077] In a possible embodiment, as shown by the solid line in Figure 3 When the channel switching module only receives the audio channel switching instruction corresponding to the game application or the audio channel switching instruction corresponding to the screen projection Android media application sent by the channel control module, the channel switching module switches the DSP audio channel to the media playing channel of the Windows system side.

[0078] Optionally, after the channel switching is completed, the audio arbitration module sends a playing instruction to the rear-row audio control module, so as to trigger the rear-row audio control module to enter a playing state. For example, the game application audio or the screen projection Android media application audio is played on the Windows system side.

[0079] In a possible embodiment, as shown by the solid line in Figure 3 When the channel switching module only receives the audio channel switching instruction corresponding to the game application or the audio channel switching instruction corresponding to the screen projection Android media application sent by the channel control module, the channel switching module switches the DSP audio channel to the media playing channel of the Windows system side.

[0080] S203, the audio data of the application of the rear-row screen is output to the whole-vehicle audio equipment through the media playing channel by the rear-row audio control module.

[0081] More specifically, the rear screen application includes a system application of a rear screen virtual machine system and a projection application of a main screen virtual machine system projected on the rear screen; wherein the audio data of the projection application is routed to the cross-domain transmission module by the channel switching module, and is transmitted to the rear audio control module by the cross-domain transmission module, and the audio data of the system application is obtained based on the rear screen virtual machine system.

[0082] Optionally, after transmitting the whole vehicle playing information of the rear screen application to the audio arbitration module, the audio arbitration module controls the corresponding audio data of the projection application to be routed to the channel switching module based on the projection application, so that the channel switching module routes the audio data to the cross-domain transmission module.

[0083] In a possible embodiment, when the main screen virtual machine system is an Android system, the rear audio control module transmits the whole vehicle playing information corresponding to any one of the projection Android applications to the audio arbitration module, so that the audio arbitration module determines the above-mentioned projection Android application running in the Android system, thereby controlling the projection Android application to route the corresponding audio data to the channel switching module by calling the setZoneidforUid function of the native AOSP, and then passing through the channel switching module to the cross-domain transmission module, and controlling the projection Android application to generate a corresponding audio focus application request and send it to the channel control module. Wherein, the above-mentioned projection Android application runs in the main screen virtual machine system, and the corresponding interface is presented on the rear screen.

[0084] The embodiment transmits the whole vehicle playing information initiated by the rear screen to the main screen virtual machine system, so that the audio arbitration module in the main screen virtual machine system issues a corresponding audio focus application request, and also controls the corresponding audio data to flow from the main screen virtual machine system side to the cross-domain transmission module, so as to be transmitted to the rear screen virtual machine system, thereby realizing the rear screen playing the audio of the application running on the multiple systems on demand, and enhancing the user experience.

[0085] In a possible embodiment, as shown by the dashed line in Figure 3 When the rear audio control module obtains the playing instruction and the audio data of the game application, the corresponding audio data is transmitted to the whole vehicle playing device based on the switched DSP audio channel, so as to play the audio of the game application on the Windows system side. Wherein, the whole vehicle playing device is an AUD (Audio Device) audio device.

[0086] In a possible embodiment, as shown by the dashed line in Figure 3As shown by the dotted line, when the rear-row audio control module obtains the playing instruction and the audio data of the projected Android media application, the corresponding audio data is transmitted to the vehicle audio playing device based on the switched DSP audio channel, so as to play the audio of the projected Android media application on the vehicle on the Windows system side.

[0087] In a possible embodiment, as Figure 3 As shown by the dotted line, when the channel switching module obtains the audio data of the Android media application, the corresponding audio data is transmitted to the vehicle audio playing device based on the switched DSP audio channel, so as to play the audio of the Android media application on the vehicle on the Android system side.

[0088] Optionally, the audio data played on the vehicle is output to the AUD audio device through the DSP module based on the switched DSP audio channel.

[0089] The audio playing method of the audio system provided by the embodiments of the present application can meet the personalized and diversified audio playing scenarios and improve the user experience by switching the media playing channel of the vehicle audio device when playing the audio of the applications of different systems on the rear-row screen.

[0090] Optionally, after the audio data of the rear-row screen application is output to the vehicle audio device through the media playing channel, the audio focus application request corresponding to the main screen application is obtained through the channel control module, the audio channel switching instruction corresponding to the main screen application is generated and sent to the channel switching module, and the vehicle audio channel is switched to the media playing channel of the main screen virtual machine system through the channel switching module according to the audio channel switching instruction, so that the audio data of the main screen application is output to the vehicle audio device through the media playing channel. The audio focus application request corresponding to the main screen application is sent to the channel control module by the main screen application.

[0091] In a possible embodiment, as Figure 4As shown, the main screen virtual machine system is an Android system, and the rear screen virtual machine system is a Windows system. When the rear screen plays audio of the application of the Windows system, if the user selects the main screen to play the application of the main screen, the channel control module determines to play the application of the main screen on the Android system according to a preset audio playing priority strategy. At this time, the channel control module generates an audio channel switching instruction corresponding to the application of the main screen and sends the audio channel switching instruction to the channel switching module, so that the channel switching module switches the DSP audio channel to the media playing channel of the Android system, and outputs the audio data through the switched DSP audio channel, to realize playing the audio of the application of the main screen on the Android system. In this embodiment, when the rear screen plays audio of the application, the application selected by the current user is assigned a priority, to trigger the switching of the audio channel, so as to realize effective playing of the audio of the application of the main screen, effective response to the operation of the main screen by the user, and effective management of the audio playing of the multiple systems, and enhance the user experience.

[0092] Optionally, the rear audio control module on the rear screen virtual machine system side determines the playing mode, such as earphone playing or vehicle playing, by acquiring the playing device selected by the user.

[0093] Optionally, in the scenario where the user does not select a playing device, when the application to be played is a system application, the connection state of the earphone audio device is determined, and the connection state is monitored by the rear audio control module in real time and transmitted to the audio arbitration module across domains; when it is determined that the earphone audio device is connected, the audio arbitration module transmits an earphone playing instruction to the rear audio control module across domains, so that the rear audio control module outputs the audio data of the system application to the earphone audio device through the earphone channel. In this embodiment, when the rear screen plays the application, the earphone connection state of the rear screen virtual machine system side is transmitted across domains with the main screen virtual machine system, which improves the convenience and reliability of the user playing the application of the rear screen through the earphone, expands the audio playing scenario, and enhances the user experience.

[0094] In a possible embodiment, based on Figure 2 an audio system, Figure 4 a flowchart of an audio playing method of the audio system provided in the present application Figure 5 such as Figure 5As shown, the driver in the cabin selects the audio of the whole vehicle playing the Android media application by operating the main screen, and the audio channel of the DSP is switched to the media playing channel of the Android system through the channel control module, so that the audio of the Android media application is played in the whole vehicle. After that, if the user in the back row enters the game running interface by operating the back row screen, the audio arbitration module obtains the connection state of the back row earphone from the back row audio control module of the Windows system and determines whether the back row earphone is connected. If it is determined to be connected, an earphone playing instruction is generated and sent to the back row audio control module of the Windows system side across domains, so that the back row audio control module outputs the audio data of the game application running in the Windows system to the earphone interface through the earphone channel, and then to the back row earphone connected to the earphone interface, so as to realize the playing of the audio of the game application by the back row earphone. For example, in this scenario, if it is determined that it is not connected, the audio arbitration module generates an audio focus application request of the game application and sends the audio focus application request to the channel control module, so that the channel control module switches the DSP audio channel to the media playing channel of the Windows system. At this time, the audio arbitration module generates a whole vehicle playing instruction and transmits it to the back row audio control module of the Windows system across domains, so that the back row audio control module transmits the game application audio to the switched DSP audio channel, so as to play the game application audio in the whole vehicle through the loudspeaker.

[0095] In a possible embodiment, when the audio of the Android media application played by the whole vehicle, the rear user plays the audio of the screen projection Android media application by operating the rear screen, and the audio arbitration module obtains the rear earphone connection state from the rear audio control module of the Windows system and determines whether the rear earphone is connected. If it is determined that the connection is connected, the audio arbitration module generates an earphone playing instruction and transmits it to the rear audio control module of the Windows system, and also controls the screen projection Android media application running in the Android system to flow the corresponding audio data to the cross-domain transmission module through the channel switching module, so that the cross-domain transmission module transmits the audio data to the rear audio control module of the Windows system, and the rear audio control module outputs the obtained audio data to the rear earphone through the earphone channel according to the earphone playing instruction, realizing the rear earphone playing the audio of the screen projection Android media application. For example, if it is determined that the connection is not connected, the audio arbitration module controls the screen projection Android media application to generate a corresponding audio focus application request and sends it to the channel control module, so that the channel control module switches the DSP audio channel to the media playing channel of the Windows system. At this time, the audio arbitration module generates a whole vehicle playing instruction and transmits it to the rear audio control module of the Windows system, and also controls the screen projection Android media application running in the Android system to flow the corresponding audio data to the cross-domain transmission module through the channel switching module, so that the cross-domain transmission module transmits the audio data to the rear audio control module of the Windows system, and the rear audio control module outputs the obtained audio data to the whole vehicle loudspeaker through the switched DSP audio channel according to the whole vehicle playing instruction, realizing the whole vehicle loudspeaker playing the audio of the screen projection Android media application.

[0096] The embodiment transmits the audio data of the screen projection application in the rear screen application through cross-domain transmission, to realize playing the application audio on multiple systems based on the rear screen, and transmits the earphone connection state and the playing instruction through cross-domain transmission, to realize effectively playing the application displayed by the rear screen through multiple playing modes, expand the entertainment scene, and without increasing peripheral hardware devices to transmit the audio to the earphone, reducing the hardware cost and improving the user experience.

[0097] Optionally, the screen projection application in the main screen application and the rear screen application in the embodiment is an application running on the main screen virtual machine system. For example, the whole vehicle plays the application a on the main screen virtual machine system by operating the main screen, and at the same time, the earphone plays the application a on the main screen virtual machine system by operating the rear screen.

[0098] In a possible embodiment, the user selects the audio of any one rear screen application by operating the rear screen (such as the audio of the rear screen application a), and the audio arbitration module obtains the rear earphone connection state from the rear audio control module of the Windows system and determines whether the rear earphone is connected. If it is determined that the connection is connected, the audio arbitration module generates an earphone playing instruction and transmits it to the rear audio control module of the Windows system, and also controls the screen projection Android media application running in the Android system to flow the corresponding audio data to the cross-domain transmission module through the channel switching module, so that the cross-domain transmission module transmits the audio data to the rear audio control module of the Windows system, and the rear audio control module outputs the obtained audio data to the rear earphone through the earphone channel according to the earphone playing instruction, realizing the rear earphone playing the audio of the screen projection Android media application. For example, if it is determined that the connection is not connected, the audio arbitration module controls the screen projection Android media application to generate a corresponding audio focus application request and sends it to the channel control module, so that the channel control module switches the DSP audio channel to the media playing channel of the Windows system. At this time, the audio arbitration module generates a whole vehicle playing instruction and transmits it to the rear audio control module of the Windows system, and also controls the screen projection Android media application running in the Android system to flow the corresponding audio data to the cross-domain transmission module through the channel switching module, so that the cross-domain transmission module transmits the audio data to the rear audio control module of the Windows system, and the rear audio control module outputs the obtained audio data to the whole vehicle loudspeaker through the switched DSP audio channel according to the whole vehicle playing instruction, realizing the whole vehicle loudspeaker playing the audio of the screen projection Android media application.Figure 5 In state 1), the rear audio control module generates the vehicle playback information for the rear screen application and sends it to the audio arbitration module, so that the audio arbitration module sends an audio focus request (e.g., ...) to the channel control module for the rear screen application. Figure 5 (State 2). When the channel control module receives an audio focus request from the rear-seat screen application, if it determines that the audio from the main screen application is being played throughout the vehicle, it generates an audio channel switching instruction for the rear-seat screen application based on a preset audio playback priority strategy and sends it to the channel switching module. The channel switching module then switches the DSP audio channel to the media playback channel of the rear-seat screen virtual machine system, thereby interrupting the playback of the main screen application's audio from the vehicle speakers (e.g., ...). Figure 5 In state 3), and play the audio of the app on the back screen (such as...). Figure 5 State 4 in the middle.

[0099] In one possible embodiment, based on Figure 5 In state 4, if the rear-seat user selects headphone playback via the rear screen (e.g.) Figure 5 In state 5), the rear audio control module in the rear screen virtual machine system transmits headphone playback information across domains to the audio arbitration module in the main screen virtual machine system. The audio arbitration module generates an audio focus release request for the rear screen application (e.g., ...). Figure 6 In state 6), the command is sent to the channel control module, which then determines the audio channel switching instruction for the main screen application based on the audio focus release request and the preset audio playback priority strategy, and sends it to the channel switching module. The channel switching module switches the DSP audio channel to the media playback channel of the main screen virtual machine system, thereby stopping the playback of audio from the rear screen application by the vehicle speakers and restoring the main screen application audio that was interrupted in state 3 (e.g., ...). Figure 6 (State 7 in the text). This embodiment manages and controls audio playback in different locations by acquiring the audio playback mode in different locations in the cockpit, thereby meeting personalized and diverse audio playback scenarios and improving user experience.

[0100] In a possible embodiment, when the audio of the rear screen application is played in the whole vehicle, if the driver selects the audio of any one of the main screen applications for playing in the whole vehicle by operating the main screen, the main screen application running in the main screen virtual machine system will send a corresponding audio focus application request to the channel control module, the channel control module will determine that the audio focus application request of the main screen application will preempt the audio focus application request of the rear screen application according to a preset audio playing priority strategy, and thus generate an audio channel switching instruction of the main screen application and send the audio channel switching instruction to the channel switching module. The DSP audio channel is switched to the media playing channel of the main screen virtual machine system by the channel switching module, so as to stop the audio of the rear screen application played by the whole vehicle loudspeaker and play the audio of the main screen application.

[0101] Figure 7 The structure schematic diagram of the audio playing device of the audio system provided in the present application includes a main screen virtual machine system and a rear screen virtual machine system, the main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module and a cross-domain transmission module, and the rear screen virtual machine system includes a rear audio control module, as shown in Figure 7 The audio playing device 60 of the audio system provided in the present embodiment includes:

[0102] The obtaining module 601 is configured to obtain a user instruction, and when the user instruction indicates playing in the whole vehicle, obtain an audio focus application request of an application to be played through the channel control module, and generate an audio channel switching instruction based on the audio focus application request and send the audio channel switching instruction to the channel switching module.

[0103] The processing module 602 is configured to switch the audio channel of the whole vehicle to a media playing channel of the rear screen virtual machine system when the channel switching module receives an audio channel switching instruction corresponding to the rear screen application, output audio data of the rear screen application to the audio equipment of the whole vehicle through the media playing channel by the rear audio control module, and the rear screen application includes a screen projection application of the main screen virtual machine system on the rear screen and a system application of the rear screen virtual machine system.

[0104] The audio data of the screen projection application is routed to the cross-domain transmission module by the channel switching module and transmitted to the rear audio control module by the cross-domain transmission module, and the audio data of the system application is obtained based on the rear screen virtual machine system.

[0105] Optionally, the processing module 602 is further configured to, before obtaining the audio focus application request of the application to be played, if the application to be played is a rear screen application played in the whole vehicle, transmit the whole vehicle playing information of the rear screen application to the audio arbitration module across domains by the rear audio control module.

[0106] Based on the system application, the audio arbitration module generates an audio focus application request corresponding to the system application according to the whole vehicle playing information, and sends the audio focus application request to the channel control module.

[0107] Optionally, the processing module 602 is further configured to, after transmitting the whole vehicle playing information of the rear screen application to the audio arbitration module, based on the screen projection application, control the screen projection application to generate an audio focus application request corresponding to the screen projection application according to the whole vehicle playing information and send the audio focus application request to the channel control module;

[0108] The audio arbitration module controls the screen projection application to route the corresponding audio data to the channel switching module, so that the channel switching module routes the audio data to the cross-domain transmission module.

[0109] Optionally, the processing module 602 is further configured to, after outputting the audio data of the rear screen application to the whole vehicle audio device through the media playing channel, acquire, by the channel control module, an audio focus application request corresponding to the main screen application, generate an audio channel switching instruction corresponding to the main screen application and send the audio channel switching instruction to the channel switching module;

[0110] The channel switching module switches the whole vehicle audio channel to the media playing channel of the main screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main screen application is output to the whole vehicle audio device through the media playing channel, and the audio focus application request corresponding to the main screen application is sent to the channel control module by the main screen application.

[0111] Optionally, when the to-be-played application is a system application, the processing module 602 is further configured to determine, by the audio arbitration module, a connection state of the earphone audio device, the connection state being monitored in real time by the rear audio control module and transmitted to the audio arbitration module in a cross-domain manner;

[0112] When it is determined that the earphone audio device is connected, the audio arbitration module transmits an earphone playing instruction to the rear audio control module in a cross-domain manner, so that the rear audio control module outputs the audio data of the system application to the earphone audio device through the earphone channel.

[0113] Optionally, the system types of the main screen virtual machine system and the rear screen virtual machine system are different, and the processing module 602 is further configured to run the main screen virtual machine system and the rear screen virtual machine system in the same system-level chip.

[0114] The audio playing device of the audio system provided in the embodiment can execute the method provided in the method embodiment, and has similar implementation principles and technical effects, which will not be described here.

[0115] ​ The structure schematic diagram of the electronic device provided in the present application is shown in FIG. 1. ​As shown, the electronic device 70 provided by the embodiment includes at least one processor 701 and a memory 702. Optionally, the device 70 further includes a communication component 703. The processor 701, the memory 702 and the communication component 703 are connected through a bus 704.

[0116] In the implementation process, the at least one processor 701 executes the computer execution instructions stored in the memory 702, so that the at least one processor 701 executes the above-mentioned method.

[0117] The specific implementation process of the processor 701 can refer to the above-mentioned method embodiment, which has similar implementation principles and technical effects, and will not be described here in detail.

[0118] In the above-mentioned embodiments, it should be understood that the processor can be a central processing unit (English: Central Processing Unit, for short: CPU), and can also be other general-purpose processors, digital signal processors (English: Digital Signal Processor, for short: DSP), application specific integrated circuits (English: Application Specific Integrated Circuit, for short: ASIC) and the like. The general-purpose processor can be a microprocessor, or the processor can also be any conventional processor, etc. The steps of the method disclosed in combination with the application can be directly embodied as execution completed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

[0119] The memory can contain a random access memory (Random Access Memory, RAM), and can also include a non-volatile memory (Non-volatile Memory, NVM), for example, at least one disk memory.

[0120] The bus can be an industry standard architecture (Industry Standard Architecture, ISA) bus, a peripheral component (Peripheral Component, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, the bus in the drawings of the present application does not limit only one bus or one type of bus.

[0121] The present application also provides a computer program product, including a computer program, which is executed by a processor to implement the above-mentioned method.

[0122] The application further provides a computer readable storage medium, and the computer readable storage medium stores computer execution instructions.

[0123] The readable storage medium can be implemented by any type of volatile or nonvolatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0124] An exemplary readable storage medium is coupled to the processor, so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be an integral part of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the readable storage medium can also exist as discrete components in the device.

[0125] The division of units is only a logical function division, and in actual implementation, there can be another division mode, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0126] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or they can be distributed on multiple network units. According to actual needs, some or all of the units can be selected to achieve the purpose of the embodiment.

[0127] In addition, the functional units in each embodiment of the application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0128] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the parts of the technical solutions that essentially contribute to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the embodiments of the method of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0129] It can be understood by those skilled in the art that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction related hardware. The aforementioned program can be stored in a computer readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk, and various media that can store program codes.

[0130] Finally, it should be noted that: those skilled in the art will easily think of other embodiments of the present application after considering the specification and practicing the application disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application that follow the general principles of the present application and include common knowledge or conventional technical means in the art that are not disclosed in the present application, and is not limited to the precise structure described above and shown in the drawings, and various modifications and changes can be made without departing from the scope thereof. The scope of the present application is only limited by the appended claims.

Claims

1. An audio playback method for an audio system, characterized in that, The audio system includes a main screen virtual machine system and a rear screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module, and a cross-domain transmission module. The rear screen virtual machine system includes a rear audio control module. The method includes: When a user command is received and the whole vehicle is instructed to play, the audio focus request of the application to be played is obtained through the channel control module. Based on the audio focus request, an audio channel switching command is generated and sent to the channel switching module. When the channel switching module receives the audio channel switching instruction corresponding to the rear screen application, it switches the vehicle audio channel to the media playback channel of the rear screen virtual machine system; the rear audio control module outputs the audio data of the rear screen application to the vehicle audio device through the media playback channel; the rear screen application includes the projection application of the main screen virtual machine system on the rear screen and the system application of the rear screen virtual machine system; The audio data of the screen projection application is routed from the channel switching module to the cross-domain transmission module, and then transmitted across domains by the cross-domain transmission module to the rear audio control module. The audio data of the system application is obtained based on the rear screen virtual machine system.

2. The method according to claim 1, characterized in that, Before receiving the audio focus request from the application to be played, the process also includes: If the application to be played is a rear-seat screen application that is played throughout the vehicle, then the vehicle playback information of the rear-seat screen application is transmitted across domains to the audio arbitration module through the rear-seat audio control module. Based on the system application, the audio arbitration module generates an audio focus request corresponding to the system application according to the vehicle playback information, and sends it to the channel control module.

3. The method according to claim 2, characterized in that, After transmitting the vehicle playback information of the rear-seat screen application across domains to the audio arbitration module, the following is also included: Based on the screen mirroring application, the audio arbitration module controls the screen mirroring application to generate a corresponding audio focus request and send it to the channel control module according to the vehicle playback information. The audio arbitration module controls the screen mirroring application to route the corresponding audio data to the channel switching module, so that the channel switching module routes the audio data to the cross-domain transmission module.

4. The method according to any one of claims 1-3, characterized in that, Also includes: After the audio data of the rear screen application is output to the vehicle audio equipment through the media playback channel, the channel control module obtains the audio focus request corresponding to the main screen application, generates the audio channel switching instruction corresponding to the main screen application, and sends it to the channel switching module. The channel switching module switches the vehicle audio channel to the media playback channel of the main screen virtual machine system according to the audio channel switching instruction, so that the audio data of the main screen application is output to the vehicle audio device through the media playback channel. The audio focus request corresponding to the main screen application is sent by the main screen application to the channel control module.

5. The method according to claim 1, characterized in that, Also includes: When the application to be played is a system application, the connection status of the headphone audio device is determined by the audio arbitration module. The connection status is monitored in real time by the rear audio control module and transmitted across domains to the audio arbitration module. When the headphone audio device connection is confirmed, the audio arbitration module transmits the headphone playback command across domains to the rear audio control module, so that the rear audio control module outputs the audio data of the system application to the headphone audio device through the headphone channel.

6. The method according to claim 1, characterized in that, The main screen virtual machine system and the rear screen virtual machine system are of different system types, but they run on the same system-on-a-chip.

7. An audio playback device for an audio system, characterized in that, The audio system includes a main screen virtual machine system and a rear screen virtual machine system. The main screen virtual machine system includes an audio arbitration module, a channel control module, a channel switching module, and a cross-domain transmission module. The rear screen virtual machine system includes a rear audio control module. The device includes: The acquisition module is used to acquire user instructions. When the user instructions instruct the whole vehicle to play, the module acquires the audio focus request of the application to be played through the channel control module, generates an audio channel switching instruction based on the audio focus request, and sends it to the channel switching module. The processing module is used to switch the vehicle audio channel to the media playback channel of the rear screen virtual machine system when the channel switching module receives the audio channel switching instruction corresponding to the rear screen application; and to output the audio data of the rear screen application to the vehicle audio device through the media playback channel via the rear audio control module; the rear screen application includes the projection application of the main screen virtual machine system on the rear screen and the system application of the rear screen virtual machine system. The audio data of the screen projection application is routed from the channel switching module to the cross-domain transmission module, and then transmitted across domains by the cross-domain transmission module to the rear audio control module. The audio data of the system application is obtained based on the rear screen virtual machine system.

8. An electronic device, characterized in that, include: Memory, processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-6.

10. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method described in any one of claims 1-6.

Images