Audio control method and device and vehicle audio playing equipment

Abstract

The embodiment of the invention provides an audio control method and device and vehicle audio playing equipment. The audio control method comprises the following steps: respectively acquiring multi-channel audio data of first equipment; each path of audio data in the multiple paths of audio data corresponds to an audio application running in the first equipment; independently sending each path of audio data in the multiple paths of audio data to the second equipment; the second equipment is used for respectively controlling the playing effect of each path of audio data in the multiple paths of audio data.

Description

Technical Field

[0001] The present application relates to the field of audio control technology, and in particular to an audio control method, device and vehicle audio playback equipment. Background Art

[0002] With the rapid development of the automobile industry, the automobile industry is increasingly moving towards intelligence, electronization and digitization. People's lives are becoming more and more inseparable from cars. As a result, passengers' demand for entertainment in the rear area is increasing, especially for the ability to independently obtain audio data from the rear channels and control the volume of each audio channel through the front central control to meet the needs of different passengers. Summary of the invention

[0003] In view of this, the embodiments of the present application at least provide an audio control method, device and vehicle audio playback device.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides an audio control method, including: obtaining multiple channels of audio data from a first device respectively; each channel of audio data in the multiple channels of audio data corresponds to an audio application running in the first device; each channel of audio data in the multiple channels of audio data is sent separately to a second device; and the second device is used to control the playback effect of each channel of audio data in the multiple channels of audio data respectively.

[0006] In a second aspect, an embodiment of the present application provides an audio control method, comprising: receiving each channel of audio data among multiple channels of audio data sent by a first device; and controlling the playback effect of each channel of audio data respectively to play each channel of audio data.

[0007] In a third aspect, an embodiment of the present application provides an audio control device, comprising: an acquisition module, used to respectively acquire multiple channels of audio data of a first device; each channel of audio data in the multiple channels corresponds to an audio application running in the first device; a sending module, used to send each channel of audio data in the multiple channels of audio data separately to the second device; the second device is used to respectively control the playback effect of each channel of audio data in the multiple channels of audio data.

[0008] In a fourth aspect, an embodiment of the present application provides an audio control device, comprising: a receiving module for receiving each channel of audio data among multiple channels of audio data sent by a first device; and a playing module for controlling the playing effect of each channel of audio data respectively to play each channel of audio data.

[0009] In a fifth aspect, an embodiment of the present application provides a vehicle audio playback device, comprising: a mobile device and a central control screen device; wherein the mobile device is used to respectively obtain multiple channels of audio data of the mobile device; each channel of audio data in the multiple channels of audio data corresponds to an audio application running in the mobile device; each channel of audio data in the multiple channels of audio data is sent separately to the central control screen device; the central control screen device is used to receive each channel of audio data in the multiple channels of audio data sent by the mobile device; and the playback effect of each channel of audio data is controlled separately to play each channel of audio data

[0010] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0012] Figure 1 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0013] Figure 2 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0014] Figure 3 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0015] Figure 4 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0016] Figure 5 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0017] Figure 6 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0018] Figure 7 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0019] Figure 8 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application;

[0020] Fig. 9 A schematic diagram of an implementation of an audio control method provided in an embodiment of the present application;

[0021] Fig.10A schematic diagram of an implementation of audio capture provided in an embodiment of the present application;

[0022] Fig.11 A schematic diagram of the structure of an audio control device provided in an embodiment of the present application;

[0023] Fig.12 A schematic diagram of the structure of an audio control device provided in an embodiment of the present application

[0024] Fig.13 A hardware entity schematic diagram of a vehicle audio playback device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application are further elaborated in detail below in conjunction with the drawings and embodiments. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0026] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict. The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific order for the objects. It is understood that "first / second / third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0027] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing this application and are not intended to limit this application.

[0028] With the rapid development of the automobile industry, the automobile industry is increasingly moving towards intelligence, electronics and digitalization. People's lives are becoming more and more inseparable from cars. As a result, passengers' demand for entertainment in the rear area is increasing, especially the demand for control of rear audio data.

[0029] Based on this, in the first related technology, the central control device and the rear-seat tablet computer are integrated devices, that is, one system with multiple screens. The central control device can flexibly control the rear-seat tablet computer, but due to the limitations of chip capabilities and multiple screens, the central control device and the rear-seat tablet computer cannot support more diverse entertainment needs. In the second related technology, the central control device and the rear-seat tablet computer are independent devices, and the rear-seat tablet computer can be used independently without the central control device, but the central control device can only obtain the mixed audio data of the rear-seat tablet computer, which can no longer meet more diverse entertainment needs.

[0030] Regarding the technical problems existing in the related technology, in an embodiment of the present application, the first device and the second device are independent devices. When the first device plays audio data through the second device, multiple audio data of multiple audio applications on the first device are obtained respectively, and each audio data is sent to the second device separately. The second device can independently control the playback effect of each audio data to meet the user's entertainment needs and improve the user experience.

[0031] Figure 1 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application, such as Figure 1 As shown, the method includes the following steps S101 and S102, combining Figure 1 The steps shown are explained.

[0032] Step S101: Acquire multiple channels of audio data of a first device respectively.

[0033] Each channel of audio data in the multiple channels of audio data corresponds to an audio application running in the first device.

[0034] In some embodiments, the first device can be a server, a laptop, a tablet computer, a desktop computer, a smart TV, a set-top box, a mobile device (such as a mobile phone, a portable video player, a personal digital assistant, a dedicated messaging device, a portable gaming device), or the like, which has audio playback and data processing capabilities.

[0035] In some embodiments, multi-channel audio data refers to audio data from multiple sound sources; in an embodiment of the present application, multi-channel audio refers to multiple audio data from multiple audio applications; exemplarily, multi-channel audio data can be audio data from a music application running on a tablet computer, audio data from a video application, audio data from a telephone application, etc.

[0036] In some embodiments, multi-channel audio data of the first device are obtained respectively; it can be understood that the audio data of each audio application running in the first device is obtained respectively, including: registering multiple recording policies on the first device; in the case that a target audio application running in the first device exists in the multiple recording policies on the first device, the audio policy of the target audio application is obtained.

[0037] Exemplarily, the first device takes a tablet computer as an example to illustrate the embodiment of the present application. Obtain the system signature of the tablet computer manufacturer, and set the permissions of the tablet computer as system permissions based on the system signature of the tablet computer; and register multiple recording policies on the tablet computer, such as music application recording policy, video application audio data, phone application audio data, etc.; when there is a recording policy corresponding to the running target audio application among the multiple recording policies of the tablet computer, obtain the audio data of the target audio application.

[0038] In an embodiment of the present application, obtaining an audio policy of a target audio application includes: before at least one audio application plays audio, that is, in response to a playback request of at least one audio application running on a first device, comparing a plurality of registered recording policies with identification information of each audio application, and in a case where identification information of the target audio application exists in the plurality of recording policies, creating a virtual input device and a virtual playback device of the target audio application, copying an audio track of the target audio application as an audio track of the virtual playback device, and recording the audio track of the virtual playback device through the virtual input device to obtain audio data of the target audio application; wherein, in a case where the target audio application is a plurality of audio applications, creating a virtual input device and a virtual playback device for each target audio application, copying an audio track of each target audio application as an audio track of the virtual playback device of each target audio application, and recording the audio track of the virtual playback device of each target audio application through the virtual input device of each target audio application to obtain audio data of each target audio application.

[0039] Exemplarily, in response to a user's audio playback request for an audio application such as a music application, a video application, or a telephone application that is running on a tablet computer, multiple registered recording strategies are compared with the application identifiers of the running music application, video application, telephone application, etc. If there is a recording strategy corresponding to the music application, video application, telephone application, etc. in the multiple recording strategies, a virtual input device and a virtual playback device are created for the music application, the audio track of the music application is copied as the audio track of the virtual playback device of the music application, and the audio track of the virtual playback device of the music application is recorded through the virtual input device of the music application to obtain audio data of the music application; a virtual input device and a virtual playback device are created for the video application, the audio track of the video application is copied as the audio track of the virtual playback device of the audio and video application, and the audio track of the virtual playback device of the video application is recorded through the virtual input device of the video application to obtain audio data of the video application; a virtual input device and a virtual playback device are created for the telephone application, the audio track of the telephone application is copied as the audio track of the virtual playback device of the telephone application, and the audio track of the virtual playback device of the telephone application is recorded through the virtual input device of the telephone application to obtain audio data of the telephone application.

[0040] Step S102: Send each channel of the multiple channels of audio data to the second device separately.

[0041] The second device is used to control the playback effect of each channel of the multiple channels of audio data respectively.

[0042] In an embodiment of the present application, the second device is a central control device of the vehicle; wherein the central control device can be a server, a laptop computer, a tablet computer, a desktop computer, a smart TV, a set-top box, a mobile device (such as a mobile phone, a portable video player, a personal digital assistant, a dedicated messaging device, a portable gaming device), and other devices with audio playback and data processing capabilities.

[0043] In some embodiments, the multi-channel audio data representation can process each channel of audio data separately. Exemplarily, the multi-channel audio data includes audio data of a music application, audio data of a video application, and audio data of a telephone application, and the audio data of the music application, the audio data of the video application, and the audio data of the telephone application can be encoded, optimized, compressed, etc. separately.

[0044] In an embodiment of the present application, the first device may encode multiple channels of audio data separately to send each channel of audio data to the second device separately.

[0045] Exemplarily, the tablet computer can encode the acquired audio data of the music application, the audio data of the video application, the audio data of the telephone application, etc., respectively, so as to send the audio data of the music application, the audio data of the video application, and the audio data of the telephone application to the central control device separately.

[0046] In some embodiments, the playback effect of each channel of audio data may be the playback status, volume, playback position, etc. of each channel of audio data; wherein the playback status includes pause playback and start playback, and the playback position may include playback in the front row of the vehicle, playback in the back row, playback in the entire vehicle, etc.

[0047] In some embodiments, after receiving multiple channels of audio data transmitted separately by the first device, the second device generates a playback strategy based on the audio identifier corresponding to each channel of audio data and the playback rules of the second device, and controls the playback effect of each channel of audio data based on the playback strategy; wherein the playback rules of the second device represent the playback priority of each channel of audio data when multiple channels of audio data exist at the same time; for example, the multiple channels of audio data include audio data of a music application, audio data of a video application, and audio data of a telephone application. If the central control device is playing audio data of a music application and audio data of a video application, and audio data of a telephone application is accessed, the playback of the audio data of the music application and the audio data of the video application is paused, and the audio data of the telephone application is played.

[0048] Exemplarily, when the central control device receives audio data of a music application, audio data of a video application, and audio data of a telephone application respectively transmitted by the first device, it generates a playback strategy based on the music application identifier, the video application identifier, the telephone application identifier, and the playback rules of the central control device to control the pause of the audio data of the music application and the audio data of the video application, and the continuation of the playback of the audio data of the telephone application.

[0049] In an embodiment of the present application, when at least one audio application running on the first device plays audio through the central control device, audio data of each audio application running on the first device is obtained respectively, and each channel of audio data is transmitted to the central control device. The central control device independently controls the playback status, playback volume, position, etc. of each audio data based on the identifier of each audio data and the system rules of the central control device, so that when the audio application running on the first device is played through the central control device, the playback effect of the audio data corresponding to each audio application is controlled by the central control device, thereby improving the user experience.

[0050] Figure 2 A schematic diagram of the implementation flow of an audio control method provided in an embodiment of the present application. Figure 1 , Figure 1Step S101 in the above example can be updated to step S201 and step S202, which will be combined with Figure 2 The steps shown are explained.

[0051] Step S201: Obtain a target audio application from multiple audio applications in the first device.

[0052] The target audio application is executed in response to the audio control policy of the second device.

[0053] In some embodiments, a target audio application is obtained from audio applications of the first device according to multiple recording policies registered on the first device; it can be understood that an audio application in the recording policy among multiple audio applications running on the first device is determined as the target audio application.

[0054] Exemplarily, the multiple recording policies registered on the tablet computer are music recording policy, phone recording policy, and video recording policy; the multiple audio applications running on the tablet computer are music applications and phone applications, then the music application and phone application that have music recording policy and phone recording policy are determined as target audio applications.

[0055] In some embodiments, the playback state of the target audio application is controlled based on the audio control policy sent by the second device; illustratively, if the audio control policy is to pause the music application and play the phone application, the music application in the tablet computer is controlled to pause and play the phone application.

[0056] Step S202: Acquire audio data of the target audio application.

[0057] In some embodiments, the target audio application may be one or more audio applications, and the audio data of the target audio application may be one or more audio data.

[0058] In some embodiments, obtaining the audio data of the target audio application includes: creating a virtual input device and a virtual playback device for the target audio application, copying the audio track of the target audio application as the audio track of the virtual playback device of the target audio application, and recording the audio track of the virtual playback device of the target audio application through the virtual input device of the target audio application to obtain the audio data of the target audio application.

[0059] Exemplarily, if the target audio application is a telephone application, obtaining the audio data of the telephone application includes: creating a virtual input device and a virtual playback device for the telephone application, copying the audio track of the telephone application as the audio track of the virtual playback device of the telephone application, and recording the audio track of the virtual playback device of the target telephone application through the virtual input device of the telephone application to obtain the audio data of the telephone application.

[0060] In an embodiment of the present application, the recording policy registered on the first device is matched with the audio application running on the first device to obtain a target audio application with a recording policy, so as to obtain audio data of the target application, and the playback state of the target audio application is controlled based on the audio control policy generated by the second device to improve the accuracy of control over the target audio application on the first device, thereby improving the user experience.

[0061] Figure 3 A schematic diagram of the implementation flow of an audio control method provided in an embodiment of the present application. Figure 2 , Figure 2 S202 in can be updated to step S301 to step S303, combining Figure 3 The steps shown are explained.

[0062] Step S301: Create a virtual playback device and a virtual input device corresponding to the target audio application.

[0063] In some embodiments, the virtual input device is a software component or driver that simulates an audio capture function, which can simulate the effect of an audio input device in an audio application, capture audio data from a specified source (such as a file, network, other virtual devices, etc.), and provide it to the audio application for processing.

[0064] In some embodiments, the virtual playback device is a software component or driver that simulates audio playback functions. It can simulate the effect of an audio output device in an audio application and send audio data to a specified destination (such as a file, network, other virtual devices, etc.) instead of playing it through physical speakers.

[0065] In an embodiment of the present application, a virtual input device and a virtual playback device of a target audio application are created to achieve the effect of simulating the input device of the target audio application, and to capture the audio data of the target audio application as output audio data of the virtual playback device.

[0066] Exemplarily, a virtual playback device of a phone application is created as an analog output device of the phone application, and a virtual input device of the phone application is created to achieve the effect of simulating the phone application input device to capture audio data output by the virtual playback device as the analog output device of the phone application.

[0067] Step S302: copy the audio track of the target audio application and use it as the audio track of the virtual playback device.

[0068] In some embodiments, the audio track of the target audio application is a parallel track in the audio application for storing and editing audio data.

[0069] In the embodiment of the present application, copying the audio track of the target audio application means copying the parallel track for storing audio data in the target audio application, and using the parallel track for storing audio data as the audio track of the virtual playback device.

[0070] Illustratively, a parallel track used by the phone application to store audio data is replicated as an analog output device of the phone application.

[0071] Step S303: Use the virtual input device to record the audio track of the virtual playback device to obtain audio data corresponding to the target audio application.

[0072] In some embodiments, the virtual input device is used to record a parallel track of a virtual playback device for storing audio data to obtain audio data of a target audio application.

[0073] Exemplarily, the virtual input device of the telephone application is used to record the parallel track for storing audio data of the analog output device of the telephone application to obtain the audio data of the telephone application.

[0074] In an embodiment of the present application, a virtual playback device and a virtual input device of the target audio application are created, and the audio track of the target audio application is copied as the audio track of the virtual playback device, so that the audio track for storing audio data of the virtual playback device of the target audio application can be recorded through the virtual input device. In the case where there are multiple target audio applications, it is possible to independently obtain the audio data of each target audio.

[0075] Figure 4 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application. The method comprises steps S401 to S403, which are combined with Figure 4 The steps shown are explained.

[0076] Step S401: In response to a playback status control request, an application identifier of at least one audio application to be controlled is sent to the second device.

[0077] In some embodiments, when a user plays audio data of an audio application of a first device through a second device, in response to the user controlling the playback status of the audio data of the audio application through the second device, an audio identifier of the audio application to be controlled is sent to the second device, and the second device generates an audio control policy for the audio application to be controlled based on the audio identifier of the audio application to be controlled and the system rules of the second device.

[0078] Exemplarily, when a user plays audio data of a tablet computer's music application and telephone application through a central control device, in response to the user controlling the playback status of the audio data of the music application and telephone application through the central control device, identification information of the music application and telephone application to be controlled is sent to the central control device, and the central control device generates an audio control strategy for pausing the music application and playing the audio data of the telephone application based on the identification information of the music application and telephone application and the system rules of the central control device.

[0079] Step S402: Receive the audio control policy sent by the second device.

[0080] The audio control policy is determined by the second device based on the application identifier of the at least one audio application to be controlled and the system rules of the second device.

[0081] In some embodiments, the first device receives an audio control policy for the audio application to be controlled sent by the second device, so as to control the playback state of the audio application to be controlled on the first device.

[0082] Step S403: Control the playing state of the audio application to be controlled based on the audio control strategy.

[0083] In some embodiments, the playing state of the audio application to be controlled includes pausing the playing of the audio application to be controlled, starting the playing of the audio application to be controlled, switching the playing of audio data of the audio application to be controlled, etc.

[0084] In some embodiments, based on the audio control policy, the playback of the audio application to be controlled is paused, the playback of the audio application to be controlled is started, the audio data of the audio application to be controlled is switched, etc.

[0085] In an embodiment of the present application, in response to controlling the playback status of an audio application through a second device, the first device sends an identifier of the audio application to be controlled to the second device, and the first device controls the playback status of the audio application based on an audio control policy generated by the second device according to the identifier of the audio application to be controlled and the system rules of the second device, so as to achieve control of the playback status of the audio application of the first device based on the second device, thereby improving the user experience.

[0086] Figure 5 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application. The process includes step S501 and step S502. Figure 5 The steps shown are explained.

[0087] Step S501: Receive each channel of audio data among multiple channels of audio data sent by a first device.

[0088] In some embodiments, when a user plays audio data of an audio application of a first device through a second device, the first device respectively obtains audio data of multiple audio applications running on the first device, and the second device receives multiple audio data multiplexed by the first device.

[0089] Exemplarily, when a user plays the audio data of a tablet computer's music application and a telephone application through a central control device, in response to the user controlling the playback status of the audio data of the music application and the telephone application through the central control device, the audio data of the music application and the telephone application to be controlled are sent to the central control device via multiplexing.

[0090] Step S502: Control the playing effect of each channel of audio data respectively to play each channel of audio data.

[0091] In some embodiments, the playback effect of each channel of audio data includes the playback volume, playback position, etc. of each channel of audio data.

[0092] In some embodiments, based on the user's playback requirements for each audio application, the playback volume, playback position, etc. of each channel of audio data are controlled on the second device.

[0093] Exemplarily, the audio application includes a music application and a telephone application. The user controls the audio data of the music application to be played in the rear seat of the vehicle based on the second device, and controls the telephone application to be played in the main driver's seat of the vehicle.

[0094] In an embodiment of the present application, the second device receives multiple channels of audio data respectively obtained by the first device, and the user can control the playback effect of each channel of audio data through the second device, thereby improving the user experience.

[0095] Figure 6 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application. The process includes steps S601 to S603. Figure 6 The steps shown are explained.

[0096] Step S601: Receive an application identifier of at least one audio application to be controlled sent by the first device.

[0097] In some embodiments, in response to a user controlling the playback status of at least one audio application to be controlled through a second device or playing at least one audio application to be controlled based on a system rule of the second device, an application identifier of at least one audio application to be controlled sent by the first device is received.

[0098] Exemplarily, when audio data of at least one audio application running on the tablet computer is played through the central control device, in response to controlling the playing state of the at least one audio application through the central control device, the tablet computer sends an application identifier corresponding to the at least one audio application to the central control device.

[0099] Step S602: Generate an audio control policy based on the at least one application identifier to be controlled and the system rule of the second device.

[0100] In some embodiments, in response to a user controlling the playback status of at least one audio application to be controlled through a second device or playing at least one audio application to be controlled based on the system rules of the second device, an audio control policy for at least one audio application to be controlled is generated based on the application identifier of at least one audio application to be controlled sent by the first device and the system rules of the second device.

[0101] Step S603: Send the audio control policy to the first device.

[0102] The audio control strategy is used to control the playing state of the audio application to be controlled in the first device.

[0103] In some embodiments, the second device generates an audio control policy for at least one audio application to be controlled based on the application identifier of at least one audio application to be controlled and the system rules of the second device, and sends it to the first device to control the playback status of each audio application to be controlled.

[0104] In an embodiment of the present application, when the playback status of at least one audio application is controlled by a central control device, an audio control policy for at least one audio application to be controlled is generated based on the application identifier of the at least one audio application and the system rules of the central control device, and sent to the tablet computer to achieve control of the playback status of the audio application of the tablet computer by the central control device.

[0105] Figure 7 A schematic diagram of the implementation flow of an audio control method provided in an embodiment of the present application. Figure 5 , Figure 5 Step 502 in the above example can be updated to step S701, step S702 or step S703. Figure 7 The steps shown are explained.

[0106] The playback effect includes at least one of the following: playback volume and playback position.

[0107] Step S701: Control the playback volume of each channel of audio data based on the application identifier of each audio application; and play each channel of audio data based on the playback volume of each channel of audio data.

[0108] In some embodiments, when audio data of at least one audio application running on a first device is played through a second device, the second device controls the playback volume of each audio application on the vehicle based on identification information of each audio application, so as to play the audio data of each audio application through the second device based on the playback volume of each audio application.

[0109] Exemplarily, when a telephone application or a music application running on a tablet computer is played through the central control device, the second device controls the volume of the telephone application to a high volume and the volume of the music application to a low volume based on the identification information of the telephone application and the music application, so as to play the audio data of the telephone application through the central control device based on the high volume and play the audio data of the music application through the central control device based on the low volume.

[0110] Step S702: Based on the application identifier of each of the audio applications, control the playback position of each of the audio data; and play each of the audio data based on the playback position of each of the audio data.

[0111] When audio data of at least one audio application running on the first device is played through the second device, the second device controls the playback position of each audio application on the vehicle based on the identification information of each audio application, so as to play the audio data of each audio application through the second device based on the playback position of each audio application.

[0112] Exemplarily, when playing a phone application or a music application running on a tablet computer through the central control device, the second device controls the playback position of the phone application to be in the main driver's seat, and controls the playback position of the music application to be in the rear seat of the vehicle based on the identification information of the phone application and the music application, so as to play the audio data of the phone application through the central control device in the main driver's seat, and play the audio data of the music application through the central control device in the rear seat of the vehicle.

[0113] Step S703: Control the playback volume and playback position of each channel of audio data based on the application identifier of each audio application; and play each channel of audio data based on the playback volume and playback position of each channel of audio data.

[0114] In some embodiments, when audio data of at least one audio application running on the first device is played through the second device, the second device controls the playback position and playback volume of each audio application on the vehicle based on identification information of each audio application, so as to play the audio data of each audio application through the second device based on the playback position and playback volume of each audio application.

[0115] Exemplarily, when playing a phone application or a music application running on a tablet computer through the central control device, the second device controls the volume of the phone application to a high volume and the playback position to the main driver's seat, and controls the volume of the music application to a low volume and the playback position to the rear seat of the vehicle based on the identification information of the phone application and the music application, so that the audio data of the phone application is played through the central control device at the main driver's seat based on the high volume, and the audio data of the music application is played through the central control device at the rear seat of the vehicle based on the low volume.

[0116] In an embodiment of the present application, when audio data of at least one audio application running on a first device is played through a second device, the second device controls the playback position and playback volume of each audio application on the vehicle based on the identification information of each audio application, so as to achieve playback of the audio data of each audio application through the second device based on the playback position and playback volume of each audio application.

[0117] With the rapid development of the automobile industry, the automobile industry is increasingly moving towards intelligence, electronization and digitization. People's lives are becoming more and more inseparable from cars. As a result, passengers' demand for entertainment in the rear area is increasing, especially for the ability to independently obtain audio data from the rear channels and control the volume of each audio channel through the front central control to meet the needs of different passengers.

[0118] Related technical solution 1: The central control device and the rear-seat tablet computer are integrated devices, that is, one system with multiple screens, and the central control device can flexibly control the rear-seat tablet computer.

[0119] Related technical solution two: The central control device and the rear-seat tablet computer are independent devices, and the rear-seat tablet computer can be used independently from the central control device.

[0120] Regarding the above-mentioned related technical solution 1, although the central control device can flexibly control the rear tablet, it is limited by the chip capabilities and the multi-screen situation, and the central control device and the rear row cannot support more diverse entertainment needs.

[0121] Regarding the above-mentioned related technical solution 2: the central control device can only obtain the mixed audio data of the rear-seat tablet computer, which can no longer meet more diverse entertainment needs.

[0122] In response to the technical problems in the relevant technical solutions, this solution proposes an audio control method, in which the central control device can independently obtain the audio data of each channel of the rear-seat device and independently control the volume of each audio channel for playback, including: when the central control device and the rear-seat tablet computer are independent devices, the rear-seat tablet computer sometimes needs to play the audio of the application through the entire vehicle, and sometimes through the tablet computer or Bluetooth headphones. However, it is hoped that the rear-seat tablet computer will comply with the tablet system rules when playing, and comply with the central control device rules when playing through the entire vehicle. In addition, the central control device can also independently control the audio volume and playback logic transmitted by each APP during audio playback. Among them, the tablet system rules are also called audio strategies, which are provided by the tablet manufacturer. The tablet computer plays audio from multiple apps at the same time, and the playback order of multiple app audios. For example, when the tablet is playing music and a call suddenly comes in, the music is paused and the voice on the phone is kept.

[0123] In an embodiment of the present application, the central control device of the vehicle and the tablet computer in the back row can be connected via a local area network, with the central control device acting as a server and the tablet computer acting as a client.

[0124] Figure 8 A schematic diagram of an implementation flow of an audio control method provided in an embodiment of the present application; applied to a client. The method includes steps S801 to S803, combining Figure 8 The steps shown are explained.

[0125] Step S801: In response to an audio playback request, obtain audio data corresponding to a target audio application in at least one audio application.

[0126] In an embodiment of the present application, in response to a user's audio playback request for at least one audio application through a tablet computer, audio data corresponding to a target audio in at least one audio application is obtained respectively; this can be achieved by the following steps: setting the permissions of the tablet computer to system permissions, and based on the system permissions, before playing the audio data corresponding to each audio application in at least one audio application, comparing the audio type of each audio application with multiple preset audio strategies, and in the case where a recording strategy corresponding to the target audio application exists in the multiple audio strategies, creating a virtual playback device and a virtual input device corresponding to the target audio application; copying the audio track of the target audio application and using it as the audio track of the virtual playback device; using the virtual input device to record the audio track of the virtual playback device to obtain the audio data corresponding to the target audio application. Among them, multiple recording strategies are recording strategies for different types of audio; they can also be recording strategies for different audio applications.

[0127] Step S802: Send the audio identifier corresponding to the audio data of the target audio application to the server.

[0128] In an embodiment of the present application, the target audio application includes at least one audio application, and the audio data corresponding to the target audio application includes at least one audio data.

[0129] In an embodiment of the present application, in response to a user controlling the playback status of at least one audio application through a server or controlling the playback status of at least one audio application based on a system rule of the server, an application identifier of at least one audio application sent by a client is received.

[0130] In an embodiment of the present application, the server generates an audio control policy for the at least one audio application based on the server rules and the audio identifier corresponding to the at least one audio data, and sends the audio control policy to the client.

[0131] Step S803, receiving the audio control strategy sent by the server, and controlling the playback status of each audio application based on the audio control strategy.

[0132] The audio control strategy is generated by the server based on server rules and an audio identifier corresponding to at least one audio data.

[0133] In some embodiments, the client encodes and compresses the audio data corresponding to the audio application to be played based on the audio control strategy, and sends the audio data to the server respectively.

[0134] In the embodiment of the present application, the server controls the playback position and playback volume of the audio data of each audio application in the vehicle based on the application identifier of each audio application, including determining the volume of the audio information corresponding to each audio application and the playback position of the audio corresponding to each audio application; controlling the audio to be played through the rear speakers, front speakers, and the entire vehicle speakers, etc.

[0135] Fig. 9 This is a schematic diagram of an implementation of an audio control method provided in an embodiment of the present application; it is applied to a scenario where audio data of an audio application running on a tablet computer is played through a central control device. Fig. 9 , 901 is a tablet computer, 902 is a client application installed on the tablet computer 901, 903 is an audio application installed on the tablet computer 901, 904 is an audio focus on the tablet computer 901, 905 is an audio playback on the tablet computer 901, 906 is an audio capture on the tablet computer 901, 907 is a central control device, 908 is a server application installed on the central control device 907, 909 is an audio playback on the central control device 907, 910 is an audio focus on the central control device 907, and 911 is an audio focus request on the central control device 907.

[0136] Among them, in response to the play request for the audio application 901, the audio focus 904 determines at least one audio application to be played based on the system rules of the tablet computer, and sends the application identifier of the at least one audio application to be played to the server application 908 on the central control device 907 through the client application 902. The server application 908 generates an audio control policy for the at least one audio application to be played based on the application identifier of the at least one audio application to be played and the system rules of the server application 908, and sends the audio control policy to the client application 901. The client application 901 sends the audio control policy to the audio player 905 through the audio capture 906, and records the audio tracks of the target audio applications in the audio control policy on the tablet computer respectively to obtain the audio data of the target audio application, and optimizes the audio effect of the audio data of the target audio application. After the optimized audio data is encoded through the audio capture 906, it is sent to the server application 908 through the client application 901, and the encoded audio data of the target audio application is played through the audio player 909 on the central control device 907.

[0137] In other embodiments, in response to the user controlling the playback status of the audio data of the target audio application through the audio focus request 911 on the central control device 907, a new audio control strategy is generated and sent to the client application 901, and the above process is repeated to achieve control of the playback status of the audio application on the tablet computer 901 through the central control device 907.

[0138] Fig.10 A schematic diagram of an implementation of audio capture provided in an embodiment of the present application, 1001 is an audio application on a tablet computer, 1002 is a plurality of recording strategies registered on the audio application 1001, 1003 is an audio track of the audio application 1002, 1004 is a client application on a tablet computer, 1005 is a virtual input device of the audio application 1001 created by the client application 1004, 1006 is a virtual playback device of the audio application 1001 created by the client application 1004; wherein, when the audio data of the audio application 1002 running on the tablet computer is played through the central control device, When there is an audio policy for an audio application to be played among multiple recording strategies 1002, the audio track 1003 of the audio application to be played is obtained as the audio track of the virtual playback device 1006, and the audio data on the audio track of the virtual playback device 1006 is remotely mixed, the remotely mixed audio track of the virtual playback device 1006 is recorded through the virtual input device 1006, and the recorded audio data is encoded and sent to the client application 1004, so that the audio data of the audio application to be played can be sent to the central control device for control through the client application 1004.

[0139] Based on the foregoing embodiments, an embodiment of the present application provides an audio control device, which includes the units included and the modules included in the units, which can be implemented by a processor in a vehicle audio playback device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0140] Fig.11 A schematic diagram of the structure of an audio control device provided in an embodiment of the present application is shown in FIG. Fig.11 As shown, the audio control device 1100 includes: an acquisition module 1101 and a sending module 1102, wherein the acquisition module 1101 is used to respectively acquire multiple channels of audio data from a first device; each channel of the multiple channels of audio data corresponds to an audio application running in the first device; the sending module 1102 is used to separately send each channel of the multiple channels of audio data to a second device; and the second device is used to respectively control the playback effect of each channel of the multiple channels of audio data.

[0141] In some embodiments, the acquisition module 1101 is further used to acquire a target audio application from multiple audio applications in the first device; the target audio application is run in response to the audio control policy of the second device; and acquire audio data of the target audio application.

[0142] In some embodiments, the acquisition module 1101 is also used to create a virtual playback device and a virtual input device corresponding to the target audio application; copy the audio track of the target audio application and use it as the audio track of the virtual playback device; use the virtual input device to record the audio track of the virtual playback device to obtain audio data corresponding to the target audio application.

[0143] In some embodiments, the sending module 1102 is also used to send an application identifier of at least one audio application to be controlled to the second device in response to a playback status control request; receive an audio control policy sent by the second device; the audio control policy is determined by the second device based on the application identifier of the at least one audio application to be controlled and the system rules of the second device; and control the playback status of the audio application to be controlled based on the audio control policy.

[0144] Fig.12A schematic diagram of the structure of an audio control device provided in an embodiment of the present application is shown in FIG. Fig.12 As shown, the audio control device 1200 includes: a receiving module 1201 and a control module 1202; wherein the receiving module 1201 is used to receive each channel of audio data among multiple channels of audio data sent by the first device; and the control module 1202 is used to control the playback effect of each channel of audio data respectively to play each channel of audio data.

[0145] In some embodiments, the receiving module 1201 is further configured to receive an application identifier of at least one audio application to be controlled sent by the first device;

[0146] An audio control policy is generated based on the at least one application identifier to be controlled and the system rules of the second device; the audio control policy is sent to the first device; and the audio control policy is used to control the playback state of the audio application to be controlled in the first device.

[0147] In some embodiments, the playback effect includes at least one of the following: playback volume, playback position; the control module 1202 is also used to control the playback volume of each channel of audio data based on the application identifier of each audio application; play each channel of audio data based on the playback volume of each channel of audio data; control the playback position of each channel of audio data based on the application identifier of each audio application; play each channel of audio data based on the playback position of each channel of audio data; control the playback volume and playback position of each channel of audio data based on the application identifier of each audio application; play each channel of audio data based on the playback volume and playback position of each channel of audio data.

[0148] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided in the embodiment of the present application can be used to execute the method described in the above method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0149] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The software product is stored in a storage medium, including several instructions to enable a vehicle audio playback device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software, and firmware.

[0150] An embodiment of the present application provides a vehicle audio playback device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0151] The embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium can be transient or non-transient.

[0152] An embodiment of the present application provides a computer program, including a computer-readable code. When the computer-readable code is executed in a vehicle audio playback device, a processor in the vehicle audio playback device executes some or all of the steps in the above method.

[0153] The embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented specifically by hardware, software or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK) and the like.

[0154] It should be noted here that the description of the various embodiments above tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. The description of the above device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the embodiments of the device, storage medium, computer program and computer program product of this application, please refer to the description of the method embodiment of this application for understanding.

[0155] Fig.13 A hardware entity diagram of a vehicle audio playback device provided in an embodiment of the present application, such as Fig.13 As shown, the hardware entity of the vehicle audio playback device 1300 includes: a mobile device 1301 and a central control screen device 1302; wherein the mobile device 1301 is used to respectively obtain multiple channels of audio data of the mobile device; each channel of the multiple channels of audio data corresponds to an audio application running in the mobile device; and each channel of the multiple channels of audio data is sent separately to the central control screen device.

[0156] The central control screen device 1302 is used to receive each channel of audio data among the multiple channels of audio data sent by the mobile device; and control the playback effect of each channel of audio data respectively to play each channel of audio data.

[0157] An embodiment of the present application provides a computer storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the method of any of the above embodiments.

[0158] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0159] The processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that the electronic device that implements the functions of the processor may also be other, and the embodiments of the present application are not specifically limited.

[0160] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM) and the like; it can also be various terminals including one or any combination of the above-mentioned memories, such as a mobile phone, a computer, a tablet computer, a personal digital assistant, etc.

[0161] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial number of each step / process mentioned above does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0162] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0163] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0164] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0165] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units. A person of ordinary skill in the art can understand that all or part of the steps of the above method embodiments can be completed by hardware related to program instructions, and the above program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above method embodiments are executed; and the above storage medium includes: mobile storage devices, read-only memory (ROM), disks or optical disks, etc. Various media that can store program codes.

[0166] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions for enabling a vehicle audio playback device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0167] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. An audio control method, the method comprising: Respectively obtain multi-channel audio data of the first device; Each channel of audio data in the multiple channels of audio data corresponds to an audio application running in the first device; Each channel of audio data in the multiple channels of audio data is sent separately to a second device; and the second device is used to control the playback effect of each channel of audio data in the multiple channels of audio data separately.

2. The method according to claim 1, wherein the step of respectively acquiring the multi-channel audio data of the first device comprises: Acquire a target audio application from a plurality of audio applications in the first device; The target audio application is executed in response to the audio control policy of the second device; Acquire audio data of the target audio application.

3. The method according to claim 2, wherein obtaining the audio data of the target audio application comprises: Creating a virtual playback device and a virtual input device corresponding to the target audio application; Copying the audio track of the target audio application and using it as the audio track of the virtual playback device; The audio track of the virtual playback device is recorded using the virtual input device to obtain audio data corresponding to the target audio application.

4. The method according to claim 1 or 2, further comprising: In response to the playback state control request, sending an application identifier of at least one audio application to be controlled to the second device; receiving the audio control policy sent by the second device; The audio control policy is determined by the second device based on the application identifier of the at least one audio application to be controlled and a system rule of the second device; The playing state of the audio application to be controlled is controlled based on the audio control policy.

5. An audio control method, the method comprising: receiving each channel of audio data among the multiple channels of audio data sent by the first device; The playing effect of each channel of audio data is controlled respectively to play each channel of audio data.

6. The method according to claim 5, further comprising: receiving an application identifier of at least one audio application to be controlled sent by the first device; generating an audio control policy based on the at least one application identifier to be controlled and the system rule of the second device; Sending the audio control policy to the first device; The audio control policy is used to control the playing state of the audio application to be controlled in the first device.

7. The method according to claim 5, wherein the playback effect comprises at least one of the following: playback volume, playback position; and the controlling the playback effect of each channel of audio data to play each channel of audio data comprises at least one of the following: Based on the application identifier of each of the audio applications, controlling the playback volume of each channel of audio data; and playing each channel of audio data based on the playback volume of each channel of audio data; Based on the application identifier of each of the audio applications, controlling the playback position of each channel of audio data; Play each channel of audio data based on the playback position of each channel of audio data; Based on the application identifier of each of the audio applications, controlling the playback volume and playback position of each channel of audio data; Each channel of audio data is played based on the playback volume and playback position of each channel of audio data.

8. An audio control device, comprising: An acquisition module, used to respectively acquire multi-channel audio data of the first device; Each channel of audio data in the multiple channels of audio data corresponds to an audio application running in the first device; The sending module is used to send each channel of audio data in the multiple channels of audio data to the second device separately; the second device is used to control the playback effect of each channel of audio data in the multiple channels of audio data separately.

9. An audio control device, comprising: A receiving module, configured to receive each channel of audio data among multiple channels of audio data sent by the first device; The playing module is used to control the playing effect of each channel of audio data respectively so as to play each channel of audio data.

10. A vehicle audio playback device, comprising a mobile device and a central control screen device, The mobile device is used to respectively obtain multiple channels of audio data of the mobile device; each channel of audio data in the multiple channels of audio data corresponds to an audio application running in the mobile device; and each channel of audio data in the multiple channels of audio data is sent separately to the central control screen device; The central control screen device is used to receive each channel of audio data among the multiple channels of audio data sent by the mobile device; The playing effect of each channel of audio data is controlled respectively to play each channel of audio data.

Images