Audio data synchronization method, central control equipment and audio data synchronization system

Abstract

The invention is suitable for the technical field of audio data processing, and provides an audio data synchronization method, a central control device and an audio data synchronization system.The method is applied to a first control system in the central control device and comprises the steps that first audio data are obtained, and when the first audio data comprise input audio data, the first audio data are sent to the central control device; and synchronizing the input audio data to the first application, sending the first to-be-played data to a second control system under the condition that the first audio data comprises the first to-be-played data, and sending the first to-be-played data to an audio codec connected with the first control system, so that the audio codec processes the first to-be-played data and sends the first to-be-played data to the first application. And under the condition that the first audio data comprises the second to-be-played data, sending the second to-be-played data to the audio codec, so that the audio codec processes the second to-be-played data. According to the invention, the synchronism of the audio data among different control systems can be improved.

Description

Technical Field

[0001] The present application belongs to the field of audio data processing technology, and in particular relates to an audio data synchronization method, apparatus, central control equipment, audio data synchronization system and computer-readable storage medium. Background Art

[0002] With the widespread adoption of intelligent in-vehicle systems, in-vehicle central control devices not only assume vehicle control functions, but also undertake user interaction, audio and video entertainment, and other functions. For example, a vehicle central control device can provide intelligent vehicle assistance functions and, through running applications, provide voice recognition, real-time communication, audio and video playback, and other functions.

[0003] To ensure system stability and real-time audio data processing, more and more in-vehicle central control systems are adopting a dual-system architecture. This means running different control systems simultaneously within the in-vehicle central control system, each implementing its own functionality. However, due to the varying audio data processing capabilities of these control systems, their stability and real-time performance vary significantly, making it difficult to synchronize audio data between these control systems. Summary of the Invention

[0004] The embodiments of the present application provide an audio data synchronization method, a central control device, and an audio data synchronization system, which can improve the synchronization of audio data between different control systems.

[0005] In a first aspect, an embodiment of the present application provides an audio data synchronization method, which is applied to a first control system in a central control device, comprising:

[0006] Obtaining first audio data; the first audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein the input audio data is audio data collected by an in-vehicle display device connected to the central control device, the first data to be played is audio data to be played by a first application in the first control system, and the second data to be played is audio data to be played sent by a second application in a second control system; the second control system is a system running in the central control device that is different from the first control system; the in-vehicle display device includes a first display device connected to the first control system, or a second display device connected to the second control system;

[0007] In a case where the first audio data includes the input audio data, synchronizing the input audio data to the first application;

[0008] In a case where the first audio data includes the first data to be played, sending the first data to be played to the second control system, and sending the first data to be played to an audio codec connected to the first control system so that the audio codec processes the first data to be played;

[0009] In a case where the first audio data includes the second data to be played, the second data to be played is sent to the audio codec, so that the audio codec processes the second data to be played.

[0010] In a second aspect, an embodiment of the present application provides an audio data synchronization method, which is applied to a second control system in a central control device, comprising:

[0011] Obtaining second audio data; the second audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein the input audio data is audio data collected by an in-vehicle display device connected to the central control device, the first data to be played is audio data to be played by a first application in a first control system, and the second data to be played is audio data to be played sent by a second application in the second control system; the first control system is a system running in the central control device that is different from the second control system; the in-vehicle display device includes a first display device connected to the first control system, or a second display device connected to the second control system;

[0012] In a case where the second audio data includes the input audio data, synchronizing the input audio data to the second application;

[0013] When the second audio data includes the first data to be played and the second control system detects the second display device, sending the first data to be played to the second display device so that the second display device plays the first data to be played;

[0014] When the second audio data includes the second data to be played and the second control system detects the second display device, the second data to be played is sent to the second display device, so that the second display device plays the second data to be played.

[0015] In a third aspect, an embodiment of the present application provides an audio data synchronization system, comprising: a central control device and a vehicle-mounted display device, wherein a first control system and a second control system are running in the central control device; the vehicle-mounted display device comprises a first display device connected to the first control system, or a second display device connected to the second control system.

[0016] In a fourth aspect, an embodiment of the present application provides a central control device, comprising a memory, a processor, and a computer program stored in the memory and runnable on the processor, wherein when the processor executes the computer program, the steps of the audio data synchronization method described in the first and second aspects above are implemented.

[0017] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the audio data synchronization method described in the first and second aspects above are implemented.

[0018] In a sixth aspect, an embodiment of the present application provides a computer program product, which, when executed on a central control device, enables the central control device to execute the audio data synchronization method described in any one of the first and second aspects above.

[0019] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0020] In an embodiment of the present application, a first control system and a second control system are run in the central control device, and the first control system obtains the first audio data. Since the above-mentioned first audio data includes at least one of the following: input audio data, first data to be played and second data to be played; wherein the above-mentioned input audio data is the audio data collected by the vehicle-mounted display device connected to the central control device, the above-mentioned first data to be played is the audio data to be played of the first application in the first control system, and the above-mentioned second data to be played is the audio data to be played sent by the second application in the second control system; the above-mentioned vehicle-mounted display device includes the first display device connected to the above-mentioned first control system, or the second display device connected to the above-mentioned second control system, so the above-mentioned first audio data includes audio data from different sources, and then the above-mentioned first audio data includes the input audio data In the case where the first audio data includes first data to be played, the first data to be played is sent to the second control system, and the first data to be played is sent to the audio codec connected to the first control system, so that the audio codec processes the first data to be played; in the case where the first audio data includes second data to be played, the second data to be played is sent to the audio codec, so that the audio codec processes the second data to be played, that is, the audio data in the first audio data will be synchronized to the first application or sent to the second control system according to the source of the audio data, so as to timely process the received audio data and send the audio data, thereby improving the synchronization of input and output of audio data between the first control system and the second control system. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 This is a flowchart of an audio data synchronization method applied to a first control system in a central control device according to an embodiment of the present application;

[0023] Figure 2 This is a flowchart of an audio data synchronization method for a second control system in a central control device provided by an embodiment of the present application;

[0024] Figure 3 This is an interactive diagram of audio data transmission between a first control system and a second control system provided by an embodiment of the present application;

[0025] Figure 4 Schematic diagram of the structure of the audio data synchronization system provided by the embodiment of the present application;

[0026] Figure 5 Schematic diagram of the structure of the audio data synchronization device provided in an embodiment of the present application;

[0027] Figure 6 It is a structural diagram of the central control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0029] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0030] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0031] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0032] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0033] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0034] In a dual-system architecture, a central control system includes two independent yet collaborative control systems, each integrating different functions. For example, a central control system can run both Android and Linux simultaneously. The Android system can integrate the central control system (for user interaction, application execution, etc.), while the Linux system can integrate the instrument system (for receiving and processing instrument information).

[0035] With the popularization of intelligent assistance functions, audio data needs to be processed and synchronized in a timely manner between the two control systems of the vehicle's central control device. However, each control system is independent of each other. Due to factors such as system load and hardware resources, different control systems have large differences in their ability to process audio data. Therefore, it is difficult to synchronize audio data in a timely manner when the two control systems interact. In addition, since the vehicle's central control device may not be compatible with the original vehicle (for example, the user may purchase a smart central control device separately and connect it to the original car screen), the vehicle's central control device equipped with a dual-system architecture may need to be developed or deployed separately according to actual conditions. The synchronization of audio data is closely related to the adaptability of the dual control systems in the vehicle's central control device. When the adaptability of the dual control systems in the vehicle's central control device is poor, it may further lead to difficulty in synchronizing audio data in a timely manner between the various control systems.

[0036] In order to improve the synchronization of audio data between different control systems, the present application provides an audio data synchronization method, in which a first control system obtains first audio data; the above-mentioned first audio data includes at least one of the following: input audio data, first data to be played and second data to be played; when the above-mentioned first audio data includes input audio data, the above-mentioned input audio data is synchronized to a first application; when the above-mentioned first audio data includes first data to be played, the first data to be played is sent to the second control system, and the first data to be played is sent to an audio codec connected to the first control system, so that the audio codec processes the first data to be played; when the above-mentioned first audio data includes second data to be played, the second data to be played is sent to the audio codec, so that the audio codec processes the second data to be played.

[0037] Figure 1 A flow chart of an audio data synchronization method provided in an embodiment of the present application is shown. The above method is applied to the first control system in the central control device, and is described in detail as follows:

[0038] S10. Obtain first audio data; the first audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein, the input audio data is audio data collected by the vehicle-mounted display device connected to the central control device, the first data to be played is audio data to be played by the first application in the first control system, and the second data to be played is audio data to be played sent by the second application in the second control system; the second control system is a system different from the first control system running in the central control device; the vehicle-mounted display device includes a first display device connected to the first control system, or a second display device connected to the second control system.

[0039] Among them, the above-mentioned first control system and the second control system are different systems running in the central control device that are independent of each other and communicate with each other. The above-mentioned first control system and the second control system can communicate with each other through one or more methods such as hardware interface, network, etc. The above-mentioned first application is an application running in the first control system, and the above-mentioned second application is an application running in the second control system. It should be noted that the above-mentioned first control system and the second control system can be integrated in different cores of the same processor of the central control device, or can be integrated in different processors of the central control device. The deployment method of the above-mentioned first control system and the second control system can be set according to actual conditions and is not limited here.

[0040] It should be understood that the above-mentioned first control system can be a system in the central control device responsible for processing the first type of vehicle tasks, and the above-mentioned second control system can be a system in the central control device responsible for processing the second type of vehicle tasks, wherein the above-mentioned first type of vehicle tasks refer to tasks in the central control device with high requirements for real-time and stability. For example, the above-mentioned first type of vehicle tasks may include: voice recognition tasks, vehicle assisted driving tasks (such as advanced driving assistance systems (ADAS, Advanced Driving Assistance System), emergency braking assistance systems (AEBS, Advanced Emergency Braking System), driver monitoring systems (DMS, Driver Monitoring System) and other algorithm-related tasks), driving recording tasks, etc.; the above-mentioned second type of vehicle tasks refer to interaction-related tasks in the central control device. For example, the above-mentioned second type of vehicle tasks may include: UI display tasks, user interaction tasks, etc.

[0041] It should be understood that the above-mentioned vehicle-mounted display device refers to a device that is directly connected to the central control device, and the above-mentioned vehicle-mounted display device and the central control device can be connected through a hardware interface (such as a USB interface), a network, etc. It should be noted that the above-mentioned central control device can be installed in two ways, and the above-mentioned two installation methods include connecting the central control device and the first display device, or connecting the central control device and the second display device, wherein the above-mentioned first display device refers to a display device that can directly communicate with the above-mentioned first control system; the above-mentioned second display device refers to a display device that can directly communicate with the above-mentioned second control system. For example, the user can purchase the central control device and its matching display device (i.e., the first display device) at the same time, connect the central control device and the first display device, and then install them in the vehicle. At this time, the user can remove the original vehicle display device or not use the original vehicle display device; or the user can only purchase the central control device and connect it to the display device that matches the original vehicle display device (i.e., the second display device).

[0042] It should also be understood that the above-mentioned in-vehicle display device includes an audio acquisition device (such as a microphone (mic)) and an audio playback device (such as a speaker, etc.). When the central control device is connected to the first display device, the first control system is responsible for audio acquisition and audio playback tasks; when the central control device is connected to the second display device, the second control system is responsible for audio acquisition and audio playback tasks.

[0043] In some embodiments, the first control system may be a Linux system, and the second control system may be an Android system.

[0044] Specifically, after the central control device and the vehicle-mounted display device are connected, the first control system can obtain audio data from different sources in real time through a preset data transmission protocol or channel, including one or more of the audio data collected by the audio acquisition device in the vehicle-mounted display device (i.e., input audio data), the data to be played of the internal application (i.e., the first application) (i.e., the first data to be played), and the data to be played of the external application (i.e., the second application). It should be noted that in order to avoid confusion in audio data acquisition and ensure stable audio data transmission, the input audio data, the first data to be played, and the second data to be played can all correspond to independent data transmission protocols or channels.

[0045] S11. When the first audio data includes the input audio data, synchronize the input audio data to the first application.

[0046] It should be understood that during the actual operation of the first control system, its internal application (i.e., the first application) needs to use audio data from the external environment to implement corresponding functions. Therefore, the above-mentioned input audio data collected by the vehicle-mounted display device needs to be synchronized to the first application in a timely manner.

[0047] Specifically, when the above-mentioned first audio data includes input audio data, the input audio data collected by the first display device, or the input audio data collected by the second display device, is sent to the corresponding first application in the first control system for the first application to use the input audio data.

[0048] In an embodiment of the present application, the central control system may be connected to the first display device or the second display device. When the first control system receives the corresponding input audio data, it will send it to the internal application, so as to process the input audio data collected by the first display device or the second display device in a timely manner.

[0049] S12. In the case where the first audio data includes the first data to be played, the first data to be played is sent to the second control system, and the first data to be played is sent to the audio codec connected to the first control system, so that the audio codec processes the first data to be played.

[0050] The audio codec may be an audio processing device between the first control system and the first display device, i.e., the audio codec is connected to both the first control system and the first display device. For example, the audio codec may be a WM8388, ES8388, or other encoder.

[0051] Specifically, for the data to be played used within the first control system (i.e., the first data to be played), it can be copied into two copies, one of which is sent to the second control system, and the other is sent to the audio codec connected to the above-mentioned first control system. It should be noted that when the central control device is connected to the first display device, the audio codec is connected to the central control device and the first display device at the same time. After processing, the first data to be played sent to the audio codec can be played through the audio playback device of the first display device (for example, a speaker). At this time, since the second control system will not be connected to the second display device, the first data to be played sent to the second control system will not be played; when the central control device is connected to the second display device, the first data to be played sent to the second control system can be played through the audio playback device of the second display device. At this time, the audio codec will not be connected to the first display device, so the first data to be played sent to the audio codec will not be played.

[0052] In the embodiment of the present application, the first data to be played is sent to the second control system and the audio codec simultaneously, so that when the central control device is connected to the first display device or the second display device, it can be processed and played in a timely manner, thereby improving the synchronization of the first data to be played. In addition, for either connection method (the central control device is connected to the first display device or the second display device), the first control system can use the same control logic to process the first data to be played, without the need for separate development for each connection method, which reduces development costs while also improving the applicability of the dual control system.

[0053] S13. In a case where the first audio data includes the second data to be played, the second data to be played is sent to the audio codec, so that the audio codec processes the second data to be played.

[0054] Specifically, when the above-mentioned first audio data includes the second data to be played, the above-mentioned first control system will send the above-mentioned second data to be played to the audio codec in real time. It should be noted that when the central control device is connected to the first display device, the audio codec is connected to the central control device and the first display device at the same time. The second data to be played sent to the audio codec can be played through the audio playback device of the first display device (for example, a speaker) after processing; when the central control device is connected to the second display device, although the audio codec receives the second data to be played, it will not play the second data to be played because it is not connected to the first display device. At this time, the second data to be played is played by the second control system through the above-mentioned second display device.

[0055] In the embodiment of the present application, the second data to be played can be processed and played in a timely manner when the central control device is connected to the first display device or the second display device, thereby improving the synchronization of the second data to be played. In addition, for either connection method (the central control device is connected to the first display device or the second display device), the first control system can use the same control logic to process the second data to be played, eliminating the need for separate development for each connection method, reducing development costs while also improving the applicability of the dual control system.

[0056] In an embodiment of the present application, a first control system and a second control system are run in the central control device, and the first control system obtains the first audio data. Since the above-mentioned first audio data includes at least one of the following: input audio data, first data to be played and second data to be played; wherein the above-mentioned input audio data is the audio data collected by the vehicle-mounted display device connected to the central control device, the above-mentioned first data to be played is the audio data to be played of the first application in the first control system, and the above-mentioned second data to be played is the audio data to be played sent by the second application in the second control system; the above-mentioned vehicle-mounted display device includes the first display device connected to the above-mentioned first control system, or the second display device connected to the above-mentioned second control system, so the above-mentioned first audio data includes audio data from different sources, and then the above-mentioned first audio data includes the input audio data In the case where the first audio data includes first data to be played, the first data to be played is sent to the second control system, and the first data to be played is sent to the audio codec connected to the first control system, so that the audio codec processes the first data to be played; in the case where the first audio data includes second data to be played, the second data to be played is sent to the audio codec, so that the audio codec processes the second data to be played, that is, the audio data in the first audio data will be synchronized to the first application or sent to the second control system according to the source of the audio data, so as to timely process the received audio data and send the audio data, thereby improving the synchronization of input and output of audio data between the first control system and the second control system.

[0057] In some embodiments, the input audio data includes first input audio data collected by the first display device, or second input audio data collected by the second display device, wherein the first input audio data is audio data collected by an audio collection device (e.g., a physical mic) in the first display device, and the second input audio data is audio data collected by an audio collection device (e.g., a physical mic) in the second display device.

[0058] It should be understood that in order to avoid confusion in audio data transmission, multiple channels for transmitting audio data are set between the first control system and the second control system. At the same time, audio data is transmitted between the above-mentioned first display device and the first control system, as well as between the second display device and the second control system through independent transmission protocols or channels.

[0059] Specifically, the first control system and the audio codec can interact with each other through the first interface, and the first control system and the second control system can interact with each other through the second interface and the third interface. That is, the first control system is connected to the audio codec through the first interface, the first control system is connected to the third interface of the second control system through the second interface, and the first control system and the second control system interact with each other through multiple channels between the second interface and the third interface. The above-mentioned interface can be a hardware interface, for example, a synchronous audio interface (Synchronous Audio Interface, SAI) and the like.

[0060] For example, the first control system is a Linux system, and the second control system is an Android system. The Linux system is connected to an audio codec (such as WM8388) through the SAI0 interface (i.e., the first interface) for audio input and output; at the same time, the Linux system transmits audio data through the SAI1 interface (i.e., the second interface) and the SAI3 interface (i.e., the third interface) of the Android system through multiple channels of the I2S protocol.

[0061] Correspondingly, the obtaining of the first audio data includes:

[0062] receiving audio data sent by the first display device in real time to obtain the first input audio data, or reading audio data in a first channel in real time to obtain the second input audio data; wherein the first channel is a channel set between the first control system and the second control system for transmitting the second input audio data;

[0063] and / or,

[0064] receiving in real time the audio data to be played sent by the first application in the first control system to obtain the first data to be played;

[0065] and / or,

[0066] The audio data in the second channel is read in real time to obtain the second data to be played; wherein the second channel is a channel set between the first control system and the second control system for transmitting the second data to be played.

[0067] Specifically, for input audio data (including first input audio data or second input audio data), when the central control device is connected to the first display device, the first input audio data collected by the first display device can be sent to the first control system through the first interface after being processed by the above-mentioned audio codec; when the central control device is connected to the second display device, the second input audio collected by the second display device is transmitted to the first control system through the first channel between the second interface and the third interface. It should be noted that the first control system will simultaneously connect to the first interface and the first channel, and continuously read the audio data transmitted by the first interface and the first channel, and perform data mixing processing on the read input audio data (including the first input audio data or the second input audio data) for use by applications in the first control system. It should be noted that since the actual central control device will only be connected to one display device, after the mixing processing, the audio data used by the application in the first control system is actually the first input audio data or the second input audio data.

[0068] It should also be noted that the above-mentioned first control system receives audio data collected from the first display device through the first interface, and receives audio data collected from the first display device through the first channel. When the corresponding display device does not send the collected audio data, the data obtained by the first control system in the corresponding channel is silent data.

[0069] For example, if the first control system is Linux and the second control system is Android, the Linux system will simultaneously connect to the data from the first interface and the first channel, mix and process the data, and output it to the Linux system's driving recorder module. If the central control device is connected to the first display device, no audio data will be transmitted on the first channel, and the data after mixing and processing will be the first input audio data. If the central control device is connected to the second display device, no audio data will be transmitted on the first interface, and the data after mixing and processing will be the second input audio data.

[0070] With respect to the aforementioned first data to be played, the first control system will receive the aforementioned first data to be played sent by each first application in the aforementioned first control system in real time, perform data mixing, and then send the data to the audio codec for processing based on the priority of different first applications. Similarly, when the central control device is connected to the first display device, the first data to be played after being processed by the audio codec can be played through the first display device. When the central control device is connected to the second display device, the first data to be played after being processed by the audio codec will not be played.

[0071] For the above-mentioned second data to be played, the first control system will receive the above-mentioned second data to be played in real time through the second channel between the second interface and the third interface, and then send it to the audio codec for processing. Similarly, when the central control device is connected to the first display device, the second data to be played after the audio codec processing can be played through the first display device. When the central control device is connected to the second display device, the second data to be played after the audio codec processing will not be played. It should also be noted that when the first control system determines that the audio data in the second channel is silent data, it can be sent directly or omitted, that is, only when the audio data in the second channel is non-silent data (that is, the second data to be played is received), it is sent to the audio codec for processing.

[0072] In an embodiment of the present application, the first control system can independently obtain audio data from different sources through the protocol or channel provided by the hardware interface, avoiding confusion when audio data from different sources interact, and improving the stability and security of audio data transmission.

[0073] In another optional embodiment of the present application, after receiving the audio data sent by the first display device in real time and obtaining the first input audio data, the method further includes:

[0074] The first input audio data is sent to the second control system through a third channel; wherein the third channel is a channel set between the first control system and the second control system for transmitting the first input audio data.

[0075] Specifically, in order to synchronize the first input audio data to the second control system in a timely manner, after the first control system receives the first input audio data in real time, a copy can be transmitted to the second control system through the third channel between the second interface and the third interface for use by the second control system.

[0076] In the embodiment of the present application, the timeliness and stability of the synchronization of the first input audio data can be improved by transmitting the first input audio data to the second control system through an independent third channel.

[0077] In some embodiments, a fourth channel for transmitting the first data to be played is provided between the first control system and the second control system, and the first data to be played is sent to the second control system, including:

[0078] The first data to be played is sent to the second control system via the fourth channel.

[0079] Specifically, in order to synchronize the to-be-played data of the first application to the second control system in a timely manner, the first to-be-played data may be transmitted to the second control system via a fourth channel between the second interface and the third interface for use by the second control system.

[0080] In the embodiment of the present application, the timeliness and stability of the synchronization of the first data to be played can be improved by transmitting the first input audio data to the second control system through an independent fourth channel.

[0081] Figure 2 A flow chart of an audio data synchronization method provided in an embodiment of the present application is shown. The above method is applied to the second control system in the central control device, and is described in detail as follows:

[0082] S20. Obtain second audio data; the second audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein, the input audio data is audio data collected by the vehicle-mounted display device connected to the central control device, the first data to be played is audio data to be played by the first application in the first control system, and the second data to be played is audio data to be played sent by the second application in the second control system; the first control system is a system different from the second control system running in the central control device; the vehicle-mounted display device includes a first display device connected to the first control system, or a second display device connected to the second control system.

[0083] The first control system and the second control system can communicate with each other through one or more methods such as a hardware interface and a network. The first application is an application running in the first control system, and the second application is an application running in the second control system. The vehicle-mounted display device may include a first display device or a second display device depending on the installation method of the central control device. The connection method between the vehicle-mounted display device and the central control device, the connection method and functions of the first control system and the second control system can refer to the above embodiments and will not be repeated here.

[0084] Specifically, after the central control device and the vehicle-mounted display device are connected, the second control system can also obtain audio data from different sources in real time through a preset data transmission protocol or channel, including one or more of the audio data collected by the audio acquisition device in the vehicle-mounted display device (i.e., input audio data), the to-be-played data of the internal application (i.e., the second application) (i.e., the second to-be-played data), and the to-be-played data of the external application (i.e., the first application). It should be noted that in order to avoid confusion in audio data acquisition and to ensure stable audio data transmission, the above-mentioned input audio data, the first to-be-played data, and the second to-be-played data can all correspond to independent data transmission protocols or channels.

[0085] S21. When the second audio data includes the input audio data, synchronize the input audio data to the second application.

[0086] It should be understood that during the actual operation of the second control system, its internal application (i.e., the second application) needs to use audio data from the external environment to implement corresponding functions. Therefore, the above-mentioned input audio data collected by the vehicle-mounted display device needs to be synchronized to the second application in a timely manner.

[0087] Specifically, when the above-mentioned second audio data includes input audio data, the input audio data collected by the first display device, or the input audio data collected by the second display device, is sent to the corresponding second application in the second control system for the second application to use the input audio data.

[0088] For example, the second control system (such as the Android system) may use the input audio data as an audio input source for a phone application.

[0089] In an embodiment of the present application, the central control system may be connected to the first display device or the second display device. When the second control system receives the corresponding input audio data, it will send it to the internal application, so as to process the input audio data collected by the first display device or the second display device in a timely manner.

[0090] S22. When the second audio data includes the first data to be played and the second control system detects the second display device, the first data to be played is sent to the second display device so that the second display device plays the first data to be played.

[0091] Specifically, the second control system can detect the connection mode of the central control device according to the preset screen projection protocol, that is, the second display device can be detected through the preset screen projection protocol. When the second audio data includes the first data to be played, and the second control system detects the second display device, it means that the central control device and the second display device are connected. At this time, the second control system assumes the audio playback task, and sends the first data to be played to the second display device through a preset link (such as a screen projection link), so that the second display device plays the first data to be played through an audio playback device (such as a speaker).

[0092] It should be understood that if the second audio data includes the first data to be played, and the second control system does not detect the second display device, it means that the central control device and the first display device are connected. In this case, the first control system assumes the audio playback task, and the second control system can directly ignore the second data to be played. Of course, if the second display device is not detected, the first data to be played may not be received.

[0093] In the embodiment of the present application, since the second control system can detect whether the second display device is connected, it can determine whether to use the first data to be played based on actual conditions, that is, it is used when the connection of the second display device is detected, and not used when the connection of the second display device is not detected, thereby improving the accuracy of the use of the first audio data to be played.

[0094] S23. When the second audio data includes the second data to be played and the second control system detects the second display device, the second data to be played is sent to the second display device so that the second display device plays the second data to be played.

[0095] Specifically, when the above-mentioned second audio data includes second data to be played and the second control system detects a second display device, it means that the central control device and the second display device are connected. At this time, the second control system assumes the audio playback task, and sends the above-mentioned second data to be played to the second display device through a preset link (such as a screen projection link), so that the above-mentioned second display device plays the above-mentioned second data to be played through an audio playback device (such as a speaker).

[0096] In the embodiment of the present application, since the second control system can detect whether the second display device is connected, the second data to be played is used when the connection of the second display device is detected, thereby improving the accuracy of the use of the second audio data to be played.

[0097] In an embodiment of the present application, a first control system and a second control system are run in the central control device, and the second control system obtains second audio data. Since the above-mentioned second audio data includes at least one of the following: input audio data, first data to be played and second data to be played; wherein the above-mentioned input audio data is audio data collected by the vehicle-mounted display device connected to the central control device, the above-mentioned first data to be played is audio data to be played of the first application in the first control system, and the above-mentioned second data to be played is audio data to be played sent by the second application in the second control system; the above-mentioned vehicle-mounted display device includes a first display device connected to the above-mentioned first control system, or a second display device connected to the above-mentioned second control system, so the above-mentioned second audio data includes audio data from different sources, and then the above-mentioned second audio data includes input audio data In the case of the second audio data, the input audio data is synchronized to the second application; in the case of the second audio data including the first data to be played and the second control system detects the second display device, the first data to be played is sent to the second display device, so that the second display device plays the first data to be played; in the case of the second audio data including the second data to be played and the second control system detects the second display device, the second data to be played is sent to the second display device, so that the second display device plays the second data to be played, that is, the audio data in the second audio data will be synchronized to the second application according to the source of the audio data, or sent to the second display device for playback, so as to timely process the received audio data and improve the synchronization of the audio data between the first control system and the second control system.

[0098] In some embodiments, the input audio data includes first input audio data collected by the first display device, or second input audio data collected by the second display device; and multiple channels for transmitting audio data are provided between the first control system and the second control system.

[0099] Specifically, the first control system and the audio codec can exchange audio data via the first interface, and the first control system and the second control system can exchange data via the second interface and the third interface. The description of the first interface, the second interface, and the third interface can be referred to in the above embodiment and will not be repeated here.

[0100] Correspondingly, the above-mentioned obtaining of the second audio data includes:

[0101] When the second control system detects the second display device, receiving the audio data sent by the second display device in real time to obtain the second input audio data, or when the second control system does not detect the second display device, reading the audio data in the third channel in real time to obtain the first input audio data;

[0102] and / or,

[0103] receiving in real time the audio data to be played sent by the second application in the second control system to obtain the second audio data to be played;

[0104] and / or,

[0105] When the second control system detects the second display device, the audio data in the fourth channel is read in real time to obtain the first data to be played; wherein the fourth channel is a channel set between the first control system and the second control system for transmitting the first data to be played.

[0106] Specifically, for input audio data (including first input audio data or second input audio data), when the central control device is connected to the first display device (that is, the second control system does not detect the above-mentioned second display device), the first input audio data collected by the first display device is transmitted to the second control system through the third channel between the second interface and the third interface; when the central control device is connected to the second display device (that is, the second control system detects the above-mentioned second display device), the second input audio collected by the second display device is transmitted to the second control system in real time through the hardware interface (such as USB) or the network.

[0107] It should be noted that the audio data in the third channel may include silent data (that is, when the central control device is connected to the second display device, the first display device does not exist at this time, so the audio data in the third channel is actually silent data) or non-silent data (that is, when the central control device is connected to the first display device, the audio data collected through the physical mic of the first display device, that is, the first input audio data). When the central control device is connected to the second display device, that is, when the above-mentioned second control system detects the above-mentioned second display device, the above-mentioned second control system can directly ignore the first input audio data in the third channel; when the central control device is connected to the first display device, that is, when the above-mentioned second control system does not detect the above-mentioned second display device, the first input audio data in the third channel is used.

[0108] For the above-mentioned second data to be played, the second control system will receive the above-mentioned second data to be played sent by each second application in the above-mentioned second control system in real time, and then when the second display device is detected, it will be sent to the second display device through a preset link (for example, a screen projection link), so that the above-mentioned second display device plays the above-mentioned second data to be played through the audio playback device.

[0109] For the first data to be played, when the second control system detects the second display device, it will receive the above-mentioned first data to be played in real time through the fourth channel between the second interface and the third interface, and then send it to the second display device through a preset link (such as a screen projection link), so that the above-mentioned second display device plays the above-mentioned first data to be played through the audio playback device.

[0110] It should be understood that since the second control system can detect whether it is connected to the second display device, the above-mentioned first data to be played and the above-mentioned second data to be played can be ignored and not read when the second display device is not detected, or discarded after reading, that is, the playback or use of the audio is carried out through the first control system.

[0111] It should also be understood that when the second control system detects that a second display device is connected and the above-mentioned first data to be played and the above-mentioned second data to be played exist at the same time, the second control system can mix the first data to be played and the second data to be played, and send them to the second display device for playback according to priority, thereby improving the accuracy of the playback of the first data to be played and the second data to be played.

[0112] In an embodiment of the present application, the second control system can independently obtain audio data from different sources through the protocol or channel provided by the hardware interface, avoiding confusion when audio data from different sources interact, and improving the stability and security of audio data transmission.

[0113] In some embodiments, after receiving the audio data sent by the second display device in real time to obtain the second input audio data, the method further includes:

[0114] The second input audio data is sent to the first control system through a first channel; wherein the first channel is a channel set between the first control system and the second control system for transmitting the second input audio data.

[0115] Specifically, in order to synchronize the second input audio data to the first control system in a timely manner, after the second control system receives the second input audio data in real time, it can make a copy and transmit it to the first control system through the first channel between the second interface and the third interface for use by the first control system.

[0116] In the embodiment of the present application, the second input audio data is transmitted to the first control system through an independent first channel, so that the timeliness and stability of the synchronization of the second input audio data can be improved.

[0117] In some embodiments, after receiving the audio data to be played sent by the second application in the second control system in real time and obtaining the second audio data to be played, the method further includes:

[0118] The second data to be played is sent to the first control system through a second channel; wherein the second channel is a channel set between the first control system and the second control system for transmitting the second data to be played.

[0119] Specifically, for the data to be played (i.e., the second data to be played) used within the second control system, a copy can be made and then sent directly to the above-mentioned first control system through the second channel for the first control system. In addition, since the second control system can detect whether the second display device is connected, the second data to be played can also be sent to the above-mentioned first control system through the second channel only when the second display device is not detected, so as to be played through the first display device connected to the first control system. It should be noted that when the second control system detects the second display device, the second data to be played is not sent to the above-mentioned first control system through the second channel. At this time, the audio data read by the first control system is silent data, so the first control system will not play it.

[0120] In the embodiment of the present application, by detecting whether the second display device is detected and transmitting the second data to be played to the first control system through an independent second channel, the timeliness and stability of the synchronization of the second data to be played can be improved.

[0121] In order to better illustrate the transmission of audio data between the first control system and the second control system, Figure 3 For explanation, refer to Figure 3 As shown, it is an interactive diagram of audio data transmission between the first control system and the second control system, wherein the first control system is a Linux system, the second control system is an Android system, the Linux system is connected to the audio codec (such as WM8388) through a first interface (such as SAI0), and the Linux system is connected to the third interface (such as SAI3 interface) of the Android system through a second interface (such as SAI1 interface), and multiple data transmission channels (such as multiple channels of the I2S protocol) are included between the second interface and the third interface: the first channel to the fourth channel, wherein:

[0122] The initialization phase performs the following steps:

[0123] A1: Initialize the first interface, that is, connect the first interface to the audio codec;

[0124] A2: Initialize the second interface, that is, connect the second interface to the third interface of the Android system;

[0125] A3: Initialize the third interface, that is, connect the third interface to the second interface of the Linux system;

[0126] The Linux system at any stage performs the following steps:

[0127] B1: The Linux system continuously collects the first input audio data; that is, it continuously reads the audio data processed by the audio codec through the first interface; for example, when the central control device is connected to the first display device, the first input audio data may be audio data collected by the physical microphone in the first display device, or when the central control device is connected to the second display device, the first input audio data may be silent data;

[0128] B2: The Linux system continuously obtains the second input audio data through the first channel; that is, it continuously reads the audio data in the first channel; for example, when the central control device is connected to the second display device, the second input audio data may be audio data collected by the physical microphone in the second display device, or when the central control device is connected to the first display device, the second input audio data may be mute data;

[0129] B3: The Linux system mixes the first input audio data and the second input audio data, and then interfaces the mixed audio data with the Linux system for use by applications of the Linux system. Since only one display device is connected, there is only one audio data source after the mixing process.

[0130] B4: The Linux system sends the first input audio data to the Android system through the third channel; that is, the first input audio data is synchronized to the Android system;

[0131] B5: The Linux system continuously reads the second data to be played from the second channel. For example, when the central control device is connected to the first display device, the second data to be played is not silent data because the Linux system is performing an audio playback task. When the central control device is connected to the second display device, the second data to be played may be silent data because the Android system is performing an audio playback task.

[0132] B6: The Linux system performs a silence detection on the second data to be played;

[0133] B7: When the second data to be played is not silent data, the Linux system sends the second data to be played to the audio codec and plays it through the speaker connected to the audio codec; if the second data to be played is silent data, the second data to be played can be directly ignored;

[0134] B8: The Linux system receives the first data to be played; that is, the Linux system receives the data to be played from the internal application;

[0135] B9: The Linux system sends the first to-be-played data to the Android system via the fourth channel;

[0136] When the central control device is connected to the first display device, the Android system performs the following steps:

[0137] C1: The Android system continuously reads the first input audio data of the third channel; that is, the Android system obtains the audio data collected by the first display device through the third channel;

[0138] C2: The Android system connects the first input audio data to the second application for use;

[0139] C3: The Android system sends the second to-be-played data to the Linux system through the second channel; that is, the Android system sends the to-be-played data of the internal application to the Linux system for playback;

[0140] When the central control device is connected to a second display device, the Android system performs the following steps:

[0141] D1: The Android system obtains the second input audio data, that is, the Android system obtains the audio data collected by the second display device;

[0142] D2: The Android system sends the second input audio data to the Linux system through the first channel; that is, the second input audio data is synchronized to the Linux system;

[0143] D3: The Android system sends the second to-be-played data to the second display device for playback; for example, the Android system sends the to-be-played data of the internal application to the second display device for playback through the screen projection link;

[0144] D4: The Android system reads the first data to be played from the fourth channel; that is, the Android system obtains the data to be played from the internal application of the Linux system through the fourth channel;

[0145] D5: The Android system sends the first data to be played to the second display device for playback; for example, the Android system sends the first data to be played to the second display device for playback through the screen projection link.

[0146] In the embodiments of the present application, the Linux system maintains the same control logic at all stages, while the Android system itself can identify whether a second display device is connected and adjust the interaction logic for different audio data accordingly. That is, regardless of the installation method, seamless switching can be achieved. For the dual-system architecture, there is no need to separately configure or use different software corresponding to different installation methods. This improves the applicability of the dual-system architecture and allows for timely exchange of audio data between the Linux and Android systems. In addition, the transmission of audio data between the Linux and Android systems via a hardware interface can also reduce the delay in audio data transmission between the two systems and improve the synchronization of audio data between the two systems.

[0147] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0148] Corresponding to the audio data synchronization method described in the above embodiment, Figure 4 A structural diagram of the audio data synchronization system provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0149] Reference Figure 4 The above-mentioned system includes: a central control device 41 and an on-board display device 42, wherein a first control system and a second control system are running in the above-mentioned central control device 41; the above-mentioned on-board display device 42 includes a first display device 421 connected to the above-mentioned first control system, or a second display device 422 connected to the above-mentioned second control system.

[0150] The central control device further includes an audio codec device (e.g., WM8388), which is connected to the audio codec device via a first interface (e.g., SAI0), and the audio codec device is connected to the first display device. The second control system and the second display device are connected via a hardware interface (e.g., a USB interface) or a network, and the first control system is connected to the third interface (e.g., SAI3) of the second control system via a second interface (e.g., SAI1), so that audio data between the first control system and the second control system can be synchronized through the first to fourth channels.

[0151] It should be noted that the interaction and execution process between the central control device and the vehicle-mounted display device, the interaction and execution process between the first control system / the second control system, etc., are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0152] Corresponding to the audio data synchronization method described in the above embodiment, Figure 5 A structural diagram of the audio data synchronization device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0153] Reference Figure 5 , the device may include a first audio data synchronization device 51 and a second audio data synchronization device 52, wherein the first audio data synchronization device 51 is applied to the first control system of the central control device, and may include a first data acquisition module 511, a first data synchronization module 512, a second data synchronization module 513 and a third data synchronization module 514; the above-mentioned second audio data synchronization device 52 is applied to the second control system of the central control device, and may include a second data acquisition module 521, a fourth data synchronization module 522, a fifth data synchronization module 523 and a sixth data synchronization module 524;.

[0154] Reference Figure 5 , the first audio data synchronization device 51 includes:

[0155] The first data acquisition module 511 is configured to acquire first audio data; the first audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein the input audio data is audio data collected by an in-vehicle display device connected to the central control device, the first data to be played is audio data to be played by a first application in the first control system, and the second data to be played is audio data to be played sent by a second application in a second control system; the second control system is a system running in the central control device that is different from the first control system; the in-vehicle display device includes a first display device connected to the first control system, or a second display device connected to the second control system;

[0156] A first data synchronization module 512 is configured to synchronize the input audio data to the first application when the first audio data includes the input audio data;

[0157] a second data synchronization module 513 configured to, when the first audio data includes the first data to be played, send the first data to be played to the second control system, and send the first data to be played to an audio codec connected to the first control system, so that the audio codec processes the first data to be played;

[0158] The third data synchronization module 514 is configured to, when the first audio data includes the second data to be played, send the second data to be played to the audio codec, so that the audio codec processes the second data to be played.

[0159] The second audio data synchronization device 52 includes:

[0160] The second data acquisition module 521 is configured to acquire second audio data; the second audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein the input audio data is audio data collected by an in-vehicle display device connected to the central control device, the first data to be played is audio data to be played by a first application in a first control system, and the second data to be played is audio data to be played sent by a second application in the second control system; the first control system is a system running in the central control device that is different from the second control system; the in-vehicle display device includes a first display device connected to the first control system, or a second display device connected to the second control system;

[0161] a fourth data synchronization module 522, configured to synchronize the input audio data to the second application when the second audio data includes the input audio data;

[0162] a fifth data synchronization module 523, configured to, when the second audio data includes the first data to be played and the second control system detects the second display device, send the first data to be played to the second display device, so that the second display device plays the first data to be played;

[0163] The sixth data synchronization module 524 is used to send the second data to be played to the second display device when the second audio data includes the second data to be played and the second control system detects the second display device, so that the second display device plays the second data to be played.

[0164] It should be noted that the information interaction, execution process, etc. between the devices / units are based on the same concept as the method embodiments of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0165] Figure 6 This is a structural diagram of the central control device provided in one embodiment of the present application. Figure 6 As shown, the central control device 6 of this embodiment includes: at least one processor 60 ( Figure 6Only one is shown in the figure), a memory 61, and a computer program 62 stored in the memory 61 and executable on the at least one processor 60. When the processor 60 executes the computer program 62, the steps of any of the method embodiments are implemented.

[0166] The central control device 6 can be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The central control device can include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art will understand that Figure 6 It is only an example of the central control device 6 and does not constitute a limitation of the central control device 6. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the central control device may also include an input and sending device, a network access device, a bus, etc.

[0167] The processor 60 may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0168] In some embodiments, the memory 61 may be an internal storage unit of the central control device 6, such as a hard disk or memory of the central control device 6. The memory 61 may also be an external storage device of the central control device 6, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the central control device 6. Furthermore, the memory 61 may also include both an internal storage unit and an external storage device of the central control device 6. The memory 61 is used to store an operating system, an application, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 61 may also be used to temporarily store data that has been sent or is to be sent.

[0169] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the functional units and modules is used as an example for illustration. In actual applications, the function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0170] An embodiment of the present application also provides a network device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the method embodiments when executing the computer program.

[0171] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the various method embodiments can be implemented.

[0172] An embodiment of the present application provides a computer program product. When the computer program product is run on a central control device, the central control device can implement the steps in the various method embodiments when executing the computer program product.

[0173] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process in the embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, it can implement the steps of the various method embodiments. Among them, the computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / central control device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, USB flash drive, mobile hard disk, magnetic disk or optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0174] In the embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0175] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0176] In the embodiments provided in this application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0177] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0178] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for synchronizing audio data, characterized in that: The first control system used in the central control equipment includes: Obtaining first audio data; the first audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein the input audio data is audio data collected by an in-vehicle display device connected to the central control device, the first data to be played is audio data to be played by a first application in the first control system, and the second data to be played is audio data to be played sent by a second application in a second control system; the second control system is a system running in the central control device that is different from the first control system; the in-vehicle display device includes a first display device connected to the first control system, or a second display device connected to the second control system; In a case where the first audio data includes the input audio data, synchronizing the input audio data to the first application; In a case where the first audio data includes the first data to be played, sending the first data to be played to the second control system, and sending the first data to be played to an audio codec connected to the first control system so that the audio codec processes the first data to be played; In a case where the first audio data includes the second data to be played, the second data to be played is sent to the audio codec, so that the audio codec processes the second data to be played.

2. The audio data synchronization method according to claim 1, wherein: The input audio data includes first input audio data collected by the first display device, or second input audio data collected by the second display device; A plurality of channels for transmitting audio data are provided between the first control system and the second control system; The obtaining of the first audio data includes: receiving audio data sent by the first display device in real time to obtain the first input audio data, or reading audio data in a first channel in real time to obtain the second input audio data; wherein the first channel is a channel set between the first control system and the second control system for transmitting the second input audio data; and / or, receiving in real time the audio data to be played sent by the first application in the first control system to obtain the first data to be played; and / or, The audio data in the second channel is read in real time to obtain the second data to be played; wherein the second channel is a channel set between the first control system and the second control system for transmitting the second data to be played.

3. The audio data synchronization method according to claim 2, wherein: After receiving the audio data sent by the first display device in real time to obtain the first input audio data, the method further includes: The first input audio data is sent to the second control system through a third channel; wherein the third channel is a channel set between the first control system and the second control system for transmitting the first input audio data.

4. The audio data synchronization method according to any one of claims 1 to 3, characterized in that: A fourth channel for transmitting the first data to be played is provided between the first control system and the second control system, and the sending of the first data to be played to the second control system includes: The first data to be played is sent to the second control system through the fourth channel.

5. A method for synchronizing audio data, characterized in that: The second control system used in the central control equipment includes: Obtaining second audio data; the second audio data includes at least one of the following: input audio data, first data to be played, and second data to be played; wherein the input audio data is audio data collected by an in-vehicle display device connected to the central control device, the first data to be played is audio data to be played by a first application in a first control system, and the second data to be played is audio data to be played sent by a second application in the second control system; the first control system is a system running in the central control device that is different from the second control system; the in-vehicle display device includes a first display device connected to the first control system, or a second display device connected to the second control system; In a case where the second audio data includes the input audio data, synchronizing the input audio data to the second application; When the second audio data includes the first data to be played and the second control system detects the second display device, sending the first data to be played to the second display device so that the second display device plays the first data to be played; When the second audio data includes the second data to be played and the second control system detects the second display device, the second data to be played is sent to the second display device, so that the second display device plays the second data to be played.

6. The audio data synchronization method according to claim 5, wherein: The input audio data includes first input audio data collected by the first display device, or second input audio data collected by the second display device; A plurality of channels for transmitting audio data are provided between the first control system and the second control system; The obtaining of the second audio data includes: When the second control system detects the second display device, receiving audio data sent by the second display device in real time to obtain the second input audio data, or when the second control system does not detect the second display device, reading audio data in the third channel in real time to obtain the first input audio data; and / or, receiving in real time the audio data to be played sent by the second application in the second control system to obtain the second audio data to be played; and / or, When the second control system detects the second display device, the audio data in the fourth channel is read in real time to obtain the first data to be played; wherein, the fourth channel is a channel set between the first control system and the second control system for transmitting the first data to be played.

7. The audio data synchronization method according to claim 6, wherein: After receiving the audio data sent by the second display device in real time to obtain the second input audio data, the method further includes: The second input audio data is sent to the first control system through a first channel; wherein the first channel is a channel set between the first control system and the second control system for transmitting the second input audio data.

8. The audio data synchronization method according to claim 6 or 7, wherein: After receiving the audio data to be played sent by the second application in the second control system in real time and obtaining the second audio data to be played, the method further includes: The second data to be played is sent to the first control system through a second channel; wherein the second channel is a channel set between the first control system and the second control system for transmitting the second data to be played.

9. A central control device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 4 and the method according to any one of claims 5 to 8 are implemented.

10. An audio data synchronization system, characterized in that: include: The central control device and the vehicle-mounted display device as described in claim 9, wherein a first control system and a second control system are running in the central control device; and the vehicle-mounted display device includes a first display device connected to the first control system, or a second display device connected to the second control system.

Images