An audio playing system, method, driving device and storage medium

By introducing a shared sound card and audio playback platform for focused arbitration in the in-vehicle system, the problem of simultaneous sound output from the instrument subsystem and entertainment subsystem was solved, improving driving safety and the reliability of sound control.

CN115604645BActive Publication Date: 2026-03-31CHINA AUTOMOTIVE INNOVATION CORP
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-30
Publication Date
2026-03-31

AI Technical Summary

Technical Problem

In traditional in-vehicle infotainment systems, the instrument panel and entertainment subsystems each have their own independent sound cards, which may cause them to emit sound simultaneously, posing a driving hazard, and they cannot support rapid sound output upon startup.

Method used

A shared sound card and operating subsystem are used, and focus arbitration is performed through the audio playback platform to coordinate the sound playback order and ensure that important prompts are played first.

Benefits of technology

It effectively avoids simultaneous sound output, reduces driving hazards, saves sound card costs, and improves the accuracy and reliability of sound control by using a single control shared sound card.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115604645B_ABST
    Figure CN115604645B_ABST
Patent Text Reader

Abstract

The application discloses an audio playing system, method, driving device and storage medium, and relates to the technical field of audio playing systems. The audio playing system comprises an audio playing platform, which comprises a receiving module, an arbitration module and a first sending module. The receiving module is used for receiving a focus request. The arbitration module is used for performing focus arbitration processing in response to the focus request and obtaining a focus arbitration result. The first sending module is used for sending the focus arbitration result to at least a sound source object corresponding to the focus request, so that the sound source object sends audio data to a shared sound card according to the focus arbitration result. The second sending module is used for sending the focus arbitration result to a control module, so that the control module controls the shared sound card to play the audio data according to the focus arbitration result. The application provides a dedicated audio playing platform to perform focus arbitration, which can effectively coordinate the sound emission sequence in the audio playing system, control the shared sound card to play the audio data, avoid simultaneous sound emission, and improve driving safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of vehicle system technology, and in particular to an audio playback system, method, driving device, and storage medium. Background Technology

[0002] Traditional in-vehicle infotainment systems consist of an instrument cluster subsystem (Instrument Linux Subsystem, IPK) and an entertainment subsystem (Entertainment Android Subsystem, IVI). These two subsystems are completely independent, each with its own sound card for sound output, and they do not communicate with each other. However, the two subsystems may emit sound simultaneously, and the alarm sounds from the instrument cluster may be drowned out by the entertainment sounds, creating a driving hazard. Furthermore, existing in-vehicle infotainment systems cannot support rapid sound output upon startup. Summary of the Invention

[0003] To address the problems existing in the prior art, the present invention provides an audio playback system, method, driving device, and storage medium, which can effectively coordinate the sound playback sequence and reduce driving hazards. The technical solution is as follows:

[0004] On one hand, the present invention provides an audio playback system, including an audio playback platform, the audio playback platform comprising:

[0005] The receiving module is used to receive focus requests;

[0006] The arbitration module is used to respond to the focus request, perform focus arbitration processing, and obtain a focus arbitration result; the focus arbitration result includes focus allocation information and playback status information;

[0007] The first sending module is used to send the focus arbitration result to at least the audio source object corresponding to the focus request, so that the audio source object sends audio data to the shared sound card according to the focus arbitration result;

[0008] The second sending module is used to send the focus arbitration result to the control module, so that the control module controls the shared sound card to play the audio data according to the focus arbitration result.

[0009] Furthermore, the audio playback system includes a shared sound card, an operation subsystem, and at least one playback subsystem;

[0010] The playback subsystem includes at least one of the audio source objects;

[0011] The operating subsystem includes a control module and an audio playback platform that are connected via communication. The audio playback platform is connected via communication with the playback subsystem, and the control module is connected via communication with the shared sound card.

[0012] Furthermore, the playback subsystem also includes a communication module, which is used to transmit information with the operation subsystem.

[0013] Furthermore, the communication module is communicatively connected to the operating subsystem.

[0014] Preferably, the playback subsystem includes a first playback subsystem and a second playback subsystem. The communication module of the first playback subsystem is communicatively connected to the operation subsystem, and the communication module of the first playback subsystem is also communicatively connected to the communication module of the second playback subsystem, so that the second playback subsystem can communicate with the operation subsystem through the communication module of the first playback subsystem.

[0015] Furthermore, the operation subsystem includes a built-in audio source object, which is communicatively connected to the audio playback platform.

[0016] On the other hand, the present invention provides an audio playback method, applied to the audio playback platform of the above-described audio playback system, the method comprising:

[0017] Receive focus request;

[0018] In response to the focus request, a focus arbitration process is performed to obtain a focus arbitration result; the focus arbitration result includes focus allocation information and playback status information;

[0019] The focus arbitration result is sent at least to the audio source object corresponding to the focus request, so that the audio source object sends audio data to the shared sound card according to the focus arbitration result;

[0020] The focus arbitration result is sent to the control module so that the control module controls the shared sound card to play the audio data based on the focus arbitration result.

[0021] Furthermore, the process of conducting focus arbitration in response to the focus request, and obtaining a focus arbitration result, includes:

[0022] In response to the focus request, focus arbitration is performed based on preset priority information to obtain the focus arbitration result; the preset priority information is information on the priority playback permissions of various audio source objects.

[0023] On the other hand, the present invention also provides a driving device, including the audio playback system described above.

[0024] On the other hand, the present invention also provides a storage medium storing at least one instruction or at least one program, wherein the at least one instruction or the at least one program is loaded and executed by a processor to implement the audio playback method described above.

[0025] Implementing this invention has the following beneficial effects:

[0026] 1. The audio playback system of the present invention provides a dedicated audio playback platform for focus arbitration processing, obtains the focus arbitration result, and transmits the focus arbitration result between the audio playback platform, the sound source object, and the control module to control the distribution of audio data and control the playback of audio data by the shared sound card, effectively coordinating the sound sequence, greatly avoiding simultaneous sound output, and reducing driving hazards.

[0027] 2. The audio playback system of the present invention uses a shared sound card, which can save on the sound card and related costs. Furthermore, the shared sound card is controlled exclusively by the operation subsystem, ensuring precise and reliable control and reducing the likelihood of sound conflicts.

[0028] 3. The first playback subsystem and the second playback subsystem of the present invention can interact with each other, so that the second playback subsystem can communicate indirectly with the operation subsystem through the first playback subsystem instead of directly communicating with the operation subsystem, thereby realizing information exchange between multiple playback subsystems and further avoiding simultaneous sound output. Attached Figure Description

[0029] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly described below. Obviously, the drawings described below are merely some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0030] Figure 1 A logical structure diagram of an audio playback method provided by the present invention;

[0031] Figure 2 A block diagram of an audio playback system provided by the present invention;

[0032] Figure 3 This is a block diagram of an audio playback system in a specific embodiment of the present invention;

[0033] Figure 4 This invention provides an information interaction flowchart between a playback subsystem and an audio playback platform.

[0034] Figure 5 This is a schematic diagram of the structure of an audio playback platform provided by the present invention;

[0035] Figure 6 This is a timing diagram of an audio playback method in a specific embodiment of the present invention;

[0036] Figure 7 This is a timing diagram of an audio playback method in another specific embodiment of the present invention. Detailed Implementation

[0037] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments, and therefore should not be construed as limiting the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0038] It should be noted that the terms "first," "second," etc., in the specification, claims, and drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention can be implemented in orders other than those shown in the figures or descriptions below. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or devices.

[0039] This embodiment addresses the problem in existing technologies where the instrument panel and entertainment subsystems of traditional in-vehicle infotainment systems have their own sound cards, operate completely independently, and do not communicate with each other, potentially causing driving hazards. It provides an audio playback system comprising a shared sound card, an operation subsystem, and at least one playback subsystem. The playback subsystem includes at least one audio source object, which is the top-level module of the playback subsystem, providing an application (APK) for functions such as playing music, radio, making Bluetooth calls, and providing voice prompts. The operation subsystem includes an audio playback platform, upon which the audio playback system can implement an audio playback method, such as... Figure 1 and Figure 2As shown, when a focus request occurs, the audio playback platform receives the focus request; in response to the focus request, the audio playback platform performs focus arbitration processing to obtain a focus arbitration result, which includes focus allocation information and playback status information; then, the audio playback platform sends the focus arbitration result to at least the audio source object corresponding to the focus request, so that the audio source object sends audio data to the shared sound card according to the focus arbitration result; the audio playback platform also sends the focus arbitration result to the control module, so that the control module controls the shared sound card to play audio data according to the focus arbitration result; this audio playback platform can effectively coordinate the sound output order of multiple audio source objects, avoid simultaneous sound output, reduce driving hazards, and ensure the safety of drivers and passengers.

[0040] Specifically, the operation subsystem also includes a control module, which is communicatively connected to the audio playback platform and in turn to the shared sound card. After the audio playback platform obtains the focus arbitration result, it sends the result to the control module, which then sends control instructions and other relevant information to the registers of the shared sound card based on the result. This controls the shared sound card to produce sound according to the focus arbitration result. The operation subsystem provides unique control over the shared sound card, ensuring reliable control logic and enabling rapid initialization of the shared sound card's functions.

[0041] Specifically, in one possible implementation, such as Figure 3 As shown, the operating subsystem is a Real-Time Operating System (RTOS). An RTOS is an operating system that can accept and process external events or data at a sufficiently fast speed, and whose processing results can control the production process or respond quickly to the processing system within a specified time, scheduling all available resources to complete real-time tasks and controlling all real-time tasks to run in a coordinated manner. This RTOS can respond in a timely manner, effectively improving the efficiency of focus arbitration processing and data transmission, with good real-time performance and reliability. Furthermore, the RTOS has good functional scalability. When increasing the number of playback subsystems in the audio playback system, the functions of the audio playback platform in the RTOS can be directly modified, and a send / receive thread for the playback subsystem can be added. The scope of modification is small, there are few restrictions on modification, and it is convenient.

[0042] In one alternative implementation, the real-time operating system includes any one of μClinux, μC / OS-II, eCos, FreeRTOS, mbed OS, RTX, Vxworks, QNX, NuttX, Dujiangyan OS (djyos), Alios Things, Huawei LiteOS, RT-Thread, and SylixOS.

[0043] In one alternative implementation, such as Figure 2 As shown, the audio playback platform (or RTOS) and the shared sound card communicate via the IIC transceiver interface, which is mainly used to transmit audio commands. It has low power consumption, strong anti-interference ability, and can effectively improve the accuracy and reliability of controlling the sound production process.

[0044] In this embodiment, at least one playback subsystem shares the same shared sound card with the operation subsystem, which can save on redundant sound cards and corresponding costs. In an optional implementation, the shared sound card is a DSP sound card. On the other hand, the audio playback system also controls the playback behavior and playback content (i.e., audio data) of the shared sound card through the operation subsystem, which can effectively improve the simplicity and reliability of control, and the control logic is precise. This greatly avoids the situation where multiple playback subsystems emit sound at the same time, masking important prompts, thereby ensuring that warning prompts are played first, reducing driving hazards, and greatly improving driving safety.

[0045] Specifically, the playback subsystem also includes a communication module, which is used for information transmission with the operation subsystem. This module can send focus requests from the playback subsystem and receive focus arbitration results from the operation subsystem. Furthermore, such as Figure 3 As shown, within the playback subsystem, there is an intermediate layer and an audio command control module (AudioControl) between the audio source object and the communication module. The intermediate layer can provide functions such as arbitration, mixing, and volume control logic, while the audio command control module interacts with the upper layer, the intermediate layer, and the audio source object, and exchanges information with the lower layer and the communication module to transmit data signals.

[0046] In an optional implementation, the communication module includes a first communication module that is directly connected to the operation subsystem. The first communication module is capable of receiving data signals sent by the audio source object in the playback subsystem and sending the data signals to the operation subsystem. It is also capable of receiving data signals fed back by the operation subsystem and optionally sending them to the upper-level audio source object.

[0047] In one specific embodiment, the first communication module is a Router (SPI) transceiver module. On the one hand, the audio command control module of the playback subsystem can send information on setting the DSP sound card to the microcontroller unit (MCU) of the RTOS through the SPI interface, so that the RTOS can control the DSP sound card to produce sound. On the other hand, it can also receive the MCU's response through the SPI interface, thereby controlling the transmission of audio data in the sound source object, making the transmission efficient and convenient.

[0048] In an optional implementation, the communication module includes a second communication module that can directly communicate with a second communication module in another playback subsystem, thereby enabling information exchange between playback subsystems and achieving information communication between multiple playback subsystems. Correspondingly, the audio playback system includes multiple playback subsystems, including a first playback subsystem and a second playback subsystem. The communication module of the first playback subsystem is directly connected to the operation subsystem, and the first playback subsystem includes a first communication module and a second communication module. The second playback subsystem is indirectly connected to the operation subsystem, and the second playback subsystem includes a second communication module. That is, the second communication modules of the first playback subsystem and the second communication module of the second playback subsystem are connected to each other, so that the second playback subsystem can transmit data signals to the operation subsystem through the first communication module of the first playback subsystem, thereby achieving communication between multiple systems.

[0049] When the audio playback system includes one playback subsystem, the playback subsystem includes a first communication module to ensure the effectiveness of audio focus arbitration by the audio playback platform. When the audio playback system includes at least two playback subsystems, each playback subsystem includes a second communication module. However, one of the playback subsystems can be configured with the first communication module so that multiple playback subsystems can communicate directly or indirectly with the first communication module, thereby establishing a communication connection with the operation subsystem. This ensures the reliability of the transmission of focus requests and focus arbitration results, while also saving the first communication module and making the communication path simpler and more flexible.

[0050] In one specific embodiment, the second communication module is a Socket transceiver module. The audio command control module of the second playback subsystem sends information on setting the DSP sound card to the first playback subsystem with an SPI interface through the Socket transceiver interface. This information on setting the DSP sound card can then be further transmitted to the microcontroller unit of the RTOS through the SPI interface, and the response from the MCU can be received in reverse. The data transmission time is short and the transmission reliability is high.

[0051] Corresponding to the communication module, the operation subsystem includes a third communication module, which is directly connected to the first communication module to realize the data signal transmission between the operation subsystem and the playback subsystem; at the same time, the third communication module is also connected to the audio playback platform to enable the data signal to be transmitted within the operation subsystem.

[0052] Specifically, such as Figure 4As shown, when a sound playback request occurs, the audio command control module (AudioControl or Audio Command Control) of the playback subsystem transmits the audio playback request command to the sending thread. At this time, the audio command control module is blocked, waiting for the response from the RTOS and the information from the receiving thread. Meanwhile, the sending thread generates focus request information according to the protocol and sends the focus request information to the third communication module of the RTOS through the communication module, which then transmits it to the audio playback platform. After the focus arbitration is processed by the audio playback platform, it is sent to the receiving thread. The receiving thread receives the RTOS callback and generates the focus arbitration result information according to the protocol, which is then sent back to the communication module of the playback subsystem. At this time, the audio command control module receives the response, unblocks the main thread, and completes a focus request.

[0053] Specifically, the operating subsystem RTOS includes a built-in sound source object, meaning that the RTOS itself also has sound generation capabilities and can generate focus requests. This built-in sound source object communicates with the audio playback platform, thereby sending the focus request to the audio playback platform for focus arbitration processing to meet the need for fast sound playback after the RTOS boots up.

[0054] It should be noted that the above communication modules (including the first and second communication modules) and the third communication module are all modules used for data communication. The objects sent and received are data of the type of instructions such as audio playback commands (as shown by the solid arrows in the figure), including focus requests and focus arbitration results. As for the download of audio data, it is directly downloaded from the corresponding audio source object to the shared sound card (as shown by the dashed arrows in the figure), without going through the RTOS. The transmission path is simple, efficient and fast.

[0055] like Figure 2 As shown, in one possible implementation, the playback subsystem and / or operation subsystem further include an IIS driver module, which is used to send audio data to the shared sound card. At the same time, the IIS driver module also transmits audio parameters related to the audio data to the shared sound card so that the shared sound card can accurately play the audio data. For example, when the focus arbitration result is that the RTOS obtains audio focus, the audio source object in the RTOS directly writes audio data to the IIS driver module, and then the IIS driver module continues to send the audio data to the IIS interface of the shared sound card, completing the audio data sending process.

[0056] Specifically, such as Figure 3As shown, the playback subsystem also includes the TinyAlsa audio module, located between the IIS driver module and the middleware layer of the playback subsystem. The TinyAlsa audio module includes an audio database (TinyAlsaData), which is used to receive audio source data transmitted by the audio source object through the middleware layer, and enables the audio hardware abstraction layer (AudioHal) at the bottom layer of the playback subsystem to write audio data to the IIS driver module through the audio database (TinyAlsaData), thereby realizing the transmission of audio data.

[0057] Meanwhile, the TinyAlsa audio module also includes an audio data control module (TinyAlsaCmd), which is communicatively connected to the audio command control module and located between the audio command control module and the IIS driver module. It receives the focus arbitration result fed back from the audio playback platform via the first communication module, sets the driver parameters of the IIS driver module according to the focus arbitration result, controls the IIS driver module to start, and continues to send audio data to the shared sound card for better audio data transmission.

[0058] Specifically, such as Figure 5 As shown, the audio playback platforms include:

[0059] Receiver module 510 is used to receive focus requests;

[0060] Arbitration module 520 is used to respond to the focus request, perform focus arbitration processing, and obtain a focus arbitration result; the focus arbitration result includes focus allocation information and playback status information;

[0061] The first sending module 530 is used to send the focus arbitration result to at least the audio source object corresponding to the focus request, so that the audio source object sends audio data to the shared sound card according to the focus arbitration result;

[0062] The second sending module 540 is used to send the focus arbitration result to the control module, so that the control module controls the shared sound card to play the audio data according to the focus arbitration result.

[0063] The receiving module and the first sending module can be integrated into the same third communication module, reducing the complexity of the instruction transmission path.

[0064] It should be noted that the audio playback platform provided above is only an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, this audio playback platform and the method embodiment described below belong to the same concept, and the specific implementation process can be found in the method embodiment, which will not be repeated here.

[0065] Corresponding to the aforementioned audio playback platform, this invention also provides an audio playback method. The technical solution of this invention will be described in detail below, with reference to the appendix to the specification. Figure 1 The method includes:

[0066] S101, Receive focus request.

[0067] The focus request is a request sent by the audio source object (or the built-in audio source object) to request audio focus from the audio playback platform. The focus request includes the identification information of the audio source object that sent the focus request. The identification information represents the playback permissions of the audio source object so that the audio playback platform can make logical judgments based on the identification information.

[0068] Optionally, the identification information includes the purpose information of the audio source object; optionally, the identification information includes the type information of the audio source object; and even more optionally, the identification information includes the location information of the audio source object, that is, the information of the system (corresponding to a playback subsystem and an operation subsystem) in which the audio source object is located; at least one of the purpose information, type information and location information corresponds to the playback permissions of the audio source object.

[0069] When any playback subsystem (or RTOS) has a playback requirement, it will generate a focus request according to the intermediate layer protocol and send it out through the communication module. In the operation subsystem, the audio playback platform can receive the focus request through the third communication module.

[0070] Optionally, the system that issues the focus request can be at least one of the operation subsystem and at least one playback subsystem; in one possible implementation, the system that issues the focus request can be any playback subsystem or the operation subsystem; in another possible implementation, when at least two playback subsystems have playback needs, the system that issues the focus request can be at least two playback subsystems, and the two playback subsystems compete for audio focus to obtain playback rights.

[0071] S103, in response to the focus request, perform focus arbitration processing to obtain a focus arbitration result; the focus arbitration result includes focus allocation information and playback status information.

[0072] The focus arbitration result indicates the allocation of audio focus according to the arbitration agreement. The focus allocation information includes information about the audio source object that has obtained the audio focus, indicating that the audio focus is currently allocated to this audio source object, and the audio data of this audio source object can be played first. The playback status information includes information about the current playback status of the audio source object. Combining the focus allocation information and the playback status information, it can be determined that the playback status of the audio source object that has obtained the audio focus will be changed to the playback status, while the playback status of other audio source objects will be changed to the stopped playback status, effectively avoiding confusion caused by simultaneous sound.

[0073] According to the focus arbitration result, if the focus allocation information is consistent with the identification information of the focus request, the audio source object that sent the focus request successfully preempts the request, and continues to execute steps S105 to S107, so that the audio source object that sent the focus request can make a sound; if the focus allocation information is inconsistent with the identification information, the audio source object that sent the focus request fails to preempt the request, and the shared sound card maintains the current playback state.

[0074] S105, the focus arbitration result is sent to at least the audio source object corresponding to the focus request, so that the audio source object sends audio data to the shared sound card according to the focus arbitration result.

[0075] Specifically, in steps S101 and S105, the playback subsystem and the operation subsystem exchange information according to the protocols shown in Tables 1 and 2. For example, byte 3 (parameter 2) in Table 1 indicates that when the entertainment subsystem (Android) sends data to the RTOS, this byte is set to ROUTE_ID_ANDROID_AUIDO by the entertainment subsystem. When the RTOS responds, this byte is set to ROUTE_ID_ANDROID_AUIDO or ROUTE_ID_ANDROID_CLUSTER_AUIDO by the RTOS. Furthermore, while sending audio data, the IIS driver module also transmits audio parameters related to the audio data to the shared sound card. These audio parameters include audio format parameters (pc...). The audio parameters (m_format), audio channel parameters (pcm_channel), and audio sampling rate parameters (pcm_rate) are shown in rows 6 and 7 of Table 1. When the playback subsystem sends information to the operation subsystem, the information about the audio parameters is sent according to the "AUDIO_CMD_SET_AUDIO_ATTR" protocol to request the operation subsystem to perform focus arbitration processing and determine the values ​​of each audio parameter. After receiving the response from the operation subsystem, the values ​​of each audio parameter are received according to the "AUDIO_CMD_SET_AUDIO_ATTR_Response" protocol. This allows the audio parameters to be further transmitted to the shared sound card through the IIS driver module while the audio data is being sent, thus controlling the playback of the audio data.

[0076] Furthermore, in this step, when the focus arbitration result indicates a change in the current playback state and focus state, the operation subsystem actively reports a message to the playback subsystem according to the protocol shown in Table 3. The target of the focus arbitration result can be selected to be sent to the audio source object corresponding to the focus request, or it can be selected to be sent to multiple or even all audio source objects (or playback subsystems), regardless of which audio source object caused the change in the current playback state and focus state. This strengthens the information interaction between multiple playback subsystems, providing good flexibility and high reliability. For example, the third byte (parameter 2) in Table 3 indicates that when the MCU of the operation subsystem actively reports, this byte is set by the MCU to ROUTE_ID_ANDROID_AUIDO or ROUTE_ID_ANDROID_CLUSTER_AUIDO.

[0077] Table 1. Protocol for information exchange between the playback subsystem and the operation subsystem (bytes 0-18)

[0078]

[0079]

[0080] Table 2. Protocol for information exchange between the playback subsystem and the operation subsystem (bytes 12-18)

[0081]

[0082] Table 3. Protocols actively reported by the operation subsystem to the playback subsystem

[0083]

[0084]

[0085] S107, the focus arbitration result is sent to the control module so that the control module controls the shared sound card to play the audio data according to the focus arbitration result.

[0086] This audio playback platform communicates with the control module to exchange information, enabling the control module to receive the focus arbitration result and control the shared sound card to play the received audio data based on the focus arbitration result. The control logic is simple and reliable.

[0087] Specifically, the process of conducting focus arbitration in response to the focus request and obtaining a focus arbitration result includes:

[0088] In response to the focus request, focus arbitration is performed based on preset priority information to obtain the focus arbitration result; the preset priority information is information on the priority playback permissions of various audio source objects.

[0089] The playback permissions of audio source objects are implemented through the priority of playback permissions, i.e., the preset priority information, which represents the playback order of each audio source object when there is a simultaneous playback demand. In one possible implementation, the preset priority information is sorted as follows: the priority of the RTOS is higher than the priority of the instrument subsystem, and the priority of the instrument subsystem is higher than the priority of the entertainment subsystem. In this case, the higher priority audio source object will preempt the lower priority audio source object, and the latter will interrupt the former in the case of the same priority.

[0090] In another possible implementation, the preset priority order in the preset priority information is: Safety > Communication > Voice > Media > System Prompts. Among these, the Safety category (SafetyAlert, Chime) consists of brief warning announcements and prompts, such as serious fault announcements and driver assistance prompts. This Safety category audio source object has the highest priority and cannot be interrupted by any other type of audio source object, except for subsequent events of the same type. The Communication category (BCall, BT-Call, RingTone, VOIP) has a lower priority than the Safety category in driving scenarios. The Voice category (VoiceRecognition, Navigation, Notification) is real-time information with high information density, and its priority is lower than the Safety and Communication categories. When a Safety or Communication category audio source object has a playback request, it will preempt the Voice category audio source object. The Media category (FM, AM, USB-Music, BT-Music, OnlineMusic, OnlineRadio, OnlineVideo) and the System prompt category (System) have lower priorities and are easily preempted by higher-priority audio source objects.

[0091] Taking a specific implementation process as an example, such as Figure 3 As shown, the playback subsystem includes an instrument subsystem and an entertainment subsystem. The operating subsystem is an RTOS. Both the entertainment subsystem and the instrument subsystem include Socket transceiver interfaces. The entertainment subsystem and the instrument subsystem communicate with each other through their respective Socket transceiver interfaces. The instrument subsystem also communicates with the RTOS through an SPI interface. Through the Socket transceiver interface and the SPI interface, the instrument subsystem, the entertainment subsystem, and the RTOS can achieve three-way interaction. In addition, the RTOS also communicates with the shared sound card, which can uniquely control the shared sound card to play audio data, effectively coordinate the sound playback order, avoid simultaneous sound playback, and greatly improve driving safety.

[0092] When a single subsystem in the audio playback system requests focus, for example, Figure 6As shown, if the instrument subsystem requests playback but no other subsystem requests it, the instrument subsystem sends a focus request to the RTOS, requesting audio focus AUDIO_CMD_REQUEST_FOCUS. After the audio playback platform in the RTOS performs focus arbitration, it returns the focus arbitration result AUDIO_CMD_REQUEST_FOCUS_REPONSE to the instrument subsystem. Only after the instrument subsystem obtains the audio focus can it start playback. In addition, the RTOS also notifies the instrument subsystem and the entertainment subsystem of the specific information of the focus arbitration result, namely, UNSOLICITED_CMD_AUDIO_FOCUS. The Chime type focus status is Granted, which means that the current audio focus has been successfully preempted by the instrument subsystem's Chime type tone.

[0093] When two subsystems in an audio playback system request focus, for example, ... Figure 7 As shown, the entertainment subsystem has already acquired audio focus and is playing. At this time, the instrumentation subsystem requests sound and requests playback from the RTOS. Since the instrumentation subsystem has higher priority than the entertainment subsystem, it will preempt the audio focus. During this process, the instrumentation subsystem sends a focus request to the RTOS, requesting the audio focus "AUDIO_CMD_REQUEST_FOCUS warning tone". After the audio playback platform performs focus arbitration, it returns the arbitration result "Granted AUDIO_CMD_REQUEST_FOCUS_REPONSE" to the instrumentation subsystem, indicating that the instrumentation subsystem has successfully preempted the audio focus. The instrumentation subsystem then begins playback, while the entertainment subsystem stops playing. Furthermore, the RTOS also notifies both the instrumentation and entertainment subsystems of the specific information regarding the focus arbitration result, namely UNSOLICITED_CMD_AUDIO_FOCUS. The Media type focus state is LOSS, and the warning tone type focus is Granted, which means that the current audio focus has been successfully preempted by the warning tone of the instrument subsystem. The entertainment subsystem can choose to interact with the upper intermediate layer or the sound source object or not interact with the upper layer, which is flexible and reliable.

[0094] As can be seen from the above embodiments, the audio playback system and audio playback method in the embodiments of the present invention have the following beneficial effects:

[0095] 1. The audio playback system of the present invention provides a dedicated audio playback platform for focus arbitration processing to obtain the focus arbitration result, and transmits the focus arbitration result between the audio playback platform, the sound source object and the control module to control the audio data distribution and control the shared sound card to play the audio data, coordinate the sound output order, greatly avoid simultaneous sound output, reduce driving hazards and improve driving safety.

[0096] 2. The audio playback system of the present invention uses a shared sound card, which can save on the sound card and related costs. Furthermore, the shared sound card is controlled exclusively by the operation subsystem, ensuring precise and reliable control and reducing the likelihood of sound conflicts.

[0097] 3. The first playback subsystem and the second playback subsystem of the present invention can interact with each other, so that the second playback subsystem can communicate indirectly with the operation subsystem through the first playback subsystem instead of directly communicating with the operation subsystem, thereby realizing information exchange between multiple playback subsystems and further avoiding simultaneous sound output.

[0098] 4. The operating subsystem of this invention is a real-time operating system with good real-time performance and a startup time of only a few hundred milliseconds, enabling it to start up and make sounds quickly.

[0099] This invention also provides a driving device, including a main controller and the aforementioned audio playback system. The audio playback system can be integrated into the main controller, which controls the information interaction between various subsystems. The main controller includes a processor and a memory. The processor (or CPU (Central Processing Unit)) is the core component of the audio playback system, and its main function is to interpret memory instructions and process data fed back by various monitoring modules or acquisition modules. The processor's structure is roughly divided into an arithmetic logic unit and a register unit. The arithmetic logic unit mainly performs related logical calculations (such as shift operations, logical operations, fixed-point or floating-point arithmetic operations, and address operations), while the register unit is used to temporarily store instructions, data, and addresses.

[0100] A memory is a storage device used to store software programs and modules. A processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory may primarily include a program storage area and a data storage area. The program storage area may store the operating system, including but not limited to Windows, Linux, etc., which are not limited in this invention. Furthermore, it may store application programs required for functions. For example, the memory storage space may also contain at least one instruction suitable for loading and execution by the processor; these instructions may be one or more computer programs (including program code). The data storage area may store data created based on the use of the device. Accordingly, the memory may also include a memory controller to provide the processor with access to the memory.

[0101] This invention also provides a storage medium storing at least one instruction or at least one program segment, which is loaded and executed by a processor to implement the audio playback method described above. Optionally, the storage medium may be located at at least one network server among multiple network servers in a computer network. Furthermore, the storage medium may include, but is not limited to, random access memory (RAM), read-only memory (ROM), USB flash drive, portable hard drive, disk storage device, flash memory device, other volatile solid-state storage devices, and other storage media capable of storing program code.

[0102] It should be noted that the order of the above embodiments of the present invention is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, specific embodiments have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0103] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0104] The above description is merely some embodiments of the present invention and is not intended to limit the present invention. Those skilled in the art should understand that the present invention can have various changes and improvements, and any modifications, equivalent substitutions and improvements made in accordance with the present invention fall within the scope of protection claimed by the present invention.

Claims

1. An audio playback system, characterized by, The audio playing system comprises a shared sound card, an operation subsystem and at least one playing subsystem, the shared sound card is a shared sound card of the at least one playing subsystem and the operation subsystem, the playing subsystem comprises at least one sound source object, the operation subsystem comprises a control module and an audio playing platform connected in communication, the control module is connected in communication with the shared sound card, the operation subsystem comprises a built-in sound source object, the built-in sound source object is connected in communication with the audio playing platform, and the audio playing platform comprises: The receiving module is configured to receive a focus request. The arbitration module is configured to perform focus arbitration processing in response to the focus request to obtain a focus arbitration result, wherein the focus arbitration result comprises focus allocation information and playing state information. The first sending module is configured to send the focus arbitration result to at least the sound source object corresponding to the focus request, so that the sound source object sends audio data to the shared sound card according to the focus arbitration result. The second sending module is configured to send the focus arbitration result to the control module, so that the control module controls the shared sound card to play the audio data according to the focus arbitration result.

2. The audio playback system of claim 1, wherein, The playing subsystem further comprises a communication module, and the communication module is configured to perform information transmission with the operation subsystem.

3. The audio playback system of claim 2, wherein, The communication module is connected in communication with the operation subsystem.

4. The audio playback system of claim 2, wherein, The playing subsystem comprises a first playing subsystem and a second playing subsystem, the communication module of the first playing subsystem is connected in communication with the operation subsystem, and the communication module of the first playing subsystem is further connected in communication with the communication module of the second playing subsystem, so that the second playing subsystem is connected in communication with the operation subsystem through the communication module of the first playing subsystem.

5. An audio playback method, characterized by, The audio playing platform applied to the audio playing system of any one of claims 1-4, the method comprises: Receiving a focus request; Performing focus arbitration processing in response to the focus request to obtain a focus arbitration result, wherein the focus arbitration result comprises focus allocation information and playing state information. Sending the focus arbitration result to at least the sound source object corresponding to the focus request, so that the sound source object sends audio data to the shared sound card according to the focus arbitration result. Sending the focus arbitration result to the control module, so that the control module controls the shared sound card to play the audio data according to the focus arbitration result.

6. The audio playback method of claim 5, wherein, The response to the focus request, performing focus arbitration processing to obtain a focus arbitration result comprises: In response to the focus request, performing focus arbitration processing according to preset priority information to obtain the focus arbitration result, wherein the preset priority information is information of priority playing rights of a plurality of sound source objects.

7. A driving apparatus characterized by comprising: The audio playing system of any one of claims 1-4.

8. A storage medium, characterized by The storage medium stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to realize the audio playing method of any one of claims 5-6.

Citation Information

Patent Citations

  • Arbitration method and device for vehicle-mounted audio focus

    CN113794968A