A data processing method, system, device, program product and storage medium

Abstract

The application discloses a data processing method, system, device, program product and storage medium. Target data information sent by a master control chip is acquired through an audio channel between the master control chip and a first chip. The target data information includes media data to be processed by the first chip. The media data is processed to obtain a data processing result. The data processing result is sent to the master control chip, so that the master control chip performs a corresponding target operation based on the data processing result. By introducing the first chip, part of complex algorithm operation tasks are transferred from the master control chip to the first chip, so that the master control chip can perform the corresponding target operation based on the data processing result of the first chip, and the computing power burden of the master control chip is effectively reduced.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method, system, device, program product, and storage medium. Background Technology

[0002] With the development of automotive intelligence, modern in-vehicle audio systems not only need to provide high-quality basic audio playback functions, but also integrate a variety of advanced audio processing algorithms, such as speech recognition, karaoke effect processing, and media sound enhancement. These algorithms are crucial for improving the user experience. For example, speech algorithms enable vehicles to better understand and respond to the driver's voice commands; karaoke algorithms can significantly improve the in-car karaoke experience; and media sound effect algorithms can provide a richer and more immersive music experience.

[0003] However, these advanced audio processing algorithms often come with high computational complexity. When an in-vehicle audio system needs to run multiple algorithms simultaneously, it puts immense pressure on the system's computing resources. This is especially true when real-time audio processing is involved, as the system needs to complete a large number of data processing tasks in a short period, placing even higher demands on processor performance. Currently, the mainstream in-vehicle infotainment solutions on the market use Qualcomm's SA8295P chip. Although this chip integrates a dedicated digital signal processor (DSP) designed to improve audio processing efficiency, its limited built-in DSP computing power still makes it difficult to meet the demands of running multiple advanced audio processing algorithms simultaneously. When multiple algorithms are running concurrently, it can lead to system resource overload, causing problems such as stuttering and noise during audio playback, severely impacting the user experience.

[0004] Therefore, how to effectively manage the computing resources of in-vehicle audio systems and ensure the efficient operation of multiple algorithms under limited hardware conditions has become an urgent problem to be solved in the field of in-vehicle audio technology. Summary of the Invention

[0005] In view of the above problems, this application provides a data processing method, system, device, program product and storage medium.

[0006] To address the above problems, the technical solutions provided in this application are as follows:

[0007] The first aspect of this application provides a data processing method, including:

[0008] The target data information sent by the main control chip is obtained through the audio path between the main control chip and the first chip. The target data information includes media data to be processed by the first chip.

[0009] The media data is processed to obtain the data processing result;

[0010] The data processing results are sent to the main control chip so that the main control chip can perform the corresponding target operation based on the data processing results.

[0011] In one possible implementation, processing the media data to obtain a data processing result includes:

[0012] The received target data information is parsed to obtain control information, which is used to instruct sound effects. algorithm The media data is processed;

[0013] When the control information includes a playback audio identifier, the sound effect algorithm interface corresponding to the playback audio identifier is called, and the sound effect algorithm interface is initialized.

[0014] Based on the configuration information obtained during initialization, the media data to be processed is processed to obtain the processed data result.

[0015] In one possible implementation, after parsing the received target data information to obtain control information, the method further includes:

[0016] When the control information includes a parameter setting identifier, the sound effect algorithm interface corresponding to the parameter setting identifier is called to configure the parameters of the sound effect algorithm module indicated by the control information. The sound effect algorithm module is a software component that implements sound effect functions and contains at least one preset algorithm.

[0017] The process of processing the media data to be processed based on the configuration information obtained during initialization, to obtain the processed data results, includes:

[0018] Based on the configuration information obtained during initialization and the audio effect algorithm module after parameter configuration, the media data to be processed is processed to obtain the processed data processing result.

[0019] In one possible implementation, when the control information includes a parameter setting identifier, calling the sound effect algorithm interface corresponding to the parameter setting identifier to configure the parameters of the sound effect algorithm module indicated by the control information includes:

[0020] When the control information includes parameter setting identifier and parameter configuration information, the sound effect algorithm interface corresponding to the parameter setting identifier is called, and the parameters of the sound effect algorithm module indicated by the control information are configured based on the parameter configuration information.

[0021] In one possible implementation, the method further includes:

[0022] When the control information includes a stop playback identifier, the sound effect algorithm interface is called to perform an algorithm pause operation. The algorithm pause operation is used to indicate that the sound effect algorithm currently in execution is paused.

[0023] In one possible implementation, the method further includes:

[0024] When the pause operation is completed, all data processing operations on the media data are paused.

[0025] In one possible implementation, obtaining the target data information sent by the main control chip through the audio path between the main control chip and the first chip includes:

[0026] The target data information sent by the main control chip is obtained through the audio path corresponding to the first port between the main control chip and the first chip.

[0027] The step of sending the data processing result to the main control chip, so that the main control chip can perform the corresponding target operation based on the data processing result, includes:

[0028] The data processing result is sent to the main control chip through the second port, so that the main control chip can mix the processed data result with the local data information of the main control chip to obtain audio output data for sending to the serial audio bus through the third port.

[0029] A second aspect of this application provides a data processing system, comprising:

[0030] A main control chip and a first chip, the first chip being connected to the main control chip, are used to execute the data processing method described in the first aspect above.

[0031] A third aspect of this application provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the data processing method described in the first aspect above.

[0032] The fourth aspect of this application provides a computer program product that, when run on a computer, executes the data processing method described in the first aspect above.

[0033] The fifth aspect of this application provides a computer-readable storage medium storing instructions that, when executed on a terminal device, cause the terminal device to perform the data processing method described in the first aspect above.

[0034] Compared with the prior art, this application has the following beneficial effects:

[0035] The target data information sent by the main control chip is obtained through the audio path between the main control chip and the first chip. This target data information includes media data to be processed by the first chip. The media data is processed to obtain a data processing result. This data processing result is sent back to the main control chip as the basis for the next operation. After receiving the data processing result, the main control chip executes the corresponding target operation based on it. By introducing the first chip, some complex algorithm calculation tasks are transferred from the main control chip to the first chip, allowing the main control chip to execute the corresponding target operation based on the data processing result of the first chip, effectively reducing the computational burden on the main control chip. Since the computational power of the main control chip is freed up, it no longer needs to process multiple complex audio algorithms simultaneously. The main control chip can run other tasks more stably, avoiding playback stuttering, noise, and other problems caused by insufficient computational power. Therefore, it effectively solves the problems of high resource consumption, playback stuttering, noise, and system stability caused by the simultaneous operation of multiple algorithms in existing in-vehicle audio systems. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in this embodiment or the prior art, the drawings used in the description of the embodiment or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0037] Figure 1 A flowchart illustrating a data processing method provided in an embodiment of this application;

[0038] Figure 2 This is a schematic diagram of the vehicle system framework provided in an embodiment of this application;

[0039] Figure 3 This is a structural diagram of a data processing system provided in an embodiment of this application. Detailed Implementation

[0040] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0041] To facilitate understanding of the technical solutions provided in the embodiments of this application, the technical terms involved in the embodiments of this application will be explained below.

[0042] The in-vehicle infotainment system (Head Unit, HU) is the multimedia entertainment and navigation control system installed inside a car. It typically integrates functions such as a radio, CD player, Bluetooth connectivity, navigation system, and reversing camera. Modern in-vehicle infotainment systems may also support advanced features such as smartphone connectivity, touchscreen operation, and voice control. The in-vehicle infotainment system is an indispensable part of modern cars, providing a wealth of driving assistance and entertainment experiences.

[0043] Digital Signal Processing (DSP) is a technology that uses mathematical algorithms to process digital signals. A DSP chip is a microprocessor specifically designed to execute these algorithms, enabling it to efficiently handle complex signal processing tasks in real-time environments. In automotive electronics, DSPs are commonly used for applications such as audio processing, noise suppression, and echo cancellation. In the embodiments of this application, both aDSP and DSP refer to a DSP chip, i.e., a chip capable of implementing digital signal processing technology.

[0044] Time Division Multiplexing (TDM) is a digital audio interface technology that transmits multiple independent audio channels by sharing the same physical line. Each channel occupies the line for a predetermined time period, thus achieving efficient transmission of multi-channel audio data. TDM is widely used in professional audio equipment and car audio systems, reducing wiring complexity and improving system reliability.

[0045] A2B, short for Audio over Broadband (A2B), is a high-bandwidth, bidirectional digital audio bus technology developed by Analog Devices. A2B technology allows for the transmission of high-quality audio data and control signals over long distances at a lower cost, while also supporting multi-node networks. In automotive audio systems, A2B can significantly reduce the number and weight of cables, improving system reliability and flexibility.

[0046] The Serial Peripheral Interface (SPI) is a high-speed, full-duplex, synchronous communication bus widely used in embedded systems. SPI typically consists of four lines: MOSI (Master Out Slave In), MISO (Master In Slave Out), SCLK (Serial Clock), and SS / CS (Slave Select / Chip Select). The SPI protocol is simple and flexible, suitable for short-distance, high-speed data transmission, and is commonly used to connect microcontrollers to various peripherals such as sensors, memory, and displays.

[0047] To facilitate understanding of the technical solutions provided in the embodiments of this application, the background technology involved in the embodiments of this application will be described below.

[0048] As mentioned earlier, existing in-vehicle audio systems require the computation of multiple algorithms, such as voice algorithms, karaoke algorithms, and media sound effect algorithms. When multiple algorithms are processed simultaneously, they consume significant system computing resources. The Qualcomm SA8295P chip used in current in-vehicle infotainment systems has limited built-in aDSP computing power, which cannot meet the requirements for running all of these algorithms simultaneously. Forcing multiple algorithms to run concurrently can result in stuttering and noise during audio playback, and may also affect the stability of the in-vehicle infotainment system.

[0049] To address the aforementioned issues, this application embodiment provides a method for acquiring target data information sent by the main control chip via an audio path between the main control chip and the first chip. This target data information includes media data to be processed by the first chip. The media data received by the first chip is processed to obtain a data processing result. The first chip can be specifically designed to execute specific audio algorithms, such as voice algorithms, karaoke algorithms, and media sound effect algorithms. This shifts the computational burden of the main control chip to the first chip, thereby reducing the load on the main control chip. The data processing result is then sent back to the main control chip via the audio path. Upon receiving the data processing result, the main control chip executes the corresponding target operation based on the data processing result.

[0050] Therefore, by processing some audio algorithms through a first chip, this application can significantly reduce the computational burden on the main control chip, avoiding problems such as audio stuttering and noise caused by insufficient resources. The main control chip no longer needs to process multiple complex audio algorithms simultaneously, thereby improving the overall stability and response speed of the audio processing system. Furthermore, the main control chip can focus on other critical tasks, such as system management and user interface interaction, thus utilizing system resources more efficiently.

[0051] The first chip can be an external chip. In practical applications, the first chip can be specifically designed to process specific audio algorithms, such as voice algorithms, karaoke algorithms, and media sound effect algorithms. This specialized design ensures the efficiency and accuracy of audio processing, thereby improving the quality of the final audio output and reducing stuttering and noise. Furthermore, through the design of the first chip, the system can flexibly select first chips with different performance levels according to actual needs, and can even add multiple first chips to further enhance processing capabilities. This flexibility allows the system to better adapt to different application scenarios. The introduction of the first chip allows the system to flexibly add or replace algorithms without requiring hardware upgrades or redesign of the main control chip.

[0052] For example, suppose the current vehicle infotainment system needs to run a voice recognition algorithm, a karaoke effect processing algorithm, and a media audio enhancement algorithm simultaneously. The main control chip (Qualcomm SA8295P) sends the audio data to be processed to the first chip via the TDM interface. The first chip is responsible for processing the karaoke effect and media audio enhancement, and then returns the processed data to the main control chip via the TDM interface. The main control chip then mixes this processed data with the local voice recognition results, and finally outputs high-quality audio. Through the data processing method provided in this application embodiment, even when multiple algorithms are running simultaneously, the smoothness and stability of the audio system can be guaranteed, improving the user experience.

[0053] It should be noted that the data processing methods, systems, devices, program products, and storage media provided in this application can be applied to the field of computer technology. The above are merely examples and do not limit the application areas of the data processing methods, systems, devices, program products, and storage media provided in this application. Furthermore, the embodiments of this application may not limit the executing entity of the data processing; for example, the data processing method of the embodiments of this application can be applied to data processing devices such as terminal devices or servers. The terminal device can be an electronic device such as a smartphone, computer, personal digital assistant (PDA), or tablet computer. The server can be a standalone server, a cloud server, or a cluster server composed of multiple servers.

[0054] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0055] The following embodiment illustrates a data processing method provided in this application. See also: Figure 1 ,Should Figure 1 A flowchart of a data processing method provided in this application embodiment, applied to a first chip connected to a main control chip, the method comprising:

[0056] S101. Obtain the target data information sent by the main control chip through the audio path between the main control chip and the first chip.

[0057] The main control chip and the first chip can establish a stable audio path through TDM (Time Division Multiplexing) or other compatible audio interfaces. TDM is a technology that allows multiple audio signals to share the same physical channel, achieving simultaneous transmission of multiple signals through time-slice allocation, and is suitable for audio data transmission scenarios requiring high real-time performance and stability.

[0058] The target data information contains the audio data to be processed by the first chip. This data can be raw media data, such as an unprocessed recording file, or data that has already undergone preliminary processing by the main control chip, such as basic noise suppression or format conversion. The target data information may also contain control instructions or metadata to guide the first chip on how to process the audio data, such as applying specific sound effect algorithms or adjusting processing parameters.

[0059] The main control chip sends the target data information to the first chip through the audio path. The encoding process may include, but is not limited to, compression and format conversion to improve transmission efficiency and data integrity.

[0060] To ensure the reliability and accuracy of data transmission, the main control chip adds necessary synchronization and error detection information to the encoded data. Synchronization information ensures the receiving end can correctly identify the start position of the data frame, while error detection information (such as checksums) detects potential errors during transmission. The main control chip sends the encoded target data information to the first chip through the established audio path. Upon receiving the target data information, the first chip first performs decoding to recover the original target data information. During decoding, it checks the synchronization and error detection information to ensure data integrity and accuracy. The decoded target data information is stored in a buffer, ready for subsequent audio effect algorithm processing.

[0061] Therefore, through encoding and synchronization mechanisms, the efficiency and reliability of data transmission are ensured. Adding error detection information can effectively detect and correct errors during transmission, improving the robustness of the system.

[0062] Whether it's raw audio data or pre-processed data, the first chip can receive it and perform further processing, improving the system's adaptability and processing capabilities. By offloading some audio processing tasks to the first chip, the workload of the main control chip can be effectively reduced, thereby saving resources and extending the equipment's lifespan.

[0063] S102. Process the media data to obtain the data processing result.

[0064] In step S101, the first chip has received the target data information from the main control chip through the audio path, which includes the media data to be processed. A series of processing operations are performed on the media data received by the first chip to generate the final data processing result.

[0065] Before processing begins, the first chip can perform some preprocessing on the received media data, such as decoding, format conversion, or synchronization adjustments. These preprocessing steps depend on the original format of the media data and the processing capabilities of the first chip.

[0066] The primary task of the first chip is to process media data using specific audio effect algorithms. These algorithms can include filtering, equalization, compression, limiting, reverb, echo, and delay, aiming to improve audio quality, enhance the listening experience, or achieve specific audio effects. The selection and application of audio effect algorithms depend on the application scenario, user needs, and system configuration. For example, in music playback applications, an equalizer can be used to adjust the audio's spectral balance; in voice call applications, noise suppression algorithms can be used to reduce background noise interference.

[0067] During the application of sound effect algorithms, the first chip can adjust the algorithm parameters according to actual needs. These parameters may include filter cutoff frequency, gain, Q value, reverberation time, echo delay, etc. By adjusting these parameters, the output effect of the sound effect algorithm can be precisely controlled.

[0068] In one possible implementation, processing the media data to obtain a data processing result includes:

[0069] The received target data information is parsed to obtain control information, which is used to instruct the sound effect algorithm to process the media data. When the control information includes a playback audio identifier, the sound effect algorithm interface corresponding to the playback audio identifier is called, and the sound effect algorithm interface is initialized. Based on the configuration information obtained from the initialization, the media data to be processed is processed to obtain the processed data processing result.

[0070] The first chip first parses the received target data. This process involves extracting useful information from the data packets, including the media data itself and related control information. The control information is a set of instructions or parameters that guide the first chip on how to process the media data. It may include the type of audio effect algorithm, parameter settings, processing mode, etc.

[0071] When the control information includes an audio playback identifier, the first chip can locate and invoke the corresponding audio effect algorithm interface based on that identifier. The audio effect algorithm interface is a predefined function or method in the first chip used to perform specific audio effect processing tasks. Each interface corresponds to one or more audio effect algorithms.

[0072] The main purpose of algorithm initialization is to prepare for subsequent media data processing. This step ensures that the resources and configurations required by the audio effect algorithm are ready to efficiently process media data. Using the configuration information obtained after initialization, specific audio effect processing is performed on the media data to be processed.

[0073] During initialization, the first chip allocates necessary hardware resources (such as memory and processor time slices) and software resources (such as buffers and algorithm parameters). The proper allocation of these resources directly affects the performance of subsequent processing. During initialization, the first chip reads and configures the parameters required by the sound effect algorithm to obtain the initial parameters needed by the algorithm. These parameters may include the frequency response curve of the equalizer, the threshold of the dynamic range controller, and the sensitivity of the noise suppression algorithm. Correct parameter configuration is crucial to ensuring the effectiveness of sound effect processing.

[0074] During initialization, the first chip can set the initial state of the sound effect algorithm. This includes setting the algorithm's operating mode (such as real-time processing, offline processing, etc.), initializing internal variables and data structures, etc. Correctly setting these states ensures that the algorithm can function correctly when processing data.

[0075] Therefore, initialization provides the necessary resources for media data processing. Without initialization, processing may fail or suffer performance degradation due to insufficient resources. The parameters configured during initialization are fundamental to the algorithm's operation during processing. Correct parameter configuration ensures the quality of the processing results. Incorrect parameter configuration can lead to results deviating from expectations. The initial state set during initialization is a prerequisite for the algorithm's operation. Incorrect initial state settings can result in anomalies or errors during processing. Initialization can perform preprocessing and optimization, such as preheating the cache and optimizing data structures, which can significantly improve processing performance. If errors are detected during initialization, they can be addressed promptly to prevent unforeseen problems during processing. This contributes to improving system stability and reliability.

[0076] In one possible implementation, after parsing the received target data information to obtain control information, the method further includes:

[0077] When the control information includes a parameter setting identifier, the sound effect algorithm interface corresponding to the parameter setting identifier is called to configure the parameters of the sound effect algorithm module indicated by the control information.

[0078] Audio effects algorithm modules are software components in audio processing systems used to implement specific audio effects. These modules typically contain a series of predefined algorithms used to process audio signals to achieve specific audio effects. Audio effects algorithm modules can be applied to various scenarios, such as music playback, audio editing, and voice communication. Common audio effects algorithm modules include equalizers (EQ), reverb, dynamic range compression (DRC), pitch shifting, and noise reduction.

[0079] After parsing the target data information, the first chip checks whether the control information contains a parameter setting identifier. This identifier is used when entering parameter configuration mode is required. If the control information contains a parameter setting identifier, the first chip calls the sound effect algorithm interface corresponding to that identifier. The sound effect algorithm interface is the key bridge connecting the first chip and the sound effect algorithm module, responsible for communication and data exchange between the two.

[0080] In the first scenario, where the control information includes a parameter setting identifier and parameter configuration information, the sound effect algorithm interface corresponding to the parameter setting identifier is invoked. Based on the parameter configuration information, the sound effect algorithm module indicated by the control information is configured with parameters. The configured sound effect algorithm module is then used to perform specific sound effect processing on the media data to be processed.

[0081] The parameter setting identifier specifies which audio effect algorithm module needs to be configured, while the parameter configuration information contains the configuration details required by that module. Through the audio effect algorithm interface, the parsed parameter setting identifier and parameter configuration information are passed to the corresponding audio effect algorithm module. This process may involve data format conversion or verification to ensure that the parameters can be correctly received and interpreted by the audio effect algorithm module. This parameter configuration information can include various parameter settings of the audio effect algorithm module, such as filter type, equalizer gain, compressor threshold, etc. The first chip performs the corresponding configuration operations on the audio effect algorithm module based on the received parameter configuration information.

[0082] After completing the parameter configuration, the first chip can perform several verification steps to ensure the correctness of the configuration. This includes checking whether the parameter values ​​are within the valid range and whether the parameter types match. If a configuration error or invalid parameter is found, the external chip can take some error handling measures, such as ignoring the erroneous parameter, using the default value instead, or sending an error report to the main control chip.

[0083] Once configured, the configured audio algorithm module can return a status code or confirmation message to indicate whether the parameter settings were successful. The first chip can check this return message and perform error handling or logging as needed. Finally, the first chip updates its internal state to reflect the new configuration of the audio algorithm module. This helps ensure that the first chip can correctly apply these new parameters when processing audio data in the future.

[0084] Parameter configuration only occurs when both parameter setting identifiers and specific parameter configuration information are included. This ensures the accuracy and validity of parameter configuration and avoids configuration errors caused by incomplete information. With explicit parameter configuration information, the chip can more precisely control the behavior of the audio effect algorithm module, ensuring the accuracy of parameter configuration. This helps generate more desirable audio effect processing results to adapt to different audio scenarios and needs, thus improving the user experience.

[0085] In the second case, the control information includes parameter setting identifiers but does not include parameter configuration information.

[0086] If parameter configuration is not required, the first chip can ignore the parameter setting identifier and continue processing media data according to other instructions in the control information. For example, it can use preset default parameter configurations. These default parameters can be preset at the chip factory or parameters saved during the last successful configuration.

[0087] In some cases, the first chip can send a request to the main control chip or other relevant devices, requesting missing parameter configuration information. If this information is subsequently provided, the first chip can re-enter parameter configuration mode. For example, the first chip can request parameter configuration information from the user through some means (such as a user interface, API call, etc.).

[0088] If the missing parameter configuration information is an error (e.g., due to data transmission errors or protocol mismatch), the first chip records the error information, sends an error report to the main control chip, and notifies the upper-layer application or user that parameter configuration data is missing in the control information.

[0089] By calling the audio effect algorithm interface corresponding to the parameter setting identifier, the first chip can dynamically configure the parameters of the audio effect algorithm module as needed, enabling the chip to flexibly adjust the audio effect processing process according to different application requirements. Furthermore, combining initialization and parameter configuration ensures that the audio effect algorithm is in its optimal state before each data processing step. This avoids audio quality degradation or processing failures caused by improper initial configuration or incorrect parameter settings.

[0090] After configuring the sound effect algorithm module, it can include: processing the media data to be processed based on the configuration information obtained during initialization and the sound effect algorithm module after parameter configuration, and obtaining the processed data processing result.

[0091] When the control information includes a parameter setting identifier, the corresponding sound effect algorithm interface is called to configure the parameters of the sound effect algorithm module indicated by the control information. This sound effect algorithm module is a software component containing multiple preset algorithms, each responsible for implementing a specific sound effect function (such as equalizer, reverb, compression, etc.). For example, if the control information indicates that the depth of the reverb effect needs to be adjusted, the system will call the reverb algorithm interface to set a new depth parameter.

[0092] Based on the initial configuration information and the configured audio algorithm module, the media data to be processed is processed to obtain the processed data result. The initial configuration information includes default audio parameters and system settings, while the configured audio algorithm module contains parameters dynamically adjusted according to control information. The system comprehensively considers these two parts of information to process the media data to achieve the best audio effect.

[0093] Suppose a user wants to dynamically adjust the sound effects settings of a smart speaker system via a mobile application. Specific implementation steps may include:

[0094] Users send control information via a mobile app, which is transmitted over the network to the smart speaker's main control chip. This control information includes parameter setting identifiers, indicating the audio effect algorithm module that needs adjustment and its specific parameter values. Upon receiving the control information, the smart speaker's main control chip forwards it to an external audio effect processing chip. The audio effect processing chip parses the control information and extracts the parameter setting identifiers and their corresponding parameter values.

[0095] The audio processing chip calls the audio algorithm interface corresponding to the parameter setting identifier to configure the parameters of the specified audio algorithm module. For example, if the control information indicates that the frequency response curve of the equalizer needs to be adjusted, the audio processing chip can call the equalizer algorithm interface to set new frequency response parameters. Based on the initial configuration information (such as the default equalizer settings) and the newly configured parameter information, the audio processing chip processes the input audio data. For example, it may use a new frequency response curve to process the audio signal to enhance the low-frequency effect.

[0096] In one possible implementation, the method further includes:

[0097] When the control information includes a stop playback identifier, the sound effect algorithm interface is called to perform an algorithm pause operation. The algorithm pause operation is used to indicate that the sound effect algorithm currently in execution is paused.

[0098] If the control information includes a stop playback identifier, the first chip calls the audio effect algorithm interface to execute an algorithm pause operation. This algorithm pause operation is used to suspend the currently executing audio effect algorithm. This means that if the audio effect algorithm is processing media data (such as applying a certain audio effect, filtering, or compression), then the processing will be temporarily interrupted.

[0099] By calling the sound effect algorithm interface to pause the algorithm, the start and stop of sound effect processing can be flexibly controlled to adapt to different application scenarios and needs. For example, stopping the sound effect algorithm in a timely manner when sound effect processing is not needed can avoid unnecessary sound interference and improve user satisfaction.

[0100] In one possible implementation, the method further includes:

[0101] When the pause operation is completed, all data processing operations on the media data are paused.

[0102] Once the audio effect algorithm's pause operation is complete, the first chip can pause all data processing operations on the media data. This includes, but is not limited to, audio decoding, data buffering, and audio output. This is done to ensure that no new audio data is processed or output to the audio device during the audio effect algorithm's pause, thereby avoiding data inconsistency or processing errors.

[0103] Firstly, upon receiving a command to resume playback or continue processing, the first chip can gradually resume media data processing based on the current state information. This may include steps such as reloading the audio effect algorithm, restoring the data buffer, and starting audio output. Secondly, pausing all data processing operations allows for centralized management of error handling and state recovery, simplifying the complexity of error handling. This helps ensure that the system can quickly return to normal operation when audio effect processing resumes.

[0104] When the audio effects algorithm pauses, the first chip does not continue processing media data, ensuring data processing consistency. This avoids data inconsistencies and potential errors that could occur if data processing continued during the audio effects algorithm pause.

[0105] S103. The data processing result is sent to the main control chip so that the main control chip can perform the corresponding target operation based on the data processing result.

[0106] After the first chip completes the processing of the media data, it sends the processing result to the main control chip.

[0107] From the perspective of in-vehicle audio playback, assuming the first chip enhances the sound effects and reduces noise in the music audio, generating high-quality, clean audio data, the main control chip, upon receiving this result, can execute the corresponding target operation according to its system's preset logic. If the in-vehicle system is currently playing music, the main control chip can output the optimized audio data to the in-vehicle audio system, where it will be played through each channel. Users can then enjoy high-quality music that has been enhanced and noise-removed, greatly improving the audio playback experience.

[0108] In one possible implementation, after receiving the data processing results, the main control chip can store them in an internal cache or memory for subsequent processing and analysis. The cache size and storage strategy can be configured according to system requirements and resource availability. For example, in systems with high real-time requirements, a smaller cache can be used to reduce data processing latency; while in systems with high data processing capabilities, a larger cache can be used to store more processing results.

[0109] In one possible implementation, after receiving the data processing results, the main control chip can use these processed data and its local data information (which may be background music, voice prompts or other audio content) to perform audio output processing, and finally generate audio output data.

[0110] After processing the media data (which may include decoding, filtering, compression, and audio effects), the first chip encapsulates the processed data into a specific format or data packets. Then, the first chip sends these data packets to the main control chip via a communication interface.

[0111] The main control chip receives data packets from the first chip through its communication interface. The main control chip parses these data packets and extracts the processed audio data. The main control chip prepares its local data information, which may include background music, voice prompts, notification sounds, etc. The main control chip can preprocess this local data, such as adjusting volume, applying sound effects, and ensuring that the format of the local audio data is consistent with the format of the processed media data. For example, the local audio data may be converted to a 16-bit, 44.1kHz sampling rate format to ensure harmonious integration with the processed audio data during mixing.

[0112] The main control chip mixes the processed audio data with local data. This mixing process includes multiple steps, such as adjusting the audio volume, balancing the left and right channels, and applying an equalizer. Finally, the main control chip generates the mixed audio output data.

[0113] In one possible implementation, the SA8295P chip can be used as the main control chip, responsible for overall audio management and the operation of some audio algorithms. An integrated aDSP is used to process basic audio algorithms, such as voice algorithms and karaoke algorithms. The SA8295P chip is a high-performance SoC designed specifically for automotive cockpits, using the latest 5nm process, and possesses powerful computing capabilities, graphics processing capabilities, and rich peripheral support. One important peripheral support is its audio interface, especially the TDM (Time Division Multiplexing) port.

[0114] The ADSP-21569 chip is used as an external ADSP, specifically for processing media audio effects algorithms. Data is exchanged with the SA8295P via the TDM (Time Division Multiplexing) port to reduce the computational burden on the built-in aDSP.

[0115] For details regarding the interaction process between the SA8295P chip and the external ADSP-21569 in this application, please refer to [link / reference needed]. Figure 2 , Figure 2This is a schematic diagram of the vehicle system framework provided in this application embodiment. The SA8295P chip includes multiple TDM ports; in this application embodiment, three ports, TDM4, TDM8, and TDM9, are used. When playing media data, the media data is sent to the TDM8 port after passing through the built-in aDSP. The TDM8 port outputs the data to the external ADSP-21569. The ADSP-21569 integrates media audio effect algorithms. After receiving the media data, the algorithm processes the data and sends the processed media data back to the built-in aDSP through the TDM9 port. After receiving the processed media data, the built-in aDSP mixes the media data with other data and then outputs the audio data to the A2B bus through the TDM4 port.

[0116] in, Figure 2 FM in this context refers to Frequency Modulation (FM), a radio signal transmission technology commonly used for transmitting audio programs to radio stations. In in-vehicle infotainment systems, an FM radio is a common feature, allowing users to listen to radio programs. In this system, "FM data input" indicates the audio signal input from the FM radio. These signals typically require decoding and processing before they can be heard by the user. Specifically, in this system, the FM signal enters the built-in aDSP (audio digital signal processor) within the 8295 chip via the TDM5 port, where it undergoes further processing and mixing within the chip.

[0117] Figure 2 In this system, MIC stands for Microphone, a sensor that converts sound into electrical signals. In in-vehicle infotainment systems, microphones are primarily used for functions such as voice recognition and telephone calls. In this system, the location marked "MIC" indicates two different microphone input points. One is connected to the TDM8 port, and the other is directly connected to the 8295 chip. This indicates that the system can support multi-channel recording or other specific microphone input requirements. For example, the microphone input on the TDM8 port can be used for voice recognition or other advanced audio processing tasks, while the microphone directly connected to the 8295 chip is for simpler applications, such as telephone calls.

[0118] The TDM port is a digital audio interface that uses time-division multiplexing technology to transmit data from multiple audio channels over the same physical connection. The SA8295P chip includes multiple TDM ports, which can be flexibly configured to meet the needs of different application scenarios. In this embodiment, the TDM configuration may include TDM8, TDM9, and TDM4, each with a different function. The TDM8 port is used to transmit unprocessed media data. The TDM9 port is used to transmit processed media data. The TDM4 port is used to transmit the final mixed audio data.

[0119] Firstly, using different ports for receiving target data (port 1) and sending data processing results (port 2) enables parallel processing, reduces data transmission latency, and improves overall system performance. Distributing different data streams to different ports helps balance the load on each port, avoiding data transmission bottlenecks caused by overload of a single port. It also reduces interference between different types of data, ensuring the stability and accuracy of data transmission. Secondly, assigning different types of communication tasks to different ports ensures that a failure in one port does not affect the operation of other ports, enhancing the system's fault tolerance and reliability. The discrete port design simplifies debugging, allowing developers to troubleshoot specific ports and improving system maintainability. Thirdly, each port can be independently configured with parameters such as baud rate and data format to adapt to different application scenarios. Adding new ports or changing the functionality of existing ports is relatively easy, allowing the system to be flexibly expanded according to future needs.

[0120] When designing the system, it is necessary to ensure that the audio interface configurations between the main control chip and the first chip are compatible. This includes matching data formats, clock frequencies, number of channels, etc. If the interfaces are incompatible, additional converters or adapters can be used to bridge the communication between the two devices.

[0121] The audio system is loaded and initialized after the SA8295P boots up. These operations include checking hardware connections, verifying software versions, and initializing internal registers and buffers. During system initialization, the TDM8 and TDM9 ports are configured to ensure they are available.

[0122] Before playing media data, the audio system checks the operating status of the ADSP-21569 chip. This typically involves sending a test signal or query command to the ADSP-21569 and waiting for its response. If the ADSP-21569 responds normally, it indicates that it is working properly and the next step can be performed.

[0123] Once the ADSP-21569 is confirmed to be functioning correctly, the audio system will configure the audio path from the SA8295P to the ADSP-21569. This includes setting parameters such as the operating mode, data format, and transfer rate of the TDM8 and TDM9 ports. These parameter settings must ensure that data can be transmitted correctly and efficiently between these two ports.

[0124] Once configured, the audio system will officially open the audio path from the SA8295P to the ADSP-21569. This process involves activating the relevant hardware circuitry and software logic to allow data to flow between the TDM8 and TDM9 ports.

[0125] Once the audio path is open, the audio system can begin preparing to play media data. This includes reading data from the storage medium, decoding it into the appropriate audio format, and sending it to the ADSP-21569 for further processing.

[0126] After receiving media data from the SA8295P, the ADSP-21569 processes it using its integrated media audio algorithms. The processed data is then sent back to the SA8295P via the TDM9 port.

[0127] After receiving the data processed by the ADSP-21569, the SA8295P mixes it with other audio data. The mixed data is then transmitted to the audio output device through an appropriate output port (such as the A2B bus connected to the TDM4 port).

[0128] During data processing, Media-Control-TASK is a task module in the ADSP-21569 responsible for parsing control information from the SA8295P and executing corresponding audio effect algorithm operations. Through Media-Control-TASK, the ADSP-21569 can respond to the SA8295P's control commands in real time, enabling dynamic adjustment and management of audio effect algorithms, thereby improving the system's flexibility and response speed, and ensuring the efficient operation of the in-vehicle audio system.

[0129] Algo-Process-TASK is a task or process dedicated to processing audio data, playing a central role in audio processing systems. When the system receives a command to play audio, Algo-Process-TASK is activated and responsible for executing the specific audio processing logic.

[0130] In other words, for the above data processing, the process can be implemented based on the Media-Control-TASK module and the Algo-Process-TASK task in three cases: when the control information includes an audio playback identifier, when the control information includes a parameter setting identifier, and when the control information includes a stop playback identifier.

[0131] The SA8295P sends target control information, consisting of module ID, control ID, and algorithm parameters required for the audio effect algorithm, to the ADSP-21569 via the SPI bus. After receiving the target control information, the ADSP-21569 passes it to the Media-Control-TASK task for parsing.

[0132] The Media-Control-TASK module first parses the target control information received from the SA8295P or other control sources. If the target control information includes a stop playback identifier, it indicates that the system needs to stop the current audio playback and sound effect processing. Once it is determined that playback needs to be stopped, the Media-Control-TASK module immediately calls the sound effect algorithm interface. This interface is responsible for sending instructions to the sound effect algorithm module, requesting it to terminate the current algorithm operation. This may involve releasing the resources occupied by the algorithm, saving necessary state information (for future recovery or reinitialization), and ensuring that the algorithm smoothly transitions to the stopped state.

[0133] After the audio effect algorithm interface is successfully invoked and it is confirmed that the algorithm has stopped running, the Media-Control-TASK module will perform the next operation: suspending the Algo-Process-TASK task. Algo-Process-TASK is the task responsible for processing audio data and applying audio effect algorithms. Suspending it means pausing all activities of this task, including data reading, processing, and output. This ensures that no new audio data is processed or output to the audio device while playback is stopped.

[0134] After suspending the Algo-Process-TASK task, the first chip can perform some additional cleanup work, such as reclaiming the memory and other resources allocated to the task, and updating the system's internal state to reflect the fact that playback has stopped. Finally, the system can provide feedback to the user that playback has stopped (e.g., through on-screen display or sound prompts) and log relevant information for future analysis and debugging.

[0135] When the control information includes parameter setting identifiers, calling the audio effect algorithm interface can initialize the audio effect algorithm module, making it ready to receive and apply new parameter settings. Through the audio effect algorithm interface, control modules (such as Media-Control-TASK) can pass parameter setting requests and related parameter values ​​to the audio effect algorithm module. Calling the audio effect algorithm interface for parameter setting ensures that the audio effect algorithm module processes audio data as expected, thereby improving the quality and accuracy of audio processing. Through the audio effect algorithm interface, the parameters of the audio effect algorithm module can be dynamically adjusted during audio processing to adapt to different audio scenarios and needs.

[0136] When the control information includes a playback audio identifier, upon receiving media data, the Algo-Process-TASK task invokes the audio effect algorithm interface to process the data. The processing includes, but is not limited to, equalizer algorithms, dynamic range control algorithms, surround sound algorithms, and noise suppression algorithms. These algorithms can be configured and debugged using graphical programming tools.

[0137] The above are some specific implementations of the data processing method provided in the embodiments of this application. Based on this, this application also provides a corresponding system for data processing. The system provided in the embodiments of this application will be described below from the perspective of functional modularity. Figure 3 This is a structural diagram of a data processing system provided in an embodiment of this application.

[0138] The system includes:

[0139] The main control chip 110 and the first chip 111 are connected to the main control chip 110 and are used to execute the data processing method described in the foregoing embodiments.

[0140] This application also provides corresponding devices and computer storage media for implementing the data processing method provided in this application.

[0141] The device includes a memory and a processor. The memory is used to store instructions or code, and the processor is used to execute the instructions or code to cause the device to perform the data processing method described in any embodiment of this application.

[0142] The computer storage medium stores code, and when the code is run, the device running the code implements the data processing method described in any embodiment of this application.

[0143] This application also provides a computer program product, which, when run on a computer, executes the data processing method described in any embodiment of this application.

[0144] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the systems or apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the descriptions are relatively simple, and relevant parts can be referred to the method section.

[0145] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0146] It should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", and "outer" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention.

[0147] It should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to fixed connections, detachable connections, or integral connections; they can refer to mechanical connections or electrical connections; they can refer to direct connections or indirect connections through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0148] It should also be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0149] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0150] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A data processing method, characterized in that, The method, applied to a first chip connected to a main control chip, includes: The target data information sent by the main control chip is obtained through the audio path between the main control chip and the first chip. The target data information includes media data to be processed by the first chip. The media data is processed to obtain the data processing result; The data processing results are sent to the main control chip so that the main control chip can perform the corresponding target operation based on the data processing results.

2. The method according to claim 1, characterized in that, The process of processing the media data to obtain the data processing result includes: The received target data information is parsed to obtain control information, which is used to instruct the sound effect algorithm to process the media data; When the control information includes a playback audio identifier, the sound effect algorithm interface corresponding to the playback audio identifier is called, and the sound effect algorithm interface is initialized. Based on the configuration information obtained during initialization, the media data to be processed is processed to obtain the processed data result.

3. The method according to claim 2, characterized in that, After parsing the received target data information to obtain control information, the process further includes: When the control information includes a parameter setting identifier, the sound effect algorithm interface corresponding to the parameter setting identifier is called to configure the parameters of the sound effect algorithm module indicated by the control information. The sound effect algorithm module is a software component that implements sound effect functions and contains at least one preset algorithm. The process of processing the media data to be processed based on the configuration information obtained during initialization, to obtain the processed data results, includes: Based on the configuration information obtained during initialization and the audio effect algorithm module after parameter configuration, the media data to be processed is processed to obtain the processed data processing result.

4. The method according to claim 3, characterized in that, When the control information includes a parameter setting identifier, the sound effect algorithm interface corresponding to the parameter setting identifier is called to configure the parameters of the sound effect algorithm module indicated by the control information, including: When the control information includes parameter setting identifier and parameter configuration information, the sound effect algorithm interface corresponding to the parameter setting identifier is called, and the parameters of the sound effect algorithm module indicated by the control information are configured based on the parameter configuration information.

5. The method according to any one of claims 2 to 4, characterized in that, The method further includes: When the control information includes a stop playback identifier, the sound effect algorithm interface is called to perform an algorithm pause operation. The algorithm pause operation is used to indicate that the sound effect algorithm currently in execution is paused.

6. The method according to claim 5, characterized in that, The method further includes: When the pause operation is completed, all data processing operations on the media data are paused.

7. The method according to any one of claims 1 to 6, characterized in that, The step of obtaining target data information sent by the main control chip through the audio path between the main control chip and the first chip includes: The target data information sent by the main control chip is obtained through the audio path corresponding to the first port between the main control chip and the first chip; The step of sending the data processing result to the main control chip, so that the main control chip can perform the corresponding target operation based on the data processing result, includes: The data processing result is sent to the main control chip through the second port, so that the main control chip can mix the processed data processing result with the local data information of the main control chip to obtain audio output data for sending to the serial audio bus through the third port.

8. An audio system, characterized in that, include: A main control chip and a first chip, the first chip being connected to the main control chip, are used to execute the data processing method according to any one of claims 1-7.

9. An electronic device, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the data processing method as described in any one of claims 1-7.

10. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the data processing method as described in any one of claims 1-7.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a terminal device, cause the terminal device to perform the data processing method as described in any one of claims 1-7.

Images