DAB audio playback and image decoding processing system

By using FIFO memory as a data processing transit station in the DAB system, the alternating operation of audio and picture processing is achieved, and the delay and lag problems during parallel processing in the prior art are solved, and the synchronous display of audio and picture is realized, reducing the System cost.

CN118264834BActive Publication Date: 2024-11-22SHENZHEN BELON TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410406617.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-02
Publication Date
2024-11-22
Estimated Expiration
2044-04-02

AI Technical Summary

Technical Problem

When existing DAB receiving devices perform image display and sound playback in parallel on low-cost chips with tight resources, they are prone to delayed image display or sound stuttering, making it difficult to perform both simultaneously, resulting in poor user experience.

Method used

By using FIFO memory as a data processing transit station in the DAB audio playback and picture decoding processing system, alternating processing of audio data and picture data is realized, and noise reduction, EQ, DRC processing, decompression, color conversion, and depth are performed in RAM respectively in RAM. Conversion and other steps, use trigger signals to optimize resource utilization to ensure the alternating operation of audio and image processing.

Benefits of technology

Almost synchronous operation of audio playback and picture display on resources with limited width is achieved, avoiding image display delay and sound lag, significantly improving user experience, and low system cost.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118264834B_ABST
    Figure CN118264834B_ABST
Patent Text Reader

Abstract

The present invention provides a DAB audio playback and picture decoding processing system, which cleverly uses the chip hardware resource FIFO memory as a transition of RAM, so that the three steps of audio data processing and picture data processing are interspersed, and finally the audio playback and picture display are almost synchronously realized on a "single lane". The two are quickly executed by intelligently switching the algorithm. In practice, the two are separated by only milliseconds, which effectively avoids picture display delay and sound jamming, and the actual system does not need to consume too much cost.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a DAB audio playing and picture decoding processing system. Background Art

[0002] Digital Audio Broadcasting (DAB) is a wireless communication technology that transmits audio content via digital signals. It has the advantages of high sound quality, multiple frequencies, and multiplexing, and has gradually become the mainstream technology in the broadcasting industry.

[0003] However, the DAB receivers currently on the market are often expensive, which limits their popularity and application in the mass market. The cost of traditional DAB receivers mainly comes from the cost of hardware equipment and related technologies, making it difficult for ordinary consumers to accept. Therefore, how to reduce the cost of DAB receivers and increase their popularity has become an important issue in the current development of DAB technology.

[0004] In particular, for DAB systems, it is not difficult to display images or play sounds separately, and it is not difficult to perform these two tasks on a chip with sufficient resources. However, performing image display and sound playback in parallel is extremely difficult. Performing these two tasks in parallel on a low-cost chip with limited resources is like trying to have two vehicles drive side by side on a road with only one lane at the same time. It is difficult for the single lane to make the two vehicles run at the same speed and arrive at the same speed.

[0005] Of course, in traditional technology, it is also possible to let the "two cars" of picture display and sound playback run in sequence one after the other. However, this will cause the speed of the "following car" to be delayed and out of sync. If the "following car" is "picture display", the DAB system will show picture display delay, and if the "following car" is "sound playback", the DAB system will show sound jamming. You can't have your cake and eat it too. Summary of the invention

[0006] The present invention provides a DAB audio playback and picture decoding processing system, which effectively solves the above-mentioned problems in the prior art and ensures that both are achieved.

[0007] Specifically, the present invention provides a DAB audio playback and image decoding processing system for digital audio broadcasting, the system comprising a FIFO memory, a RAM, a CPU, and a DAC. In the process of digital audio broadcasting, the system first caches the original audio data in the FIFO memory, then extracts the original image data of the image to be played and saves it to the RAM and performs decompression processing in the RAM to form decompressed image data, then the decompressed image data is released from the RAM by the CPU, and a first trigger signal is sent to the FIFO memory at the same time. After receiving the first trigger signal, the FIFO memory loads the original audio data into the RAM, thereby performing noise reduction processing on the audio data in the RAM to form noise-reduced audio data, and the noise-reduced audio data is released from the RAM by the CPU back to the FIFO memory; then, the decompressed image data is loaded into the RAM and spatial color conversion is performed to form color-converted image data, and then , the color conversion picture data is released from the RAM by the CPU, and a second trigger signal is sent to the FIFO memory at the same time; after the FIFO memory receives the second trigger signal, the noise reduction audio data is loaded into the RAM, thereby performing EQ processing on the noise reduction audio data in the RAM to form EQ audio data, and the EQ audio data is released from the RAM back to the FIFO memory by the CPU; subsequently, the color conversion picture data is loaded into the RAM, thereby performing color depth conversion to form depth conversion picture data, and the RAM sends a third trigger signal to the FIFO memory. After the depth conversion picture data is released from the RAM, it is directly displayed to the user on the picture screen after image scaling processing; after the FIFO memory receives the third trigger signal, the EQ audio data is loaded into the RAM, and DRC processing is performed on the EQ audio data in the RAM to form DRC audio data, and the DRC audio data is output to the DAC, thereby realizing sound playback.

[0008] Optionally, the format of the original image data is JPEG or PNG.

[0009] The EQ processing refers to equalizing the audio data.

[0010] The DRC process is used to dynamically adjust the audio output amplitude.

[0011] In summary, the DAB audio playback and picture decoding processing system provided by the present invention cleverly utilizes the hardware resource FIFO memory of the chip itself as a transition to RAM, so that the three steps of audio data processing and picture data processing are interspersed, and finally the audio playback and picture display are almost synchronously realized on a "single lane". The two are quickly executed by intelligently switching the algorithm, and the two are only separated by milliseconds in practice, which effectively avoids picture display delay and sound freeze, and the actual system does not need to consume too much cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be discussed below. Obviously, the technical solutions described in conjunction with the drawings are only some embodiments of the present invention. For ordinary technicians in this field, other embodiments and their drawings can be obtained based on the embodiments shown in these drawings without paying creative work.

[0013] Figure 1 The specific operation flow of the DAB audio playback and picture decoding processing system according to the present invention is shown. DETAILED DESCRIPTION

[0014] The technical solutions of various embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments described in the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0015] In summary, the present invention provides a DAB audio playback and picture decoding processing system, in which the chip's own hardware resources - first-in-first-out (FIFO) memory is used as a data processing transfer station for audio and picture, thereby realizing the alternating operation of sound decoding and picture decoding. On the one hand, data that needs to be processed immediately is placed in a random access memory (RAM) for processing, and on the other hand, data that can be processed later is temporarily placed in the FIFO memory for temporary storage, and is released to enter the RAM for calculation when calculation is required.

[0016] It can be seen that the present invention can use the FIFO memory as a transfer station through reasonable configuration, thereby ensuring that the image display and sound playback can be quickly alternated on a "single lane" with limited width. Furthermore, priority judgment and data compression and release processing are made in this process, ensuring that the overall system can "almost" achieve synchronous operation. The reason why "almost" is said here is that although the two tasks are indeed running alternately in theory, this system can achieve alternating operation more than once within 0.1ms, so in practice it is almost equivalent to synchronous operation.

[0017] The specific operation of the DAB audio playback and picture decoding processing system according to the present invention will be described in detail below. Figure 1 The specific operation flow of the DAB audio playback and picture decoding processing system according to the present invention is shown.

[0018] like Figure 1 As shown, in the DAB audio playback and picture decoding processing system, during the digital audio broadcasting process, audio data and picture data are first input.

[0019] Before playing audio and displaying pictures to users, audio data needs to go through three processing steps: noise reduction, EQ, and DRC. Noise reduction is easy to understand, which is to reduce the noise in the audio. EQ (Equalizer) processing refers to equalization processing, which can make the sound in a certain track more natural and make the scratching sound crisper. DRC (Dynamic range compression) processing is generally used to dynamically adjust the audio output amplitude, suppressing the volume within a certain range when the volume is high, and appropriately increasing the volume when the volume is low.

[0020] In addition, image data processing also requires three steps: decompression, color space conversion, and color depth conversion.

[0021] In order to display pictures and play audio to users synchronously during digital audio broadcasting, due to the limitation of data transmission path, just like the "single lane" mentioned above, it is impossible to process audio and pictures in parallel. Therefore, the general idea is to complete the three steps of audio data and then play the audio on the "single lane", and then complete the three steps of picture data and then display the picture (or display the picture first and then play the audio). This will cause an embarrassing situation. Either the audio playback as the "following vehicle" is forced to wait for the picture data to be processed first, resulting in audio jams; or the picture display as the "following vehicle" is forced to wait for the audio data to be processed first, resulting in picture display delays, which seriously affects the user experience.

[0022] In order to avoid this embarrassing situation, the DAB audio playback and image decoding processing system provided by the present invention considers interleaving the three steps of audio processing and image processing. Figure 1 The specific process of the DAB audio playback and picture decoding processing system provided by the present invention is introduced in detail.

[0023] like Figure 1 As shown, during the digital audio broadcasting process, the original audio data is first buffered in the FIFO memory, but is not processed in advance.

[0024] exist Figure 1As shown on the right side of , the picture to be played is extracted (for example, extracted in JPEG or PNG format). The extracted original picture data is saved to RAM (Random-Access Memory) space, and then the picture is subjected to the first step of picture processing, that is, decompression processing, to form decompressed picture data. After the decompression processing, the decompressed picture data is released from the RAM by the CPU (Central Processing Unit), thereby releasing the RAM space and sending a first trigger signal to the FIFO memory.

[0025] After receiving the first trigger signal, the FIFO memory loads the original audio data originally cached therein into the RAM whose space has been released, thereby performing noise reduction processing on the audio data in the RAM, thereby forming noise-reduced audio data.

[0026] Subsequently, the noise-reduced audio data is released from the RAM back to the FIFO memory by the CPU, thereby freeing up space in the RAM again.

[0027] Subsequently, the decompressed image data is loaded into the RAM, thereby performing the second step of image processing, that is, spatial color conversion, to form color converted image data. Then, the color converted image data is released from the RAM by the CPU, thereby freeing up space in the RAM and sending a second trigger signal to the FIFO memory.

[0028] After receiving the second trigger signal, the FIFO memory loads the noise reduction audio data originally stored therein into the RAM whose space has been released, thereby performing EQ processing on the noise reduction audio data in the RAM, thereby forming EQ audio data.

[0029] Subsequently, the EQ audio data is released from the RAM back to the FIFO memory by the CPU, thereby freeing up space in the RAM again.

[0030] Subsequently, the color conversion picture data is loaded into the RAM, thereby performing the third step of picture processing, that is, color depth conversion, to form depth conversion picture data. At this point, the periodic processing of the picture data is completed, and the three steps of decompression, spatial color conversion, and color depth conversion are completed in the depth conversion picture data. Then, the depth conversion picture data is released from the RAM by the CPU, thereby freeing up space in the RAM and sending a third trigger signal to the FIFO memory at the same time.

[0031] After the depth conversion image data is released from the RAM, it is directly displayed to the user on the image screen after image scaling processing.

[0032] After receiving the third trigger signal, the FIFO memory loads the EQ audio data originally stored therein into the RAM whose space has been released, thereby performing DRC processing on the EQ audio data in the RAM, thereby forming DRC audio data. At this point, the periodic processing of the audio data is also completed, and the three steps of noise reduction processing, EQ processing, and DRC processing are completed in the DRC audio data.

[0033] The DRC audio data will no longer be returned to the FIFO memory, but will be output to the DAC (Digital to Analog Converter) to achieve sound playback.

[0034] So far, the operation flow of the DAB audio playback and picture decoding processing system provided by the present invention has been basically explained. As mentioned above, the DAB audio playback and picture decoding processing system provided by the present invention cleverly utilizes the hardware resources of the chip itself—FIFO memory as a transition to RAM, so that the three steps of audio data processing and picture data processing are interspersed, and finally the audio playback and picture display are almost synchronously realized on the "single lane". In practice, the two are separated by only milliseconds, which effectively avoids picture display delay and sound jamming, and the actual system does not need to consume too much cost.

[0035] The above description is only an exemplary embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A DAB audio playback and picture decoding processing system for digital audio broadcasting, characterized in that: The system includes a FIFO memory, a RAM, a CPU, and a DAC. During the digital audio broadcasting process, the system first caches the original audio data in the FIFO memory. Subsequently, the original picture data of the picture to be played is extracted and saved to the RAM and decompressed in the RAM to form decompressed picture data. Subsequently, the decompressed picture data is released from the RAM by the CPU and a first trigger signal is sent to the FIFO memory. After receiving the first trigger signal, the FIFO memory loads the original audio data into the RAM, thereby performing noise reduction processing on the audio data in the RAM to form noise-reduced audio data, and the noise-reduced audio data is released from the RAM back to the FIFO memory by the CPU; Then, the decompressed picture data is loaded into the RAM and a spatial color conversion is performed to form color converted picture data, and then, the color converted picture data is released from the RAM by the CPU, and a second trigger signal is sent to the FIFO memory; After receiving the second trigger signal, the FIFO memory loads the noise reduction audio data into the RAM, thereby performing EQ processing on the noise reduction audio data in the RAM to form EQ audio data, and the EQ audio data is released from the RAM back to the FIFO memory by the CPU; Subsequently, the color conversion picture data is loaded into the RAM, thereby performing color depth conversion to form depth conversion picture data, the RAM sends a third trigger signal to the FIFO memory, and the depth conversion picture data is released from the RAM and directly displayed to the user on the picture screen after picture scaling processing; After receiving the third trigger signal, the FIFO memory loads the EQ audio data into the RAM, performs DRC processing on the EQ audio data in the RAM, thereby forming DRC audio data, and outputs the DRC audio data to the DAC, thereby realizing sound playback.

2. The system according to claim 1, characterized in that The format of the original image data is JPEG or PNG.

3. The system according to claim 1, characterized in that The EQ processing refers to equalizing the audio data.

4. The system according to claim 1, characterized in that The DRC process is used to dynamically adjust the audio output amplitude.