Sound signal processing device and sound signal processing method

By designing a plurality of processing units corresponding to buffers of different sizes in the sound signal processing device, the performance degradation caused by buffers in the sound signal processing is solved, processing efficiency is improved, delay is reduced, and product value is ensured.

CN114938680BActive Publication Date: 2025-08-29DENSO TEN LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202080022356.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-12
Publication Date
2025-08-29
Estimated Expiration
2040-10-12

AI Technical Summary

Technical Problem

In the prior art, when using Soft ip to perform sound signal processing, the sound signal passes through the buffer and causes the performance of each function to be deteriorated, and the processing efficiency of multiple processing units cannot be improved.

Method used

A sound signal processing device is designed, and a plurality of sound signal processing units and buffers are used, with different buffer sizes and corresponding to the processing unit, so as to ensure that the sound signal processing unit matches its corresponding buffer size, and reduce the time when a signal passes through the buffer.

Benefits of technology

By optimizing the matching of the buffer size with the processing unit, the CPU load is reduced, the processing efficiency is improved, the product delay time and CPU usage is reduced, and the product value is prevented from decreasing or disappearing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114938680B_ABST
    Figure CN114938680B_ABST
Patent Text Reader

Abstract

A sound signal processing device according to an embodiment includes multiple sound signal processing units and multiple buffers. The multiple sound signal processing units each belong to one of multiple groups and perform predetermined processing using a supplied sound signal. The multiple buffers have different buffer sizes and are each associated with one of the groups. The stored sound signals are supplied to the sound signal processing unit belonging to the associated group.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a sound signal processing device and a sound signal processing method. Background Art

[0002] In recent years, from the perspective of cost reduction, sound processing solutions (ECNC: Echo Canceller / Noise Canceller, ICC: In-Car Communication, etc.) have been replaced by Hard DSPs with Soft IPs.

[0003] When using Soft IP, buffers are required before and after each processing unit that performs functions related to audio signal processing. On the other hand, the time it takes for the audio signal to pass through the buffer will cause the performance of each function to deteriorate.

[0004] Furthermore, conventionally, there is known a technique for increasing the efficiency of the entire circuit by dividing a single RAM (Random Access Memory) into multiple areas as needed when caching multiple data (see, for example, Patent Document 1).

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Laid-Open No. 2001-175591 Summary of the Invention

[0008] -Problems to be solved by the invention-

[0009] However, conventional technologies sometimes fail to improve the processing efficiency of a device including a plurality of processing units that execute functions related to audio signal processing.

[0010] The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to improve the processing efficiency of a device including a plurality of processing units that execute functions related to audio signal processing.

[0011] -Methods for solving the problem-

[0012] To solve the above-mentioned problems and achieve the purpose, the present invention relates to a sound signal processing device comprising multiple sound signal processing units and multiple buffers. Each of the multiple sound signal processing units belongs to one of multiple groups and performs predetermined processing using a supplied sound signal. The multiple buffers have different buffer sizes and are each associated with a member of a group. The stored sound signals are supplied to the sound signal processing units belonging to the associated groups.

[0013] -Effects of the Invention-

[0014] According to the present invention, it is possible to improve the processing efficiency of a device including a plurality of processing units that execute functions related to audio signal processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a diagram showing the structure of a conventional sound signal processing device.

[0016] Figure 2 It is a diagram showing a configuration example of a sound signal processing device according to an embodiment.

[0017] Figure 3 This is a flowchart showing the steps of processing executed by the audio signal processing device according to the embodiment. DETAILED DESCRIPTION

[0018] Hereinafter, embodiments of the sound signal processing device and the sound signal processing method disclosed in the present application will be described in detail with reference to the accompanying drawings.

[0019] First, use Figure 1 , the structure of the existing sound signal processing device is explained. Figure 1 This is a diagram showing the structure of a conventional sound signal processing device.

[0020] like Figure 1 As shown, the audio signal processing device 1a includes a plurality of audio signal processing units (reference numerals 81, 82, 83, and 84) and a buffer (accumulation unit 80) provided upstream of the plurality of audio signal processing units. A buffer is further provided downstream of each audio signal processing unit.

[0021] exist Figure 1 In the example of FIG, the frequency of supplying the audio signal stored in the buffer to each processing unit for processing increases, thereby increasing the CPU (Central Processing Unit) load. One of the purposes of the embodiment is to suppress such an increase in CPU load.

[0022] Figure 2 1 is a diagram showing a configuration example of a sound signal processing device according to an embodiment. For example, the sound signal processing device 1 is a multifunctional car audio system having multiple functions.

[0023] like Figure 2 As shown, the audio signal processing device 1 includes a microphone 10 , a DSP 20 (Audio DSP), and a driver 30 (Sound Driver).

[0024] The DSP 20 performs sound amplification and tuning, and the driver 30 performs sampling rate conversion.

[0025] Furthermore, the audio signal processing device 1 includes an accumulation unit 41, an accumulation unit 42, and an accumulation unit 43. Each accumulation unit functions as a buffer for temporarily accumulating audio signals.

[0026] The buffer size of the storage unit 41 is 1024 frames. The buffer size of the storage unit 42 is 256 frames. The buffer size of the storage unit 43 is 32 frames. Here, the amount of the audio signal is expressed in these numbers of frames.

[0027] Furthermore, the sound signal processing device 1 includes a sound signal processing unit 411 , a sound signal processing unit 421 , a sound signal processing unit 422 , and a sound signal processing unit 431 .

[0028] exist Figure 2 In the example of , the audio signal processing unit 411 functions as a drive recorder and requires 1024 frames of audio signals to perform processing.

[0029] Furthermore, the audio signal processing unit 421 functions as VR (Voice Recognition), and requires 256 frames of audio signals in order to perform processing.

[0030] Furthermore, the audio signal processing unit 422 functions as HF (Hands Free) & VR, and requires 256 frames of audio signals to perform processing.

[0031] Furthermore, the audio signal processing unit 431 functions as an ICC and requires 32 frames of audio signals to perform processing.

[0032] Furthermore, each sound signal processing unit transfers the sound signal obtained after the processing to a subsequent function. In addition, each sound signal processing unit has an independent CPU.

[0033] The audio signal processing units are classified into groups according to the sizes of the audio signals required for processing. In addition, each group is associated with a storage unit having the same buffer size as the size of the audio signal required for processing.

[0034] For example, the audio signal processing unit 411 belongs to the first group of audio signals requiring 1024 frames to process, and is associated with the storage unit 41 .

[0035] Furthermore, for example, the audio signal processing unit 421 and the audio signal processing unit 422 belong to the second group of audio signals that require 256 frames to process, and are associated with the storage unit 42 .

[0036] Furthermore, for example, the audio signal processing unit 431 belongs to the third group of audio signals requiring 32 frames for processing, and is associated with the storage unit 43 .

[0037] Thus, each audio signal processing unit belongs to one of the groups divided according to the size of the audio signal required for processing. In addition, each storage unit has a buffer size equal to the size of the audio signal required for processing by the audio signal processing unit belonging to the corresponding group.

[0038] This can shorten the time it takes for the audio signal to pass through the buffer, thereby reducing the processing load on the CPU.

[0039] Thus, the audio signal processing device 1 includes a plurality of audio signal processing units each belonging to one of a plurality of groups, and a plurality of storage units (buffers) having different buffer sizes and corresponding to one of the groups.

[0040] In the audio signal processing method according to the embodiment, a plurality of storage units (buffers) supply the stored audio signals to the audio signal processing units belonging to the associated group.

[0041] Furthermore, in the sound signal processing method according to the embodiment, the plurality of sound signal processing units perform predetermined processing using the supplied sound signal.

[0042] In this way, a buffer having a buffer size matching the combination of the audio signal processing units is supplied with the audio signal. Therefore, according to the embodiment, the processing efficiency of the device including a plurality of processing units that execute functions related to audio signal processing can be improved.

[0043] Figure 3 1 is a flowchart showing the steps of processing performed by the sound signal processing device according to the embodiment. Figure 3 As shown, first, the audio signal processing device 1 accumulates the audio signal input from the microphone 10 in a buffer (accumulation unit) (step S101 ).

[0044] exist Figure 2 In the example of , the audio signal is stored in the storage unit 41, the storage unit 42, and the storage unit 43 at the same time.

[0045] Here, the audio signal processing device 1 continues to accumulate the audio signal (step S101 ) in each buffer until the audio signal is accumulated to a size required for processing (step S102 : No).

[0046] Each storage unit is associated with a sound signal processing unit required to process a sound signal of the same size as its own buffer. Therefore, the size required for processing the sound signal is equal to the buffer size of each associated storage unit.

[0047] For example, when 1024 frames of audio signals are accumulated in the accumulation unit 41 , the determination in step S102 is “Yes”.

[0048] For example, when the storage unit 42 stores audio signals for 256 frames, the determination in step S102 is “Yes”.

[0049] For example, when 32 frames of audio signals are stored in the storage unit 43 , the determination in step S102 is “Yes”.

[0050] When the audio signal is accumulated in each buffer to a size required for processing (step S102 : Yes), the audio signal processing device 1 supplies the accumulated audio signal to the audio signal processing unit (step S103 ).

[0051] As described above, the sound signal processing device 1 involved in the embodiment includes multiple sound signal processing units and multiple buffers (accumulation units). The multiple sound signal processing units belong to any one of a plurality of groups and perform a given process using the supplied sound signal. The buffer sizes of the multiple buffers are different from each other, and the multiple buffers are each established in correspondence with any one of the groups, and the accumulated sound signals are supplied to the sound signal processing unit belonging to the corresponding group. In this way, by preparing buffers of a size that matches the sound signal required for processing, the time that each sound signal processing unit waits for the accumulation of sound signals can be reduced. Therefore, according to this embodiment, the processing efficiency of a device having multiple processing units that perform functions related to sound signal processing can be improved.

[0052] Here, in a multi-functional car audio system, if the time it takes for an audio signal to pass through each processing unit becomes longer, certification requirements for each function may not be met, and the product value may be reduced or lost.

[0053] By applying the audio signal processing device 1 of this embodiment to a multi-functional speaker, it is possible to suppress reduction or loss of product value.

[0054] The audio signal processing device 1 of this embodiment may also be Figure 1 The conventional sound signal processing device 1a shown is a device that performs component optimization such as reducing redundant buffers and arranging buffers with optimal buffer sizes.

[0055] Therefore, specific effects of the sound signal processing device 1 of this embodiment will be described in comparison with the conventional sound signal processing device 1 a.

[0056] As an example, accumulating 32 frames of audio signals in the buffer memory requires 1.33 ms of time and 1% of CPU usage.

[0057] like Figure 1 As shown, in the conventional sound signal processing device 1a, apart from the storage unit 80 having a buffer size of 32 frames, each sound signal processing unit includes a buffer having the same buffer size as the size of the sound signal required for processing.

[0058] The audio signal processing unit 81 functioning as a drive recorder includes a buffer having a buffer size of 1024 frames.

[0059] The audio signal processing unit 81 accumulates the audio signal in a buffer having a buffer size of 1024 frames. In contrast, the audio signal processing unit 411 in the embodiment is supplied with the audio signal of 1024 frames from the accumulation unit 41 .

[0060] Therefore, according to (1024 frames / 32 frames)×1%=32%, according to this embodiment, the processing load of the CPU that executes the drive recorder can be reduced by 32%.

[0061] Furthermore, each of the audio signal processing unit 82 that functions as VR and the audio signal processing unit 83 that functions as HF & Mobile VR includes a buffer having a buffer size of 256 frames.

[0062] The sound signal processing units 82 and 83 respectively store sound signals in buffers having a buffer size of 256 frames. In contrast, the sound signal processing units 421 and 422 in the embodiment are supplied with 256 frames of sound signals from the storage unit 42.

[0063] Therefore, according to (256 frames / 32 frames)×1%=8%, according to this embodiment, the processing load of the CPU executing VR or HF&Mobile VR can be reduced by 8%.

[0064] Furthermore, according to (256 frames / 32 frames)×1.33 ms=10.64 ms, according to this embodiment, the delay time when executing VR or HF&Mobile VR can be reduced by 10.64 ms.

[0065] Furthermore, the audio signal processing unit 84 functioning as the ICC includes a buffer having a buffer size of 32 frames.

[0066] The audio signal processing unit 84 accumulates audio signals in a buffer for 32 frames, whereas the audio signal processing unit 431 in the embodiment is supplied with audio signals for 32 frames from the accumulation unit 43 .

[0067] Therefore, according to (32 frames / 32 frames)×1.33 ms=1.33 ms, according to this embodiment, the delay time when executing ICC can be reduced by 1.33 ms.

[0068] Those skilled in the art can easily derive further effects and modifications. Therefore, the broader aspects of the present invention are not limited to the specific detailed and representative embodiments shown and described above. Therefore, various changes can be made without departing from the spirit or scope of the general inventive concept defined by the appended claims and their equivalents.

[0069] -Explanation of symbols-

[0070] 1.1a Sound signal processing device

[0071] 10 microphones

[0072] 20 DSP

[0073] 30 Driver

[0074] 41, 42, 43, 80 Storage

[0075] 81, 82, 83, 84, 411, 421, 422, 431 Sound signal processing unit.

Claims

1. A sound signal processing device, characterized in that: have: A plurality of sound signal processing units, each belonging to any one of the plurality of groups, and performing predetermined processing using a supplied sound signal; as well as A plurality of buffers having different buffer sizes and corresponding to any one of the groups are provided, wherein the stored sound signals are supplied to the sound signal processing unit belonging to the corresponding group. Two or more sound signal processing units belong to at least one of the plurality of groups. The two or more sound signal processing units perform different processing on the supplied sound signals. The sound signal processing unit belongs to any one of the groups divided for each size of the sound signal required for processing, The buffer has the same buffer size as the size of a sound signal required to be processed by the sound signal processing unit belonging to the associated group.

2. A sound signal processing method, which is performed by a sound signal processing device, The sound signal processing device comprises: a plurality of sound signal processing units, each belonging to any one of the plurality of groups; as well as A plurality of buffers, each having a different buffer size, are associated with any one of the groups. The sound signal processing method is characterized by comprising: a supplying step of supplying the stored sound signal to the sound signal processing unit belonging to the corresponding group; as well as a sound signal processing step, wherein the sound signal processing unit performs predetermined processing using the supplied sound signal; Two or more sound signal processing units belong to at least one of the plurality of groups. The two or more sound signal processing units perform different processing on the supplied sound signals. The sound signal processing unit belongs to any one of the groups divided for each size of the sound signal required for processing, The buffer has the same buffer size as the size of a sound signal required to be processed by the sound signal processing unit belonging to the associated group.

Citation Information

Patent Citations

  • Device and method for buffering data

    JP2001175591A

  • Processor system

    CN102819699A

  • Extended line width memory-side cache systems and methods

    CN110580229A