Sound adjustment method and device of sound system, storage medium and electronic equipment
By detecting the audio characteristics of the main and auxiliary sound sources in the audio system, calculating the audio transmission delay value and adjusting it, the problem of poor delay detection accuracy between multiple sound sources in the audio system is solved, and the synchronous sound playback is significantly improved Effect.
Patent Information
- Application Number
- CN202410981249.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-15
AI Technical Summary
The accuracy of delay detection between multiple sound sources in existing audio systems is poor, resulting in poor synchronous sound playback.
By obtaining the recording data recorded when pre-made audio, detecting the audio characteristics of the main and auxiliary sound sources, calculating the audio transmission delay values, and adjusting the sound source according to these delay values for synchronous playback.
It improves the accuracy of delay detection between multiple sound sources in the audio system and improves the effect of synchronous sound playback.
Smart Images

Figure CN118972746A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of sound playback, and in particular to a sound adjustment method, device, storage medium and electronic device for an audio system. Background Art
[0002] With the development of technology, the sound system can usually include multiple sound sources (for example, speakers, loudspeakers, sound boxes, etc.). For example, the built-in speakers of a TV and multiple external speakers of the TV can form a sound system. There is usually a time delay between multiple sound sources in a distributed sound system, resulting in asynchrony in the sound playback between the multiple sound sources.
[0003] However, there are some related technologies that obtain the time delay between multiple sound sources by detecting the distance between multiple sound sources in the audio system. However, the applicant found that in this way, the accuracy of delay detection is prone to errors, which makes it difficult to adjust the multiple sound sources to play sounds synchronously. Summary of the invention
[0004] The embodiment of the present application provides a sound adjustment scheme for an audio system, which can effectively improve the accuracy of delay detection between multiple sound sources in the audio system, and further improve the effect of synchronous sound playback between multiple sound sources.
[0005] The embodiments of the present application provide the following technical solutions:
[0006] According to one embodiment of the present application, a sound adjustment method for an audio system includes a main sound source and multiple auxiliary sound sources, and the method includes: obtaining recording data recorded when the audio system plays pre-produced audio, the pre-produced audio includes a main audio feature corresponding to the main sound source and auxiliary audio features corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature; performing audio feature detection on the recording data to obtain a first recording moment when the main sound source plays the main audio feature and a second recording moment when each of the auxiliary sound sources plays the corresponding auxiliary audio feature; performing difference calculation on the first recording moment and each of the second recording moments to obtain multiple second sound time differences; performing difference calculation on the second sound time difference corresponding to the same auxiliary audio feature and the first sound time difference to obtain an audio transmission delay value between each of the auxiliary sources and the main sound source, and the audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
[0007] In some embodiments of the present application, after performing a difference calculation on the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each of the auxiliary sources and the main sound source, the method further includes: determining a delay compensation adjustment value based on the audio transmission delay value between each of the auxiliary sources and the main sound source; performing a difference calculation on the delay compensation adjustment value and the audio transmission delay value between each of the auxiliary sources and the main sound source to obtain the delay compensation value corresponding to each of the auxiliary sources.
[0008] In some embodiments of the present application, the delay compensation adjustment value is determined based on the audio transmission delay value between each of the auxiliary sources and the main sound source, including: determining the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sources and the main sound source; and using the maximum audio transmission delay value as the delay compensation adjustment value.
[0009] In some embodiments of the present application, determining the delay compensation adjustment value based on the audio transmission delay value between each of the auxiliary sources and the main sound source includes: determining the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sources and the main sound source; obtaining sound source distribution data of the sound sources included in the sound system; and adjusting the maximum audio transmission delay value according to the sound source distribution data to obtain the delay compensation adjustment value.
[0010] In some embodiments of the present application, the maximum audio transmission delay value is adjusted according to the sound source distribution data to obtain the delay compensation adjustment value, including: performing calculations and analysis based on the sound source distribution data to obtain a corresponding sound source distribution category; determining an adjustment coefficient that matches the sound source distribution category from a preset adjustment coefficient table; and adjusting the maximum audio transmission delay value according to the adjustment coefficient to obtain the delay compensation adjustment value.
[0011] In some embodiments of the present application, before obtaining the audio data recorded when the sound system plays the pre-produced audio, the method further includes: determining a sound source combination of sound sources in the sound system; and selecting a test audio that matches the sound source combination according to the sound source combination to obtain the pre-produced audio.
[0012] In some embodiments of the present application, the preproduced audio is generated in the following manner: obtain the main audio features corresponding to the main sound source and the secondary audio features corresponding to each of the secondary sound sources; insert corresponding difference frequency points into the main audio features corresponding to the main sound source and the secondary audio features corresponding to each of the secondary sound sources, and the frequency of the difference frequency points is higher than a predetermined threshold; mix each of the secondary audio features and the main audio features after being separated by a corresponding first sound time difference to obtain the preproduced audio.
[0013] According to one embodiment of the present application, a sound adjustment device for an audio system includes a main sound source and multiple auxiliary sound sources, and the device includes: a recording data acquisition module, used to obtain recording data recorded when the audio system plays pre-produced audio, wherein the pre-produced audio includes a main audio feature corresponding to the main sound source and auxiliary audio features corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature; a feature detection module, used to perform audio feature detection on the recording data to obtain a first recording moment when the main sound source plays the main audio feature and a second recording moment when each of the auxiliary sound sources plays the corresponding auxiliary audio feature; a time difference calculation module, used to perform difference calculation on the first recording moment and each of the second recording moments, respectively, to obtain multiple second sound time differences; a delay value calculation module, used to perform difference calculation on the second sound time difference corresponding to the same auxiliary audio feature and the first sound time difference, to obtain an audio transmission delay value between each of the auxiliary sound sources and the main sound source, and the audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
[0014] In some embodiments of the present application, after performing a difference calculation on the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each of the auxiliary sources and the main sound source, the device also includes a compensation processing module, which is used to: determine a delay compensation adjustment value according to the audio transmission delay value between each of the auxiliary sources and the main sound source; perform a difference calculation on the delay compensation adjustment value and the audio transmission delay value between each of the auxiliary sources and the main sound source to obtain a delay compensation value corresponding to each of the auxiliary sources.
[0015] In some embodiments of the present application, the compensation processing module is used to: determine the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sound sources and the main sound source; and use the maximum audio transmission delay value as the delay compensation adjustment value.
[0016] In some embodiments of the present application, the compensation processing module is used to: determine the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sound sources and the main sound source; obtain the sound source distribution data of the sound sources included in the sound system; adjust the maximum audio transmission delay value according to the sound source distribution data to obtain the delay compensation adjustment value.
[0017] In some embodiments of the present application, the compensation processing module is used to: perform calculations and analysis based on the sound source distribution data to obtain a corresponding sound source distribution category; determine an adjustment coefficient that matches the sound source distribution category from a preset adjustment coefficient table; and adjust the maximum audio transmission delay value based on the adjustment coefficient to obtain the delay compensation adjustment value.
[0018] In some embodiments of the present application, before obtaining the audio data recorded when the sound system plays the pre-produced audio, the device also includes an audio selection module, which is used to: determine a sound source combination of sound sources in the sound system; and select a test audio that matches the sound source combination according to the sound source combination to obtain the pre-produced audio.
[0019] In some embodiments of the present application, the device also includes an audio generation module, which is used to: obtain a main audio feature corresponding to the main sound source and a secondary audio feature corresponding to each of the secondary sound sources; insert corresponding difference frequency points into the main audio feature corresponding to the main sound source and the secondary audio feature corresponding to each of the secondary sound sources, and the frequency of the difference frequency points is higher than a predetermined threshold; mix each of the secondary audio features and the main audio feature after being separated by a corresponding first sound time difference to obtain the preproduced audio.
[0020] According to another embodiment of the present application, a storage medium stores a computer program thereon, and when the computer program is executed by a processor of a computer, the computer executes the method described in the embodiment of the present application.
[0021] According to another embodiment of the present application, an electronic device may include: a memory storing a computer program; and a processor reading the computer program stored in the memory to execute the method described in the embodiment of the present application.
[0022] According to another embodiment of the present application, a computer program product or a computer program includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method provided in various optional implementations described in the embodiments of the present application.
[0023] In the sound adjustment method of the sound system of the embodiment of the present application, the sound system includes a main sound source and multiple auxiliary sound sources, and the method includes: obtaining recording data recorded when the sound system plays pre-produced audio, the pre-produced audio includes a main audio feature corresponding to the main sound source and auxiliary audio features corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature; performing audio feature detection on the recording data to obtain a first recording moment when the main sound source plays the main audio feature and a second recording moment when each of the auxiliary sound sources plays the corresponding auxiliary audio feature; performing difference calculation on the first recording moment and each of the second recording moments to obtain multiple second sound time differences; performing difference calculation on the second sound time difference corresponding to the same auxiliary audio feature and the first sound time difference to obtain an audio transmission delay value between each of the auxiliary sources and the main sound source, and the audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
[0024] In this way, when multiple sound sources in the sound system play pre-recorded audio, recording data is obtained, and the pre-recorded audio contains the main audio feature corresponding to the main sound source and the auxiliary audio features corresponding to each auxiliary sound source, and each auxiliary audio feature has a corresponding first sound time difference with the main audio feature; further, by detecting and calculating the recording data to obtain multiple second sound time differences, and further calculating the difference between the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature, the audio transmission delay value between each auxiliary sound source and the main sound source can be accurately obtained, and based on the audio transmission delay value, the main sound source and the multiple auxiliary sound sources can be effectively adjusted for synchronous sound playback. In addition, the accuracy of time delay detection between multiple sound sources in the sound system is effectively improved, and the effect of synchronous sound playback between multiple sound sources is further improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0026] Figure 1 A flow chart of a sound adjustment method for an audio system according to an embodiment of the present application is shown.
[0027] Figure 2 The figure shows an architecture diagram of a sound system according to an embodiment of the present application.
[0028] Figure 3 A schematic diagram of preset audio according to an embodiment of the present application is shown.
[0029] Figure 4 A block diagram of a sound adjustment device for an audio system according to an embodiment of the present application is shown.
[0030] Figure 5 A block diagram of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION
[0031] The present disclosure is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the embodiments provided herein are only used to explain the present disclosure and are not intended to limit the present disclosure. In addition, the embodiments provided below are partial embodiments for implementing the present disclosure, rather than providing all embodiments for implementing the present disclosure. In the absence of conflict, the technical solutions recorded in the embodiments of the present disclosure can be implemented in any combination.
[0032] It should be noted that, in the embodiments of the present disclosure, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a method or apparatus including a series of elements includes not only the elements explicitly recorded, but also includes other elements not explicitly listed, or also includes elements inherent to the implementation of the method or apparatus. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other related elements in the method or apparatus including the element (such as a step in the method or a unit in the apparatus, for example, a unit may be a part of a circuit, a part of a processor, a part of a program or software, etc.).
[0033] For example, the sound adjustment method of the audio system provided in the embodiment of the present disclosure includes a series of steps, but the sound adjustment method of the audio system provided in the embodiment of the present disclosure is not limited to the recorded steps. Similarly, the sound adjustment device of the audio system provided in the embodiment of the present disclosure includes a series of units, but the device provided in the embodiment of the present disclosure is not limited to including the units explicitly recorded, and may also include units required to obtain relevant information or perform processing based on the information.
[0034] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present disclosure belongs. The terms used herein are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure.
[0035] Figure 1 The flowchart of the sound adjustment method of the sound system according to an embodiment of the present application is schematically shown. The execution subject of the sound adjustment method of the sound system can be any device with processing capabilities, such as a TV, a computer, a mobile phone, a smart watch, and a home appliance.
[0036] like Figure 1 As shown, the sound adjustment method of the sound system may include steps S110 to S140. The sound system includes a main sound source and a plurality of auxiliary sound sources.
[0037] Step S110, obtaining recording data recorded when the sound system plays pre-recorded audio, wherein the pre-recorded audio includes a main audio feature corresponding to the main sound source and auxiliary audio features corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature.
[0038] Step S120, performing audio feature detection on the recording data to obtain a first recording time when the main sound source plays the main audio feature and a second recording time when each of the auxiliary sound sources plays the corresponding auxiliary audio feature.
[0039] Step S130, performing difference calculation on the first recording moment and each of the second recording moments to obtain a plurality of second sound time differences.
[0040] Step S140, calculate the difference between the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each of the auxiliary sound sources and the main sound source, and the audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
[0041] See also Figure 2 and Figure 3 In one example, a sound system such as Figure 3 As shown, the corresponding pre-made audio is as follows Figure 4 As shown. Figure 3 The sound system shown in the figure includes a main sound source 201, an auxiliary sound source 202, an auxiliary sound source 203, an auxiliary sound source 204, an auxiliary sound source 205, and an auxiliary sound source 206. Figure 4 The pre-produced audio shown includes a main audio feature 301 corresponding to the main sound source 201, a secondary audio feature 302 corresponding to the secondary sound source 202, a secondary audio feature 303 corresponding to the secondary sound source 203, a secondary audio feature 304 corresponding to the secondary sound source 204, a secondary audio feature 305 corresponding to the secondary sound source 205, and a secondary audio feature 306 corresponding to the secondary sound source 206.
[0042] Each auxiliary audio feature in the pre-produced audio has a corresponding first sound time difference with the main audio feature, for example, Figure 3As shown, there is a corresponding first sound time difference XL between the main audio feature 301 and the secondary audio feature 302, there is a corresponding first sound time difference XR between the main audio feature 301 and the secondary audio feature 303, there is a corresponding first sound time difference X-LS between the main audio feature 301 and the secondary audio feature 304, there is a corresponding first sound time difference X-RS between the main audio feature 301 and the secondary audio feature 305, and there is a corresponding first sound time difference X-LFE between the main audio feature 301 and the secondary audio feature 306.
[0043] The pre-recorded audio is transmitted to the sound system for playback. The sound system includes a main sound source and multiple auxiliary sound sources that play the sound. The recording data recorded when the sound system plays the pre-recorded audio can be obtained through recording. Figure 2 The microphone 207 (used in far-field voice scenarios) or the remote control 208 (used in on-site voice scenarios) shown is used to record to obtain recording data.
[0044] By performing audio feature detection on the recorded data, the main audio features played by the main sound source in the recorded data can be detected and the time when the main audio features are played (i.e., the first recording time) can be determined. At the same time, the auxiliary audio features played by each auxiliary sound source in the recorded data can be detected and the time when each auxiliary sound source plays the corresponding auxiliary audio features can be determined (i.e., the second recording time).
[0045] The difference calculation is performed on the first recording time and each second recording time to obtain multiple second sound time differences. For example, the auxiliary sound source 202 plays the first recording time of the corresponding auxiliary sound feature 302 minus the first recording time to obtain the second sound time difference YL; the auxiliary sound source 203 plays the first recording time of the corresponding auxiliary sound feature 303 minus the first recording time to obtain the second sound time difference YR; the auxiliary sound source 204 plays the first recording time of the corresponding auxiliary sound feature 304 minus the first recording time to obtain the second sound time difference Y-LS; the auxiliary sound source 205 plays the first recording time of the corresponding auxiliary sound feature 305 minus the first recording time to obtain the second sound time difference Y-RS; the auxiliary sound source 206 plays the first recording time of the corresponding auxiliary sound feature 306 minus the first recording time to obtain the second sound time difference Y-LFE.
[0046] The second sound time difference and the first sound time difference corresponding to the same consonant audio feature are calculated to obtain the audio transmission delay value between each auxiliary source and the main sound source. Among them, the second sound time difference and the first sound time difference corresponding to the same consonant audio feature are the second sound time difference and the first sound time difference calculated according to the same consonant audio feature. For example, the second sound time difference YL and the first sound time difference XL corresponding to the consonant audio feature 302 are calculated to obtain the audio transmission delay value ZL between the auxiliary source 202 and the main sound source 201; the second sound time difference YR and the first sound time difference XR corresponding to the consonant audio feature 303 are calculated to obtain the audio transmission delay value ZR between the auxiliary source 203 and the main sound source 201; the second sound time difference Y-LS and the first sound time difference X-LS corresponding to the consonant audio feature 304 are calculated to obtain the audio transmission delay value ZR between the auxiliary source 203 and the main sound source 201. The audio transmission delay value Z-LS between the auxiliary source 204 and the main sound source 201 is obtained; the second sound time difference Y-RS and the first sound time difference X-RS corresponding to the auxiliary audio feature 305 are calculated to obtain the audio transmission delay value Z-RS between the auxiliary source 205 and the main sound source 201; the second sound time difference Y-LFE and the first sound time difference X-LFE corresponding to the auxiliary audio feature 306 are calculated to obtain the audio transmission delay value Z-LFE between the auxiliary source 206 and the main sound source 201.
[0047] The audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback. According to the audio transmission delay value between each auxiliary sound source and the main sound source, the main sound source and the multiple auxiliary sound sources can be accurately adjusted to synchronously play sound.
[0048] In this way, based on steps S110 to S140, recording data is obtained when multiple sound sources in the sound system play pre-produced audio. The pre-produced audio contains the main audio feature corresponding to the main sound source and the auxiliary audio features corresponding to each auxiliary sound source. Each auxiliary audio feature has a corresponding first sound time difference with the main audio feature. Further, by detecting and calculating the recording data to obtain multiple second sound time differences, and further calculating the difference between the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature, the audio transmission delay value between each auxiliary sound source and the main sound source can be accurately obtained. Based on the audio transmission delay value, the main sound source and the multiple auxiliary sound sources can be effectively adjusted for synchronous sound playback. In addition, the accuracy of time delay detection between multiple sound sources in the sound system is effectively improved, and the effect of synchronous sound playback between multiple sound sources is further improved.
[0049] Described below Figure 1 When the sound of the sound system is adjusted in the embodiment, further optional specific embodiments are provided for each step performed.
[0050] In one embodiment, after calculating the difference between the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each of the auxiliary sound sources and the main sound source, the method may further include:
[0051] According to the audio transmission delay value between each of the auxiliary sources and the main sound source, a delay compensation adjustment value is determined; according to the difference between the delay compensation adjustment value and the audio transmission delay value between each of the auxiliary sources and the main sound source, the delay compensation value corresponding to each of the auxiliary sources is obtained.
[0052] According to the audio transmission delay value between each auxiliary source and the main sound source, the delay compensation adjustment value ZM is determined, and then the delay compensation value corresponding to each auxiliary source is obtained by performing a difference calculation between the delay compensation adjustment value and the audio transmission delay value between each auxiliary source and the main sound source.
[0053] For example, ZM minus ZL is calculated to be DL, and DL is used as the delay compensation value corresponding to the auxiliary sound source 202. Similarly, the delay compensation value corresponding to each auxiliary sound source can be calculated. When transmitting audio data to each auxiliary sound source in the sound system, the corresponding delay compensation value is added, so that the sound between multiple sound sources in the sound system can be played synchronously.
[0054] In one embodiment, determining the delay compensation adjustment value based on the audio transmission delay value between each of the auxiliary sources and the main sound source may include: determining the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sources and the main sound source; and using the maximum audio transmission delay value as the delay compensation adjustment value.
[0055] For example, the audio transmission delay values between each auxiliary source and the main sound source are: the audio transmission delay value ZL between the auxiliary source 202 and the main sound source 201, the audio transmission delay value ZR between the auxiliary source 203 and the main sound source 201, the audio transmission delay value Z-LS between the auxiliary source 204 and the main sound source 201, the audio transmission delay value Z-RS between the auxiliary source 205 and the main sound source 201, and the audio transmission delay value Z-LFE between the auxiliary source 206 and the main sound source 201. Then, a maximum audio transmission delay value Zmax can be selected from these audio transmission delay values as the delay compensation adjustment value ZM.
[0056] In one embodiment, determining the delay compensation adjustment value according to the audio transmission delay value between each of the auxiliary sound sources and the main sound source may include:
[0057] Determine the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sound sources and the main sound source; obtain the sound source distribution data of the sound sources included in the sound system; adjust the maximum audio transmission delay value according to the sound source distribution data to obtain the delay compensation adjustment value.
[0058] For example, the audio transmission delay values between each auxiliary source and the main sound source are: the audio transmission delay value ZL between the auxiliary source 202 and the main sound source 201, the audio transmission delay value ZR between the auxiliary source 203 and the main sound source 201, the audio transmission delay value Z-LS between the auxiliary source 204 and the main sound source 201, the audio transmission delay value Z-RS between the auxiliary source 205 and the main sound source 201, and the audio transmission delay value Z-LFE between the auxiliary source 206 and the main sound source 201. A maximum audio transmission delay value Zmax can be selected from these audio transmission delay values.
[0059] Then, the sound source distribution data of the sound sources included in the sound system is obtained. The sound system includes a main sound source and multiple auxiliary sound sources. The sound source distribution data may include: the size of the space where the sound system is located, and the distances between the main sound source and the multiple auxiliary sound sources.
[0060] The maximum audio transmission delay value is adjusted according to the sound source distribution data. In this embodiment, the adjusted value is used as the delay compensation adjustment value. Compensation is performed when playing sound in the audio system according to the delay compensation adjustment value, so that synchronous sound playback can be achieved more effectively.
[0061] In one embodiment, adjusting the maximum audio transmission delay value according to the sound source distribution data to obtain the delay compensation adjustment value may include:
[0062] Calculation and analysis are performed based on the sound source distribution data to obtain the corresponding sound source distribution category; the adjustment coefficient matching the sound source distribution category is determined from a preset adjustment coefficient table; the maximum audio transmission delay value is adjusted based on the adjustment coefficient to obtain the delay compensation adjustment value.
[0063] According to the "size of the space where the sound system is located" and the "distance between the main sound source and multiple auxiliary sound sources" in the sound source distribution data, analysis is performed in a predetermined manner to obtain a category indication value; based on the category indication value, the sound source distribution category corresponding to the category indication value can be determined by querying from a preset category query table.
[0064] From the preset adjustment coefficient table, determine the adjustment coefficient that matches the sound source distribution category; adjust the maximum audio transmission delay value according to the adjustment coefficient to obtain the delay compensation adjustment value, and compensate when playing the sound in the audio system according to the delay compensation adjustment value to further effectively achieve synchronous sound playback.
[0065] According to the "size of the space where the sound system is located" and "the distance between the main sound source and multiple auxiliary sound sources" in the sound source distribution data, the category indication value is obtained by analyzing in a predetermined manner, which can be specifically: querying the "spatial range" where the "size of the space where the sound system is located" is located from the preset sound source analysis table, and further querying the "category indication value" corresponding to the "distance between the main sound source and multiple auxiliary sound sources" under the "spatial range" from the preset sound source analysis table. Each different category indication value in the preset category query table corresponds to a sound source category. The preset category query table and the preset sound source analysis table can be the same table or two different tables.
[0066] The maximum audio transmission delay value is adjusted according to the adjustment coefficient to obtain the delay compensation adjustment value, which may be specifically: multiplying the adjustment coefficient by the maximum audio transmission delay value to obtain the delay compensation adjustment value. Alternatively, the delay compensation adjustment value may be obtained by adjusting in other adjustment ways.
[0067] In one embodiment, before obtaining the audio data recorded when the sound system plays the pre-produced audio, the method further includes: determining a sound source combination of sound sources in the sound system; and selecting a test audio that matches the sound source combination according to the sound source combination to obtain the pre-produced audio.
[0068] The sound source combination of the sound source in the sound system may be: the number and model of the main sound source and multiple auxiliary sound sources, etc. According to the sound source combination, a matching test audio can be effectively selected as the pre-produced audio. For example, a test audio including a main audio feature corresponding to the main sound source and auxiliary audio features corresponding to each auxiliary sound source can be selected as the pre-produced audio, and each auxiliary audio feature has a corresponding first sound time difference with the main audio feature.
[0069] In one embodiment, the preproduced audio is generated in the following manner: obtaining a main audio feature corresponding to the main sound source and a secondary audio feature corresponding to each of the secondary sound sources; inserting corresponding difference frequency points into the main audio feature corresponding to the main sound source and the secondary audio features corresponding to each of the secondary sound sources, respectively, and the frequency of the difference frequency points is higher than a predetermined threshold; mixing each of the secondary audio features and the main audio feature after being separated by a corresponding first sound time difference to obtain the preproduced audio.
[0070] After obtaining the main audio features corresponding to the main sound source and the secondary audio features corresponding to each auxiliary sound source, the corresponding difference frequency points are respectively inserted into the main audio features corresponding to the main sound source and the secondary audio features corresponding to each auxiliary sound source. The difference frequency points are high-frequency points with frequencies higher than a predetermined threshold. Furthermore, the difference frequency points can be used in relevant embodiments to detect different audio features from the recorded data, and the user's ears cannot hear the high-frequency points, so sound adjustments can be made during the user's use of the audio system without affecting the user experience.
[0071] In order to facilitate better implementation of the sound adjustment method of the sound system provided in the embodiment of the present application, the embodiment of the present application also provides a sound adjustment device for the sound system based on the sound adjustment method of the sound system. The meanings of the terms are the same as those in the sound adjustment method of the sound system, and the specific implementation details can refer to the description in the method embodiment. Figure 4 A block diagram of a sound adjustment device for a sound system according to an embodiment of the present application is shown. The sound system includes a main sound source and a plurality of auxiliary sound sources.
[0072] like Figure 4 As shown, the sound adjustment device 400 of the sound system may include: a recording data acquisition module 410, which can be used to obtain the recording data recorded when the sound system plays the pre-produced audio, wherein the pre-produced audio contains the main audio feature corresponding to the main sound source and the auxiliary audio feature corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature; a feature detection module 420, which can be used to perform audio feature detection on the recording data to obtain the first recording moment when the main sound source plays the main audio feature and the second recording moment when each of the auxiliary sound sources plays the corresponding auxiliary audio feature; a time difference calculation module 430, which can be used to perform difference calculation on the first recording moment and each of the second recording moments, respectively, to obtain multiple second sound time differences; a delay value calculation module 440, which can be used to perform difference calculation on the second sound time difference corresponding to the same auxiliary audio feature and the first sound time difference, to obtain the audio transmission delay value between each of the auxiliary sound sources and the main sound source, and the audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
[0073] In some embodiments of the present application, after performing a difference calculation on the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each of the auxiliary sources and the main sound source, the device also includes a compensation processing module, which is used to: determine a delay compensation adjustment value according to the audio transmission delay value between each of the auxiliary sources and the main sound source; perform a difference calculation on the delay compensation adjustment value and the audio transmission delay value between each of the auxiliary sources and the main sound source to obtain a delay compensation value corresponding to each of the auxiliary sources.
[0074] In some embodiments of the present application, the compensation processing module is used to: determine the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sound sources and the main sound source; and use the maximum audio transmission delay value as the delay compensation adjustment value.
[0075] In some embodiments of the present application, the compensation processing module is used to: determine the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sound sources and the main sound source; obtain the sound source distribution data of the sound sources included in the sound system; adjust the maximum audio transmission delay value according to the sound source distribution data to obtain the delay compensation adjustment value.
[0076] In some embodiments of the present application, the compensation processing module is used to: perform calculations and analysis based on the sound source distribution data to obtain a corresponding sound source distribution category; determine an adjustment coefficient that matches the sound source distribution category from a preset adjustment coefficient table; and adjust the maximum audio transmission delay value based on the adjustment coefficient to obtain the delay compensation adjustment value.
[0077] In some embodiments of the present application, before obtaining the audio data recorded when the sound system plays the pre-produced audio, the device also includes an audio selection module, which is used to: determine a sound source combination of sound sources in the sound system; and select a test audio that matches the sound source combination according to the sound source combination to obtain the pre-produced audio.
[0078] In some embodiments of the present application, the device also includes an audio generation module, which is used to: obtain a main audio feature corresponding to the main sound source and a secondary audio feature corresponding to each of the secondary sound sources; insert corresponding difference frequency points into the main audio feature corresponding to the main sound source and the secondary audio feature corresponding to each of the secondary sound sources, and the frequency of the difference frequency points is higher than a predetermined threshold; mix each of the secondary audio features and the main audio feature after being separated by a corresponding first sound time difference to obtain the preproduced audio.
[0079] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.
[0080] In addition, the present application also provides an electronic device, such as Figure 5 As shown, Figure 5A block diagram of an electronic device according to an embodiment of the present application is shown, specifically:
[0081] The electronic device may include components such as a processor 501 with one or more processing cores, a memory 502 with one or more computer-readable storage media, a power supply 503, and an input unit 504. Those skilled in the art will appreciate that Figure 5 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0082] in:
[0083] The processor 501 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire computer device. By running or executing software programs and / or modules stored in the memory 502 and calling data stored in the memory 502, it executes various functions of the computer device and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 501 may include one or more processing cores; preferably, the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user pages and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 501.
[0084] The memory 502 can be used to store software programs and modules. The processor 501 executes various functional applications and data processing by running the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.
[0085] The electronic device also includes a power supply 503 for supplying power to each component. Preferably, the power supply 503 can be logically connected to the processor 501 through a power management system, so as to manage charging, discharging, power consumption and other functions through the power management system. The power supply 503 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.
[0086] The electronic device may further include an input unit 504, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
[0087] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 501 in the electronic device will load the executable files corresponding to the processes of one or more computer programs into the memory 502 according to the following instructions, and the processor 501 will run the computer program stored in the memory 502, thereby realizing various functions in the aforementioned embodiments of the present application, such as the processor 501 may perform the following steps:
[0088] Acquire recording data recorded when the sound system plays pre-produced audio, wherein the pre-produced audio includes a main audio feature corresponding to the main sound source and a secondary audio feature corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature; perform audio feature detection on the recording data to obtain a first recording moment when the main sound source plays the main audio feature and a second recording moment when each of the auxiliary sound sources plays the corresponding secondary audio feature; perform difference calculation on the first recording moment and each of the second recording moments to obtain multiple second sound time differences; perform difference calculation on the second sound time difference and the first sound time difference corresponding to the same secondary audio feature to obtain an audio transmission delay value between each of the auxiliary sound sources and the main sound source, and the audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
[0089] In some embodiments of the present application, after performing a difference calculation on the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each of the auxiliary sources and the main sound source, it also includes: determining a delay compensation adjustment value according to the audio transmission delay value between each of the auxiliary sources and the main sound source; performing a difference calculation on the delay compensation adjustment value and the audio transmission delay value between each of the auxiliary sources and the main sound source to obtain a delay compensation value corresponding to each of the auxiliary sources.
[0090] In some embodiments of the present application, the delay compensation adjustment value is determined based on the audio transmission delay value between each of the auxiliary sources and the main sound source, including: determining the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sources and the main sound source; and using the maximum audio transmission delay value as the delay compensation adjustment value.
[0091] In some embodiments of the present application, determining the delay compensation adjustment value based on the audio transmission delay value between each of the auxiliary sources and the main sound source includes: determining the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sources and the main sound source; obtaining sound source distribution data of the sound sources included in the sound system; and adjusting the maximum audio transmission delay value according to the sound source distribution data to obtain the delay compensation adjustment value.
[0092] In some embodiments of the present application, the maximum audio transmission delay value is adjusted according to the sound source distribution data to obtain the delay compensation adjustment value, including: performing calculations and analysis based on the sound source distribution data to obtain a corresponding sound source distribution category; determining an adjustment coefficient that matches the sound source distribution category from a preset adjustment coefficient table; and adjusting the maximum audio transmission delay value according to the adjustment coefficient to obtain the delay compensation adjustment value.
[0093] In some embodiments of the present application, before obtaining the audio data recorded when the sound system plays the pre-produced audio, it also includes: determining a sound source combination of sound sources in the sound system; and selecting a test audio that matches the sound source combination according to the sound source combination to obtain the pre-produced audio.
[0094] In some embodiments of the present application, it also includes: obtaining the main audio feature corresponding to the main sound source and the auxiliary audio feature corresponding to each of the auxiliary sound sources; inserting corresponding difference frequency points into the main audio feature corresponding to the main sound source and the auxiliary audio feature corresponding to each of the auxiliary sound sources, and the frequency of the difference frequency points is higher than a predetermined threshold; mixing each of the auxiliary audio features and the main audio feature after being separated by a corresponding first sound time difference to obtain the preproduced audio.
[0095] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0096] To this end, an embodiment of the present application further provides a storage medium, in which a computer program is stored. The computer program can be loaded by a processor to execute the steps in any method provided in the embodiment of the present application.
[0097] The storage medium may be a computer-readable storage medium, and the storage medium may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.
[0098] Since the computer program stored in the storage medium can execute the steps in any method provided in the embodiments of the present application, the beneficial effects that can be achieved by the method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0099] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.
[0100] It should be understood that the present application is not limited to the embodiments that have been described above and shown in the accompanying drawings, but various modifications and changes may be made without departing from the scope thereof.
Claims
1. A sound adjustment method for an audio system, characterized in that: The sound system includes a main sound source and a plurality of auxiliary sound sources, and the method includes: Acquire recording data recorded when the sound system plays pre-recorded audio, wherein the pre-recorded audio includes a main audio feature corresponding to the main sound source and auxiliary audio features corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature; Performing audio feature detection on the recording data to obtain a first recording time when the main sound source plays the main audio feature and a second recording time when each of the auxiliary sound sources plays the corresponding auxiliary audio feature; Calculating the difference between the first recording moment and each of the second recording moments to obtain a plurality of second sound time differences; The difference between the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature is calculated to obtain the audio transmission delay value between each auxiliary sound source and the main sound source. The audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
2. The method according to claim 1, characterized in that After calculating the difference between the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each of the auxiliary sound sources and the main sound source, the method further includes: Determining a delay compensation adjustment value according to an audio transmission delay value between each of the auxiliary sound sources and the main sound source; The delay compensation value corresponding to each auxiliary source is obtained by performing a difference calculation based on the delay compensation adjustment value and the audio transmission delay value between each auxiliary source and the main sound source.
3. The method according to claim 2, characterized in that The step of determining the delay compensation adjustment value according to the audio transmission delay value between each of the auxiliary sound sources and the main sound source comprises: Determining the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sound sources and the main sound source; The maximum audio transmission delay value is used as the delay compensation adjustment value.
4. The method according to claim 2, characterized in that: The step of determining the delay compensation adjustment value according to the audio transmission delay value between each of the auxiliary sound sources and the main sound source comprises: Determining the maximum audio transmission delay value from the audio transmission delay values between each of the auxiliary sound sources and the main sound source; Acquiring sound source distribution data of sound sources included in the sound system; The maximum audio transmission delay value is adjusted according to the sound source distribution data to obtain the delay compensation adjustment value.
5. The method according to claim 4, characterized in that The adjusting the maximum audio transmission delay value according to the sound source distribution data to obtain the delay compensation adjustment value includes: Performing calculation and analysis based on the sound source distribution data to obtain corresponding sound source distribution categories; Determining the adjustment coefficient matching the sound source distribution category from a preset adjustment coefficient table; The maximum audio transmission delay value is adjusted according to the adjustment coefficient to obtain the delay compensation adjustment value.
6. The method according to claim 1, characterized in that Before acquiring the audio data recorded when the sound system plays the pre-produced audio, the method further includes: determining a sound source combination of sound sources in the sound system; A test audio that matches the sound source combination is selected according to the sound source combination to obtain the pre-produced audio.
7. The method according to claim 1, characterized in that The pre-made audio is generated in the following manner: Acquire a main audio feature corresponding to the main sound source and a secondary audio feature corresponding to each of the secondary sound sources; Insert corresponding difference frequency points into the main audio feature corresponding to the main sound source and the auxiliary audio features corresponding to each of the auxiliary sound sources, respectively, and the frequency of the difference frequency points is higher than a predetermined threshold; The auxiliary audio features are respectively separated from the main audio features by a corresponding first sound time difference and then mixed to obtain the pre-produced audio.
8. A sound adjustment device for an audio system, characterized in that: The sound system includes a main sound source and a plurality of auxiliary sound sources, and the device includes: a recording data acquisition module, used to acquire recording data recorded when the sound system plays pre-recorded audio, wherein the pre-recorded audio includes a main audio feature corresponding to the main sound source and auxiliary audio features corresponding to each of the auxiliary sound sources, and each of the auxiliary audio features has a corresponding first sound time difference with the main audio feature; A feature detection module is used to perform audio feature detection on the recording data to obtain a first recording time when the main sound source plays the main audio feature and a second recording time when each of the auxiliary sound sources plays the corresponding auxiliary audio feature; A time difference calculation module, used for respectively calculating the difference between the first recording moment and each of the second recording moments to obtain a plurality of second sound time differences; A delay value calculation module is used to calculate the difference between the second sound time difference and the first sound time difference corresponding to the same auxiliary audio feature to obtain the audio transmission delay value between each auxiliary sound source and the main sound source. The audio transmission delay value is used to adjust the main sound source and the multiple auxiliary sound sources for synchronous sound playback.
9. A storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the method according to any one of claims 1 to 7.
10. An electronic device, characterized in that: include: a memory storing a computer program; A processor reads a computer program stored in a memory to execute the method according to any one of claims 1 to 7.
Citation Information
Cited By
Intelligent sound system and method
CN119603601A
