Sound adjustment method and apparatus, storage medium, and electronic device
By scanning and calibrating the characteristic parameters and transmission latency of audio devices, combined with audio-related information and user preferences, efficient sound synchronization playback between multiple audio devices is achieved, simplifying adjustment operations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SHENZHEN TCL DIGITAL TECH CO LTD
- Filing Date
- 2024-07-19
- Publication Date
- 2026-04-14
AI Technical Summary
The sound synchronization between multiple audio devices is poor and the adjustment operation is complicated and inconvenient.
By scanning the characteristic parameters of the audio device, audio calibration is performed to obtain the transmission delay, and sound synchronization is adjusted by combining audio-related information and user preference information using analysis models or strategy tables.
It improves the sound synchronization between multiple audio devices, simplifies the adjustment process, and enhances convenience.
Smart Images

Figure CN119052526B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of sound playback technology, specifically to a sound adjustment method, apparatus, storage medium, and electronic device. Background Technology
[0002] Taking a TV as an example, the main device can connect to multiple audio devices (such as speakers, wired headphones, Bluetooth headphones, etc.) to provide a personalized listening experience. However, due to audio transmission and other reasons, when multiple audio devices connected to the main device play the audio transmitted by the main device, the sound of the multiple audio devices is easily different.
[0003] Currently, there are several ways to adjust audio synchronization, including manually adjusting audio parameters, using dedicated synchronization equipment, or adjusting based on the distance between audio devices. However, with current methods, the audio synchronization effect between multiple audio devices is still poor, and the operation of audio synchronization adjustment is complicated and inconvenient. Summary of the Invention
[0004] This application provides a sound adjustment scheme that can improve the sound synchronization playback effect between multiple audio devices and enhance the convenience of sound synchronization adjustment.
[0005] The embodiments of this application provide the following technical solutions:
[0006] According to one embodiment of this application, a sound adjustment method includes: scanning a plurality of audio devices connected to a host device and recording characteristic parameters of each audio device; performing audio calibration on each audio device to obtain the audio transmission delay of each audio device; detecting audio-related information in the host device; and performing sound synchronization adjustment on each audio device based on the characteristic parameters, the audio transmission delay, and the audio-related information.
[0007] In some embodiments of this application, before adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, and the audio-related information, the method further includes: obtaining user-defined audio preference information; correspondingly, adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, and the audio-related information includes: adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information.
[0008] In some embodiments of this application, the step of performing audio calibration on each of the audio devices to obtain the audio transmission delay of each of the audio devices includes: acquiring microphone data corresponding to each of the audio devices, wherein the microphone data is recorded when test audio is transmitted through the main device to each of the audio devices and the reference device for playback; analyzing the microphone data corresponding to each of the audio devices to obtain the relative delay of each of the audio devices relative to the reference device; and obtaining the audio transmission delay of each of the audio devices based on the relative delay of each of the audio devices relative to the reference device.
[0009] In some embodiments of this application, the characteristic parameters of the audio device include at least one of the following: the type, brand, and volume of the audio device.
[0010] In some embodiments of this application, the audio-related information includes at least one of the following: playback scene, playback status, and audio output format.
[0011] In some embodiments of this application, the step of adjusting the sound synchronization of each audio device based on the feature parameters, the audio transmission delay, and the audio-related information includes: analyzing and processing the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each audio device, wherein the first synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information; and adjusting the sound synchronization of each audio device based on the first synchronization adjustment strategy information corresponding to each audio device.
[0012] In some embodiments of this application, the step of analyzing and processing the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices includes one of the following methods: using a first synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices; querying the strategy information matching the feature parameters, the audio transmission delay, and the audio-related information from a first adjustment strategy table to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices.
[0013] In some embodiments of this application, the step of adjusting the sound synchronization of each audio device based on the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information includes: analyzing and processing the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain second synchronization adjustment strategy information corresponding to each audio device, wherein the second synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information; and adjusting the sound synchronization of each audio device based on the second synchronization adjustment strategy information corresponding to each audio device.
[0014] In some embodiments of this application, the step of analyzing and processing the feature parameters, audio transmission delay, audio-related information, and audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device includes one of the following methods: using a second synchronization adjustment analysis model to analyze and process the feature parameters, audio transmission delay, audio-related information, and audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device; querying the strategy information matching the feature parameters, audio transmission delay, audio-related information, and audio preference information from the second adjustment strategy table to obtain the second synchronization adjustment strategy information corresponding to each audio device.
[0015] According to one embodiment of this application, a sound adjustment device includes: a scanning module for scanning multiple audio devices connected to a host device and recording characteristic parameters of each audio device; a calibration module for performing audio calibration on each audio device to obtain the audio transmission delay of each audio device; a detection module for detecting audio-related information in the host device; and an adjustment module for performing sound synchronization adjustment on each audio device based on the characteristic parameters, the audio transmission delay, and the audio-related information.
[0016] In some embodiments of this application, the device further includes an acquisition module for acquiring user-defined audio preference information; the adjustment module is used to: adjust the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, the audio-related information and the audio preference information.
[0017] In some embodiments of this application, the calibration module is configured to: acquire microphone data corresponding to each of the audio devices, wherein the microphone data is recorded when test audio is transmitted through the main device to each of the audio devices and the reference device for playback; analyze the microphone data corresponding to each of the audio devices to obtain the relative delay of each of the audio devices relative to the reference device; and obtain the audio transmission delay of each of the audio devices based on the relative delay of each of the audio devices relative to the reference device.
[0018] In some embodiments of this application, the characteristic parameters of the audio device include at least one of the following: the type, brand, and volume of the audio device.
[0019] In some embodiments of this application, the audio-related information includes at least one of the following: playback scene, playback status, and audio output format.
[0020] In some embodiments of this application, the adjustment module is configured to: analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each of the audio devices, wherein the first synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discard transmission audio data strategy information; and perform sound synchronization adjustment on each of the audio devices according to the first synchronization adjustment strategy information corresponding to each of the audio devices.
[0021] In some embodiments of this application, the adjustment module is used to implement one of the following methods: using a first synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each of the audio devices; querying the strategy information matching the feature parameters, the audio transmission delay, and the audio-related information from the first adjustment strategy table to obtain first synchronization adjustment strategy information corresponding to each of the audio devices.
[0022] In some embodiments of this application, the adjustment module is configured to: analyze and process the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain second synchronization adjustment strategy information corresponding to each of the audio devices, wherein the second synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information; and perform sound synchronization adjustment on each of the audio devices according to the second synchronization adjustment strategy information corresponding to each of the audio devices.
[0023] In some embodiments of this application, the adjustment module is used to implement one of the following methods: using a second synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain second synchronization adjustment strategy information corresponding to each of the audio devices; querying the strategy information matching the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information from the second adjustment strategy table to obtain second synchronization adjustment strategy information corresponding to each of the audio devices.
[0024] According to another embodiment of this application, a storage medium stores a computer program thereon, which, when executed by a computer's processor, causes the computer to perform the methods described in the embodiments of this application.
[0025] According to another embodiment of this application, an electronic device may include: a memory storing a computer program; and a processor reading the computer program stored in the memory to execute the methods described in the embodiments of this application.
[0026] According to another embodiment of this application, a computer program product or computer program includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in the embodiments of this application.
[0027] In this embodiment, multiple audio devices connected to the host device are scanned and the characteristic parameters of each audio device are recorded; audio calibration is performed on each audio device to obtain the audio transmission delay of each audio device; audio-related information in the host device is detected; and sound synchronization adjustment is performed on each audio device according to the characteristic parameters, the audio transmission delay, and the audio-related information.
[0028] In this way, for multiple audio devices connected to the master device, by comprehensively considering the characteristic parameters of each audio device, the audio transmission delay of each audio device, and the audio-related information in the master device, the sound synchronization adjustment of each audio device is performed. On the one hand, this information can be easily collected; on the other hand, by comprehensively considering this information, it can effectively adapt to the actual use of the audio devices. Overall, it can effectively improve the sound synchronization playback effect between multiple audio devices and improve the convenience of sound synchronization adjustment. Attached Figure Description
[0029] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0030] Figure 1 A flowchart of a sound adjustment method according to an embodiment of this application is shown.
[0031] Figure 2 An audio calibration flowchart according to one embodiment of this application is shown.
[0032] Figure 3 A flowchart illustrating sound adjustment according to an embodiment of this application is shown in one scenario.
[0033] Figure 4 A block diagram of a sound adjustment device according to an embodiment of this application is shown.
[0034] Figure 5 A block diagram of an electronic device according to an embodiment of this application is shown. Detailed Implementation
[0035] The present disclosure will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the embodiments provided herein are merely illustrative of the present disclosure and are not intended to limit the present disclosure. Furthermore, the embodiments provided below are some embodiments for implementing the present disclosure, and not all embodiments for implementing the present disclosure. Unless otherwise specified, the technical solutions described in the embodiments of the present disclosure can be implemented in any combination.
[0036] It should be noted that, in the embodiments of this disclosure, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a method or apparatus that includes a list of elements includes not only the elements expressly described, but also other elements not expressly listed, or elements inherent to implementing the method or apparatus. Without further limitations, an element defined by the phrase "comprising a..." does not exclude the presence of other related elements (e.g., steps in the method or units in the apparatus, such as portions of circuitry, processors, programs, or software, etc.) in the method or apparatus that includes that element.
[0037] For example, the sound adjustment method provided in this embodiment includes a series of steps, but the sound adjustment method provided in this embodiment is not limited to the steps described. Similarly, the sound adjustment device provided in this embodiment includes a series of units, but the device provided in this embodiment is not limited to the units explicitly described, but may also include units that need to be set up for obtaining relevant information or processing based on information.
[0038] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of this disclosure.
[0039] It is understood that in the specific implementation of this application, relevant data is involved. When the embodiments in this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0040] Figure 1 A flowchart illustrating a sound adjustment method according to an embodiment of this application is shown. The device executing this sound adjustment method can be any device with processing capabilities, such as a television, computer, mobile phone, smartwatch, and home appliance. In one specific embodiment of this application, the device serving as the executing entity is specifically a television, and the various audio devices include speakers, wired headphones, Bluetooth headphones, etc.
[0041] like Figure 1 As shown, the sound adjustment method may include steps S110 to S140.
[0042] Step S110: Scan multiple audio devices connected to the master device and record the characteristic parameters of each audio device; Step S120: Perform audio calibration on each audio device to obtain the audio transmission delay of each audio device; Step S130: Detect audio-related information in the master device; Step S140: Adjust the sound synchronization of each audio device according to the characteristic parameters, the audio transmission delay and the audio-related information.
[0043] The main device, such as a TV or VR device, can connect to multiple audio devices, such as speakers, wired headphones, and Bluetooth headphones, via wired or wireless connections. By scanning the multiple audio devices connected to the main device, the characteristic parameters of each audio device can be obtained and recorded.
[0044] Audio calibration is performed on each audio device to obtain the audio transmission delay of each audio device. The audio transmission delay of each audio device can be the relative delay of each audio device with respect to a certain reference device, which can be the speaker in the main device.
[0045] The main device is tested to detect audio-related information within it. This audio-related information pertains to the playback of audio data on the main device.
[0046] Based on a comprehensive analysis of characteristic parameters, audio transmission delay, and audio-related information, multiple delay-influencing factors can be considered. The applicant found that adjusting the audio synchronization of various audio devices by considering these factors can effectively improve the audio synchronization playback effect. Furthermore, these factors can be easily obtained, and the overall adjustment process is significantly more convenient.
[0047] In this way, based on steps S110 to S140, for multiple audio devices connected to the main device, by comprehensively considering the characteristic parameters of each audio device, the audio transmission delay of each audio device, and the audio-related information in the main device, the sound synchronization adjustment of each audio device is performed. On the one hand, this information can be easily collected; on the other hand, by comprehensively considering this information, it can effectively adapt to the actual use of the audio devices. Overall, it can effectively improve the sound synchronization playback effect between multiple audio devices and improve the convenience of sound synchronization adjustment.
[0048] The following description Figure 1 Further optional specific embodiments are provided for each step performed during sound adjustment in the example implementation.
[0049] In one embodiment, the characteristic parameters of the audio device include at least one of the audio device type, brand, and volume. Recording the characteristic parameters of each audio device may include: obtaining at least one of the audio device type, brand, and volume; and obtaining the characteristic parameters of each audio device based on at least one of the audio device type, brand, and volume. It should be noted that the characteristic parameters of the audio device in this application may also include other types of parameters that can effectively reflect the characteristics of the audio device, and this application does not limit this.
[0050] For each audio device, at least one of the following is scanned and obtained: type, brand, and volume. This type, brand, and volume are used as characteristic parameters of the audio device. In one specific embodiment, the characteristic parameters of each audio device include type, brand, and volume. These three parameters can "effectively reflect the characteristics of the audio device with a small number of parameters," and their use in adjusting the sound synchronization of the audio device can further improve the synchronization effect.
[0051] In one embodiment, the step of performing audio calibration on each of the audio devices to obtain the audio transmission delay of each of the audio devices may include:
[0052] Acquire microphone data corresponding to each of the audio devices, wherein the microphone data is recorded when test audio is transmitted through the main device to each of the audio devices and the reference device for playback; analyze the microphone data corresponding to each of the audio devices to obtain the relative delay of each audio device relative to the reference device; and obtain the audio transmission delay of each audio device based on the relative delay of each audio device relative to the reference device.
[0053] Test audio (which can be audio with specific frequency characteristics) is transmitted from the main device to each audio device and reference device for playback. At the same time, microphone data can be obtained by recording with a recording device with a microphone (such as a remote control).
[0054] See Figure 2 In one example, the device acting as the execution entity is the main device. Multiple audio devices connected to the main device are a Bluetooth headset 201 and a speaker / amplifier 202. The reference device is the speaker 203 in the main device. The main control module 205 in the main device can transmit test audio (audio with specific frequency characteristics) to each audio device and the reference device. The test audio played by each audio device can be recorded using a remote control 204 with a microphone to obtain recording data, which is then sent back to the main control module 205 in the main device. It is understood that for audio devices with low external volume, such as headsets, an audio amplifier can be used on these devices to record the audio for the microphone remote control 204 to record. Alternatively, the microphone remote control 204 can be placed close enough to the headset or other devices to achieve recording. The recording method can be selected according to actual needs, and this application does not specifically limit it.
[0055] By analyzing the microphone data corresponding to each audio device, the playback time of each audio device for a specific feature and the playback time of the reference device for the specific feature can be detected in the microphone data. Then, by calculating the difference between the playback time of each audio device for the specific feature and the playback time of the reference device for the specific feature, the relative delay of each audio device relative to the reference device can be obtained.
[0056] Furthermore, based on the relative delay of each audio device relative to the reference device, the audio transmission delay of each audio device can be obtained. Specifically, the relative delay of each audio device relative to the reference device can be used as the audio transmission delay of each audio device, or the relative delay of each audio device relative to the reference device can be adjusted according to a preset adjustment coefficient and then used as the audio transmission delay of each audio device.
[0057] In one embodiment, audio-related information may include at least one of a playback scenario, a playback state, and an audio output format. The playback scenario may include scenarios such as live streaming, on-demand playback, in-app playback, screen mirroring, or gaming; the playback state may include pause, fast forward, or rewind; and the audio output format may include PCM (Pulse Code Modulation), Raw audio output format, or analog audio output format. Correspondingly, detecting audio-related information in the main device may include: detecting at least one of a playback scenario, a playback state, and an audio output format in the main device; and obtaining the audio-related information in the main device based on at least one of the playback scenario, playback state, and audio output format. It should be noted that the audio-related information in this application may also include other types of audio-related information, and this application does not limit this.
[0058] For a main device (e.g., a television), at least one of the playback scene, playback status, and audio output format in the main device is detected, and at least one of the playback scene, playback status, and audio output format is used as audio-related information in the main device.
[0059] In one specific implementation, the audio-related information in the main device includes three types: playback scene, playback status, and audio output format. These three types of audio-related information in the main device can "effectively reflect the audio processing characteristics in the main device with a small number of parameters," and can be used to adjust the sound synchronization of each audio device to further improve the synchronization effect.
[0060] In one embodiment, before adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, and the audio-related information, the method may further include: obtaining user-defined audio preference information; the adjustment of the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, and the audio-related information may include: adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information.
[0061] Users of each audio device can customize their audio preferences individually. These preferences can be entered by the user in real time or pre-collected and stored. The audio preference information may include acceptable latency and preferred volume levels.
[0062] By acquiring user-defined audio preference information for each audio device, and further integrating the feature parameters, audio transmission delay, audio-related information, and audio preference information, sound synchronization adjustments are made for each audio device. This allows the audio synchronization adjustments to more effectively meet user needs and further improve the synchronized playback effect of the audio devices.
[0063] In one embodiment, adjusting the sound synchronization of each audio device based on the characteristic parameters, the audio transmission delay, and the audio-related information may include:
[0064] Based on the characteristic parameters, the audio transmission delay, and the audio-related information, analysis and processing are performed to obtain the first synchronization adjustment strategy information corresponding to each audio device. The first synchronization adjustment strategy information includes one of the following: delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information. Based on the first synchronization adjustment strategy information corresponding to each audio device, sound synchronization adjustment is performed on each audio device.
[0065] In this embodiment, based on the characteristic parameters, audio transmission delay and audio-related information, the first synchronization adjustment strategy information corresponding to each audio device is obtained. The first synchronization adjustment strategy information includes one of the following: delay compensation strategy information, playback sampling rate adjustment strategy information and discarding transmitted audio data strategy information.
[0066] By comprehensively considering characteristic parameters, audio transmission delay, and audio-related information, a suitable first synchronization adjustment strategy can be determined for each audio device. This strategy can be one of three: delay compensation, playback sampling rate adjustment, or discarding transmitted audio data. Based on this first synchronization adjustment strategy, effective sound synchronization adjustment can be performed on each audio device.
[0067] Specifically, the delay compensation strategy information can be the compensation value for delay compensation when transmitting audio data to the audio device; the playback sampling rate adjustment strategy information can be the target adjustment value of the playback sampling rate of the audio device; and the audio data discarding strategy information can be the amount of data to be discarded when transmitting audio data to the audio device.
[0068] In one embodiment, adjusting the sound synchronization of each audio device based on the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information may include:
[0069] Based on the analysis and processing of the characteristic parameters, the audio transmission delay, the audio-related information, and the audio preference information, a second synchronization adjustment strategy information corresponding to each audio device is obtained. The second synchronization adjustment strategy information includes one of the following: delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information. Based on the second synchronization adjustment strategy information corresponding to each audio device, sound synchronization adjustment is performed on each audio device.
[0070] In this embodiment, based on the characteristic parameters, audio transmission delay, audio-related information and audio preference information, the second synchronization adjustment strategy information corresponding to each audio device is obtained. The second synchronization adjustment strategy information includes one of the following: delay compensation strategy information, playback sampling rate adjustment strategy information and discarding transmitted audio data strategy information.
[0071] By comprehensively considering characteristic parameters, audio transmission delay, audio-related information, and audio preference information, a suitable second synchronization adjustment strategy can be determined for each audio device. The suitable second synchronization adjustment strategy for each audio device is one of three: delay compensation strategy, playback sampling rate adjustment strategy, or discarding transmitted audio data strategy. Based on the corresponding second synchronization adjustment strategy for each audio device, effective sound synchronization adjustment can be performed on each audio device.
[0072] Specifically, the delay compensation strategy information can be the compensation value for delay compensation when transmitting audio data to the audio device; the playback sampling rate adjustment strategy information can be the target adjustment value of the playback sampling rate of the audio device; and the audio data discarding strategy information can be the amount of data to be discarded when transmitting audio data to the audio device.
[0073] In one embodiment, the step of analyzing and processing the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices may include one of the following methods:
[0074] The first method involves using a first synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each audio device.
[0075] The second method involves querying the first adjustment strategy table to obtain the first synchronization adjustment strategy information corresponding to each audio device by matching the feature parameters, the audio transmission delay, and the audio-related information.
[0076] The first approach employs a first synchronization adjustment analysis model to analyze and process feature parameters, audio transmission delay, and audio-related information to obtain the first synchronization adjustment strategy information corresponding to each audio device. This first synchronization adjustment analysis model can be obtained by fine-tuning a large language model, or it can be obtained by training other self-built models. This first approach provides a more reliable way to obtain the first synchronization adjustment strategy information corresponding to each audio device, and can more effectively improve the sound synchronization adjustment effect.
[0077] The second method involves querying the first adjustment strategy table to find the matching strategy information for characteristic parameters, audio transmission delay, and audio-related information, which serves as the first synchronization adjustment strategy information for each audio device. The first adjustment strategy table stores the correspondence between different first synchronization adjustment strategy information and synchronization parameter sets; by using this correspondence, the first synchronization adjustment strategy information for each audio device can be retrieved from the first adjustment strategy table.
[0078] In one embodiment, the step of analyzing and processing the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain the second synchronization adjustment strategy information corresponding to each of the audio devices includes one of the following methods:
[0079] The first method employs a second synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device.
[0080] The second method involves querying the feature parameters, audio transmission delay, audio-related information, and audio preference information matching strategy information from the second adjustment strategy table to obtain the second synchronization adjustment strategy information corresponding to each audio device.
[0081] The first approach employs a second synchronization adjustment analysis model to analyze and process feature parameters, audio transmission delay, audio-related information, and audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device. This second synchronization adjustment analysis model can be obtained by fine-tuning a large language model, or it can be obtained by training other self-built models. This first approach provides a more reliable way to obtain the second synchronization adjustment strategy information corresponding to each audio device, and can more effectively improve the sound synchronization adjustment effect.
[0082] The second method involves querying the second adjustment strategy table to find the matching strategy information for characteristic parameters, audio transmission delay, audio-related information, and audio preference information. This information serves as the second synchronization adjustment strategy information for each audio device. The second adjustment strategy table stores the correspondence between different second synchronization adjustment strategies and synchronization parameter sets. The second synchronization adjustment strategy information for each audio device can be retrieved from the second adjustment strategy table based on this correspondence.
[0083] In one scenario, refer to Figure 3 The main device is a television, and the process of adjusting the sound in the television is as follows: Figure 3 As shown, in this scenario, the sound adjustment process may include steps S310 to S360.
[0084] Step S310: Input a data stream, which can be an audio / video stream or an audio stream;
[0085] Step S320: Data stream processing. If the data stream is an audio / video stream, the audio / video stream is demultiplexed to obtain a video stream and an audio stream.
[0086] Step S330: Decoding. The video stream is decoded using a video decoder, and the audio stream is decoded using an audio decoder.
[0087] Step S340, Audio-Video Sync (AV Sync): Synchronize the decoded audio and video data;
[0088] Step S350: Adjust the audio data for synchronized playback across multiple audio devices. Specifically, the decoded audio data is transmitted to each audio device, and the method described in the foregoing embodiments of this application is used to adjust the audio data for synchronized playback across the audio devices.
[0089] Step S360: The decoded video data is sent to the display for display.
[0090] In this scenario, by applying the aforementioned embodiments of this application to adjust the sound synchronization, the sound synchronization playback effect when the TV is connected to multiple audio devices for sound playback can be effectively improved. Moreover, these factors can be easily obtained, and the overall adjustment process is significantly more convenient.
[0091] To facilitate better implementation of the sound adjustment method provided in the embodiments of this application, the embodiments of this application also provide a sound adjustment device based on the above-described sound adjustment method. The meanings of the terms used are the same as in the sound adjustment method described above, and specific implementation details can be found in the descriptions in the method embodiments. Figure 4 A block diagram of a sound adjustment device according to an embodiment of this application is shown.
[0092] like Figure 4 As shown, the sound adjustment device 400 may include: a scanning module 410 for scanning multiple audio devices connected to a host device and recording the characteristic parameters of each audio device; a calibration module 420 for performing audio calibration on each audio device to obtain the audio transmission delay of each audio device; a detection module 430 for detecting audio-related information in the host device; and an adjustment module 440 for performing sound synchronization adjustment on each audio device based on the characteristic parameters, the audio transmission delay, and the audio-related information.
[0093] In some embodiments of this application, the device further includes an acquisition module for acquiring user-defined audio preference information; and an adjustment module for adjusting the sound synchronization of each audio device based on the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information.
[0094] In some embodiments of this application, the calibration module is configured to: acquire microphone data corresponding to each of the audio devices, wherein the microphone data is recorded when test audio is transmitted through the main device to each of the audio devices and the reference device for playback; analyze the microphone data corresponding to each of the audio devices to obtain the relative delay of each of the audio devices relative to the reference device; and obtain the audio transmission delay of each of the audio devices based on the relative delay of each of the audio devices relative to the reference device.
[0095] In some embodiments of this application, the characteristic parameters of the audio device include at least one of the following: the type, brand, and volume of the audio device.
[0096] In some embodiments of this application, the audio-related information includes at least one of the following: playback scene, playback status, and audio output format.
[0097] In some embodiments of this application, the adjustment module is configured to: analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each of the audio devices, wherein the first synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discard transmission audio data strategy information; and perform sound synchronization adjustment on each of the audio devices according to the first synchronization adjustment strategy information corresponding to each of the audio devices.
[0098] In some embodiments of this application, the adjustment module is used to implement one of the following methods: using a first synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each of the audio devices; querying the strategy information matching the feature parameters, the audio transmission delay, and the audio-related information from the first adjustment strategy table to obtain first synchronization adjustment strategy information corresponding to each of the audio devices.
[0099] In some embodiments of this application, the adjustment module is configured to: analyze and process the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain second synchronization adjustment strategy information corresponding to each of the audio devices, wherein the second synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information; and perform sound synchronization adjustment on each of the audio devices according to the second synchronization adjustment strategy information corresponding to each of the audio devices.
[0100] In some embodiments of this application, the adjustment module is used to implement one of the following methods: using a second synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain second synchronization adjustment strategy information corresponding to each of the audio devices; querying the strategy information matching the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information from the second adjustment strategy table to obtain second synchronization adjustment strategy information corresponding to each of the audio devices.
[0101] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of this application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.
[0102] Furthermore, embodiments of this application also provide an electronic device, such as... Figure 5 As shown, Figure 5 A block diagram of an electronic device according to an embodiment of this application is shown, specifically:
[0103] The electronic device may include components such as a processor 501 with one or more processing cores, a memory 502 with one or more computer-readable storage media, and a power supply 503. Those skilled in the art will understand that... Figure 5The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:
[0104] The processor 501 is the control center of the electronic device. It connects to various parts of the computer device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 502, and by calling data stored in the memory 502, it performs various functions of the computer device and processes data, thereby providing overall monitoring of the electronic device. Optionally, the processor 501 may include one or more processing cores; preferably, the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user page, and application programs, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 501.
[0105] The memory 502 can be used to store software programs and modules. The processor 501 executes various functional applications and data processing by running the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 502 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.
[0106] The electronic device also includes a power supply 503 that supplies power to various components. Preferably, the power supply 503 can be logically connected to the processor 501 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 503 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0107] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 501 in the electronic device loads the executable files corresponding to the processes of one or more computer programs into the memory 502 according to the following instructions, and the processor 501 runs the computer programs stored in the memory 502, thereby realizing the various functions in the foregoing embodiments of this application. For example, the processor 501 can perform the following steps:
[0108] Scan multiple audio devices connected to the master device and record the characteristic parameters of each audio device; perform audio calibration on each audio device to obtain the audio transmission delay of each audio device; detect audio-related information in the master device; and adjust the sound synchronization of each audio device according to the characteristic parameters, the audio transmission delay, and the audio-related information.
[0109] In some embodiments of this application, before adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, and the audio-related information, the method further includes: obtaining user-defined audio preference information; correspondingly, adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, and the audio-related information includes: adjusting the sound synchronization of each audio device according to the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information.
[0110] In some embodiments of this application, the step of performing audio calibration on each of the audio devices to obtain the audio transmission delay of each of the audio devices includes: acquiring microphone data corresponding to each of the audio devices, wherein the microphone data is recorded when test audio is transmitted through the main device to each of the audio devices and the reference device for playback; analyzing the microphone data corresponding to each of the audio devices to obtain the relative delay of each of the audio devices relative to the reference device; and obtaining the audio transmission delay of each of the audio devices based on the relative delay of each of the audio devices relative to the reference device.
[0111] In some embodiments of this application, the characteristic parameters of the audio device include at least one of the following: the type, brand, and volume of the audio device.
[0112] In some embodiments of this application, the audio-related information includes at least one of the following: playback scene, playback status, and audio output format.
[0113] In some embodiments of this application, the step of adjusting the sound synchronization of each audio device based on the feature parameters, the audio transmission delay, and the audio-related information includes: analyzing and processing the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each audio device, wherein the first synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information; and adjusting the sound synchronization of each audio device based on the first synchronization adjustment strategy information corresponding to each audio device.
[0114] In some embodiments of this application, the step of analyzing and processing the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices includes one of the following methods: using a first synchronization adjustment analysis model to analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices; querying the strategy information matching the feature parameters, the audio transmission delay, and the audio-related information from a first adjustment strategy table to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices.
[0115] In some embodiments of this application, the step of adjusting the sound synchronization of each audio device based on the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information includes: analyzing and processing the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain second synchronization adjustment strategy information corresponding to each audio device, wherein the second synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information; and adjusting the sound synchronization of each audio device based on the second synchronization adjustment strategy information corresponding to each audio device.
[0116] In some embodiments of this application, the step of analyzing and processing the feature parameters, audio transmission delay, audio-related information, and audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device includes one of the following methods: using a second synchronization adjustment analysis model to analyze and process the feature parameters, audio transmission delay, audio-related information, and audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device; querying the strategy information matching the feature parameters, audio transmission delay, audio-related information, and audio preference information from the second adjustment strategy table to obtain the second synchronization adjustment strategy information corresponding to each audio device.
[0117] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by a computer program, or by a computer program controlling related hardware. The computer program can be stored in a computer-readable storage medium and loaded and executed by a processor.
[0118] Therefore, embodiments of this application also provide a storage medium storing a computer program that can be loaded by a processor to execute the steps in any of the methods provided in embodiments of this application.
[0119] The storage medium can be a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.
[0120] Since the computer program stored in the storage medium can execute the steps of any of the methods provided in the embodiments of this application, the beneficial effects that the methods provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.
[0121] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein.
[0122] It should be understood that this application is not limited to the embodiments described above and shown in the accompanying drawings, but various modifications and changes can be made without departing from its scope.
Claims
1. A sound adjustment method, characterized in that, include: Scan multiple audio devices connected to the master device and record the characteristic parameters of each audio device; Perform audio calibration on each of the audio devices to obtain the audio transmission delay of each of the audio devices; Detect audio-related information in the main device; Based on the characteristic parameters, the audio transmission delay, and the audio-related information, sound synchronization adjustment is performed on each of the audio devices; The step of adjusting the sound synchronization of each audio device based on the characteristic parameters, the audio transmission delay, and the audio-related information includes: Based on the characteristic parameters, the audio transmission delay and the audio-related information, the first synchronization adjustment strategy information corresponding to each audio device is obtained through analysis and processing. The first synchronization adjustment strategy information includes one of the following: delay compensation strategy information, playback sampling rate adjustment strategy information and discarding transmitted audio data strategy information. According to the first synchronization adjustment strategy information corresponding to each audio device, sound synchronization adjustment is performed on each audio device.
2. The method according to claim 1, characterized in that, Before adjusting the sound synchronization of each audio device based on the characteristic parameters, the audio transmission delay, and the audio-related information, the method further includes: Obtain user-defined audio preference information; Correspondingly, the step of adjusting the sound synchronization of each audio device based on the feature parameters, the audio transmission delay, and the audio-related information includes: Based on the characteristic parameters, the audio transmission delay, the audio-related information, and the audio preference information, sound synchronization adjustments are made for each audio device.
3. The method according to claim 1, characterized in that, The step of performing audio calibration on each of the audio devices to obtain the audio transmission delay of each of the audio devices includes: Acquire microphone data corresponding to each of the aforementioned audio devices, wherein the microphone data is recorded when test audio is transmitted from the main device to each of the aforementioned audio devices and the reference device for playback; Analyze the microphone data corresponding to each audio device to obtain the relative delay of each audio device relative to the reference device; The audio transmission delay of each audio device is obtained based on the relative delay of each audio device with respect to the reference device.
4. The method according to claim 1, characterized in that, The characteristic parameters of the audio device include at least one of the following: the type, brand, and volume of the audio device.
5. The method according to claim 1, characterized in that, The audio-related information includes at least one of the following: playback scene, playback status, and audio output format.
6. The method according to claim 1, characterized in that, The step of analyzing and processing the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each of the audio devices includes one of the following methods: A first synchronization adjustment analysis model is used to analyze and process the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each audio device. From the first adjustment strategy table, query the strategy information matching the feature parameters, the audio transmission delay, and the audio-related information to obtain the first synchronization adjustment strategy information corresponding to each audio device.
7. The method according to claim 1, characterized in that, The step of adjusting the sound synchronization of each audio device based on the characteristic parameters, the audio transmission delay, and the audio-related information includes: Based on the characteristic parameters, the audio transmission delay, the audio-related information and the audio preference information, the second synchronization adjustment strategy information corresponding to each audio device is obtained. The second synchronization adjustment strategy information includes one of the following: delay compensation strategy information, playback sampling rate adjustment strategy information and discarding transmitted audio data strategy information. According to the second synchronization adjustment strategy information corresponding to each audio device, sound synchronization adjustment is performed on each audio device.
8. The method according to claim 7, characterized in that, The step of analyzing and processing the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device includes one of the following methods: A second synchronization adjustment analysis model is used to analyze and process the feature parameters, the audio transmission delay, the audio-related information and the audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device. From the second adjustment strategy table, query the strategy information matching the feature parameters, the audio transmission delay, the audio-related information, and the audio preference information to obtain the second synchronization adjustment strategy information corresponding to each audio device.
9. A sound adjustment device, characterized in that, include: The scanning module is used to scan multiple audio devices connected to the main device and record the characteristic parameters of each audio device; A calibration module is used to perform audio calibration on each of the audio devices to obtain the audio transmission delay of each of the audio devices. The detection module is used to detect audio-related information in the main device; An adjustment module is used to perform sound synchronization adjustment on each of the audio devices based on the feature parameters, the audio transmission delay, and the audio-related information. The step of performing sound synchronization adjustment on each of the audio devices based on the feature parameters, the audio transmission delay, and the audio-related information includes: analyzing and processing the feature parameters, the audio transmission delay, and the audio-related information to obtain first synchronization adjustment strategy information corresponding to each of the audio devices, wherein the first synchronization adjustment strategy information includes one of delay compensation strategy information, playback sampling rate adjustment strategy information, and discarding transmitted audio data strategy information; and performing sound synchronization adjustment on each of the audio devices based on the first synchronization adjustment strategy information corresponding to each of the audio devices.
10. A storage medium, characterized in that, It stores a computer program that, when executed by the computer's processor, causes the computer to perform the method described in any one of claims 1 to 8.
11. An electronic device, characterized in that, include: Memory, which stores computer programs; A processor reads a computer program stored in memory to perform the method described in any one of claims 1 to 8.
Citation Information
Patent Citations
Audio and video playing synchronization method and synchronization device
CN105898502A
Audio synchronous playing method and system and storage medium
CN118102434A