Reverberation adjustment method and device, display equipment and storage medium

Abstract

The invention discloses a reverberation adjusting method and device, display equipment and a storage medium, and relates to the technical field of display equipment, the method is applied to the display equipment, the display equipment comprises a loudspeaker and a microphone, and the method comprises the following steps: outputting a preset test sound source through the loudspeaker; when the output of the test sound source is stopped, starting the timing of the target reverberation time; collecting a reverberation signal through a microphone, and stopping timing of the target reverberation time when the sound pressure level of the reverberation signal is attenuated by a preset decibel; and adjusting a preset reverberation algorithm according to a time difference between the target reverberation time and a preset standard reverberation time, so that the time difference is smaller than a preset difference threshold. According to the method and the device, the reverberation algorithm can be adaptively corrected according to the environment where the user is located, so that the reverberation algorithm is matched with the current environment, the reverberation effect in the current environment can be close to the optimal reverberation effect in the test environment, and the karaoke experience of the user in the home environment is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a reverberation adjustment method, device, display device, and storage medium. Background Art

[0002] With the rapid development of smart home technology, smart TVs have become an important part of the home entertainment center, among which the karaoke function is particularly popular among home users.

[0003] Smart TVs currently on the market generally support downloading karaoke software through built-in app stores. These apps typically offer a vast library of songs for users to choose from and come equipped with basic audio processing features, such as echo and reverberation effects. However, the system's production and commissioning environment is fixed. When used in a user's home, the reverberation effect can be affected by the varying environments, resulting in a poor karaoke experience.

[0004] In summary, how to improve the karaoke experience in a home environment has become a technical challenge that needs to be solved urgently.

[0005] The above content is only used to assist in understanding the technical solution of this application and does not constitute an admission that the above content is prior art. Summary of the Invention

[0006] The main purpose of this application is to provide a reverberation adjustment method, device, display device and storage medium, aiming to solve the technical problem of how to improve the karaoke experience in a home environment.

[0007] To achieve the above objectives, the present application proposes a reverberation adjustment method, which is applied to a display device, wherein the display device includes a speaker and a microphone, and the method includes:

[0008] outputting a preset test sound source through the speaker;

[0009] When the output of the test sound source stops, starting the timing of the target reverberation time;

[0010] collecting a reverberation signal through the microphone, and stopping the timing of the target reverberation time when the sound pressure level of the reverberation signal decays by a preset decibel;

[0011] The preset reverberation algorithm is adjusted according to the time difference between the target reverberation time and the preset standard reverberation time, so that the time difference is less than a preset difference threshold.

[0012] In one embodiment, the display device further includes: a positioning module; after the step of adjusting the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, the method further includes:

[0013] Acquire a spatial model of the environment in which the display device is located;

[0014] Acquire a first spatial coordinate of the microphone in the spatial model by the positioning module;

[0015] When the first space coordinates are updated, prompt information for prompting recalibration is output.

[0016] In one embodiment, after the step of obtaining the first spatial coordinates of the microphone in the spatial model by the positioning module, the method further includes:

[0017] Segmenting the spatial model to obtain a plurality of sub-regions;

[0018] Determine a first sub-region corresponding to the first spatial coordinate in each of the sub-regions;

[0019] The adjusted first algorithm parameter of the reverberation algorithm is associated with the first sub-region and stored in a preset storage space.

[0020] In one embodiment, after the step of adjusting the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, the method further includes:

[0021] When the first spatial coordinate is updated, obtaining a second spatial coordinate of the microphone in the spatial model;

[0022] Determine a second sub-region corresponding to the second spatial coordinate in the sub-region;

[0023] searching the storage space for a second algorithm parameter corresponding to the second sub-region;

[0024] Applying the second algorithm parameters to the reverberation algorithm when the second algorithm parameters exist.

[0025] In one embodiment, when the speaker is a speaker group, after the step of obtaining the first spatial coordinates of the microphone in the spatial model by the positioning module, the method further includes:

[0026] Calculating the coordinate difference between the first spatial coordinate and the preset center coordinate;

[0027] The output parameters of the speaker group are adjusted according to the coordinate difference.

[0028] In one embodiment, after the step of associating the adjusted first algorithm parameter of the reverberation algorithm with the first sub-region and storing them in a preset storage space, the method further includes:

[0029] For each target sub-region in each of the sub-regions, obtaining adjacent target algorithm parameters corresponding to each adjacent sub-region of the target sub-region;

[0030] With the spatial coordinate axis as a reference, the target algorithm parameters corresponding to the target sub-region are smoothed based on the adjacent target algorithm parameters.

[0031] In one embodiment, after the step of adjusting the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, the method further includes:

[0032] Get the style reverb parameters of multiple preset style reverbs;

[0033] Calculating the parameter difference between each style reverberation parameter and the preset reverberation parameter of the reverberation algorithm;

[0034] Each of the style reverberation parameters is adjusted according to the adjusted first algorithm parameter of the reverberation algorithm to update each of the style reverberation parameters.

[0035] In addition, to achieve the above-mentioned purpose, the present application also proposes a reverberation adjustment device, which is provided on a display device, wherein the display device includes: a speaker and a microphone, and the device includes:

[0036] An output module, configured to output a preset test sound source through the speaker;

[0037] A timing module, configured to start timing the target reverberation time when the output of the test sound source stops;

[0038] an acquisition module, configured to acquire a reverberation signal through the microphone, and stop timing the target reverberation time when the sound pressure level of the reverberation signal decays by a preset decibel;

[0039] The adjustment module is configured to adjust a preset reverberation algorithm according to a time difference between the target reverberation time and a preset standard reverberation time, so that the time difference is smaller than a preset difference threshold.

[0040] In addition, to achieve the above-mentioned purpose, the present application also proposes a display device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the reverberation adjustment method described above.

[0041] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium and stores a computer program. When the computer program is executed by a processor, the steps of the reverberation adjustment method described above are implemented.

[0042] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the reverberation adjustment method described above are implemented.

[0043] The present application provides a reverberation adjustment method, which outputs a preset test sound source through a loudspeaker, and then collects a reverberation signal after system reverberation and room reverberation through a microphone. When the test sound source stops outputting, timing starts, and then stops when the sound pressure level of the reverberation signal collected by the microphone decays by a preset decibel. At this time, the reverberation time of the system in the current environment can be obtained, and the time difference between the reverberation time and the preset standard reverberation time is calculated. Then, the reverberation algorithm preset by the system is adjusted according to the time difference until the time difference is less than a preset difference threshold, which indicates that the current reverberation effect has approached the optimal one.

[0044] In summary, this application corrects the preset reverberation algorithm by comparing the difference in reverberation time between the current environment and the test environment. Compared with the fixed reverberation algorithm in the conventional karaoke system, this application can adaptively correct the reverberation algorithm according to the user's environment, so that the reverberation algorithm matches the current environment, so that the reverberation effect in the current environment can approach the optimal reverberation effect in the test environment, thereby improving the user's karaoke experience in a home environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0046] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0047] Figure 1 A flowchart of the first embodiment of the reverberation adjustment method of the present application is provided;

[0048] Figure 2 This is a schematic diagram of the reverberation scene in the room for this application;

[0049] Figure 3This is a flow chart of an embodiment of a reverberation adjustment method of the present application;

[0050] Figure 4 This is a schematic diagram of a reverberation signal involved in an embodiment of the reverberation adjustment method of the present application;

[0051] Figure 5 This is a schematic diagram of the module structure of the reverberation adjustment device according to an embodiment of the present application;

[0052] Figure 6 Schematic diagram of the device structure of the hardware operating environment involved in the reverberation adjustment method in the embodiment of the present application.

[0053] The purpose, features and advantages of this application will be further explained with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0054] It should be understood that the specific embodiments described herein are merely used to explain the technical solutions of the present application and are not intended to limit the present application.

[0055] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0056] The main solution of the embodiment of the present application is: outputting a preset test sound source through the speaker;

[0057] When the output of the test sound source stops, the timing of the target reverberation time is started; the reverberation signal is collected by the microphone, and the timing of the target reverberation time is stopped when the sound pressure level of the reverberation signal decays by a preset decibel; and the preset reverberation algorithm is adjusted according to the time difference between the target reverberation time and the preset standard reverberation time so that the time difference is less than a preset difference threshold.

[0058] With the rapid development of smart home technology, smart TVs have become an important part of the home entertainment center, among which the karaoke function is particularly popular among home users.

[0059] Smart TVs currently on the market generally support downloading karaoke software through built-in app stores. These apps typically offer a vast library of songs for users to choose from and come equipped with basic audio processing features, such as echo and reverberation effects. However, the system's production and commissioning environment is fixed. When used in a user's home, the reverberation effect can be affected by the varying environments, resulting in a poor karaoke experience.

[0060] In summary, how to improve the karaoke experience in a home environment has become a technical challenge that needs to be solved urgently.

[0061] In response to the above problems, the present application provides a reverberation adjustment method, which outputs a preset test sound source through a speaker, and then collects the reverberation signal after system reverberation and room reverberation through a microphone. When the test sound source stops outputting, the timing starts, and then when the sound pressure level of the reverberation signal collected by the microphone decays by a preset decibel, the timing stops. At this time, the reverberation time of the system in the current environment can be obtained, and the time difference between the reverberation time and the preset standard reverberation time can be calculated. The system preset reverberation algorithm is then adjusted according to the time difference until the time difference is less than the preset difference threshold, which indicates that the current reverberation effect has approached the optimal one.

[0062] In summary, this application corrects the preset reverberation algorithm by comparing the difference in reverberation time between the current environment and the test environment. Compared with the fixed reverberation algorithm in the conventional karaoke system, this application can adaptively correct the reverberation algorithm according to the user's environment, so that the reverberation algorithm matches the current environment, so that the reverberation effect in the current environment can approach the optimal reverberation effect in the test environment, thereby improving the user's karaoke experience in a home environment.

[0063] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, mobile phone, etc., or an electronic device or display device capable of implementing the above functions. The following uses a display device as an example to illustrate this embodiment and the following embodiments.

[0064] Based on this, the embodiment of the present application provides a reverberation adjustment method, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the reverberation adjustment method of the present application.

[0065] In this embodiment, the reverberation adjustment method is applied to a display device, which includes a speaker and a microphone. The method includes steps S10 to S40:

[0066] Step S10, outputting a preset test sound source through the speaker;

[0067] It should be noted that, in this embodiment, please refer to Figure 2 , Figure 2 This is a schematic diagram of the reverberation scene in the room of this application. In a room, the spatial sound where the speaker and the listener are located is as follows: Figure 2As shown in the figure, the listener hears not only the direct signal but also many reflected sounds. There are two key factors that influence the sound quality the listener perceives: room size and reflection intensity. When the room in which the two parties are located is very large, reflections are essentially inaudible. Similarly, the material of a house also affects the intensity of reflections. For example, a house made of metal and wood will obviously have different reflection effects.

[0068] It should be noted that in this embodiment, reverberation is mainly used for karaoke singing, increasing the delay of the microphone sound, generating an appropriate amount of echo, making the singing voice rounder and more beautiful, and the singing less "dry". Reverberation time is an important parameter that characterizes the acoustic characteristics of a room. The definition of reverberation time is the time required for the sound pressure level to decay by 60dB after the sound source stops making sound. It is mainly determined by the size of the room and the acoustic characteristics of the surface material. If the reverberation time is too long, the sound will appear wet and turbid. If the reverberation time is too short, the sound will appear dry and unnatural. Televisions and karaoke systems have been debugged in standard rooms to obtain the optimal reverberation time when they leave the factory, and the karaoke effect is best at this time. Users' home environments are different, and the reverberation time has also changed. It has deviated from the optimal reverberation time, and the reverberation time needs to be corrected according to the user's home environment.

[0069] In this embodiment, the system outputs a preset test sound source through a speaker, and uses the speaker to play a known and standardized sound signal, which will be used for subsequent reverberation time measurement and analysis.

[0070] Step S20, when the output of the test sound source is stopped, the target reverberation time is started;

[0071] In this embodiment, after the output sound stabilizes, the output of the test sound source is stopped, and then the system starts timing the target reverberation time.

[0072] Step S30, collecting a reverberation signal through the microphone, and stopping the timing of the target reverberation time when the sound pressure level of the reverberation signal decays by a preset decibel;

[0073] In this embodiment, the system uses a microphone to capture the reverberation signal and stops counting the target reverberation time when the reverberation signal's sound pressure level drops by a preset decibel level. The microphone, acting as a sound receiving device, captures the reverberation signal in the environment. When the sound pressure level of this signal drops to the preset decibel level, the reverberation process ends, and the system stops counting.

[0074] Step S40 : adjusting a preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, so that the time difference is smaller than a preset difference threshold.

[0075] It should be noted that, in this embodiment, the karaoke system is equipped with a set reverberation algorithm during the development process. The reverberation algorithm will be tested in a fixed test environment, and the reverberation time tested at this time is the standard reverberation time.

[0076] In this embodiment, the system adjusts the preset reverberation algorithm based on the time difference between the target reverberation time and the preset standard reverberation time, so that the time difference is less than a preset difference threshold. This adjustment process is an adaptive cycle. By comparing the actual measured reverberation time with the expected standard reverberation time, the system fine-tunes the reverberation algorithm to optimize the sound quality and bring the actual reverberation time closer to the ideal value.

[0077] For details, please refer to Figure 3 , Figure 3 This is a flow chart of an embodiment of the reverberation adjustment method of the present application, as shown in FIG. Figure 3 As shown in the figure, when calibrating the reverberation algorithm, a standard sound source, pink noise, at a sound pressure of 100dB was played through the TV speakers. Pink noise is a common natural noise, covering the human hearing range of 20Hz-20kHz. From a waveform perspective, because pink noise is distributed according to frequency octaves, each sampling point has the same energy. From a power (energy) perspective, the energy of pink noise decays from low to high frequencies, following a 1 / f curve, typically decreasing by 3dB per octave. Pink noise is a sound most commonly used in acoustic testing. On an FFT Fourier analyzer, the spectrum of pink noise appears to ripple like a wave, with the level fluctuating within a certain range. A handheld microphone is used at the user's karaoke location to collect the current sound pressure level. The microphone is connected to the TV via a wireless module and transmits the collected sound pressure level to the TV's main chip. First, pink noise plays for about three minutes to stabilize the room's sound field. Then, the TV's main chip stops playback and starts timing. When the TV's main chip detects a 60dB attenuation of the sound pressure level captured by the microphone at its current location, it stops timing. The time t elapsed between the start and the end of timing is the reverberation time of the user's home environment. This time difference is then compared with the preset optimal reverberation time to determine the reverberation time difference. This reverberation time difference is then fed back to the convolution reverberation algorithm module. Based on this difference, the convolution artificial reverberation algorithm module adaptively adjusts the reverberation parameters to calibrate the room impulse response, ensuring that the reverberation algorithm is optimized for the current environment.

[0078] For the preset reverberation algorithm in the karaoke system, please refer to Figure 4 , Figure 4 This is a schematic diagram of a reverberation signal involved in an embodiment of the reverberation adjustment method of the present application, as shown in FIG. Figure 4As shown, the reverberation signal includes direct sound (without any reflection), early reflection (composed of sound waves reflected once or several times), and late reverberation (composed of sound waves reflected more times).

[0079] As an example, in the reverberation algorithm, the room impulse response (RIR) can be decomposed into two parts: early reflection and late reverberation. The early reflection can be represented by the delayed sum with corresponding attenuation factors; the late reverberation RIR is synthesized in the frequency domain and then transformed into the time domain. First, the room frequency response (RFR) is synthesized in the frequency domain using the autoregressive sliding average model, and then the time domain RIR is obtained by inverse Fourier transform. Finally, the clean anechoic signal is convolved with the RIR to obtain the reverberation signal.

[0080] From signal processing theory, we know that for a linear time-invariant system, its output signal is equal to the convolution of the input signal and the room impulse response y(t) = x(t) * h(t).

[0081] Where is the output signal, is the input signal, and is the room impulse response. If the room is considered a linear time-invariant system, the sound emitted by a source within the room is "processed" by the room and transmitted to the receiver. The received sound is the output signal of the system. The room impulse response is equivalent to the unit impulse response of the system. Artificial reverberation using the convolution method involves convolving clean speech with to produce a reverberant signal.

[0082] Speech signals can be considered to be short-term stationary and long-term non-stationary. Their long-term non-stationary nature is due to the physical motion of the vocal organs, which have a certain degree of inertia. Therefore, for short periods of time, speech signals can be treated as stationary. To fully preserve the original information in speech while minimizing computational overhead, short periods of speech are typically sampled at intervals of 15-20 milliseconds for feature extraction. The distribution of relevant characteristic parameters of speech signals is considered consistent over short periods (10-30 milliseconds), but exhibits significant variations over longer periods. In digital signal processing, we generally aim to perform time-frequency analysis on stationary signals to extract features. Therefore, when extracting features from speech signals, we define a time window of approximately 20 milliseconds, within which the speech signal is considered stationary. This window is then moved across the speech signal, and a feature representing the signal within each time window is extracted, resulting in a feature sequence for the speech signal. The speech waveform in the time domain contains a series of distinct events. As the time domain changes, the spectral characteristics in the frequency domain also vary significantly over time. Simply performing a simple Fourier transform on the entire speech signal would fail to accurately capture the spectral information that changes over time, and the speech segments would be abruptly interrupted and the spectrum distorted. Therefore, performing a short-time Fourier transform and an inverse short-time Fourier transform on the speech signal is useful.

[0083] h(t) can be decomposed into two parts: early reflection and late reverberation, h(t) = h e (t)+h1(t).

[0084] where h e (t) is the early room impulse response, and h1(t) is the late room impulse response.

[0085] H(k)=H e (k)+H1(k);

[0086] Among them, H e (k) and H1(k) are h e (t) and h1(t). The early reflection can be represented by the sum of M-order delays with corresponding attenuation factors, which can be expressed in the frequency domain as

[0087]

[0088] where ρ k and τ k are the attenuation factor and delay of the kth delay respectively.

[0089] The later room impulse response can be expressed as: H1(k)

[0090] Φ(z)H1(k)=Θ(z)ε(k)

[0091]

[0092]

[0093] Among them, after a series of calculations, H can be obtained after the length, width, height and reverberation time of the room are given. e (k) and H1(k), and then undergoing an inverse Fourier transform to obtain the complete room impulse response h(t). The clean speech x(t) is convolved with h(t) to produce the reverberation signal. This combines real sound with simulated spatial reflections. As can be seen from the above process, the room impulse response can be altered by changing parameters such as room geometry and reverberation time.

[0094] Furthermore, in a feasible implementation manner, after the above step S40, the method may further include steps S50 to S70:

[0095] Step S50, obtaining style reverberation parameters of a plurality of preset style reverberations;

[0096] In this embodiment, based on the previous steps, the system further obtains style reverberation parameters for multiple preset style reverberations. Style reverberation parameters refer to sets of reverberation parameters preset for different sound styles (such as theater, concert hall, and recording studio). These parameters define the unique reverberation and reflection characteristics of each style. These parameters can be obtained through pre-set configuration files, user-defined settings, or downloaded from the Internet.

[0097] Step S60, calculating the parameter difference between each style reverberation parameter and the preset reverberation parameter of the reverberation algorithm;

[0098] In this embodiment, the system calculates the difference between each style's reverberation parameters and the preset reverberation parameters of the reverberation algorithm. This step is to compare and evaluate the differences between the style's reverberation parameters and the current reverberation algorithm parameters, facilitating subsequent parameter adjustments. Parameter differences can include differences in reverberation time, high-frequency attenuation, low-frequency enhancement, and other aspects.

[0099] Step S70 : adjusting each of the style reverberation parameters according to the adjusted first algorithm parameter of the reverberation algorithm to update each of the style reverberation parameters.

[0100] In this embodiment, the system adjusts the reverberation parameters for each style based on the adjusted first algorithm parameters of the reverberation algorithm to update these parameters. Based on the customized reverberation algorithm parameters obtained in the previous step, the style reverberation parameters are adjusted accordingly to ensure they match the current environment and microphone position. Adjustments can include multiple parameters, such as reverberation time, reflection coefficient, decay rate, etc.

[0101] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction and will not be repeated hereafter. On this basis, the display device further includes: a positioning module; after the above-mentioned step S40, the method may further include steps A10 to A30:

[0102] Step A10, obtaining a spatial model of the environment where the display device is located;

[0103] In this embodiment, after adjusting the reverberation algorithm, the system further acquires a spatial model of the display device's environment. This spatial model is typically a three-dimensional representation that describes the physical layout of the display device's surroundings, including walls, ceilings, furniture, and other factors that may affect sound propagation. This spatial model can be acquired using pre-set parameters, a 3D model generated by camera scanning, or user-entered environmental information.

[0104] Step A20, obtaining the first spatial coordinates of the microphone in the spatial model through the positioning module;

[0105] In this embodiment, the system uses a positioning module to obtain the first spatial coordinates of the microphone in the spatial model. The positioning module can use a variety of technologies, such as ultrasonic positioning, infrared positioning, camera image recognition positioning, or Wi-Fi / Bluetooth-based triangulation positioning, which can accurately measure the position of the microphone relative to the display device or other known points in the environment.

[0106] Step A30: When the first spatial coordinates are updated, output prompt information for prompting recalibration.

[0107] In this embodiment, when the microphone's first spatial coordinates are updated, the system outputs a prompt to recalibrate. This typically occurs when the device moves, the environment changes, or the positioning module detects a significant position change. The prompt can be conveyed via a display device screen, an audio prompt, or a notification sent to the user's mobile device.

[0108] Through the above steps, not only the display device's adaptability to environmental changes is enhanced, but also the accuracy of sound processing and user experience are further improved through precise microphone positioning and timely calibration prompts.

[0109] Based on the first and / or second embodiments of the present application, in the third embodiment of the present application, the same or similar contents as those of the first and / or second embodiments can be referred to above and will not be described in detail. On this basis, after the above step A20, the method may further include steps B10 to B30:

[0110] Step B10, dividing the spatial model into multiple sub-regions;

[0111] In this embodiment, after completing the spatial positioning of the microphones, the system further segments the spatial model into multiple sub-regions. These sub-regions can be divided based on the physical characteristics of the environment (such as walls, doors, windows, etc.) or functional requirements (such as different rooms, areas, etc.). The purpose of segmentation is to more accurately describe the sound characteristics of different locations in the environment, thereby achieving more refined control over sound processing.

[0112] Step B20, determining the first sub-region corresponding to the first spatial coordinate in each of the sub-regions;

[0113] In this embodiment, the system determines the first sub-area corresponding to the first spatial coordinate of the microphone in each sub-area, and associates the position of the microphone with a specific sub-area based on the sub-area information. This helps the system identify the environmental area where the microphone is currently located, thereby selecting the most appropriate sound processing strategy.

[0114] Step B30: associate the adjusted first algorithm parameter of the reverberation algorithm with the first sub-region and store them in a preset storage space.

[0115] In this embodiment, the system associates the adjusted first algorithm parameter of the reverberation algorithm with the first sub-region and stores them in a preset storage space.

[0116] Furthermore, in a feasible implementation manner, after the above step S40, the method may further include steps C10 to C40:

[0117] Step C10: when the first spatial coordinates are updated, obtaining the second spatial coordinates of the microphone in the spatial model;

[0118] In this embodiment, when the first spatial coordinates of the microphone change (for example, the user moves the microphone or the display device), the system re-acquires the second spatial coordinates of the microphone in the spatial model through the positioning module.

[0119] Step C20, determining a second sub-region corresponding to the second spatial coordinate in the sub-region;

[0120] In this embodiment, the system determines the sub-region where the microphone is currently located, that is, the second sub-region, according to the updated second spatial coordinates.

[0121] Step C30, searching the storage space for a second algorithm parameter corresponding to the second sub-region;

[0122] In this embodiment, the system searches for the second algorithm parameters corresponding to the second sub-region in a preset storage space. These parameters were customized and stored based on the sound characteristics of the sub-region in the previous step. By searching these parameters, the system can obtain a sound processing strategy that matches the current microphone position.

[0123] Step C40: When the second algorithm parameters exist, apply the second algorithm parameters to the reverberation algorithm.

[0124] In this embodiment, when the second algorithm parameters corresponding to the second sub-region are found in the storage space, the system applies these parameters to the reverberation algorithm. This means that the system can dynamically adjust the reverberation algorithm parameters based on changes in microphone position, thereby achieving customized optimization of sound processing.

[0125] The above steps not only achieve real-time updates of microphone positions and dynamic adjustments to sound processing, but also further enhance the accuracy and effectiveness of sound processing through sub-region division and customized storage of algorithm parameters. This series of steps together constitutes a complete dynamic sound processing flow, ensuring the stability and performance of the sound processing system in different environments and locations.

[0126] Furthermore, in a feasible implementation manner, after the above step B30, the method may further include steps B40 to B50:

[0127] Step B40: for each target sub-region in each of the sub-regions, obtaining adjacent target algorithm parameters corresponding to each adjacent sub-region of the target sub-region;

[0128] In this embodiment, the system further obtains the algorithm parameters corresponding to each adjacent sub-region (referred to as the adjacent target algorithm parameters) for each sub-region in the spatial model (referred to as the target sub-region). These adjacent sub-region algorithm parameters are customized and stored based on the sound characteristics of the sub-region.

[0129] Step B50 , using the spatial coordinate axis as a reference, and based on each of the adjacent target algorithm parameters, performing smoothing processing on the target algorithm parameters corresponding to the target sub-region.

[0130] In this embodiment, the system uses the spatial coordinate axis as a reference and smoothes the target algorithm parameters corresponding to the target sub-region based on the algorithm parameters of each adjacent target. Smoothing can include a variety of mathematical methods, such as weighted averaging and interpolation, to achieve a smoother transition between the algorithm parameters of the target sub-region and those of its adjacent sub-regions, avoiding abrupt changes. During processing, the system considers the relative positions of the adjacent sub-regions and the target sub-region on the spatial coordinate axis, as well as the values ​​of their corresponding algorithm parameters.

[0131] The above steps not only consider the sound characteristics within the sub-region, but also the interactions between adjacent sub-regions, achieving continuity and naturalness in the algorithm parameters through smoothing. This series of steps together constitutes a complete sub-region algorithm parameter smoothing process, ensuring smoother and more coherent transitions between different sub-regions in the sound processing system, providing users with a more natural and comfortable sound experience.

[0132] Based on the first to third embodiments of the present application, in the fourth embodiment of the present application, the same or similar contents as those of the first to third embodiments can be referred to above and will not be described in detail. On this basis, when the speaker is a speaker group, after the above step A20, the method may further include steps D10 to D20:

[0133] Step D10, calculating the coordinate difference between the first space coordinate and the preset center coordinate;

[0134] In this embodiment, the system first calculates the coordinate difference between the microphone's first spatial coordinate (i.e., the microphone's current position in the spatial model) and a preset center coordinate. The preset center coordinate can be the center point of a display device or speaker group, or the user's desired location for optimal sound experience. The coordinate difference is calculated to assess the offset between the microphone's current position and the center position, thereby determining whether the speaker group's output parameters need to be adjusted to optimize the sound effect.

[0135] Step D20: adjusting the output parameters of the speaker group according to the coordinate difference.

[0136] In this embodiment, based on the calculated coordinate differences, the system adjusts the output parameters of the speaker group. These output parameters may include speaker volume, pitch, directionality (such as beamforming parameters), delay (for sound localization), and more. The purpose of these adjustments is to ensure that the sound emitted from the speaker group is properly processed and optimized, reaching the microphone location (i.e., the user's location) in an optimal manner, thereby providing the best possible sound experience.

[0137] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the reverberation adjustment method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0138] This application also provides a reverberation adjustment device, please refer to Figure 5 The reverberation adjustment device is provided on a display device, the display device includes: a speaker and a microphone, and the device includes:

[0139] An output module 10, configured to output a preset test sound source through the speaker;

[0140] A timing module 20, configured to start timing the target reverberation time when the output of the test sound source is stopped;

[0141] The acquisition module 30 is configured to acquire a reverberation signal through the microphone, and stop timing the target reverberation time when the sound pressure level of the reverberation signal decays by a preset decibel;

[0142] The adjustment module 40 is configured to adjust the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, so that the time difference is smaller than a preset difference threshold.

[0143] Optionally, the reverberation adjustment device is further used to:

[0144] Acquire a spatial model of the environment in which the display device is located;

[0145] Acquire a first spatial coordinate of the microphone in the spatial model by the positioning module;

[0146] When the first space coordinates are updated, prompt information for prompting recalibration is output.

[0147] Optionally, the reverberation adjustment device is further used to:

[0148] Segmenting the spatial model to obtain a plurality of sub-regions;

[0149] Determine a first sub-region corresponding to the first spatial coordinate in each of the sub-regions;

[0150] The adjusted first algorithm parameter of the reverberation algorithm is associated with the first sub-region and stored in a preset storage space.

[0151] Optionally, the reverberation adjustment device is further used to:

[0152] When the first spatial coordinate is updated, obtaining a second spatial coordinate of the microphone in the spatial model;

[0153] Determine a second sub-region corresponding to the second spatial coordinate in the sub-region;

[0154] searching the storage space for a second algorithm parameter corresponding to the second sub-region;

[0155] Applying the second algorithm parameters to the reverberation algorithm when the second algorithm parameters exist.

[0156] Optionally, the reverberation adjustment device is further used to:

[0157] Calculating the coordinate difference between the first spatial coordinate and the preset center coordinate;

[0158] The output parameters of the speaker group are adjusted according to the coordinate difference.

[0159] Optionally, the reverberation adjustment device is further used to:

[0160] For each target sub-region in each of the sub-regions, obtaining adjacent target algorithm parameters corresponding to each adjacent sub-region of the target sub-region;

[0161] With the spatial coordinate axis as a reference, the target algorithm parameters corresponding to the target sub-region are smoothed based on the adjacent target algorithm parameters.

[0162] Optionally, the reverberation adjustment device is further used to:

[0163] Get the style reverb parameters of multiple preset style reverbs;

[0164] Calculating the parameter difference between each style reverberation parameter and the preset reverberation parameter of the reverberation algorithm;

[0165] Each of the style reverberation parameters is adjusted according to the adjusted first algorithm parameter of the reverberation algorithm to update each of the style reverberation parameters.

[0166] The reverberation adjustment device provided in this application, employing the reverberation adjustment method of the aforementioned embodiment, can solve the technical problem of improving the karaoke experience in a home environment. Compared to the prior art, the beneficial effects of the reverberation adjustment device provided in this application are the same as those of the reverberation adjustment method provided in the aforementioned embodiment. Other technical features of the reverberation adjustment device are the same as those disclosed in the aforementioned embodiment and are not further described here.

[0167] The present application provides a display device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the reverberation adjustment method of the above-mentioned embodiment 1.

[0168] Reference below Figure 6 , which shows a schematic diagram of the structure of a display device suitable for implementing the embodiments of the present application. The display device in the embodiments of the present application may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), in-vehicle terminals (such as in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 6 The display device shown is merely an example and should not limit the functions and scope of use of the embodiments of the present application.

[0169] like Figure 6 As shown, the display device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes based on programs stored in a read-only memory (ROM) 1002 or programs loaded from a storage device 1003 into a random access memory (RAM) 1004. RAM 1004 also stores various programs and data required for the operation of the display device. Processing device 1001, ROM 1002, and RAM 1004 are connected to each other via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to I / O interface 1006: input device 1007 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output device 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage device 1003 including, for example, a magnetic tape, hard disk, etc.; and communication device 1009. Communication device 1009 can allow the display device to communicate with other devices wirelessly or wired to exchange data. Although the figure shows a display device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have instead.

[0170] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program comprising program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0171] The display device provided in this application, employing the reverberation adjustment method of the above-described embodiment, can solve the technical problem of improving the karaoke experience in a home environment. Compared to the prior art, the beneficial effects of the display device provided in this application are the same as those of the reverberation adjustment method provided in the above-described embodiment, and the other technical features of the display device are the same as those disclosed in the above-described embodiment, and are not further described here.

[0172] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0173] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

[0174] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer program) stored thereon, wherein the computer-readable program instructions are used to execute the reverberation adjustment method in the above embodiment.

[0175] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0176] The computer-readable storage medium may be included in the display device, or may exist independently without being assembled into the display device.

[0177] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the display device, the display device: outputs a preset test sound source through the speaker; starts timing the target reverberation time when output of the test sound source stops; collects a reverberation signal through the microphone, and stops timing the target reverberation time when the sound pressure level of the reverberation signal decays by a preset decibel; and adjusts a preset reverberation algorithm based on the time difference between the target reverberation time and a preset standard reverberation time so that the time difference is less than a preset difference threshold.

[0178] The computer program code for performing the operations of the present application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0179] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0180] The modules described in the embodiments of the present application may be implemented in software or hardware, wherein the name of a module does not necessarily limit the unit itself.

[0181] The computer-readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described reverberation adjustment method. This computer-readable storage medium can address the technical problem of improving the karaoke experience in a home environment. Compared to the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the reverberation adjustment method provided in the above-described embodiment, and are not further elaborated here.

[0182] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned reverberation adjustment method when executed by a processor.

[0183] The computer program product provided in this application can solve the technical problem of how to improve the karaoke experience in a home environment. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the reverberation adjustment method provided in the above embodiment, and will not be repeated here.

[0184] The above description is only part of the embodiments of the present application and does not limit the patent scope of the present application. All equivalent structural transformations made by using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A reverberation adjustment method, characterized in that: The method is applied to a display device, the display device includes: a speaker and a microphone, and the method includes: Outputting a preset test sound source through the speaker; When the output of the test sound source stops, starting the timing of the target reverberation time; The reverberation signal is collected by the microphone, and when the sound pressure level of the reverberation signal decays by a preset decibel, the timing of the target reverberation time is stopped; The preset reverberation algorithm is adjusted according to the time difference between the target reverberation time and the preset standard reverberation time, so that the time difference is less than a preset difference threshold.

2. The reverberation adjustment method according to claim 1, characterized in that: The display device further includes: a positioning module; after the step of adjusting the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, the method further includes: Acquire a spatial model of the environment where the display device is located; Acquire the first spatial coordinates of the microphone in the spatial model through the positioning module; When the first space coordinates are updated, prompt information for prompting recalibration is output.

3. The reverberation adjustment method according to claim 2, characterized in that: After the step of acquiring the first spatial coordinates of the microphone in the spatial model by the positioning module, the method further includes: Segmenting the spatial model to obtain a plurality of sub-regions; Determine a first sub-region corresponding to the first spatial coordinate in each of the sub-regions; The adjusted first algorithm parameter of the reverberation algorithm is associated with the first sub-region and stored in a preset storage space.

4. The reverberation adjustment method according to claim 3, characterized in that: After the step of adjusting the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, the method further includes: When the first spatial coordinates are updated, obtaining the second spatial coordinates of the microphone in the spatial model; Determine a second sub-region corresponding to the second spatial coordinate in the sub-region; searching the storage space for a second algorithm parameter corresponding to the second sub-region; Applying the second algorithm parameters to the reverberation algorithm when the second algorithm parameters exist.

5. The reverberation adjustment method according to claim 2, characterized in that: In the case where the speaker is a speaker group, after the step of acquiring the first spatial coordinates of the microphone in the spatial model by the positioning module, the method further includes: Calculating the coordinate difference between the first spatial coordinate and the preset center coordinate; The output parameters of the speaker group are adjusted according to the coordinate difference.

6. The reverberation adjustment method according to claim 3, characterized in that: After the step of associating the adjusted first algorithm parameter of the reverberation algorithm with the first sub-region and storing them in a preset storage space, the method further includes: For each target sub-region in each of the sub-regions, obtaining adjacent target algorithm parameters corresponding to each adjacent sub-region of the target sub-region; With the spatial coordinate axis as a reference, the target algorithm parameters corresponding to the target sub-region are smoothed based on the adjacent target algorithm parameters.

7. The reverberation adjustment method according to claim 3, characterized in that: After the step of adjusting the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, the method further includes: Get the style reverb parameters of multiple preset style reverbs; Calculating the parameter difference between each style reverberation parameter and the preset reverberation parameter of the reverberation algorithm; The style reverberation parameters are adjusted according to the adjusted first algorithm parameter of the reverberation algorithm to update the style reverberation parameters.

8. A reverberation adjustment device, characterized in that: The device is arranged on a display device, the display device comprises: a speaker and a microphone, and the device comprises: An output module, used for outputting a preset test sound source through the speaker; A timing module, used to start timing the target reverberation time when the output of the test sound source stops; A collection module, used for collecting a reverberation signal through the microphone, and stopping the timing of the target reverberation time when the sound pressure level of the reverberation signal decays by a preset decibel; The adjustment module is used to adjust the preset reverberation algorithm according to the time difference between the target reverberation time and the preset standard reverberation time, so that the time difference is less than a preset difference threshold.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the reverberation adjustment method according to any one of claims 1 to 7 are implemented.

10. A display device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the reverberation adjustment method according to any one of claims 1 to 7.

Images