Multi-channel sound correction system and multi-channel sound correction method

Abstract

The invention relates to a multi-channel sound correction system and a multi-channel sound correction method. The multi-channel sound equipment correction system comprises a master control sound equipment and a plurality of sound channel sound equipment, millimeter wave radars and sound production devices are arranged in the plurality of sound channel sound equipment respectively, and audio signals are sent to a target object through the sound production devices according to initial audio parameters. And collecting sound vibration information generated by the target object according to the audio signal through the millimeter wave radar, and sending the sound vibration information to the master control sound. Sound vibration information corresponding to the sound channel sound equipment is received through the main control sound equipment, and the sound vibration information is converted into a target audio parameter received by the target object; and according to the preset audio parameter and the target audio parameter, determining a target correction audio parameter, and sending the target correction audio parameter to the sound channel sound equipment, so that the sound channel sound equipment corrects the initial audio parameter, and determining a target sound field center which is the position of the target object.

Description

Technical Field

[0001] The present disclosure relates to the technical field of sound control, and in particular to a multi-channel sound correction system and a multi-channel sound correction method. Background Art

[0002] In the indoor viewing space, in order to create an immersive spatial feeling for users, the audio equipment in the indoor viewing space has multiple channel sound sources such as left, center, right, left surround, right surround, left rear surround, right rear surround, LFE, left front top, right front top, left rear top and right rear top. This can restore and present the live sound more realistically, allowing users to feel the "immersive sound", "sense of space" and "3D".

[0003] In the related art, in order to enable multi-channel audio to create immersive audio, a preset standard layout for placing multiple channel speakers is determined according to a preset sound field center of the indoor viewing space, the multiple channel speakers are placed according to the preset standard layout, and corresponding standard audio playback parameters are set for the multiple channel speakers according to the preset standard layout, so that users can obtain high-quality spatial sound quality in the preset sound field center.

[0004] However, in real life, the layout of the indoor viewing space may be different, and the user's position may also change. Therefore, when the user's position changes, that is, when the user is not in the center of the preset sound field, if the audio signal is played according to the current audio playback parameters, the audio received by the user will have delays and uneven sound pressure, resulting in the user being unable to receive high-quality audio. Summary of the invention

[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a multi-channel sound correction system and a multi-channel sound correction method, which collects the sound vibration information generated by the target object according to the audio signal in real time through the millimeter wave radar set by the channel sound, and determines the target correction audio parameters based on the sound vibration information, so that the channel sound can correct the audio parameters of the played audio signal. When the audio signal is played through the corrected audio parameters, the sound field center of the current indoor viewing space can be adjusted to the position of the target object such as the user, so that the target object at the center of the target sound field can receive high-quality audio, thereby improving the user experience.

[0006] In a first aspect, the present disclosure provides a multi-channel sound correction system, the multi-channel sound correction system comprising: a main control sound, and a plurality of channel sounds, wherein the plurality of channel sounds are respectively provided with a millimeter wave radar and a sound generating device;

[0007] The sound-generating device is configured as follows:

[0008] Sending an audio signal to a target object according to initial audio parameters, wherein the initial audio parameters are used to determine an initial sound field center;

[0009] The millimeter wave radar is configured as follows:

[0010] Collecting the sound vibration information generated by the target object according to the audio signal, and sending the sound vibration information to the master control speaker;

[0011] The master control speaker is configured as follows:

[0012] Receiving sound vibration information corresponding to the channel sound, and converting the sound vibration information into target audio parameters received by the target object;

[0013] According to the preset audio parameters and the target audio parameters, target correction audio parameters are determined and sent to the channel speakers, so that the channel speakers correct the initial audio parameters and determine the target sound field center, which is the position of the target object.

[0014] As an optional implementation of the embodiment of the present disclosure, the master control speaker is specifically configured as follows:

[0015] Calculating a difference between the preset audio parameter and the target audio parameter;

[0016] For a plurality of preset adjustment parameters, the preset adjustment parameter that minimizes the difference is determined as the target corrected audio parameter.

[0017] As an optional implementation of the embodiment of the present disclosure, the preset audio parameter includes a preset sound pressure; the target audio parameter includes a target sound pressure; the preset adjustment parameter includes: a preset adjustment volume;

[0018] The master control speaker is specifically configured as follows:

[0019] Calculating a sound pressure difference between the preset sound pressure and the target sound pressure;

[0020] For the plurality of preset adjustment volumes, the preset adjustment volume that minimizes the sound pressure difference is determined as a target correction audio parameter.

[0021] As an optional implementation of the embodiment of the present disclosure, the preset audio parameter further includes: a preset phase; the target audio parameter further includes: a target phase; the preset adjustment parameter includes: a preset adjustment delay;

[0022] The master control speaker is specifically configured as follows:

[0023] Calculating a phase difference between the preset phase and the target phase;

[0024] For the plurality of preset adjustment delays, the preset adjustment time that minimizes the phase difference is determined as a target correction audio parameter.

[0025] As an optional implementation of the embodiment of the present disclosure, the channel audio system further includes: a control module; the initial audio parameters include: initial sound pressure and initial phase;

[0026] The control module is configured as follows:

[0027] Receiving target correction audio parameters sent by the master control audio, wherein the target correction audio parameters include: target adjustment volume and target adjustment delay;

[0028] Adjust the volume according to the target and correct the initial sound pressure;

[0029] The initial phase is corrected according to the target adjustment delay.

[0030] As an optional implementation of the embodiment of the present disclosure, the master control speaker is specifically configured as follows:

[0031] Obtaining a target time difference and a target phase difference corresponding to the sound vibration information;

[0032] According to the target time difference and the target phase difference, obtaining the vibration displacement velocity of the reflected continuous wave corresponding to the sound vibration information;

[0033] According to the vibration displacement velocity, obtaining a time domain signal corresponding to the reflected continuous wave;

[0034] Performing Fourier transform on the time domain signal to obtain target audio parameters received by the target object.

[0035] As an optional implementation of the embodiment of the present disclosure, the master control speaker is specifically configured as follows:

[0036] Determine a first moment when the sound-generating device sends an audio signal, and a second moment when the millimeter-wave radar collects the sound vibration information;

[0037] Determining a target time difference according to the first moment and the second moment;

[0038] The target phase difference is determined according to the target time difference and the frequency corresponding to the reflected continuous wave.

[0039] As an optional implementation of the embodiment of the present disclosure, the master control speaker is further configured as:

[0040] After determining the target correction audio parameter, determining the target distance between the channel sound and the target object according to a preset mapping relationship, wherein the preset mapping relationship includes: a correspondence relationship between a preset adjustment volume and a preset distance;

[0041] Determining multiple target key points according to the position of the target object and multiple target distances;

[0042] A target area where the target object is located is determined according to the multiple target key points.

[0043] In a second aspect, a multi-channel sound correction method is provided, which is applied to a multi-channel sound correction system, wherein the multi-channel sound correction system comprises: a master control sound, and a plurality of channel sounds, wherein the plurality of channel sounds are respectively provided with a millimeter wave radar and a sound generating device; the method comprises:

[0044] Sending an audio signal to a target object through the sound-generating device according to initial audio parameters, wherein the initial audio parameters are used to determine an initial sound field center;

[0045] collecting the sound vibration information generated by the target object according to the audio signal through the millimeter wave radar, and sending the sound vibration information to the main control speaker;

[0046] Receiving the sound vibration information corresponding to the channel sound through the master control sound, and converting the sound vibration information into the target audio parameter received by the target object;

[0047] According to the preset audio parameters and the target audio parameters, target correction audio parameters are determined and sent to the channel speakers, so that the channel speakers correct the initial audio parameters and determine the target sound field center, which is the position of the target object.

[0048] As an optional implementation of the embodiment of the present disclosure, the determining the target correction audio parameter according to the preset audio parameter and the target audio parameter includes:

[0049] Calculating the difference between the preset audio parameter and the target audio parameter by the master control speaker;

[0050] For a plurality of preset adjustment parameters, the preset adjustment parameter that minimizes the difference is determined as the target corrected audio parameter.

[0051] As an optional implementation of the embodiment of the present disclosure, the preset audio parameter includes a preset sound pressure; the target audio parameter includes a target sound pressure; the preset adjustment parameter includes: a preset adjustment volume;

[0052] The calculating the difference between the preset audio parameter and the target audio parameter; and determining, for a plurality of preset adjustment parameters, the preset adjustment parameter that minimizes the difference as the target correction audio parameter, comprises:

[0053] Calculating the sound pressure difference between the preset sound pressure and the target sound pressure by the master control speaker;

[0054] For the plurality of preset adjustment volumes, the preset adjustment volume that minimizes the sound pressure difference is determined as a target correction audio parameter.

[0055] As an optional implementation of the embodiment of the present disclosure, the preset audio parameter further includes: a preset phase; the target audio parameter further includes: a target phase; the preset adjustment parameter includes: a preset adjustment delay;

[0056] The calculating the difference between the preset audio parameter and the target audio parameter; and determining, for a plurality of preset adjustment parameters, the preset adjustment parameter that minimizes the difference as the target correction audio parameter, comprises:

[0057] Calculating the phase difference between the preset phase and the target phase by the master control speaker;

[0058] For the plurality of preset adjustment delays, the preset adjustment time that minimizes the phase difference is determined as a target correction audio parameter.

[0059] As an optional implementation of the embodiment of the present disclosure, the channel audio system further includes: a control module; the initial audio parameters include: initial sound pressure and initial phase; the method further includes:

[0060] Receiving, by the control module, target correction audio parameters sent by the master control audio, the target correction audio parameters including: target adjustment volume and target adjustment delay;

[0061] Adjust the volume according to the target and correct the initial sound pressure;

[0062] The initial phase is corrected according to the target adjustment delay.

[0063] As an optional implementation of the embodiment of the present disclosure, converting the sound vibration information into a target audio parameter received by the target object includes:

[0064] Acquiring the target time difference and the target phase difference corresponding to the sound vibration information through the master control speaker;

[0065] According to the target time difference and the target phase difference, obtaining the vibration displacement velocity of the reflected continuous wave corresponding to the sound vibration information;

[0066] According to the vibration displacement velocity, obtaining a time domain signal corresponding to the reflected continuous wave;

[0067] Performing Fourier transform on the time domain signal to obtain target audio parameters received by the target object.

[0068] As an optional implementation of the embodiment of the present disclosure, the acquiring, by the master control speaker, a target time difference and a target phase difference corresponding to the sound vibration information includes:

[0069] Determine, by the master control speaker, the first moment when the sound-generating device sends the audio signal, and the second moment when the millimeter-wave radar collects the sound vibration information;

[0070] Determining a target time difference according to the first moment and the second moment;

[0071] The target phase difference is determined according to the target time difference and the frequency corresponding to the reflected continuous wave.

[0072] As an optional implementation of the embodiment of the present disclosure, the method further includes:

[0073] After determining the target correction audio parameter, the master control speaker determines the target distance between the channel speaker and the target object according to a preset mapping relationship, wherein the preset mapping relationship includes: a correspondence between a preset adjustment volume and a preset distance;

[0074] Determining multiple target key points according to the position of the target object and multiple target distances;

[0075] A target area where the target object is located is determined according to the multiple target key points.

[0076] Compared with the related art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0077] The multi-channel sound correction method proposed in the embodiment of the present disclosure is applied to a multi-channel sound correction system, which includes: a master control speaker and multiple channel speakers, wherein the multiple channel speakers are respectively provided with millimeter wave radars and sound-generating devices, and the sound-generating devices send audio signals to the target object according to the initial audio parameters, wherein the initial audio parameters are used to determine the initial sound field center. The sound vibration information generated by the target object according to the audio signal is collected by the millimeter wave radar, and the sound vibration information is sent to the master control speaker. The sound vibration information corresponding to the channel speaker is received by the master control speaker, and the sound vibration information is converted into the target audio parameters received by the target object; according to the preset audio parameters and the target audio parameters, the target correction audio parameters are determined, and sent to the channel speakers, so that the channel speakers correct the initial audio parameters and determine the target sound field center, and the target sound field center is the position of the target object. In the above technical solution, the millimeter wave radar set by the channel speaker collects the sound vibration information generated by the target object according to the audio signal in real time, and the target correction audio parameters are determined based on the sound vibration information, so that the channel speakers correct the audio parameters of the played audio signal. When the audio signal is played using the corrected audio parameters, the sound field center of the current indoor viewing space can be adjusted to the position of the target object, such as the user, so that the target object at the center of the target sound field can receive high-quality audio, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0079] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0080] Figure 1A A schematic diagram of an application scenario of a multi-channel audio system in the related art;

[0081] Figure 1B A schematic diagram of an application scenario of a multi-channel sound correction method provided by an embodiment of the present disclosure;

[0082] Figure 2 A hardware configuration block diagram of a control device according to one or more embodiments of the present disclosure;

[0083] Figure 3 A schematic diagram of a flow chart of a multi-channel sound calibration method provided by an embodiment of the present disclosure;

[0084] Figure 4A A schematic diagram of an application scenario of another multi-channel sound correction method provided by an embodiment of the present disclosure;

[0085] Figure 4B A schematic diagram of an application scenario of another multi-channel sound correction method provided by an embodiment of the present disclosure;

[0086] Figure 5 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure;

[0087] Figure 6 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure;

[0088] Figure 7 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure;

[0089] Figure 8 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure;

[0090] Fig. 9 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure;

[0091] Fig.10 A schematic diagram of an application scenario of another multi-channel sound correction method provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0092] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0093] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0094] The terms "first", "second", "third", etc. in the specification and claims of the present disclosure and the above drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0095] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0096] Figure 1A Schematic diagram of an application scenario of a multi-channel speaker in the related art, such as Figure 1A As shown, multiple channel speakers 200 are installed in different positions in the indoor viewing space according to a preset standard layout, so that the audio equipment in the indoor viewing space has multiple channel sound sources such as left, center, right, left surround, right surround, left rear surround, right rear surround, LFE, left front top, right front top, left rear top and right rear top, thereby creating an immersive spatial feeling for users, allowing users to feel "immersive sound", "sense of space" and "3D".

[0097] Exemplarily, by placing multiple channel speakers according to a preset standard layout, the general principle is to determine a preset sound field center in the indoor viewing space, at which high-quality audio in the entire indoor viewing space can be received, and each channel speaker is placed at an orthogonal or equidistant distance relative to the preset sound field center. For example, when creating Dolby sound effects, for an indoor viewing space of a preset size, the length x width x height of each channel speaker is: 3.5m x3m x 2.4m to 6.4mx 5.5mx 3m. At the same time, a standard placement angle is set for the angle between each channel speaker and the preset sound field center, and corresponding standard audio playback parameters are set for each channel speaker according to the preset standard layout. When each channel speaker plays an audio signal through the standard audio playback parameters, it is ensured that the target object, such as a user, can receive high-quality audio when in the preset sound field center.

[0098] However, in real life, the layout of the indoor viewing space may be different, and the user's position may also change. Therefore, when the user's position changes, that is, when the user is not in the center of the preset sound field, if the audio signal is played according to the current audio playback parameters, the audio received by the user will have delays and uneven sound pressure, resulting in the user being unable to receive high-quality audio.

[0099] In view of the shortcomings of the above method, the embodiment of the present disclosure provides a multi-channel sound correction method, which is applied to a multi-channel sound correction system. The multi-channel sound correction system includes: a master control speaker and multiple channel speakers, each of which is provided with a millimeter wave radar and a sound-generating device, and the sound-generating device sends an audio signal to the target object according to the initial audio parameters. The sound vibration information generated by the target object according to the audio signal is collected by the millimeter wave radar, and the sound vibration information is sent to the master control speaker. The sound vibration information corresponding to the channel speaker is received by the master control speaker, and the sound vibration information is converted into the target audio parameter received by the target object; according to the preset audio parameters and the target audio parameters, the target correction audio parameters are determined and sent to the channel speaker, so that the channel speaker corrects the initial audio parameters and determines the target sound field center, and the target sound field center is the position of the target object. In the above technical solution, the millimeter wave radar set by the channel speaker collects the sound vibration information generated by the target object according to the audio signal in real time, and determines the target correction audio parameters based on the sound vibration information, so that the channel speaker corrects the audio parameters of the played audio signal. When the audio signal is played using the corrected audio parameters, the sound field center of the current indoor viewing space can be adjusted to the position of the target object, such as the user, so that the target object, such as the user, at the center of the target sound field can receive high-quality audio, thereby improving the user experience.

[0100] The multi-channel sound correction method provided by the embodiment of the present disclosure can be implemented based on a multi-channel sound correction system, or a functional module or functional entity in the multi-channel sound correction system. The multi-channel sound correction system includes: a main control speaker, and multiple channel speakers, each of which is provided with a millimeter wave radar and a sound generating device, wherein the millimeter wave radar refers to a radar sensor operating in the millimeter wave frequency band. It has the characteristics of wide bandwidth, short wavelength, and large atmospheric propagation loss. The millimeter wave radar can realize the functions of ranging, speed measurement, azimuth measurement, micro-motion detection and 4D imaging. The present application arranges the millimeter wave radar inside the speaker to collect audio using its characteristics and realize the correction of audio playback parameters. In this way, there is no need to collect audio through external equipment, the operation is simple, and it is not easy to be idle or lost. .

[0101] For example, Figure 1B As shown, Figure 1B A schematic diagram of an application scenario of a multi-channel sound correction method provided by an embodiment of the present disclosure, in Figure 1BIn the embodiment, the user can operate the multi-channel sound correction system 20 through a control device such as a remote control or a smart device such as a smart phone. The multi-channel sound correction system 20 includes: a main control speaker 203, and multiple channel speakers 200, each of which is provided with a millimeter wave radar 201 and a sound-generating device; the sound-generating device plays an audio signal, and when the audio signal reaches the surface of a target object such as a user, a weak sound vibration information is generated, and a detection signal wave is sent through the millimeter wave radar 201 built into the channel speaker, so as to collect the reflected continuous wave corresponding to the sound vibration information, so as to obtain the weak sound vibration information generated on the surface of the target object 204. Further, the main control speaker 201 determines the target correction audio parameters according to the sound vibration information collected by each channel speaker 200, and determines the target correction audio parameters based on the sound vibration information, so that the channel speaker corrects the audio parameters of the played audio signal. Since the sound field center of the current indoor viewing space can be adjusted to the position of the target object such as the user when the audio signal is played through the corrected audio parameters, the target object such as the user in the center of the target sound field can receive high-quality audio, thereby improving the user experience.

[0102] In some embodiments, the control device may be a remote controller, and the communication between the remote controller and the multi-channel sound correction system includes infrared protocol communication or Bluetooth protocol communication, and at least one of other short-range communication methods, to control the multi-channel sound correction system 20 wirelessly or wired. The user may input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the multi-channel sound correction system 20. Figure 2 FIG. 1 is a block diagram of a hardware configuration of a control device according to one or more embodiments of the present disclosure. Figure 2 As shown, the control device includes a controller 110, a communication interface 130, a user input / output interface 140, a storage device, and a power supply. The control device can receive the user's input operation instructions, and convert the operation instructions into instructions that the multi-channel sound correction system 20 can recognize and respond to, and play the role of an interactive intermediary between the user and the multi-channel sound correction system 20. The communication interface 130 is used to communicate with the outside world, including a wireless network communication technology WIFI chip, a Bluetooth module, NFC (Near Field Communication) or at least one of an alternative module. The user input / output interface 140 includes a microphone, a touchpad, a sensor, a button or at least one of an alternative module.

[0103] In some embodiments, a smart device can also be used to control the multi-channel sound correction system 20. For example, the multi-channel sound correction system 20 is controlled using an application running on the smart device. The smart device can install software applications with the multi-channel sound correction system 20, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. Among them, the smart device can be a smart phone, a smart tablet, a personal computer (PC), a tablet computer, a laptop computer, a mainframe computer, etc. with a smart control function, and the embodiments of the present disclosure are not specifically limited to this.

[0104] In some embodiments, the multi-channel sound correction system 20 may not use the above-mentioned smart device to receive instructions, but may receive user control through voice or touch.

[0105] In order to explain this scheme in more detail, the following will be combined in an exemplary manner Figure 3 To explain, it is understandable that although Figure 3 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 3 At least part of the steps may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps. The method for multi-channel sound correction provided in the embodiment of the present disclosure shall prevail.

[0106] Figure 3 A flowchart of a multi-channel sound correction method provided by an embodiment of the present disclosure. The multi-channel sound correction method is applied to a multi-channel sound correction system, which includes: a master control sound, and multiple channel sounds, each of which is provided with a millimeter wave radar and a sound generating device. The method specifically includes the following steps:

[0107] S31. Send an audio signal to a target object through a sound-generating device according to initial audio parameters.

[0108] Among them, the initial audio parameters are used to determine the initial sound field center. The initial audio parameters refer to the initial playback parameters set when the channel speakers play audio signals. The initial audio parameters can be audio playback parameters set according to a preset standard layout for placing multiple channel speakers, or can be audio playback parameters used to play audio signals when the user used multiple channel speakers last time. The initial audio parameters include: initial phase, initial sound pressure, and initial delay. The initial sound field center refers to the position in the indoor viewing space that can receive high-quality audio when the audio signal is played using the initial audio parameters.

[0109] For example, Figure 4A As shown, when multiple channel speakers 200 play audio signals through their respective corresponding initial playback parameters, the initial sound field center O formed in the indoor viewing space, that is, high-quality sound quality can be received at the initial sound field center O. However, it is not limited to this, and the present disclosure is not specifically limited, and those skilled in the art can set it according to actual conditions.

[0110] Specifically, for the channel audio included in the multi-channel audio correction system, an audio signal is sent to a target object such as a user through a sound generating device according to initial audio parameters.

[0111] On the basis of the above embodiments, in some embodiments of the present disclosure, an audio signal is sent to a target object such as a user, wherein the audio signal can be realized by sending a frequency modulated continuous wave signal, which is a frequency modulated continuous signal. The frequency modulated continuous wave signal is divided into a triangular wave, a sawtooth wave, and a sine wave according to different frequency modulation methods, but is not limited to this. The present disclosure does not specifically limit it, and those skilled in the art can set it according to actual conditions.

[0112] S32. Collecting sound vibration information generated by the target object according to the audio signal through the millimeter wave radar, and sending the sound vibration information to the main control speaker.

[0113] Specifically, the sound-generating device of the channel audio plays an audio signal, and the audio signal reaches the surface of the target object to generate weak sound vibration information. The sound vibration information generated on the surface of the target object is collected by the millimeter wave radar, and the collected sound vibration information is sent to the main control audio.

[0114] Based on the above embodiments, in some embodiments of the present disclosure, such as Figure 4B As shown, one implementation method of collecting the sound vibration information generated by the target object according to the audio signal through the millimeter wave radar can be: the millimeter wave radar transmits a continuous detection wave signal such as a frequency modulated continuous wave such as a triangle wave or a sawtooth wave to the target object, and uses the phase velocity measurement method of the millimeter wave radar to identify the weak sound vibration information generated by the target object such as the user surface. However, it is not limited to this, and the present disclosure is not specifically limited, and those skilled in the art can set it according to actual conditions.

[0115] It should be noted that when the millimeter-wave radar collects sound vibration information and sends the sound vibration information to the main control speaker, it will also send the identification information of the channel speaker, so that the main control speaker can determine the sound vibration information collected by the channel speaker.

[0116] S33, receiving sound vibration information corresponding to the channel speakers through the main control speaker, and converting the sound vibration information into target audio parameters received by the target object.

[0117] The target audio parameter is the actual audio parameter corresponding to the target, such as the current audio parameter of the user.

[0118] Specifically, after receiving the sound vibration information collected by the channel speakers through the main control speaker, the sound vibration information is converted into target audio parameters received by the target object.

[0119] In some embodiments, Figure 5 A schematic flow chart of another multi-channel sound calibration method provided by an embodiment of the present disclosure. Figure 5 is Figure 3 Further optimization based on Figure 5 As shown, one implementation method for converting the sound vibration information into the target audio parameters received by the target object may be:

[0120] S51. Obtain a target time difference and a target phase difference corresponding to the sound vibration information.

[0121] The target time difference is the time delay caused by the time when each channel speaker transmits an audio signal such as a continuous detection wave signal to a target object such as a user, and the time when the millimeter wave radar collects the sound vibration signal. Based on this, Figure 6 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure is shown in FIG. Figure 6 is Figure 5 Further optimization based on Figure 6 As shown, one implementation of S51 may be:

[0122] S61, determining the first moment when the sound-emitting device sends the audio signal and the second moment when the millimeter-wave radar collects the sound vibration information.

[0123] S62: Determine a target time difference according to the first moment and the second moment.

[0124] Specifically, the main control audio obtains the first moment when the sound-emitting device sends the audio signal, and the second moment when the millimeter-wave radar collects the reflected continuous wave corresponding to the sound vibration information, and calculates the difference between the first moment and the second moment to obtain the target time difference.

[0125] S63: Determine the target phase difference according to the target time difference and the frequency corresponding to the reflected continuous wave.

[0126] Among them, the reflected continuous wave is the detection signal wave emitted by the millimeter wave radar to the target object such as the user.

[0127] Specifically, after calculating the target time difference, the master control speaker determines the target phase difference according to the target time difference and the frequency corresponding to the reflected continuous wave.

[0128] Exemplarily, the target phase difference may be obtained by Δω=2πft, where t represents the target time difference and f represents the frequency.

[0129] S52. Obtain the vibration displacement velocity of the reflected continuous wave corresponding to the sound vibration information according to the target time difference and the target phase difference.

[0130] S53. Obtain a time domain signal corresponding to the sound vibration information according to the vibration displacement velocity.

[0131] S54, performing Fourier transform on the time domain signal to obtain target audio parameters received by the target object.

[0132] The target audio parameters include target phase, target sound pressure, target frequency and target delay, but are not limited thereto. The present disclosure does not specifically limit these parameters, and those skilled in the art may set them according to actual conditions.

[0133] Specifically, the main control audio obtains the target time difference and target phase difference corresponding to the sound vibration information, and obtains the vibration displacement velocity of the reflected continuous wave corresponding to the sound vibration information based on the target time difference and target phase difference. After obtaining the vibration displacement velocity, the time domain signal corresponding to the sound vibration information is determined based on the vibration displacement velocity, and the time domain signal is Fourier transformed to obtain the target audio parameters received by the target object.

[0134] S34. Determine target correction audio parameters according to preset audio parameters and target audio parameters, and send the target correction audio parameters to the channel speakers, so that the channel speakers correct the initial audio parameters and determine the target sound field center.

[0135] The target sound field center is the position of the target object. The preset audio parameters refer to the parameters used to determine whether the audio parameters when playing the audio signal can enable the user to receive high-quality audio. The preset audio parameters can be determined according to industry standard certification. The present disclosure does not specifically limit the preset audio parameters. Those skilled in the art can set them according to actual conditions. The target sound field center refers to the position where high-quality audio can be obtained when multiple channel speakers play audio signals according to the corrected audio parameters and the target object is at the target sound field center. For example, continue to refer to Figure 4B As shown, when the multi-channel speakers 200 play the audio signal according to the corrected audio parameters, the sound field center can be adjusted to the position of the target object such as the user, that is, the target sound field center O1, so that the target object such as the user at the target sound field center O1 can receive high-quality audio. However, this is not limited to this, and the present disclosure is not specifically limited, and those skilled in the art can set it according to actual conditions.

[0136] Specifically, after obtaining the target audio parameters, the main control speaker determines the target correction audio parameters according to the preset audio parameters and the target audio parameters, and sends the target correction audio parameters to the channel speaker, so that the channel speaker corrects the initial audio parameters such as the initial phase and the initial sound pressure, and then uses the corrected audio parameters to play the audio signal, so that the current sound field center can be adjusted to the position of the target object such as the user.

[0137] In some embodiments, Figure 7 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure is provided. Figure 7 is Figure 6 Further optimization based on Figure 7 As shown, one implementation of S34 may be:

[0138] S71. Calculate the difference between the preset audio parameter and the target audio parameter.

[0139] S72. For multiple preset adjustment parameters, determine the preset adjustment parameter that minimizes the difference as the target correction audio parameter.

[0140] Among them, the preset adjustment parameters refer to the parameters set for correcting the audio parameters of the played audio signal, and the preset adjustment parameters include but are not limited to: preset adjustment volume and preset adjustment delay, wherein the preset adjustment volume is used to adjust the sound pressure, and the preset adjustment delay is used to adjust the phase.

[0141] Specifically, after obtaining the target audio parameter, the master control audio calculates the difference between the preset audio parameter and the target audio parameter, traverses multiple preset adjustment parameters, and determines the preset adjustment parameter that minimizes the difference as the target correction audio parameter.

[0142] The technical solution provided by the embodiment of the present disclosure is applied to a multi-channel sound correction system, which includes: a master control speaker and multiple channel speakers, each of which is provided with a millimeter wave radar and a sound-generating device, and an audio signal is sent to a target object through the sound-generating device according to the initial audio parameters. The sound vibration information generated by the target object according to the audio signal is collected by the millimeter wave radar, and the sound vibration information is sent to the master control speaker. The sound vibration information corresponding to the channel speaker is received by the master control speaker, and the sound vibration information is converted into the target audio parameters received by the target object; according to the preset audio parameters and the target audio parameters, the target correction audio parameters are determined and sent to the channel speakers, so that the channel speakers correct the initial audio parameters and determine the target sound field center, which is the position of the target object. In the above technical solution, the millimeter wave radar set by the channel speaker collects the sound vibration information generated by the target object according to the audio signal in real time, and the target correction audio parameters are determined based on the sound vibration information, so that the channel speakers correct the audio parameters of the played audio signal. When the audio signal is played using the corrected audio parameters, the sound field center of the current indoor viewing space can be adjusted to the position of the target object, such as the user, so that the target object at the center of the target sound field can receive high-quality audio, thereby improving the user experience.

[0143] In some embodiments, Figure 8 A flowchart of another multi-channel sound calibration method provided by an embodiment of the present disclosure is provided. Figure 8 is Figure 7 Based on the further optimization, the preset audio parameters for playing the audio signal include preset sound pressure and preset phase; the target audio parameters received by the target object include target sound pressure and target phase, and the preset adjustment parameters include: preset adjustment volume and preset adjustment delay. Based on this, Figure 8 As shown, one implementation of S71-S72 may be:

[0144] S81. Calculate the sound pressure difference between the preset sound pressure and the target sound pressure.

[0145] S82. For a plurality of preset adjustment volumes, determine a preset adjustment volume that minimizes the sound pressure difference as a target correction audio parameter.

[0146] Among them, multiple preset adjustment volumes refer to the volume values ​​of the audio signals played by the channel speakers. For example, if the adjustment volume range of the channel speakers is 0-50, then the multiple preset adjustment volumes can be determined to be 50 adjustment volumes, but this is not limited to this. The present disclosure does not specifically limit this, and those skilled in the art can set it according to actual conditions.

[0147] Specifically, after obtaining the target sound pressure, the master control audio calculates the difference between the preset sound pressure and the target sound pressure, traverses multiple preset adjustment volumes, and for each preset adjustment volume, obtains a sound pressure difference between the preset sound pressure and the target sound pressure, compares the multiple sound pressure differences, and determines the preset adjustment volume that minimizes the sound pressure difference as the target correction audio parameter.

[0148] In this way, in the technical solution provided by the embodiment of the present disclosure, in the above process, the target correction audio parameters used to correct the audio parameters of the played audio signal, that is, the sound pressure, can be obtained, so that the channel audio can correct the sound pressure of the played audio signal. When the audio signal is played through the corrected audio parameters, the sound field center of the current indoor viewing space can be changed, so that the target object such as the user at the current target sound field center can receive high-quality audio, thereby improving the user experience.

[0149] In some embodiments, continue to refer to Figure 8 As shown, another implementation of S71-S72 may be:

[0150] S83. Calculate the phase difference between the preset phase and the target phase.

[0151] S84. For a plurality of preset adjustment delays, determine a preset adjustment time that minimizes the phase difference as a target correction audio parameter.

[0152] Among them, multiple preset adjustment delays are used to determine the parameters set for the phase when the target object, such as a user, can receive high-quality audio when playing the audio signal. The multiple preset adjustment delays can be, for example, 1 second to 20 seconds, but are not limited to this. The present disclosure does not specifically limit this, and technical personnel in this field can set it according to actual conditions.

[0153] Specifically, after obtaining the target phase, the master control audio calculates the difference between the preset phase and the target phase, traverses multiple preset adjustment delays, and for each preset adjustment delay, obtains a phase difference between the preset phase and the target phase, compares the multiple phase difference values, and determines the preset adjustment delay that minimizes the phase difference as the target correction audio parameter.

[0154] In this way, in the technical solution provided by the embodiment of the present disclosure, in the above process, the target correction audio parameters, i.e., the phase of the audio parameters for correcting the played audio signal can be obtained, so that the channel audio can correct the phase of the played audio signal. When the audio signal is played through the corrected audio parameters, the sound field center of the current indoor viewing space can be changed, so that the target object such as the user at the center of the current target sound field can receive high-quality audio, thereby improving the user experience.

[0155] In some embodiments, Fig. 9A flowchart of another multi-channel sound correction method provided by an embodiment of the present disclosure is shown below. Fig. 9 As shown, the channel audio also includes: a control module; the initial audio parameters include: initial sound pressure and initial phase; based on this, the method also includes:

[0156] S91. Receive target calibration audio parameters sent by the master control speaker.

[0157] The target correction audio parameters include: target adjustment volume and target adjustment delay.

[0158] S92. Adjust the volume according to the target and correct the initial sound pressure.

[0159] S93, adjusting the delay according to the target and correcting the initial phase.

[0160] Specifically, after the control module of the channel audio receives the target correction audio parameters sent by the main control audio, where the target correction audio parameters include the target adjustment volume and the target adjustment delay, since the sound pressure received by the user is related to the volume of the played audio signal, the channel audio corrects the initial sound pressure according to the target adjustment volume through the control module, and since the phase is related to the delay, the initial phase of the played audio signal is corrected according to the target adjustment delay.

[0161] Thus, in the technical solution provided by the embodiment of the present disclosure, in the above process, after receiving the target correction audio parameters, the channel speaker corrects the audio parameters of the played audio signal. Since the audio signal is played by the corrected audio parameters, the sound field center of the current indoor viewing space can be changed, so that the target object such as the user at the center of the current target sound field can receive high-quality audio, thereby improving the user experience.

[0162] On the basis of the above embodiments, in some embodiments of the present disclosure, the method further includes:

[0163] After the target correction audio parameter is determined, the target distance between the channel sound and the target object is determined according to a preset mapping relationship.

[0164] The preset mapping relationship includes: a corresponding relationship between a preset adjustment volume and a preset distance.

[0165] Specifically, after determining the target correction audio parameter, the master control speaker determines the target distance between the channel speaker and the target object according to a preset mapping relationship including a correspondence relationship between a preset adjustment volume and a preset distance.

[0166] A plurality of target key points are determined according to the position of the target object and the plurality of target distances.

[0167] According to multiple target key points, a target area where the target object is located is determined.

[0168] The target area refers to an area where the user can receive a relatively high-quality audio signal.

[0169] Specifically, after determining the target distance between the channel speaker and the target object, the master control speaker determines multiple target key points according to the position of the target object and the multiple target distances, and after obtaining the multiple target key points, determines the target area where the target object can receive high-quality audio.

[0170] Exemplarily, following the above embodiment, as Fig.10 As shown, for 50 preset adjustment volumes, the preset adjustment volume corresponds to a distance, such as preset adjustment volume 1, the corresponding preset distance is d1, preset adjustment volume 2, the corresponding preset distance is d2.... preset adjustment volume 50, the corresponding preset distance is d50, according to the target adjustment volume corresponding to the channel speaker 200, the target distance between the target object 204 of the channel speaker 200 is determined to be D1, D2, D3, D4, further, according to the target object 204 and the target distance D1, D2, D3, D4, multiple target key points A, B, C, E are determined, and the multiple target key points A, B, C, E are connected to obtain a target area where the target object 204 can receive high-quality audio, but is not limited to this, the present disclosure is not specifically limited, and those skilled in the art can set it according to actual conditions.

[0171] Thus, in the technical solution provided by the embodiment of the present disclosure, in the above process, the target area where the target object receives high-quality audio can be obtained. Thus, when the target object is in the target area, no correction is required, thus saving resources.

[0172] The embodiments of the present disclosure also provide a storage medium containing computer executable instructions, which, when executed by a computer processor, implement the various processes of the method provided in any of the above embodiments and can achieve the same technical effect. To avoid repetition, they are not described here.

[0173] The computer-readable storage medium may be a read-only memory device (ROM), a random access memory device (RAM), a magnetic disk or an optical disk, etc.

[0174] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A multi-channel sound calibration system, characterized in that: The multi-channel sound correction system comprises: a main control sound, and a plurality of channel sounds, wherein the plurality of channel sounds are respectively provided with a millimeter wave radar and a sound generating device; The sound-generating device is configured as follows: Sending an audio signal to a target object according to initial audio parameters, wherein the initial audio parameters are used to determine an initial sound field center; The millimeter wave radar is configured as follows: Collecting the sound vibration information generated by the target object according to the audio signal, and sending the sound vibration information to the master control speaker; The master control speaker is configured as follows: Receiving sound vibration information corresponding to the channel sound, and converting the sound vibration information into target audio parameters received by the target object; According to the preset audio parameters and the target audio parameters, target correction audio parameters are determined and sent to the channel speakers, so that the channel speakers correct the initial audio parameters and determine the target sound field center, which is the position of the target object.

2. The multi-channel sound calibration system according to claim 1, characterized in that: The master control speaker is specifically configured as follows: Calculating a difference between the preset audio parameter and the target audio parameter; For a plurality of preset adjustment parameters, the preset adjustment parameter that minimizes the difference is determined as the target corrected audio parameter.

3. The multi-channel sound correction system according to claim 2, characterized in that: The preset audio parameter includes a preset sound pressure; the target audio parameter includes a target sound pressure; The preset adjustment parameters include: preset adjustment volume; The master control speaker is specifically configured as follows: Calculating a sound pressure difference between the preset sound pressure and the target sound pressure; For the plurality of preset adjustment volumes, the preset adjustment volume that minimizes the sound pressure difference is determined as a target correction audio parameter.

4. The multi-channel sound calibration system according to claim 2, characterized in that: The preset audio parameters also include: preset phase; the target audio parameters also include: target phase; the preset adjustment parameters include: preset adjustment delay; The master control speaker is specifically configured as follows: Calculating a phase difference between the preset phase and the target phase; For the plurality of preset adjustment delays, the preset adjustment time that minimizes the phase difference is determined as a target correction audio parameter.

5. The multi-channel sound calibration system according to claim 1, characterized in that: The channel audio system further comprises: a control module; the initial audio parameters comprise: initial sound pressure and initial phase; The control module is configured as follows: Receiving target correction audio parameters sent by the master control audio, wherein the target correction audio parameters include: target adjustment volume and target adjustment delay; Adjust the volume according to the target and correct the initial sound pressure; The initial phase is corrected according to the target adjustment delay.

6. The multi-channel sound calibration system according to claim 1, characterized in that: The master control speaker is specifically configured as follows: Obtaining a target time difference and a target phase difference corresponding to the sound vibration information; According to the target time difference and the target phase difference, obtaining the vibration displacement velocity of the reflected continuous wave corresponding to the sound vibration information; According to the vibration displacement velocity, obtaining a time domain signal corresponding to the reflected continuous wave; Performing Fourier transform on the time domain signal to obtain target audio parameters received by the target object.

7. The multi-channel sound calibration system according to claim 6, characterized in that: The master control speaker is specifically configured as follows: Determine a first moment when the sound-generating device sends an audio signal, and a second moment when the millimeter-wave radar collects the sound vibration information; Determining a target time difference according to the first moment and the second moment; The target phase difference is determined according to the target time difference and the frequency corresponding to the reflected continuous wave.

8. The multi-channel sound calibration system according to claim 4, characterized in that: The master control speaker is also configured as: After determining the target correction audio parameter, determining the target distance between the channel sound and the target object according to a preset mapping relationship, wherein the preset mapping relationship includes: a correspondence relationship between a preset adjustment volume and a preset distance; Determining multiple target key points according to the position of the target object and multiple target distances; A target area where the target object is located is determined according to the multiple target key points.

9. A multi-channel sound calibration method, characterized in that: Applied to a multi-channel sound correction system, the multi-channel sound correction system comprises: a master control sound, and a plurality of channel sounds, wherein the plurality of channel sounds are respectively provided with a millimeter wave radar and a sound generating device; the method comprises: Sending an audio signal to a target object through the sound-generating device according to initial audio parameters, wherein the initial audio parameters are used to determine an initial sound field center; collecting the sound vibration information generated by the target object according to the audio signal through the millimeter wave radar, and sending the sound vibration information to the main control speaker; Receiving the sound vibration information corresponding to the channel sound through the master control sound, and converting the sound vibration information into the target audio parameter received by the target object; According to the preset audio parameters and the target audio parameters, target correction audio parameters are determined and sent to the channel speakers, so that the channel speakers correct the initial audio parameters and determine the target sound field center, which is the position of the target object.

10. The multi-channel sound calibration method according to claim 9, characterized in that: The step of determining the target correction audio parameter according to the preset audio parameter and the target audio parameter includes: Calculating the difference between the preset audio parameter and the target audio parameter by the master control speaker; For a plurality of preset adjustment parameters, the preset adjustment parameter that minimizes the difference is determined as the target corrected audio parameter.

Images