Device binding method, apparatus, device, and storage medium

Abstract

The application provides a device binding method and device, equipment and a storage medium, the method comprises the following steps: for each audio playing device, controlling the audio playing device to play audio based on first audio information; controlling each camera device to record the audio played by the audio playing device under the condition that the echo noise reduction function is turned off, to obtain second audio information recorded by each camera device; determining at least one third audio information with echo characteristics in all second audio information, and determining a target camera device based on a target amplitude of each third audio information; and binding the target camera device with the audio playing device. The application can improve the binding efficiency of the audio playing device and the camera device.

Description

Technical Field

[0001] This invention relates to the field of surveillance technology, and in particular to a device binding method, apparatus, device, and storage medium. Background Technology

[0002] Traditional surveillance systems typically use network cameras (Internet Protocol Cameras, IPCs) for video and audio capture and playback. However, the audio-related chips within IPCs usually have limited power, making them unsuitable for scenarios requiring higher-power audio output. Therefore, network speakers (IPSpeakers) can be used for both audio capture and playback.

[0003] In existing technologies, it is usually necessary to manually bind the IPC and IPSpeaker one-to-one. After binding, the IPC can be used to acquire images within the monitoring area, and the IPSpeaker can be used to acquire and play audio within the same monitoring area.

[0004] However, the manual binding method described above is inefficient. Summary of the Invention

[0005] This invention provides a device binding method, apparatus, device, and storage medium to address the shortcomings of low binding efficiency between audio playback devices and camera devices in the prior art, thereby improving the binding efficiency of audio playback devices and camera devices.

[0006] This invention provides a device binding method applied to a management platform, the method comprising: For each audio playback device, control the audio playback device to play audio based on the first audio information; With echo noise reduction function turned off, each camera device records the audio played by the audio playback device to obtain the second audio information recorded by each camera device; Identify at least one third audio message with echo characteristics among all second audio messages, and determine the target camera device based on the target amplitude of each of the third audio messages; Bind the target camera device to the audio playback device.

[0007] According to a device binding method provided by the present invention, determining the target camera device based on the target amplitude of each of the third audio information includes: For each of the third audio information, the average amplitude of the third audio information is determined, and the average amplitude is determined as the target amplitude of the third audio information; The camera device corresponding to the target amplitude that is greater than the preset amplitude is determined as the target camera device.

[0008] According to a device binding method provided by the present invention, the method further includes: If no echo features are found in any of the second audio information, the audio playback device is controlled to play audio based on the fourth audio information, and each of the camera devices is controlled to re-record the audio played by the audio playback device until the target camera device is determined; the amplitude of the fourth audio information is greater than the amplitude of the first audio information.

[0009] According to a device binding method provided by the present invention, the recording duration of the second audio information is longer than the playback duration of the first audio information.

[0010] According to a device binding method provided by the present invention, determining the average amplitude of the third audio information includes: The third audio information is subjected to noise reduction processing to obtain the noise-reduced audio information; Determine the amplitude of the noise-reduced audio information at each moment; The average amplitude of the third audio information is determined based on the amplitude at each of the stated times.

[0011] According to a device binding method provided by the present invention, both the first audio information and the fourth audio information include single pulse audio information.

[0012] The present invention also provides a device binding method applied to an audio playback device, the method comprising: Audio is played based on the first audio information; Acquire the second audio information recorded by each camera device with echo noise reduction function turned off; Identify at least one third audio message with echo characteristics among all second audio messages, and determine the target camera device based on the target amplitude of each of the third audio messages; The identification information of the target camera device is sent to the management platform, and the identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

[0013] The present invention also provides a device binding method, applied to a camera device, the method comprising: With echo noise reduction function off, at least one audio playback device plays audio based on the first audio information in sequence to obtain at least one second audio information; Identify at least one third audio message with echo characteristics among all second audio messages, and determine the target audio playback device based on the target amplitude of each third audio message; The identification information of the target audio playback device is sent to the management platform, and the identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

[0014] The present invention also provides a device binding apparatus, comprising: The control module is used to control each audio playback device to play audio based on the first audio information. The control module is also used to control each camera device to record the audio played by the audio playback device when the echo noise reduction function is turned off, so as to obtain the second audio information recorded by each camera device; The determination module is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target camera device based on the target amplitude of each of the third audio information; The binding module is used to bind the target camera device to the audio playback device.

[0015] The present invention also provides a device binding apparatus, comprising: The playback module is used to play audio based on the first audio information; The acquisition module is used to acquire the second audio information recorded by each camera device when the echo noise reduction function is turned off; The determination module is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target camera device based on the target amplitude of each of the third audio information; The sending module is used to send the identification information of the target camera device to the management platform. The identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

[0016] The present invention also provides a device binding apparatus, comprising: The recording module is used to sequentially record audio played by at least one audio playback device based on the first audio information when the echo noise reduction function is turned off, so as to obtain at least one second audio information. The determination module is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target audio playback device based on the target amplitude of each of the third audio information. The sending module is used to send the identification information of the target audio playback device to the management platform. The identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

[0017] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement any of the device binding methods described above.

[0018] The present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the device binding method as described above.

[0019] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements any of the device binding methods described above.

[0020] The device binding method, apparatus, device, and storage medium provided by this invention, for each audio playback device, involves controlling the audio playback device to play audio based on first audio information, and controlling each camera device to record the audio played by the audio playback device with echo cancellation disabled, obtaining second audio information recorded by each camera device. After determining that at least one third audio information with echo characteristics exists in all second audio information, the target camera device is determined based on the target amplitude of each third audio information, and the target camera device is bound to the audio playback device. Since the target camera device to be bound can be determined by analyzing whether the second audio information recorded by each camera device contains echo characteristics, and based on the target amplitude of the third audio information containing echo characteristics, automatic binding of the target camera device and the audio playback device can be achieved even when the camera device and the audio playback device do not have sound localization functions, thus improving the device binding efficiency. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0022] Figure 1 This is one of the flowcharts illustrating the device binding method provided in an embodiment of the present invention.

[0023] Figure 2 This is a second flowchart illustrating the device binding method provided in an embodiment of the present invention.

[0024] Figure 3 This is the third flowchart illustrating the device binding method provided in this embodiment of the invention.

[0025] Figure 4This is one of the structural schematic diagrams of the device binding device provided in an embodiment of the present invention.

[0026] Figure 5 This is a second schematic diagram of the device binding device provided in an embodiment of the present invention.

[0027] Figure 6 The third schematic diagram of the device binding device provided in the embodiment of the present invention.

[0028] Figure 7 This is a schematic diagram of the physical structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0030] Currently, after connecting camera and audio playback devices to the management platform, manual binding of corresponding camera and audio playback devices within the same monitoring area is required, based on their installation locations. Since audio playback devices do not play images, it is difficult for operators to determine the actual installation location of each audio playback device when multiple devices are connected to the management platform. They can only determine the installation location and bind the devices based on the product model, serial number, and installation location recorded during installation, resulting in a low-efficiency binding process.

[0031] In view of the above problems, the present invention proposes a device binding method. In this method, an audio playback device is controlled to play audio, and each camera device is controlled to record audio with echo noise reduction function turned off. Since the recorded audio will contain echo characteristics when the distance between the audio playback device and the camera device is close, and the closer the two are, the greater the amplitude of the recorded audio will be. Based on this, the target camera device that needs to be bound to the audio playback device can be selected from multiple camera devices, thereby realizing automatic binding of the audio playback device and the camera device and improving the efficiency of device binding.

[0032] The device binding method provided by the embodiments of the present invention will be described below. The embodiments of the present invention are applicable to scenarios requiring video capture, audio capture, and audio playback, such as security monitoring and smart homes. The executing entity of this method can be a management platform, which may include, for example, a network video recorder (NVR), terminal device, computer, server, server cluster, or specially designed device binding device, or a device binding device installed in the electronic device. This device binding device can be implemented through software, hardware, or a combination of both.

[0033] Figure 1 This is one of the flowcharts illustrating the device binding method provided in an embodiment of the present invention, such as... Figure 1 As shown, the method includes: Step 101: For each audio playback device, control the audio playback device to play audio based on the first audio information.

[0034] In this step, the identification information of multiple audio playback devices and multiple camera devices that need to be bound can be added to the NVR. Audio playback devices may include, for example, an IPSpeaker or other devices capable of audio capture and playback, while camera devices may include, for example, cameras, webcams, or other devices capable of image capture.

[0035] In practical applications, the camera device bound to each audio playback device added to the NVR can be found by polling or traversing the audio playback devices. For the currently traversed audio playback device, in one implementation, the NVR directly sends the first audio information to be played to that audio playback device, which then plays the audio based on the received first audio information. In another implementation, the NVR selects a camera device, sends the first audio information to that camera device, and then the camera device forwards the first audio information to the audio playback device, which then plays the audio based on the received first audio information.

[0036] Step 102: Control each camera device to record the audio played by the audio playback device while the echo noise reduction function is turned off, and obtain the second audio information recorded by each camera device.

[0037] In this step, the NVR can send a noise reduction function off command to each added camera device. After receiving the noise reduction function off command, each camera device will turn off its own echo noise reduction function, that is, turn off the echo suppression function.

[0038] During audio playback, each camera device records the audio played by the audio playback device using a microphone, thus obtaining recorded second audio information. Each camera device can add its own identification information to the recorded second audio information and send the second audio information with added identification information to the NVR. In this way, the NVR can quickly identify the file recorded by each camera device based on the identification information.

[0039] It should be understood that, in another implementation, each camera device may also send the second audio information with added identification information to the audio playback device currently playing the audio via the network. The audio playback device may then use the received second audio information to find the target camera device that needs to be bound to it from all the camera devices.

[0040] Step 103: Determine at least one third audio message with echo characteristics among all the second audio messages, and determine the target camera device based on the target amplitude of each third audio message.

[0041] In this step, since the echo noise reduction function of each camera device is turned off, if the audio playback device and a certain camera device are close together, an echo effect will exist between the audio playback device and that camera device, and the second audio information recorded by that camera device will contain echo characteristics. Therefore, the second audio information recorded by each camera device can be analyzed to determine whether it contains echo characteristics.

[0042] In one implementation, the estimated echo component in the second audio information can be eliminated using an acoustic echo cancellation method. The audio after echo cancellation is then compared with the original second audio information. If there is a significant difference between the two, the second audio information is considered to contain echo features.

[0043] In another implementation, since echoes typically form a spectral copy that is similar to the original signal but delayed in time, the presence of echo features in the second audio information can be determined by performing spectral analysis on the second audio information.

[0044] After analyzing the second audio information corresponding to each camera device, third audio information containing echo characteristics can be selected from all the second audio information. Furthermore, by combining the target amplitude of each third audio information, target camera devices that are less than a preset distance from the audio playback device can be selected from the camera devices that recorded the third audio information.

[0045] Step 104: Bind the target camera device to the audio playback device.

[0046] In this step, the distance between the target camera and the audio playback device is less than the preset distance, indicating that they are installed in the same monitoring area. Therefore, they can be linked together. In this way, subsequent monitoring of the area will involve image acquisition via the target camera and audio acquisition and playback via the audio playback device.

[0047] By following the above method, after traversing all audio playback devices, the corresponding target camera device can be found for each audio playback device.

[0048] For example, in a specific implementation, a camera device can be used as a reference to find the target audio playback device that needs to be bound to the camera device from multiple audio playback devices. Specifically, for each camera device, the camera device can be controlled to sequentially record audio played by at least one audio playback device based on the first audio information, thereby obtaining at least one recorded second audio information. The camera device can send the at least one recorded second audio information to the NVR so that the NVR can determine at least one third audio information with echo characteristics among all the second audio information, and determine the target audio playback device based on the target amplitude of each third audio information. Alternatively, the camera device can independently determine at least one third audio information with echo characteristics, and determine the target audio playback device that needs to be bound to the camera device based on the target amplitude of each third audio information.

[0049] By iterating through each camera device, the corresponding target audio playback device can be found for each camera device.

[0050] The device binding method provided in this embodiment of the invention, for each audio playback device, involves controlling the audio playback device to play audio based on first audio information, and controlling each camera device to record the audio played by the audio playback device with echo noise reduction function disabled, obtaining second audio information recorded by each camera device. After determining that at least one third audio information with echo characteristics exists in all second audio information, the target camera device is determined based on the target amplitude of each third audio information, and the target camera device is bound to the audio playback device. Since the target camera device to be bound can be determined by analyzing whether the second audio information recorded by each camera device contains echo characteristics, and based on the target amplitude of the third audio information containing echo characteristics, the target camera device can be automatically bound to the audio playback device even when the camera device and the audio playback device do not have sound positioning function, thus improving the device binding efficiency.

[0051] In practical applications, taking the determination of the target camera device corresponding to each audio playback device as an example, each camera device, after recording the second audio information, performs audio analysis on its recorded second audio information to determine whether echo features exist. If echo features are found, the third audio information containing echo features is then sent to the NVR. The NVR determines the target amplitude of each third audio information containing echo features, thereby identifying the target camera device from multiple camera devices. Alternatively, when a camera device determines that its recorded second audio information contains echo features, it continues to analyze the target amplitude of the second audio information and sends the analyzed target amplitude to the NVR. The NVR directly determines the target camera device from multiple camera devices based on the acquired target amplitudes.

[0052] In another implementation, the NVR can also send the second audio information recorded by all the camera devices or the determined target amplitude to the audio playback device. The audio playback device then determines the target camera device based on each piece of second audio information or each target amplitude. Alternatively, the NVR can send the second audio information recorded by all the camera devices or the determined target amplitude to each camera device, allowing each camera device to determine whether it is the target camera device based on each piece of second audio information or each target amplitude.

[0053] Furthermore, after identifying the target camera device, the NVR can directly bind the target camera device to the audio playback device, or send the identification information of the audio playback device to the identified target camera device, which will then perform the binding operation. Alternatively, the NVR can send the identification information of the target camera device to the audio playback device, which will then perform the binding operation.

[0054] The process of determining the target audio playback device corresponding to each camera device based on the camera device is similar to the process described above, and will not be repeated here.

[0055] For example, based on the above embodiments, when determining the target camera device based on the target amplitude of each third audio information, it can be done in the following way: For each third audio information, the average amplitude of the third audio information is determined, and the average amplitude is determined as the target amplitude of the third audio information. Then, the camera device corresponding to the target amplitude that is greater than the preset amplitude is determined as the target camera device.

[0056] Specifically, audio analysis is performed on each third audio information containing echo features to calculate the average amplitude of the third audio information. This average amplitude is the average value of the audio signal amplitude within a certain time window, which can be used as a signal strength index of the third audio information. The calculated average amplitude is used as the target amplitude of the third audio information.

[0057] Since the closer the camera device and the audio playback device are, the larger the amplitude of the recorded audio will be, after calculating the target amplitude of each third audio information, the camera device corresponding to the target amplitude greater than the preset amplitude is selected from all target amplitudes as the target camera device to be bound to the audio playback device. The preset amplitude can be set according to actual conditions or experience; this embodiment does not limit the actual value of the preset amplitude. For example, the camera device corresponding to the largest target amplitude among all target amplitudes can also be directly determined as the target camera device to be bound to the audio playback device, that is, the target camera device that is closest to the audio playback device.

[0058] In this embodiment, by determining the target amplitude of the third audio information and based on the magnitude of each target amplitude, the target camera device that is less than a preset distance from the audio playback device can be quickly selected from all camera devices, thereby improving the efficiency of target camera device determination.

[0059] For example, based on the above embodiments, when determining the average amplitude of the third audio information, the third audio information can be denoised to obtain denoised audio information, and the amplitude of the denoised audio information at each time can be determined, thereby determining the average amplitude of the third audio information based on the amplitude at each time.

[0060] Specifically, the third audio information can be denoised using any method that can denoise the signal, such as wavelet transform, adaptive filtering, or depth model, to reduce or eliminate noise components in the third audio information, making the denoised audio information clearer, thereby enhancing the original audio and echo audio.

[0061] For each denoised audio message, the absolute value of the amplitude at each moment can be calculated as A(t) = |y(t)|, where y(t) represents the amplitude of the denoised audio message at time t.

[0062] Furthermore, the average amplitude of the third audio information can be determined based on the following formula (1): (1) in, The third audio information represents the average amplitude, and N represents the audio duration corresponding to the third audio information.

[0063] In this embodiment, by performing noise reduction processing on the third audio information, the original audio and echo audio can be enhanced, improving the quality of the third audio information and thus improving the accuracy of the determined average amplitude.

[0064] Furthermore, based on the above embodiments, considering the varying installation distances between audio playback devices and camera devices, to more effectively implement the automatic binding function, multiple audio information messages can be stored in the NVR. These different audio messages possess different amplitudes to detect audio playback devices and camera devices at different distances. For example, if no echo characteristics are found in any of the second audio messages, the audio playback device is controlled to play audio based on the fourth audio message, and each camera device is controlled to re-record the audio played by the audio playback device until the target camera device is identified; the amplitude of the fourth audio message is greater than the amplitude of the first audio message.

[0065] Specifically, for the currently traversed audio playback device, if after playing audio based on the first audio information, none of the second audio information recorded by any camera device with echo noise reduction disabled includes echo features, it indicates that no suitable target camera device was found at the amplitude corresponding to the first audio information. Therefore, it is necessary to re-control the audio playback device to play audio based on the fourth audio information, where the amplitude of the fourth audio information is greater than the amplitude of the first audio information.

[0066] During the audio playback process based on the fourth audio information, each camera device needs to re-record the audio played by the audio playback device with the echo noise reduction function turned off, and filter the audio information containing echo features in the re-recorded audio. In this way, the camera device corresponding to the target amplitude that is greater than the preset amplitude among the target amplitudes of the filtered audio information is identified as the target camera device.

[0067] If none of the re-recorded audio samples contain echo characteristics, the system will select an audio sample with an amplitude greater than that of the fourth audio sample and continue playing it until the target camera is found.

[0068] Therefore, when binding for the first time, you can choose to play the audio information with the smallest amplitude. If no target camera device is found, you can choose to play the audio information with the second smallest amplitude, and so on, until a target camera device that can be bound to the audio playback device is found.

[0069] In this embodiment, considering that the installation distance between the audio playback device and the camera device varies, the target camera device can be found by playing audio information with different amplitudes one by one until it is located, which can improve the accuracy of the identified target camera device.

[0070] For example, based on the above embodiments, the recording duration of the second audio information recorded by each camera device is longer than the playback duration of the first audio information.

[0071] Specifically, when recording audio played by an audio playback device, each camera device can record based on a target duration, which is longer than the playback duration of the first audio information. For example, the target duration could be three times the playback duration of the first audio information. Setting the recording duration of the second audio information to a value greater than the playback duration of the first audio information ensures that any possible echoes can be transmitted to the camera device and recorded, improving the accuracy of the recorded second audio information and avoiding the situation where the echo signal is truncated due to a short recording time.

[0072] For example, based on the above embodiments, the first audio information and the fourth audio information played by the audio playback device both include single pulse audio information, which makes it easier for the camera device to detect the audio played by the audio playback device and improves the efficiency of device binding.

[0073] It should be noted that for audio playback devices and camera devices that are incorrectly or not bound, manual correction or binding can be performed to ensure that all devices are bound correctly.

[0074] It should be noted that the device binding methods in the above embodiments can also be executed by an audio playback device or a camera device. The following will describe these methods in conjunction with... Figure 2 and Figure 3 Please provide an explanation.

[0075] Figure 2 This is a second flowchart illustrating the device binding method provided in an embodiment of the present invention. The executing entity in this embodiment is an audio playback device. Figure 2 As shown, the method includes: Step 201: Play audio based on the first audio information.

[0076] In this step, the management platform can send audio playback instructions to the audio playback device. The first audio information can be sent directly from the management platform to the audio playback device, or it can be forwarded by the management platform to the audio playback device through the camera device.

[0077] Step 202: Obtain the second audio information recorded by each camera device with echo noise reduction function turned off.

[0078] In this step, while the audio playback device is playing audio, each camera device, with echo cancellation disabled, records the audio played by the audio playback device using its microphone, thus obtaining recorded second audio information. Each camera device can send the recorded second audio information to the management platform, which then forwards it to the audio playback device. Alternatively, each camera device can directly send its recorded second audio information to the audio playback device. Each camera device can add its own identification information to the recorded second audio information, allowing the audio playback device to quickly identify the file recorded by each camera device based on the identification information.

[0079] Step 203: Determine at least one third audio message with echo characteristics among all the second audio messages, and determine the target camera device based on the target amplitude of each third audio message.

[0080] In this step, since the echo noise reduction function of each camera device is turned off, if the audio playback device and a certain camera device are close together, an echo effect will exist between the audio playback device and that camera device, and the second audio information recorded by that camera device will contain echo characteristics. Therefore, the second audio information recorded by each camera device can be analyzed to determine whether it contains echo characteristics. The specific method for determining whether the second audio information contains echo characteristics can be referred to the description in step 103, which will not be repeated here.

[0081] After analyzing the second audio information corresponding to each camera device, third audio information containing echo characteristics can be selected from all the second audio information. Furthermore, by combining the target amplitude of each third audio information, target camera devices that are less than a preset distance from the audio playback device can be selected from the camera devices that recorded the third audio information.

[0082] Step 204: Send the identification information of the target camera device to the management platform. The identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

[0083] In this step, after identifying the target camera device, the audio playback device can send the identification information of the target camera device to the management platform. In this way, the management platform can bind the target camera device to the audio playback device, thereby obtaining the binding relationship between each camera device and each audio playback device, which facilitates the management of the camera devices and audio playback devices.

[0084] Alternatively, the audio playback device can bind the target camera device and the audio playback device locally, and then send the binding relationship to the management platform.

[0085] The device binding method provided in this invention involves playing audio based on first audio information, obtaining second audio information recorded by each camera device with echo noise reduction disabled, determining at least one third audio information containing echo characteristics among all second audio information, and identifying the target camera device based on the target amplitude of each third audio information. The identification information of the target camera device is then sent to a management platform, instructing the management platform to bind the target camera device to the audio playback device. Because analyzing whether the second audio information recorded by each camera device contains echo characteristics, and based on the target amplitude of the third audio information containing echo characteristics, the target camera device to be bound can be determined. This allows for automatic binding of the target camera device and audio playback device even when neither the camera device nor the audio playback device has sound localization capabilities, improving device binding efficiency.

[0086] Figure 3 This is the third flowchart illustrating the device binding method provided in this embodiment of the invention. The executing entity in this embodiment is a camera device. Figure 3 As shown, the method includes: Step 301: With echo noise reduction function off, record audio played by at least one audio playback device based on the first audio information in sequence to obtain at least one second audio information.

[0087] In this step, the management device will control each audio playback device to play the first audio information in sequence. In order to prevent the second audio information recorded by the camera device from being confused, the next audio playback device will play the first audio information after one audio playback device has finished playing it.

[0088] For each camera device, with the echo noise reduction function turned off, it will sequentially record the audio played by at least one audio playback device based on the first audio information. After recording the first audio information played by each audio playback device, an end mark can be added to the obtained second audio information to facilitate and accurately distinguish each second audio information.

[0089] Step 302: Determine at least one third audio information with echo characteristics among all second audio information, and determine the target audio playback device based on the target amplitude of each third audio information.

[0090] In this step, since the echo noise reduction function of the camera device is turned off, if an audio playback device and the camera device are close together, an echo effect will exist between them, and the second audio information recorded by the camera device will contain echo characteristics. Therefore, the second audio information recorded by the camera device can be analyzed to determine whether it contains echo characteristics. The specific method for determining whether the second audio information contains echo characteristics can be found in the description of step 103, and will not be repeated here.

[0091] After analyzing each second audio message, the camera can filter out third audio messages containing echo features from all the second audio messages. Furthermore, by combining the target amplitude of each third audio message, it can filter out target audio playback devices that are less than a preset distance from the camera from the audio playback devices corresponding to each third audio message.

[0092] Step 303: Send the identification information of the target audio playback device to the management platform. The identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

[0093] In this step, after the camera device identifies the target audio playback device, it can send the identification information of the target audio playback device to the management platform. In this way, the management platform can bind the camera device to the target audio playback device, thereby obtaining the binding relationship between each camera device and each audio playback device, which facilitates the management of the camera device and the audio playback device.

[0094] Alternatively, the camera device can bind itself to the target audio playback device locally, and then send the binding relationship to the management platform.

[0095] The device binding method provided in this invention involves sequentially recording audio played by at least one audio playback device based on first audio information with echo noise reduction disabled, obtaining at least one second audio information, identifying at least one third audio information containing echo characteristics among all second audio information, determining the target audio playback device based on the target amplitude of each third audio information, and sending the identification information of the target audio playback device to a management platform. This identification information is used to instruct the management platform to bind the camera device to the target audio playback device. Since the target audio playback device to be bound can be determined by analyzing whether each second audio information recorded by the camera device contains echo characteristics, and based on the target amplitude of the third audio information containing echo characteristics, automatic binding of the camera device and the target audio playback device can be achieved even when the camera device and the audio playback device do not have sound localization capabilities, thus improving the device binding efficiency.

[0096] The device binding apparatus provided by the present invention will be described below. The device binding apparatus described below and the device binding method described above can be referred to in correspondence.

[0097] Figure 4 This is one of the structural schematic diagrams of the device binding device provided in the embodiments of the present invention, referring to... Figure 4 As shown, the device binding device 400 includes: Control module 11 is used to control each audio playback device to play audio based on the first audio information. The control module 11 is also used to control each camera device to record the audio played by the audio playback device when the echo noise reduction function is turned off, so as to obtain the second audio information recorded by each camera device; The determining module 12 is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target camera device based on the target amplitude of each of the third audio information; Binding module 13 is used to bind the target camera device to the audio playback device.

[0098] In one example embodiment, the determining module 12 is specifically used for: For each of the third audio information, the average amplitude of the third audio information is determined, and the average amplitude is determined as the target amplitude of the third audio information; The camera device corresponding to the target amplitude that is greater than the preset amplitude is determined as the target camera device.

[0099] In one example embodiment, the control module 11 is specifically used for: If no echo features are found in any of the second audio information, the audio playback device is controlled to play audio based on the fourth audio information, and each of the camera devices is controlled to re-record the audio played by the audio playback device until the target camera device is determined; the amplitude of the fourth audio information is greater than the amplitude of the first audio information.

[0100] In one example embodiment, the recording duration of the second audio information is longer than the playback duration of the first audio information.

[0101] In one example embodiment, the determining module 12 is specifically used for: The third audio information is subjected to noise reduction processing to obtain the noise-reduced audio information; Determine the amplitude of the noise-reduced audio information at each moment; The average amplitude of the third audio information is determined based on the amplitude at each of the stated times.

[0102] In one example embodiment, both the first audio information and the fourth audio information include single-pulse audio information.

[0103] The apparatus of this embodiment can be used to execute the method of any embodiment in the device binding method side embodiment. Its specific implementation process and technical effects are similar to those in the device binding method side embodiment. For details, please refer to the detailed description in the device binding method side embodiment, which will not be repeated here.

[0104] Figure 5 This is a second schematic diagram of the device binding device provided in an embodiment of the present invention, referring to... Figure 5 As shown, the device binding device 500 includes: Playback module 21 is used to play audio based on the first audio information; The acquisition module 22 is used to acquire the second audio information recorded by each camera device when the echo noise reduction function is turned off; The determining module 23 is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target camera device based on the target amplitude of each of the third audio information; The sending module 24 is used to send the identification information of the target camera device to the management platform. The identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

[0105] The apparatus of this embodiment can be used to execute the method of any embodiment in the device binding method side embodiment. Its specific implementation process and technical effects are similar to those in the device binding method side embodiment. For details, please refer to the detailed description in the device binding method side embodiment, which will not be repeated here.

[0106] Figure 6 This is the third schematic diagram of the device binding device provided in the embodiment of the present invention, referring to... Figure 6 As shown, the device binding device 600 includes: Recording module 31 is used to record audio played by at least one audio playback device based on first audio information in sequence when the echo noise reduction function is turned off, so as to obtain at least one second audio information. The determining module 32 is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target audio playback device based on the target amplitude of each of the third audio information. The sending module 33 is used to send the identification information of the target audio playback device to the management platform. The identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

[0107] The apparatus of this embodiment can be used to execute the method of any embodiment in the device binding method side embodiment. Its specific implementation process and technical effects are similar to those in the device binding method side embodiment. For details, please refer to the detailed description in the device binding method side embodiment, which will not be repeated here.

[0108] Figure 7 This is a schematic diagram of the physical structure of an electronic device provided in an embodiment of the present invention, such as... Figure 7 As shown, the electronic device may include a processor 710, a communications interface 720, a memory 730, and a communication bus 740, wherein the processor 710, communications interface 720, and memory 730 communicate with each other via the communication bus 740. The processor 710 can call logical instructions in the memory 730 to execute a device binding method, which includes: controlling each audio playback device to play audio based on first audio information; controlling each camera device to record the audio played by the audio playback device with echo cancellation disabled, obtaining second audio information recorded by each camera device; determining at least one third audio information with echo characteristics in all the second audio information, and determining a target camera device based on the target amplitude of each third audio information; and binding the target camera device to the audio playback device.

[0109] The processor 710 can call logical instructions in the memory 730 to execute a device binding method, which includes: playing audio based on first audio information; acquiring second audio information recorded by each camera device with echo noise reduction function turned off; determining at least one third audio information with echo characteristics in all the second audio information, and determining a target camera device based on the target amplitude of each of the third audio information; sending the identification information of the target camera device to a management platform, wherein the identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

[0110] The processor 710 can call logical instructions in the memory 730 to execute a device binding method, which includes: recording audio played by at least one audio playback device based on first audio information in sequence when the echo noise reduction function is off, to obtain at least one second audio information; determining at least one third audio information with echo characteristics in all the second audio information, and determining a target audio playback device based on the target amplitude of each of the third audio information; and sending the identification information of the target audio playback device to a management platform, wherein the identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

[0111] Furthermore, the logical instructions in the aforementioned memory 730 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0112] On the other hand, the present invention also provides a computer program product, the computer program product comprising a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer is able to execute the device binding method provided by the above methods. The method includes: for each audio playback device, controlling the audio playback device to play audio based on first audio information; controlling each camera device to record the audio played by the audio playback device with echo noise reduction function turned off, to obtain second audio information recorded by each camera device; determining at least one third audio information with echo characteristics in all the second audio information, and determining a target camera device based on the target amplitude of each third audio information; and binding the target camera device to the audio playback device.

[0113] When the computer program is executed by the processor, the computer can execute the device binding method provided by the above methods. The method includes: playing audio based on first audio information; acquiring second audio information recorded by each camera device with echo noise reduction function turned off; determining at least one third audio information with echo characteristics in all second audio information, and determining a target camera device based on the target amplitude of each third audio information; sending the identification information of the target camera device to the management platform, wherein the identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

[0114] When the computer program is executed by the processor, the computer is able to execute the device binding method provided by the above methods. The method includes: with the echo noise reduction function turned off, sequentially recording audio played by at least one audio playback device based on first audio information to obtain at least one second audio information; determining at least one third audio information with echo characteristics among all the second audio information, and determining the target audio playback device based on the target amplitude of each of the third audio information; sending the identification information of the target audio playback device to the management platform, wherein the identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

[0115] In another aspect, the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the device binding method provided by the above methods. The method includes: controlling each audio playback device to play audio based on first audio information; controlling each camera device to record the audio played by the audio playback device with echo cancellation disabled, thereby obtaining second audio information recorded by each camera device; determining at least one third audio information in all the second audio information that exhibits echo characteristics, and determining a target camera device based on the target amplitude of each of the third audio information; and binding the target camera device to the audio playback device.

[0116] When executed by a processor, the computer program implements the device binding method provided by the above methods, the method comprising: playing audio based on first audio information; acquiring second audio information recorded by each camera device with echo noise reduction function turned off; determining at least one third audio information with echo characteristics in all the second audio information, and determining a target camera device based on the target amplitude of each of the third audio information; sending the identification information of the target camera device to a management platform, the identification information being used to instruct the management platform to bind the target camera device to the audio playback device.

[0117] When executed by a processor, the computer program implements the device binding method provided by the above methods, which includes: with echo noise reduction function disabled, sequentially recording audio played by at least one audio playback device based on first audio information to obtain at least one second audio information; determining at least one third audio information with echo characteristics among all the second audio information, and determining a target audio playback device based on the target amplitude of each of the third audio information; sending the identification information of the target audio playback device to a management platform, wherein the identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

[0118] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0119] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0120] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A device binding method, characterized in that, Applied to a management platform, the method includes: For each audio playback device, control the audio playback device to play audio based on the first audio information; With echo noise reduction function turned off, each camera device records the audio played by the audio playback device to obtain the second audio information recorded by each camera device; Identify at least one third audio message with echo characteristics among all second audio messages, and determine the target camera device based on the target amplitude of each of the third audio messages; Bind the target camera device to the audio playback device.

2. The device binding method according to claim 1, characterized in that, The determination of the target camera device based on the target amplitude of each of the third audio information includes: For each of the third audio information, the average amplitude of the third audio information is determined, and the average amplitude is determined as the target amplitude of the third audio information; The camera device corresponding to the target amplitude that is greater than the preset amplitude is determined as the target camera device.

3. The device binding method according to claim 1, characterized in that, The method further includes: If no echo features are found in any of the second audio information, the audio playback device is controlled to play audio based on the fourth audio information, and each of the camera devices is controlled to re-record the audio played by the audio playback device until the target camera device is determined; the amplitude of the fourth audio information is greater than the amplitude of the first audio information.

4. The device bonding method according to any one of claims 1-3, characterized in that, The recording duration of the second audio information is longer than the playback duration of the first audio information.

5. The device binding method according to claim 2, characterized in that, Determining the average amplitude of the third audio information includes: The third audio information is subjected to noise reduction processing to obtain the noise-reduced audio information; Determine the amplitude of the noise-reduced audio information at each moment; The average amplitude of the third audio information is determined based on the amplitude at each of the stated times.

6. A device bonding method, characterized in that, Applied to an audio playback device, the method includes: Audio is played based on the first audio information; Acquire the second audio information recorded by each camera device with echo noise reduction function turned off; Identify at least one third audio message with echo characteristics among all second audio messages, and determine the target camera device based on the target amplitude of each of the third audio messages; The identification information of the target camera device is sent to the management platform, and the identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

7. A device bonding method, characterized in that, Applied to a camera device, the method includes: With echo noise reduction function off, at least one audio playback device plays audio based on the first audio information in sequence to obtain at least one second audio information; Identify at least one third audio message with echo characteristics among all second audio messages, and determine the target audio playback device based on the target amplitude of each third audio message; The identification information of the target audio playback device is sent to the management platform, and the identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

8. A device binding device, characterized in that, include: The control module is used to control each audio playback device to play audio based on the first audio information. The control module is also used to control each camera device to record the audio played by the audio playback device when the echo noise reduction function is turned off, so as to obtain the second audio information recorded by each camera device; The determination module is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target camera device based on the target amplitude of each of the third audio information; The binding module is used to bind the target camera device to the audio playback device.

9. A device binding device, characterized in that, include: The playback module is used to play audio based on the first audio information; The acquisition module is used to acquire the second audio information recorded by each camera device when the echo noise reduction function is turned off; The determination module is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target camera device based on the target amplitude of each of the third audio information; The sending module is used to send the identification information of the target camera device to the management platform. The identification information is used to instruct the management platform to bind the target camera device to the audio playback device.

10. A device binding device, characterized in that, include: The recording module is used to sequentially record audio played by at least one audio playback device based on the first audio information when the echo noise reduction function is turned off, so as to obtain at least one second audio information. The determination module is used to determine at least one third audio information with echo characteristics among all the second audio information, and to determine the target audio playback device based on the target amplitude of each of the third audio information. The sending module is used to send the identification information of the target audio playback device to the management platform. The identification information is used to instruct the management platform to bind the camera device to the target audio playback device.

11. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the device binding method as described in any one of claims 1 to 5, or the device binding method as described in claim 6, or the device binding method as described in claim 7.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the device binding method as described in any one of claims 1 to 5, or the device binding method as described in claim 6, or the device binding method as described in claim 7.

Images