Audio processing method, device, doorbell, door and medium

Abstract

The present invention discloses an audio processing method, device, doorbell, door and medium, including: starting the doorbell to play and collect audio data to obtain the original audio data stream, and establishing an audio data transmission channel with a pre-bound user terminal; storing the original audio data stream as playback data, and performing echo elimination processing on the original audio data stream to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is the data stream after eliminating the echo audio data; based on the audio data transmission channel, sending the call audio data stream to the user terminal. The solution provided by the present application is used to solve the problem that the existing doorbell has relatively single functions. The technical effect of enriching the doorbell functions is achieved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an audio processing method, device, doorbell, door and medium. Background Art

[0002] With the continuous development of Internet of Things technology, various intelligent terminal devices continue to penetrate into people's lives, providing people with a more convenient way of life and work. For example, smart doorbells have begun to be promoted and used on a large scale. At present, smart doorbells carry the work of identifying visitors, conveying visitor information, and security protection. When visitors visit, the smart doorbell can collect video or voice information and process and feedback it to the visitor.

[0003] However, since current smart doorbells only provide call or video functions, their functions are relatively simple and cannot meet the growing needs of users. Summary of the invention

[0004] In view of the above problems, the present invention is proposed to provide an audio processing method, device, doorbell, door and medium that overcome the above problems or at least partially solve the above problems.

[0005] In a first aspect, an audio processing method is provided, wherein the method is applied to a doorbell, comprising:

[0006] Start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with the pre-bound user terminal;

[0007] The original audio data stream is stored as playback data, and the original audio data stream is subjected to echo elimination processing to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after the echo audio data is eliminated;

[0008] Based on the audio data transmission channel, the call audio data stream is sent to the user terminal.

[0009] Optionally, storing the original audio data stream as playback data includes: storing the original audio data stream in a storage unit of the doorbell as playback data, or sending the original audio data stream to a server corresponding to the doorbell for storage as playback data, or sending the original audio data stream to the user terminal for storage as playback data.

[0010] Optionally, starting the doorbell to play and collect audio data to obtain the original audio data stream, and establishing an audio data transmission channel with a pre-bound user terminal includes: after receiving a call operation, generating a call instruction based on the call operation, and sending the call instruction to the user terminal pre-bound to the doorbell; after receiving a response signal returned by the user terminal, starting the doorbell to play and collect audio data to obtain the original audio data stream, and establishing an audio data transmission channel with the user terminal.

[0011] Optionally, sending the call audio data stream to the user terminal includes: sending the call audio data stream to the user terminal based on a Bluetooth communication module, a WIFI communication module, a LTE communication module, a Z-wave communication module or a ZigBee communication module set on the doorbell.

[0012] Optionally, the method further includes: receiving an opening instruction sent by the user terminal, and controlling the opening of the smart door corresponding to the doorbell based on the opening instruction.

[0013] Optionally, the receiving the opening instruction sent by the user terminal includes: receiving audio data sent by the user terminal, and when the audio data includes target audio data matching a preset door opening audio, using the target audio data as the opening instruction.

[0014] In a second aspect, an audio processing device is provided, wherein the device is a doorbell, comprising:

[0015] A start module, used to start the doorbell to play and collect audio data to obtain the original audio data stream, and to establish an audio data transmission channel with a pre-bound user terminal;

[0016] a processing module, configured to store the original audio data stream as playback data, and perform echo cancellation processing on the original audio data stream to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after the echo audio data is cancelled;

[0017] A sending module is used to send the call audio data stream to the user terminal based on the audio data transmission channel.

[0018] Optionally, the processing module is also used to: store the original audio data stream in the storage unit of the doorbell as playback data, or send the original audio data stream to the server corresponding to the doorbell for storage as playback data, or send the original audio data stream to the user terminal for storage as playback data.

[0019] Optionally, the startup module is also used to: after receiving a call operation, generate a call instruction based on the call operation, and send the call instruction to a user terminal pre-bound to the doorbell; after receiving a response signal returned by the user terminal, start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with the user terminal.

[0020] Optionally, the sending module includes: a Bluetooth communication module, a WIFI communication module, a LTE communication module, a Z-wave communication module or a ZigBee communication module.

[0021] Optionally, the device also includes: an opening module, which is used to receive an opening instruction sent by the user terminal, and control the opening of the smart door corresponding to the doorbell based on the opening instruction.

[0022] Optionally, the opening module is further used to: receive audio data sent by the user terminal, and when the audio data includes target audio data matching a preset door opening audio, use the target audio data as the opening instruction.

[0023] In a third aspect, a smart doorbell is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described in the first aspect when executing the program.

[0024] Optionally, the smart doorbell includes a doorbell body and a doorbell base station; the doorbell body is arranged outside the door, the doorbell base station is arranged indoors, the doorbell body and the doorbell base station are communicatively connected, and the doorbell base station and the user terminal are communicatively connected.

[0025] In a fourth aspect, a smart door is provided, comprising the smart doorbell described in the third aspect.

[0026] According to a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, any method described in the first aspect is implemented.

[0027] The technical solution provided in the embodiments of the present application has at least the following technical effects or advantages:

[0028] The audio processing method, device, doorbell, door and medium provided in the embodiments of the present application, during a video call or voice call, the doorbell not only provides a call audio data stream after echo cancellation processing to meet the real-time clear call requirements, but also stores the original audio data stream that has not been processed for echo cancellation as playback data for subsequent playback by the user. This not only increases the playback function, but also because the echo cancellation is not performed on the callback data, the playback data collected only at the doorbell end can also include the audio data played by the doorbell collected by the user terminal. The dialogue integrity of the playback audio is guaranteed.

[0029] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0031] Figure 1 is a flowchart of an audio processing method in an embodiment of the present invention;

[0032] Figure 2 is a schematic diagram of the structure of an audio processing device in an embodiment of the present invention;

[0033] Figure 3 The structure of the doorbell in the embodiment of the present invention is shown in FIG. Figure 1 ;

[0034] Figure 4 This is a schematic diagram of a doorbell installed on a door in an embodiment of the present invention;

[0035] Figure 5 The structure of the doorbell in the embodiment of the present invention is shown in FIG. Figure 2 ;

[0036] Figure 6 Schematic diagram of the structure of the medium in the embodiment of the present invention. DETAILED DESCRIPTION

[0037] The technical solution in the embodiment of the present application has the following general idea:

[0038] The doorbell processes the collected raw audio data in two ways: one way is directly stored as playback data, and the other way is processed as real-time call data after echo cancellation. In this way, on the basis of ensuring clear real-time calls, not only the playback function is added, but also because the echo cancellation is not performed on the callback data, the playback data collected only at the doorbell end can also include the audio data played by the doorbell collected by the user terminal, ensuring the integrity of the playback audio conversation.

[0039] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0040] This embodiment provides an audio processing method, characterized in that: Figure 1 As shown, the method is applied to a doorbell, comprising:

[0041] Step S101, start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with a pre-bound user terminal;

[0042] Step S102, storing the original audio data stream as playback data, and performing echo cancellation processing on the original audio data stream to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after the echo audio data is cancelled;

[0043] Step S103: sending the call audio data stream to the user terminal based on the audio data transmission channel.

[0044] It should be noted that the audio processing method provided in this embodiment can be used not only for doorbells that only provide a calling function, but also for doorbells that provide a video calling function, without limitation here.

[0045] Next, combine Figure 1 The implementation steps of the audio processing method provided in this embodiment are described in detail:

[0046] Step S101, start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with a pre-bound user terminal.

[0047] In the specific implementation process, there are many ways to start the doorbell playback and collect audio data to obtain the original audio data stream. The following are two examples:

[0048] The first method is that after receiving a call operation such as pressing a doorbell button, the doorbell generates a call instruction based on the call operation and sends the call instruction to the user terminal pre-bound with the doorbell. After receiving a response signal returned by the user terminal, the doorbell starts playing and collecting audio data to obtain the original audio data stream, and establishes an audio data transmission channel with the user terminal.

[0049] Specifically, the doorbell may be pre-set to store a unique identification code of the user terminal, and when a call operation is received, the object to which the call instruction is sent is determined based on the unique identification code. The doorbell may also be pre-set to establish a wireless connection such as a Bluetooth connection with the user terminal, and when a call operation is received, the object to which the call instruction is sent is determined based on the wireless connection, without limitation here.

[0050] Second, after the doorbell receives a call operation such as pressing a doorbell button, it starts playing and collecting audio data to obtain an original audio data stream.

[0051] Specifically, when the doorbell receives a call operation, it triggers the start of audio and / or video acquisition. The establishment of the audio data transmission channel with the user terminal can be that a wireless connection is pre-established, and when a call operation is received, the wireless connection is directly used as the audio data transmission channel; or, after receiving a call operation, a request is triggered to send to the user terminal to request the establishment of an audio data transmission channel.

[0052] Of course, the methods of starting the doorbell to play and collecting audio data to obtain the original audio data stream are not limited to the above two methods, which will not be described here.

[0053] Step S102, storing the original audio data stream as playback data, and performing echo elimination processing on the original audio data stream to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is the data stream after eliminating the echo audio data.

[0054] There are many ways to store the original audio data stream as playback data, and three of them are listed below as examples:

[0055] The first method is to directly store the original audio data stream in the storage unit of the doorbell as playback data. When the user needs to play back the audio or video, he or she can directly operate on the doorbell to play it back, or export the playback data from the interface of the doorbell to a playback device for playback.

[0056] The second method is to send the original audio data stream to the server corresponding to the doorbell to store it as playback data. That is, the doorbell APP is installed on the user terminal, and the server corresponding to the doorbell is set in the background of the APP. The doorbell sends the audio data stream to the server to store it as playback data. When the user needs to play back, he can log in to the APP on the user terminal and access the server to view it.

[0057] The third method is to send the original audio data stream to the user terminal to store it as playback data, that is, to send the original audio data stream to the user terminal and store it locally in the user terminal. When the playback needs to be viewed, the user can directly view it on the user terminal.

[0058] Of course, the specific storage methods are not limited to the above three methods, and are not limited here and are not listed one by one.

[0059] It should be noted that any existing echo cancellation technology may be used to cancel the echo of the original audio data stream, and no limitation is made here.

[0060] Step S103: sending the call audio data stream to the user terminal based on the audio data transmission channel.

[0061] The call audio data stream can be sent to the user terminal through a Bluetooth communication module, a WIFI communication module, an LTE communication module, a Z-wave communication module or a ZigBee communication module, etc., and there is no limitation here.

[0062] Specifically, while the doorbell is collecting the audio data of the visitor, it is also playing the audio data of the owner collected and sent by the user terminal. In order to prevent the audio data of the owner played by the doorbell from being collected and sent to the user terminal by the doorbell, resulting in an echo in the audio heard by the owner, the present application performs echo cancellation processing on the collected original audio data before sending it to the user terminal to increase the clarity of the call. Furthermore, the doorbell is also provided with the function of storing data and replaying audio. In order to prevent the replayed audio from only containing the speech of the visitor at the doorbell end but not the speech of the owner at the user terminal, the audio data of the owner collected by the user device and sent to the doorbell for playback is collected and stored, that is, the original audio data stream without echo cancellation processing, so that the playback data includes the audio data at both ends of the doorbell and the user terminal, ensuring the integrity of the playback data.

[0063] As an optional embodiment, a doorbell can be configured to receive an opening instruction sent by a user terminal, and control the opening of the smart door corresponding to the doorbell based on the opening instruction. In a specific implementation, the opening instruction can be an instruction sent by a user clicking a door opening button on the user terminal, or an instruction sent by a user voice, which is not limited here. For example, the doorbell can receive audio data sent by the user terminal, and when the audio data includes target audio data that matches the preset door opening audio, the target audio data is used as the opening instruction.

[0064] For example, when the owner says "open the door" to the user terminal, the user terminal collects audio data and sends it to the doorbell. After receiving the audio data, the doorbell recognizes that there is an "open the door" audio, and then controls the door to open. The target audio data can be stored in advance by the user or by the default of the doorbell. Of course, the user terminal can also directly recognize the collected audio data. When it recognizes that the target audio data matches the preset door opening audio, it generates an opening instruction and sends the opening instruction to the doorbell.

[0065] Based on the same inventive concept, an embodiment of the present invention further provides an audio processing device, wherein the device is a doorbell, such as Figure 2 Shown include:

[0066] A starting module 201 is used to start the doorbell to play and collect audio data to obtain the original audio data stream, and to establish an audio data transmission channel with a pre-bound user terminal;

[0067] The processing module 202 is used to store the original audio data stream as playback data, and perform echo elimination processing on the original audio data stream to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after eliminating the echo audio data;

[0068] The sending module 203 is used to send the call audio data stream to the user terminal based on the audio data transmission channel.

[0069] Optionally, the processing module 202 is also used to: store the original audio data stream in the storage unit of the doorbell as playback data, or send the original audio data stream to the server corresponding to the doorbell for storage as playback data, or send the original audio data stream to the user terminal for storage as playback data.

[0070] Optionally, the startup module 201 is also used to: after receiving a call operation, generate a call instruction based on the call operation, and send the call instruction to a user terminal pre-bound to the doorbell; after receiving a response signal returned by the user terminal, start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with the user terminal.

[0071] Optionally, the sending module 203 includes: a Bluetooth communication module, a WIFI communication module, a LTE communication module, a Z-wave communication module or a ZigBee communication module.

[0072] Optionally, the device also includes: an opening module, which is used to receive an opening instruction sent by the user terminal, and control the opening of the smart door corresponding to the doorbell based on the opening instruction.

[0073] Optionally, the opening module is further used to: receive audio data sent by the user terminal, and when the audio data includes target audio data matching a preset door opening audio, use the target audio data as the opening instruction.

[0074] Since the device introduced in this application is a device used to implement the audio processing method of this application, based on the method introduced, the person skilled in the art can understand the specific structure and deformation of the device, so it is not repeated here. All devices used in the audio processing method of this application belong to the scope of protection of the present invention.

[0075] Based on the same inventive concept, the present application also provides a smart doorbell, such as Figure 3 As shown, it includes a memory 310, a processor 320, and a computer program 311 stored in the memory 310 and executable on the processor 320. When the processor 320 executes the computer program 311, the following steps are implemented:

[0076] Start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with the pre-bound user terminal;

[0077] The original audio data stream is stored as playback data, and the original audio data stream is subjected to echo elimination processing to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after the echo audio data is eliminated;

[0078] Based on the audio data transmission channel, the call audio data stream is sent to the user terminal.

[0079] In the embodiment of the present application, when the processor 420 executes the computer program 411, any implementation method in the first embodiment of the present application can be implemented.

[0080] The following is an optional doorbell structure: the doorbell includes a doorbell body and a doorbell base station; the doorbell body is arranged outside the door, the doorbell base station is arranged indoors, the doorbell body and the doorbell base station are communicatively connected, and the doorbell base station is communicatively connected to a user terminal.

[0081] See Figure 4 , the smart doorbell of this embodiment includes a doorbell body 1 and a doorbell base station 2. In an application scenario of the present invention, the doorbell body 1 is arranged outside the door. Specifically, the doorbell body is installed at a preset position outside the door. Specifically, it can be installed on the door body, on the door frame, or on the wall next to the door. In the specific implementation process, the installation position of the doorbell body can be set according to actual needs, and this application does not limit it. The doorbell body mainly includes: a data collector 11, such as a "call" button, a camera, etc. The doorbell base station 2 is arranged indoors, and it can be arranged at any position indoors, such as a living room wall, a TV wall, etc. Of course, the doorbell base station 2 can also be arranged on the same door as the doorbell body 1.

[0082] The doorbell body 1 is connected to the doorbell base station 2 in communication, and the doorbell base station 2 is connected to the network side terminal in communication. Preferably, the doorbell body 1 and the doorbell base station 2 can be physically separated, and the two do not have to be arranged in one place. Of course, the doorbell body 1 and the doorbell base station 2 can also have a physical connection relationship, and they can be installed separately or in combination according to actual conditions.

[0083] When a visitor triggers the "call" button of the doorbell body 1, the doorbell body 1 can be connected to the doorbell base station 2 through communication, so that the doorbell base station 2 outputs a prompt sound, thereby reminding the user in the room that someone is visiting.

[0084] Furthermore, the doorbell body 1 and the doorbell base station 2 both include a power supply device for supplying power, which includes a lithium battery, a common battery, and the like.

[0085] The power supply device of the doorbell body 1 is connected to each component of the doorbell body 1 to supply power to the doorbell body 1. The power supply device of the doorbell base station 2 is connected to the second processor and other components of the doorbell base station 2 to supply power to the doorbell base station 2.

[0086] Combine the following Figure 4 and Figure 5 The doorbell body 1 and the doorbell base station 2 are introduced respectively.

[0087] The doorbell body 1 includes: a data collector 11, a first processor 12, a first low-power communication module 13, and a first wireless communication module 14; the data collector 11, the first low-power communication module 13, and the first wireless communication module 14 are connected to the first processor 12 respectively;

[0088] The doorbell base station 2 includes: a second processor 21, a second low-power communication module 22, and a second wireless communication module 23, wherein the second low-power communication module 22 and the second wireless communication module 23 are respectively connected to the second processor 21; the second low-power communication module 22 is communicatively connected to the first low-power communication module 13, and the second wireless communication module 23 is respectively communicatively connected to the first wireless communication module 14 and the network side terminal.

[0089] The power consumption of the low power communication module in the embodiment of the present invention is controlled below 50mW.

[0090] In the absence of visitors, in order to achieve the purpose of low power consumption, the first low-power communication module 13 and the first wireless communication module 14 of the doorbell body 1 are in a dormant state. The doorbell body 1 and the doorbell base station 2 are kept alive through a low-power communication module. For example, the second low-power communication module 22 of the doorbell base station 2 sends a probe message (such as "Are you still there") to the first low-power communication module 13 regularly or randomly, and the first low-power communication module 13 feeds back a response message (such as "Are you there"), and the two communicate regularly or randomly to achieve liveness. Of course, the second wireless communication module 23 of the doorbell base station 2 is always in working state, waiting for the network side terminal communication connection at any time.

[0091] As an optional embodiment, the doorbell base station 2 can also receive a command from the network side terminal to wake up the doorbell body 1. In the specific implementation process, after the second wireless communication module 23 of the doorbell base station 2 receives the wake-up command from the network side terminal, it will transmit it to the second processor 21, and the second processor 21 will control the second low-power communication module 22 and the first low-power communication module 13 to communicate, and transmit the wake-up command to the first processor 12, and the first processor 12 will wake up the first wireless communication module 14 to transmit data.

[0092] As an optional embodiment, in the case of a visitor, when the visitor triggers the doorbell or the camera captures the visitor, the second processor 21 will also be triggered to wake up the first wireless communication module 14. In addition, the data collector 11 will collect the visitor data and transmit it to the first processor 12, and the first processor 12 will control the first wireless communication module 14 and the second wireless communication module 23 to communicate, and the visitor data will be transmitted to the second processor 21 by the second wireless communication module 23. The second processor 21 processes the visitor data and then controls the corresponding components to remind, which will be described in detail later. Of course, the second processor 21 can also transmit the visitor data to the network side terminal for processing through the second wireless communication module 23.

[0093] The data collector 11 includes: a camera and a doorbell button; the camera and the doorbell button are respectively connected to the first processor 12. When a visitor visits, the camera can collect the visitor's image data and transmit it to the first processor 12, and transmit the image data to the second processor 21 for processing by controlling the first wireless communication module 14 and the second wireless communication module 23 to communicate. In addition, if the visitor presses the doorbell, the doorbell button will transmit the doorbell data to the first processor 12, and transmit the image data to the second processor 21 for processing by controlling the first wireless communication module 14 and the second wireless communication module 23 to communicate.

[0094] As an optional embodiment, the first low-power communication module 13 and the second low-power communication module 22 are the same.

[0095] Further, the first low-power communication module 13 and the second low-power communication module 22 of this embodiment are of various types, for example, the first low-power communication module 13 includes: 433 communication module, Bluetooth communication module, ZigBee communication module, Z-wave communication module, NFC radio frequency communication module, etc. Similarly, the second low-power communication module 22 includes: 433 communication module, Bluetooth communication module, ZigBee communication module, Z-wave communication module, NFC radio frequency communication module, etc.

[0096] As an optional embodiment, the doorbell body 1 and the doorbell base station 2 can also realize voice intercom. Specifically, the first processor 12 is connected to the first voice broadcast component and the first sound collector; the second processor 21 is connected to the second voice broadcast component and the second sound collector.

[0097] Furthermore, the first voice broadcast component includes: a first speaker; the first sound collector includes: a first microphone. The first voice broadcast component includes: a second speaker; the first sound collector includes: a second microphone. Specifically, if a visitor rings the doorbell, the doorbell information received by the second processor 21 from the doorbell body 1 can be played through the second speaker, and then played through the second speaker. If the visitor hears it, the inquiry information (for example, who are you?) can be collected through the second microphone, and the inquiry information will be played to the visitor through the first speaker, and the visitor's answer will be collected using the first microphone, thereby realizing voice intercom.

[0098] As an optional embodiment, the smart doorbell is also provided with an anti-theft function. Specifically, the doorbell body 1 further includes: a doorbell anti-theft trigger component connected to the first processor 12; if the doorbell anti-theft trigger component detects a trigger operation, such as a visitor illegally prying the smart doorbell, or smashing the smart doorbell, etc., the doorbell anti-theft trigger component will be triggered to send abnormal data to the first processor 12, and then the first wireless communication module 14 will transmit it to the doorbell base station 2 for alarm.

[0099] On the doorbell base station 2 side, after the second processor 21 receives the abnormal data, during the alarm process, the second voice broadcast component can receive the alarm instruction sent by the second processor 21 and issue a voice alarm according to the alarm instruction.

[0100] Furthermore, the doorbell base station 2 also includes an alarm, which is connected to the second processor 21. The alarm includes a photoelectric alarm, an infrared alarm, etc., and can sound an alarm according to an alarm instruction.

[0101] Furthermore, after the data collector 11 transmits the collected data to the second processor 21 through the corresponding modules, if the second processor 21 analyzes the data, if the data is abnormal, it will also generate an alarm instruction to control the corresponding module to alarm. For example, if the doorbell button collects doorbell information for more than 10 minutes, the second processor 21 will make a judgment based on the 10-minute doorbell information. If the judgment is overtime, it means that the data is abnormal, and then generate a corresponding alarm instruction to control the corresponding module to alarm.

[0102] The above is the communication between the doorbell body 1 and the doorbell base station 2 in terms of data transmission, alarm, voice intercom, etc. Furthermore, the doorbell base station 2 and the network side terminal also have a communication connection relationship. For example, the network side terminal specifically includes: a mobile phone or a server. Various data of the doorbell base station 2 can be communicated with the corresponding APP in the mobile phone through the second wireless communication module 23, or communicated with the corresponding server.

[0103] Since the doorbell introduced in this application is a doorbell used to implement the audio processing method of this application, based on the introduced method, those skilled in the art can understand the specific structure and deformation of the doorbell, so it is not repeated here. All doorbells used in the audio processing method of this application belong to the scope of protection of the present invention.

[0104] Based on the same inventive concept, an embodiment of the present invention further discloses a smart door, which includes the doorbell described in one or more of the above embodiments.

[0105] Based on the same inventive concept, the embodiment of the present invention further discloses a computer-readable storage medium 600, such as Figure 6 As shown, a computer program 611 is stored thereon, characterized in that when the computer program 611 is executed by a processor, the following steps are implemented:

[0106] Start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with the pre-bound user terminal;

[0107] The original audio data stream is stored as playback data, and the original audio data stream is subjected to echo elimination processing to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after the echo audio data is eliminated;

[0108] Based on the audio data transmission channel, the call audio data stream is sent to the user terminal.

[0109] During the specific implementation process, when the computer program 611 is executed by the processor, any implementation method in Example 1 of the present application can be implemented.

[0110] The technical solution provided in the embodiments of the present application has at least the following technical effects or advantages:

[0111] The audio processing method, device, doorbell, door and medium provided in the embodiments of the present application, during a video call or voice call, the doorbell not only provides a call audio data stream after echo cancellation processing to meet the real-time clear call requirements, but also stores the original audio data stream that has not been processed for echo cancellation as playback data for subsequent playback by the user. This not only increases the playback function, but also because the echo cancellation is not performed on the callback data, the playback data collected only at the doorbell end can also include the audio data played by the doorbell collected by the user terminal. The dialogue integrity of the playback audio is guaranteed.

[0112] The algorithm and display provided herein are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the present invention is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the present invention described herein, and the description of the above specific languages ​​is for disclosing the best mode of the present invention.

[0113] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0114] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the intention that the claimed invention requires more features than those explicitly recited in each claim. More specifically, as reflected in the claims below, inventive aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present invention.

[0115] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0116] In addition, those skilled in the art will appreciate that, although some embodiments herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.

[0117] The various component embodiments of the present invention can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components in a gateway, proxy server, or system according to an embodiment of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0118] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claims. The word "one" or "an" preceding a component does not exclude the presence of a plurality of such components. The present invention may be implemented by means of hardware comprising a number of different components and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.

[0119] The present invention discloses, A1, an audio processing method, the method is applied to a doorbell, comprising:

[0120] Start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with the pre-bound user terminal;

[0121] The original audio data stream is stored as playback data, and the original audio data stream is subjected to echo elimination processing to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after the echo audio data is eliminated;

[0122] Based on the audio data transmission channel, the call audio data stream is sent to the user terminal.

[0123] A2. The method as described in A1, characterized in that storing the original audio data stream as playback data comprises:

[0124] The original audio data stream is stored in the storage unit of the doorbell as playback data, or the original audio data stream is sent to a server corresponding to the doorbell to be stored as playback data, or,

[0125] The original audio data stream is sent to the user terminal to be stored as playback data.

[0126] A3. The method as described in A1, characterized in that the step of starting the doorbell to play and collect audio data to obtain an original audio data stream, and establishing an audio data transmission channel with a pre-bound user terminal, comprises:

[0127] After receiving the call operation, generating a call instruction based on the call operation, and sending the call instruction to the user terminal pre-bound with the doorbell;

[0128] After receiving the response signal returned by the user terminal, the doorbell is started to play and collect audio data to obtain the original audio data stream, and an audio data transmission channel is established with the user terminal.

[0129] A4. The method as described in A1, characterized in that the sending of the call audio data stream to the user terminal comprises:

[0130] Based on the Bluetooth communication module, WIFI communication module, LTE communication module, Z-wave communication module or ZigBee communication module provided on the doorbell, the call audio data stream is sent to the user terminal.

[0131] A5. The method as described in A1, characterized in that it also includes:

[0132] Receive an opening instruction sent by the user terminal, and control the opening of the smart door corresponding to the doorbell based on the opening instruction.

[0133] A6. The method as described in A1, characterized in that the receiving of the opening instruction sent by the user terminal comprises:

[0134] The audio data sent by the user terminal is received, and when the audio data includes target audio data matching the preset door opening audio, the target audio data is used as the opening instruction.

[0135] B7. An audio processing device, the device being a doorbell, comprising:

[0136] A start module, used to start the doorbell to play and collect audio data to obtain the original audio data stream, and to establish an audio data transmission channel with a pre-bound user terminal;

[0137] a processing module, configured to store the original audio data stream as playback data, and perform echo cancellation processing on the original audio data stream to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell, and the call audio data stream is a data stream after the echo audio data is cancelled;

[0138] A sending module is used to send the call audio data stream to the user terminal based on the audio data transmission channel.

[0139] B8. The device as described in B7 is characterized in that the processing module is also used for:

[0140] The original audio data stream is stored in the storage unit of the doorbell as playback data, or the original audio data stream is sent to a server corresponding to the doorbell to be stored as playback data, or,

[0141] The original audio data stream is sent to the user terminal to be stored as playback data.

[0142] B9. The device as described in B7 is characterized in that the startup module is also used for:

[0143] After receiving the call operation, generating a call instruction based on the call operation, and sending the call instruction to the user terminal pre-bound with the doorbell;

[0144] After receiving the response signal returned by the user terminal, the doorbell is started to play and collect audio data to obtain the original audio data stream, and an audio data transmission channel is established with the user terminal.

[0145] B10. The device as described in B7, characterized in that the sending module includes:

[0146] Bluetooth communication module, WIFI communication module, LTE communication module, Z-wave communication module or ZigBee communication module.

[0147] B11. The device as described in B7, characterized in that it also includes:

[0148] The opening module is used to receive the opening instruction sent by the user terminal, and control the opening of the smart door corresponding to the doorbell based on the opening instruction.

[0149] B12. The device as described in B7 is characterized in that the opening module is also used for:

[0150] The audio data sent by the user terminal is received, and when the audio data includes target audio data matching the preset door opening audio, the target audio data is used as the opening instruction.

[0151] C13. A smart doorbell, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described in claims 1-6 when executing the program.

[0152] C14. The smart doorbell as described in C13 is characterized by comprising a doorbell body and a doorbell base station; the doorbell body is arranged outside the door, the doorbell base station is arranged indoors, the doorbell body and the doorbell base station are communicatively connected, and the doorbell base station and the user terminal are communicatively connected.

[0153] D15. A smart door, comprising the smart doorbell described in C13.

[0154] E16. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the methods described in A1-A6.

Claims

1. An audio processing method, characterized in that: The method is applied to a doorbell, comprising: Start the doorbell to play and collect audio data to obtain the original audio data stream, and establish an audio data transmission channel with the pre-bound user terminal; wherein the original audio data stream includes the owner's audio data played by the doorbell and the collected visitor's audio data; The original audio data stream is stored as playback data, and the original audio data stream is subjected to echo elimination processing to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell and the visitor audio data, and the call audio data stream is a data stream after the echo audio data is eliminated; Based on the audio data transmission channel, the call audio data stream is sent to the user terminal.

2. The method according to claim 1, characterized in that The storing of the original audio data stream as playback data comprises: storing the original audio data stream in a storage unit of the doorbell as playback data, or, Send the original audio data stream to the server corresponding to the doorbell to be stored as playback data, or, The original audio data stream is sent to the user terminal to be stored as playback data.

3. The method according to claim 1, characterized in that The step of starting the doorbell to play and collect audio data to obtain an original audio data stream, and establishing an audio data transmission channel with a pre-bound user terminal, includes: After receiving the call operation, generating a call instruction based on the call operation, and sending the call instruction to the user terminal pre-bound with the doorbell; After receiving the response signal returned by the user terminal, the doorbell is started to play and collect audio data to obtain the original audio data stream, and an audio data transmission channel is established with the user terminal.

4. The method according to claim 1, characterized in that The sending the call audio data stream to the user terminal includes: Based on the Bluetooth communication module, WIFI communication module, LTE communication module, Z-wave communication module or ZigBee communication module provided on the doorbell, the call audio data stream is sent to the user terminal.

5. The method according to claim 1, characterized in that Also includes: Receive an opening instruction sent by the user terminal, and control the opening of the smart door corresponding to the doorbell based on the opening instruction.

6. The method according to claim 1, characterized in that The receiving the opening instruction sent by the user terminal includes: The audio data sent by the user terminal is received, and when the audio data includes target audio data matching the preset door opening audio, the target audio data is used as the opening instruction.

7. An audio processing device, characterized in that: The device is a doorbell, comprising: A start module, used to start the doorbell to play and collect audio data to obtain an original audio data stream, and to establish an audio data transmission channel with a pre-bound user terminal; wherein the original audio data stream includes the owner's audio data played by the doorbell and the collected visitor's audio data; a processing module, configured to store the original audio data stream as playback data, and perform echo cancellation processing on the original audio data stream to generate a call audio data stream, wherein the playback data includes the collected echo audio data played by the doorbell and the visitor audio data, and the call audio data stream is a data stream after the echo audio data is cancelled; A sending module is used to send the call audio data stream to the user terminal based on the audio data transmission channel.

8. The device according to claim 7, characterized in that The processing module is also used for: storing the original audio data stream in a storage unit of the doorbell as playback data, or, Send the original audio data stream to the server corresponding to the doorbell to be stored as playback data, or, The original audio data stream is sent to the user terminal to be stored as playback data.

9. The device according to claim 7, characterized in that The startup module is also used for: After receiving the call operation, generating a call instruction based on the call operation, and sending the call instruction to the user terminal pre-bound with the doorbell; After receiving the response signal returned by the user terminal, the doorbell is started to play and collect audio data to obtain the original audio data stream, and an audio data transmission channel is established with the user terminal.

10. The device according to claim 7, characterized in that The sending module comprises: Bluetooth communication module, WIFI communication module, LTE communication module, Z-wave communication module or ZigBee communication module.

11. The device according to claim 7, characterized in that Also includes: The opening module is used to receive the opening instruction sent by the user terminal, and control the opening of the smart door corresponding to the doorbell based on the opening instruction.

12. The device according to claim 7, characterized in that The opening module is also used for: The audio data sent by the user terminal is received, and when the audio data includes target audio data matching the preset door opening audio, the target audio data is used as the opening instruction.

13. A smart doorbell, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements any method of claims 1-6 when executing the program.

14. The smart doorbell according to claim 13, characterized in that: It includes a doorbell body and a doorbell base station; the doorbell body is arranged outside the door, the doorbell base station is arranged indoors, the doorbell body is communicatively connected to the doorbell base station, and the doorbell base station is communicatively connected to a user terminal.

15. A smart door, characterized in that: Including the smart doorbell described in claim 13.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method described in any one of claims 1 to 6 is implemented.

Images