Method for realizing interaction between visual doorbell and VoLTE video, storage medium, equipment and computer program product

Abstract

The invention discloses a method for realizing interaction between a visual doorbell and a VoLTE video, a storage medium, equipment and a computer program product, and the method comprises the steps: a visual doorbell server calls a relay gateway interface to initiate a video call request, initiates a VoLTE video call for a mobile phone user at an IMS network end, and carries out the identity verification; after the identity verification is passed, the relay gateway pulls a stream from the visual doorbell server, fuses the stream with the VoLTE video stream, and finally establishes a video call between the mobile phone and the visual doorbell terminal; the visual doorbell terminal presses down a door opening key, the visual doorbell server side pushes a door opening instruction request to the relay gateway, the relay gateway pushes a navigation video to the mobile phone user, the mobile phone user presses down the key, and if the key is correct, the visual doorbell service terminal performs remote door opening. According to the invention, VoLTE video call and remote control between the visual doorbell and an operator are realized.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method, storage medium, device and computer program product for realizing interaction between a video doorbell and VoLTE video. Background Art

[0002] With the advent of the Internet era, terminal devices of various hardware manufacturers will connect their devices to the Internet to achieve remote control and improve the intelligence of the devices. At the same time, related industries will also equip terminals with voice and video assistance capabilities to improve the user-friendliness of their own products. The control of voice and video assistance capabilities requires users to install APP applications. For video doorbells, users must open the APP and be in an active state to experience the high-quality experience brought by audio and video collaborative services. However, the most difficult problem currently encountered is that most of the time users will not actively activate the APP, and message reminders do not arrive in real time, resulting in the unavailability of audio and video assistance services.

[0003] With the evolution of communication technology, VoLTE services have entered the commercial era. Phones can carry voice and video transmission at the same time. You can consider triggering phone interaction through doorbell terminals to achieve real-time message reminders. In this case, if you can get through the multimedia communication between the doorbell terminal and the VoLTE video and realize interactive control, you can solve the problem that users do not need to install or open the APP, and can experience visual intelligent services through mobile phone VoLTE video calls. Summary of the invention

[0004] In view of the deficiencies in the prior art, the present invention provides a method, storage medium, device and computer program product for realizing video interaction between a video doorbell and VoLTE. On the basis of not changing the video doorbell terminal, the present invention integrates a video gateway to realize video calls and remote control between the video doorbell and the operator's VoLTE, and solves the problem of the interaction usage scenario between the existing video doorbell system and the video doorbell terminal when the mobile phone APP is not enabled.

[0005] To achieve the above object, the present invention adopts the following technical solution: a method for realizing video doorbell and VoLTE video interaction, specifically comprising the following steps:

[0006] Step S1: The video doorbell server calls the relay gateway interface to initiate a video call request, and initiates a VoLTE video call to the mobile phone user on the IMS network.

[0007] Step S2: The mobile phone receives a VoLTE video call. If the call is answered, identity verification is performed; otherwise, the mobile phone hangs up, and the video doorbell server broadcasts a prompt message to the video doorbell terminal;

[0008] Step S3: After the identity authentication is passed, the relay gateway pulls the stream from the video doorbell server, merges it with the VoLTE video stream, and finally establishes a video call between the mobile phone and the video doorbell terminal;

[0009] Step S4, the video doorbell terminal presses the door opening button, the video doorbell service end pushes the door opening command request to the relay gateway, the relay gateway pushes the navigation video to the mobile phone user, the mobile phone user presses the button, if the button is correct, the video doorbell service terminal remotely opens the door.

[0010] Furthermore, step S1 includes the following sub-steps:

[0011] Step S1.1, the video doorbell server calls the relay gateway interface to initiate a video call request, and sends the relay access authentication identification information of the video doorbell server to the relay gateway;

[0012] Step S1.2, the relay gateway parses the video call request and authenticates the relay of the video doorbell server;

[0013] Step S1.3: After authentication is passed, a VoLTE video call is initiated to the mobile phone user on the IMS network end for the mobile phone number to be contacted.

[0014] Furthermore, the video call request in step S1.1 includes: request instruction information, a mobile phone number to be contacted, and an address of the media push-pull stream where the doorbell is located.

[0015] Furthermore, the specific process of identity authentication in step S2 is as follows:

[0016] i. Convert the RTP video stream of the VoLTE video into an RTSP video stream and push it to the video stream receiving address of the face recognition engine of the video doorbell server;

[0017] ii. The face recognition engine captures face information from the real-time RTSP video stream for identity verification.

[0018] Furthermore, step S3 includes the following sub-steps:

[0019] Step S3.1: The relay gateway pulls the RTSP video stream from the media push-pull stream address of the doorbell provided by the video doorbell server, converts it into an RTP video stream and transmits it to the mobile phone user;

[0020] Step S3.2: convert the mobile phone user's RTP video stream into an RTSP video stream and transmit it to the video doorbell server;

[0021] Step S3.3: The video doorbell server pushes the RTSP video stream to the video doorbell terminal, and finally establishes a video call between the mobile phone and the video doorbell terminal.

[0022] Furthermore, step S4 includes the following sub-steps:

[0023] Step S4.1: The video doorbell terminal presses the door opening button and pushes the door opening command request to the video doorbell server;

[0024] Step S4.2: After receiving the door opening command request, the video doorbell server encapsulates the door opening command request parameters and calls the relay gateway interface;

[0025] Step S4.3: After receiving the door opening command request, the relay gateway pushes the navigation video to the user's mobile phone according to the type of the door opening command request, prompts the mobile phone to input a key, and starts the DTMF key receiving process;

[0026] Step S4.4, the mobile phone terminal inputs key information according to the prompt of the navigation video;

[0027] Step S4.5: The relay gateway converts the DTMF keys of the IMS network Inband type into the DTMF keys of the RFC2833 type and transmits them to the video doorbell server;

[0028] Step S4.6: If the DTMF key is correct, the video doorbell server sends a door opening command to the video doorbell terminal to realize remote door opening; otherwise, repeat steps S4.1-S4.5.

[0029] Furthermore, the present invention also provides a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the method for realizing the interaction between a video doorbell and a VoLTE video.

[0030] Furthermore, the present invention also provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for realizing the interaction between the video doorbell and the VoLTE video is implemented.

[0031] Furthermore, the present invention also provides a computer program product, including a computer program, which, when executed by a processor, implements the method for realizing the interaction between a video doorbell and a VoLTE video.

[0032] Compared with the prior art, the present invention has the following beneficial effects:

[0033] (1) The method for realizing video interaction between a video doorbell and VoLTE of the present invention pulls the stream from the video doorbell server through a relay gateway, merges it with the VoLTE video stream, and finally establishes a video call between the mobile phone and the video doorbell terminal. The video stream fusion is realized through the relay gateway, and the problem of video stream protocol conversion and adaptation is solved. The doorbell system does not need to change the communication architecture and communication protocol of the doorbell terminal and the server, and can complete the video communication with the mobile phone by simple adaptation.

[0034] (2) The method of the present invention for realizing the interaction between the video doorbell and the VoLTE video is to initiate a video call request by invoking the relay gateway interface through the video doorbell server, and initiate a VoLTE video call to the mobile phone user on the IMS network side, so that the mobile phone user can receive the call request and establish the video call in real time, completely solving the problem of APP installation and the problem of untimely message reception. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 The overall architecture diagram of the method for realizing the interaction between the video doorbell and VoLTE video in the present invention;

[0036] Figure 2 The present invention is a flow chart of a method for realizing video doorbell and VoLTE video interaction. DETAILED DESCRIPTION

[0037] The technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings.

[0038] like Figure 1 The overall architecture diagram of the method for realizing the video doorbell and VoLTE video interaction of the present invention includes three levels of communication control:

[0039] 1. Video doorbell application layer: the video doorbell terminal, video doorbell APP and video doorbell server communicate by establishing an Internet connection. The video doorbell terminal is generally installed in a fixed place with a relatively stable network. The video doorbell APP must be installed on a mobile phone, but the mobile phone network is relatively unstable. If you need to receive messages pushed by the doorbell server in real time, you must be in an activated state at the same time, otherwise you will not be able to receive real-time messages.

[0040] 2. The intercommunication control layer includes: connecting the video doorbell server and the IMS network through the relay gateway. When the video doorbell server detects that the video doorbell APP control terminal is not activated, it sends a command to the relay gateway through the interface to initiate a VoLTE call to the mobile phone user on the IMS network.

[0041] 3. Communication bearer level, including: initiating VoLTE video calls to user's mobile phone in fixed-line outbound call mode according to the call request of the relay gateway, realizing intercommunication between the IMS network and the mobile phone; the user's mobile phone is used to send and receive VoLTE videos and DTMF buttons. The most commonly used scenarios in video doorbells are audio and video communications, key-based instructions, etc., which are similar to the call capability scenarios provided by the operator's IMS network. The relay gateway itself realizes the functions of making audio and video calls and collecting DTMF buttons. It only needs simple adaptation to add a more practical way of use for the video doorbell.

[0042] like Figure 2 The present invention is a flow chart of a method for realizing video doorbell and VoLTE video interaction, which specifically includes the following steps:

[0043] Step S1: If the existing video doorbell is to receive messages in real time, the doorbell APP must be installed and must be in an active state to establish a video call, which limits the application of the video doorbell; the present invention initiates a video call request by calling the relay gateway interface through the video doorbell server, initiates a VoLTE video call to the mobile phone user on the IMS network, and enables the mobile phone user to receive the call request and establish a video call in real time through the mobile phone VoLTE communication, which completely solves the problem of doorbell APP installation and the problem of untimely message reception; the present invention includes the following sub-steps:

[0044] Step S1.1, the video doorbell server calls the relay gateway interface to initiate a video call request, including: request instruction information, the mobile phone number to be contacted, and the address of the media push-pull stream where the doorbell is located; the relay access authentication identification information of the video doorbell server is sent to the relay gateway;

[0045] Step S1.2, the relay gateway parses the video call request and authenticates the relay of the video doorbell server;

[0046] Step S1.3: After authentication is passed, a VoLTE video call is initiated to the mobile phone user on the IMS network end for the mobile phone number to be contacted.

[0047] Step S2: The mobile phone receives a VoLTE video call. If the call is answered, identity verification is performed; otherwise, the mobile phone hangs up, and the video doorbell server broadcasts a prompt message to the video doorbell terminal.

[0048] The specific process of identity authentication in the present invention is as follows:

[0049] i. Convert the RTP video stream of the VoLTE video into an RTSP video stream and push it to the video stream receiving address of the face recognition engine of the video doorbell server;

[0050] ii. The face recognition engine captures face information from the real-time RTSP video stream for identity verification.

[0051] Step S3: After the identity authentication is passed, the relay gateway pulls the stream from the video doorbell server and merges it with the VoLTE video stream, and finally establishes a video call between the mobile phone and the video doorbell terminal. The video stream fusion is realized through the relay gateway, and the video stream protocol conversion and adaptation problems are solved. The doorbell system does not need to change the communication architecture and communication protocol of the doorbell terminal and the server, and can complete the video communication with the mobile phone by simple adaptation; specifically, it includes the following sub-steps:

[0052] Step S3.1: The relay gateway pulls the RTSP video stream from the media push-pull stream address of the doorbell provided by the video doorbell server, converts it into an RTP video stream and transmits it to the mobile phone user;

[0053] Step S3.2: convert the mobile phone user's RTP video stream into an RTSP video stream and transmit it to the video doorbell server;

[0054] Step S3.3: The video doorbell server pushes the RTSP video stream to the video doorbell terminal, and finally establishes a video call between the mobile phone and the video doorbell terminal.

[0055] Step S4: The video doorbell terminal presses the door opening button, the video doorbell service end pushes the door opening command request to the relay gateway, the relay gateway pushes the navigation video to the mobile phone user, the mobile phone user presses the button, if the button is correct, the video doorbell service terminal remotely opens the door, thereby improving the security of remote door opening, which specifically includes the following sub-steps:

[0056] Step S4.1: The video doorbell terminal presses the door opening button and pushes the door opening command request to the video doorbell server;

[0057] Step S4.2: After receiving the door opening command request, the video doorbell server encapsulates the door opening command request parameters and calls the relay gateway interface;

[0058] Step S4.3: After receiving the door opening command request, the relay gateway pushes the navigation video to the user's mobile phone according to the type of the door opening command request, prompts the mobile phone to input a key, and starts the DTMF key receiving process;

[0059] Step S4.4, the mobile phone terminal inputs key information according to the prompt of the navigation video;

[0060] Step S4.5: The relay gateway converts the DTMF keys of the IMS network Inband type into the DTMF keys of the RFC2833 type and transmits them to the video doorbell server;

[0061] Step S4.6: If the DTMF key is correct, the video doorbell server sends a door opening command to the video doorbell terminal to realize remote door opening; otherwise, repeat steps S4.1-S4.5.

[0062] The method for realizing video interaction between a video doorbell and VoLTE does not change the video doorbell terminal, integrates a video gateway, realizes video calls and remote control between the video doorbell and the operator's VoLTE, and solves the problem of interactive use scenarios between the existing video doorbell system and the video doorbell terminal when the mobile phone APP is not enabled.

[0063] In a technical solution of the present invention, a computer-readable storage medium is also provided, storing a computer program, wherein the computer program enables a computer to execute the method for realizing the interaction between a video doorbell and VoLTE video.

[0064] In one technical solution of the present invention, an electronic device is also provided, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the method for realizing the interaction between the video doorbell and the VOLTE video is implemented.

[0065] In a technical solution of the present invention, a computer program product is also provided, including a computer program, and when the computer program is executed by a processor, the method for realizing the interaction between the video doorbell and the VoLTE video is implemented.

[0066] In the embodiments disclosed in the present application, the computer storage medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. The computer storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above. More specific examples of computer storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0067] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0068] The above are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should be regarded as the protection scope of the present invention.

Claims

1. A method for realizing video doorbell and VoLTE video interaction, characterized in that: The specific steps include: Step S1: The video doorbell server calls the relay gateway interface to initiate a video call request, and initiates a VoLTE video call to the mobile phone user on the IMS network. Step S2: The mobile phone receives a VoLTE video call. If the call is answered, identity verification is performed. Otherwise, the mobile phone hangs up, and the video doorbell server broadcasts the prompt information to the video doorbell terminal; Step S3: After the identity authentication is passed, the relay gateway pulls the stream from the video doorbell server, merges it with the VoLTE video stream, and finally establishes a video call between the mobile phone and the video doorbell terminal; Step S4, the video doorbell terminal presses the door opening button, the video doorbell service end pushes the door opening command request to the relay gateway, the relay gateway pushes the navigation video to the mobile phone user, the mobile phone user presses the button, if the button is correct, the video doorbell service terminal remotely opens the door.

2. The method for realizing video doorbell and VoLTE video interaction according to claim 1, characterized in that: Step S1 includes the following sub-steps: Step S1.1, the video doorbell server calls the relay gateway interface to initiate a video call request, and sends the relay access authentication identification information of the video doorbell server to the relay gateway; Step S1.2, the relay gateway parses the video call request and authenticates the relay of the video doorbell server; Step S1.3: After authentication is passed, a VoLTE video call is initiated to the mobile phone user on the IMS network end for the mobile phone number to be contacted.

3. The method for realizing video interaction between a video doorbell and VoLTE according to claim 2, characterized in that: The video call request in step S1.1 includes: request instruction information, the mobile phone number to be contacted, and the address of the media push-pull stream where the doorbell is located.

4. The method for realizing video doorbell and VoLTE video interaction according to claim 3, characterized in that: The specific process of identity authentication in step S2 is as follows: i. Convert the RTP video stream of the VoLTE video into an RTSP video stream and push it to the video stream receiving address of the face recognition engine of the video doorbell server; ii. The face recognition engine captures face information from the real-time RTSP video stream for identity verification.

5. The method for realizing video doorbell and VoLTE video interaction according to claim 4, characterized in that: Step S3 includes the following sub-steps: Step S3.1: The relay gateway pulls the RTSP video stream from the media push-pull stream address of the doorbell provided by the video doorbell server, converts it into an RTP video stream and transmits it to the mobile phone user; Step S3.2: convert the mobile phone user's RTP video stream into an RTSP video stream and transmit it to the video doorbell server; Step S3.3: The video doorbell server pushes the RTSP video stream to the video doorbell terminal, and finally establishes a video call between the mobile phone and the video doorbell terminal.

6. The method for realizing video doorbell and VoLTE video interaction according to claim 5, characterized in that: Step S4 includes the following sub-steps: Step S4.1: The video doorbell terminal presses the door opening button and pushes the door opening command request to the video doorbell server; Step S4.2: After receiving the door opening command request, the video doorbell server encapsulates the door opening command request parameters and calls the relay gateway interface; Step S4.3: After receiving the door opening command request, the relay gateway pushes the navigation video to the user's mobile phone according to the type of the door opening command request, prompts the mobile phone to input a key, and starts the DTMF key receiving process; Step S4.4, the mobile phone terminal inputs key information according to the prompt of the navigation video; Step S4.5: The relay gateway converts the DTMF keys of the IMS network Inband type into the DTMF keys of the RFC2833 type and transmits them to the video doorbell server; Step S4.6: If the DTMF key is correct, the video doorbell server sends a door opening command to the video doorbell terminal to realize remote door opening; otherwise, repeat steps S4.1-S4.

5.

7. A computer-readable storage medium storing a computer program, characterized in that: The computer program enables the computer to execute the method for realizing the interaction between the video doorbell and VoLTE video as described in any one of claims 1-6.

8. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for realizing the interaction between a video doorbell and VoLTE video as described in any one of claims 1 to 6 is realized.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for realizing the interaction between a video doorbell and VoLTE video as described in any one of claims 1 to 6 is implemented.

Images