A method, storage medium, device and computer program product for implementing a visual doorbell and VoLTE video interaction

Abstract

The application discloses a kind of method for realizing visual doorbell and VoLTE video interaction, storage medium, equipment and computer program product, including: visual doorbell server calls relay gateway interface to initiate video call request, initiates VoLTE video call to the mobile phone user of IMS network end, carries out identity verification;After identity verification, relay gateway pulls stream from visual doorbell server, and is fused with VoLTE video stream, and finally establishes the video call between mobile phone and visual doorbell terminal;Visual doorbell terminal presses open door button, and visual doorbell server pushes open door instruction request to relay gateway, and relay gateway pushes navigation video to mobile phone user, and mobile phone user presses button, if button is correct, visual doorbell service terminal carries out remote opening door.The application realizes visual doorbell and operator VoLTE video call and remote control.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and more specifically, to a method, storage medium, device, and computer program product for realizing video doorbell and VoLTE video interaction. Background Technology

[0002] With the advent of the internet age, various hardware manufacturers are connecting their devices to the internet for remote control, enhancing the intelligence of their devices. Simultaneously, related industries are equipping their devices with voice and video assistance capabilities to improve user experience. Controlling voice and video assistance requires users to install an app. For video doorbells, users must have the app open and active to experience the superior audio-visual collaboration service. However, the most challenging problem currently is that users rarely activate the app, resulting in delayed notifications and rendering the audio-visual assistance service unusable.

[0003] With the evolution of communication technology, VoLTE services have entered the commercial era. Telephones can simultaneously carry voice and video transmissions. It is possible to consider triggering telephone interactions through doorbell terminals to achieve real-time message reminders. In this case, if multimedia communication between the doorbell terminal and VoLTE video can be established and interactive control can be achieved, users can experience visualized smart services through mobile phone VoLTE video calls without installing or opening an app. Summary of the Invention

[0004] This invention addresses the shortcomings of existing technologies by providing a method, storage medium, device, and computer program product for realizing video doorbell and VoLTE video interaction. Without changing the video doorbell terminal, it integrates a video gateway to enable video doorbell to make VoLTE video calls and remote control with operators, solving the problem of interaction between existing video doorbell systems and the video doorbell terminal when the mobile APP is not enabled.

[0005] To achieve the above objectives, the present invention adopts the following technical solution: a method for realizing video doorbell and VoLTE video interaction, specifically including the following steps:

[0006] Step S1: The video doorbell server calls the relay gateway interface to initiate a video call request and initiates a VoLTE video call to the mobile phone user on the IMS network.

[0007] Step S2: When the mobile phone receives a VoLTE video call, if it answers, it will verify its identity; otherwise, the mobile phone will hang up and the video doorbell server will broadcast a prompt message to the video doorbell terminal.

[0008] Step S3: After successful authentication, the relay gateway pulls the stream from the video doorbell server and merges it with the VoLTE video stream to finally establish a video call between the mobile phone and the video doorbell terminal.

[0009] Step S4: When the video doorbell terminal presses the open button, the video doorbell server pushes an open command request to the relay gateway. The relay gateway pushes a navigation video to the mobile phone user. The mobile phone user presses the button. If the button is pressed correctly, the video doorbell server remotely opens the door.

[0010] Further, step S1 includes the following sub-steps:

[0011] Step S1.1: The video doorbell server calls the trunk gateway interface to initiate a video call request and sends the trunk access authentication information of the video doorbell server to the trunk gateway.

[0012] Step S1.2: The relay gateway parses the video call request and authenticates the relay of the video doorbell server.

[0013] Step S1.3: After authentication is successful, initiate a VoLTE video call to the mobile user on the IMS network for the mobile phone number that needs to be contacted.

[0014] Furthermore, the video call request in step S1.1 includes: request instruction information, the mobile phone number to be contacted, and the address of the media push-pull stream where the doorbell is located.

[0015] Furthermore, the specific process of identity verification in step S2 is as follows:

[0016] i. Convert the VoLTE video's RTP video stream into an RTSP video stream and push it to the video stream receiving address of the face recognition engine on the video doorbell server.

[0017] ii. The face recognition engine captures facial information from real-time RTSP video streams for identity verification.

[0018] Furthermore, step S3 includes the following sub-steps:

[0019] Step S3.1: The relay gateway pulls the RTSP video stream from the address of the push-pull media stream where the doorbell is located, provided by the video doorbell server, converts it into an RTP video stream, and sends it to the mobile phone user.

[0020] Step S3.2: Convert the RTP video stream of the mobile phone user into an RTSP video stream and send it to the video doorbell server;

[0021] Step S3.3: The video doorbell server pushes the RTSP video stream to the video doorbell terminal, thus establishing a video call between the mobile phone and the video doorbell terminal.

[0022] Furthermore, step S4 includes the following sub-steps:

[0023] Step S4.1: The video doorbell terminal presses the open button and pushes an open command request to the video doorbell server;

[0024] Step S4.2: After receiving the door opening command request, the video doorbell server encapsulates the door opening command request parameters and calls the relay gateway interface;

[0025] Step S4.3: After receiving the door opening command request, the relay gateway pushes a navigation video to the user's mobile phone according to the type of door opening command request, prompts the mobile phone to input keys, and starts the DTMF key reception process.

[0026] Step S4.4: On the mobile device, input the button information according to the prompts in the navigation video;

[0027] Step S4.5: The relay gateway converts the IMS network Inband type DTMF keypad into RFC2833 type DTMF keypad and transmits it to the video doorbell server.

[0028] Step S4.6: If the DTMF button is pressed correctly, the video doorbell server sends an opening command to the video doorbell terminal to enable remote door opening; otherwise, repeat steps S4.1-S4.5.

[0029] Furthermore, the present invention also provides a computer-readable storage medium storing a computer program that causes a computer to execute the method for implementing video doorbell and VoLTE video interaction.

[0030] Furthermore, the present invention also provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the method for realizing video doorbell and VoLTE video interaction.

[0031] Furthermore, the present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the method for realizing video doorbell and VoLTE video interaction.

[0032] Compared with the prior art, the present invention has the following beneficial effects:

[0033] (1) The method of realizing video doorbell and VoLTE video interaction in this invention pulls the video stream from the video doorbell server through the relay gateway and merges it with the VoLTE video stream to finally establish a video call between the mobile phone and the video doorbell terminal. The video stream fusion is realized through the relay gateway, which solves the problem of video stream protocol conversion and adaptation. The doorbell system does not need to change the communication architecture and communication protocol of the doorbell terminal and the server. It can easily adapt to complete the video communication with the mobile phone.

[0034] (2) The method of realizing video doorbell and VoLTE video interaction in this invention initiates a video call request by calling the relay gateway interface through the video doorbell server, and initiates a VoLTE video call to the mobile phone user on the IMS network, so that the mobile phone user can receive the call request and establish a video call in real time, thus completely solving the problems of APP installation and untimely message reception. Attached Figure Description

[0035] Figure 1 This is a diagram illustrating the overall architecture of the method for realizing video doorbell and VoLTE video interaction according to the present invention.

[0036] Figure 2 This is a flowchart illustrating the method for implementing video doorbell and VoLTE video interaction according to the present invention. Detailed Implementation

[0037] The technical solutions of the present invention will now be clearly and completely described in conjunction with the accompanying drawings.

[0038] like Figure 1 This is a diagram illustrating the overall architecture of the method for realizing video doorbell and VoLTE video interaction according to the present invention. The video doorbell and VoLTE video interaction includes three levels of communication control:

[0039] 1. The video doorbell application layer consists of a video doorbell terminal, a video doorbell APP, and a video doorbell server. The video doorbell terminal is usually installed in a fixed location with a relatively stable network. The video doorbell APP must be installed on a mobile phone, but the mobile network is relatively unstable. In addition, if you need to receive messages pushed by the doorbell server in real time, it must be in an active state at all times. Otherwise, you will not be able to receive real-time messages.

[0040] 2. Interoperability control layer includes: interconnection between the video doorbell server and the IMS network through a relay gateway. When the video doorbell server detects that the video doorbell APP control terminal is not activated, it sends a command to the relay gateway through the interface to initiate a VoLTE call to the mobile phone user on the IMS network.

[0041] 3. Communication bearer layer, including: initiating VoLTE video calls to user mobile phones via landline outbound calls based on call requests from the relay gateway, achieving interoperability between the IMS network and the mobile phone; the user's mobile phone is used to send and receive VoLTE video and DTMF key presses. The most common scenarios in video doorbells are audio and video communication and key press commands, which are similar to the call capabilities provided by the operator's IMS network. The relay gateway itself implements the functions of making audio and video calls and collecting DTMF key presses. With simple adaptation, it can add a more practical usage method to the video doorbell.

[0042] like Figure 2 This is a flowchart of the method for realizing video interaction between a video doorbell and VoLTE according to the present invention. The method specifically includes the following steps:

[0043] Step S1: Existing video doorbells require a doorbell app to be installed and constantly active to receive messages in real time, thus limiting their application. This invention initiates a video call request via the video doorbell server's call to the relay gateway interface, launching a VoLTE video call to the mobile user on the IMS network. Through VoLTE communication, the mobile user receives the call request and establishes a video call in real time, completely solving the problems of doorbell app installation and untimely message reception. This includes the following sub-steps:

[0044] Step S1.1: The video doorbell server calls the trunk gateway interface to initiate a video call request, including: request instruction information, the mobile phone number to be contacted, and the address of the media push-pull stream where the doorbell is located; the video doorbell server sends the trunk access authentication information to the trunk gateway.

[0045] Step S1.2: The relay gateway parses the video call request and authenticates the relay of the video doorbell server.

[0046] Step S1.3: After authentication is successful, initiate a VoLTE video call to the mobile user on the IMS network for the mobile phone number that needs to be contacted.

[0047] Step S2: When the mobile phone receives a VoLTE video call, if it answers, it will verify its identity; otherwise, the mobile phone will hang up, and the video doorbell server will broadcast a prompt message to the video doorbell terminal.

[0048] The specific process of identity verification in this invention is as follows:

[0049] i. Convert the VoLTE video's RTP video stream into an RTSP video stream and push it to the video stream receiving address of the face recognition engine on the video doorbell server.

[0050] ii. The face recognition engine captures facial information from real-time RTSP video streams for identity verification.

[0051] Step S3: After successful authentication, the relay gateway pulls the video stream from the video doorbell server and merges it with the VoLTE video stream to establish a video call between the mobile phone and the video doorbell terminal. The relay gateway achieves video stream fusion, resolving video stream protocol conversion and adaptation issues. This allows the doorbell system to easily adapt and complete video communication with the mobile phone without changing the communication architecture and protocol of the doorbell terminal and server. Specifically, it includes the following sub-steps:

[0052] Step S3.1: The relay gateway pulls the RTSP video stream from the address of the push-pull media stream where the doorbell is located, provided by the video doorbell server, converts it into an RTP video stream, and sends it to the mobile phone user.

[0053] Step S3.2: Convert the RTP video stream of the mobile phone user into an RTSP video stream and send it to the video doorbell server;

[0054] Step S3.3: The video doorbell server pushes the RTSP video stream to the video doorbell terminal, thus establishing a video call between the mobile phone and the video doorbell terminal.

[0055] Step S4: When the video doorbell terminal presses the open button, the video doorbell server pushes an open command request to the relay gateway. The relay gateway then pushes a navigation video to the mobile phone user. The mobile phone user presses the button correctly, and if the button press is correct, the video doorbell server remotely opens the door, thereby improving the security of remote door opening. This includes the following sub-steps:

[0056] Step S4.1: The video doorbell terminal presses the open button and pushes an open command request to the video doorbell server;

[0057] Step S4.2: After receiving the door opening command request, the video doorbell server encapsulates the door opening command request parameters and calls the relay gateway interface;

[0058] Step S4.3: After receiving the door opening command request, the relay gateway pushes a navigation video to the user's mobile phone according to the type of door opening command request, prompts the mobile phone to input keys, and starts the DTMF key reception process.

[0059] Step S4.4: On the mobile device, input the button information according to the prompts in the navigation video;

[0060] Step S4.5: The relay gateway converts the IMS network Inband type DTMF keypad into RFC2833 type DTMF keypad and transmits it to the video doorbell server.

[0061] Step S4.6: If the DTMF button is pressed correctly, the video doorbell server sends an opening command to the video doorbell terminal to enable remote door opening; otherwise, repeat steps S4.1-S4.5.

[0062] The present invention provides a method for enabling video doorbells to interact with VoLTE without altering the video doorbell terminal. By integrating a video gateway, the method enables video doorbells to conduct VoLTE video calls and remote control with operators, thus solving the problem of interaction between existing video doorbell systems and the video doorbell terminal when the mobile app is not enabled.

[0063] In one embodiment of the present invention, a computer-readable storage medium is also provided, storing a computer program that enables a computer to execute the method for implementing video doorbell and VoLTE video interaction.

[0064] In one technical solution of the present invention, an electronic device is also provided, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the method for realizing video doorbell and VoLTE video interaction.

[0065] In one technical solution of the present invention, a computer program product is also provided, including a computer program, which, when executed by a processor, implements the method for realizing video doorbell and VoLTE video interaction.

[0066] In the embodiments disclosed in this application, a computer storage medium may be a tangible medium that may contain or store programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of computer storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0067] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0068] The above are merely preferred embodiments of the present invention. The scope of protection of the present invention is not limited to the above embodiments. All technical solutions falling within the scope of the present invention's concept are within the scope of protection of the present invention. It should be noted that for those skilled in the art, any improvements and modifications made without departing from the principles of the present invention should be considered within the scope of protection of the present invention.

Claims

1. A method for realizing video doorbell and VoLTE video interaction, characterized in that, Specifically, the steps include the following: Step S1: The video doorbell server initiates a video call request by calling the relay gateway interface to initiate a VoLTE video call to the mobile phone user on the IMS network; this includes the following sub-steps: Step S1.1: The video doorbell server calls the trunk gateway interface to initiate a video call request and sends the trunk access authentication information of the video doorbell server to the trunk gateway. Step S1.2: The relay gateway parses the video call request and authenticates the relay of the video doorbell server. Step S1.3: After authentication is successful, initiate a VoLTE video call to the mobile user on the IMS network for the mobile phone number that needs to be contacted. Step S2: When the mobile phone receives a VoLTE video call, if it answers, it will verify its identity; otherwise, the mobile phone will hang up and the video doorbell server will broadcast a prompt message to the video doorbell terminal. Step S3: After successful authentication, the relay gateway pulls the stream from the video doorbell server and merges it with the VoLTE video stream to finally establish a video call between the mobile phone and the video doorbell terminal. Step S4: The video doorbell terminal presses the open button. The video doorbell server pushes an open command request to the relay gateway. The relay gateway pushes a navigation video to the mobile phone user. The mobile phone user presses the button. If the button press is correct, the video doorbell server remotely opens the door. This includes the following sub-steps: Step S4.1: The video doorbell terminal presses the open button and pushes an open command request to the video doorbell server; Step S4.2: After receiving the door opening command request, the video doorbell server encapsulates the door opening command request parameters and calls the relay gateway interface; Step S4.3: After receiving the door opening command request, the relay gateway pushes a navigation video to the user's mobile phone according to the type of door opening command request, prompts the mobile phone to input keys, and starts the DTMF key reception process. Step S4.4: On the mobile device, input the button information according to the prompts in the navigation video; Step S4.5: The relay gateway converts the IMS network Inband type DTMF keypad into RFC2833 type DTMF keypad and transmits it to the video doorbell server. Step S4.6: If the DTMF button is pressed correctly, the video doorbell server sends an opening command to the video doorbell terminal to enable remote door opening; otherwise, repeat steps S4.1-S4.

5.

2. The method for realizing video doorbell and VoLTE video interaction according to claim 1, characterized in that, The video call request in step S1.1 includes: request instruction information, the mobile phone number to be contacted, and the address of the media push-pull stream where the doorbell is located.

3. The method for realizing video doorbell and VoLTE video interaction according to claim 2, characterized in that, The specific process of authentication in step S2 is as follows: i. Convert the VoLTE video's RTP video stream into an RTSP video stream and push it to the video stream receiving address of the face recognition engine on the video doorbell server. ii. The face recognition engine captures facial information from real-time RTSP video streams for identity verification.

4. The method for realizing video doorbell and VoLTE video interaction according to claim 3, characterized in that, Step S3 includes the following sub-steps: Step S3.1: The relay gateway pulls the RTSP video stream from the address of the push-pull media stream where the doorbell is located, provided by the video doorbell server, converts it into an RTP video stream, and sends it to the mobile phone user. Step S3.2: Convert the RTP video stream of the mobile phone user into an RTSP video stream and send it to the video doorbell server; Step S3.3: The video doorbell server pushes the RTSP video stream to the video doorbell terminal, thus establishing a video call between the mobile phone and the video doorbell terminal.

5. A computer-readable storage medium storing a computer program, characterized in that, The computer program causes the computer to execute the method for implementing video doorbell and VoLTE video interaction as described in any one of claims 1-4.

6. An electronic device, characterized in that, include: The memory, the processor, and the computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the method for implementing video doorbell and VoLTE video interaction as described in any one of claims 1-4.

7. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the method for realizing video doorbell and VoLTE video interaction as described in any one of claims 1-4.

Images