Video call method and system based on smart video door lock, and device and medium

Abstract

Disclosed in the present invention are a video call method and system based on a smart video door lock, and a device and a medium. The video call method comprises: initiating a first video call request to a video call platform by means of a user terminal, such that the video call platform determines a corresponding smart video door lock, and issues the first video call request to the smart video door lock by means of a smart-home connection control platform; when the smart video door lock is online, by means of the smart-home connection control platform and the video call platform, establishing a video call connection between the smart video door lock and the user terminal; and when the smart video door lock is offline, by means of the video call platform and the smart-home connection control platform, the user terminal issuing a wake-up instruction to the smart video door lock and polling the online status of the smart video door lock, so as to re-initiate the first video call request to the video call platform after the smart video door lock comes online. The present invention improves the efficiency of a video call based on a smart video door lock and the usage experience of a user, and can be widely applied to the technical field of video calls.

Description

Video call method, system, device and medium based on intelligent video door lock Technical Field

[0001] The present invention relates to the technical field of video calling, and in particular to a video calling method and system based on an intelligent video door lock, an electronic device, and a storage medium. Background Art

[0002] Traditional door locks use keys to open the door, which can be inconvenient when people forget their keys. Smart door locks offer ways to open the door using fingerprints, mobile clients, and other methods. Some related technologies also include video functions, enabling video intercoms to be initiated from the lock (receivers include but are not limited to mobile phones, smart speakers with screens, and other smart devices).

[0003] Currently, most smart video door locks (including video doorbells) on the market call users' mobile phones through APP push notifications to notify users of video calls. On the one hand, this method requires video streaming to be pushed through communication networks (including 4G, 5G, WIFI, etc.) and APP clients, which has the disadvantages of high bandwidth and large latency. On the other hand, users need to open a specific APP client before responding to video call requests from smart video door locks. The operation is cumbersome and time-consuming, affecting the efficiency of video calls in smart video door locks. In addition, some solutions use a built-in SIM phone card in the smart video door lock to implement video dialing. This method requires a communication module compatible with the SIM phone card inside the smart video door lock, which increases the hardware cost and space occupied by the smart video door lock, affecting the user experience. Summary of the Invention

[0004] The purpose of the present invention is to solve one of the technical problems existing in the prior art to at least a certain extent.

[0005] To this end, an object of an embodiment of the present invention is to provide a video calling method based on a smart video door lock, which improves the video calling efficiency of the smart video door lock and the user experience.

[0006] Another object of an embodiment of the present invention is to provide a video calling system based on a smart video door lock.

[0007] In order to achieve the above technical objectives, the technical solutions adopted by the embodiments of the present invention include:

[0008] In one aspect, an embodiment of the present invention provides a video call method based on a smart video door lock, comprising the following steps:

[0009] Initiating a first video call request to the video call platform through the user terminal, so that the video call platform determines a corresponding smart video door lock according to the first video call request, and sends the first video call request to the smart video door lock through the smart home connection control platform;

[0010] When the smart video door lock is online, responding to the first video call request through the smart video door lock, and establishing a video call connection between the smart video door lock and the user terminal through the smart home connection control platform and the video call platform;

[0011] When the smart video door lock is offline, a device offline status code is returned to the user terminal through the video call platform, so that the user terminal sends a wake-up command to the smart video door lock through the video call platform and the smart home connection control platform and polls the online status of the smart video door lock, and then re-initiates the first video call request to the video call platform after the smart video door lock comes online;

[0012] The first video call request includes the landline telephone number of the smart video door lock, and the smart video door lock includes a VoLTE call module, which is used to implement a video call between the smart video door lock and the user terminal through VoLTE technology.

[0013] Furthermore, in one embodiment of the present invention, the video calling method further includes the following steps:

[0014] Sending a call device query request to the smart home connection control platform through the smart video door lock, so that the smart home connection control platform determines the current video call device according to the preset device priority, and returns the first device identifier of the current video call device to the smart video door lock;

[0015] generating, by the smart video door lock, a second video call request according to the first device identifier, and initiating the second video call request to the video call platform, so that the video call platform determines the current video call device according to the second video call request, and then sends the second video call request to the current video call device;

[0016] Responding to the second video call request through the current video call device, and establishing a video call connection between the current video call device and the smart video door lock through the video call platform and the smart home connection control platform;

[0017] The current video call device includes at least one of a smart speaker, an application client and the user terminal.

[0018] Furthermore, in one embodiment of the present invention, the video calling method further includes the following steps:

[0019] Initiating a third video call request to the video call platform through the smart video door lock and the smart home connection control platform, so that the video call platform determines the user terminal bound to the smart video door lock according to the third video call request, and sends the third video call request to the user terminal;

[0020] Responding to the third video call request through the user terminal, and establishing a video call connection between the user terminal and the smart video door lock through the video call platform and the smart home connection control platform;

[0021] The third video call request includes the fixed telephone number of the smart video door lock, and the video call platform is used to query the user terminal bound to the smart video door lock according to the fixed telephone number.

[0022] Furthermore, in one embodiment of the present invention, the video calling method further includes the step of pre-binding the smart video door lock with the smart home connection control platform and the video calling platform, which specifically includes:

[0023] Initiating a video call binding request to the smart home connection control platform through the smart video door lock, so that the smart home connection control platform sends the video call binding request to the video call platform;

[0024] Responding to the video call binding request through the video call platform and generating the landline telephone number, and then sending the landline telephone number to the smart video door lock through the smart home connection control platform;

[0025] Storing the landline phone number through the smart video door lock, generating a video call registration request according to the landline phone number, and then sending the video call registration request to the video call platform through the smart home connection control platform;

[0026] The video call registration request is responded to through the video call platform, and a heartbeat connection between the video call platform and the smart video door lock is established through the smart home connection control platform.

[0027] Furthermore, in one embodiment of the present invention, the video calling method further includes the following steps:

[0028] When it is detected that the smart video door lock is in low power consumption mode, the heartbeat connection between the video call platform and the smart video door lock is disconnected, and a heartbeat connection between the smart home connection control platform and the smart video door lock is established.

[0029] Furthermore, in one embodiment of the present invention, the video calling method further includes a step of pre-binding the smart video door lock and the user terminal, which specifically includes:

[0030] Establishing a communication connection between the smart video door lock and the user terminal through the smart home connection control platform;

[0031] The landline telephone number is sent to the user terminal through the smart video door lock, so that the user terminal generates a device binding request according to the landline telephone number and the second device identifier of the user terminal, and then sends the device binding request to the video call platform;

[0032] The video call platform responds to the device binding request, generates a first mapping relationship between the fixed telephone number and the second device identifier according to the device binding request, stores the first mapping relationship, and then returns a binding success message to the user terminal.

[0033] Furthermore, in one embodiment of the present invention, the step of sending a wake-up command to the smart video door lock through the video call platform and the smart home connection control platform and polling the online status of the smart video door lock, and then re-initiating the first video call request to the video call platform after the smart video door lock comes online, specifically includes:

[0034] Generate the wake-up instruction through the video call platform, and send the wake-up instruction to the smart video door lock through the smart home connection control platform, so that the smart video door lock goes online;

[0035] Generate a video call registration request according to the landline phone number by the smart video door lock, and then send the video call registration request to the video call platform through the smart home connection control platform;

[0036] Responding to the video call registration request through the video call platform, and establishing a heartbeat connection between the video call platform and the smart video door lock through the smart home connection control platform;

[0037] Polling the online status of the smart video door lock through the smart home connection control platform, and returning the online status to the user terminal through the video call platform;

[0038] When it is determined that the smart video door lock is online, the first video call request is re-initiated to the video call platform through the user terminal.

[0039] On the other hand, an embodiment of the present invention provides a video calling system based on a smart video door lock, comprising:

[0040] a video call request sending module, configured to initiate a first video call request to a video call platform through a user terminal, so that the video call platform determines a corresponding smart video door lock according to the first video call request, and sends the first video call request to the smart video door lock through a smart home connection control platform;

[0041] a video call connection establishing module, configured to, when the smart video door lock is online, respond to the first video call request through the smart video door lock, and establish a video call connection between the smart video door lock and the user terminal through the smart home connection control platform and the video call platform;

[0042] The smart video door lock wake-up module is configured to return a device offline status code to the user terminal via the video call platform when the smart video door lock is offline, so that the user terminal sends a wake-up instruction to the smart video door lock via the video call platform and the smart home connection control platform and polls the online status of the smart video door lock, and then re-initiates the first video call request to the video call platform after the smart video door lock comes online;

[0043] The first video call request includes the landline telephone number of the smart video door lock, and the smart video door lock includes a VoLTE call module, which is used to implement a video call between the smart video door lock and the user terminal through VoLTE technology.

[0044] On the other hand, an embodiment of the present invention provides an electronic device, which includes a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for realizing connection and communication between the processor and the memory. When the program is executed by the processor, the video call method based on the smart video door lock as described above is realized.

[0045] On the other hand, an embodiment of the present invention also provides a storage medium, which is a computer-readable storage medium for computer-readable storage. The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the video call method based on the smart video door lock as described above.

[0046] The advantages and benefits of the present invention will be described in part in the following description and will become apparent from the following description or learned through practice of the present invention:

[0047] In an embodiment of the present invention, a user terminal initiates a first video call request to a video call platform, so that the video call platform determines the corresponding smart video door lock according to the first video call request, and sends the first video call request to the smart video door lock through the smart home connection control platform. If the smart video door lock is online, the smart video door lock responds to the first video call request, and establishes a video call connection between the smart video door lock and the user terminal through the smart home connection control platform and the video call platform. If the smart video door lock is offline, the video call platform returns a device offline status code to the user terminal, so that the user terminal sends a wake-up command to the smart video door lock through the video call platform and the smart home connection control platform and polls the online status of the smart video door lock, and then re-initiates the first video call request to the video call platform after the smart video door lock is online. The embodiment of the present invention integrates the video function into the smart video door lock, and realizes video calls between the smart video door lock and the user terminal based on the video call platform, the smart home connection control platform and the VoLTE technology, so that the user can directly initiate / respond to video calls with the smart video door lock through the user terminal, thereby improving the video call efficiency of the smart video door lock; there is no need to build a SIM phone card into the smart video door lock, which reduces the hardware cost and occupied space of the smart video door lock and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following introduction is made to the drawings required for use in the embodiments of the present invention. It should be understood that the drawings introduced below are only for the convenience of clearly describing some embodiments of the technical solutions of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without any creative work.

[0049] FIG1 is a flow chart of a video calling method based on a smart video door lock provided by an embodiment of the present invention;

[0050] FIG2 is another flow chart of a video calling method based on a smart video door lock provided by an embodiment of the present invention;

[0051] FIG3 is another flow chart of a video calling method based on a smart video door lock provided by an embodiment of the present invention;

[0052] FIG4 is a flow chart of pre-binding a smart video door lock with a smart home connection control platform and a video call platform according to an embodiment of the present invention;

[0053] FIG5 is another flow chart of pre-binding a smart video door lock with a smart home connection control platform and a video call platform according to an embodiment of the present invention;

[0054] FIG6 is a flow chart of pre-binding a smart video door lock and a user terminal according to an embodiment of the present invention;

[0055] FIG7 is a flow chart of step S103 provided in an embodiment of the present invention;

[0056] FIG8 is a schematic diagram of the interactive process of a video calling method based on a smart video door lock provided by an embodiment of the present invention;

[0057] FIG9 is a schematic structural diagram of a video calling system based on a smart video door lock according to an embodiment of the present invention;

[0058] FIG10 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0059] The embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and are not to be construed as limitations on the present application. It should be noted that, although the functional modules are divided in the system schematic and the logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in a different order than the module division in the system schematic or the order in the flow chart. For the step numbers in the following embodiments, they are only provided for the convenience of explanation, and no limitation is placed on the order between the steps. The execution order of each step in the embodiment can be adaptively adjusted according to the understanding of those skilled in the art.

[0060] In the description of the present invention, the meaning of "a plurality" is two or more. If there is a description of "first" or "second", it is only used to distinguish technical features and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features. In addition, unless otherwise defined, all technical and scientific terms used in this document have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used in this document are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0061] The video call method based on a smart video door lock provided in the embodiments of the present application can be applied to a terminal or a server, or can be software running on the terminal or server. In some embodiments, the terminal can be a smartphone, tablet computer, laptop computer, desktop computer, set-top box, etc.; the server can be configured as an independent physical server, or as a server cluster or distributed system consisting of multiple physical servers, or as a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms; the software can be an application that implements the video call method based on a smart video door lock, etc., but is not limited to the above forms.

[0062] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multi-processor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, and the like. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments in which tasks are performed by remote processing devices connected via a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

[0063] It should be noted that in each specific embodiment of the present application, when it comes to the need to perform relevant processing based on data related to the user's identity or characteristics, such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of such data will comply with the relevant laws, regulations, and standards of the relevant countries and regions. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.

[0064] FIG1 is a flowchart of a video call method based on a smart video door lock according to an embodiment of the present invention. Referring to FIG1 , an embodiment of the present invention provides a video call method based on a smart video door lock, specifically comprising the following steps:

[0065] S101. Initiate a first video call request to a video call platform through a user terminal, so that the video call platform determines a corresponding smart video door lock based on the first video call request, and sends the first video call request to the smart video door lock through a smart home connection control platform;

[0066] S102: When the smart video door lock is online, responding to the first video call request through the smart video door lock, and establishing a video call connection between the smart video door lock and the user terminal through the smart home connection control platform and the video call platform;

[0067] S103: When the smart video door lock is offline, a device offline status code is returned to the user terminal via the video call platform, so that the user terminal sends a wake-up command to the smart video door lock via the video call platform and the smart home connection control platform and polls the online status of the smart video door lock. Then, after the smart video door lock comes online, the user terminal re-initiates a first video call request to the video call platform;

[0068] The first video call request includes the fixed telephone number of the smart video door lock, and the smart video door lock includes a VoLTE call module, which is used to implement a video call between the smart video door lock and the user terminal through VoLTE technology.

[0069] Specifically, the present invention is based on a smart video door lock, a smart home connectivity control platform (such as an IoT platform), a video calling platform (such as the Yijia Smart Talk platform), and a user terminal (such as a smartphone). A software module (SDK) is embedded in the existing chip module of the smart door lock to make and receive VoLTE voice and video calls.

[0070] It can be understood that Figure 1 shows the process of actively initiating a video call from the user terminal to the smart video door lock. When the smart video door lock is online, a video call connection is established between the smart video door lock and the user terminal directly through the smart home connection control platform and the video call platform, so that the video stream can be transmitted; when the smart video door lock is not online, it cannot respond to the video call request of the user terminal. It is necessary to wake up the smart video door lock through the video call platform and the smart home connection control platform, and then re-initiate the video call request through the user terminal.

[0071] The embodiments of this invention utilize unique VoLTE video calling technology, resulting in a short connection time (waiting time after dialing a call) (normally, a VoLTE call takes 0.5-2 seconds, compared to 5-8 seconds for a regular phone call). VoLTE also offers clearer video calls, and VoLTE video calling can be implemented with custom software embedded in the smart door lock's chip, eliminating the need for new hardware or SIM cards.

[0072] FIG2 is another flow chart of a video calling method based on a smart video door lock according to an embodiment of the present invention. Referring to FIG2 , as an optional embodiment, the video calling method further includes the following steps:

[0073] S201: Sending a call device query request to the smart home connection control platform through the smart video door lock, so that the smart home connection control platform determines the current video call device according to a preset device priority and returns a first device identifier of the current video call device to the smart video door lock;

[0074] S202: Generate, by the smart video door lock, a second video call request based on the first device identifier, and initiate the second video call request to the video call platform, so that the video call platform determines the current video call device based on the second video call request, and then sends the second video call request to the current video call device;

[0075] S203: Respond to the second video call request through the current video call device, and establish a video call connection between the current video call device and the smart video door lock through the video call platform and the smart home connection control platform;

[0076] Among them, the current video call device includes at least one of a smart speaker, an application client and a user terminal.

[0077] Specifically, Figure 2 shows the process of a smart video door lock actively initiating a video call to video call devices such as smart speakers, application clients, and user terminals. First, the smart video door lock's internal software SDK queries the current default video call device through the smart home connection control platform. The smart home connection control platform can return the device identifier of the current video call device (which can be a smart speaker ID, the user terminal's mobile phone number, the APP client's username, etc.) based on the set priority. The smart video door lock then connects to the video call platform to make a video call, and the video call platform and the current video call device work together to make a video call. In some optional embodiments, if the current video call device does not answer the call, the video call device with the second highest priority can be redialed.

[0078] FIG3 is another flow chart of a video calling method based on a smart video door lock according to an embodiment of the present invention. Referring to FIG3 , as an optional embodiment, the video calling method further includes the following steps:

[0079] S301, initiating a third video call request to the video call platform through the smart video door lock and the smart home connection control platform, so that the video call platform determines the user terminal bound to the smart video door lock based on the third video call request, and sends the third video call request to the user terminal;

[0080] S302: Respond to the third video call request through the user terminal, and establish a video call connection between the user terminal and the smart video door lock through the video call platform and the smart home connection control platform;

[0081] The third video call request includes the fixed telephone number of the smart video door lock, and the video call platform is used to query the user terminal bound to the smart video door lock according to the fixed telephone number.

[0082] Specifically, Figure 2 shows the process of the smart video door lock actively initiating a video call to a bound user terminal. The landline phone number of the smart video door lock has been pre-bound to the homeowner's user terminal (such as a smart phone). When the homeowner is out, he can directly switch the call mode of the smart video door lock so that the video call request initiated by the smart video door lock is only sent to the homeowner's user terminal, and no longer sent to other video call devices such as smart speakers. In this way, when a visitor makes a video call on the smart video door lock, the video call platform will look up the corresponding mobile phone number of the bound user terminal based on the landline phone number of the smart video door lock, thereby establishing a video call connection between the user terminal and the smart video door lock.

[0083] FIG4 is a flowchart of pre-binding a smart video door lock with a smart home connection control platform and a video call platform according to an embodiment of the present invention. Referring to FIG4 , as an optional embodiment, the video call method further includes the step of pre-binding the smart video door lock with the smart home connection control platform and the video call platform, which specifically includes:

[0084] S401: Initiate a video call binding request to the smart home connection control platform through the smart video door lock, so that the smart home connection control platform sends the video call binding request to the video call platform;

[0085] S402: Respond to the video call binding request through the video call platform and generate a landline phone number, which is then sent to the smart video door lock through the smart home connection control platform;

[0086] S403: The smart video door lock stores the fixed-line phone number, generates a video call registration request based on the fixed-line phone number, and then sends the video call registration request to the video call platform through the smart home connection control platform;

[0087] S404: Respond to the video call registration request through the video call platform, and establish a heartbeat connection between the video call platform and the smart video door lock through the smart home connection control platform.

[0088] Specifically, the embodiment of the present invention pre-establishes a binding relationship between the smart video door lock, the smart home connection control platform, and the video call platform. The video call platform will assign a fixed telephone number to the smart video door lock. In this way, when the smart video door lock initiates a video call, the user can determine through the caller ID whether the video call is initiated by the smart video door lock he owns, so that he can respond to the video call in time, avoiding the risk that the user's mobile phone may automatically determine it as a harassing call or be rejected by the user due to the caller ID showing a random Internet call.

[0089] In some optional embodiments, the embodiments of the present invention bind a fixed telephone number to each smart video door lock, but adopt a number pool multiplexing method, that is, for each user, his or her smart video door lock is a call from a fixed number, and the user can store it in the address book for easy answering, but for the operator, the number can be reused by multiple users, thereby saving number resources.

[0090] FIG5 is another flowchart of pre-binding a smart video door lock with a smart home connection control platform and a video calling platform according to an embodiment of the present invention. Referring to FIG5 , as an optional embodiment, the video calling method further includes the following steps:

[0091] S405: When it is detected that the smart video door lock is in low power consumption mode, the heartbeat connection between the video call platform and the smart video door lock is disconnected, and a heartbeat connection between the smart home connection control platform and the smart video door lock is established.

[0092] Specifically, when the smart video door lock is low on power, it will automatically switch to low power mode. In low power mode, the smart video door lock will disconnect the heartbeat connection with the video call platform and only maintain the heartbeat connection between the smart home connection control platform and the smart video door lock to reduce the power consumption of the smart video door lock.

[0093] FIG6 is a flowchart of pre-binding a smart video door lock and a user terminal according to an embodiment of the present invention. Referring to FIG6 , as an optional embodiment, the video call method further includes the step of pre-binding the smart video door lock and the user terminal, which specifically includes:

[0094] S601: Establishing a communication connection between the smart video door lock and the user terminal through the smart home connection control platform;

[0095] S602: Sending the landline phone number to the user terminal through the smart video door lock, so that the user terminal generates a device binding request according to the landline phone number and the second device identifier of the user terminal, and then sends the device binding request to the video call platform;

[0096] S603: Respond to the device binding request through the video call platform, generate a first mapping relationship between the fixed telephone number and the second device identifier according to the device binding request, store the first mapping relationship, and then return a binding success message to the user terminal.

[0097] Specifically, the user can pre-match and connect the user terminal with the smart video door lock through the smart home connection control platform in the home scene, and then generate a device binding request based on the fixed telephone number of the smart video door lock and the device identification of the user terminal, and generate a first mapping relationship through the video call platform and store it. In this way, when the smart video door lock initiates a video call request subsequently, the corresponding bound user terminal can be quickly found, thereby improving the response speed of the video call and further improving the video call efficiency of the smart video door lock.

[0098] FIG7 is a flowchart of step S103 according to an embodiment of the present invention. Referring to FIG7 , as an optional implementation, a wake-up command is sent to the smart video door lock through the video call platform and the smart home connection control platform, and the online status of the smart video door lock is polled. After the smart video door lock comes online, a first video call request is re-initiated to the video call platform. This step specifically includes:

[0099] S1031. Generate a wake-up command through the video call platform, and send the wake-up command to the smart video door lock through the smart home connection control platform, so that the smart video door lock goes online;

[0100] S1032: Generate a video call registration request according to the fixed phone number through the smart video door lock, and then send the video call registration request to the video call platform through the smart home connection control platform;

[0101] S1033. Respond to the video call registration request through the video call platform, and establish a heartbeat connection between the video call platform and the smart video door lock through the smart home connection control platform;

[0102] S1034. Polling the online status of the smart video door lock through the smart home connection control platform, and returning the online status to the user terminal through the video call platform;

[0103] S1035: When it is determined that the smart video door lock is online, re-initiate a first video call request to the video call platform through the user terminal.

[0104] Specifically, as shown in Figure 8, there is a schematic diagram of the interactive process of the video call method based on the smart video door lock provided by an embodiment of the present invention. It can be recognized that although the embodiment of the present invention pre-binds the smart video door lock with the smart home connection control platform and the video call platform, when the smart video door lock is not online, its heartbeat connection with the video call platform is disconnected. Therefore, the embodiment of the present invention needs to re-register for the video call after waking up the smart video door lock, so as to establish a heartbeat connection between the video call platform and the smart video door lock. At the same time, the online status of the smart video door lock is polled through the smart home connection control platform. When it is determined that the smart video door lock is online and the heartbeat connection has been established, a video call request is re-initiated to the video call platform through the user terminal.

[0105] The above describes the method steps of the embodiment of the present invention. It is understandable that the embodiment of the present invention integrates the video function into the smart video door lock, and implements video calls between the smart video door lock and the user terminal based on the video call platform, the smart home connection control platform, and VoLTE technology. This allows users to directly initiate / respond to video calls with the smart video door lock through the user terminal, thereby improving the video call efficiency of the smart video door lock. It also eliminates the need for a built-in SIM card in the smart video door lock, reducing the hardware cost and space occupied by the smart video door lock and improving the user experience.

[0106] Compared with the prior art, the embodiments of the present invention also have the following advantages:

[0107] 1) The embodiment of the present invention integrates a software-based video call SDK into the smart video door lock, eliminating the need for a built-in SIM card. This saves hardware costs and space inside the door lock. Customization or additional hardware implantation is not required, reducing manufacturers' production costs and optimizing the door lock structure. The freed-up space can be used to increase battery life and enhance the user experience.

[0108] 2) The smart video door lock is bound to a fixed telephone number (a fixed telephone number or mobile phone number specified by the user) through the video connection platform. For the user, when the caller ID is displayed, he can see at a glance that the call is from the door lock and can respond to the call in time; avoiding the risk that the user's mobile phone may automatically identify the random Internet call as a harassing call or reject the call due to the random Internet call ID.

[0109] 3) The video call SDK will directly connect to the operator platform and access the operator's call network, using the unique VoLTE video call technology to shorten the connection time. At the same time, the characteristic of VoLTE is that the video call video is clearer, making video calls faster and clearer than existing technologies.

[0110] 4) The embodiment of the present invention divides the platform into a smart home connection control platform and a video call platform, wherein the video call platform is specifically used for real-time video connection and video cloud storage capabilities, and the smart home connection control platform can simultaneously connect to other smart devices and store scene automation instructions; the advantage of the separate platforms is that when the smart video door lock opens the door, other smart devices (such as turning on smart lights) can be controlled through the smart home connection control platform, thereby achieving smart scene automation (such as indoor lights and air conditioners automatically turning on when the user opens the door). At the same time, the smart home connection control platform also facilitates communication connection and data interaction between the user terminal and the smart video door lock.

[0111] FIG9 is a schematic diagram showing the structure of a video call system based on a smart video door lock according to an embodiment of the present invention. Referring to FIG9 , an embodiment of the present invention provides a video call system based on a smart video door lock, including:

[0112] A video call request sending module, configured to initiate a first video call request to the video call platform through a user terminal, so that the video call platform determines a corresponding smart video door lock based on the first video call request, and sends the first video call request to the smart video door lock through the smart home connection control platform;

[0113] A video call connection establishment module is used to respond to the first video call request through the smart video door lock when the smart video door lock is online, and establish a video call connection between the smart video door lock and the user terminal through the smart home connection control platform and the video call platform;

[0114] The smart video door lock wake-up module is used to return a device offline status code to the user terminal through the video call platform when the smart video door lock is offline. The user terminal then sends a wake-up command to the smart video door lock through the video call platform and the smart home connection control platform and polls the online status of the smart video door lock. Then, the user terminal re-initiates the first video call request to the video call platform after the smart video door lock comes online.

[0115] The first video call request includes the fixed telephone number of the smart video door lock, and the smart video door lock includes a VoLTE call module, which is used to implement a video call between the smart video door lock and the user terminal through VoLTE technology.

[0116] The contents of the above method embodiments are all applicable to the present system embodiments. The functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0117] An embodiment of the present invention further provides an electronic device comprising: a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for enabling communication between the processor and the memory. When the program is executed by the processor, the above-described video call method based on a smart video door lock is implemented. The electronic device can be any smart terminal, including a tablet computer and an in-vehicle computer.

[0118] FIG10 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention. Referring to FIG10 , an embodiment of the present invention provides an electronic device, including:

[0119] The processor 1001 may be implemented as a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is configured to execute relevant programs to implement the technical solutions provided by the embodiments of the present invention.

[0120] The memory 1002 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 1002 can store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program codes are stored in the memory 1002 and are called by the processor 1001 to execute the video call method based on the smart video door lock according to the embodiment of the present invention.

[0121] Input / output interface 1003, used to implement information input and output;

[0122] Communication interface 1004, used to implement communication interaction between this device and other devices, which can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WiFi, Bluetooth, etc.);

[0123] Bus 1005 , which transmits information between various components of the device (e.g., processor 1001 , memory 1002 , input / output interface 1003 , and communication interface 1004 );

[0124] The processor 1001 , the memory 1002 , the input / output interface 1003 and the communication interface 1004 are connected to each other in communication within the device via the bus 1005 .

[0125] An embodiment of the present invention also provides a storage medium, which is a computer-readable storage medium used for computer-readable storage. The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the above-mentioned video call method based on the smart video door lock.

[0126] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0127] Embodiments of the present invention further disclose a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device can read the computer instructions from the computer-readable storage medium and execute the computer instructions, causing the computer device to perform the method shown in FIG1 .

[0128] In some optional embodiments, the function / operation mentioned in the block diagram may not occur in the order mentioned in the operation diagram. For example, depending on the function / operation involved, the two boxes shown in succession can actually be executed substantially simultaneously or the above-mentioned boxes can sometimes be executed in reverse order. In addition, the embodiment presented and described in the flow chart of the present invention is provided in an exemplary manner for the purpose of providing a more comprehensive understanding of the technology. The disclosed method is not limited to the operation and logic flow presented herein. Optional embodiments are contemplated in which the order of the various operations is changed and the sub-operations described as a part of a larger operation are performed independently.

[0129] In addition, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise stated, one or more of the above-mentioned functions and / or features can be integrated into a single physical device and / or software module, or one or more functions and / or features can be implemented in separate physical devices or software modules. It is also understood that a detailed discussion of the actual implementation of each module is not necessary for understanding the present invention. More specifically, given the properties, functions, and internal relationships of the various functional modules in the devices disclosed herein, the actual implementation of the module will be understood within the routine skills of an engineer. Therefore, a person skilled in the art can implement the present invention set forth in the claims using ordinary skills without undue experimentation. It is also understood that the specific concepts disclosed are merely illustrative and are not intended to limit the scope of the present invention, which is determined by the full scope of the appended claims and their equivalents.

[0130] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the above methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program code.

[0131] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0132] More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic devices), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disc read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable media on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, deciphering, or processing in another suitable manner as necessary, and then stored in a computer memory.

[0133] It should be understood that various parts of the present invention can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0134] In the above description of this specification, reference to the terms "one embodiment / example," "another embodiment / example," or "certain embodiments / examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0135] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to the embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the claims and their equivalents.

[0136] The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the above embodiments. Those skilled in the art can make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are all included in the scope defined by the claims of this application.

Claims

1. A video call method based on an intelligent video door lock, characterized in that: The following steps are involved: Initiate a first video call request to the video call platform through the user terminal, so that the video call platform determines the corresponding smart video door lock according to the first video call request, and sends the first video call request to the smart video door lock through the smart home connection control platform; When the smart video door lock is online, responding to the first video call request through the smart video door lock, and establishing a video call connection between the smart video door lock and the user terminal through the smart home connection control platform and the video call platform; When the smart video door lock is offline, a device offline status code is returned to the user terminal through the video call platform, so that the user terminal sends a wake-up instruction to the smart video door lock through the video call platform and the smart home connection control platform and polls the online status of the smart video door lock, and then re-initiates the first video call request to the video call platform after the smart video door lock is online; The first video call request includes the fixed telephone number of the smart video door lock, and the smart video door lock includes a VoLTE call module, which is used to implement a video call between the smart video door lock and the user terminal through the VoLTE technology.

2. A video call method based on a smart video door lock according to claim 1, characterized in that: The video calling method further comprises the following steps: Sending a call device query request to the smart home connection control platform through the smart video door lock, so that the smart home connection control platform determines the current video call device according to the preset device priority, and returns the first device identifier of the current video call device to the smart video door lock; Generate a second video call request according to the first device identifier by the smart video door lock, and initiate the second video call request to the video call platform, so that the video call platform determines the current video call device according to the second video call request, and then sends the second video call request to the current video call device; Responding to the second video call request through the current video call device, and establishing a video call connection between the current video call device and the smart video door lock through the video call platform and the smart home connection control platform; Among them, the current video call device includes at least one of a smart speaker, an application client and the user terminal.

3. The video calling method based on the smart video door lock according to claim 1, characterized in that: The video calling method further comprises the following steps: Initiate a third video call request to the video call platform through the smart video door lock and the smart home connection control platform, so that the video call platform determines the user terminal bound to the smart video door lock according to the third video call request, and sends the third video call request to the user terminal; Responding to the third video call request through the user terminal, and establishing a video call connection between the user terminal and the smart video door lock through the video call platform and the smart home connection control platform; The third video call request includes the fixed telephone number of the smart video door lock, and the video call platform is used to query the user terminal bound to the smart video door lock according to the fixed telephone number.

4. A video calling method based on an intelligent video door lock according to any one of claims 1 to 3, characterized in that: The video calling method further includes the step of pre-binding the smart video door lock with the smart home connection control platform and the video calling platform, which specifically includes: Initiating a video call binding request to the smart home connection control platform through the smart video door lock, so that the smart home connection control platform sends the video call binding request to the video call platform; Responding to the video call binding request through the video call platform and generating the fixed telephone number, and then sending the fixed telephone number to the smart video door lock through the smart home connection control platform; The fixed telephone number is stored by the smart video door lock, and a video call registration request is generated according to the fixed telephone number, and then the video call registration request is sent to the video call platform through the smart home connection control platform; The video call registration request is responded to through the video call platform, and a heartbeat connection between the video call platform and the smart video door lock is established through the smart home connection control platform.

5. A video call method based on an intelligent video door lock according to claim 4, characterized in that: The video calling method further comprises the following steps: When it is detected that the smart video door lock is in low power consumption mode, the heartbeat connection between the video call platform and the smart video door lock is disconnected, and a heartbeat connection between the smart home connection control platform and the smart video door lock is established.

6. The video calling method based on the smart video door lock according to claim 3 is characterized in that: The video call method further includes a step of pre-binding the smart video door lock and the user terminal, which specifically includes: Establishing a communication connection between the smart video door lock and the user terminal through the smart home connection control platform; The fixed telephone number is sent to the user terminal through the smart video door lock, so that the user terminal generates a device binding request according to the fixed telephone number and the second device identifier of the user terminal, and then sends the device binding request to the video call platform; The video call platform responds to the device binding request, generates a first mapping relationship between the fixed telephone number and the second device identifier according to the device binding request and stores the first mapping relationship, and then returns a binding success message to the user terminal.

7. The video calling method based on the smart video door lock according to claim 1, characterized in that: The step of sending a wake-up instruction to the smart video door lock through the video call platform and the smart home connection control platform and polling the online status of the smart video door lock, and then re-initiating the first video call request to the video call platform after the smart video door lock goes online, specifically includes: Generate the wake-up instruction through the video call platform, and send the wake-up instruction to the smart video door lock through the smart home connection control platform, so that the smart video door lock goes online; Generate a video call registration request according to the fixed telephone number by the smart video door lock, and then send the video call registration request to the video call platform through the smart home connection control platform; Respond to the video call registration request through the video call platform, and establish a heartbeat connection between the video call platform and the smart video door lock through the smart home connection control platform; Polling the online status of the smart video door lock through the smart home connection control platform, and returning the online status to the user terminal through the video call platform; When it is determined that the smart video door lock is online, the first video call request is re-initiated to the video call platform through the user terminal.

8. A video call system based on an intelligent video door lock, characterized in that: include: A video call request sending module, configured to initiate a first video call request to a video call platform through a user terminal, so that the video call platform determines a corresponding smart video door lock according to the first video call request, and sends the first video call request to the smart video door lock through a smart home connection control platform; A video call connection establishing module, configured to respond to the first video call request through the smart video door lock when the smart video door lock is online, and establish a video call connection between the smart video door lock and the user terminal through the smart home connection control platform and the video call platform; The smart video door lock wake-up module is used to return a device offline status code to the user terminal through the video call platform when the smart video door lock is offline, so that the user terminal sends a wake-up instruction to the smart video door lock through the video call platform and the smart home connection control platform and polls the online status of the smart video door lock, and then re-initiates the first video call request to the video call platform after the smart video door lock is online; The first video call request includes the fixed telephone number of the smart video door lock, and the smart video door lock includes a VoLTE call module, which is used to implement a video call between the smart video door lock and the user terminal through the VoLTE technology.

9. An electronic device, characterized in that: The electronic device includes a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for realizing connection and communication between the processor and the memory. When the program is executed by the processor, the steps of the video call method based on the smart video door lock as described in any one of claims 1 to 7 are realized.

10. A storage medium, the storage medium being a computer-readable storage medium, used for computer-readable storage, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the video calling method based on the smart video door lock as described in any one of claims 1 to 7.

Images