Communication hang-up method, intelligent cat-eye system and storage medium

Abstract

The embodiment of the present application discloses a communication hang-up method, a smart cat's eye system and a storage medium. The smart cat's eye system includes a smart cat's eye and a communication platform. After the smart cat's eye receives a call request from a target object, the smart cat's eye obtains video information of the target object and sends the video information to the communication platform; the communication platform determines whether to hang up based on the video information and a preset threshold; if it is determined to hang up, the communication platform sends a hang-up instruction to the smart cat's eye; the smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object, which has better flexibility and applicability in communication control.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a communication hang-up method, a smart cat eye system and a storage medium. Background Art

[0002] With the popularity of smart home devices, smart cat eyes have also integrated audio and video communication functions. They can initiate audio and video communications with other devices under the same account, such as smart speakers, set-top boxes, IP Multimedia Subsystem (IMS), mobile phones, etc., by opening an account through a mobile phone or binding a device.

[0003] In the prior art, a button is usually set in the smart cat's eye to initiate communication with the bound device, and the bound device performs a hang-up operation after the communication is completed. However, such a communication process often results in problems such as the visitor has left, but the smart cat's eye is still communicating with the bound device, or the user has received the visitor at the door, but the communication status between the smart cat's eye and other bound devices cannot be ended at the same time. It can be seen that in the prior art, the flexibility and applicability of the communication control of the smart cat's eye are poor. Summary of the invention

[0004] The embodiments of the present application provide a communication hang-up method, a smart cat-eye system and a storage medium, which have better flexibility and applicability in communication control.

[0005] The technical solution of the embodiment of the present application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a communication hang-up method, the method being applied to a smart cat eye system, the smart cat eye system comprising a smart cat eye and a communication platform, the method comprising:

[0007] After the smart cat's eye receives a call request from a target object, the smart cat's eye obtains video information of the target object and sends the video information to the communication platform;

[0008] The communication platform determines whether to hang up based on the video information and a preset threshold;

[0009] If it is determined to hang up, the communication platform sends a hang up instruction to the smart cat eye;

[0010] The smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object.

[0011] In a second aspect, an embodiment of the present application provides a smart cat's eye system, the smart cat's eye system comprising a smart cat's eye and a communication platform; the smart cat's eye comprises a sending unit and a responding unit, the communication platform comprises a judging unit,

[0012] The sending unit is used for, after the smart cat's eye receives a call request from the target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform;

[0013] The judging unit is used for the communication platform to judge whether to perform a hang-up process according to the video information and a preset threshold;

[0014] The response unit is used for the smart cat's eye to respond to the hang-up instruction and hang up the call request of the target object.

[0015] In a third aspect, an embodiment of the present application provides a smart cat's eye system, which also includes a processor and a memory storing instructions executable by the processor. When the instructions are executed by the processor, the communication hang-up method described above is implemented.

[0016] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium on which a program is stored, which is applied to a smart cat-eye system. When the program is executed by a processor, the communication hang-up method as described above is implemented.

[0017] The embodiment of the present application provides a communication hang-up method, a smart cat's eye system and a storage medium. The smart cat's eye system includes a smart cat's eye and a communication platform. After the smart cat's eye receives the call request of the target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform; the communication platform determines whether to hang up the call based on the video information and a preset threshold; if it is determined to hang up, the communication platform sends a hang-up instruction to the smart cat's eye; the smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object. It can be seen that the present application obtains the real-time video information of the visiting guest through the smart cat's eye, and uploads the video information to the communication platform. The communication platform judges and processes the video information by combining the judgment method of the preset threshold to determine whether to hang up. If it is determined that the hang-up is required, a hang-up instruction will be sent to the smart cat's eye, and then the smart cat's eye can respond to the hang-up instruction to hang up, thereby improving the flexibility and applicability of the communication control of the smart cat's eye. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 1 ;

[0019] Figure 2 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 1 ;

[0020] Figure 3 Schematic diagram of the implementation of the communication hang-up method proposed in the embodiment of the present application Figure 1 ;

[0021] Figure 4 Schematic diagram of the implementation of the communication hang-up method proposed in the embodiment of the present application Figure 2 ;

[0022] Figure 5 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 2 ;

[0023] Figure 6 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 3 ;

[0024] Figure 7 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 4 ;

[0025] Figure 8 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 5 ;

[0026] Fig. 9 Schematic diagram of the implementation of the communication hang-up method proposed in the embodiment of the present application Figure 3 ;

[0027] Fig.10 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 2 ;

[0028] Fig.11 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 3 ;

[0029] Fig.12 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 4 . DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. It is understood that the specific embodiments described herein are only used to explain the related applications, rather than to limit the applications. It should also be noted that, for ease of description, only the parts related to the related applications are shown in the drawings.

[0031] The communication of the smart cat eye is initiated by the smart cat eye when a visitor knocks on the door. However, most smart cat eyes are designed with only one control button to initiate communication with the bound home device. At this time, the calling side is the visitor at the door, and the called side is the bound home device. However, after initiating the communication, the user needs to go to the door to handle the visitor's matters, which may cause the user to be separated from the called side; at the same time, the smart cat eye can only initiate communication with the bound home device, and the rejection or hang up is executed by the called side, that is to say, the smart cat eye cannot actively execute the hang up operation, which will cause, for example, the visitor has left, but the smart cat eye is still communicating with the bound device, or the user has received the visitor at the door but cannot end the communication status between the smart cat eye and other bound devices at the same time.

[0032] In order to solve this problem, the present application proposes a communication hang-up method, a smart cat's eye system and a storage medium. The smart cat's eye system includes a smart cat's eye and a communication platform. After the smart cat's eye receives the call request of the target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform; the communication platform determines whether to hang up based on the video information and a preset threshold; if it is determined to hang up, the communication platform sends a hang-up instruction to the smart cat's eye; the smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object, thereby having better flexibility and applicability in communication control.

[0033] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0034] Embodiment 1

[0035] An embodiment of the present application provides a communication hang-up method, which is applied to a smart cat-eye system. Figure 1 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 1 ,like Figure 1 As shown, the smart cat's eye system 10 includes a smart cat's eye 11 and a communication platform 12 .

[0036] In an embodiment of the present application, the smart cat's eye can receive a call request from a target object, and then send the video information of the target object to a communication platform, and can respond to a hang-up instruction sent by the communication platform to perform a hang-up operation; the communication platform can process the video information after receiving the video information, and determine whether a hang-up process is required based on a preset threshold, generate a corresponding hang-up instruction, and then send the hang-up instruction to the smart cat's eye.

[0037] Figure 2 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 1 ,like Figure 2As shown, the communication hang-up method may include the following steps:

[0038] Step 101: After the smart cat's eye receives a call request from a target object, the smart cat's eye obtains video information of the target object and sends the video information to a communication platform.

[0039] In an embodiment of the present application, after the smart cat's eye receives a call request from the target object, the smart cat's eye obtains video information of the target object and sends the video information to the communication platform.

[0040] It should be noted that, in the embodiment of the present application, the target object is a visitor, that is, the object that initiates a call request on the smart cat's eye terminal.

[0041] It can be understood that in the embodiments of the present application, the smart cat's eye can be configured with a call button, and the smart cat's eye can detect the pressing operation of the target object through the call button, thereby receiving and processing the call request of the target object; further, the smart cat's eye can also be configured with a display screen, and the smart cat's eye can detect the touch operation of the target object through the display screen, thereby receiving and processing the call request of the target object.

[0042] Furthermore, in an embodiment of the present application, the video information is real-time video information about a target object acquired by a smart cat's eye from the perspective of the smart cat's eye.

[0043] It can be understood that in the embodiment of the present application, after the smart cat's eye receives the call request of the target object, in addition to sending the video information of the target object to the communication platform, a communication connection can be established with the bound device; Figure 3 Schematic diagram of the implementation of the communication hang-up method proposed in the embodiment of the present application Figure 1 ,like Figure 3 As shown, the smart cat's eye receives a call request from the target object, and then the smart cat's eye sends the video information of the target object to the communication platform. At the same time, the smart cat's eye establishes a communication connection with the bound device.

[0044] Exemplarily, in an embodiment of the present application, the bound device may be a speaker, a television, a mobile phone, or other device.

[0045] It should be noted that, in the embodiment of the present application, the smart cat's eye sends video information to the communication platform according to the preset identification information, that is, a communication platform can have multiple smart cat's eyes communicating with it. Figure 4 This is a schematic diagram of the implementation of the communication hang-up method proposed in the embodiment of the present application. Figure 2 ,like Figure 4As shown, a communication platform can have three smart cat's eyes communicating with it, including smart cat's eye A, smart cat's eye B and smart cat's eye C; the way to distinguish different smart cat's eyes is to distinguish them according to different preset identification information corresponding to different smart cat's eyes, that is, different smart cat's eyes have different preset identification information. When the smart cat's eyes send video information to the communication platform, the communication platform can distinguish which smart cat's eye sent the video information according to the preset identification information carried by the video information; exemplarily, the Session ID can be used as the preset identification information of the smart cat's eye, and then the smart cat's eye can send video information to the communication platform according to the Session ID, and the communication platform also sends a hang-up instruction to the smart cat's eye according to the Session ID.

[0046] Step 102: The communication platform determines whether to hang up the call based on the video information and a preset threshold.

[0047] In an embodiment of the present application, after the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform, the communication platform determines whether to hang up based on the video information and a preset threshold.

[0048] It should be noted that, in an embodiment of the present application, a preset threshold can be used to determine whether the target object is still waiting in front of the door, and the door may have been opened, and whether the target object is pushing the door open; specifically, the preset threshold may include a human shape offset threshold and a door opening action threshold; wherein the human shape offset threshold is used to determine whether the target object is still waiting in front of the door; and the door opening action threshold is used to determine whether the target object is in an open door state.

[0049] It can be understood that, in the embodiment of the present application, the hang-up process refers to the smart cat eye ending the call request and disconnecting the communication connection with the bound device.

[0050] Further, in an embodiment of the present application, it is the communication platform that determines whether to hang up the call, and the communication platform determines whether to hang up the call based on the video information and a preset threshold; specifically, after acquiring the video information, the communication platform extracts the incoming image of the target object from the video information according to the preset time threshold, and then pre-processes the incoming image to obtain the processed image, and then obtains the human shape offset and the second door opening action offset of the processed image; wherein the human shape offset refers to the offset of the human body shape of the target object; the second door opening action offset refers to the offset of the door opening action of the target object; the human shape offset and the second door opening action offset are respectively compared with the human shape offset threshold and the door opening action threshold in the preset threshold, so as to determine whether to hang up the call based on the comparison result.

[0051] Step 103: If it is determined to hang up, the communication platform sends a hang up instruction to the smart cat's eye.

[0052] In an embodiment of the present application, after the communication platform determines whether to hang up the call based on the video information and a preset threshold, if it is determined to hang up the call, the communication platform sends a hang up instruction to the smart cat's eye.

[0053] It can be understood that in the embodiment of the present application, the hang-up instruction is used to instruct the smart cat eye to end the call request and disconnect the communication connection with the bound device.

[0054] Furthermore, in an embodiment of the present application, after the communication platform determines that a hang-up process needs to be performed based on a preset threshold, it can send a hang-up instruction to the smart cat's eye, thereby instructing the smart cat's eye to perform a corresponding hang-up process.

[0055] It should be noted that in the embodiment of the present application, the communication platform sends a hang-up command to the smart cat's eye according to the preset identification information. That is to say, after receiving the video information carrying the preset identification information, the communication platform will send a hang-up command according to the preset identification information, thereby ensuring that the hang-up command is sent to the correct and corresponding smart cat's eye among the many smart cat's eyes communicating with the communication platform; thereby realizing communication between different smart cat's eyes and the communication platform through a specific channel, ensuring the accuracy of information transmission.

[0056] Step 104: The smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object.

[0057] In an embodiment of the present application, after the communication platform determines to perform a hang-up process and sends a hang-up instruction to the smart cat eye, the smart cat eye responds to the hang-up instruction and hangs up the call request of the target object.

[0058] It can be understood that in the embodiment of the present application, the smart cat eye hangs up the call request of the target object by responding to the hang-up instruction. That is to say, the smart cat eye can end the call request of the target object and disconnect the communication connection with the bound device by responding to the hang-up instruction.

[0059] It can be seen that after processing and judging the video information based on the communication platform, it can determine whether to instruct the smart cat's eye to hang up, thereby realizing the communication hang-up method of hanging up the operation on the smart cat's eye end, and improving the flexibility and applicability of the smart cat's eye communication control.

[0060] Figure 5 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 2 ,like Figure 5As shown, after the smart cat's eye receives the call request of the target object, the smart cat's eye obtains the video information of the target object, and before sending the video information to the communication platform, that is, before step 101, the following steps may also be included:

[0061] Step 105: Determine a plurality of human shape feature values ​​and a plurality of first door opening action offsets in different scenes based on a preset image data set.

[0062] In an embodiment of the present application, before the smart cat's eye obtains video information of the target object and sends the video information to the communication platform, the communication platform can determine multiple human feature values ​​and multiple first door opening action offsets in different scenes based on a preset image data set.

[0063] It should be noted that in the embodiments of the present application, the preset image data set is used to obtain multiple human shape feature values ​​and multiple first door opening action offsets in different scenarios, that is, the images in the preset image data set can show the postures or actions of people in front of the door in different scenarios, for example, the person can be in the center of the picture, that is, standing in front of the door waiting; or the person can be ready to leave and present a walking posture; or the person can be ready to push the door open and present a hand raising hand to push the door. Thus, multiple human shape feature values ​​and multiple first door opening action offsets in different scenarios can be obtained according to the preset image data set.

[0064] Furthermore, in an embodiment of the present application, the human shape feature value is a feature value that describes the integrity of the human body shape. For example, when the overall shape of the person is complete in the picture, the human shape feature value is A; and when only a partial shape of the person exists in the picture, the human shape feature value is B.

[0065] Furthermore, in an embodiment of the present application, the first door opening action offset is used to describe the offset of a person's posture action when opening the door. For example, when a person raises his hand to push the door, his first door opening action offset is C; and when the person does not make any door opening action, his first door opening action offset is D.

[0066] Step 106: Calculate a human shape offset threshold value according to the multiple human shape feature values, and calculate a door opening action threshold value according to the multiple first door opening action offsets.

[0067] In an embodiment of the present application, after the communication platform determines multiple human shape feature values ​​and multiple first door opening action offsets in different scenes based on a preset image data set, it can calculate the human shape offset threshold according to the multiple human shape feature values, and calculate the door opening action threshold according to the multiple first door opening action offsets.

[0068] It should be noted that, in the embodiment of the present application, the human figure deviation threshold is used to determine whether the target object is still waiting in front of the door; the door opening action threshold is used to determine whether the target object is in the door opening state.

[0069] It can be understood that in the embodiments of the present application, the human shape offset threshold is calculated based on these multiple human shape feature values. That is to say, since the human shape feature value can represent whether a person is complete in the picture, after obtaining multiple human shape feature values ​​in different scenes, the optimal empirical threshold can be calculated based on the multiple human shape feature values ​​to obtain the human shape offset threshold. Therefore, when the actual human shape offset is greater than or equal to this human shape offset threshold, it can be judged that the target object may have left or has left.

[0070] It can be understood that in the embodiments of the present application, the door opening action threshold is calculated based on multiple first door opening action offsets. That is to say, since the first door opening action offset can characterize the degree of offset of a person's posture movement when opening the door, after obtaining multiple first door opening action offsets in different scenarios, the optimal empirical threshold can be calculated based on the multiple first door opening action offsets to obtain the door opening action threshold. Therefore, when the actual door opening action offset is greater than or equal to the door opening action threshold, it can be judged that the target object may push the door to enter, or is pushing the door to enter.

[0071] Step 107: Determine a preset threshold value according to the human figure deviation threshold value and the door opening action threshold value.

[0072] In an embodiment of the present application, the communication platform calculates a human shape offset threshold based on multiple human shape feature values, and after calculating a door opening action threshold based on multiple first door opening action offsets, a preset threshold can be determined based on the human shape offset threshold and the door opening action threshold.

[0073] It can be understood that, in the embodiment of the present application, the preset thresholds include a human figure deviation threshold and a door opening action threshold, so that whether to perform the hang-up process is determined based on the preset thresholds.

[0074] Figure 6 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 3 ,like Figure 6 As shown, in an embodiment of the present application, the communication platform determines whether to perform hang-up processing according to the video information and a preset threshold, that is, step 102 may include the following steps:

[0075] Step 102a: extracting the incoming image of the target object from the video information at a preset time interval.

[0076] In an embodiment of the present application, the communication platform determines whether to perform a hang-up process based on the video information and a preset threshold. Specifically, the communication platform extracts the incoming image of the target object from the video information at a preset time interval.

[0077] It should be noted that, in the embodiment of the present application, after the communication platform obtains the video information, it is necessary to intercept the video stream of the video information and save it as an incoming image. Specifically, the interception timing is to intercept according to a preset time interval.

[0078] It can be understood that in the embodiments of the present application, since the visiting images are captured in the video information at preset time intervals, the visiting images can show the status of the target object in front of the door at different times.

[0079] Furthermore, in an embodiment of the present application, since the visiting image is extracted from the video information at a preset time interval, the visiting image may include multiple pictures, that is, the visiting image may include pictures extracted from the video information at different times.

[0080] Step 102b: pre-process the incoming image to obtain a processed image.

[0081] In an embodiment of the present application, after the communication platform extracts the incoming image of the target object from the video information at a preset time interval, it can pre-process the incoming image to obtain a processed image.

[0082] It should be noted that in the embodiments of the present application, preprocessing refers to grayscale processing and noise reduction processing; after the grayscale processing and noise reduction processing of the visiting image, the processed image obtained can facilitate the extraction of relevant feature information, namely, the human shape offset and the second door opening action offset.

[0083] Furthermore, in an embodiment of the present application, since the incoming image includes multiple pictures, after the incoming image is preprocessed, the processed image obtained also includes multiple pictures.

[0084] Step 102c: determine whether to perform hang-up processing according to the processed image and the preset threshold.

[0085] In an embodiment of the present application, the communication platform pre-processes the incoming image, and after obtaining the processed image, it can determine whether to perform hang-up processing based on the processed image and a preset threshold.

[0086] It can be understood that in the embodiment of the present application, whether to perform the hang-up processing is determined based on the processed image and the preset threshold, that is, whether to perform the hang-up processing is determined based on multiple pictures in the processed image and the preset threshold.

[0087] Figure 7 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 4 ,like Figure 7As shown, in the embodiment of the present application, the communication platform determines whether to perform hang-up processing according to the processed image and the preset threshold value, that is, step 102c may include the following steps:

[0088] Step 102c1, obtaining the human figure offset and the second door opening action offset of the processed image.

[0089] In an embodiment of the present application, the communication platform determines whether to perform hang-up processing based on the processed image and a preset threshold. Specifically, the communication platform first obtains the human shape offset and the second door opening action offset of the processed image.

[0090] It should be noted that, in the embodiments of the present application, the human shape offset refers to the offset of the human body shape of the target object in the processed image. For example, at 11:02, the human shape offset in the processed image is a, and at 11:02:30, the human shape offset is b; a and b may be the same or different; when a and b are the same, it means that the target object may not have moved at these two moments; when a and b are different, it means that the target object may have moved at these two moments, and the degree of offset of the human body shape presented in the picture is different.

[0091] It should be noted that, in the embodiments of the present application, the second door opening action offset refers to the offset of the door opening action of the target object obtained from the processed image. For example, at 11:02, the second door opening action offset in the processed image is c, and at 11:02:30, the second door opening action offset is d; similarly, c and d may be the same or different.

[0092] Step 102c2: If the human shape offset is greater than or equal to the human shape offset threshold; and / or the second door opening action offset is greater than or equal to the door opening action threshold, it is determined to perform a hang-up process.

[0093] In an embodiment of the present application, after the communication platform obtains the human shape offset and the second door opening action offset of the processed image, if the human shape offset is greater than or equal to the human shape offset threshold; and / or the second door opening action offset is greater than or equal to the door opening action threshold, it is determined to perform the hang-up process.

[0094] It should be noted that, in an embodiment of the present application, the human shape offset is compared with the human shape offset threshold, and the second door opening action offset is compared with the door opening action threshold. When any one of the offsets is greater than the threshold, it can be determined to hang up; that is, when the human shape offset is greater than or equal to the human shape offset threshold, and / or the second door opening action offset is greater than or equal to the door opening action threshold, it is determined to hang up.

[0095] It can be understood that in the embodiment of the present application, when the human shape offset is greater than or equal to the human shape offset threshold, it means that the target object may have left at this time, so the smart cat eye does not need to continue to maintain the call request state and can hang up; and when the second door opening action offset is greater than or equal to the door opening action threshold, it means that the user inside the door may have unlocked the door at this time, and the target user has the action of opening the door, then it is determined that the smart cat eye does not need to continue to maintain the call request state and can hang up.

[0096] Figure 8 Schematic diagram of the implementation process of the communication hang-up method proposed in the embodiment of the present application Figure 5 ,like Figure 8 As shown, in the embodiment of the present application, after the communication platform determines whether to hang up according to the video information and the preset threshold, that is, after step 102, the following steps are also included:

[0097] Step 108: If it is determined that the hang-up process is not to be performed, the communication platform records the call holding time of the call request.

[0098] In an embodiment of the present application, after the communication platform determines whether to perform a hang-up process based on the video information and a preset threshold, if it is determined not to perform a hang-up process, the communication platform records the call holding time of the call request.

[0099] It should be noted that in the embodiment of the present application, when it is determined not to hang up, it means that the target object may still be waiting at the door and the door is not open. In this case, the communication platform will not send a hang-up instruction to the smart cat eye, and the smart cat eye will continue to make the call request, but at the same time, the communication platform will record the call holding time of the call request.

[0100] Step 109: If the call holding time is greater than or equal to the preset time threshold, the communication platform sends a hang-up instruction to the smart cat eye.

[0101] In an embodiment of the present application, if it is determined that no hang-up processing is performed, then after the communication platform records the call holding time of the call request, if the call holding time is greater than or equal to the preset time threshold, the communication platform sends a hang-up instruction to the smart cat's eye; exemplarily, the preset time threshold is 3 minutes, when the call holding time recorded by the communication platform reaches 3 minutes, the communication platform sends a hang-up instruction to the smart cat's eye.

[0102] It should be noted that in the embodiment of the present application, although the smart cat's eye can continue to maintain the call request status after the communication platform determines not to hang up the process, it will not always maintain the call request status. Instead, when the call holding time is greater than or equal to the preset time threshold, the communication platform sends a hang-up instruction to the smart cat's eye.

[0103] Step 110: The smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object.

[0104] In an embodiment of the present application, if the call holding time is greater than or equal to a preset time threshold, after the communication platform sends a hang-up instruction to the smart cat eye, the smart cat eye responds to the hang-up instruction and hangs up the call request of the target object.

[0105] It can be understood that in the embodiment of the present application, after the communication platform sends a hang-up instruction to the smart cat eye, the smart cat eye can respond to the hang-up instruction and hang up the call request of the target object, thereby enhancing the applicability of the smart cat eye in communication control.

[0106] The embodiment of the present application provides a communication hang-up method, the smart cat's eye system includes a smart cat's eye and a communication platform. After the smart cat's eye receives the call request of the target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform; the communication platform determines whether to hang up the call based on the video information and a preset threshold; if it is determined to hang up, the communication platform sends a hang-up instruction to the smart cat's eye; the smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object. It can be seen that the present application obtains the real-time video information of the visiting guest through the smart cat's eye, and uploads the video information to the communication platform. The communication platform judges and processes the video information by combining the judgment method of the preset threshold, so as to determine whether to hang up. If it is determined that the hang-up is required, the hang-up instruction will be sent to the smart cat's eye, and then the smart cat's eye can respond to the hang-up instruction to hang up, thereby improving the flexibility and applicability of the communication control of the smart cat's eye.

[0107] Embodiment 2

[0108] Exemplarily, based on the above embodiment, in another embodiment of the present application, Fig. 9 Schematic diagram of the implementation of the communication hang-up method proposed in the embodiment of the present application Figure 3 ,like Fig. 9 As shown, in an embodiment of the present application, the smart cat's eye communicates with the communication platform, and the smart cat's eye can be bound to home devices. When the target object makes a call request through the smart cat's eye, the user receives the call request through the home device; the communication platform mainly performs image extraction and determines whether to hang up.

[0109] Furthermore, in an embodiment of the present application, the media interaction and result notification between the smart cat's eye and the communication platform are realized through the Megaport Cloud Router (MCR) service, and the incoming images in the video information are identified and extracted.

[0110] Specifically, in an embodiment of the present application, after the smart cat's eye receives a call request from the target object, the smart cat's eye can obtain real-time video information of the target object and send the video information to the communication platform, which will complete the image processing and determine whether to hang up the call.

[0111] It should be noted that in the embodiments of the present application, the communication platform determines whether to hang up based on a preset threshold, and the preset threshold is obtained by obtaining multiple human shape feature values ​​and multiple first door opening action offsets in different scenes in a preset image data set, and calculating and determining the human shape offset threshold and the door opening action threshold from the multiple human shape feature values ​​and the multiple first door opening action offsets, and the human shape offset threshold and the door opening action threshold constitute the preset threshold.

[0112] Furthermore, in an embodiment of the present application, after receiving the video information, the communication platform needs to extract the incoming image from the video information at a preset time interval, that is, complete the conversion from video to image, and then make a subsequent hang-up processing judgment based on the image.

[0113] Furthermore, in an embodiment of the present application, after extracting the visitor image, the communication platform also needs to preprocess the visitor image to obtain an image that can be used to extract the human shape offset and the second door opening action offset; the visitor image after preprocessing is a processed image, and the preprocessing includes grayscale processing and noise reduction processing.

[0114] Furthermore, in an embodiment of the present application, after obtaining the processed image, a hang-up processing can be determined based on the processed image. The determination method is to obtain the human shape offset and the second door opening action offset in the processed image, and then compare the human shape offset and the second door opening action offset with the human shape offset threshold and the door opening action threshold respectively, and determine whether to perform the hang-up processing based on the comparison result.

[0115] Specifically, in an embodiment of the present application, if the comparison result is that the human figure offset is greater than or equal to the human figure offset threshold, and / or the second door opening action offset is greater than or equal to the door opening action threshold, that is, as long as one of the two conditions is met, it can be determined to perform a hang-up process; wherein, when the comparison result is that the human figure offset is greater than or equal to the human figure offset threshold, it means that the target object may have left or has entered the room, and a call request is no longer needed, so the hang-up process can be executed; and when the comparison result is that the second door opening action offset is greater than or equal to the door opening action threshold, it means that the door may have been unlocked, and the target object may open the door and enter the room, so a call request is no longer needed, and the hang-up process can be executed.

[0116] Furthermore, in an embodiment of the present application, the smart cat's eye and the communication platform can communicate through preset identification information, for example, using the Session ID as the channel identifier of the conversation between the smart cat's eye and the communication platform, so that the smart cat's eye sends video information to the communication platform according to this identifier, and correspondingly, the communication platform sends a hang-up command to the smart cat's eye according to this identification information.

[0117] To sum up, in the embodiments of the present application, the "human shape offset" plus the "door opening action offset" is obtained by induction and refinement as the judgment standard for hang-up processing, and at the same time, combined with image analysis technology, a discrimination model is established to judge whether a person leaves the current conversation scene of the target object, or a person opens the door to enter the room, so as to judge whether the current conversation scene needs to be hung up. This solves the problem that the smart cat's eye end cannot actively execute the hang-up operation, is not restricted by any device and APP, and will not affect the normal communication process. It has good intelligence and applicability.

[0118] The embodiment of the present application provides a communication hang-up method, the smart cat's eye system includes a smart cat's eye and a communication platform. After the smart cat's eye receives the call request of the target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform; the communication platform determines whether to hang up the call based on the video information and a preset threshold; if it is determined to hang up, the communication platform sends a hang-up instruction to the smart cat's eye; the smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object. It can be seen that the present application obtains the real-time video information of the visiting guest through the smart cat's eye, and uploads the video information to the communication platform. The communication platform judges and processes the video information by combining the judgment method of the preset threshold, so as to determine whether to hang up. If it is determined that the hang-up is required, the hang-up instruction will be sent to the smart cat's eye, and then the smart cat's eye can respond to the hang-up instruction to hang up, thereby improving the flexibility and applicability of the communication control of the smart cat's eye.

[0119] Embodiment 3

[0120] Based on the above embodiment, in another embodiment of the present application, Fig.10 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 2 ,like Fig.10 As shown, the smart cat's eye 11 proposed in the embodiment of the present application includes a first sending unit 111, a responding unit 112 and an establishing unit 123. Fig.11 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 3 ,like Fig.11 As shown, the communication platform 12 includes a judgment unit 121, a determination unit 122, a calculation unit 123, a recording unit 124, and a second sending unit 125.

[0121] The first sending unit 111 is used for obtaining video information of the target object and sending the video information to the communication platform after the smart cat's eye receives a call request from the target object.

[0122] The determining unit 121 is used for the communication platform to determine whether to perform a hang-up process according to the video information and a preset threshold.

[0123] The response unit 112 is used for the smart cat's eye to respond to the hang-up instruction and hang up the call request of the target object.

[0124] The determination unit 122 is used to determine multiple human feature values ​​and multiple first door opening action offsets in different scenes based on a preset image data set after the smart cat's eye receives a call request from the target object, the smart cat's eye obtains video information of the target object, and before sending the video information to the communication platform.

[0125] The calculation unit 123 is used to calculate a human shape offset threshold according to the multiple human shape feature values, and calculate a door opening action threshold according to the multiple first door opening action offsets.

[0126] Furthermore, the determination unit 122 is further configured to determine the preset threshold value according to the human figure deviation threshold value and the door opening action threshold value.

[0127] Furthermore, the judgment unit 121 is specifically used to extract the incoming image of the target object from the video information at a preset time interval; pre-process the incoming image to obtain a processed image; and determine whether to hang up based on the processed image and the preset threshold.

[0128] Furthermore, the judgment unit 121 is also specifically used to obtain the human shape offset and the second door opening action offset of the processed image; if the human shape offset is greater than or equal to the human shape offset threshold; and / or the second door opening action offset is greater than or equal to the door opening action threshold, it is determined to perform hang-up processing.

[0129] The recording unit 124 is configured to, after the communication platform determines whether to perform a hang-up process according to the video information and a preset threshold, if it is determined that the hang-up process is not to be performed, the communication platform records the call holding time of the call request.

[0130] The second sending unit 125 is configured to cause the communication platform to send a hang-up instruction to the smart cat eye if the call holding time is greater than or equal to a preset time threshold.

[0131] The response unit 112 is also used for the smart cat's eye to respond to the hang-up instruction and hang up the call request of the target object.

[0132] Furthermore, the smart cat's eye sends the video information to the communication platform according to preset identification information; correspondingly, the communication platform sends the hang-up instruction to the smart cat's eye according to the preset identification information.

[0133] Furthermore, the establishing unit 123 is used to establish a communication connection between the smart cat eye and the bound device after the smart cat eye receives the call request of the target object.

[0134] Furthermore, the response unit 112 is specifically used for the smart cat's eye to disconnect the communication connection with the bound device.

[0135] In the embodiments of the present application, further, Fig.12 Schematic diagram of the structure of the smart cat's eye system proposed in this application embodiment Figure 4 ,like Fig.12 As shown, the smart cat's eye system 10 proposed in the embodiment of the present application may also include a processor 13 and a memory 14 storing executable instructions of the processor 13. Furthermore, the smart cat's eye system 10 may also include a communication interface 15 and a bus 16 for connecting the processor 13, the memory 14 and the communication interface 15.

[0136] Furthermore, in an embodiment of the present application, the processor 13 is used for, after the smart cat's eye receives the call request of the target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform; the communication platform determines whether to hang up based on the video information and a preset threshold; if it is determined to hang up, the communication platform sends a hang-up instruction to the smart cat's eye; the smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object.

[0137] In an embodiment of the present application, the above-mentioned processor can be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that for different devices, the electronic device used to realize the above-mentioned processor function can also be other, and the embodiment of the present application is not specifically limited. The memory can be connected to the processor, wherein the memory is used to store executable program code, and the program code includes computer operation instructions, and the memory may include a high-speed RAM memory, and may also include a non-volatile memory, for example, at least two disk memories.

[0138] In the embodiment of the present application, the bus is used to connect the communication interface, the processor and the memory, as well as the mutual communication between these devices.

[0139] In the embodiment of the present application, the memory is used to store instructions and data.

[0140] In practical applications, the above-mentioned memory can be a volatile memory (volatile memory), such as a random access memory (Random-Access Memory, RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory (Read-Only Memory, ROM), a flash memory (flash memory), a hard disk (Hard Disk Drive, HDD) or a solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provide instructions and data to the processor.

[0141] In addition, each functional module in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software functional modules.

[0142] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0143] The embodiment of the present application provides a smart cat's eye system, which includes a smart cat's eye and a communication platform. After the smart cat's eye receives a call request from a target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform; the communication platform determines whether to hang up the call based on the video information and a preset threshold; if it is determined to hang up, the communication platform sends a hang-up instruction to the smart cat's eye; the smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object. It can be seen that the present application obtains the real-time video information of the visiting guest through the smart cat's eye, and uploads the video information to the communication platform. The communication platform judges and processes the video information by combining the judgment method of the preset threshold to determine whether to hang up. If it is determined that hang up is required, a hang-up instruction will be sent to the smart cat's eye, and then the smart cat's eye can respond to the hang-up instruction to hang up, thereby improving the flexibility and applicability of the communication control of the smart cat's eye.

[0144] An embodiment of the present application provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the communication hang-up method as described above is implemented.

[0145] Specifically, the program instructions corresponding to a communication hang-up method in this embodiment can be stored on a storage medium such as a CD, a hard disk, a USB flash drive, etc. When the program instructions corresponding to a communication hang-up method in the storage medium are read or executed by the smart cat eye system, the following steps are included:

[0146] After the smart cat's eye receives a call request from a target object, the smart cat's eye obtains video information of the target object and sends the video information to the communication platform;

[0147] The communication platform determines whether to hang up based on the video information and a preset threshold;

[0148] If it is determined to hang up, the communication platform sends a hang up instruction to the smart cat eye;

[0149] The smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object.

[0150] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0151] The present application is described with reference to implementation flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0152] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which is implemented in the implementation flow diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0153] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing the steps in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0154] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. A communication hanging up method, characterized in that: The method is applied to a smart cat's eye system, the smart cat's eye system includes a smart cat's eye and a communication platform, and the method includes: After the smart cat's eye receives a call request from a target object, the smart cat's eye obtains video information of the target object and sends the video information to the communication platform; The communication platform extracts the visiting image of the target object from the video information at a preset time interval; Preprocessing the incoming image to obtain a processed image; Obtaining a human figure offset and a second door opening action offset of the processed image; If the human shape offset is greater than or equal to the human shape offset threshold; and / or the second door opening action offset is greater than or equal to the door opening action threshold, it is determined to perform hang-up processing; wherein the human shape offset threshold is used to determine whether the target object is still waiting in front of the door; the door opening action threshold is used to determine whether the target object is in the door opening state; the human shape offset is the offset of the human body shape of the target object; the second door opening action offset is the offset of the door opening action of the target object; If it is determined to hang up, the communication platform sends a hang up instruction to the smart cat eye; The smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object.

2. The method according to claim 1, characterized in that After the smart cat's eye receives a call request from the target object, the smart cat's eye obtains video information of the target object, and before the video information is sent to the communication platform, the method further includes: Determine a plurality of human shape feature values ​​and a plurality of first door opening action offsets in different scenes based on a preset image data set; A human shape offset threshold is calculated according to the multiple human shape feature values, and a door opening action threshold is calculated according to the multiple first door opening action offsets.

3. The method according to claim 1, characterized in that The method further comprises: If it is determined that the hang-up process is not to be performed, the communication platform records the call holding time of the call request; If the call holding time is greater than or equal to a preset time threshold, the communication platform sends a hang-up instruction to the smart cat eye; The smart cat's eye responds to the hang-up instruction and hangs up the call request of the target object.

4. The method according to claim 1, characterized in that The method further comprises: The smart cat's eye sends the video information to the communication platform according to the preset identification information; accordingly, The communication platform sends the hang-up instruction to the smart cat's eye according to the preset identification information.

5. The method according to claim 1, characterized in that: The method further comprises: After the smart cat's eye receives the call request of the target object, the smart cat's eye establishes a communication connection with the bound device.

6. The method according to claim 5, characterized in that The hanging up process of the call request of the target object includes: The smart cat's eye disconnects the communication connection with the bound device.

7. An intelligent cat-eye system, characterized in that: The smart cat's eye system includes a smart cat's eye and a communication platform; the smart cat's eye includes a sending unit and a responding unit, and the communication platform includes a judging unit. The sending unit is used for, after the smart cat's eye receives a call request from the target object, the smart cat's eye obtains the video information of the target object and sends the video information to the communication platform; The judging unit is used to extract the visiting image of the target object from the video information at a preset time interval; Preprocessing the incoming image to obtain a processed image; Obtaining a human shape offset and a second door opening motion offset of the processed image; if the human shape offset is greater than or equal to a human shape offset threshold; and / or the second door opening motion offset is greater than or equal to a door opening motion threshold, determining to perform a hang-up process; wherein the human shape offset threshold is used to determine whether the target object is still waiting in front of the door; the door opening motion threshold is used to determine whether the target object is in a door opening state; the human shape offset is an offset of the human body shape of the target object; the second door opening motion offset is an offset of the door opening motion of the target object; The response unit is used for the smart cat's eye to respond to a hang-up instruction and hang up the call request of the target object.

8. An intelligent cat-eye system, characterized in that: The smart cat's eye system further includes a processor and a memory storing instructions executable by the processor. When the instructions are executed by the processor, the method according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium having a program stored thereon, applied in a smart cat-eye system, wherein when the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images