Safety monitoring method and device and sofa

Abstract

The embodiment of the invention discloses a safety monitoring method and device and a sofa, the safety monitoring method and device are applied to the sofa, the sofa comprises a monitoring device, the monitoring device comprises a camera, the sofa is in communication connection with terminal equipment, and the method comprises the following steps: receiving a target monitoring area sent by the terminal equipment; the target monitoring area is a monitoring area selected from a complete monitoring area corresponding to the monitoring device by the terminal equipment in response to a selection operation; controlling a camera to carry out image acquisition on the target monitoring area to obtain a real-time monitoring area picture corresponding to the target monitoring area; the real-time monitoring picture is recognized, if a safety event is detected according to the real-time monitoring picture, warning information is sent to the terminal equipment, and the warning information is used for warning that the safety event occurs in the target monitoring area, so that the flexibility and the real-time response capability of the sofa for monitoring the articles of the user are improved; and the safety protection level in public places is improved.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to a security monitoring method, device and electronic equipment. Background Art

[0002] In modern society, people often leave their seats temporarily for various reasons in public places such as restaurants, bars, and cafes. In this case, personal belongings (including tableware, wine glasses, tea cups, etc.) may be exposed to potential safety risks when left unattended. Since some items are in direct contact with food and drinks, their safety is directly related to the user's personal health. Once personal belongings are maliciously contaminated or moved by others, they may pose a health threat to the user or cause economic losses.

[0003] At present, most public places are equipped with basic security monitoring systems to ensure the safety of people and property in the places. However, most security monitoring systems have limited coverage, insufficient real-time response capabilities, and low security protection levels. Summary of the invention

[0004] The embodiments of the present application disclose a security monitoring method, device and electronic equipment, which improves the flexibility and real-time response capability of a sofa in monitoring user items, and improves the level of security protection in public places.

[0005] In a first aspect, an embodiment of the present application discloses a security monitoring method, which is applied to a sofa, wherein the sofa includes a monitoring device, wherein the monitoring device includes a camera, and the sofa is communicatively connected to a terminal device. The method includes:

[0006] receiving a target monitoring area sent by the terminal device; the target monitoring area is a monitoring area selected by the terminal device from the complete monitoring area corresponding to the monitoring device in response to a selection operation;

[0007] Controlling the camera to collect images of the target monitoring area to obtain a real-time monitoring picture corresponding to the target monitoring area;

[0008] The real-time monitoring screen is identified, and if a security incident is detected based on the real-time monitoring screen, a warning message is sent to the terminal device, wherein the warning message is used to warn the target monitoring area of ​​the security incident.

[0009] As an optional implementation, in the first aspect of the embodiment of the present application, the monitoring device further includes a laser emitting device and a laser receiving device, and the method further includes:

[0010] The laser emitting device emits a plurality of laser beams to the target monitoring area to construct a laser curtain corresponding to the target monitoring area;

[0011] When the laser receiving device is unable to receive part of the laser light beam, it is determined that a safety incident has occurred, and a warning message is sent to the terminal device.

[0012] As an optional implementation, in the first aspect of the embodiment of the present application, the sofa includes a lifting device, the lifting device is connected to the monitoring device, the sofa is further provided with a receiving slot, and the method further includes:

[0013] When it is detected that the user is on the sofa, the lifting device is controlled to be in a first lifting state, wherein the first lifting state refers to a state in which the lifting device and the monitoring device are completely stored in the receiving slot;

[0014] When it is detected that the user leaves the sofa, the lifting device is controlled to be in a second lifting state, wherein the second lifting state refers to a state in which the lifting device is at least partially extended from the receiving slot so that the monitoring device can monitor the target monitoring area.

[0015] As an optional implementation manner, in the first aspect of the embodiment of the present application, the method further includes:

[0016] The lifting height of the lifting device is adjusted according to the target monitoring area, and / or the rotation angle of the monitoring device is adjusted so that the monitoring device monitors the target monitoring area.

[0017] A second aspect of an embodiment of the present application discloses a security monitoring method, which is applied to a terminal device, wherein the terminal device is communicatively connected to a sofa, wherein the sofa includes a monitoring device, and wherein the monitoring device includes a camera; the method includes:

[0018] Displaying a monitoring interface corresponding to the sofa, wherein the monitoring interface is used to display a complete monitoring area corresponding to the monitoring device;

[0019] In response to a selection operation on the monitoring interface, acquiring a target monitoring area selected in the complete monitoring area;

[0020] The target monitoring area is sent to the sofa, so that the sofa controls the camera to collect images of the target monitoring area, and obtains a real-time monitoring picture corresponding to the target monitoring area;

[0021] Receive the warning information sent by the sofa and output the warning information, wherein the warning information is sent by the sofa when it identifies the real-time monitoring screen and detects a security incident based on the real-time monitoring screen; the warning information is used to warn the target monitoring area of ​​the security incident.

[0022] As an optional implementation, in the second aspect of the embodiment of the present application, before displaying the monitoring interface corresponding to the sofa, the method further includes:

[0023] Scan the graphic code corresponding to the sofa through a camera;

[0024] Identify the graphic code to obtain device identification information corresponding to the sofa; wherein the device identification information is used to uniquely identify the sofa;

[0025] Based on the device identification information, a connection request is sent to the corresponding sofa, where the connection request is used to establish a communication connection with the sofa.

[0026] As an optional implementation, in the second aspect of the embodiment of the present application, the displaying the monitoring interface corresponding to the sofa includes:

[0027] Acquire scene data corresponding to the sofa, and generate a monitoring interface corresponding to the sofa according to the scene data, wherein the monitoring interface includes a three-dimensional scene model of the area around the sofa;

[0028] The acquiring, in response to the selection operation on the monitoring interface, a target monitoring area selected in the complete monitoring area comprises:

[0029] In response to a selection operation on the three-dimensional scene model, a target monitoring area selected on the three-dimensional scene model is acquired.

[0030] A third aspect of the present application discloses a security monitoring device, which is applied to a sofa. The sofa includes a monitoring device, which includes a camera. The sofa is communicatively connected to a terminal device, and the device includes:

[0031] An area receiving module, used for receiving a target monitoring area sent by the terminal device; the target monitoring area is a monitoring area selected by the terminal device from the complete monitoring area corresponding to the monitoring device in response to a selection operation;

[0032] An image acquisition module is used to control the camera to acquire images of the target monitoring area to obtain a real-time monitoring picture corresponding to the target monitoring area;

[0033] The information sending module is used to identify the real-time monitoring screen. If a security incident is detected based on the real-time monitoring screen, a warning message is sent to the terminal device, and the warning message is used to warn the target monitoring area that the security incident has occurred.

[0034] A fourth aspect of the present application discloses a security monitoring device, which is applied to a terminal device, wherein the terminal device is communicatively connected to a sofa, wherein the sofa comprises a monitoring device, wherein the monitoring device comprises a camera; the device comprises:

[0035] An interface display module, used to display a monitoring interface corresponding to the sofa, wherein the monitoring interface is used to display a complete monitoring area corresponding to the monitoring device;

[0036] An area acquisition module, configured to acquire a target monitoring area selected in the complete monitoring area in response to a selection operation on the monitoring interface;

[0037] An area sending module is used to send the target monitoring area to the sofa, so that the sofa controls the camera to collect images of the target monitoring area and obtain a real-time monitoring picture corresponding to the target monitoring area;

[0038] The information receiving module is used to receive the warning information sent by the sofa and output the warning information. The warning information is sent by the sofa when it recognizes the real-time monitoring screen and detects a security incident based on the real-time monitoring screen; the warning information is used to warn the target monitoring area of ​​the security incident.

[0039] A fifth aspect of the embodiment of the present application discloses a sofa, comprising:

[0040] A memory storing executable program code;

[0041] a processor coupled to the memory;

[0042] The processor calls the executable program code stored in the memory to execute the method described in any one of the above embodiments.

[0043] A sixth aspect of the embodiments of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method described in any of the above embodiments is implemented.

[0044] A seventh aspect of the embodiments of the present application discloses a computer program product, including a computer program, and when the computer program is executed by a processor, the method described in any of the above embodiments is implemented.

[0045] Compared with the related art, the embodiments of the present application include at least the following beneficial effects:

[0046] The embodiment of the present application discloses a security monitoring method, device and electronic device, wherein a sofa receives a target monitoring area sent by a terminal device; the target monitoring area is a monitoring area selected by the terminal device from the complete monitoring area corresponding to the monitoring device in response to a selection operation; further, the sofa controls a camera to collect images of the target monitoring area to obtain a real-time monitoring screen corresponding to the target monitoring area; the real-time monitoring screen is identified, and if a security event is detected according to the real-time monitoring screen, a warning message is sent to the terminal device, and the warning message is used to warn the target monitoring area of ​​the security event. In the embodiment of the present application, a monitoring device is integrated in the sofa, and the sofa is connected to the terminal device for communication. The user can select the target monitoring area from the complete monitoring area corresponding to the monitoring device through the terminal device, realize the personalized setting of the monitoring range of the sofa, and improve the flexibility of the sofa to monitor the user's items. At the same time, the sofa can identify the security events that occur in the real-time monitoring screen corresponding to the target monitoring area, and send a warning message to the terminal device when a security event occurs, ensuring that the user can receive the notification and take corresponding measures in the first time, thereby improving the real-time response capability of the sofa to monitor items and improving the safety protection level in public places. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0048] Figure 1 It is an application scenario diagram of a security monitoring method disclosed in an embodiment of the present application;

[0049] Figure 2 is a flow chart of a security monitoring method disclosed in an embodiment of the present application;

[0050] Figure 3 It is a structural schematic diagram of a sofa disclosed in an embodiment of the present application;

[0051] Figure 4 It is a schematic diagram of a process for establishing a communication connection between a sofa and a terminal device disclosed in an embodiment of the present application;

[0052] Figure 5 is a flow chart of another security monitoring method disclosed in an embodiment of the present application;

[0053] Figure 6 is a block diagram of a security monitoring device disclosed in an embodiment of the present application;

[0054] Figure 7 is a block diagram of another security monitoring device disclosed in an embodiment of the present application;

[0055] Figure 8 It is a structural block diagram of the sofa disclosed in the embodiment of the present application. DETAILED DESCRIPTION

[0056] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0058] Figure 1 is an application scenario diagram of a security monitoring method disclosed in an embodiment of the present application, such as Figure 1 As shown, the security monitoring method can be applied to a sofa 110. The sofa 110 is provided with a monitoring device 120, and a communication connection is established between the sofa 110 and a terminal device 130 so that data can be transmitted between them.

[0059] The above-mentioned communication connection may include but is not limited to a cellular network connection, a Wi-Fi connection, etc., and the embodiments of the present application do not specifically limit this.

[0060] The sofa 110 can be placed in public places, such as restaurants, cafes, bars, libraries, airport waiting areas, etc., and the user's personal belongings can be monitored through the monitoring device 120. The sofa 110 can include but is not limited to chairs, massage chairs, public seats, public sofas, etc. It should be noted that the sofa 110 is not limited to seats including cushions, but can also be seats of other structures. The sofa 110 can be a single seat or a seat for multiple people, which is not limited here.

[0061] The monitoring device 120 may refer to a device used to monitor and record activities in a specific area. The monitoring device 120 may include a camera and a laser device.

[0062] Among them, the camera can be used to capture images of a specific area. The camera may include a visual probe, a pan-tilt camera, a cylindrical camera, etc., and the embodiments of the present application do not make specific limitations on this.

[0063] The laser device may include a laser emitting device and a laser receiving device. The laser emitting device may be used to emit a laser beam; and the laser receiving device may be used to receive a laser beam. Optionally, the laser beam may include visible light, infrared light, etc., which is not specifically limited in the embodiments of the present application.

[0064] Optionally, the terminal device may include but is not limited to a mobile phone, a tablet computer, a PC (Personal Computer), a PDA (Personal Digital Assistant), etc., and the embodiments of the present application do not specifically limit this.

[0065] In the embodiment of the present application, the terminal device 130 can display the monitoring screen corresponding to the sofa 110, and the monitoring interface is used to display the complete monitoring area corresponding to the monitoring device 120. The user can select the target monitoring area to be monitored on the monitoring interface, and the terminal device 130 can obtain the target monitoring area selected in the complete monitoring area in response to the user's selection operation on the monitoring interface. The terminal device 130 can send the target monitoring area to the sofa 110, and the sofa 110 receives the target monitoring area sent by the terminal device 130. The sofa 110 controls the camera to collect images of the target monitoring area to obtain the real-time monitoring screen corresponding to the target monitoring area. The sofa 110 identifies the real-time monitoring screen. If a security event is detected according to the real-time monitoring screen, a warning message is sent to the terminal device 130, and the warning message is used to warn the target monitoring area of ​​the security event. The terminal device 130 receives the warning message sent by the sofa 110 and can output the warning message, thereby warning the user that a security event has occurred in the target monitoring area.

[0066] See also Figure 2 , Figure 2 It is a flow chart of a security monitoring method disclosed in an embodiment of the present application.

[0067] like Figure 2 As shown, the security monitoring method may include the following steps:

[0068] Step 210: The terminal device displays a monitoring interface corresponding to the sofa, where the monitoring interface is used to display the complete monitoring area corresponding to the monitoring device.

[0069] After the sofa establishes a communication connection with the terminal device, the sofa can control the camera in the monitoring device to collect images and send the complete monitoring area corresponding to the monitoring device to the terminal device. The terminal device can receive the complete monitoring area sent by the sofa.

[0070] The complete monitoring area may refer to the area corresponding to the maximum range that can be captured by the monitoring device. For example, the terminal device may display the area image corresponding to the complete monitoring area in the monitoring interface, or the terminal device may display the area range data corresponding to the complete monitoring area in the monitoring interface, such as the range angle and range distance corresponding to the complete monitoring area with the sofa as the center.

[0071] Step 220: The terminal device obtains the target monitoring area selected in the complete monitoring area in response to the selection operation on the monitoring interface.

[0072] The user can select the desired target monitoring area on the monitoring interface displayed on the terminal device. The target monitoring area can be the entire area or a part of the complete monitoring area.

[0073] The terminal device can respond to the user's selection operation on the monitoring interface, obtain the target monitoring area selected by the user in the complete monitoring area, and send the target monitoring area to the sofa.

[0074] In some embodiments, the user can select the complete monitoring area displayed on the monitoring interface, and the terminal device can determine the area selected by the user as the target monitoring area.

[0075] In some embodiments, the complete monitoring area may include multiple preset monitoring areas, each preset monitoring area corresponds to a different area range on the complete monitoring area, and the terminal device may display images corresponding to the multiple preset monitoring areas in the monitoring interface, or the terminal device may display area range data corresponding to the multiple preset monitoring areas in the monitoring interface. The user may click on the multiple preset monitoring areas displayed on the monitoring interface, and the terminal device may obtain the preset monitoring area selected by the user and determine the preset monitoring area as the target monitoring area.

[0076] Step 230: The terminal device sends the target monitoring area to the sofa.

[0077] After determining the target monitoring area, the terminal device can send the target monitoring area to the sofa based on the communication connection with the sofa.

[0078] Step 240: Sofa receives the target monitoring area sent by the terminal device.

[0079] Based on the communication connection with the terminal device, the sofa can receive the target monitoring area sent by the terminal device.

[0080] Step 250, the sofa controls the camera to collect images of the target monitoring area to obtain a real-time monitoring picture corresponding to the target monitoring area.

[0081] The real-time monitoring screen may refer to the image of the target monitoring area captured by the camera at each time point.

[0082] In some embodiments, the sofa can control the camera to collect images of the target monitoring area according to a preset collection period to obtain a real-time monitoring picture corresponding to the target monitoring area. For example, the sofa can control the camera to collect images of the target monitoring area every 3 seconds to obtain a real-time monitoring picture corresponding to the target monitoring area.

[0083] In some embodiments, Figure 3 As shown, the sofa 300 may also include a lifting device 310, which may be connected to the monitoring device 320. The sofa 300 may adjust the lifting height of the monitoring device 320 by controlling the lifting of the lifting device 310. The sofa 300 is also provided with a receiving groove 330, which may be used to receive the lifting device 310 and the monitoring device 320, thereby realizing the storage of the lifting device 310 and the monitoring device 320.

[0084] Furthermore, when the sofa detects that the user is on the sofa, the lifting device can be controlled to be in the first lifting state, and the first lifting state refers to the state in which the lifting device and the monitoring device are completely stored in the receiving slot; when the sofa detects that the user leaves the sofa, the lifting device can be controlled to be in the second lifting state, and the second lifting state refers to the state in which the lifting device at least partially extends from the receiving slot so that the monitoring device can monitor the target monitoring area. By judging whether the user is on the sofa and controlling the storage state of the lifting device and the monitoring device, the sofa can be made more beautiful and the occupied volume of the sofa can be reduced.

[0085] In some embodiments, the sofa can also adjust the lifting height of the lifting device according to the target monitoring area, and / or adjust the rotation angle of the monitoring device so that the monitoring device monitors the target monitoring area.

[0086] Furthermore, the sofa can adjust the lifting height of the lifting device and / or the rotation angle of the monitoring device according to the three-dimensional coordinates corresponding to the target monitoring area, so that the monitoring device can monitor the target monitoring area. The sofa can adjust the lifting height of the lifting device and the rotation angle of the monitoring device to achieve personalized settings of the monitoring range, thereby improving the flexibility of monitoring.

[0087] Step 260: Sofa identifies the real-time monitoring image and detects the occurrence of a security incident based on the real-time monitoring image.

[0088] Among them, security incidents may refer to events that affect the personal safety, information security or economic security of users, for example, adding unknown substances to the user's food, taking personal belongings without authorization, etc.

[0089] Optionally, the way in which the sofa identifies the real-time monitoring screen may include one or more methods including square difference method, feature point matching, optical flow method, convolutional neural network, semantic segmentation, etc., which is not specifically limited in the embodiments of the present application.

[0090] In some embodiments, Sofa can detect whether a security incident has occurred by identifying adjacent real-time monitoring screens through the square difference method. Sofa can calculate the square difference between the pixel values ​​corresponding to the same position in adjacent real-time monitoring screens, and add the square differences of each image position to obtain the sum of square differences (Sum of Squared Differences, SSD). The smaller the SSD value, the more similar the adjacent real-time monitoring screens are; the larger the SSD value, the greater the difference between adjacent real-time monitoring screens. Sofa can pre-set a difference threshold, and determine whether a security incident has occurred by judging the size relationship between the SSD value and the difference threshold. If the SSD value is greater than or equal to the difference threshold, it is determined that a security incident has occurred, and a warning message is sent to the terminal device; if the SSD value is less than the difference threshold, it is determined that no security incident has occurred.

[0091] In some embodiments, the sofa can determine whether a security incident has occurred by detecting and matching feature points in the collected multiple frames of real-time monitoring images. Specifically, the sofa can first convert each frame of real-time monitoring images into a corresponding grayscale image, and use Gaussian blur to remove noise for each frame of grayscale images; then, the sofa can use a feature detection algorithm to detect feature points in each frame of grayscale images, and generate a feature descriptor corresponding to each feature point, and the feature descriptor can be used to describe the local information around the feature point; then, the control device can use a feature point matching algorithm on the feature descriptor to match the feature points in the multiple frames of grayscale images, determine the successfully matched feature points, and then calculate the motion vector of the successfully matched feature point pair between two consecutive grayscale images, and the motion vector can be used to represent the moving direction and moving distance of the successfully matched feature point pair between two consecutive grayscale images; finally, the sofa can integrate the motion vectors of all successfully matched feature point pairs between two consecutive grayscale images, generate pixel movement information, and determine whether a security incident has occurred based on the pixel movement information. If a security incident is determined to have occurred based on the pixel movement information, a warning message is sent to the terminal device.

[0092] Among them, a grayscale image refers to an output image in which each pixel contains only a single brightness information but no color information, and the brightness information in a grayscale image refers to the grayscale value of each pixel in the grayscale image. Gaussian blur refers to the use of a Gaussian function to reduce the noise and details of a grayscale image, which can make some parts of a grayscale image look softer while other parts remain relatively clear.

[0093] Feature detection algorithms may include ORB (Oriented FAST and Rotated BRIEF) algorithm, SIFT (Scale-Invariant Feature Transform) algorithm, SURF (Speeded-Up Robust Features) algorithm, and the like.

[0094] Feature points may include corner points, edge points, and other points where the grayscale value changes significantly. A corner point may refer to the intersection of two edges in a grayscale image; an edge point may refer to a point on a contour line in a grayscale image.

[0095] The local information around the feature point may refer to the grayscale values ​​of pixels around the feature point.

[0096] The feature point matching algorithm may include a nearest neighbor matching algorithm, a RANSAC (Random Sample Consensus) algorithm, a FLANN (Fast Library for Approximate Nearest Neighbors), and the like.

[0097] Step 270: Sofa sends a warning message to the terminal device.

[0098] After the sofa detects a security incident based on the real-time monitoring screen, it can send a warning message to the terminal device. The warning message can be used to warn the user that a security incident has occurred in the target monitoring area. For example, the warning message can be that an unknown object has appeared in the target monitoring area, or that a person has intruded into the target monitoring area.

[0099] Step 280: The terminal device receives the warning information sent by the sofa and outputs the warning information.

[0100] The terminal device can receive the warning information sent by the sofa and output the warning information.

[0101] Optionally, the terminal device may output warning information in the form of voice reminder, text message reminder, etc., which is not specifically limited in the embodiment of the present application.

[0102] In some embodiments, after the terminal device outputs a warning message, the user can perform a viewing operation on the monitoring interface to view a surveillance video composed of multiple frames of real-time monitoring images. The terminal device can send a surveillance video acquisition request to the sofa in response to the user's viewing operation; the sofa can receive the surveillance video acquisition request, query the surveillance video corresponding to the terminal device from the memory, and send the surveillance video to the terminal device; the terminal device can receive the surveillance video and display the surveillance video on the monitoring interface. The user can view and confirm the surveillance video on the monitoring interface. If it is determined that there is a security incident in the surveillance video, the user can perform a save operation on the monitoring interface, and the terminal device can save the surveillance video in response to the user's save operation.

[0103] In the embodiment of the present application, the sofa receives the target monitoring area sent by the terminal device; the target monitoring area is the monitoring area selected by the terminal device from the complete monitoring area corresponding to the monitoring device in response to the selection operation; then, the sofa controls the camera to collect images of the target monitoring area to obtain the real-time monitoring screen corresponding to the target monitoring area; the real-time monitoring screen is identified, and if a security event is detected according to the real-time monitoring screen, a warning message is sent to the terminal device, and the warning message is used to warn the target monitoring area of ​​the security event. In the embodiment of the present application, the sofa is integrated with the monitoring device, and the sofa is connected to the terminal device for communication. The user can select the target monitoring area from the complete monitoring area corresponding to the monitoring device through the terminal device, realize the personalized setting of the sofa monitoring range, and improve the flexibility of the sofa to monitor the user's items. At the same time, the sofa can identify the security events that occur in the real-time monitoring screen corresponding to the target monitoring area, and send a warning message to the terminal device when a security event occurs, ensuring that the user can receive the notification and take corresponding measures in the first time, thereby improving the real-time response capability of the sofa to monitor items and improving the safety protection level in public places.

[0104] In some embodiments, before the terminal device displays the monitoring interface corresponding to the sofa, the sofa can establish a communication connection with the terminal device. As an implementation method, the terminal device can scan the sofas existing in the surrounding area and obtain the connection information (such as connection password, account number, etc.) corresponding to each scanned sofa. The user can click on the connection information corresponding to the sofa currently located on the connection interface displayed by the terminal device to trigger the connection operation. The terminal device can respond to the connection operation triggered by the user and establish a communication connection with the sofa according to the connection information corresponding to the sofa selected by the user.

[0105] As another implementation, the terminal device may also obtain the connection information of the sofa by scanning the graphic code and establish a communication connection with the sofa. Figure 4As shown, establishing a communication connection between the sofa and the terminal device may include the following steps 410 to 420:

[0106] Step 410: The terminal device scans the graphic code corresponding to the sofa through a camera.

[0107] The terminal device is equipped with a camera, through which the graphic code corresponding to the sofa can be scanned.

[0108] Each sofa corresponds to a graphic code. The graphic code may refer to a graphic symbol containing the device identification information corresponding to the sofa. Optionally, the graphic code may include but is not limited to a QR code (Quick Response Code), a QR code, a barcode, etc., which is not limited in the present embodiment of the application. The QR code refers to a square pattern composed of black and white squares, which can be used to store the device identification information corresponding to the sofa.

[0109] The device identification information may refer to information used to uniquely identify the sofa. Optionally, the device identification information may include the sofa number, connection information corresponding to the sofa, etc., which is not specifically limited in the embodiment of the present application. Among them, the connection information corresponding to the sofa may include but is not limited to one or more information such as the connection password, account number, and communication address corresponding to the sofa. The communication address may refer to the address of the sofa for communicating with other devices in the network, such as an IP (Internet Protocol) address.

[0110] Step 420: The terminal device identifies the graphic code to obtain device identification information corresponding to the sofa; wherein the device identification information is used to uniquely identify the sofa.

[0111] After scanning the graphic code corresponding to the sofa, the terminal device can identify the graphic code, decode the graphic code according to the coding method of the graphic code, and obtain the device identification information corresponding to the sofa.

[0112] Step 430: the terminal device sends a connection request to the corresponding sofa based on the device identification information, and the connection request is used to establish a communication connection with the sofa.

[0113] The terminal device can generate a connection request according to the device identification information corresponding to the sofa, and send the connection request to the sofa. The sofa can receive the connection request and establish a communication connection with the terminal device according to the connection request.

[0114] In the embodiment of the present application, the terminal device can scan the graphic code corresponding to the sofa through the camera, identify the graphic code, obtain the device identification information corresponding to the sofa, and send a connection request to the corresponding sofa based on the device identification information; the sofa receives the connection request and establishes a communication connection with the terminal device. By scanning the graphic code, the process of establishing a communication connection between the sofa and the terminal device is simplified. At the same time, each sofa has unique device identification information, which ensures that the terminal device can be correctly connected to the sofa and reduces the risk of misconnection.

[0115] In some embodiments, the monitoring device set up on the sofa may also include a laser emitting device and a laser receiving device. The sofa can emit multiple laser beams to the target monitoring area through the laser emitting device to construct a laser curtain corresponding to the target monitoring area; when the laser receiving device cannot receive part of the laser beams, the sofa can determine that a security incident has occurred and send a warning message to the terminal device.

[0116] The laser curtain corresponding to the target monitoring area may refer to a curtain formed by a plurality of laser beams irradiated on the edge of the target monitoring area.

[0117] It can be understood that when no object (such as a person, animal or other obstacle) passes through the laser curtain, the multiple laser beams emitted by the laser emitting device to the target monitoring area can be directly received by the laser receiving device, and when an object passes through the laser curtain, part of the laser beam emitted by the laser emitting device to the target monitoring area will be interrupted by the object, resulting in the laser receiving device being unable to receive this part of the laser beam. Therefore, the sofa can determine that a security incident has occurred when the laser receiving device is unable to receive part of the laser beam, and send a warning message to the terminal device.

[0118] In the embodiment of the present application, the sofa constructs a laser curtain corresponding to the target monitoring area through a laser emitting device and a laser receiving device, which can accurately detect any behavior that crosses the laser beam without contact, thereby improving the sofa's safety protection capability for the target monitoring area.

[0119] In some embodiments, the terminal device can determine the target monitoring area based on the scene data corresponding to the sofa. Figure 5 FIG. 1 is a flow chart of another security monitoring method disclosed in an embodiment of the present application. Figure 5 As shown, the security monitoring method may include the following steps 510 to 590:

[0120] Step 510: The sofa controls the camera to collect images of the surrounding environment to obtain scene data corresponding to the sofa.

[0121] The scene data corresponding to the sofa may refer to image data of the environment surrounding the sofa.

[0122] In some embodiments, the sofa can also control the camera to rise, fall and rotate, collect images of the environment around the sofa, and obtain scene data corresponding to the sofa.

[0123] Step 520: the sofa sends the scene data to the terminal device.

[0124] After obtaining the scene data, the sofa can send the scene data to the terminal device based on the communication connection with the terminal device.

[0125] Step 530: The terminal device receives scene data corresponding to the sofa, and generates a monitoring interface corresponding to the sofa according to the scene data. The monitoring interface includes a three-dimensional scene model of the environment surrounding the sofa.

[0126] The three-dimensional scene model of the sofa surrounding environment may refer to a virtual three-dimensional space showing the sofa surrounding environment. The sofa surrounding environment may be, for example, a table, potted plants, etc. around the sofa.

[0127] In some embodiments, the terminal device can construct a three-dimensional scene model of the environment around the sofa using a triangulation method based on multiple images of the sofa at different angles included in the scene data, and display the three-dimensional scene model on the monitoring interface.

[0128] In some embodiments, the terminal device can obtain depth information corresponding to the scene by comparing the differences between two or more images of the same scene in the environment around the sofa, generate a three-dimensional scene model of the environment around the sofa based on the depth information, and display the three-dimensional scene model on the monitoring interface.

[0129] Step 540: The terminal device obtains the target monitoring area selected on the three-dimensional scene model in response to the selection operation on the three-dimensional scene model.

[0130] The terminal device can display a three-dimensional scene model including the surrounding environment of the sofa on the monitoring interface. The user can select the three-dimensional scene model on the monitoring interface. Then the terminal device can obtain the target monitoring area selected on the three-dimensional scene model in response to the user's selection operation on the three-dimensional scene model.

[0131] In some embodiments, the three-dimensional scene model may include multiple preset monitoring objects, and the user may select the multiple preset monitoring objects on the monitoring interface, and then the terminal device may determine the selected preset monitoring object as the target monitoring area in response to the user's selection operation on the multiple preset monitoring objects. The preset monitoring object may refer to an object or a specific area in the environment surrounding the sofa.

[0132] In some embodiments, after acquiring the target monitoring area, the terminal device may highlight the target monitoring area to highlight the target monitoring area for user viewing convenience.

[0133] Step 550: The terminal device sends the target monitoring area to the sofa.

[0134] Step 560: the sofa controls the camera to collect images of the target monitoring area to obtain a real-time monitoring picture corresponding to the target monitoring area.

[0135] Step 570: Sofa identifies the real-time monitoring image and detects the occurrence of a security incident based on the real-time monitoring image.

[0136] Step 580: Sofa sends a warning message to the terminal device.

[0137] Step 590: The terminal device receives the warning information sent by the sofa and outputs the warning information.

[0138] Steps 550 to 590 have been described above, and the details may refer to the above description.

[0139] In the embodiment of the present application, the sofa controls the camera to collect images of the surrounding environment, obtains the scene data corresponding to the sofa, the sofa sends the scene data to the terminal device, the terminal device receives the scene data corresponding to the sofa, and generates a monitoring interface corresponding to the sofa according to the scene data, the monitoring interface includes a three-dimensional scene model of the sofa's surrounding environment, the terminal device responds to the selection operation of the three-dimensional scene model, obtains the target monitoring area selected on the three-dimensional scene model, the terminal device sends the target monitoring area to the sofa, the sofa controls the camera to collect images of the target monitoring area, obtains the real-time monitoring screen corresponding to the target monitoring area, the sofa identifies the real-time monitoring screen, detects the occurrence of a security incident according to the real-time monitoring screen, the sofa sends a warning message to the terminal device, the terminal device receives the warning message sent by the sofa, and outputs the warning message. This method allows the user to select a specific area as the target monitoring area in the three-dimensional scene model, enhances the user's sense of control and participation, makes the setting more flexible and personalized, and thus improves the flexibility of monitoring.

[0140] Figure 6 600 is a block diagram of the security monitoring device disclosed in the embodiment of the present application. The security monitoring device 600 can be applied to the above-mentioned sofa. Figure 6 As shown, the security monitoring device 600 includes a region receiving module 610 , an image acquisition module 620 and an information sending module 630 .

[0141] The area receiving module 610 is used to receive a target monitoring area sent by a terminal device; the target monitoring area is a monitoring area selected by the terminal device from the complete monitoring area corresponding to the monitoring device in response to a selection operation.

[0142] The image acquisition module 620 is used to control the camera to acquire images of the target monitoring area to obtain a real-time monitoring picture corresponding to the target monitoring area.

[0143] The information sending module 630 is used to identify the real-time monitoring screen. If a security incident is detected based on the real-time monitoring screen, a warning message is sent to the terminal device. The warning message is used to warn the target monitoring area of ​​the security incident.

[0144] In some embodiments, the monitoring device may further include a laser emitting device and a laser receiving device, and the safety monitoring device 600 may further include a laser curtain building module and a safety event determination module.

[0145] A laser curtain construction module is used to emit multiple laser beams to the target monitoring area through a laser emitting device to construct a laser curtain corresponding to the target monitoring area;

[0146] The safety event determination module is used to determine the occurrence of a safety event and send a warning message to the terminal device when the laser receiving device cannot receive part of the laser beam.

[0147] In some embodiments, the sofa includes a lifting device, which is connected to the monitoring device. The sofa is also provided with a receiving slot. The safety monitoring device 600 also includes a lifting control module.

[0148] The lifting control module is used to control the lifting device to be in a first lifting state when it is detected that the user is on the sofa, and the first lifting state refers to a state in which the lifting device and the monitoring device are completely stored in the receiving groove; when it is detected that the user leaves the sofa, the lifting device is controlled to be in a second lifting state, and the second lifting state refers to a state in which the lifting device at least partially extends from the receiving groove so that the monitoring device can monitor the target monitoring area.

[0149] In some embodiments, the security monitoring device 600 also includes an adjustment module.

[0150] The adjustment module is used to adjust the lifting height of the lifting device according to the target monitoring area, and / or to adjust the rotation angle of the monitoring device so that the monitoring device monitors the target monitoring area.

[0151] Figure 7 700 is a block diagram of another security monitoring device disclosed in an embodiment of the present application. The security monitoring device 700 can be applied to the above terminal device. Figure 7 As shown, the security monitoring device 700 may include an interface display module 710 , a region acquisition module 720 , a region sending module 730 and an information receiving module 740 .

[0152] The interface display module 710 is used to display the monitoring interface corresponding to the sofa, and the monitoring interface is used to display the complete monitoring area corresponding to the monitoring device.

[0153] The area acquisition module 720 is used to acquire a target monitoring area selected in the complete monitoring area in response to a selection operation on the monitoring interface.

[0154] The area sending module 730 is used to send the target monitoring area to the sofa, so that the sofa controls the camera to collect images of the target monitoring area and obtain a real-time monitoring picture corresponding to the target monitoring area.

[0155] The information receiving module 740 is used to receive the warning information sent by the sofa and output the warning information. The warning information is sent by the sofa when it identifies the real-time monitoring screen and detects a security incident based on the real-time monitoring screen; the warning information is used to warn the target monitoring area of ​​a security incident.

[0156] In some embodiments, the security monitoring device 700 further includes a scanning module, an identification module, and a request sending module.

[0157] The scanning module is used to scan the graphic code corresponding to the sofa through a camera.

[0158] The identification module is used to identify the graphic code to obtain the device identification information corresponding to the sofa; wherein the device identification information is used to uniquely identify the sofa.

[0159] The request sending module is used to send a connection request to the corresponding sofa based on the device identification information, and the connection request is used to establish a communication connection with the sofa.

[0160] In some embodiments, the interface display module 710 is further used to obtain scene data corresponding to the sofa, and generate a monitoring interface corresponding to the sofa according to the scene data, wherein the monitoring interface includes a three-dimensional scene model of the area surrounding the sofa.

[0161] The region acquisition module 720 is further configured to acquire a target monitoring region selected on the three-dimensional scene model in response to a selection operation on the three-dimensional scene model.

[0162] In the embodiment of the present application, the sofa receives the target monitoring area sent by the terminal device; the target monitoring area is the monitoring area selected by the terminal device in response to the selection operation from the complete monitoring area corresponding to the monitoring device; then, the sofa controls the camera to collect images of the target monitoring area to obtain the real-time monitoring screen corresponding to the target monitoring area; the real-time monitoring screen is identified, and if a security event is detected according to the real-time monitoring screen, a warning message is sent to the terminal device, and the warning message is used to warn the target monitoring area of ​​the security event. In the embodiment of the present application, the sofa is integrated with the monitoring device, and the sofa is connected to the terminal device for communication. The user can select the target monitoring area from the complete monitoring area corresponding to the monitoring device through the terminal device, so as to realize the personalized setting of the monitoring range of the sofa for personal items, thereby improving the flexibility of monitoring. At the same time, the sofa can identify the security events occurring in the real-time monitoring screen corresponding to the target monitoring area, and send a warning message to the terminal device when a security event occurs, thereby ensuring that the user can receive the notification and take corresponding measures in the first time, thereby improving the flexibility and real-time response capability of the sofa in monitoring personal items, and improving the level of safety protection in public places.

[0163] Figure 8 : is a structural block diagram of the sofa disclosed in the embodiment of the present application. Figure 8 As shown, the sofa 800 may include one or more of the following components: a processor 810, and a memory 820 coupled to the processor 810, wherein the memory 820 may store one or more computer programs, and the one or more computer programs may be configured to implement the security monitoring method applied to the sofa as described in the above embodiments when executed by one or more processors 810.

[0164] The processor 810 may include one or more processing cores. The processor 810 uses various interfaces and lines to connect the various parts of the entire sofa 800, and executes various functions and processes data of the sofa 800 by running or executing instructions, programs, code sets or instruction sets stored in the memory 820, and calling data stored in the memory 820. Optionally, the processor 810 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 810 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 810, but may be implemented separately through a communication chip.

[0165] The memory 820 may include a random access memory (RAM) or a read-only memory (ROM). The memory 820 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 820 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the sofa 800 during use, etc.

[0166] This embodiment discloses an electronic device, which includes a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the above instructions to implement the security monitoring method applied to the terminal device as described in the above embodiments.

[0167] An embodiment of the present application discloses a computer-readable storage medium. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can implement the security monitoring method applied to a sofa as described in the above embodiments.

[0168] An embodiment of the present application discloses a computer-readable storage medium. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can implement the security monitoring method applied to a terminal device as described in the above embodiments.

[0169] An embodiment of the present application discloses a computer program product, including a computer program, and the computer program can be executed by a processor to implement the security monitoring method described in the above embodiments.

[0170] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a ROM, etc.

[0171] As used herein, any reference to memory, storage, database, or other medium may include nonvolatile and / or volatile memory. Suitable nonvolatile memory may include ROM, programmable ROM (Programmable ROM, PROM), erasable PROM (Erasable PROM, EPROM), electrically erasable PROM (Electrically Erasable PROM, EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which is used as an external cache memory. By way of illustration and not limitation, RAM may be in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), memory bus direct RAM (RDRAM) and direct memory bus dynamic RAM (DRDRAM).

[0172] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application. It should be noted that "multiple" in the present application includes "two or more".

[0173] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0174] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0175] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0176] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0177] The above is a detailed introduction to a security monitoring method and device, electronic device, and storage medium disclosed in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core ideas of the present application. At the same time, for those of ordinary skill in the art, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A security monitoring method, characterized in that: Applied to a sofa, the sofa includes a monitoring device, the monitoring device includes a camera, the sofa is communicatively connected with a terminal device, and the method includes: receiving a target monitoring area sent by the terminal device; the target monitoring area is a monitoring area selected by the terminal device from the complete monitoring area corresponding to the monitoring device in response to a selection operation; Controlling the camera to collect images of the target monitoring area to obtain a real-time monitoring picture corresponding to the target monitoring area; The real-time monitoring screen is identified, and if a security incident is detected based on the real-time monitoring screen, a warning message is sent to the terminal device, wherein the warning message is used to warn the target monitoring area of ​​the security incident.

2. The method according to claim 1, characterized in that The monitoring device further includes a laser emitting device and a laser receiving device, and the method further includes: The laser emitting device emits a plurality of laser beams to the target monitoring area to construct a laser curtain corresponding to the target monitoring area; When the laser receiving device is unable to receive part of the laser light beam, it is determined that a safety incident has occurred, and a warning message is sent to the terminal device.

3. The method according to claim 1, characterized in that: The sofa comprises a lifting device, the lifting device is connected to the monitoring device, the sofa is also provided with a receiving slot, and the method further comprises: When it is detected that the user is on the sofa, the lifting device is controlled to be in a first lifting state, wherein the first lifting state refers to a state in which the lifting device and the monitoring device are completely stored in the receiving slot; When it is detected that the user leaves the sofa, the lifting device is controlled to be in a second lifting state, wherein the second lifting state refers to a state in which the lifting device is at least partially extended from the receiving slot so that the monitoring device can monitor the target monitoring area.

4. The method according to claim 3, characterized in that The method further comprises: The lifting height of the lifting device is adjusted according to the target monitoring area, and / or the rotation angle of the monitoring device is adjusted so that the monitoring device monitors the target monitoring area.

5. A security monitoring method, characterized in that: Applied to a terminal device, the terminal device is communicatively connected to a sofa, the sofa includes a monitoring device, and the monitoring device includes a camera; the method includes: Displaying a monitoring interface corresponding to the sofa, wherein the monitoring interface is used to display a complete monitoring area corresponding to the monitoring device; In response to a selection operation on the monitoring interface, acquiring a target monitoring area selected in the complete monitoring area; The target monitoring area is sent to the sofa, so that the sofa controls the camera to collect images of the target monitoring area, and obtains a real-time monitoring picture corresponding to the target monitoring area; Receive the warning information sent by the sofa and output the warning information, wherein the warning information is sent by the sofa when it identifies the real-time monitoring screen and detects a security incident based on the real-time monitoring screen; the warning information is used to warn the target monitoring area of ​​the security incident.

6. The method according to claim 5, characterized in that Before displaying the monitoring interface corresponding to the sofa, the method further includes: Scan the graphic code corresponding to the sofa through a camera; Identify the graphic code to obtain device identification information corresponding to the sofa; wherein the device identification information is used to uniquely identify the sofa; Based on the device identification information, a connection request is sent to the corresponding sofa, where the connection request is used to establish a communication connection with the sofa.

7. The method according to claim 5, characterized in that The monitoring interface corresponding to the sofa is displayed, including: Acquire scene data corresponding to the sofa, and generate a monitoring interface corresponding to the sofa according to the scene data, wherein the monitoring interface includes a three-dimensional scene model of the area around the sofa; The acquiring, in response to the selection operation on the monitoring interface, a target monitoring area selected in the complete monitoring area comprises: In response to a selection operation on the three-dimensional scene model, a target monitoring area selected on the three-dimensional scene model is acquired.

8. A security monitoring device, characterized in that: Applied to a sofa, the sofa includes a monitoring device, the device includes a camera, the sofa is communicatively connected with a terminal device, and the device includes: An area receiving module, used for receiving a target monitoring area sent by the terminal device; the target monitoring area is a monitoring area selected by the terminal device from the complete monitoring area corresponding to the monitoring device in response to a selection operation; An image acquisition module is used to control the camera to acquire images of the target monitoring area to obtain a real-time monitoring picture corresponding to the target monitoring area; The information sending module is used to identify the real-time monitoring screen. If a security incident is detected based on the real-time monitoring screen, a warning message is sent to the terminal device, and the warning message is used to warn the target monitoring area that the security incident has occurred.

9. A security monitoring device, characterized in that: Applied to a terminal device, the terminal device is communicatively connected to a sofa, the sofa comprises a monitoring device, the monitoring device comprises a camera; the device comprises: An interface display module, used to display a monitoring interface corresponding to the sofa, wherein the monitoring interface is used to display a complete monitoring area corresponding to the monitoring device; An area acquisition module, configured to acquire a target monitoring area selected in the complete monitoring area in response to a selection operation on the monitoring interface; An area sending module is used to send the target monitoring area to the sofa, so that the sofa controls the camera to collect images of the target monitoring area and obtain a real-time monitoring picture corresponding to the target monitoring area; The information receiving module is used to receive the warning information sent by the sofa and output the warning information. The warning information is sent by the sofa when it recognizes the real-time monitoring screen and detects a security incident based on the real-time monitoring screen; the warning information is used to warn the target monitoring area of ​​the security incident.

10. A sofa, characterized in that: include: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the method according to any one of claims 1 to 4 or 5 to 7.

Images