Terminal alarm method, device, storage medium and product

Abstract

The present application provides a terminal alarm method, device, storage medium and product, belonging to the field of Internet technology. The method is executed by an alarm device installed on a first terminal, and the alarm device is provided with a camera module; the method includes: when it is detected that a first user leaves a preset area in front of the display screen of the first terminal, detecting the preset area through the camera module, where the first user is the holder of the first terminal; when it is detected that a user enters the preset area, performing face recognition based on the detected first image; and when it is recognized that the first image includes a face image and the face image is not the face image of the first user, outputting an alarm signal. The present application alarms when it is recognized that other users approach the first terminal, so as to be able to timely prevent other users from stealing information in the first terminal and improve the security of the information in the first terminal.

Description

Technical Field

[0001] This application relates to the field of Internet technologies, and in particular, to a terminal alarm method, apparatus, storage medium, and product. Background Art

[0002] Due to the increasingly powerful functions of terminals such as mobile phones and computers. For example, a mobile phone has payment and shooting functions, so account information such as bank cards and a large number of pictures taken are stored in the mobile phone; again, a computer has an office function, so important files in the company are stored in the computer. Thus, it can be seen that a large amount of important information is stored in the terminal. Therefore, how to protect the important information in the terminal from being stolen by others is the focus of attention in the industry. Summary of the Invention

[0003] Embodiments of this application provide a terminal alarm method, apparatus, storage medium, and product, which can improve the security of information in the terminal. The technical solution is as follows:

[0004] On the one hand, a terminal alarm method is provided. The method is executed by an alarm device installed on a first terminal, and a camera module is provided on the alarm device. The method includes:

[0005] When it is detected that a first user leaves a preset area in front of the display screen of the first terminal, the preset area is detected by the camera module, where the first user is the holder of the first terminal;

[0006] When it is detected that a user enters the preset area, face recognition is performed based on the detected first image;

[0007] When it is recognized that the first image includes a face image and the face image is not the face image of the first user, an alarm signal is output.

[0008] In a possible implementation, the detecting the preset area by the camera module includes:

[0009] Determining the state of the display screen of the first terminal;

[0010] When the state of the display screen is unlocked, the preset area is detected by the camera module.

[0011] In another possible implementation, a rotatable base is provided at the bottom of the camera module. The determining the state of the display screen of the first terminal includes:

[0012] By rotating the rotatable base, the camera module is rotated, and the shooting area of the rotated camera module includes the display screen of the first terminal;

[0013] obtaining a second image by capturing it through the camera module, wherein the second image includes an image of a display screen of the first terminal;

[0014] performing content recognition on the second image;

[0015] If the identified image content is not the target content, determining that the state of the display screen of the first terminal is unlocked;

[0016] The target content includes at least one of screen saver content and black screen content.

[0017] In another possible implementation, the method further includes:

[0018] Controlling the state of the display screen to be changed from unlocked to locked;

[0019] After the alarm signal is released, the display screen is restored to an unlocked state.

[0020] In another possible implementation, the outputting of the alarm signal includes at least one of the following implementations:

[0021] The alarm device includes a vibration motor, which outputs a vibration signal, and the vibration signal is used to generate an alarm;

[0022] An alarm event is sent to the second terminal, where the alarm event includes the facial image.

[0023] In another possible implementation, after sending the alarm event to the second terminal, the method further includes:

[0024] Receive a voice signal sent by the second terminal and play the voice signal, where the voice signal is sent by the second terminal based on the alarm event and the voice signal indicates that a second user has left the preset area, and the second user is a user corresponding to the facial image included in the first image.

[0025] In another possible implementation, the method further includes:

[0026] continuously capturing images by the camera module, and determining that the first user has left the preset area when a third image currently captured does not include the first user and a fourth image includes the first user;

[0027] The third image is an image subsequent to the fourth image, and both the third image and the fourth image include image frames of the preset area.

[0028] In another possible implementation, the method further includes:

[0029] Receiving a detection instruction from the first terminal, and in response to the detection instruction, performing the step of detecting the preset area through the camera module;

[0030] wherein the detection instruction is triggered when the first terminal detects that the first user leaves the preset area.

[0031] In another possible implementation, the face recognition based on the detected first image includes:

[0032] Performing action recognition on the detected first image;

[0033] In the case where an action of touching the first terminal is recognized from the first image, performing face recognition based on the first image.

[0034] On the other hand, an alarm device is provided. The alarm device is installed on the first terminal, and the device includes:

[0035] A camera module, configured to detect the preset area when it detects that the first user leaves the preset area in front of the display screen of the first terminal, where the first user is the holder of the first terminal;

[0036] An identification module, configured to perform face recognition based on the detected first image when it detects that a user enters the preset area;

[0037] An alarm module, configured to output an alarm signal when it is recognized that the first image includes a face image and the face image is not the face image of the first user.

[0038] In a possible implementation, the camera module is configured to determine the state of the display screen of the first terminal; and when the state of the display screen is unlocked, detect the preset area through the camera module.

[0039] In another possible implementation, a rotatable base is provided at the bottom of the camera module; the camera module is configured to rotate the camera module by rotating the rotatable base, and the shooting area of the rotated camera module includes the display screen of the first terminal; obtaining a second image through the camera module, where the second image includes an image of the display screen of the first terminal; performing content recognition on the second image; and when the recognized image content is not the target content, determining that the state of the display screen of the first terminal is unlocked;

[0040] The target content includes at least one of screen saver content and black screen content.

[0041] In another possible implementation, the apparatus further includes:

[0042] A control module, configured to control the state of the display screen to be changed from unlocked to locked;

[0043] The recovery module is used to restore the state of the display screen to unlocked after the alarm signal is released.

[0044] In another possible implementation, the alarm module used in the alarm device includes a vibration motor, and the vibration motor outputs a vibration signal, and the vibration signal is used to generate an alarm;

[0045] The alarm module is configured to send an alarm event to the second terminal, where the alarm event includes the facial image.

[0046] In another possible implementation, the apparatus further includes:

[0047] A first receiving module, configured to receive a voice signal sent by the second terminal;

[0048] The playing module is used to play the voice signal, where the voice signal is sent by the second terminal based on the alarm event, and the voice signal indicates that the second user leaves the preset area. The second user is the user corresponding to the face image included in the first image.

[0049] In another possible implementation, the apparatus further includes:

[0050] a determination module, configured to continuously capture images using the camera module, and determine that the first user has left the preset area when a third image currently captured does not include the first user and a fourth image includes the first user,

[0051] The third image is an image subsequent to the fourth image, and both the third image and the fourth image include image frames of the preset area.

[0052] In another possible implementation, the apparatus further includes:

[0053] A second receiving module, configured to receive a detection instruction from the first terminal;

[0054] The camera module is configured to detect the preset area in response to the detection instruction;

[0055] The detection instruction is triggered when the first terminal detects that the first user leaves the preset area.

[0056] In another possible implementation, the recognition module is configured to perform action recognition on the detected first image; in the case where an action of touching the first terminal is recognized from the first image, face recognition is performed based on the first image.

[0057] On the other hand, an alarm device is provided. The alarm device includes one or more processors and one or more memories. At least one program code is stored in the one or more memories, and the at least one program code is loaded and executed by the one or more processors to implement the terminal alarm method according to any of the above implementations.

[0058] On the other hand, a computer-readable storage medium is provided. At least one program code is stored in the computer-readable storage medium, and the at least one program code is loaded and executed by the alarm device to implement the terminal alarm method according to any of the above implementations.

[0059] On the other hand, a computer program product is provided. The computer program product includes computer program code. The computer program code is stored in a computer-readable storage medium. A processor of the alarm device reads the computer program code from the computer-readable storage medium, and the processor executes the computer program code, so that the alarm device executes the terminal alarm method according to any of the above implementations.

[0060] In the embodiments of the present application, an alarm device is developed. The alarm device is installed on the first terminal. Through the camera module of the alarm device, it is recognized by image recognition whether there are other users (users other than the owner of the first terminal) approaching the first terminal; when it is recognized that other users are approaching the first terminal, an alarm is issued, so as to be able to timely prevent other users from stealing information in the first terminal and improve the security of the information in the first terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0062] Figure 1 is a schematic diagram of an implementation environment of a terminal alarm provided by an embodiment of the present application;

[0063] Figure 2 is a schematic diagram of two terminals communicating with an alarm device through an APP corresponding to the alarm device provided by an embodiment of the present application;

[0064] Figure 3 is a flowchart of a terminal alarm method provided by an embodiment of the present application;

[0065] Figure 4 is a flowchart of another terminal alarm method provided by an embodiment of the present application;

[0066] Figure 5 is a flowchart of another terminal alarm method provided by an embodiment of the present application;

[0067] Figure 6 is a flowchart of another terminal alarm method provided by an embodiment of the present application;

[0068] Figure 7 is a flowchart of another terminal alarm method provided by an embodiment of the present application;

[0069] Figure 8 is a block diagram of a terminal alarm device provided by an embodiment of the present application;

[0070] Figure 9 is a block diagram of an alarm device provided by an embodiment of the present application. Detailed implementation manners

[0071] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0072] It should be noted that the user information involved in the present application (including but not limited to user device information, user personal information, etc.) is information authorized by the user or fully authorized by all parties.

[0073] The terms "first", "second", "third", "fourth", etc. in the specification and claims of the present application and the accompanying drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products, or devices.

[0074] Figure 1It is a schematic diagram of an implementation environment for terminal alarm provided by an embodiment of the present application; this implementation environment includes an alarm device 101 and a first terminal 102. The alarm device 101 is installed on the first terminal 102 and is used to protect the information in the first terminal 102. That is, when other users (users other than the owner of the first terminal 102) approach the first terminal 102, the alarm device 101 gives an alarm to prompt other users to stay away from the first terminal 102, thereby protecting the information in the first terminal 102.

[0075] It should be noted that the alarm device 101 can be installed at any position of the first terminal 102; for example, the alarm device 101 can be installed at any one of the four top corners of the first terminal 102; for another example, the alarm device 101 is installed on the display screen of the first terminal 102. In the embodiment of the present application, the specific position where the alarm device 101 is installed on the first terminal 102 is not specifically limited. And the alarm device 101 can be installed on the first terminal 102 by means of pasting, USB interface or charging interface, etc. Therefore, the alarm device 101 can be installed on any first terminal 102, and the adaptability is good.

[0076] It should be noted that the shape of the alarm device 101 can be any shape such as a cube, a cuboid, a sphere, etc., and the size of the alarm device 101 can be relatively small, that is, the size of the alarm device 101 is smaller than a preset size. For example, the size of the alarm device 101 is about the same as that of a candy, so that the alarm device 101 is convenient to carry, can not only play a concealment role, but also reduce the occlusion of the display screen of the first terminal 102 by the alarm device 101. Among them, the preset size can be set and changed as needed. In the embodiment of the present application, the preset size is not specifically limited.

[0077] Among them, when other users approach the first terminal 102, the alarm device 101 can give an alarm by sending an alarm event to other terminals; correspondingly, a second terminal 103 is also included in this implementation environment. When other users approach the first terminal 102, the alarm device 101 sends an alarm event to the second terminal 103 to give an alarm.

[0078] Before the alarm device 101 sends an alarm event to the second terminal 103, the alarm device 101 needs to obtain the terminal identifier of the second terminal 103. This process can be as follows: The alarm device 101 establishes a communication connection with the second terminal 103 through the IOT (Internet of Things) method, and thus obtains the terminal identifier of the second terminal 103 based on this communication connection; alternatively, the alarm device 101 establishes a communication connection with the second terminal 103 through a short-range communication module, and thus obtains the terminal identifier of the third terminal 102 based on this communication connection. The short-range module can be NFC (Near Field Communication) or Wifi (Wireless Fidelity), etc. In the embodiments of the present application, no specific limitation is made thereto.

[0079] The first terminal 102 is a mobile phone, a laptop computer, a desktop computer, etc., but is not limited thereto. The second terminal 103 can be a mobile phone or a wearable device, etc., but is not limited thereto. In Figure 1 the example of the first terminal 102 being a desktop computer is described.

[0080] For example, the first terminal 102 is a laptop computer or a desktop computer, and the second terminal 103 is a mobile phone; when the user leaves the laptop or desktop computer, the alarm device 101 can detect a preset area in front of the display screen of the laptop or desktop computer. When it detects that another user enters this preset area, the alarm device 101 can trigger an alarm to the user's mobile phone to notify the user in a timely manner.

[0081] For another example, the first terminal 102 is a mobile phone, and the second terminal 103 is a wearable device; when the user leaves the mobile phone, the alarm device 101 can detect a preset area in front of the display screen of the mobile phone. When it detects that another user enters this preset area, the alarm device 101 can trigger an alarm to the user's wearable device to notify the user in a timely manner.

[0082] Figure 2 is a schematic diagram of communication between two terminals and an alarm device through an APP corresponding to the alarm device provided by the embodiments of the present application; the second terminal 103 is installed with an APP (Application) corresponding to the alarm device 101, and communicates with the alarm device 101 through this APP. For example, referring to Figure 2 , if the second terminal 103 is a desktop computer, then the desktop computer is installed with an APP corresponding to the alarm device 101, and communicates with the alarm device 101 through this APP, so that the alarm device 101 sends an alarm event to the desktop computer for alarm. And, the desktop computer can also view historical alarm records, etc. through this APP. For another example, continuing to refer to Figure 2, if the first terminal 102 is a mobile phone, an APP corresponding to the alarm device 101 is installed on the mobile phone, and communication is carried out with the alarm device 101 through the APP, so as to view historical alarm records, etc. through the APP.

[0083] Figure 3 It is a flowchart of a terminal alarm method provided by an embodiment of the present application. The execution subject is an alarm device. The alarm device is installed on a first terminal, and a camera module is provided on the alarm device. See Figure 3 The method includes:

[0084] Step 301: When it is detected that the first user leaves the preset area in front of the display screen of the first terminal, the preset area is detected through the camera module, and the first user is the holder of the first terminal.

[0085] The alarm device is installed on the first terminal, and the alarm device can be installed at any position capable of capturing an image of the preset area; for example, the alarm device is installed on the display screen of the first terminal. Among them, the alarm device can be an intelligent chip, and an alarm sensing program and a camera module are deployed in the alarm device. The camera module is used to detect the preset area, and the alarm sensing program is used to alarm when it is detected that other users approach the first terminal. The camera module can be an intelligent micro camera, and the intelligent micro camera can automatically identify and photograph faces.

[0086] Step 302: When it is detected that a user enters the preset area, face recognition is performed based on the detected first image.

[0087] The alarm device identifies whether there is a face image in the first image; in the case where it is recognized that the first image includes a face image, it is determined whether the face image is the face image of the first user; in the case where the face image is not the face image of the first user, step 303 is executed; in the case where the first image does not include a face image or the face image is the face image of the first user, it ends.

[0088] Among them, the face image of the first user is pre-recorded in the alarm device, so as to compare the face image in the first image with the face image of the first user, so as to determine whether the face image included in the first image is the face image of the first user. When the face image included in the first image is not the face image of the first user, step 303 is executed; when the face image included in the first image is the face image of the first user, the alarm is not triggered, so that when used by the user himself, the alarm will not be triggered, avoiding false alarms. Moreover, when the first user uses the first terminal, it only needs to be recognized by the camera module in sequence to be used normally permanently, while when someone else approaches the first terminal, the alarm is triggered, thereby improving the security of the information in the first terminal. Even if the first user forgets to lock the display screen of the first terminal, important files and the lock screen password will not be lost.

[0089] Step 303: When it is recognized that the first image includes a face image and the face image is not the face image of the first user, an alarm signal is output.

[0090] The alarm signal can be a voice signal, a vibration signal, a text message, or an alarm event triggered to other terminals (such as the second terminal). In the embodiments of the present application, the alarm signal is not specifically limited.

[0091] In the embodiments of the present application, an alarm device is developed and installed on the first terminal. Through the camera module of the alarm device, it is recognized by image recognition whether there are other users (users other than the owner of the first terminal) approaching the first terminal; when it is recognized that other users are approaching the first terminal, an alarm is issued, so as to timely prevent other users from stealing the information in the first terminal and improve the security of the information in the first terminal.

[0092] Figure 4 It is a flowchart of a terminal alarm method provided by the embodiments of the present application. The execution subject is an alarm device, which is installed on the first terminal and a camera module is provided on the alarm device; see Figure 4 This method includes:

[0093] Step 401: When it is detected that the first user leaves the preset area in front of the display screen of the first terminal, the alarm device detects the preset area through the camera module, and the first user is the holder of the first terminal.

[0094] When the first user leaves the preset area in front of the display screen of the first terminal, other users may approach the first terminal, thereby stealing the information in the first terminal. At this time, the alarm device starts to detect the preset area through the camera module to detect whether a user enters the preset area. When the alarm device detects that a user enters the preset area, step 402 is executed; when the alarm device does not detect a user entering the preset area, the preset area is continuously detected through the camera module.

[0095] In the embodiment of the present application, it can be detected by the alarm device whether the first user leaves the preset area, or it can be detected by the first terminal whether the first user leaves the preset area. Among them, the process of detecting by the alarm device whether the first user leaves the preset area can be:

[0096] The alarm device continuously takes images through the camera module. In the case that the current captured third image does not include the first user and the fourth image includes the first user, it is determined that the first user leaves the preset area; in the case that both the third image and the fourth image include the first user, it is determined that the first user does not leave the preset area. Among them, the third image is the image after the fourth image, and both the third image and the fourth image include the image screen of the preset area.

[0097] In the embodiment of the present application, it is detected by the alarm device whether the first user leaves the preset area, which saves the time required for the alarm device to interact with the first terminal and improves the detection efficiency.

[0098] Among them, the process of detecting by the first terminal whether the first user leaves the preset area can be:

[0099] When the first terminal detects that the first user leaves the preset area, the first terminal sends a detection instruction to the alarm device, and this detection instruction is triggered when the first terminal detects that the first user leaves the preset area; the alarm device receives the detection instruction of the first terminal and determines that the first user leaves the preset area. Among them, the process of the first terminal detecting whether the first user leaves the preset area is similar to the process of the alarm device detecting whether the first user leaves the preset area, and will not be elaborated here.

[0100] It should be noted that when the first terminal detects whether the first user leaves the preset area, the alarm device executes the step of detecting the preset area through the camera module in response to this detection instruction.

[0101] In the embodiment of the present application, it is detected by the first terminal whether the first user leaves the preset area and the detection result is notified to the alarm device. In this way, the alarm device does not need to have this detection function, which reduces the requirements for the processing chip of the alarm device, and further reduces the volume of the alarm device, making the alarm device very small and improving the concealment.

[0102] It should be noted that the vertical distance between the preset area and the display screen can be 0.5 meters, 1 meter, etc., and the size of the preset area can be 1*1 meter, 2*2 meters, etc.

[0103] Step 402: When it is detected that a user enters the preset area, the alarm device performs face recognition based on the detected first image.

[0104] Since the user entering the preset area may be the first user or other users, an alarm is required only when it is detected that other users enter the preset area; therefore, when it is detected that a user enters the preset area, the alarm device performs face recognition based on the detected first image to determine whether the user entering the preset area is the first user. If it is determined that the user entering the preset area is the first user, the detection of the preset area by the camera module is stopped; if it is determined that the user entering the preset area is not the first user, step 403 is executed.

[0105] Among them, the alarm device intercepts the region of interest including the face from the first image, performs face recognition on the region of interest, and obtains a face image. And, the alarm device includes a face recognition model, and the alarm device can perform face recognition on the first image through the face recognition model.

[0106] In addition, before performing face recognition, the first terminal first determines whether there is a face image in the currently detected first image; if the currently detected first image does not include a face image, the first image is re-detected until a first image including a face image is detected. It should be noted that the camera module can be a rotatable camera module, and the alarm device can also rotate the camera module to detect a first image including a face image.

[0107] Step 403: When it is recognized that the first image includes a face image and the face image is not the face image of the first user, the alarm device sends an alarm event to the second terminal, and the alarm event includes the face image.

[0108] The alarm event includes a face image, which enables the second terminal to view the personnel photo at any time, and relevant personnel can be found through big data subsequently, improving the security; and, the face image can also be used as evidence.

[0109] It should be noted that the alarm device needs to obtain the terminal identifier of the second terminal in advance; correspondingly, in this step, the alarm device sends an alarm event to the second terminal based on the terminal identifier of the second terminal. The process by which the alarm device obtains the terminal identifier of the second terminal includes: the second terminal runs the APP corresponding to the alarm device, obtains an identifier acquisition interface based on the APP, and obtains the terminal identifier of the second terminal based on the identifier acquisition interface.

[0110] Another point that needs to be explained is that the APP also stores alarm records, which include the time of each alarm and the face images included in the alarm event, facilitating the second terminal to view the face images based on the APP and thus find the corresponding person.

[0111] Step 404: The second terminal receives the alarm event and sends a voice signal to the alarm device based on the alarm event. The voice signal instructs the second user to leave the preset area, and the second user is the user corresponding to the face image included in the first image.

[0112] The holder of the second terminal is also the first user; after the second terminal receives the alarm event, it outputs the alarm event. The process by which the second terminal outputs the alarm event includes: the second terminal outputs the alarm event by vibrating, that is, the terminal displays the face image included in the alarm event and vibrates to prompt the first user. In addition, after the second terminal displays the face image, the first user can also drive the second user to leave by voice, thereby reducing the probability of the second user stealing information in the first terminal and improving the security of the information in the first terminal. The voice signal can be "Please leave" or "Master is coming back soon, please leave", etc.

[0113] Step 405: The alarm device receives the voice signal and plays the voice signal.

[0114] The alarm device can play the voice signal once or play the voice signal in a loop until the second user leaves the preset area.

[0115] It should be noted that the alarm device can also store in advance the voice signal for alarm; in the case where it is recognized that the first image includes a face image and the face image is not the face image of the first user, the alarm device outputs the stored voice signal for alarm. Correspondingly, steps 304 - 305 can be replaced with: in the case where it is recognized that the first image includes a face image and the face image is not the face image of the first user, the alarm device outputs the stored voice signal for alarm and sends an alarm event to the second terminal, and the alarm event includes the face image.

[0116] Another point to note is that the second terminal can also view the surrounding people near it through the camera module based on the APP corresponding to the alarm device, so that when the first user forgets to lock the display screen of the second terminal, the people around the second terminal can be viewed in time.

[0117] Another point to note is that the alarm device can also detect whether the camera module is blocked. When the camera module is blocked for a first preset duration, an alarm signal is output, so as to prevent other users from maliciously blocking the camera module to steal the information in the first terminal, thereby improving the security of the information in the first terminal.

[0118] Another point to note is that a gyroscope sensor is also provided in the alarm device. The gyroscope sensor is used to detect whether the alarm device is removed from the first terminal; when it is detected that the alarm device is removed from the first terminal, an alarm signal is output, so as to prevent other users from maliciously removing the camera module to steal the information in the first terminal, thereby improving the security of the information in the first terminal.

[0119] In the embodiment of the present application, an alarm device is developed. The alarm device is installed on the first terminal. Through the camera module of the alarm device, it is identified by image recognition whether there are other users (users other than the owner of the first terminal) approaching the first terminal; when it is identified that other users approach the first terminal, an alarm event including a face image is triggered to the second terminal, so that the first user can view the face image in time through the second terminal and can find relevant personnel through big data.

[0120] Figure 5 is a flowchart of a terminal alarm method provided by an embodiment of the present application. The execution subject is an alarm device. The alarm device is installed on the first terminal, and a camera module and a vibration motor are provided on the alarm device; see Figure 5 This method includes:

[0121] Step 501: When it is detected that the first user leaves a preset area in front of the display screen of the first terminal, the alarm device detects the preset area through the camera module, and the first user is the holder of the first terminal.

[0122] Step 502: When it is detected that a user enters the preset area, the alarm device performs face recognition based on the detected first image.

[0123] It should be noted that steps 501-502 are the same as steps 401-402, and will not be elaborated here again.

[0124] Step 503: When it is recognized that the first image includes a face image and the face image is not the face image of the first user, the alarm device outputs a vibration signal through the vibration motor, and the vibration signal is used for alarm.

[0125] The alarm device outputs a vibration signal through a vibration motor, which can drive the second user to leave the preset area, reduce the threat to the information in the first terminal, and thus protect the security of the information in the first terminal. Moreover, the alarm device can continuously output a vibration signal through the vibration motor until the second user leaves the preset area. Alternatively, a stop button is provided on the alarm device. After the first user returns to the preset area, the first user can press the stop button to trigger the alarm device to stop outputting the vibration signal. In addition, while the alarm device outputs a vibration signal through the vibration motor, it can also output a voice signal for alarm, enhancing the alarm effect.

[0126] The voice signal for alarm is stored in the alarm device in advance, and this voice signal can be recorded by the first user in advance, making the voice signal more real. In addition, multiple voice signals can also be stored in the alarm device. The alarm device can determine the user type of the second user according to the face image, determine the voice signal matching the user type from the multiple voice signals, and play the determined voice signal, so as to drive the second user to leave the preset area through the targeted voice signal. The user type can be children, women, men, the elderly, etc.

[0127] In the embodiment of the present application, an alarm device is developed and installed on the first terminal. Through the camera module of the alarm device, it is identified by image recognition whether there is other user (users other than the owner of the first terminal) approaching the first terminal; when it is detected that other users approach the first terminal, a vibration signal is output for alarm, so as to be able to drive other users away from the first terminal and improve the security of the information in the first terminal.

[0128] Figure 6 It is a flowchart of a terminal alarm method provided by the embodiment of the present application. The execution entity is the alarm device, which is installed on the first terminal and a camera module is provided on the alarm device; see Figure 6 and this method includes:

[0129] Step 601: When it is detected that the first user leaves the preset area in front of the display screen of the first terminal, the alarm device detects the preset area through the camera module, and the first user is the holder of the first terminal.

[0130] Step 601 is the same as step 401 and will not be elaborated here.

[0131] Step 602: When it is detected that a user enters the preset area, the alarm device determines the state of the display screen of the first terminal.

[0132] In a possible implementation, when the display screen of the first terminal is in the locked state, the display screen of the first terminal generally displays a screensaver or a black screen; therefore, the alarm device determines the state of the display screen of the first terminal by identifying the content of the display screen through an image processing method. Moreover, a rotatable base is provided at the bottom of the camera module, and by rotating the rotatable base, the camera module can be rotated so that the camera module can capture the display screen of the first terminal; correspondingly, this process can be as follows:

[0133] The alarm device rotates the camera module by rotating the rotatable base. The shooting right of the rotated camera module includes the display screen of the first terminal; a second image is captured through the camera module, and the second image includes the image screen of the display screen of the first terminal; the content of the second image is identified; in the case where the identified image content is not the target content, it is determined that the state of the display screen of the first terminal is unlocked; in the case where the identified image content is the target content, it is determined that the state of the display screen of the first terminal is locked. Among them, the target content includes at least one of the screensaver content and the black screen content. In the embodiments of the present application, the state of the display screen of the first terminal is determined through an image processing method, and the accuracy is relatively high.

[0134] In another implementation, the first terminal communicates with the alarm device through a heartbeat. When the display screen of the first is in the locked state, the first terminal is in the sleep state, and at this time, the first terminal will not send a heartbeat to the alarm device; therefore, the alarm device can determine the state of the display screen of the first terminal by whether it receives the heartbeat of the first terminal, and this process can be as follows:

[0135] If the alarm device does not receive the heartbeat of the first terminal within the second preset duration before the current time, it is determined that the state of the display screen of the first terminal is locked; if the alarm device receives the heartbeat of the first terminal within the second preset duration before the current time, it is determined that the state of the display screen of the first terminal is unlocked. Among them, the second preset duration can be set and changed according to the frequency of the heartbeat interaction between the first terminal and the alarm device. In the embodiments of the present application, the second preset duration is not specifically limited.

[0136] Step 603: When the state of the display screen is unlocked, the alarm device performs face recognition based on the detected first image.

[0137] The steps for the alarm device to perform face recognition based on the first image are the same as those in step 302 where the alarm device performs face recognition based on the detected first image, and will not be elaborated here.

[0138] Step 604: When it is recognized that the first image includes a face image and the face image is not the face image of the first user, the alarm device outputs an alarm signal.

[0139] Step 604 can be implemented through steps 403-405, or through step 503, and will not be described in detail here.

[0140] It should be noted that when the alarm device outputs the alarm signal, it controls the display screen status to be locked from unlocked, thereby protecting the information in the first terminal from being stolen. Furthermore, after the alarm signal is released, the display screen status is restored to unlocked, thereby facilitating the first user's operation of the first terminal. The first user can then release the alarm signal by operating the second terminal.

[0141] In an embodiment of the present application, an alarm device is developed and installed on a first terminal. The camera module of the alarm device uses image recognition to identify whether other users (users other than the owner of the first terminal) are approaching the first terminal. When other users are identified as approaching the first terminal and the display screen of the first terminal is unlocked, there will be security risks in the information in the first terminal. At this time, an alarm is issued, thereby improving the security of the information in the first terminal.

[0142] Figure 7 This is a flow chart of a terminal alarm method provided by an embodiment of the present application. The execution subject is an alarm device, which is installed on the first terminal and is provided with a camera module; see Figure 7 , the method comprising:

[0143] Step 701: When detecting that a first user leaves a preset area in front of a display screen of a first terminal, the alarm device determines the state of the display screen of the first terminal, and the first user is the holder of the first terminal.

[0144] Step 701 is the same as step 602 in which the alarm device determines the state of the display screen of the first terminal, and will not be described in detail here.

[0145] Step 702: When the display screen is unlocked, the alarm device detects a preset area through a camera module.

[0146] Step 702 is the same as step 402 and will not be described again here.

[0147] Step 703: When it is detected that a user enters the preset area, the alarm device performs motion recognition on the detected first image.

[0148] When other users enter the preset area, they may just take a look or pass by, and at this time, it will not pose a threat to the information in the first terminal. Therefore, the alarm device can further identify whether other users have the action of touching the first terminal. When other users have the action of touching the first terminal, an alarm is triggered. When other users do not have the action of touching the first terminal, the preset area is continuously detected through the camera module.

[0149] Among them, an action recognition model is pre-set in the alarm device. Through this action recognition model, the action is recognized from the first image. It is determined whether the action is the target action. When the action is the target action, it is determined that the action of touching the first terminal is recognized from the first image, and step 604 is executed. When the action is not the target action, it is determined that the action of touching the first terminal is not recognized from the first image, and the preset area is continuously detected through the camera device. Among them, the target action is the action of touching the first terminal. For example, the target action is a copy action, an action of deleting information, etc.

[0150] Step 704: When the action of touching the first terminal is recognized from the first image, the alarm device performs face recognition based on the first image.

[0151] The process of the alarm device performing face recognition based on the first image in step 704 is the same as that of the alarm device performing face recognition based on the detected first image in step 402, and will not be elaborated here.

[0152] Step 705: When it is recognized that the first image includes a face image and the face image is not the face image of the first user, the alarm device outputs an alarm signal.

[0153] Step 705 can be implemented through steps 403 - 405, or can be implemented through step 503, and will not be elaborated here.

[0154] In the embodiment of the present application, an alarm device is developed. The alarm device is installed on the first terminal. Through the camera module of the alarm device, it is recognized by image recognition whether there are other users (users other than the owner of the first terminal) approaching the first terminal. When it is recognized that other users are approaching the first terminal and it is recognized that other users are touching the first terminal, there will be a security risk for the information in the first terminal, and an alarm is triggered at this time, thereby improving the security of the information in the first terminal and solving the problem of worrying about file loss when forgetting to lock the screen when the user is not present.

[0155] Figure 8 It is a block diagram of a terminal alarm device provided by an embodiment of the present application; see Figure 8 As shown in the figure, the alarm device is installed on the first terminal, and the device includes:

[0156] The camera module 801 is configured to detect a preset area in front of a display screen of a first terminal when detecting that the first user leaves the preset area in front of the display screen of the first terminal, where the first user is the holder of the first terminal;

[0157] The recognition module 802 is configured to perform face recognition based on the detected first image when detecting that a user has entered a preset area;

[0158] The alarm module 803 is configured to output an alarm signal when it is recognized that the first image includes a face image and the face image is not the face image of the first user.

[0159] In a possible implementation, the camera module 801 is used to determine the state of the display screen of the first terminal; when the state of the display screen is unlocked, the camera module 801 detects the preset area.

[0160] In another possible implementation, a rotatable base is provided at the bottom of the camera module 801; the camera module 801 is configured to rotate the rotatable base to rotate the camera module 801, so that the shooting area of the rotated camera module 801 includes the display screen of the first terminal; a second image is captured by the camera module 801, and the second image includes an image of the display screen of the first terminal; content recognition is performed on the second image; and if the recognized image content is not the target content, the status of the display screen of the first terminal is determined to be unlocked;

[0161] The target content includes at least one of screen saver content and black screen content.

[0162] In another possible implementation, the apparatus further includes:

[0163] A control module, used for controlling the state of the display screen to be changed from unlocked to locked;

[0164] The recovery module is used to restore the state of the display screen to unlocked after the alarm signal is released.

[0165] In another possible implementation, the alarm module 803 is used for the alarm device to include a vibration motor, which outputs a vibration signal, and the vibration signal is used to generate an alarm;

[0166] The alarm module 803 is configured to send an alarm event to the second terminal, where the alarm event includes a face image.

[0167] In another possible implementation, the apparatus further includes:

[0168] A first receiving module, configured to receive a voice signal sent by a second terminal;

[0169] A playback module for playing a voice signal, which is sent by a second terminal based on an alarm event and indicates that a second user has left a preset area, where the second user is the user corresponding to the face image included in the first image.

[0170] In another possible implementation, the device further includes:

[0171] A determination module for continuously capturing images through the camera module 801, and determining that the first user has left the preset area when the first user is not included in the currently captured third image and the first user is included in the fourth image,

[0172] where the third image is the image after the fourth image, and both the third image and the fourth image include the image frame of the preset area.

[0173] In another possible implementation, the device further includes:

[0174] A second receiving module for receiving a detection instruction from the first terminal;

[0175] A camera module for detecting the preset area in response to the detection instruction;

[0176] where the detection instruction is triggered when the first terminal detects that the first user has left the preset area.

[0177] In another possible implementation, the recognition module 802 is used to perform action recognition on the detected first image; in the case of recognizing an action of touching the first terminal from the first image, face recognition is performed based on the first image.

[0178] In the embodiments of the present application, an alarm device is developed and installed on the first terminal. Through the camera module 801 of the alarm device, it is recognized by image recognition whether there is another user (a user other than the owner of the first terminal) approaching the first terminal; when it is recognized that another user is approaching the first terminal, an alarm is given, so as to be able to timely prevent other users from stealing information in the first terminal and improve the security of the information in the first terminal.

[0179] It should be noted that: when the terminal alarm device provided in the above embodiments alarms, only the above-mentioned functional module division is used for illustration. In actual application, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the alarm device is divided into different functional modules to complete all or part of the functions described above. In addition, the terminal alarm device provided in the above embodiments and the embodiments of the terminal alarm method belong to the same concept, and the specific implementation process is detailed in the method embodiments and will not be repeated here.

[0180] Figure 9It is a block diagram of an alarm device 900 provided by an embodiment of the present application. The alarm device 900 includes: a camera module 901, a processor 902, and a memory 903.

[0181] The processor 902 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 902 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 902 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake state, also known as the CPU (Central Processing Unit); the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 902 may be integrated with a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 902 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computational operations related to machine learning.

[0182] The memory 903 may include one or more computer-readable storage media, and the computer-readable storage media may be non-transitory. The memory 903 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 903 is used to store at least one program code, and the at least one program code is used to be executed by the processor 902 to implement the terminal alarm method provided by the method embodiment in the present application.

[0183] In some embodiments, the alarm device 900 may further optionally include: a peripheral device interface 904 and at least one peripheral device. The processor 902, the memory 903, and the peripheral device interface 904 may be connected through a bus or signal lines. Each peripheral device may be connected to the peripheral device interface 904 through a bus, signal lines, or a circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 905, an audio circuit 906, a positioning component 907, and a power supply 908.

[0184] The peripheral device interface 904 can be used to connect at least one I / O (Input / Output) related peripheral device to the processor 902 and the memory 903. In some embodiments, the processor 902, the memory 903, and the peripheral device interface 904 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 902, the memory 903, and the peripheral device interface 904 can be implemented on separate chips or circuit boards, and this embodiment does not limit this.

[0185] The radio frequency circuit 905 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 905 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 905 converts an electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 905 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so on. The radio frequency circuit 905 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: metropolitan area network, generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area network, and / or WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 905 may further include a circuit related to NFC (Near Field Communication), and this application does not limit this.

[0186] The audio circuit 906 may include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and converts the sound waves into electrical signals for input to the processor 902 for processing, or input to the radio frequency circuit 905 to achieve voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the alarm device 900. The microphone may also be an array microphone or an omnidirectional collection type microphone. The speaker is used to convert the electrical signal from the processor 902 or the radio frequency circuit 905 into sound waves. The speaker may be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for uses such as ranging. In some embodiments, the audio circuit 906 may further include a headphone jack.

[0187] The positioning component 907 is used to locate the current geographical location of the alarm device 900 to implement navigation or LBS (Location Based Service). The positioning component 907 can be a positioning component based on the GPS (Global Positioning System) of the United States, the Beidou system of China, the GLONASS system of Russia, or the Galileo system of the European Union.

[0188] The power supply 908 is used to supply power to each component in the alarm device 900. The power supply 908 can be alternating current, direct current, a disposable battery, or a rechargeable battery. When the power supply 908 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0189] Those skilled in the art can understand that Figure 9 the structure shown in does not constitute a limitation on the alarm device 900, and it may include more or fewer components than shown in the figure, or combine some components, or adopt a different component layout.

[0190] The embodiment of the present application also provides a computer-readable storage medium, in which at least one program code is stored, and the at least one program code is loaded and executed by a processor to implement the terminal alarm method in any of the above implementation manners.

[0191] The embodiment of the present application also provides a computer program product, the computer program product includes computer program code, the computer program code is stored in a computer-readable storage medium, and the processor of the electronic device reads the computer program code from the computer-readable storage medium, and the processor executes the computer program code, so that the electronic device executes the terminal alarm method in any of the above implementation manners.

[0192] In some embodiments, the computer program product involved in the embodiment of the present application can be deployed on an electronic device for execution, or on multiple electronic devices located at one place for execution, or, on multiple electronic devices distributed at multiple places and interconnected through a communication network for execution. The multiple electronic devices distributed at multiple places and interconnected through a communication network can form a blockchain system.

[0193] The above are only optional embodiments of the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A terminal alarm method, characterized in that, The method is performed by an alarm device installed on a first terminal and provided with a camera module; the alarm device is also provided with a gyroscope sensor, and the bottom of the camera module is provided with a rotatable base; the method includes: Continuously capturing images using the camera module, and determining that the first user has left a preset area in front of the display screen of the first terminal when a third image currently captured does not include the first user and a fourth image includes the first user; wherein the third image is an image subsequent to the fourth image, and both the third image and the fourth image include image frames of the preset area in front of the display screen of the first terminal; When it is detected that the first user has left the preset area, the camera module is rotated by rotating the rotatable base, so that the shooting area of the camera module after rotation includes the display screen of the first terminal; a second image is captured by the camera module, and the second image includes an image of the display screen of the first terminal; content recognition is performed on the second image; if the recognized image content is not target content, the state of the display screen of the first terminal is determined to be unlocked; wherein the target content includes at least one of screen saver content and black screen content; When the display screen is unlocked, the preset area is detected by the camera module, and the first user is a holder of the first terminal; When detecting that a user enters the preset area, performing action recognition on the detected first image; When an action of touching the first terminal is recognized from the first image, performing face recognition based on the detected first image; outputting a first alarm signal when recognizing that the first image includes a face image and the face image is not that of the first user; controlling the state of the display screen to change from unlocked to locked; and restoring the state of the display screen to unlocked after the first alarm signal is released; The method further includes: detecting, by the gyroscope sensor, whether the alarm device is removed from the first terminal; and outputting a second alarm signal when detecting that the alarm device is removed from the first terminal; Detect whether the camera module is blocked, and output an alarm signal when the camera module is blocked for a first preset time period.

2. The method according to claim 1, characterized in that Outputting the first alarm signal includes at least one of the following implementations: The alarm device includes a vibration motor, which outputs a vibration signal, and the vibration signal is used to generate an alarm; An alarm event is sent to the second terminal, where the alarm event includes the facial image.

3. The method according to claim 2, wherein After sending the alarm event to the second terminal, the method further includes: Receive a voice signal sent by the second terminal and play the voice signal, where the voice signal is sent by the second terminal based on the alarm event and the voice signal indicates that a second user has left the preset area, and the second user is a user corresponding to the facial image included in the first image.

4. The method according to claim 1, wherein The method further comprises: Receive the detection instruction of the first terminal, and in response to the detection instruction, execute the step of detecting the preset area through the camera module; Wherein, the detection instruction is triggered when the first terminal detects that the first user leaves the preset area.

5. An alarm device, characterized in that, The alarm device is installed on the first terminal, and the device includes: A determination module, configured to continuously capture images through the camera module. When the first user is not included in the currently captured third image and the first user is included in the fourth image, determine that the first user leaves the preset area in front of the display screen of the first terminal; wherein, the third image is the image before the fourth image, and both the third image and the fourth image include the image of the preset area in front of the display screen of the first terminal; A camera module, the bottom of the camera module is provided with a rotatable base; the camera module is configured to, when detecting that the first user leaves the preset area, rotate the camera module by rotating the rotatable base, and the shooting area of the rotated camera module includes the display screen of the first terminal; obtain a second image through the camera module, the second image includes the image of the display screen of the first terminal; perform content recognition on the second image; when the recognized image content is not the target content, determine that the state of the display screen of the first terminal is unlocked; wherein, the target content includes at least one of a screensaver content and a black screen content; when the state of the display screen is unlocked, detect the preset area, and the first user is the holder of the first terminal; An identification module, configured to, when detecting that a user enters the preset area, perform action recognition on the detected first image; when detecting an action of touching the first terminal from the first image, perform face recognition based on the detected first image; An alarm module, configured to, when it is recognized that the first image includes a face image and the face image is not the face image of the first user, output a first alarm signal; control the state of the display screen to be changed from unlocked to locked; after the first alarm signal is cancelled, restore the state of the display screen to unlocked; The alarm module is further configured to detect whether the alarm device is removed from the first terminal through a gyroscope sensor; when detecting that the alarm device is removed from the first terminal, output a second alarm signal; detect whether the camera module is blocked, and when the camera module is blocked for a first preset duration, output an alarm signal.

6. An alarm device, characterized in that, The alarm device includes one or more processors and one or more memories, and at least one program code is stored in the one or more memories, and the at least one program code is loaded and executed by the one or more processors to implement the terminal alarm method according to any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, At least one program code is stored in the storage medium, and the at least one program code is loaded and executed by the alarm device to implement the terminal alarm method according to any one of claims 1 to 4.

8. A computer program product, characterized in that, The computer program product includes computer program code, the computer program code is stored in a computer-readable storage medium, a processor of the alarm device reads the computer program code from the computer-readable storage medium, and the processor executes the computer program code so that the alarm device executes the terminal alarm method according to any one of claims 1 to 4.

Images