Intelligent glasses, safety monitoring method based on intelligent glasses and related products

Abstract

The embodiment of the invention provides intelligent glasses which work when worn by a user and comprise an eye closing detection module, a tendency detection module, a first monitoring module, a second monitoring module, an early warning module and a main control module. When the main control module responds to the situation that the eyes are in the closed state for more than a preset duration, the main control module executes the following operations: if the head tends to be in an elevation state and the horizontal included angle is greater than a second preset angle, the first monitoring module is started for monitoring; if the horizontal included angle inclined by the head is smaller than or equal to a second preset angle, a second monitoring module is started for monitoring; and when any monitoring module detects that the potential intrusion object is close to the early warning range, the early warning module is started to carry out early warning. According to the intelligent glasses in the embodiment of the invention, the safety monitoring of the user in the eye closing state can be realized.

Description

Technical Field

[0001] The present invention relates to the technical field of wearable intelligent devices, and particularly to an intelligent glasses, a security monitoring method based on the intelligent glasses, an electronic device, and a computer-readable storage medium. Background Art

[0002] With the rapid development of wearable intelligent devices, intelligent glasses have gradually been applied in scenarios such as life security and auxiliary interaction by virtue of their lightweight design and real-time perception ability. In the prior art, intelligent glasses mainly achieve environmental recording through a camera, provide information prompts through augmented reality (AR) technology, or implement functions such as gesture interaction in combination with motion sensors.

[0003] There will be some scenarios of brief eye closure in daily public places (such as a short rest when taking a train / airplane), and these eye closure behaviors in public places will bring security risks (such as theft or intrusion into private space by others). The presence of intelligent glasses provides conditions for avoiding such security risks.

[0004] However, although existing intelligent glasses have functions such as video recording and security warning, they need to be actively turned on by the user. When the user has such a brief eye closure behavior in a public place, it is generally accompanied by fatigue and drowsiness, and it is very difficult for the user to consciously and actively turn on the relevant functions of the intelligent glasses, so the security monitoring of the user in the closed-eye state in a public place cannot be achieved through the intelligent glasses. Summary of the Invention

[0005] Based on the above situation, the main purpose of the present invention is to provide an intelligent glasses and related technical solutions, which can achieve the security monitoring of the user in the closed-eye state.

[0006] To achieve the above purpose, the technical solution adopted by the present invention is as follows:

[0007] An intelligent glasses provided in the first aspect of the embodiments of the present invention includes:

[0008] An eye closure detection module, configured to detect whether the user's eyes are in a closed state;

[0009] A head inclination detection module, configured to detect the head inclination of the user, where the head inclination includes a pitch state and a horizontal angle, and the horizontal angle is the angle between the viewing direction of the intelligent glasses and the horizontal direction;

[0010] A first monitoring module, configured to perform monitoring in a first monitoring direction, where the first monitoring direction faces downward of the viewing direction and forms an angle greater than a first preset angle with the viewing direction;

[0011] The second monitoring module is used to monitor in the second monitoring direction, and the second monitoring direction is parallel to the viewing direction;

[0012] The warning module is used to warn the user of potential intrusion objects;

[0013] The main control module, in response to the eyes being in the closed state for more than a preset duration, performs the following operations: If the head tilt is in the elevation state and the horizontal angle is greater than the second preset angle, the first monitoring module is turned on for monitoring; If the horizontal angle of the head tilt is less than or equal to the second preset angle, the second monitoring module is turned on for monitoring; When any monitoring module detects that a potential intrusion object approaches within the warning range, the warning module is activated to give a warning.

[0014] Preferably, the smart glasses further include: A third monitoring module for monitoring in the third monitoring direction, the third monitoring direction is parallel to the viewing direction, and the third monitoring module is arranged between the left and right lenses;

[0015] The main control module is further used for: If the head tilt is simultaneously in the depression state and the roll state, and the horizontal angle is less than or equal to the second preset angle, the third monitoring module is turned on for monitoring.

[0016] Preferably, the smart glasses further include:

[0017] A fourth monitoring module for monitoring in the fourth monitoring direction, the fourth monitoring direction faces upward of the viewing direction and forms an angle greater than a third preset angle with the viewing direction;

[0018] The main control module is further used for: If the head tilt is in the depression state and the horizontal angle is greater than the second preset angle, the fourth monitoring module is turned on for monitoring.

[0019] Preferably, any monitoring module includes: An external shooting unit and a ranging unit;

[0020] The external shooting unit is used to take pictures or videos in its corresponding monitoring direction.

[0021] The ranging unit is used to measure the distance of potential intrusion objects in its corresponding monitoring direction;

[0022] The main control module is further used for: If any ranging unit detects that a potential intrusion object approaches within the detection range, the external shooting unit corresponding to the ranging unit is turned on to take pictures or videos.

[0023] Preferably, any monitoring module includes: An external shooting unit;

[0024] The external shooting unit is used to take pictures or videos in its corresponding monitoring direction;

[0025] The main control module is further configured to: obtain a current image through any external imaging unit, and extract the foreground object from the current image; if the foreground object conforms to the image features of a potential intrusion object, use the foreground object as the potential intrusion object and track the potential intrusion object; determine the distance between the potential intrusion object and the user based on the image changes of the potential intrusion object at different times.

[0026] Preferably, the smart glasses further include: a first temple and a second temple;

[0027] A first opening is provided below any one of the temples, and the first monitoring module is disposed within the first opening;

[0028] An end portion of any one of the temples close to the lens side is provided with a second opening, and the second monitoring module is disposed within the second opening.

[0029] Preferably, the smart glasses further include: a first temple and a second temple;

[0030] A third opening is provided above any one of the temples, and the fourth monitoring module is disposed within the third opening.

[0031] Preferably, the setting of the preset angle includes at least one of the following:

[0032] The first preset angle is thirty degrees, the second preset angle is thirty degrees, and the third preset angle is ten degrees.

[0033] A smart glasses provided in the second aspect of the embodiments of the present invention includes:

[0034] An eye-closure detection module, configured to detect whether the user's eyes are in a closed state;

[0035] A tilt detection module, configured to detect the tilt of the user's head, where the tilt of the head includes a pitch state and a horizontal angle, and the horizontal angle is the angle between the viewing direction of the smart glasses and the horizontal direction;

[0036] A monitoring module, configured to monitor the potential intrusion object, and is flipably disposed between the left and right lenses;

[0037] An early warning module, configured to give an early warning of the potential intrusion object to the user;

[0038] The main control module, in response to the eyes being in a closed state for more than a preset duration, performs the following operations: If the head tilt is in an elevation state and the horizontal angle is greater than a second preset angle, control the monitoring module to flip to a first monitoring direction; if the horizontal angle of the head tilt is less than or equal to the second preset angle, control the monitoring module to flip to a second monitoring direction. The first monitoring direction faces downward in the viewing direction and forms an angle greater than a first preset angle with the viewing direction, and the second monitoring direction is parallel to the viewing direction; when the monitoring module detects that a potential intrusion object approaches within the warning range, activate the warning module to give a warning.

[0039] Preferably, the monitoring module includes: an external shooting unit and a ranging unit;

[0040] The external shooting unit is used to take images or videos in the corresponding monitoring direction.

[0041] The ranging unit is used to measure the distance to a potential intrusion object in the corresponding monitoring direction;

[0042] The main control module is also used to: If the ranging unit detects that a potential intrusion object approaches within the detection range, turn on the external shooting unit to take images or videos.

[0043] Preferably, the monitoring module includes: an external shooting unit;

[0044] The main control module is also used to: Obtain the current image through the external shooting unit and extract the foreground object of the current image; if the foreground object conforms to the image characteristics of a potential intrusion object, regard the foreground object as a potential intrusion object and track the potential intrusion object; determine the distance between the potential intrusion object and the user according to the image changes of the potential intrusion object at different times.

[0045] Preferably, the setting of the preset angle includes at least one of the following: The first preset angle is 30 degrees, and the second preset angle is 30 degrees.

[0046] A safety monitoring method based on smart glasses provided in the third aspect of the embodiments of the present invention includes:

[0047] Detect whether the user's eyes are in a closed state;

[0048] In response to the user's eyes being in a closed state for more than a preset duration, obtain the current head tilt of the user. The head tilt includes a pitch state and a horizontal angle, and the horizontal angle is the angle between the viewing direction of the smart glasses and the horizontal direction;

[0049] If the head tilt is in the elevation state and the horizontal angle is greater than the second preset angle, monitoring is performed in the first monitoring direction; if the horizontal angle of the head tilt is less than or equal to the second preset angle, monitoring is performed in the second monitoring direction; the first monitoring direction faces downward in the viewing direction and forms an angle greater than the first preset angle with the viewing direction; the second monitoring direction is parallel to the viewing direction;

[0050] If a potential intrusion object is detected approaching within the warning range, a warning about the potential intrusion object is given to the user.

[0051] Preferably, the smart glasses include a first monitoring module and a second monitoring module;

[0052] Monitoring in the first monitoring direction includes: turning on the first monitoring module and performing monitoring in the first monitoring direction through the first monitoring module;

[0053] Monitoring in the second monitoring direction includes: turning on the second monitoring module and performing monitoring in the second monitoring direction through the second monitoring module.

[0054] Preferably, the smart glasses further include: a third monitoring module for performing monitoring in a third monitoring direction, the third monitoring direction being parallel to the viewing direction, and the third monitoring module is arranged between the left and right lenses;

[0055] After obtaining the current head tilt of the user, the method further includes:

[0056] If the head tilt is simultaneously in the depression state and the roll state, and the horizontal angle is less than or equal to the second preset angle, turn on the third monitoring module for monitoring.

[0057] Preferably, the smart glasses include: a fourth monitoring module for performing monitoring in a fourth monitoring direction, the fourth monitoring direction facing upward in the viewing direction and forming an angle greater than a third preset angle with the viewing direction;

[0058] After obtaining the current head tilt of the user, the method further includes:

[0059] If the head tilt is in the depression state and the horizontal angle is greater than the second preset angle, turn on the fourth monitoring module for monitoring.

[0060] Preferably, the smart glasses include: a flippable monitoring module arranged between the left and right lenses;

[0061] Monitoring in the first monitoring direction includes: controlling the flippable monitoring module to flip to the first monitoring direction for monitoring;

[0062] Monitoring in the second monitoring direction includes: controlling the flippable monitoring module to flip to the second monitoring direction for monitoring.

[0063] Preferably, monitoring is performed in any monitoring direction, including:

[0064] The ranging unit of the monitoring module measures the distance to a potential intrusion object in the corresponding monitoring direction; if the ranging unit detects that the potential intrusion object approaches within the detection range, the external shooting unit of the monitoring module is activated to take images or videos.

[0065] Preferably, before warning a potential intrusion object when it is detected to approach within the warning range, the method further includes: the ranging unit of the monitoring module measures the distance to the potential intrusion object in the corresponding monitoring direction;

[0066] Alternatively, the current image is obtained through the external shooting unit of the monitoring module, and the foreground object of the current image is extracted; if the foreground object conforms to the image characteristics of the potential intrusion object, the foreground object is used as the potential intrusion object, and the potential intrusion object is tracked; the distance between the potential intrusion object and the user is determined based on the image changes of the potential intrusion object at different times.

[0067] Preferably, the setting of the preset angle includes at least one of the following: the first preset angle is 30 degrees, the second preset angle is 30 degrees, and the third preset angle is 10 degrees.

[0068] The computer program stored thereon provided in the fourth aspect of the embodiments of the present invention, when executed by a processor, implements the above-mentioned security monitoring method based on smart glasses in the third aspect.

[0069] An electronic device provided in the fifth aspect of the embodiments of the present invention includes a storage medium storing a computer program, and when the computer program is executed by a processor, it implements the above-mentioned security monitoring method based on smart glasses in the third aspect.

[0070] In the embodiments of the present invention, the closed-eye detection module of the smart glasses detects the user's closed-eye behavior. If the user is in the closed-eye state for more than the preset duration, the corresponding monitoring function will be activated without the user's active control, avoiding the safety blind spot period when the user unconsciously enters the closed-eye state. In addition, considering that the user will have different postures after entering a short-term closed-eye state (for example, lying on the back or sitting upright and resting against the back of the chair), and the viewing angle coverage of a single monitoring direction is limited, different postures will bring different monitoring blind spots. Therefore, the embodiments of the present invention provide at least two monitoring modules corresponding to different monitoring directions to minimize the monitoring blind spots as much as possible; and considering the balance between monitoring requirements and power consumption, the embodiments of the present invention will select to activate the monitoring module with fewer monitoring blind spots according to the user's head inclination to reduce the power consumption of the smart glasses.

[0071] Other beneficial effects of the present invention will be described in the specific implementation manners through the introduction of specific technical features and technical solutions. Those skilled in the art should be able to understand the beneficial technical effects brought by the said technical features and technical solutions through the introduction of these technical features and technical solutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] The preferred embodiments of the present invention will be described below with reference to the drawings. In the drawings:

[0073] Figure 1 show a schematic functional structure diagram of the smart glasses in an embodiment of the present invention;

[0074] Figure 2 show a schematic external structure diagram of the smart glasses in an embodiment of the present invention;

[0075] Figure 3 show a schematic diagram of the smart glasses in an elevation angle state in an embodiment of the present invention;

[0076] Figure 4 show a schematic diagram of the optional range of the first monitoring direction in an embodiment of the present invention;

[0077] Figure 5 show a schematic diagram of the first monitoring range in an embodiment of the present invention;

[0078] Figure 6 show a schematic diagram of the second monitoring range in an embodiment of the present invention;

[0079] Figure 7 show a schematic diagram of the monitoring blind area in an embodiment of the present invention;

[0080] Figure 8 show another schematic functional structure diagram of the smart glasses in an embodiment of the present invention;

[0081] Figure 9 show a schematic diagram of the horizontal included angle less than or equal to the second preset angle in an embodiment of the present invention;

[0082] Figure 10 show a schematic diagram of the monitoring module located between the lenses in an embodiment of the present invention;

[0083] Figure 11 show a schematic diagram of the smart glasses in a depression angle state in an embodiment of the present invention;

[0084] Figure 12 show a schematic diagram of the optional range of the fourth monitoring direction in an embodiment of the present invention;

[0085] Figure 13 show a schematic diagram of the fourth monitoring range in an embodiment of the present invention;

[0086] Figure 14 Another schematic diagram of the functional structure of the smart glasses in the embodiments of the present invention is shown;

[0087] Figure 15 A schematic diagram of the flipable monitoring module in the embodiments of the present invention is shown;

[0088] Figure 16 A flowchart of a security monitoring method based on smart glasses in the embodiments of the present invention is shown;

[0089] Figure 17 A schematic diagram of an electronic device in the embodiments of the present invention is shown. Detailed implementation manners

[0090] The present invention is described below based on embodiments, but the present invention is not limited to these embodiments. In the following detailed description of the present invention, some specific details are described in detail. To avoid obscuring the essence of the present invention, well-known methods, processes, procedures, and components are not described in detail.

[0091] In addition, those of ordinary skill in the art should understand that the drawings provided herein are for illustrative purposes only, and the drawings are not necessarily drawn to scale.

[0092] Unless the context clearly requires otherwise, the words "including", "comprising", and the like in the entire specification and claims should be construed in an inclusive sense rather than an exclusive or exhaustive sense; that is, the meaning of "including but not limited to".

[0093] In the description of the present invention, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be construed as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "a plurality" is two or more.

[0094] As described above, there are some scenarios of brief eye closure in daily public places. The behavior of closing eyes in these public places will pose a safety hazard. Although existing smart glasses have functions such as video recording and safety warning, they need to be actively turned on by the user. When the user has such a brief eye closure behavior in a public place, it is generally accompanied by tiredness and drowsiness, and it is very difficult to consciously turn on the related functions of the smart glasses. In view of this, the embodiments of the present invention provide a smart glasses and related technical solutions, which can sense the user's eye closure state and provide safety monitoring for the user in the eye closure state.

[0095] The following will describe in detail the specific implementation manners of the present invention with reference to the drawings.

[0096] For ease of understanding, the following explains several concepts related to the embodiments of the present invention:

[0097] Regarding orientation, in the embodiments of the present invention, direction descriptions such as "above", "below", "front", and "back" are involved. The specific reference object is the posture of the user wearing the glasses normally. The orientation roughly towards the user's head is "above", the orientation roughly towards the user's feet is "below", the orientation roughly towards the user's eyes is "front", and the orientation roughly towards the back of the user's head is "back".

[0098] Regarding the viewing direction of the smart glasses, it refers to the direction in which the user wearing the smart glasses looks straight ahead without rotating the eyeballs. Since the smart glasses in the embodiments of the present invention all work after the user wears them, the user's head and the smart glasses are regarded as an object moving together. In the embodiments of the present invention, the viewing direction of the smart glasses is used to describe the inclination of the user's head. Therefore, when the inclination of the user's head changes, the viewing direction of the smart glasses will also change synchronously.

[0099] Regarding the eye closure detection module, since it is necessary to detect the eye closure regularly in the embodiments of the present invention, a low-power detection scheme needs to be adopted. For example, an infrared eye movement sensor or a highly integrated camera module can be used. Exemplarily, if the camera module scheme is used, it can include only one camera unit (such as a wide-angle camera), or it can include two camera units, as Figure 2 shown, the eye closure detection module includes a first internal camera unit and a second internal camera unit, and the two internal camera units respectively detect the two eyeballs. It should be noted that the eye closure detection module in the embodiments of the present invention can be any software and hardware functional module capable of realizing eye closure detection, and specific details are not limited here.

[0100] Regarding the pitch state, it can specifically include the elevation angle state, the frontal state, and the depression angle state. Among them, the frontal state means that the viewing direction of the smart glasses is roughly parallel to the horizontal direction, the elevation angle state means that the viewing direction of the smart glasses is inclined upward relative to the horizontal direction, and the depression angle state means that the viewing direction of the smart glasses is inclined downward relative to the horizontal direction.

[0101] Regarding the monitoring module, it includes at least one external camera unit. The external camera unit is used to take pictures or videos in its corresponding monitoring direction, and the shooting direction of the external camera unit can be used as the monitoring direction of the monitoring module. Further, the monitoring module can also include a ranging unit, which is used to measure the distance to potential intrusion objects in its corresponding monitoring direction. Specifically, the ranging direction of the ranging unit is parallel to the monitoring direction. In practical applications, since the external camera unit and the ranging unit in the monitoring module are arranged adjacent to each other, the ranging direction can be regarded as the same as the monitoring direction.

[0102] Regarding the monitoring range, it can be determined by the monitoring direction, the position of the camera module (i.e., the external camera unit), and the viewing angle width. Specifically, reference can be made to Figure 5 , taking the position of the camera module as the vertex, the viewing angle width of the camera module as the apex angle, and the monitoring direction as the central axis, the conical region formed is used as the monitoring range. The size of the monitoring range is determined by the viewing angle parameters of the camera module. In practical applications, different camera modules can have different monitoring ranges. Specifically, the monitoring direction of the monitoring module can be set based on the viewing angle width of the camera module to minimize the monitoring blind area as much as possible.

[0103] Regarding potential intrusion objects, it refers to people or objects that can cause personal injury or property loss to users. Exemplarily, it can be a thief, a drone, or an attacker.

[0104] Please refer to Figure 1 , Figure 1 , which shows a schematic functional structure diagram of the smart glasses in an embodiment of the present invention. The smart glasses in the embodiment of the present invention work when worn by the user. The smart glasses in the embodiment of the present invention include: an eye closure detection module, a head tilt detection module, a first monitoring module, a second monitoring module, an early warning module, and a main control module. The above-mentioned modules will be described in detail below.

[0105] The eye closure detection module is used to detect whether the user's eyes are in a closed state.

[0106] The head tilt detection module is used to detect the head tilt of the user. The head tilt includes the pitch state and the horizontal angle. The horizontal angle is the angle between the viewing direction of the smart glasses and the horizontal direction (as shown in Figure 3 ). Exemplarily, the head tilt of the user can be detected by a gravity sensor and a gyroscope.

[0107] The first monitoring module is used to monitor in the first monitoring direction. The first monitoring direction is below the viewing direction of the smart glasses and forms an angle greater than a first preset angle with the viewing direction. Exemplarily, please refer to Figure 4 and Figure 5 , the red dotted line in the figure refers to the viewing direction of the smart glasses, the blue solid line in the figure refers to the first monitoring direction, and the green area in the figure refers to the optional range of the first monitoring direction. Exemplarily, the first preset angle can be set to thirty degrees. Correspondingly, the monitoring angle that the first monitoring direction can be selected to set is: the angle between the first monitoring direction and the viewing direction is between thirty degrees and ninety degrees. Since the first monitoring direction is below the viewing direction and forms an angle greater than the first preset angle with the viewing direction, therefore, as shown in Figure 5 , the first monitoring module forms a monitoring area (such as the first monitoring range in the figure) below the viewing direction of the smart glasses.

[0108] In traditional smart glasses, the orientation of the camera module generally coincides with the viewing direction of the smart glasses. When the user tilts their head back significantly, a blind spot in the viewing angle of the camera module will be formed, which can easily give potential intruders an opportunity. For example, Figure 7 As shown, taking the supine posture as an example, if the monitoring direction of the camera module coincides with the viewing direction of the smart glasses, forming a monitoring range as shown in Figure 7 As shown, a monitoring blind spot will be formed in the area below this monitoring range (i.e., the red area in the figure), posing a safety hazard to the user. In the embodiment of the present invention, a first monitoring module is provided, forming a first monitoring range below the viewing direction, effectively filling the monitoring blind spot formed when the user tilts their head back and improving the coverage of safety monitoring.

[0109] A second monitoring module is used to monitor in a second monitoring direction, and this second monitoring direction is parallel to the viewing direction of the smart glasses. Exemplarily, please refer to Figure 6 , the red dotted line in the figure refers to the viewing direction of the smart glasses, and the blue solid line in the figure refers to the second monitoring direction. Since the second monitoring direction is parallel to the viewing direction, therefore, as Figure 6 As shown, the second monitoring module forms a monitoring area (such as the second monitoring range in the figure) in front of the smart glasses.

[0110] In one implementation, the second monitoring module can be disposed within the temple of the smart glasses. Specifically, as Figure 6 As shown, a second opening is provided at the end of the temple near the lens side, and the second monitoring module is disposed within the second opening, and the second opening generally faces the viewing direction of the smart glasses. In another implementation, the second monitoring module can be disposed within the frame of the smart glasses. Specifically, reference can be made to Figure 10 , an installation groove is provided on the frame between the left and right lenses, and the second monitoring module is disposed within this installation groove, and the opening of this installation groove generally faces the viewing direction of the smart glasses.

[0111] An early warning module is used to give an early warning to the user about potential intruders. Exemplarily, please refer to Figure 2 , the early warning module can include a first early warning unit and a second early warning unit, which are respectively located in the end regions of the two temples (in the embodiment of the present invention, the side of the temple close to the lens is referred to as the front end, and the side of the temple far from the lens is referred to as the end). Specifically, the early warning unit can be a speaker. When it is necessary to give an early warning about potential intruders, a specific warning sound can be emitted through the speaker for warning.

[0112] The main control module, in response to the user's eyes being closed for more than a preset duration, performs the following operations: If the head tilt is in an elevation state and the horizontal angle is greater than a second preset angle, the first monitoring module is activated for monitoring; if the horizontal angle of the head tilt is less than or equal to the second preset angle, the second monitoring module is activated for monitoring; when any monitoring module detects that a potential intrusion object approaches within the warning range, the warning module is executed. Exemplarily, the above-mentioned preset duration can be set to 2 seconds, the above-mentioned second preset angle can be set to 30 degrees, and the above-mentioned warning range can be set to the area within 0.1 meter from the user.

[0113] It should be noted that in the embodiments of the present invention, the setting of the preset angle can refer to the viewing angle width of the camera module (such as the external camera unit in the monitoring module). The larger the viewing angle width, the smaller the monitoring blind area. For the second preset angle, in the case of a larger viewing angle width, when the user tilts the head slightly upward or downward, there will not be a large monitoring blind area in the front direction of the user (i.e., the second monitoring direction), and the second preset angle can be set slightly larger. On the contrary, if the viewing angle width is smaller, the second preset angle needs to be set to a smaller value. For the first preset angle, the setting principle can be: making the first monitoring range formed by the first monitoring direction complementary to the second monitoring range formed by the second monitoring direction, and minimizing the overlapping area between the first monitoring range and the second monitoring range. And the above-mentioned preset duration and warning range can both be set according to the actual needs of the user. Therefore, the preset parameters such as the preset angle, preset duration, and warning range can all be set according to the actual hardware conditions and / or user needs, and specific limitations are not made here.

[0114] The embodiments of the present invention have the following beneficial effects:

[0115] On the one hand, the eye-closure detection module of the smart glasses will detect the user's eye-closure behavior. If the user is in the closed-eye state for more than the preset duration, the corresponding monitoring function will be activated, without the need for the user to actively control, avoiding the safety blank period when the user unconsciously enters the closed-eye state.

[0116] On the other hand, considering that the user will have different postures after entering a short-term closed-eye state (such as lying on the back or sitting upright and resting while leaning on the back of the chair), and the viewing angle coverage of a single monitoring direction is limited, different postures will bring different monitoring blind areas. Therefore, the embodiments of the present invention provide at least two monitoring modules, corresponding to different monitoring directions respectively, to minimize the monitoring blind area as much as possible; and considering the balance between monitoring requirements and power consumption, the embodiments of the present invention will select to activate the monitoring module with fewer monitoring blind areas according to the user's head tilt, so as to reduce the power consumption of the smart glasses.

[0117] Please refer to Figure 8 , Figure 8Another functional structure schematic diagram of the smart glasses in the embodiments of the present invention is shown. In practical applications, in addition to the supine posture, when the user closes their eyes briefly, they may also adopt the postures of tilting the head to the side and lying prone, and these two postures also bring corresponding viewing blind spots. The embodiments of the present invention provide corresponding solutions.

[0118] For the posture of tilting the head to the side, on the basis of the above embodiments, the smart glasses in the embodiments of the present invention further include: a third monitoring module.

[0119] The third monitoring module is used to monitor in a third monitoring direction, and the third monitoring direction is parallel to the viewing direction of the smart glasses. Moreover, the third monitoring module is arranged between the left and right lenses. Specifically, reference can be made to Figure 10 , there is an installation groove provided on the frame between the left and right lenses, and the third monitoring module is arranged in this installation groove.

[0120] The main control module in the embodiments of the present invention is further used to: if the user's head inclination is simultaneously in a depression angle state and a side tilt state, and the horizontal angle of the head inclination is less than or equal to a second preset angle, then turn on the third monitoring module for monitoring.

[0121] The smart glasses in the embodiments of the present invention include a first temple and a second temple. A first opening is provided below the first temple, and the above-mentioned first monitoring module is arranged in this first opening; a second opening is provided at the end of the second temple close to the lens side, and the above-mentioned second monitoring module is arranged in the second opening. In practical applications, if the user's head tilts to the side of the second temple when lowering the head, the second monitoring module may be blocked. At this time, the smart glasses will turn on the third monitoring module for monitoring. In terms of hardware selection, since the third monitoring module will be used in the scenario when the user lowers the head, the external shooting unit corresponding to the third monitoring module will select a camera module with a larger viewing angle width to minimize the monitoring blind spot formed when the user tilts the head to the side. As Figure 9 shown, the red dashed line in the figure represents the viewing direction of the smart glasses, and this viewing direction can also represent the pitching amplitude of the user's head. When the horizontal angle formed when the user lowers or raises the head is less than or equal to the second preset angle, the smart glasses use the third monitoring module for monitoring.

[0122] In another embodiment, the third monitoring module can also be disposed between the left and right lenses and is rotatably disposed on the frame. At this time, the third monitoring direction is not only parallel to the viewing direction of the smart glasses, but can also be rotated above or below the viewing direction as the third monitoring module rotates. Further, when the inclination detection module detects that the user's head inclination is in an elevation angle state, the main control module can control the third monitoring module to flip and rotate the third monitoring direction below the viewing direction; similarly, when the inclination detection module detects that the user's head inclination is in a depression angle state, the main control module controls the third monitoring module to flip and rotate the third monitoring direction above the viewing direction. By controlling the third monitoring module to rotate in the direction opposite to the pitching direction of the head, the monitoring blind area formed by the user's head inclination can be better reduced.

[0123] For the lying prone posture, on the basis of the above embodiments, the smart glasses in the embodiments of the present invention further include: a fourth monitoring module.

[0124] The fourth monitoring module is used to monitor in the fourth monitoring direction, and the fourth monitoring direction faces above the viewing direction and forms an angle greater than a third preset angle with the viewing direction.

[0125] The main control module in the embodiments of the present invention is further used for: if the head inclination is in a depression angle state and the horizontal angle of the head inclination is greater than a second preset angle, the fourth monitoring module is turned on for monitoring.

[0126] In the embodiments of the present invention, as Figure 11 shown, if the user's head inclination is in a depression angle state and the formed horizontal angle is greater than the second preset angle, it is considered that the user is currently in a lying prone posture. At this time, the viewing angle of the smart glasses in the front direction of the user is basically completely blocked, and it is necessary to turn on the fourth monitoring module to monitor in the fourth monitoring direction. Specifically, reference can be made to Figure 12 , the fourth monitoring direction generally faces towards the back of the user's head and is close to the upper part. Exemplarily, the third preset angle can be set to ten degrees. Please refer to Figure 13 , a third opening is provided above the first temple or the second temple, and the third opening is close to the end of the temple. The fourth monitoring module is disposed in the third opening. In practical applications, if the user is in a lying prone posture with eyes closed briefly, the user generally leans on some objects in the front. Therefore, the potential safety hazards at this time mainly come from the area behind the user's head or above the viewing direction. As Figure 13 shown, the fourth monitoring range formed by the fourth monitoring direction can generally cover the area behind the user's head and above the viewing direction, and can detect potential intrusion objects as much as possible.

[0127] In an embodiment of the present invention, for various transient eye-closure postures that a user may exhibit, corresponding monitoring directions are selected, which can minimize the monitoring blind area as much as possible, save the power consumption of the smart glasses, and balance the requirements of power consumption and security monitoring.

[0128] Furthermore, the smart glasses in the embodiment of the present invention further include a storage module. The external shooting unit in the monitoring module can take pictures or record videos of the intrusion behavior of potential intrusion objects and store them in the storage module to retain evidence of the intrusion behavior and provide materials for process traceability.

[0129] In one implementation, the monitoring module in the embodiment of the present invention further includes a ranging unit (such as, an ultrasonic sensor, a millimeter-wave sensor, a lidar sensor, or an infrared sensor, etc.), and the ranging unit is used to measure the distance of potential intrusion objects in its corresponding monitoring direction. Considering that the power consumption of the external shooting unit is relatively large, if the shooting function of the external shooting unit is always turned on after the user closes their eyes, it will significantly affect the battery life of the smart glasses. Therefore, in the embodiment of the present invention, the ranging unit can first measure the distance of potential intrusion objects. When it is measured that the potential intrusion object approaches within the detection range, the corresponding external shooting unit is turned on for image shooting or video shooting, avoiding the long-term activation of the external shooting unit and reducing the power consumption of the smart glasses. For the detection range, in one implementation, it can be equal to the above warning range, that is, when warning, shooting is turned on, which can reduce the false triggering of the external shooting unit; in another implementation, the detection range can be larger than the above warning range, that is, two-stage hierarchical monitoring. Video recording is first turned on within the detection range, and warning is turned on again when entering the warning range. This method can more completely retain the process of the intrusion behavior.

[0130] In another implementation, when it is detected that the user's eyes are in a closed state for more than a preset duration, the external shooting unit of the monitoring module is normally turned on, and ranging is performed through the external shooting unit. Specifically, the current image can be obtained through the external shooting unit, and the foreground object of the current image can be extracted; if the foreground object conforms to the image characteristics of the potential intrusion object, the foreground object is used as the potential intrusion object, and the potential intrusion object is tracked; the distance between the potential intrusion object and the user is determined according to the image changes of the potential intrusion object at different times. A database of potential intrusion objects can be stored locally in the smart glasses. When the foreground object is obtained, the foreground object can be compared with the potential intrusion objects in the database, and ranging of the potential intrusion object is initiated after successful comparison. This implementation method does not require a ranging unit, and the hardware cost is lower.

[0131] Please refer to Figure 14 and Figure 15 , Figure 14 , which shows another functional structure diagram of the smart glasses in the embodiment of the present invention. Figure 15Another schematic diagram of the appearance structure of the smart glasses in the embodiments of the present invention is shown. In practical applications, multiple monitoring modules will increase the hardware manufacturing cost of the smart glasses. Embodiments of the present invention provide an implementation scheme with lower hardware costs. The smart glasses in the embodiments of the present invention include: a closed-eye detection module, a tendency detection module, a monitoring module, an early warning module, and a main control module. The above-mentioned modules will be described in detail below.

[0132] The closed-eye detection module is used to detect whether the user's eyes are in a closed state.

[0133] The tendency detection module is used to detect the head tendency of the user. The head tendency includes the pitch state and the horizontal angle. The horizontal angle is the angle between the viewing direction of the smart glasses and the horizontal direction.

[0134] The monitoring module is used to monitor potential intrusion objects and is rotatably arranged between the left and right lenses. Exemplarily, an installation groove (not shown in the figure) is provided on the frame between the left and right lenses. The left and right sides of the monitoring module are pivotally connected to the groove walls of the installation groove, so that the monitoring module can be turned up and down in the installation groove to change the monitoring direction.

[0135] The early warning module is used to give an early warning to the user about potential intrusion objects.

[0136] The main control module, in response to the eyes being in a closed state for more than a preset duration, performs the following operations: If the head tendency is in an elevation angle state and the horizontal angle is greater than a second preset angle, then control the monitoring module to turn to a first monitoring direction; if the horizontal angle of the head tendency is less than or equal to the second preset angle, then control the monitoring module to turn to a second monitoring direction. The first monitoring direction faces downward in the viewing direction and forms an angle greater than a first preset angle with the viewing direction, and the second monitoring direction is parallel to the viewing direction; when the monitoring module detects that a potential intrusion object approaches within the early warning range, start the early warning module to give an early warning. Exemplarily, the first preset angle can be 30 degrees, and the second preset angle can be 30 degrees.

[0137] For the monitoring module, in one implementation, the monitoring module in the embodiments of the present invention includes an external shooting unit and a ranging unit. The external shooting unit is used to take pictures or videos in the corresponding monitoring direction, and the ranging unit is used to measure the distance of potential intrusion objects in the corresponding monitoring direction. If the ranging unit detects that a potential intrusion object approaches within the detection range, then turn on the external shooting unit to take pictures or videos. In another implementation, the current image can be obtained through the external shooting unit, and the foreground object of the current image is extracted; if the foreground object conforms to the image characteristics of the potential intrusion object, then the foreground object is used as the potential intrusion object, and the potential intrusion object is tracked; the distance between the potential intrusion object and the user is determined according to the image changes of the potential intrusion object at different times.

[0138] When the inclination detection module detects that the user's head inclination is in the elevation angle state and the horizontal included angle is greater than the second preset angle, the main control module can control the monitoring module to flip and adjust the monitoring direction to the first monitoring direction; when the inclination detection module detects that the horizontal included angle of the user's head inclination is less than or equal to the second preset angle, the main control module can control the monitoring module to flip and adjust the monitoring direction to the second monitoring direction. Further, not limited to the above first monitoring direction and second monitoring direction, the main control module can also finely control the flipping angle of the monitoring module. According to the user's head inclination and the specific horizontal included angle, the monitoring module is controlled to rotate in the direction opposite to the head pitching direction to an angle matching the horizontal included angle, which can further reduce the monitoring blind area formed by the user's head inclination. And, compared with the implementation scheme of multiple monitoring modules, the embodiment of the present invention can meet the monitoring requirements in multiple directions only through one flipable monitoring module, reducing the hardware cost of the smart glasses.

[0139] Please refer to Figure 16 , Figure 16 which shows a flowchart of a safety monitoring method based on a smart glasses in an embodiment of the present invention. The embodiment of the present invention provides a safety monitoring method based on a smart glasses, which is applicable to any one of the above embodiments and includes a smart glasses, steps S1 to step S8.

[0140] In step S1, it is detected whether the user's eyes are in a closed state.

[0141] After the user wears the smart glasses in the embodiment of the present invention, the eye closing detection module in the smart glasses will detect the state of the user's eyes in real time. Once the user's eyes are in a closed state, the local timer starts timing. When the timer accumulates more than a preset duration (e.g., 2 seconds), step S2 is executed.

[0142] In step S2, in response to the user's eyes being in a closed state for more than a preset duration, the user's current head inclination is obtained.

[0143] If the user's eyes are in a closed state for more than a preset duration, the inclination detection module of the smart glasses detects the user's head inclination. Exemplarily, the user's head inclination can be detected by a gravity sensor and a gyroscope. Specifically, the head inclination includes a pitching state and a horizontal included angle, and the horizontal included angle is the included angle between the viewing direction of the smart glasses and the horizontal direction. The pitching state includes an elevation angle state, a front view state, and a depression angle state. Further, the head inclination also includes whether it is in a roll state. Exemplarily, as long as the gravity sensor detects that the user's head is tilted in the direction of any temple, it can be determined that the current head inclination is in a roll state.

[0144] In practical applications, users in a short-term eye-closed state may have the following several head postures:

[0145] 1. Lying on the back, corresponding to the head inclined at an elevation angle state and the horizontal angle being greater than the second preset angle;

[0146] 2. Sitting upright with eyes closed to rest. At this time, there may be a slight upward or downward tilt of the head, but this slight upward or downward tilt of the head will not form an obvious monitoring blind area. Therefore, it corresponds to the horizontal angle of the head inclination being less than or equal to the second preset angle (as Figure 9 shown), and the pitching state can be any one of the elevation angle state, the front view state, and the depression angle state;

[0147] 3. Bowing the head to doze off. At this time, the user is in an unconscious state of hanging the head, and the center of gravity of the head is unstable. Therefore, there may be a lateral tilt of the head, corresponding to the head inclination being in the depression angle state and the lateral tilt state at the same time, and the horizontal angle of the head inclination being less than or equal to the second preset angle;

[0148] 4. Lying prone on an object, corresponding to the head inclination being in the depression angle state, and the horizontal angle of the head inclination being greater than the second preset angle.

[0149] In step S3, the monitoring direction is selected based on the current head inclination of the user.

[0150] If the smart glasses determine that the user is currently in the above-mentioned lying-on-the-back posture, then step S4 is executed;

[0151] If the smart glasses determine that the user is currently in the above-mentioned sitting-upright-with-eyes-closed-to-rest posture, then step S5 is executed;

[0152] If the smart glasses determine that the user is currently in the above-mentioned bowing-the-head-to-doze-off posture, then step S6 is executed;

[0153] If the smart glasses determine that the user is currently in the above-mentioned lying-prone posture, then step S7 is executed.

[0154] In step S4, if the head inclination is in the elevation angle state and the horizontal angle is greater than the second preset angle, then monitoring is performed in the first monitoring direction. This first monitoring direction is below the viewing direction and forms an angle greater than the first preset angle with the viewing direction.

[0155] In one implementation, if the current smart glasses adopt a scheme of multiple monitoring modules, then the first monitoring module is turned on to monitor potential intrusion objects in the first monitoring direction.

[0156] In another implementation, if the current smart glasses adopt a scheme of a rotatable monitoring module, then the monitoring module is controlled to rotate to the first monitoring direction to monitor potential intrusion objects.

[0157] In step S5, if the horizontal angle of the head tilt is less than or equal to the second preset angle, monitoring is performed in the second monitoring direction. This second monitoring direction is parallel to the viewing direction of the smart glasses.

[0158] In one implementation, if the current smart glasses adopt a solution with multiple monitoring modules, the second monitoring module is turned on to monitor potential intrusion objects in the second monitoring direction.

[0159] In another implementation, if the current smart glasses adopt a solution with a flip - able monitoring module, the monitoring module is controlled to rotate to the second monitoring direction to monitor potential intrusion objects.

[0160] In step S6, if the head tilt is in a state of both depression angle and roll angle, and the horizontal angle of the head tilt is less than or equal to the second preset angle, monitoring is performed in the third monitoring direction. This third monitoring direction is parallel to the viewing direction of the smart glasses.

[0161] In one implementation, if the current smart glasses adopt a solution with multiple monitoring modules, the third monitoring module is turned on to monitor potential intrusion objects in the third monitoring direction.

[0162] In another implementation, if the current smart glasses adopt a solution with a flip - able monitoring module, step S5 is directly executed without avoiding the occlusion caused by roll; or, in order to obtain a better monitoring range, the monitoring module can be controlled to rotate above the viewing direction of the smart glasses to reduce the monitoring blind area.

[0163] In step S7, if the head tilt is in a state of depression angle and the horizontal angle of the head tilt is greater than the second preset angle, monitoring is performed in the fourth monitoring direction.

[0164] In the solution with a flip - able monitoring module, since it is difficult for the monitoring module to rotate to the fourth monitoring direction, in both the solution with multiple monitoring modules and the solution with a flip - able monitoring module, in step S7, an independent fourth monitoring module is required to monitor potential intrusion objects in the fourth monitoring direction.

[0165] Optionally, considering that the power consumption of the external shooting unit is relatively large, if the shooting function of the external shooting unit is always turned on after the user closes their eyes, it will significantly affect the battery life of the smart glasses. Therefore, in any of the above steps S4 to S7, the ranging unit can first measure the distance to the potential intrusion object. When it measures that the potential intrusion object approaches within the detection range, the corresponding external shooting unit is turned on for image shooting or video shooting, avoiding the long-term activation of the external shooting unit and saving the power consumption of the smart glasses. For the detection range, in one implementation, it can be equal to the above warning range, that is, when warning, shooting is turned on, which can reduce the false triggering of the external shooting unit; in another implementation, the detection range can be greater than the above warning range, that is, two-stage hierarchical monitoring. Video recording is first turned on within the detection range, and warning is turned on again when entering the warning range. This method can more completely retain the process of the intrusion behavior.

[0166] In step S8, if it is detected that the potential intrusion object approaches within the warning range, the user is warned of the potential intrusion object.

[0167] In one implementation, the ranging unit can be used to measure the distance to the potential intrusion object.

[0168] In another implementation, the current image can be obtained through the external shooting unit, and the foreground object of the current image is extracted; if the foreground object conforms to the image characteristics of the potential intrusion object, the foreground object is regarded as the potential intrusion object, and the potential intrusion object is tracked; the distance between the potential intrusion object and the user is determined according to the image changes of the potential intrusion object at different times.

[0169] Exemplarily, please refer to Figure 2 , the warning module can include a first warning unit and a second warning unit, which are respectively located in the end regions of the two temple arms (in the embodiment of the present invention, the side of the temple arm close to the lens is called the front end, and the side of the temple arm far from the lens is called the end). Specifically, the warning unit can be a speaker. When it is necessary to warn of the potential intrusion object, a specific warning sound can be emitted through the speaker for warning.

[0170] In the embodiment of the present invention, for various short-term eye-closure postures that the user may have, the corresponding monitoring direction is selected, which can minimize the monitoring blind area while saving the power consumption of the smart glasses and balancing the requirements of power consumption and security monitoring.

[0171] Figure 17 The schematic diagram of the electronic device in the embodiment of the present invention is shown. The electronic device includes: a memory 1100 and a processor 1200.

[0172] The processor 1200 may be a Central Processing Unit (CPU), or may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0173] The memory 1100 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, the ROM may store static data or instructions required by the processor 1200 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even when the computer is powered off. In some embodiments, the permanent storage device uses a mass storage device (such as a magnetic or optical disk, flash memory) as the permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as dynamic random access memory. The system memory may store some or all of the instructions and data required by the processor during operation. In addition, the memory 1100 may include any combination of computer-readable storage media, including various types of semiconductor storage chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and magnetic disks and / or optical disks may also be used. In some embodiments, the memory 1100 may include a removable storage device that is readable and / or writable, such as a compact disc (CD), read-only digital versatile disc (such as DVD-ROM, dual-layer DVD-ROM), read-only Blu-ray disc, super density disc, flash memory card (such as SD card, min SD card, Micro-SD card, etc.), magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and instantaneous electronic signals transmitted wirelessly or wired.

[0174] An executable code is stored on the memory 1100 for executing the security monitoring method based on smart glasses in the above method embodiments. When the executable code is processed by the processor 1200, it may cause the processor 1200 to execute some or all of the methods described above.

[0175] In addition, the present invention also provides a computer-readable storage medium, such as a chip, an optical disc, etc. An execution program is stored on the computer-readable storage medium, and when the execution program is executed, the safety monitoring method based on the smart glasses as described above is implemented.

[0176] It should be noted that the computer-readable storage medium described in the embodiments of the present disclosure is not limited to the above-given embodiments. For example, it may also be an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.

[0177] Those skilled in the art can understand that, on the premise of no conflict, the above preferred solutions can be freely combined and superimposed. Among them, the flowcharts and block diagrams in the drawings illustrate the possible architectures, functions, and operations of the systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order from that marked in the drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions. The numbers assigned to the steps in this article are only for convenience of description and reference, and are not used to limit the front and back order. The specific execution order is determined by the technology itself, and those skilled in the art can determine various allowed and reasonable orders according to the technology itself.

[0178] It should be noted that in the present invention, step numbers (letter or numerical numbers) are used to refer to certain specific method steps only for the purpose of convenient and concise description, and by no means to limit the order of these method steps by letters or numbers. Those skilled in the art can understand that the order of relevant method steps should be determined by the technology itself and should not be unduly restricted by the existence of step numbers. Those skilled in the art can determine various permitted and reasonable step orders according to the technology itself.

[0179] Those skilled in the art can understand that on the premise of no conflict, the above preferred solutions can be freely combined and superimposed.

[0180] It should be understood that the above embodiments are merely exemplary rather than restrictive. Without departing from the basic principle of the present invention, various obvious or equivalent modifications or substitutions that those skilled in the art can make to the above details will be included within the scope of the claims of the present invention.

Claims

1. An intelligent glasses that works when worn by a user, characterized in that, Including: An eye-closure detection module for detecting whether the user's eyes are in a closed state; A tendency detection module for detecting the head tendency of the user, where the head tendency includes a pitch state and a horizontal angle, and the horizontal angle is the angle between the viewing direction of the smart glasses and the horizontal direction; A first monitoring module for monitoring in a first monitoring direction, where the first monitoring direction faces downward of the viewing direction and forms an angle greater than a first preset angle with the viewing direction; A second monitoring module for monitoring in a second monitoring direction, where the second monitoring direction is parallel to the viewing direction; An early warning module for giving an early warning to the user about potential intrusion objects; A main control module, in response to the eyes being in a closed state for more than a preset duration, performs the following operations: If the head tendency is in an elevation state and the horizontal angle is greater than a second preset angle, then turn on the first monitoring module for monitoring; If the horizontal angle of the head tendency is less than or equal to the second preset angle, then turn on the second monitoring module for monitoring; When any one of the monitoring modules detects that a potential intrusion object approaches within the early warning range, start the early warning module to give an early warning.

2. The smart glasses according to claim 1, characterized in that The smart glasses further include: A third monitoring module for monitoring in a third monitoring direction, where the third monitoring direction is parallel to the viewing direction, and the third monitoring module is disposed between the left and right lenses; The main control module is further configured to: If the head tendency is simultaneously in a depression state and a roll state, and the horizontal angle is less than or equal to the second preset angle, then turn on the third monitoring module for monitoring.

3. The smart glasses according to claim 1, characterized in that, The smart glasses further include: A fourth monitoring module for monitoring in a fourth monitoring direction, where the fourth monitoring direction faces upward of the viewing direction and forms an angle greater than a third preset angle with the viewing direction; The main control module is further configured to: If the head tendency is in a depression state and the horizontal angle is greater than the second preset angle, then turn on the fourth monitoring module for monitoring.

4. The smart glasses according to any one of claims 1 to 3, characterized in that Any one of the monitoring modules includes: an external shooting unit and a ranging unit; The external shooting unit is used for taking pictures or shooting videos in its corresponding monitoring direction; The ranging unit is used for ranging a potential intrusion object in its corresponding monitoring direction; The main control module is further configured to: If any one of the ranging units detects that a potential intrusion object approaches within the detection range, then turn on the external shooting unit corresponding to the ranging unit for taking pictures or shooting videos.

5. The smart glasses according to any one of claims 1 to 3, characterized in that Any one of the monitoring modules includes: an external shooting unit; The external shooting unit is used for taking pictures or shooting videos in its corresponding monitoring direction; The main control module is further configured to: obtain a current image through any one of the external shooting units, and extract the foreground object of the current image; if the foreground object conforms to the image features of a potential intrusion object, then use the foreground object as the potential intrusion object, and track the potential intrusion object; determine the distance between the potential intrusion object and the user according to the image changes of the potential intrusion object at different times.

6. The smart glasses according to any one of claims 1 to 3, wherein the smart glasses further include: a first temple and a second temple; a first opening is provided below any one of the temples, and the first monitoring module is disposed in the first opening; an end of any one of the temples close to the lens side is provided with a second opening, and the second monitoring module is disposed in the second opening.

7. The smart glasses according to claim 3, wherein the smart glasses further include: a first temple and a second temple; a third opening is provided above any one of the temples, and the fourth monitoring module is disposed in the third opening.

8. The smart glasses according to claim 3, characterized in that, The setting of the preset angle includes at least one of the following: The first preset angle is thirty degrees; The second preset angle is thirty degrees; The third preset angle is ten degrees.

9. An intelligent glasses that works when worn by a user, characterized in that, including: a closed-eye detection module, configured to detect whether the user's eyes are in a closed state; a tendency detection module, configured to detect the head tendency of the user, the head tendency including a pitch state and a horizontal included angle, and the horizontal included angle being the included angle between the viewing direction of the smart glasses and the horizontal direction; a monitoring module, configured to monitor potential intrusion objects, and is rotatably disposed between the left and right lenses; an early warning module, configured to give an early warning of potential intrusion objects to the user; The main control module, in response to the eyes being in a closed state for more than a preset duration, performs the following operations: if the head tendency is in an elevation angle state and the horizontal included angle is greater than the second preset angle, then control the monitoring module to flip to the first monitoring direction, and if the horizontal included angle of the head tendency is less than or equal to the second preset angle, then control the monitoring module to flip to the second monitoring direction, the first monitoring direction facing downward of the viewing direction and forming an included angle greater than the first preset angle with the viewing direction, and the second monitoring direction being parallel to the viewing direction; When the monitoring module detects that a potential intrusion object approaches within the early warning range, start the early warning module to give an early warning.

10. The smart glasses according to claim 9, wherein the monitoring module includes: an external shooting unit and a ranging unit; the external shooting unit is configured to perform image shooting or video shooting in the corresponding monitoring direction; the ranging unit is configured to measure the distance to a potential intrusion object in the corresponding monitoring direction; The main control module is further configured to: if the ranging unit detects that a potential intrusion object approaches within the detection range, then turn on the external shooting unit to perform image shooting or video shooting.

11. The smart glasses according to claim 9, wherein the monitoring module includes: an external shooting unit; The main control module is further configured to: obtain a current image through the external shooting unit, and extract a foreground object of the current image; if the foreground object conforms to the image features of a potential intrusion object, use the foreground object as the potential intrusion object and track the potential intrusion object; determine the distance between the potential intrusion object and the user according to the image changes of the potential intrusion object at different times.

12. The smart glasses according to any one of claims 9 to 11, characterized in that, The setting of the preset angle includes at least one of the following: The first preset angle is 30 degrees; The second preset angle is 30 degrees.

13. A safety monitoring method based on smart glasses, characterized in that, After the user wears the smart glasses, perform the following steps: Detect whether the user's eyes are in a closed state; In response to the user's eyes being in a closed state for longer than a preset duration, obtain the current head inclination of the user, where the head inclination includes a pitch state and a horizontal angle, and the horizontal angle is the angle between the viewing direction of the smart glasses and the horizontal direction; If the head inclination is in an elevation angle state and the horizontal angle is greater than the second preset angle, perform monitoring in a first monitoring direction; If the horizontal angle of the head inclination is less than or equal to the second preset angle, perform monitoring in a second monitoring direction; The first monitoring direction faces downward of the viewing direction and forms an angle greater than the first preset angle with the viewing direction; The second monitoring direction is parallel to the viewing direction; If a potential intrusion object is detected to approach within the warning range, give a warning of the potential intrusion object to the user.

14. The security monitoring method according to claim 13, wherein The smart glasses include a first monitoring module and a second monitoring module; Performing monitoring in the first monitoring direction includes: turning on the first monitoring module and performing monitoring in the first monitoring direction through the first monitoring module; Performing monitoring in the second monitoring direction includes: turning on the second monitoring module and performing monitoring in the second monitoring direction through the second monitoring module.

15. The security monitoring method according to claim 14, characterized in that, The smart glasses further include: a third monitoring module for performing monitoring in a third monitoring direction, where the third monitoring direction is parallel to the viewing direction, and the third monitoring module is disposed between the left and right lenses; After obtaining the current head inclination of the user, the method further includes: If the head inclination is simultaneously in a depression angle state and a roll angle state, and the horizontal angle is less than or equal to the second preset angle, turn on the third monitoring module for monitoring.

16. The security monitoring method according to claim 15, wherein The smart glasses include: a fourth monitoring module for performing monitoring in a fourth monitoring direction, where the fourth monitoring direction faces upward of the viewing direction and forms an angle greater than a third preset angle with the viewing direction; After obtaining the current head inclination of the user, the method further includes: If the head inclination is in a depression angle state and the horizontal angle is greater than the second preset angle, turn on the fourth monitoring module for monitoring.

17. The security monitoring method according to claim 13, wherein The smart glasses include: a flipable monitoring module disposed between the left and right lenses; Performing monitoring in the first monitoring direction includes: controlling the flipable monitoring module to flip to the first monitoring direction for monitoring; Performing monitoring in the second monitoring direction includes: controlling the flipable monitoring module to flip to the second monitoring direction for monitoring.

18. The security monitoring method according to any one of claims 14 to 17, characterized in that, Performing monitoring in any monitoring direction includes: Measuring the distance to a potential intrusion object in the corresponding monitoring direction through the distance measuring unit of the monitoring module; If the distance measuring unit detects that a potential intrusion object approaches within the detection range, activate the external shooting unit of the monitoring module to take images or videos.

19. The safety monitoring method according to any one of claims 14 to 17, characterized in that, Before the method further includes warning the potential intrusion object when it is detected that the potential intrusion object approaches within the warning range, the method further includes: Measuring the distance to a potential intrusion object in the corresponding monitoring direction through the distance measuring unit of the monitoring module; Alternatively, obtaining a current image through the external shooting unit of the monitoring module, extracting the foreground object of the current image; if the foreground object conforms to the image characteristics of a potential intrusion object, using the foreground object as the potential intrusion object and tracking the potential intrusion object; determining the distance between the potential intrusion object and the user based on the image changes of the potential intrusion object at different times.

20. The security monitoring method according to claim 16, characterized in that, The setting of the preset angle includes at least one of the following: The first preset angle is 30 degrees; The second preset angle is 30 degrees; The third preset angle is 10 degrees.

21. An electronic device, comprising a processor storing a computer program, characterized in that: When the computer program is executed by a processor, it implements the security monitoring method based on smart glasses according to any one of claims 13 to 20.

22. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the security monitoring method based on smart glasses according to any one of claims 13 to 20.

Images