Behavior detection method and device and electronic equipment

Abstract

The embodiment of the invention discloses a behavior detection method and device and electronic equipment. The method comprises the following steps: determining protection personnel according to visual characteristics of candidate personnel, determining target personnel according to abnormal behavior characteristics of the candidate personnel, and determining associated protection personnel and target personnel; aiming at the associated protection personnel and target personnel, detecting behaviors of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel; and according to a behavior detection result, determining whether the target person has an abnormal shooting behavior on the protection person. According to the scheme, the protection personnel possibly subjected to abnormal shooting can be detected, the target personnel possibly having abnormal shooting behaviors can be detected, detection is performed from two aspects, and the detection accuracy is improved.

Description

Technical Field

[0001] The present application relates to the field of image detection technology, and in particular to a behavior detection method, device and electronic equipment. Background Art

[0002] The current photography technology is becoming more and more advanced and is increasingly widely used in people's lives. People can take photos with handheld cameras, mobile phones with integrated camera functions, tablet computers, wearable devices, etc. However, photography technology can also be used by some people for improper purposes, such as secretly photographing others.

[0003] The current solutions for detecting abnormal shooting behaviors can only detect obvious abnormal shooting behaviors, which is prone to misjudgment. For example, people's behaviors in normal shooting environments are misjudged as abnormal shooting behaviors, or missed detections occur. Abnormal shooting behaviors cannot be accurately identified, which affects the people being photographed. Summary of the invention

[0004] The present application provides a behavior detection method, device and electronic equipment to accurately detect abnormal shooting behavior.

[0005] According to one aspect of the present application, a behavior detection method is provided, the method comprising:

[0006] Determine the protection personnel based on the visual features of the candidate personnel, determine the target personnel based on the abnormal behavior features of the candidate personnel, and determine the associated protection personnel and target personnel;

[0007] For the associated protection personnel and target personnel, detecting the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel;

[0008] According to the behavior detection result, it is determined whether the target person has any abnormal filming behavior towards the protection personnel.

[0009] According to another aspect of the present application, a behavior detection device is provided, the device comprising:

[0010] A personnel determination module is used to determine the protection personnel according to the visual characteristics of the candidate personnel, determine the target personnel according to the abnormal behavior characteristics of the candidate personnel, and determine the associated protection personnel and target personnel;

[0011] A behavior detection module, for detecting the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel;

[0012] The abnormal shooting behavior determination module determines whether the target person has abnormal shooting behavior towards the protection person according to the behavior detection result.

[0013] According to another aspect of the present application, an electronic device is provided, the device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by at least one processor, and the computer program is executed by at least one processor so that the at least one processor can execute the behavior detection method of any embodiment of the present application.

[0017] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to implement the behavior detection method of any embodiment of the present application when executed by a processor.

[0018] The technical solution of the embodiment of the present application determines the protection personnel according to the visual features of the candidate personnel, determines the target personnel according to the abnormal behavior characteristics of the candidate personnel, and determines the associated protection personnel and target personnel; for the associated protection personnel and target personnel, the behavior of the protection personnel and / or the target personnel is detected according to the image of the protection personnel and the image of the target personnel; based on the behavior detection result, it is determined whether the target personnel has abnormal shooting behavior towards the protection personnel. The above scheme can detect protection personnel who may be abnormally photographed, and detect target personnel who may have abnormal shooting behavior, and conducts combined detection from both aspects, thereby improving the accuracy of detection and avoiding misjudgment.

[0019] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 is a flow chart of a behavior detection method provided according to Embodiment 1 of the present application;

[0022] Figure 2is a flow chart of a behavior detection method provided according to Embodiment 2 of the present application;

[0023] Figure 3 is a flow chart of a behavior detection method provided according to Embodiment 3 of the present application;

[0024] Figure 4 is a flow chart of a behavior detection method provided according to Embodiment 4 of the present application;

[0025] Figure 5 This is a schematic diagram of a simulated field of view provided according to Embodiment 4 of the present application;

[0026] Figure 6 is a structural diagram of a behavior detection device provided according to Embodiment 5 of the present application;

[0027] Figure 7 It is a structural schematic diagram of an electronic device provided according to Embodiment 6 of the present application. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0029] It should be noted that the terms "first", "second", "third", "fourth", "actual", "preset", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] Embodiment 1

[0031] Figure 1This is a flow chart of a behavior detection method provided in the first embodiment of the present application. The embodiment of the present application can be applied to the case of detecting abnormal shooting behavior. Typically, it can be applied to the case of detecting abnormal shooting behavior from both the protection personnel and the target personnel. The method can be executed by a behavior detection device, which can be implemented in the form of hardware and / or software, and the behavior detection device can be configured in an electronic device. Figure 1 As shown, the method includes:

[0032] S110, determining the protection personnel according to the visual features of the candidate personnel, determining the target personnel according to the abnormal behavior features of the candidate personnel, and determining the associated protection personnel and target personnel.

[0033] Among them, the candidate personnel can be all personnel that appear within the field of view of the image collector. The image collector can be a monitoring device set in any scene. Visual features are visible features, such as clothing features, skin features, hair features, facial features, etc. Abnormal behavior features are behavioral action features that are inconsistent with normal behavior, such as movement direction, movement speed, limb movements, etc. Abnormal behavior features include, for example, movement direction toward other personnel, movement speed consistent with other personnel, limb movements close to other personnel, etc. The protection personnel can be a person who may be abnormally photographed, and the target personnel can be a person who may have abnormal shooting behavior. The association between the protection personnel and the target personnel means that the executor and the executed person of the abnormal shooting behavior are associated, that is, the target person who performs the abnormal shooting behavior on the protection personnel is the protection personnel, and the target person is associated with the protection personnel. It can be the protection personnel and the target personnel who are preliminarily determined according to the location information and can complete the abnormal shooting behavior as the executor and the executed person. When the protection personnel may be abnormally photographed and the target personnel may have abnormal shooting behavior, if the target personnel has abnormal shooting behavior, the object of the abnormal shooting behavior is the protection personnel, and it is determined that the protection personnel is associated with the target personnel.

[0034] In the embodiment of the present application, the image of the candidate person collected by the image collector can be used for detection, and the protection personnel among the candidate persons can be determined according to the visual characteristics of the candidate person, and the target person among the candidate persons can be determined according to the abnormal behavior characteristics of the candidate person. The protection personnel and the target person are detected for association, and the associated target person and protection personnel are determined.

[0035] In the embodiment of the present application, determining the associated protected personnel and target personnel includes:

[0036] If there is a target person located in the preset area around the protection person, then determining that the target person is associated with the protection person; and / or,

[0037] If there is a protection person located in the preset area around the target person, it is determined that the protection person is associated with the target person.

[0038] Among them, the preset area can be determined according to actual conditions, for example, the preset area around the protection personnel can be within a circular area with the protection personnel as the center and the preset value as the radius. The preset area around the target person can be within a circular area with the target person as the center and the preset value as the radius. Exemplarily, for each target person, the preset area around the target person can be determined, and it is detected whether there is a protection personnel among the candidate persons located in the preset area. If so, it is determined that the target person is associated with the protection personnel in the preset area. Similarly, for each protection personnel, the preset area around the protection personnel can be determined, and it is detected whether there is a target person among the candidate persons located in the preset area. If so, it is determined that the protection personnel is associated with the target person in the preset area.

[0039] In the embodiment of the present application, determining the protection personnel according to the visual features of the candidate personnel includes:

[0040] Recognize visual features of the candidate according to the image of the candidate;

[0041] If the visual features of the candidate personnel match the preset features, the candidate personnel is determined to be a protection person.

[0042] Exemplarily, preset features may be predetermined, and the preset features may be dressing features, such as dressing features such as skirts, shorts, long shirts, and long T-shirts. Skirts may include dresses and half-length skirts. It may be skin features, such as skin exposure areas greater than preset areas, or hair features, such as long hair. It may be facial features, such as facial features unique to women. The image of the candidate may be identified, the visual features of the candidate may be determined, and the visual features of the candidate may be matched with the preset features. If the visual features match the preset features, it is determined that the candidate with the dressing features is likely to be an abnormal shooting object of other persons, and the candidate may be used as a protection person. If the visual features of the candidate do not match the preset features, the candidate will not be used as a protection person, and will not continue to track and detect whether other persons have abnormal approaching behavior and abnormal shooting behavior towards the candidate, so as to save computing power and power consumption.

[0043] S120 . For the associated protection personnel and target personnel, detect the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel.

[0044] Exemplarily, for the associated protection personnel and target personnel, an image of the protection personnel and an image of the target personnel are acquired, and the behavior of the protection personnel and / or the target personnel is detected based on the images. The image of the protection personnel and the image of the target personnel can be acquired by an image collector set in the scene where the protection personnel and the target personnel are located. The image of the protection personnel and the image of the target personnel can be in one image or in different images.

[0045] In an embodiment of the present application, the behavior of the protection personnel and / or the target personnel can be analyzed based on the image of the protection personnel and the image of the target personnel. The behavior of the protection personnel and / or the target personnel may include static behavior and dynamic behavior. Static behavior may include the position of the protection personnel, the position of the target personnel, the relative distance, relative position, facial orientation, etc. of the protection personnel and the target personnel, which may be determined by a single-frame image, and dynamic behavior may include the direction of movement, trajectory, and body movements of the protection personnel, the direction of movement, trajectory, and body movements of the target personnel, the approach behavior, tracking behavior, and interactive behavior of the protection personnel and the target personnel, which may be determined by multiple-frame images.

[0046] In the embodiments of the present application, only the behavior of the protection personnel may be detected, or only the behavior of the target personnel may be detected, or the behavior of both the protection personnel and the target personnel may be detected. The behavior detection result can be obtained through the detection and the detection conclusion of abnormal shooting behavior can be obtained based on the behavior detection result.

[0047] S130. Determine, based on the behavior detection result, whether the target person has any abnormal photography behavior toward the protection personnel.

[0048] For example, based on the behavior detection results, it can be determined whether the target person has abnormal photography behavior towards the protection personnel, such as detecting whether the target person is following the protection personnel, whether he is taking photos of the protection personnel with a camera, mobile phone or other device with a camera function, whether the handheld image acquisition device is placed in a position where the protection personnel may expose their skin, etc. Another example is detecting whether the protection personnel dodges, moves away from the target person, shows fear or anger on the face of the protection personnel, blames or drives the target person away, etc. Based on the above behavior detection results, it is determined whether the target person has abnormal photography behavior towards the protection personnel, so as to timely discover the abnormal photography behavior and stop it.

[0049] The technical solution of the embodiment of the present application determines the protection personnel according to the visual features of the candidate personnel, determines the target personnel according to the abnormal behavior characteristics of the candidate personnel, and determines the associated protection personnel and target personnel; for the associated protection personnel and target personnel, the behavior of the protection personnel and / or the target personnel is detected according to the image of the protection personnel and the image of the target personnel; based on the behavior detection result, it is determined whether the target personnel has abnormal shooting behavior towards the protection personnel. The above scheme can detect protection personnel who may be abnormally photographed, and detect target personnel who may have abnormal shooting behavior, and conducts combined detection from both aspects, thereby improving the accuracy of detection and avoiding misjudgment.

[0050] Embodiment 2

[0051] Figure 2 This is a flow chart of a behavior detection method provided in Example 2 of this application. This application example is optimized based on the above example. For solutions not described in detail in this application example, please refer to the above example. Figure 2 As shown, the method of the embodiment of the present application specifically includes the following steps:

[0052] S210: Determine the protection personnel according to the visual features of the candidate personnel, determine the target personnel according to the abnormal behavior features of the candidate personnel, and determine the associated protection personnel and target personnel.

[0053] S220: For the associated protection personnel and target personnel, detect the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel to determine whether the target personnel has any abnormal approach behavior toward the protection personnel.

[0054] Exemplarily, based on the results of behavioral detection of the protection personnel and / or the target personnel, it can be determined whether the target personnel has abnormal approach behavior toward the protection personnel. Abnormal approach behavior refers to the behavior of a stranger approaching and maintaining a close distance. It can be determined whether the target personnel has abnormal approach behavior toward the protection personnel based on at least one of the relative distance, relative position, facial orientation, approach behavior, tracking behavior, interactive behavior, etc., between the protection personnel and the target personnel obtained by detection.

[0055] S230: If the target person has abnormal approach behavior toward the protection person, detecting whether the target person has abnormal shooting behavior toward the protection person is performed.

[0056] In the embodiment of the present application, it is first detected whether the target person has any abnormal approach to the protection personnel. If the target person has any abnormal approach to the protection personnel, it is preliminarily determined that the target person may have performed abnormal filming behavior on the protection personnel. Then, it is further detected whether the target person has any abnormal filming behavior on the protection personnel, thereby forming a progressive detection method to avoid misjudgment.

[0057] S240: Determine, based on the behavior detection result, whether the target person has any abnormal photography behavior toward the protection personnel.

[0058] In the embodiment of the present application, detecting whether the target person has abnormal shooting behavior towards the protection person includes:

[0059] Detecting the items carried by the target person to determine the relative relationship between the items and the target area of ​​the protected person;

[0060] Accordingly, according to the behavior detection result, determining whether the target person has abnormal filming behavior towards the protection personnel includes:

[0061] According to the relative relationship, it is determined whether the target person has any abnormal shooting behavior towards the protection person.

[0062] Among them, the items carried by the target person can be set according to the actual situation, for example, it can be set as handheld items, such as smart terminals, bags, cups, crutches, glasses, etc., or shoes, pants and other wearable clothes or items carried on wearable clothes. In some abnormal shooting scenes, the target person does not directly hold the camera to shoot, but holds a smart terminal with a camera function such as a mobile phone or a watch to shoot, or hides the camera in items such as bags and shoes, or sets it on daily necessities such as cups, crutches, glasses, etc. If only detecting whether the target person holds a camera to determine whether the target person has abnormal shooting behavior, the tiny and hidden camera cannot be identified, and abnormal shooting behavior may be missed. In an embodiment of the present application, it can be detected whether there are items suspected of hiding the camera for abnormal shooting in the items carried by the target person, so as to further track and detect whether the target person has abnormal shooting behavior.

[0063] The target area can be set according to the actual situation, for example, it can be set to the area corresponding to the chest, buttocks, legs and other parts of the protected person. The areas corresponding to the back, hands and feet of the protected person involve less privacy and may not be used as target areas. The scope of the target area can be determined according to the actual situation, for example, it can be set to include the specific parts of the protected person and is greater than or equal to the scope of the specific parts. The scope of the target area can also be determined based on the protected person's clothing, such as the area included in the hem of the skirt, the area below the bottom edge of the shorts, the skin area not covered by the clothing, etc.

[0064] For example, for an object that is relatively stationary with respect to the target person, the object can be directly detected to determine the relative relationship between the object and the target area for protecting the person. For an object that is in relative motion with respect to the target person, after detecting the relative relationship between the object and the target area for protecting the person, if it is detected that the relative motion between the object and the target person has changed, the relative relationship between the object and the target area for protecting the person can be detected again.

[0065] Exemplarily, after detecting that the target object is carrying an item suspected to be photographable, the relative relationship between the item and the target area of ​​the protection personnel can be further detected, and based on the relative relationship, it can be determined whether the target person has abnormally photographed the protection personnel through the item.

[0066] Specifically, the target area of ​​the protection personnel may be a privacy area. If it is photographed abnormally, it will lead to privacy leakage. If the target person holds an object and takes an abnormal photo of the target area, the object and the target area should be in a relative positional relationship. According to the relative relationship between the object and the target area, the abnormal shooting behavior can be further detected. For example, if the object is located directly under the skirt of the protection personnel, it can be determined that the target person has an abnormal shooting behavior of the protection personnel. For another example, if the object is facing the target area of ​​the protection personnel and remains relatively still for a period of time, or the object moves with the protection personnel, it is determined that the target person has an abnormal shooting behavior of the protection personnel. By detecting the target person's objects, the problem that the conventional camera detection scheme is difficult to detect the shooting behavior when the target person hides the camera is solved, thereby improving the accuracy of behavior detection.

[0067] The technical solution of the embodiment of the present application detects the behavior of the protection personnel and / or the target personnel based on the image of the protection personnel and the image of the target personnel, and determines whether the target personnel has abnormal approach behavior toward the protection personnel; if so, if the target personnel has abnormal approach behavior toward the protection personnel, then the target personnel is detected to see whether it has abnormal shooting behavior toward the protection personnel. Based on the behavior detection result, it is determined whether the target personnel has abnormal shooting behavior toward the protection personnel. The above scheme can first accurately identify the abnormal approach behavior of the target personnel toward the protection personnel, and in the case of abnormal approach behavior, further detect abnormal shooting behavior of the target personnel. The progressive detection scheme improves the detection accuracy and prevents misjudgment.

[0068] Embodiment 3

[0069] Figure 3 This is a flow chart of a behavior detection method provided in Example 3 of this application. This application example is optimized based on the above example. For solutions not described in detail in this application example, see the above example. Figure 3 As shown, the method of the embodiment of the present application specifically includes the following steps:

[0070] S310: Determine the protection personnel according to the visual features of the candidate personnel, determine the target personnel according to the abnormal behavior features of the candidate personnel, and determine the associated protection personnel and target personnel.

[0071] S320: For the associated protection personnel and target personnel, detect the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel.

[0072] S330: If the density of people within a preset range centered on the protection personnel is less than a preset density, determine the relative distance between the target person and the protection personnel.

[0073] Among them, the preset range can be determined according to actual conditions, such as a circular range with a radius of 50 meters. The population density is the number of people in a unit area. The unit area can be 10 square meters or 25 square meters, etc., which is not limited here. The population density includes all people within the preset range. The preset density can be determined according to actual conditions, for example, it can be determined according to the scene where the protection personnel are located. If the protection personnel are in a relatively open area such as a waiting hall, a smaller preset density can be set. If the protection personnel are in a relatively crowded area such as a barrier-free elevator, a larger preset density can be set.

[0074] For example, if there is enough area for the target person to move around within the preset range around the protection personnel, but the target person still keeps a relatively close distance from the protection personnel, it is determined that the target person has the possibility of taking abnormal photos of the protection personnel. When the density of people within the preset range centered on the protection personnel is less than the preset density, that is, the density of people is small, and there is enough space around the protection personnel for the target person to move around, the relative distance between the target person and the protection personnel is further determined to analyze the behavior of the target person based on the relative distance.

[0075] S340: Determine, based on the relative distance, whether the target person has abnormal approach behavior toward the protection person.

[0076] For example, under normal circumstances, the target person should not be too close to the protection personnel. If the target person is too close to the protection personnel, the target person is suspected of having abnormal approach behavior to the protection personnel. It can be determined whether the target person has abnormal approach behavior to the protection personnel based on the relative distance.

[0077] In the embodiment of the present application, determining, according to the relative distance, that the target person has abnormal approach behavior toward the protection person includes:

[0078] If the relative distance is less than the preset distance, or,

[0079] If the relative distance is less than the preset distance and the duration is greater than the first preset duration, identifying whether there is any interaction between the protection personnel and the target personnel;

[0080] If not, it is determined that the target person has abnormal approach behavior towards the protection personnel.

[0081] Among them, the preset distance can be determined according to the actual situation, which can reflect the distance between the target person and the protection person. The preset distance can be adaptively determined according to the scene where the protection person is located. For example, if the protection person is in a relatively open area such as a waiting hall, a larger preset distance can be set. If the protection person is in a relatively crowded area such as a barrier-free elevator, a smaller preset distance can be set. The first preset duration can be determined according to the actual situation, for example, 5 minutes, 10 minutes, etc. Interactive behaviors can include language behaviors and physical behaviors, such as talking, holding hands, hugging, etc.

[0082] Exemplarily, if the relative distance is less than the preset distance, or the relative distance is less than the preset distance and the duration is greater than the first preset duration, it is determined that the target person is traveling with the protection person. If the target person and the protection person do not know each other, it means that the target person may have abnormal approach behavior to the protection person, such as abnormal tracking. If the target person and the protection person are companions who know each other, it is determined that the target person does not have abnormal approach behavior to the protection person. In the case where the relative distance is less than the preset distance, or the relative distance is less than the preset distance and the duration is greater than the first preset duration, it can be further identified whether the protection person and the target person have interactive behavior. If so, it is determined that the protection person and the target person know each other and are companions traveling together, and it is determined that the target person does not have abnormal approach behavior to the protection person. If the protection person and the target person do not have interactive behavior, it is determined that the target person has abnormal approach behavior to the protection person. Through the dual detection of the relative distance between the target object and the protected object and the interactive behavior, it is accurately judged whether there is abnormal approaching behavior between the target person and the protected person. The subsequent detection process is further performed on the target object with abnormal approaching behavior, and the abnormal shooting behavior is accurately detected to avoid missing the target person with abnormal shooting behavior, and avoid misjudgment of the abnormal approaching behavior of the target object.

[0083] S350: If the target person has abnormal approach behavior toward the protection person, detect whether the target person has abnormal shooting behavior toward the protection person.

[0084] S360: Determine, based on the behavior detection result, whether the target person has any abnormal filming behavior toward the protection personnel.

[0085] The embodiment of the present application provides a behavior detection method. If the density of people within a preset range centered on the protection personnel is less than the preset density, the relative distance between the target person and the protection personnel is determined; and according to the relative distance, it is determined that the target person has abnormal approach behavior toward the protection personnel. Through the dual detection of the relative distance between the target person and the protection personnel and the interactive behavior, it is accurately determined whether the target person has abnormal approach behavior toward the protection personnel, so as to further detect abnormal shooting behavior for the target person with abnormal approach behavior.

[0086] In the embodiment of the present application, determining whether the target person has abnormal approach behavior toward the protection person includes:

[0087] Determine the relative distance between the target person and the protection person; and determine, based on the relative distance, that the target person has abnormal approach behavior toward the protection person.

[0088] Exemplarily, the relative distance between the target person and the protection personnel can also be directly determined without detecting the density of people within a preset range centered on the protection personnel. Specifically, the position of the target person can be determined based on the image of the target person, the position of the protection personnel can be determined based on the image of the protection personnel, the relative distance between the target person and the protection personnel can be determined based on the position, and whether the target person has abnormal approach behavior to the protection personnel can be determined based on the relative distance. Specifically, determining the position of the target person based on the image of the target person includes: knowing the position of the image collector and the field of view of the image collector, and determining the actual area corresponding to the field of view of the image collector. Determine the position of the target person in the actual scene based on the coordinates of the target person in the image and the actual area corresponding to the field of view. The position of the protection personnel is determined in the same way.

[0089] Embodiment 4

[0090] Figure 4 This is a flow chart of a behavior detection method provided in Example 4 of the present application. The present application example is optimized based on the above example. For solutions not described in detail in the present application example, see the above example. Figure 4 As shown, the method of the embodiment of the present application specifically includes the following steps:

[0091] S410: Determine the protection personnel according to the visual features of the candidate personnel, determine the target personnel according to the abnormal behavior features of the candidate personnel, and determine the associated protection personnel and target personnel.

[0092] S420: For the associated protection personnel and target personnel, detect the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel to determine whether the target personnel has any abnormal approach behavior toward the protection personnel.

[0093] S430: If yes, determine the relative position of the object and the target area of ​​the protection personnel.

[0094] S440. If the height of the object is lower than the height of the target area, determine the relative relationship between the object and the target area of ​​the protection personnel based on the simulated field of view and the target area; wherein the simulated field of view is assuming that the object carries an image collector, and the image collector simulates the field of view when performing image acquisition.

[0095] In the embodiment of the present application, the detection is mainly performed when the target person takes abnormal photos below the waist of the protection personnel, so as to detect whether the more private parts are subjected to abnormal photos. Abnormal photos taken below the waist of the protection personnel are generally taken from bottom to top, so the relative position of the object and the target area of ​​the protection personnel is determined, and if the height of the object is lower than the height of the target area of ​​the protection personnel, the subsequent process is continued.

[0096] Specifically, the subsequent process is to determine the relative relationship between the object and the target area of ​​the protection personnel based on the simulated field of view and the target area, that is, assuming that an image collector is hidden in the object, determine whether the image collector can capture the target area when performing image acquisition. The simulated field of view is the field of view of the image collector when assuming that there is an image collector on the object, and the specific field of view can be determined based on the field of view of a conventional image collector.

[0097] In one feasible solution, if the height of the object is lower than the height of the target area of ​​the protection personnel, the relative relationship between the object and the target area of ​​the protection personnel is determined as whether the target area is included in the simulated field of view. If the target area is included in the simulated field of view, it is determined that if the object carries an image collector, the image collector can capture the image of the target area, and the target person has abnormal shooting behavior towards the protection personnel.

[0098] In another possible implementation, if the height of the object is lower than the height of the target area of ​​the protection personnel, the relative relationship between the object and the target area of ​​the protection personnel is determined as whether the object is included in the projection range of the target area on the horizontal plane where the object is located. If the target area includes the object in the projection range of the horizontal plane where the object is located, it is determined that if the object carries an image collector, the image collector can collect images of the target area, and the target person has abnormal shooting behavior towards the protection personnel.

[0099] In the embodiment of the present application, determining the relative relationship between the object and the target area of ​​the protection personnel according to the simulated field of view and the target area includes:

[0100] The object is used as a vertex, the preset angle is used as a cone angle, and the preset direction is used as a cone opening direction to construct a cone area as a simulated field of view range;

[0101] Determine whether the target area is within the simulated field of view.

[0102] The preset angle and the preset direction can be determined according to actual conditions. The preset angle can be determined according to the field of view of a conventional image collector. The preset angle can be at least one, for example, it can be a direction toward the target area, or it can be a plurality of scanning directions when simulating the image collector to perform mobile scanning image acquisition. Exemplarily, a conical area can be constructed as a simulated field of view range according to the object, the preset angle, and the preset direction to simulate the field of view range of the image collector when performing image acquisition. Exemplarily, Figure 5 As shown, taking the object as a fixed point, α as a cone angle, and a conical area with a preset direction as the opening direction as a simulated field of view, it is determined whether the target area is within the simulated field of view, thereby judging whether the target area will be captured when an image collector is assumed to exist on the object.

[0103] S450: If the target area is within the simulated field of view and the duration is greater than a second preset duration, it is determined that the target person has an abnormal shooting behavior towards the protection person.

[0104] Exemplarily, if the target area is within the simulated field of view, it means that if the object carries an image collector, the image collector can capture the target area when performing image capture. If the duration is greater than the second preset duration, it is determined that the image collector may be in a situation of continuous tracking and shooting. In this case, it can be determined that the target person has abnormal shooting behavior of the protection personnel, thereby accurately detecting and judging the abnormal shooting behavior of the target person.

[0105] In an embodiment of the present application, the method further includes:

[0106] Determine whether the target person has engaged in abnormal filming behavior toward at least one other protected person;

[0107] If so, and the number of other protection personnel reaches the preset number, the target person will be reported to the preset platform.

[0108] Exemplarily, in order to reduce the possibility of misjudgment, the target person who has been determined to have abnormal shooting behavior can be further tracked and detected to detect whether the target person has abnormal shooting behavior on at least one other protection personnel. The detection process is the same as the process of detecting whether the target person has abnormal shooting behavior on the protection personnel in the above embodiment. If the target person also has abnormal shooting behavior on at least one other protection personnel, and the number of at least one other protection personnel reaches a preset number, that is, the number of objects of the abnormal shooting behavior reaches a preset number, it is determined that the target person has abnormal shooting behavior, and the target person is reported to the preset platform, so that the staff can determine the target person according to the preset platform and take corresponding blocking and punishment measures.

[0109] Specifically, the target person can be evaluated by scoring. For example, when the target person is detected to have abnormal filming behavior of the protection personnel for the first time, the target person is recorded as 60 points. Each subsequent detection of abnormal filming behavior of the target person and the protection personnel will add 10 points on the basis of 60 points until the score reaches the preset score, which is then reported to the preset platform for processing. The preset score can be determined according to the actual situation.

[0110] The embodiment of the present application provides a behavior detection method, which determines the relative position of the object and the target area of ​​the protection personnel; if the height of the object is lower than the height of the target area, the relative relationship between the object and the target area of ​​the protection personnel is determined according to the simulated field of view and the target area; wherein the simulated field of view assumes that the object carries an image collector, and the image collector simulates the field of view when performing image acquisition, and through dual detection of relative height detection between the object and the target area, and relative relationship detection between the target area and the simulated field of view, it is accurately simulated that the image collector carried by the object will capture the target area when performing image acquisition, so as to accurately judge the abnormal shooting behavior of the target person, avoid the situation where the target person hides the image collector in the object and cannot be identified by conventional detection, and improve the accuracy of abnormal shooting behavior detection.

[0111] In the embodiment of the present application, determining whether the target person has abnormal shooting behavior toward the protection person according to the relative relationship includes:

[0112] If the target area is within the simulated field of view, it is determined that the target person has abnormal shooting behavior towards the protection person.

[0113] For example, if the target area is within the simulated field of view, it means that if the object carries an image collector, the image collector can capture the target area when performing image acquisition. In this case, it can be determined that the target person has abnormal shooting behavior of the protection personnel, so as to accurately detect and judge the abnormal shooting behavior of the target person.

[0114] Embodiment 5

[0115] Figure 6 This is a schematic diagram of the structure of a behavior detection device provided in Embodiment 5 of the present application. The device can execute the behavior detection method provided in any embodiment of the present application and has the corresponding functional modules and beneficial effects of the execution method. Figure 6 As shown, the device comprises:

[0116] A personnel determination module 510 is used to determine the protection personnel according to the visual characteristics of the candidate personnel, determine the target personnel according to the abnormal behavior characteristics of the candidate personnel, and determine the associated protection personnel and target personnel;

[0117] A behavior detection module 520 is used to detect the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel.

[0118] The abnormal shooting behavior determination module 530 determines whether the target person has abnormal shooting behavior towards the protection personnel according to the behavior detection result.

[0119] In the embodiment of the present application, the personnel determination module 510 includes:

[0120] A first associating unit is configured to determine that the target person is associated with the protection person if there is a target person located in a preset area around the protection person; and / or,

[0121] The second associating unit is used to determine that the protecting person is associated with the target person if there is a protecting person located in a preset area around the target person.

[0122] In the embodiment of the present application, the behavior detection module 520 includes:

[0123] An abnormal approach behavior detection unit, used to determine whether the target person has abnormal approach behavior towards the protection person;

[0124] The abnormal shooting behavior detection unit is used to detect whether the target person has abnormal shooting behavior towards the protection personnel if the target person has abnormal approach behavior towards the protection personnel.

[0125] Abnormal shooting behavior detection unit, including:

[0126] A relative relationship determination subunit, for detecting an item carried by the target person to determine a relative relationship between the item and the target area of ​​the protection person if the target person has abnormal approach behavior toward the protection person;

[0127] The abnormal shooting behavior determination module 530 is used to determine whether the target person has any abnormal shooting behavior towards the protection person according to the relative relationship.

[0128] In the embodiment of the present application, the abnormal approach behavior detection unit includes:

[0129] A relative distance determination subunit is used to determine the relative distance between the target person and the protection person; or, if the density of people within a preset range centered on the protection person is less than a preset density, determine the relative distance between the target person and the protection person;

[0130] The abnormal approach behavior determination subunit determines, according to the relative distance, whether the target person has an abnormal approach behavior toward the protection person.

[0131] In the embodiment of the present application, the abnormal approach behavior determination subunit is specifically used to:

[0132] If the relative distance is less than the preset distance, or,

[0133] If the relative distance is less than the preset distance and the duration is greater than the first preset duration, identifying whether there is any interaction between the protection personnel and the target personnel;

[0134] If not, it is determined that the target person has abnormal approach behavior towards the protection personnel.

[0135] In the embodiment of the present application, the relative relationship determination unit includes:

[0136] a relative position determination subunit, for determining the relative position of the object and the target area of ​​the protection personnel;

[0137] The simulation subunit is used to determine the relative relationship between the object and the target area of ​​the protection personnel based on the simulated field of view and the target area if the height of the object is lower than the height of the target area; wherein the simulated field of view is assuming that the object carries an image collector, and the image collector simulates the field of view when performing image acquisition.

[0138] In the embodiment of the present application, the simulation subunit is specifically used for:

[0139] The object is used as a vertex, the preset angle is used as a cone angle, and the preset direction is used as a cone opening direction to construct a cone area as a simulated field of view range;

[0140] Determine whether the target area is within the simulated field of view.

[0141] In the embodiment of the present application, the behavior determination unit includes:

[0142] A judgment subunit is used to determine if the target area is within the simulated field of view, or

[0143] If the target area is within the simulated field of view and the duration is greater than a second preset duration, it is determined that the target person has an abnormal shooting behavior towards the protection person.

[0144] In the embodiment of the present application, the device further includes:

[0145] a radiation detection module, used to determine whether the target person has abnormal filming behavior towards at least one other protected person;

[0146] The reporting module is used to report the target person to a preset platform if the number of other protected personnel reaches a preset number.

[0147] In the embodiment of the present application, the personnel determination module 510 includes:

[0148] A recognition module, used to recognize visual features of the candidate according to the image of the candidate;

[0149] The protection personnel determination module is used to determine that the candidate personnel is a protection personnel if the visual features of the candidate personnel match the preset features.

[0150] A behavior detection device provided in an embodiment of the present application can execute a behavior detection method provided in any embodiment of the present application, and has functional modules and beneficial effects corresponding to the execution method.

[0151] Embodiment 6

[0152] Figure 7 A schematic diagram of an electronic device 10 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0153] like Figure 7As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0154] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0155] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as the behavior detection method.

[0156] In some embodiments, the behavior detection method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the behavior detection method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the behavior detection method in any other appropriate manner (e.g., by means of firmware).

[0157] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0158] The computer programs for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable behavior detection device, so that when the computer programs are executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer programs may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0159] In the context of the present application, a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device or equipment. A computer readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer readable storage medium may be a machine readable signal medium. A more specific example of a machine readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0160] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0161] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0162] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0163] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the information expected by the technical solution of this application can be achieved, and this document is not limited here.

[0164] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. A behavior detection method, characterized in that: The method comprises: Determine the protection personnel based on the visual features of the candidate personnel, determine the target personnel based on the abnormal behavior features of the candidate personnel, and determine the associated protection personnel and target personnel; For the associated protection personnel and target personnel, detecting the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel; According to the behavior detection result, it is determined whether the target person has any abnormal filming behavior towards the protection personnel.

2. The method according to claim 1, characterized in that Identify relevant protection officers and target persons, including: If there is a target person located in the preset area around the protection person, then determining that the target person is associated with the protection person; and / or, If there is a protection person located in the preset area around the target person, it is determined that the protection person is associated with the target person.

3. The method according to claim 1, characterized in that: The behavior of the protection personnel and / or the target personnel is detected based on the image of the protection personnel and the image of the target personnel, including: Determining whether the target person has any abnormal approaching behavior toward the protection personnel; If the target person has abnormal approach behavior toward the protection person, detection is performed to determine whether the target person has abnormal shooting behavior toward the protection person.

4. The method according to claim 3, characterized in that: Determining whether the target person has any abnormal approach behavior toward the protection personnel includes: Determine the relative distance between the target person and the protection person; or, If the density of people within a preset range centered on the protection personnel is less than a preset density, determining the relative distance between the target person and the protection personnel; It is determined based on the relative distance that the target person has abnormal approaching behavior toward the protection person.

5. The method according to claim 4, characterized in that Determining, according to the relative distance, that the target person has an abnormal approaching behavior toward the protection person includes: If the relative distance is less than the preset distance, or, If the relative distance is less than the preset distance and the duration is longer than the first preset duration, then identifying whether there is any interaction between the protection personnel and the target personnel; If not, it is determined that the target person has abnormal approach behavior towards the protection personnel.

6. The method according to claim 3, characterized in that Detecting whether the target person has any abnormal filming behavior towards the protection personnel includes: Detecting the items carried by the target person to determine the relative relationship between the items and the target area of ​​the protected person; Accordingly, according to the behavior detection result, determining whether the target person has abnormal filming behavior towards the protection personnel includes: According to the relative relationship, it is determined whether the target person has any abnormal shooting behavior towards the protection person.

7. The method according to claim 6, characterized in that Detecting the items carried by the target person to determine the relative relationship between the items and the target area of ​​the protected person includes: determining the relative position of the object to the target area of ​​the protection officer; If the height of the object is lower than the height of the target area, the relative relationship between the object and the target area of ​​the protection personnel is determined based on the simulated field of view and the target area; wherein the simulated field of view is assuming that the object carries an image collector, and the image collector simulates the field of view when performing image acquisition.

8. The method according to claim 7, characterized in that Determining, based on the relative relationship, whether the target person has abnormal filming behavior toward the protection person includes: If the target area is within the simulated field of view, or, If the target area is within the simulated field of view and the duration is greater than a second preset duration, it is determined that the target person has an abnormal shooting behavior towards the protection person.

9. The method according to claim 1, characterized in that: The method further comprises: Determine whether the target person has engaged in abnormal filming behavior toward at least one other protected person; If so, and the number of other protection personnel reaches the preset number, the target person will be reported to the preset platform.

10. The method according to claim 1, characterized in that Identify protection personnel based on the visual characteristics of the candidate, including: Recognize visual features of the candidate according to the image of the candidate; If the visual features of the candidate personnel match the preset features, the candidate personnel is determined to be a protection person.

11. A behavior detection device, characterized in that: The device comprises: A personnel determination module is used to determine the protection personnel according to the visual characteristics of the candidate personnel, determine the target personnel according to the abnormal behavior characteristics of the candidate personnel, and determine the associated protection personnel and target personnel; A behavior detection module, for detecting the behavior of the protection personnel and / or the target personnel according to the image of the protection personnel and the image of the target personnel; The abnormal shooting behavior determination module determines whether the target person has abnormal shooting behavior towards the protection person according to the behavior detection result.

12. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the behavior detection method according to any one of claims 1 to 10.

Images