Inspection behavior identification method and device, inspection equipment and storage medium

Abstract

The invention discloses an inspection behavior recognition method, which comprises the following steps: when a trigger instruction of a user is obtained, determining the advancing direction of the user; identifying a target person in the advancing direction of the user according to the trigger instruction, and determining the target person containing a target violation behavior; and if the target person is within the preset distance, outputting alarm information corresponding to the target illegal behavior to the target person. According to the invention, in the process of maintaining the inspection order by the inspection personnel, direct conflicts are avoided, so that the inspection is more humanized, and the inspection efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of security inspection technology, and in particular to an inspection behavior recognition method, device, inspection equipment and storage medium. Background Art

[0002] During the security inspection process, there are personnel conflicts due to some objective reasons. For example, there are illegal stalls on the market, and certain conflicts will arise when the inspectors need to warn and punish them. As a result, the inspectors are prone to certain direct conflicts in the process of maintaining the inspection order, which makes the inspection less humane and the inspection efficiency is low. Summary of the invention

[0003] In a first aspect, the main purpose of the present invention is to provide a method for identifying patrol behavior, comprising:

[0004] When a trigger instruction of the user is obtained, determining the direction of travel of the user;

[0005] Identify the persons to be identified in the direction of travel of the user according to the trigger instruction, and determine the target persons who have committed target violations;

[0006] If the target person is within the preset distance, the warning information corresponding to the target violation behavior is output to the target person.

[0007] Preferably, when the trigger instruction of the user is obtained, before determining the direction of travel of the user, the method includes:

[0008] Acquire image information of people in a predetermined area;

[0009] Identify the image information of the personnel and determine the violators who have committed illegal acts;

[0010] Corresponding position information is determined based on the violator, and the image information and position information of the violator are stored in a preset violator database.

[0011] Preferably, identifying the persons to be identified in the direction of travel of the user according to the trigger instruction and determining the target persons who have committed target violations includes:

[0012] Determining the characteristics of the person to be identified according to the trigger instruction;

[0013] Compare the characteristics of the person to be identified with the characteristics of each violator in the preset violator database;

[0014] If there is a person whose characteristics of the violators match the characteristics of the person to be identified in the preset violators database, the person whose characteristics of the violators match the characteristics of the person to be identified is determined as the target person.

[0015] Preferably, after comparing the characteristics of the person to be identified with the characteristics of each violator in the preset violator database, the method further includes:

[0016] If there is no person whose characteristics match those of the person to be identified in the preset illegal person database, the behavior of the person to be identified is identified in real time;

[0017] If the person to be identified has a target violation, the person to be identified is determined as a target person;

[0018] If the person to be identified does not have the target violation behavior, a reminder message is output to the user.

[0019] Preferably, if the target person is within a preset distance, before outputting the warning information corresponding to the target violation to the target person, the method includes:

[0020] Obtaining location information of the target person;

[0021] Calculate the distance based on the location information of the target person to obtain the real-time distance of the target person;

[0022] It is determined whether the target person is within a preset distance according to the real-time distance.

[0023] Preferably, if the target person is within a preset distance, outputting warning information corresponding to the target violation to the target person includes:

[0024] If the target person is within the preset distance, obtain each warning information in the pre-stored warning information database, wherein the warning information corresponds to the violation behavior;

[0025] Matching the violation behaviors corresponding to each alarm information in the alarm information database with the target violation behaviors to determine the alarm information corresponding to the target violation behaviors;

[0026] Based on the warning information, voice information is output to the target person.

[0027] Preferably, the outputting voice information to the target person based on the warning information includes:

[0028] The warning information corresponding to the target violation behavior is used as the main voice information;

[0029] Acquire the personal characteristics of the target person, and filter out appearance characteristic information from the personal characteristics;

[0030] Merging the appearance feature information with the subject information to form the voice information;

[0031] The voice information is output to the target person.

[0032] In a second aspect, the main purpose of the present invention is to provide a patrol behavior recognition device, comprising:

[0033] A determination module, configured to determine a direction of travel of the user when a trigger instruction of the user is obtained;

[0034] A first identification module is used to identify the persons to be identified in the direction of travel of the user according to the trigger instruction, and determine the persons to be identified who have committed target violations;

[0035] The first output module is used to output the warning information corresponding to the target violation behavior to the person to be identified if the person to be identified is within a preset distance.

[0036] In a third aspect, an embodiment of the present invention provides an inspection device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the inspection behavior identification method as described above when executing the computer program.

[0037] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the inspection behavior identification method as described above are implemented.

[0038] The above solution of the present invention includes at least the following beneficial effects:

[0039] The inspection behavior identification method provided by the present invention first determines the direction of travel of the user when the user's trigger instruction is obtained; identifies the target person in the direction of travel of the user according to the trigger instruction, and determines the target person who has the target violation behavior; if the target person is within a preset distance, outputs the alarm information corresponding to the target violation behavior to the target person. Therefore, in the process of patrol personnel maintaining the inspection order, it is not necessary for the patrol personnel to directly speak the alarm information to the target person, but the patrol equipment or accessories are used for sound management, which can reduce the participation of patrol personnel in direct conflicts while maintaining order. When the target person re-regulates his behavior, it is not easy for the patrol personnel to accept the emotional force of the patrol personnel, but only the unified management of the sound of the equipment or accessories. In other words, a dull force is formed based on the output of the intermediate equipment or accessories, making the inspection more humane and improving the inspection efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0041] Figure 1 A schematic diagram of a process flow of an inspection behavior identification method provided by an embodiment of the present invention;

[0042] Figure 2 A structural block diagram of a patrol behavior identification device provided by an embodiment of the present invention;

[0043] Figure 3 This is a structural block diagram of the inspection device provided in an embodiment of the present invention.

[0044] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0046] The terms "first", "second", "third", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any variation thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0047] Since this application involves relevant privacy data, in the specific implementation of this application, related data such as facial images or body images are involved. When the embodiments in this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0048] First, the scheme of the embodiment of the present application is introduced by way of examples with reference to the relevant drawings.

[0049] like Figure 1 As shown, a specific embodiment of the present invention provides a patrol behavior recognition method, including:

[0050] S10. When a trigger instruction from the user is obtained, determine the moving direction of the user.

[0051] Among them, the user can be an inspection personnel. During the inspection process of the inspection personnel, the inspection can be carried out with the cooperation of the inspection equipment. For example, the inspection equipment can be an inspection three-proof machine with a camera and other equipment. The product can be directly hung on the clothes of the inspection personnel. Its viewing angle coincides with the front viewing angle of the inspection personnel. It moves in front of the inspection personnel and collects the image information of each person in real time. When the user sends a trigger instruction to the inspection equipment through a terminal, button, etc., the inspection equipment can start to assist the inspection personnel in inspection according to the trigger instruction; the user's travel direction can be the same as the travel direction of the inspection equipment, which can be confirmed by the user's trigger instruction, and then assist in the inspection after determining the user's travel direction, so that when the user arrives at the area where order needs to be maintained, it can be reminded in advance to reduce conflicts.

[0052] S20. Identify persons to be identified in the direction of travel of the user according to the trigger instruction, and determine target persons who have committed target violations.

[0053] In a specific embodiment of the present invention, the person to be identified may be a person with different behaviors, for example, a person with illegal behaviors or a person without illegal behaviors; "illegal behaviors" include stall-setting behaviors, smoking behaviors, etc., and illegal behaviors can be determined by combining regional division and positioning. In some embodiments, positioning and regional behavior requirement information may be further included. Different behavior management may correspond to different areas. For example, smoking is prohibited in some public places, smoking is not prohibited in some areas, but stalls are not allowed to sell goods and snacks, and slippers and shirtlessness are not allowed in some areas. Therefore, by first locating and obtaining the behavior requirements of the positioning area, and using it as a reference behavior, it can be more in line with the behavior requirements of the inspection specifications required for each area; in general, the target illegal behavior may be a corresponding illegal behavior in a certain area. In this process, by specifically identifying the person to be identified in the direction of the user's travel, the target person can be determined in advance to assist the inspection personnel in completing the inspection, thereby reducing conflicts.

[0054] It is worth mentioning that some public behavioral norms are common across regions. Therefore, even without positioning and obtaining regional behaviors, identification can be performed based on common behavioral norms.

[0055] S30: If the target person is within the preset distance, output warning information corresponding to the target violation to the target person.

[0056] Among them, when the inspection equipment moves towards the target person, it can calculate the distance between the target person and the inspection equipment in real time, and by comparing the distance calculated in real time with the preset distance, it is determined whether to output an alarm message to the target person; it can be understood that the real-time distance between the target person and the inspection equipment can be calculated by visual estimation. When calculating, the pixel size of the target person on the image can be calculated according to the image information corresponding to the target person, the parameters of the camera on the inspection equipment and the actual size of the target person, and then the proportional calculation can be performed according to the pixel size of the target person on the image and the actual size to determine the distance from the target person to the inspection equipment.

[0057] Optionally, the distance between the target person and the inspection equipment can also be achieved through infrared ranging or the like, so that when it is determined that the target person is within a preset distance, an alarm message can be output to the target person in a timely manner to remind the target person.

[0058] Specifically, when the user's trigger instruction is obtained, before determining the user's direction of travel, the above process includes: obtaining image information of people in a predetermined area; identifying the image information of people to determine violators who have committed illegal acts; determining corresponding location information based on the violators, and storing the image information and location information of the violators in a preset violator database.

[0059] In a specific embodiment of the present invention, the predetermined area may be a street, a sidewalk, or other area. During the inspection process of the inspection equipment, images of various persons in the predetermined area may be collected, thereby obtaining image information of the persons in the predetermined area. When identifying the image information of the persons, a pre-trained personnel recognition model may be used to identify the persons in the predetermined area so as to determine whether the persons in the predetermined area have violated the rules. It is worth mentioning that the preset violator database stores the personnel characteristics and violation behaviors of the violators. The personnel characteristics may include facial features and body features, such as gender and the color of the clothes and pants worn. The violation behaviors may include smoking in a no-smoking area, setting up a stall in a no-stall area, and the like. By storing the violators in the preset database, the violators can be identified. A database of violators is set up, so that violators in various areas can be identified more quickly; it can be understood that the image information of the violator can be a facial image, and the direction information can be four directions of east, south, west and north. By outputting and displaying the facial image and direction information of the violator, the inspection personnel can view it through the inspection equipment, and then a trigger instruction can be output to make the inspection equipment assist in the inspection in the direction of the violator; optionally, the timing of identification can be before the inspection personnel arrives at the predetermined area, so that when the inspection personnel arrives at the predetermined area, an instruction can be sent to the inspection equipment, so that the inspection equipment re-identifies the personnel in each area according to the specific trigger instruction, so as to ensure more accurate identification.

[0060] Specifically, the above-mentioned identifying the person to be identified in the user's direction of travel according to the trigger instruction and determining the target person who has the target violation behavior includes: determining the characteristics of the person to be identified according to the trigger instruction; comparing the characteristics of the person to be identified with the characteristics of each violator in a preset violator database; if there are persons in the preset violator database whose characteristics match the characteristics of the person to be identified, then the person in the characteristics of the violator that matches the characteristics of the person to be identified is determined as the target person.

[0061] In a specific embodiment of the present invention, the trigger instruction may be an instruction to inspect a certain area or multiple areas, or a voice warning assistance instruction triggered by the inspection personnel. When the inspection device inspects in the direction of the inspection personnel, the personnel to be identified can be identified by a pre-trained personnel recognition model, thereby determining the characteristics of the personnel to be identified. It can be understood that the preset illegal personnel database stores the personnel characteristics and illegal behaviors of the illegal personnel. When the characteristics of the personnel to be identified are compared with the characteristics of the illegal personnel, if the comparison between the characteristics of the personnel to be identified and the characteristics of the illegal personnel is successful, it means that there is a person with the same characteristics as the illegal personnel in the preset illegal personnel database of the inspection device. The corresponding features of the violators can then be determined as the target persons for reminders. It can be understood that by preferentially comparing the features of the persons to be identified in the user's direction of travel with the features of the violators stored in the preset violators database, the identified target persons and behaviors can be quickly extracted, making the recognition efficiency higher; when the comparison between the features of the person to be identified and the features of the violators fails, it means that the features of the violators corresponding to the person to be identified in the preset violators database of the inspection equipment do not exist. At this time, other objects can be quickly replaced and the image information of other persons to be identified can be processed, thereby making the recognition accuracy and efficiency higher.

[0062] In a specific embodiment, after comparing the characteristics of the person to be identified with the characteristics of each violator in a preset violator database, the following also includes: if there is no person in the preset violator database whose characteristics match the characteristics of the person to be identified, the behavior of the person to be identified is identified in real time; if the person to be identified has a target violation behavior, the person to be identified is determined as the target person; if the person to be identified does not have a target violation behavior, a reminder message is output to the user.

[0063] Among them, when the person to be identified is identified in real time, a pre-trained behavior recognition model can be used for real-time identification, thereby determining whether the behavior of the person to be identified is a target violation. It can be understood that the target violation can correspond to the area in the direction of travel of the patrol personnel. For example, the target violation in a prohibited stall area can be a stall-setting behavior. In the real-time identification process, if stall-setting behavior is identified in the prohibited stall area, the person to be identified in the area can be determined as a target person, and then an alarm information can be output to the target person to remind the target person.

[0064] It is understandable that the aforementioned "no target violation" includes the two situations of "no violation confirmed after identification" and "unable to identify". In some optional embodiments, if the inspection device cannot identify the corresponding target person or target behavior, it can issue information feedback such as "unable to identify" / "identification error", such as vibrating 3 times, to indicate to the inspection personnel in advance that this area cannot be assisted and needs to be handled by the inspection personnel themselves.

[0065] It is understandable that in some other examples, the current target person's behavior can be directly identified, and there is no need for advance identification and storage. In some preferred embodiments of the present invention, through early identification, the background can have sufficient time for the recognition algorithm, so that when the results are compared in real time, the comparison is simpler and faster. Through comparison and retrieval, the previously stored results can be quickly called. However, people have subjective initiative and will move and change. Therefore, in the process of identification sequence, the previously stored results can be called as the first priority identification method, and real-time identification can be used as the second priority identification method, so as to meet the needs of different inspection situations and make the inspection efficiency more efficient.

[0066] In a specific embodiment, if the target person is within the preset distance, the above-mentioned process of outputting the alarm information corresponding to the target violation to the target person includes: obtaining the location information of the target person; performing distance calculation based on the location information of the target person to obtain the real-time distance of the target person; and judging whether the target person is within the preset distance based on the real-time distance.

[0067] Among them, the inspection equipment can determine the location information of the target person through a camera or infrared light, and then use visual estimation or infrared ranging to calculate the real-time distance of the target person. When the inspection equipment approaches the target person, it can determine whether it is within the preset distance through the real-time distance. If it is within the preset distance, the target person can be warned through pre-stored alarm information to remind the target person to stop the illegal behavior.

[0068] Specifically, if the target person is within a preset distance, outputting alarm information corresponding to the target violation to the target person includes: if the target person is within a preset distance, obtaining each alarm information in a pre-stored alarm information library, wherein the alarm information corresponds to the violation; matching the violation corresponding to each alarm information in the alarm information library with the target violation to determine the alarm information corresponding to the target violation; and outputting voice information to the target person based on the alarm information.

[0069] In a specific embodiment of the present invention, the alarm information may be a prohibition on setting up stalls, a prohibition on smoking, etc. By determining the target person and his target violation behavior, the corresponding alarm information can be called for the area where the target person is located. By matching the target violation behavior with the violation behavior corresponding to each alarm information, if the corresponding violation behavior is matched in the alarm information database, the alarm information corresponding to the violation behavior can be output to remind the target person to stop the violation behavior, thereby avoiding direct conflict and making inspections more humane.

[0070] In an optional embodiment, the above-mentioned output of voice information to the target person based on the alarm information includes: using the alarm information corresponding to the target violation as the main voice information; obtaining the personnel characteristics of the target person, and screening out the appearance feature information from the personnel characteristics; fusing the appearance feature information with the main information to form voice information; and outputting the voice information to the target person.

[0071] In a specific embodiment of the present invention, the voice subject information may be an alarm message including the target violation behavior, the appearance feature information of the target person may be confirmed in real time, or may be obtained from a preset violator database, and the appearance feature information may include the target person's clothing, gender, age and other features. For example, the person feature alarm information may be an uncle wearing red clothes. Here, the appearance feature information includes "uncle, red clothes"; thus, after determining the appearance feature information, the appearance feature information and the voice subject information corresponding to the target violation behavior may be fused and output. For example, if the target person in a no-smoking area is wearing red clothes, then after fusing the appearance feature information and the subject information, the corresponding voice information may be an uncle wearing red clothes, and smoking is prohibited here; thereby, the target person may be more clearly informed to stop the violation, and direct contact between the patrol personnel and the target person may be reduced, conflicts may be reduced, and patrols may be more humane.

[0072] The inspection behavior identification method provided by the present invention first determines the direction of travel of the user when the user's trigger instruction is obtained; identifies the target person in the direction of travel of the user according to the trigger instruction, and determines the target person who has the target violation behavior; if the target person is within a preset distance, outputs the alarm information corresponding to the target violation behavior to the target person. Therefore, in the process of patrol personnel maintaining the inspection order, the patrol personnel do not need to speak the alarm information directly to the target person, but the inspection equipment or accessories are used for sound management, which can reduce the participation of the patrol personnel in direct conflicts while maintaining order. When the target person re-regulates his behavior, it is not easy for the patrol personnel to accept the emotional power of the patrol personnel, but only the unified management of the equipment or accessories sound. In other words, a dull force is formed based on the output of the intermediate equipment or accessories, making the inspection more humane and improving the inspection efficiency.

[0073] Reference Figure 2 As shown, the main purpose of the present invention is to provide an inspection behavior recognition device 40, comprising:

[0074] The determination module 41 is used to determine the user's direction of travel when a trigger instruction from the user is obtained;

[0075] The first identification module 42 is used to identify the persons to be identified in the direction of the user's travel according to the trigger instruction, and determine the target persons who have committed the target violation;

[0076] The first output module 43 is used to output warning information corresponding to the target violation behavior to the person to be identified if the person to be identified is within a preset distance.

[0077] Preferably, the above device also includes:

[0078] A first acquisition module, used to acquire image information of people in a predetermined area;

[0079] The second recognition module is used to recognize the image information of personnel and determine the violators who have committed illegal acts;

[0080] The second output module is used to determine the corresponding position information according to the violator, and store the image information and position information of the violator in a preset violator database.

[0081] Preferably, the first identification module 42 includes:

[0082] A determination unit, used to determine target personnel characteristics of the target personnel according to the trigger instruction;

[0083] A comparison unit, used to compare the target person's characteristics with the violating person's characteristics of each violating person in a preset violating person database;

[0084] The first determination unit is used to determine the person whose characteristics of the violating person match those of the target person as the target person if there is a person whose characteristics of the violating person match those of the target person in the preset violating person database.

[0085] Preferably, the comparison unit comprises:

[0086] The identification subunit is used to identify the behavior of the target person in real time if there is no person whose characteristics match those of the target person in the preset offender database;

[0087] A storage subunit, for storing the personnel characteristics and the target violation behavior of the target personnel if the target personnel has the target violation behavior;

[0088] The output subunit is used to output reminder information to the user if the target person does not have any target violation behavior.

[0089] Preferably, the above device also includes:

[0090] The second acquisition module is used to obtain the location information of the target person;

[0091] A calculation module is used to calculate the distance according to the location information of the target person to obtain the real-time distance of the target person;

[0092] The judgment module is used to judge whether the target person is within a preset distance based on the real-time distance.

[0093] Preferably, the first output module 43 includes:

[0094] A first acquisition unit is used to acquire each warning information in a pre-stored warning information database if the target person is within a preset distance, wherein the warning information corresponds to a violation behavior;

[0095] The matching unit is used to match the violation behaviors corresponding to each alarm information in the alarm information database with the target violation behaviors, determine the alarm information corresponding to the target violation behaviors, and output voice information to the target person based on the alarm information.

[0096] Preferably, the first output module 43 further includes:

[0097] A second determining unit is used to use the warning information corresponding to the target violation behavior as the main voice information;

[0098] The second acquisition unit is used to acquire the personnel characteristics of the target person and filter out the appearance characteristic information from the personnel characteristics;

[0099] A fusion unit, used to fuse the appearance feature information with the main body information to form voice information;

[0100] The inspection behavior identification device provided by the present invention first determines the direction of travel of the user when the user's trigger instruction is obtained; identifies the target person in the direction of travel of the user according to the trigger instruction, and determines the target person who has the target violation behavior; if the target person is within a preset distance, outputs the alarm information corresponding to the target violation behavior to the target person. Therefore, in the process of patrol personnel maintaining the inspection order, it is not necessary for the patrol personnel to directly speak the alarm information to the target person, but the inspection equipment or accessories are used for sound management, which can reduce the participation of patrol personnel in direct conflicts while maintaining order. When the target person re-regulates his behavior, it is not easy for the patrol personnel to accept the emotional power of the patrol personnel, but only the unified management of the equipment or accessories sound. In other words, a dull force is formed based on the output of the intermediate equipment or accessories, making the inspection more humane and improving the inspection efficiency.

[0101] It should be noted that the inspection behavior identification device 40 provided in the specific embodiment of the present invention is a device corresponding to the above-mentioned inspection behavior identification method, and all embodiments of the above-mentioned inspection behavior identification method are applicable to the inspection behavior identification device 40. The above-mentioned inspection behavior identification device 40 embodiments all have corresponding modules corresponding to the steps in the above-mentioned inspection behavior identification method, and can achieve the same or similar beneficial effects. In order to avoid excessive repetition, each module in the inspection behavior identification device 40 will not be described in detail here.

[0102] like Figure 3 As shown, a specific embodiment of the present invention further provides a patrol device 50, including a memory 502, a processor 501, and a computer program stored in the memory 502 and executable on the processor 501, wherein the processor 501 implements the steps of the above-mentioned patrol behavior identification method when executing the computer program.

[0103] Specifically, the processor 501 is used to call the computer program stored in the memory 502 and execute the following steps:

[0104] When receiving a trigger instruction from the user, determine the direction of travel of the user;

[0105] According to the trigger instruction, the persons to be identified in the direction of the user's movement are identified, and the target persons who have committed the target violations are determined;

[0106] If the target person is within the preset distance, the warning information corresponding to the target violation will be output to the target person.

[0107] Optionally, the processor 501 performs the following steps before determining the direction of travel of the user when obtaining the trigger instruction of the user:

[0108] Acquire image information of people in a predetermined area;

[0109] Identify personnel image information and identify violators who have committed illegal acts;

[0110] The corresponding position information is determined according to the violators, and the image information and position information of the violators are stored in a preset violator database.

[0111] Optionally, the processor 501 identifies the persons to be identified in the direction of travel of the user according to the trigger instruction, and determines that the target persons who have the target violation behavior include:

[0112] Determine the characteristics of the person to be identified according to the trigger instruction;

[0113] Compare the characteristics of the person to be identified with the characteristics of each violator in the preset violator database;

[0114] If there are persons whose characteristics of the violators match those of the persons to be identified in the preset violators database, the persons whose characteristics of the violators match those of the persons to be identified are determined as target persons.

[0115] Optionally, after the processor 501 compares the characteristics of the person to be identified with the characteristics of each violator in the preset violator database, the following steps may also be performed:

[0116] If there is no person whose characteristics match those of the person to be identified in the preset illegal person database, the behavior of the person to be identified is identified in real time;

[0117] If the person to be identified has a target violation, the person to be identified will be identified as a target person;

[0118] If the person to be identified does not have the target violation behavior, a reminder message is output to the user.

[0119] Optionally, before the processor 501 executes outputting warning information corresponding to the target violation to the target person if the target person is within the preset distance, the process includes:

[0120] Obtain the location information of the target person;

[0121] Calculate the distance based on the location information of the target person to obtain the real-time distance of the target person;

[0122] Determine whether the target person is within the preset distance based on the real-time distance.

[0123] Optionally, if the target person is within a preset distance, the processor 501 outputs warning information corresponding to the target violation to the target person, including:

[0124] If the target person is within the preset distance, obtain each warning information in the pre-stored warning information database, wherein the warning information corresponds to the violation behavior;

[0125] The violation behaviors corresponding to each alarm information in the alarm information database are matched with the target violation behaviors, the alarm information corresponding to the target violation behaviors is determined, and voice information is output to the target personnel based on the alarm information.

[0126] Optionally, the processor 501 outputs voice information to the target person based on the warning information, including:

[0127] The warning information corresponding to the target violation behavior is used as the main voice information;

[0128] Obtain the personnel characteristics of the target person, and filter out the appearance characteristic information from the personnel characteristics;

[0129] The appearance feature information is integrated with the main information to form the voice information;

[0130] The voice information is output to the target person.

[0131] That is, in a specific embodiment of the present invention, the processor 501 of the inspection device 50 implements the steps of the above-mentioned inspection behavior identification method when executing a computer program. Therefore, in the process of maintaining inspection order, the inspection personnel do not need to speak the alarm information directly to the target personnel. Instead, the inspection equipment or accessories are used for sound management. This can reduce the participation of inspection personnel in direct conflicts while maintaining order. When the target personnel re-regulate their behavior, it is not easy for them to accept the emotional power of the inspection personnel but only the unified management of the sound of the equipment or accessories. In other words, a dull force is formed based on the output of the intermediate equipment or accessories, making the inspection more humane and improving the inspection efficiency.

[0132] It should be noted that since the processor 501 of the inspection device 50 implements the steps of the above-mentioned inspection behavior identification method when executing a computer program, all embodiments of the above-mentioned inspection behavior identification method are applicable to the inspection device 50 and can achieve the same or similar beneficial effects.

[0133] The computer-readable storage medium provided in the embodiment of the present invention stores a computer program. When the computer program is executed by the processor, it implements the various processes of the inspection behavior identification method or the application-side inspection behavior identification method provided in the embodiment of the present invention, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0134] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

[0135] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0136] The above description is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. All equivalent structural changes made by using the contents of the present invention specification and drawings under the concept of the present invention, or directly / indirectly applied in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. A patrol behavior recognition method, characterized in that: include: When a trigger instruction of the user is obtained, determining the direction of travel of the user; Identify the persons to be identified in the direction of travel of the user according to the trigger instruction, and determine the target persons who have committed target violations; If the target person is within the preset distance, the warning information corresponding to the target violation behavior is output to the target person.

2. The inspection behavior recognition method according to claim 1, characterized in that: When the trigger instruction of the user is obtained, determining the direction of travel of the user includes: Acquire image information of people in a predetermined area; Identify the image information of the personnel and determine the violators who have committed illegal acts; Corresponding position information is determined based on the violator, and the image information and position information of the violator are stored in a preset violator database.

3. The inspection behavior recognition method according to claim 2, characterized in that: The identifying of the persons to be identified in the direction of travel of the user according to the trigger instruction and determining the target persons who have committed target violations include: Determining the characteristics of the person to be identified according to the trigger instruction; Compare the characteristics of the person to be identified with the characteristics of each violator in the preset violator database; If there is a person whose characteristics of the violators match the characteristics of the person to be identified in the preset violators database, the person whose characteristics of the violators match the characteristics of the person to be identified is determined as the target person.

4. The inspection behavior recognition method according to claim 3, characterized in that: After comparing the characteristics of the person to be identified with the characteristics of each violator in the preset violator database, the method further includes: If there is no person whose characteristics match those of the person to be identified in the preset illegal person database, the behavior of the person to be identified is identified in real time; If the person to be identified has a target violation, the person to be identified is determined as a target person; If the person to be identified does not have the target violation behavior, a reminder message is output to the user.

5. The inspection behavior recognition method according to claim 1, characterized in that: If the target person is within the preset distance, before outputting the warning information corresponding to the target violation to the target person, the method includes: Obtaining location information of the target person; Calculate the distance based on the location information of the target person to obtain the real-time distance of the target person; It is determined whether the target person is within a preset distance according to the real-time distance.

6. The inspection behavior recognition method according to claim 1, characterized in that: If the target person is within the preset distance, outputting the warning information corresponding to the target violation to the target person includes: If the target person is within the preset distance, obtain each warning information in the pre-stored warning information database, wherein the warning information corresponds to the violation behavior; Matching the violation behaviors corresponding to each alarm information in the alarm information database with the target violation behaviors to determine the alarm information corresponding to the target violation behaviors; Based on the warning information, voice information is output to the target person.

7. The inspection behavior recognition method according to claim 6, characterized in that: The outputting voice information to the target person based on the warning information includes: The warning information corresponding to the target violation behavior is used as the main voice information; Acquire the personal characteristics of the target person, and filter out appearance characteristic information from the personal characteristics; Merging the appearance feature information with the subject information to form the voice information violation behavior; The voice information is output to the target person.

8. A patrol behavior recognition device, characterized in that: include: A determination module, configured to determine a direction of travel of the user when a trigger instruction of the user is obtained; A first identification module is used to identify the persons to be identified in the direction of travel of the user according to the trigger instruction, and determine the persons to be identified who have committed target violations; The first output module is used to output the warning information corresponding to the target violation behavior to the person to be identified if the person to be identified is within a preset distance.

9. An inspection device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the inspection behavior identification method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the inspection behavior identification method according to any one of claims 1 to 7 are implemented.

Images