Production line safety protection area personnel statistics method, system and device

Abstract

The invention relates to a production line safety protection area personnel statistical method, system and device, and the method comprises the steps: receiving the change information (evidence chain information and count value) of target personnel in a safety protection area; judging an information source of the change information of the target person; if the information source of the change information comes from the second camera, acquiring a first foot point mapping track of the person based on all the counted evidence chain information, acquiring a second foot point mapping track of the target person based on the evidence chain information of the target person, and matching the first foot point mapping track and the second foot point mapping track; judging whether a matching pair of which the similarity is not lower than a preset threshold exists or not; if yes, abandoning the count value of the target person; and if not, the counting value of the target personnel is adopted for counting, and the accuracy of counting the personnel in the safety protection area of the production line is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of production line safety protection, in particular to a production line safety protection area personnel counting method, system and device. BACKGROUND

[0002] In the automatic production line scene, the assembly of various parts is mainly completed by a mechanical arm. Among them, a work station is also set on the production line. When the mechanical arm needs to be set or needs to be repaired due to failure, the operation of the mechanical arm in the production line will be stopped, and the maintenance personnel will enter the work station to set the parameters of the mechanical device or repair the failure. After the personnel leave the work station, the production line is reset and the mechanical arm continues to work. In this process, the personal safety of the maintenance personnel is of the utmost importance. The production line must be started only when all maintenance personnel have left, otherwise it may cause personal safety accidents.

[0003] At present, the protection of personnel safety mainly regards each work station as a safety protection area, and a camera is arranged at the entrance and exit of the safety protection area to detect the number of personnel entering the safety protection area, and the change of personnel in the safety protection area is detected through the single camera.

[0004] However, when the width of the entrance and exit of the safety protection area is large, the visual range of the single camera often cannot completely cover the entire entrance and exit, resulting in counting omission or error, and further leading to inaccurate personnel data statistics in the protection area and causing safety problems. In addition, the following limitations exist in the single camera detection in the wide channel scene:

[0005] (1) Visual blind area: although a wide-angle lens can expand the coverage range, the distortion of the edge area will lead to a decrease in recognition accuracy, resulting in missed detection of the edge area;

[0006] (2) Occlusion problem: when the flow is dense during peak hours, personnel are occluded by each other or by other objects, which will cause missed detection of personnel due to occlusion;

[0007] (3) Counting logic defects: cross-region moving targets may be repeatedly counted or missed.

[0008] In view of the problem of inaccurate personnel statistics in the production line safety protection area in the related art, no effective solution has been proposed at present. SUMMARY

[0009] A production line safety protection area personnel counting method, system and device are provided in the embodiment to solve the problem of inaccurate personnel statistics in the production line safety protection area in the related art.

[0010] The first aspect provides a production line safety protection area personnel statistics method in the embodiments, applied to a first camera, including:

[0011] receiving target personnel change information in a safety protection area; the target personnel change information includes evidence chain information and a count value;

[0012] judging an information source of the target personnel change information; the information source includes the first camera and a second camera, and a joint field of view of the first camera and the second camera is not less than a range of the safety protection area;

[0013] if the information source of the target personnel change information is from the second camera, obtaining a first foot point mapping track of personnel based on counted evidence chain information of the first camera and the second camera, and obtaining a second foot point mapping track of the target personnel based on evidence chain information of the target personnel, and matching the first foot point mapping track and the second foot point mapping track;

[0014] judging whether there is a matching pair with a similarity not less than a preset threshold;

[0015] if there is, discarding the count value of the target personnel; if there is not, adopting the count value of the target personnel for counting statistics.

[0016] In some embodiments, the evidence chain information includes image sequences in a preset time period before and after a time point when the count value is generated.

[0017] In some embodiments, the first foot point mapping track of personnel based on counted evidence chain information of the first camera and the second camera includes:

[0018] obtaining a key point of personnel in an image sequence collected by the counted first camera and the second camera;

[0019] calibrating a ground surface in the safety protection area to obtain a mapping matrix;

[0020] obtaining the first foot point mapping track of the personnel according to the key point of the personnel and the mapping matrix.

[0021] In some embodiments, the image sequence includes image information of a human body as a target or image information of a safety helmet worn by the human body as a target, and obtaining the key point of personnel in the image sequence collected by the counted first camera includes:

[0022] when a foot point position of the personnel is detected in the image collected by the first camera, taking the foot point position of the personnel as a key point of the personnel in the image;

[0023] When the foot point position of the person in the image captured by the first camera is not detected, the position of the safety helmet worn by the person is taken as the key point of the person in the image.

[0024] In some embodiments, before obtaining the first foot point mapping trajectory of the person based on the counted evidence chain information of the first camera and the second camera, the method further comprises:

[0025] When it is detected that the person moves in a preset first direction and touches the reference line, the counter value is triggered to increase by 1, the count value of the person is obtained, and an image sequence containing a preset time period before and after the time when the counter is triggered is obtained, to obtain the first camera evidence chain information; or when it is detected that the person moves in a preset second direction and touches the reference line, the counter value is triggered to decrease by 1, the count value of the person is obtained, and an image sequence containing a preset time period before and after the time when the counter is triggered is obtained, to obtain the first camera evidence chain information.

[0026] In some embodiments, the evidence chain information further comprises identification information of the target person, comprising:

[0027] If the information source of the change information of the target person is from the first camera, it is determined whether the change information of the target person is received from the second camera based on the identification information of the target person, if yes, the count value of the target person is discarded; otherwise, the count value of the target person is adopted for counting statistics.

[0028] In a second aspect, a production line safety protection area personnel statistics system is provided in the embodiment, the system comprises a first camera, a second camera and a joint statistics module, wherein the first camera comprises an information acquisition module and a joint analysis module, the information acquisition module is configured to acquire change information of a first target person in a field of view of the first camera according to a preset counting logic, and report the change information of the first target person to the joint analysis module; the joint analysis module is configured to analyze and process the change information of the first target person and / or the change information of a second target person, to obtain an analysis processing result, and report the analysis processing result to the joint statistics module.

[0029] The second camera is configured to acquire change information of a second target person in a field of view of the second camera according to a preset counting logic, and report the change information of the second target person to the joint analysis module.

[0030] The joint statistics module is configured to perform personnel change statistics in a safety protection area according to the analysis processing result reported by the joint analysis module.

[0031] In a third aspect, a production line safety protection area personnel counting device is provided in the embodiment, and comprises a receiving module, a judging module, a matching module and a counting module. The receiving module is configured to receive target personnel change information in a safety protection area. The target personnel change information comprises evidence chain information and a count value.

[0032] The judging module is configured to judge an information source of the target personnel change information. The information source comprises a first camera and a second camera, and a joint field of view of the first camera and the second camera is not less than a range of the safety protection area.

[0033] The matching module is configured to, when the information source of the target personnel change information is from the second camera, acquire a first foot point mapping track of all personnel based on counted evidence chain data of the first camera and the second camera, acquire a second foot point mapping track of the target personnel based on the evidence chain information of the target personnel, and match the first foot point mapping track and the second foot point mapping track.

[0034] The counting module is configured to judge whether there is a matching pair with a similarity not less than a preset threshold. If there is, the count value of the target personnel is discarded. If there is not, the count value of the target personnel is adopted for counting.

[0035] In a fourth aspect, an electronic device is provided in the embodiment, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor. The processor implements the production line safety protection area personnel counting method of the first aspect when executing the computer program.

[0036] In a fifth aspect, a storage medium is provided in the embodiment, which stores a computer program executable by a processor to implement the production line safety protection area personnel counting method of the first aspect.

[0037] Compared with related technologies, the production line safety protection area personnel counting method, system and device provided in the application can set two cameras in the safety protection area to respectively detect personnel change information in and out of the safety protection area, and convert evidence chain information of the collected personnel change information into foot point mapping tracks. By comparing the tracks, repeated counting, missing counting and incorrect counting of personnel are avoided, the problem of inaccurate production line safety protection area personnel counting is solved, and the accuracy of production line safety protection area personnel counting is improved.

[0038] Details of one or more embodiments of the application are presented in the following drawings and description to make other features, objects and advantages of the application more apparent. BRIEF DESCRIPTION OF DRAWINGS

[0039] The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application. In the drawings:

[0040] Figure 1 is a hardware structure block diagram of a terminal of a production line safety protection area personnel counting method of an embodiment of the application.

[0041] Figure 2 is a flowchart of a production line safety protection area personnel counting method of an embodiment of the application.

[0042] Figure 3 is a calibration schematic diagram of a production line safety protection area personnel counting method of an embodiment of the application.

[0043] Figure 4 is a relative position schematic diagram of a safety protection area, a reference line and personnel of a production line safety protection area personnel counting method of an embodiment of the application.

[0044] Figure 5a is a personnel unobstructed schematic diagram collected by a first camera of a production line safety protection area personnel counting method of an embodiment of the application.

[0045] Figure 5b is a personnel obstructed schematic diagram collected by a second camera of a production line safety protection area personnel counting method of an embodiment of the application.

[0046] Figure 6 is a flowchart of another production line safety protection area personnel counting method of an embodiment of the application.

[0047] Figure 7 is a structure schematic diagram of a production line safety protection area personnel counting system of an embodiment of the application.

[0048] Figure 8 is a structure block diagram of a production line safety protection area personnel counting device of an embodiment of the application. DETAILED DESCRIPTION

[0049] In order to more clearly understand the purpose, technical solutions and advantages of the application, the application is described and explained below in connection with the drawings and embodiments.

[0050] Unless otherwise defined, technical terms or scientific terms used in the present application shall have the same meaning as those commonly understood by a person of ordinary skill in the art to which the present application belongs. The terms "one", "a", "an", "the", "these", and similar terms in the present application do not mean "only one" or "exactly one", but can mean "one or more". The terms "include", "contain", "have", and any variant thereof in the present application are intended to cover the non-exclusive inclusion; for example, a process, method, and system, product or device containing a series of steps or modules (units) are not limited to the listed steps or modules (units), but can include steps or modules (units) not listed, or can include other steps or modules (units) inherent to the process, method, product or device. The terms "connect", "connect", "couple" and the like in the present application are not limited to physical or mechanical connection, but can include electrical connection, whether direct or indirect. The term "multiple" in the present application means two or more. The term "and / or" describes the association between the associated objects, which means that there can be three relationships, for example, "A and / or B" can mean that A exists alone, A and B exist together, and B exists alone. Generally, the character " / " represents the relationship between the objects before and after the connection is "or". The terms "first", "second", "third" and the like in the present application are only used to distinguish similar objects, and do not represent a specific order of the objects.

[0051] The method embodiments provided in the present embodiment can be executed in a terminal, a computer or a similar computing device. For example, the method embodiments are executed on a terminal, Figure 1 is a hardware structure block diagram of the terminal of the production line safety protection area personnel statistics method of an embodiment of the present application. As shown in Figure 1 , the terminal can include one or more (only one is shown in Figure 1 ) processor 102 and memory 104 for storing data, wherein the processor 102 can include but not limited to processing device such as microprocessor MCU or programmable logic device FPGA. The above terminal can also include transmission device 106 for communication function and input / output device 108. Those skilled in the art can understand that Figure 1 The structure shown is only schematic, which does not limit the structure of the above terminal. For example, the terminal can include more or less components than those shown in Figure 1 , or have a different configuration from that shown in Figure 1 .

[0052] The memory 104 can be used to store computer programs, such as software programs of application software and modules, such as the computer program corresponding to the production line safety protection area personnel counting method in the embodiment. The processor 102 executes various functions and data processing by running the computer programs stored in the memory 104, that is, implements the method described above. The memory 104 can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some examples, the memory 104 can further include a memory remotely arranged with respect to the processor 102, and the remote memory can be connected to the terminal through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0053] The transmission device 106 is used to receive or send data via a network. The network includes a wireless network provided by a communication provider of the terminal. In an example, the transmission device 106 includes a network interface controller (NIC) which can be connected to other network devices through a base station so as to communicate with the Internet. In an example, the transmission device 106 can be a radio frequency (RF) module which is used to communicate with the Internet in a wireless manner.

[0054] In the embodiment, a production line safety protection area personnel counting method is provided, Figure 2 is a flowchart of the production line safety protection area personnel counting method of an embodiment of the application, as shown in Figure 2 The flowchart includes the following steps:

[0055] In step S201, change information of a target person in a safety protection area is received; the change information of the target person includes evidence chain information and a count value.

[0056] Specifically, on an automated production line, a workstation is provided, which is a semi-closed space, and an entrance and a predefined safety protection area are provided on the workstation, the safety protection area being a man-machine interaction area. When the production line needs to be repaired due to a fault, a maintenance personnel enters the safety protection area through the entrance to perform maintenance work. At this time, the production line needs to be stopped to ensure the safety of the maintenance personnel. In order to detect the entering and exiting workers, a camera is currently mainly used to be arranged above the entrance of the safety protection area to detect the entering and exiting workers and monitor the entire safety protection area. However, the width of the entrance of some safety protection areas is large, and it is difficult for one camera to completely cover the entire entrance, which may easily lead to missed detection. In addition, if a large number of personnel enter and exit at the same time, the personnel may overlap with each other, which may easily lead to false detection of the personnel.

[0057] Therefore, in the embodiment, two cameras, a first camera and a second camera, are arranged above the entrance of the safety protection area, and the combined field of view of the first camera and the second camera is not less than the range of the entire safety protection area, and the combined field of view of the first camera and the second camera is not less than the width of the entrance of the safety protection area. A joint analysis module is further arranged in the first camera, and the first camera and the second camera are respectively provided with counting logic and respectively count personnel change information in the safety protection area. The personnel change information includes evidence chain information and a counting value. The evidence chain information is evidence of personnel change in the safety protection area, which can be an image sequence, personnel position information, a personnel ID, etc. The counting value is a number change value (+1) of personnel entering the safety protection area or a number change value (-1) of personnel leaving the safety protection area. A reference line is arranged at the entrance of the safety protection area, and a target personnel is determined as a personnel intersecting with the reference line, wherein the intersection with the reference line includes entering the safety protection area from outside the safety protection area through the reference line and leaving the safety protection area from inside the safety protection area through the reference line.

[0058] When the camera detects that the personnel intersects with the reference line of the safety protection area, the respective counter is triggered to count and count the target personnel, to obtain the counting value, and to record the evidence chain information of the personnel in a period of time before and after the event occurs. The evidence chain information and the counting value of the target personnel are uploaded to the joint analysis module in the first camera.

[0059] Step S202, judging the information source of the change information of the target person; the information source includes the first camera and the second camera, and the joint field of view of the first camera and the second camera is not less than the range of the safety protection area; if the information source of the change information of the target person is from the second camera, obtaining the first foot point mapping track of the person based on the counted evidence chain information of the first camera and the second camera, and obtaining the second foot point mapping track of the target person based on the evidence chain information of the target person, and matching the first foot point mapping track and the second foot point mapping track.

[0060] Specifically, after the joint analysis module in the first camera receives the change information of the target person in the safety protection area, the information source of the change information of the target person is judged to confirm whether the information is from the first camera or the second camera. The joint analysis module stores the personnel change information from the first camera and the personnel change information from the second camera, and sets an ID for the stored personnel based on the first camera. When the joint analysis module receives the change information of the target person from the first camera, it can directly judge whether the change information of the target person is received from the second camera by comparing the ID of the stored personnel. If it is found that the change information of the target person is received from the second camera, the count value of the target person is not counted, otherwise, the count value of the target person is counted.

[0061] When the joint analysis module receives the change information of the target person from the second camera, according to the imaging principle, for the vertically erected camera, the position of the human body foot in the picture always faces the image center, which is the most accurate position point of the human body in the safety protection area. Therefore, in the joint analysis module, the evidence chain information in the received change information of the target person is first converted into foot points, and the foot point positions of the target person are combined to form the movement track of the target person, thereby obtaining the second foot point mapping track. Similarly, in the joint analysis module, the evidence chain information of all the personnel counted from the first camera and the second camera is converted into foot points, and the foot point positions of each person are combined to form the movement track of each person, thereby obtaining each first foot point mapping track. The second foot point mapping track is matched with each first foot point mapping track to determine whether the target person has been collected and counted.

[0062] It should be noted that through foot point conversion, more accurate position information of the motion target with differences can be obtained in a crowded scene, thereby realizing accurate matching and counting.

[0063] Step S203, judging whether there is a matching pair with a similarity not lower than a preset threshold; if there is, discarding the count value of the target person; if there is not, adopting the count value of the target person for counting.

[0064] Specifically, after obtaining the second foot point mapping trajectory and the first foot point mapping trajectory in the step S202, a similarity threshold is set in advance according to the requirement of accuracy. In the embodiment, the trajectory distance difference between the second foot point mapping trajectory and the first foot point mapping trajectory is taken as the similarity evaluation criterion. The matching pair with the trajectory distance difference less than the set distance difference is confirmed as the matching pair meeting the similarity requirement, and then it is determined that the change information of the target person has existed in the joint analysis module. Therefore, the count value of the target person reported by the second camera is not statistically processed, and is directly discarded. If no matching pair with the similarity meeting the requirement is matched, that is, the change information of the target person is not statistically processed in the joint analysis module, the count value of the target person needs to be reported to the joint statistical module for statistics. The joint statistical module is arranged in the first camera, or the joint statistical module can also be arranged in other external terminal devices. If the statistics and display are performed by other external terminal devices, the joint analysis module can only perform reporting processing on the count value. In the matching process, the count value of the target person can be processed after the matching pair meeting the similarity threshold is matched, or the optimal matching pair with the minimum trajectory distance difference is compared with the similarity threshold after the second foot point mapping trajectory is matched with all the first foot point mapping trajectories. The count value of the target person is processed after the comparison result is obtained. The matching process is not specifically limited in the embodiment, and can be selected and set according to the actual situation. The count value includes person entering +1 and person leaving -1. After the joint analysis module adopts the count value of the target person, the count value is reported to the joint statistical module. The joint statistical module performs personnel statistics according to the reported count value. If the count value reported by the camera is person entering the safety protection area (+1), the joint statistical module adds 1 to the number of persons in the safety protection area based on the statistical number. If the count value reported by the camera is person leaving the safety protection area (-1), the joint statistical module subtracts 1 from the number of persons in the safety protection area based on the statistical number, so as to obtain the total number of persons in the safety protection area. Meanwhile, the joint analysis module also stores the evidence chain information of all personnel changes collected by the first camera and the second camera. The evidence chain information can be called and used when needed.

[0065] The variation information of the target person in the safety protection area is received through the steps S201 to S203; the variation information of the target person includes evidence chain information and a count value; the information source of the variation information of the target person is judged; the information source includes the first camera and the second camera, and the joint field of view of the first camera and the second camera is not less than the range of the safety protection area; if the information source of the variation information of the target person is from the second camera, the first foot point mapping track of the person is obtained based on the counted evidence chain information of the first camera and the second camera, and the second foot point mapping track of the target person is obtained based on the evidence chain information of the target person, and the first foot point mapping track and the second foot point mapping track are matched; it is judged whether there is a matching pair with a similarity not less than a preset threshold; if there is, the count value of the target person is discarded; if not, the count value of the target person is adopted for counting statistics. Compared with the prior art in which the variation of the person in the safety protection area is detected by the single camera, in the embodiment, two cameras are arranged in the safety protection area to detect the variation information of the person entering and leaving the safety protection area, and the evidence chain information of the collected person variation information is converted into a foot point mapping track, and the accuracy of the person statistics in the safety protection area of the production line is improved by comparing the tracks to avoid repeated statistics, missing counting and miscounting.

[0066] In some embodiments, the evidence chain information includes image sequences in a preset time period before and after the moment of generating the count value.

[0067] Specifically, the evidence chain information collected by the first camera and the second camera mainly reflects the evidence of the person entering or leaving the safety protection area, and therefore, in the embodiment, the image sequences in a preset time period before and after the moment of generating the count value are taken as the evidence chain information, that is, when the person touches the reference line in the safety protection area, the counter in the camera is triggered to count, and at the same time, the image sequences in a period of time before and after the triggering moment are obtained and saved as the evidence chain information. The length of the specific time period can be set according to the actual situation, and the embodiment does not make a specific limitation. These continuous image sequences can be used to prove the variation of the person.

[0068] In another embodiment, obtaining the first foot point mapping track of the person based on the counted evidence chain information of the first camera and the second camera includes: obtaining the key points of the person in the image sequences collected by the counted first camera and second camera; calibrating the ground in the safety protection area to obtain a mapping matrix; and obtaining the first foot point mapping track of the person according to the key points of the person and the mapping matrix.

[0069] Specifically, in order to make the variation information of the personnel collected by the first camera and the second camera more accurate, first, a world coordinate system is established on the ground where the calibration board is located, and corresponding image coordinate systems are established by respectively shooting images by the two cameras; then, the image coordinates of the preset points in the images of the two cameras are collected respectively, and a mapping matrix corresponding one-to-one between the image coordinate systems and the world coordinate system is calculated; the image of each camera can be converted to the world coordinate system, that is, to the coordinate system of the calibration board, by the corresponding mapping matrix; in the same world coordinate system, the mapping trajectories of the foot points collected by the two cameras can be compared. Figure 3 is a calibration schematic diagram of a production line safety protection area personnel counting method according to an embodiment of the present application, as shown in Figure 3 The red box regions in the images of the two cameras are calibrated respectively, the red box regions are images of the same region collected by the two cameras from different angles, the black and white grid is a calibration board, and the calibration board is placed in the upper left corner, the upper right corner, the middle, the lower left corner and the lower right corner in the red box for calibration. At each position, a plurality of points on the calibration board in the two images are aligned. The calibration method can also use other methods, which are not limited in the present embodiment.

[0070] After calibration, the key points of the personnel in the image sequence collected by the first camera are obtained. Generally, the personnel in the image sequence collected by the first camera are displayed in the form of a frame. In order to improve the accuracy of the personnel motion trajectory, the key points conforming to the actual position of the personnel are obtained from the frame in which the personnel are located. Illustratively, when the image sequence is collected, image information including a human body as a target or image information including a safety helmet worn by the human body as a target is collected. If the camera detects that the human body touches the reference line, the camera will again confirm whether the safety helmet corresponding to the human body has touched the reference line. If the record of the safety helmet touching the reference line by the human body has been recorded, the human body touching the reference line will not trigger the counter counting process, and the image sequence corresponding to the human body will not be recorded. On the contrary, if the record of the safety helmet touching the reference line by the human body is not found, the counter is triggered to count when the human body touches the reference line, and the image sequence of the human body within a preset time period before and after the time when the counter is triggered is recorded. By detecting the human body as a target or the safety helmet as a target, the problem of overlapping personnel in a relatively crowded scene can be prevented, and the problem of missing detection or false detection caused by human body detection alone can be prevented, thereby improving the accuracy of personnel counting in the safety protection area.

[0071] After the image sequence is acquired, the key points of the person in the image sequence collected by the first camera are acquired, including: when the foot point position of the person in the image collected by the first camera is detected, the foot point position of the person is taken as the key point of the person in the image; when the foot point position of the person in the image collected by the first camera is not detected, the position of the safety helmet worn by the person is taken as the key point of the person in the image.

[0072] Specifically, after the image sequence is acquired, the image sequence includes an image of a safety helmet and an image of a human body, wherein the position of the human body foot in the image information of the human body as a target is the actual position of the human body on the ground, and therefore the foot point position of the human body in the image is taken as the key point, and the image triggered by the safety helmet is generally directly below the camera, and at this time, the center point position of the safety helmet is the actual position of the human body on the ground, and therefore the center point position of the safety helmet is taken as the key point of the person in the image. In this way, the key points of each image in the image sequence are acquired, all the key points are combined with a mapping matrix to obtain a foot point mapping track of the evidence chain information collected by the first camera. Similarly, the evidence chain information of the target person collected by the second camera is processed in the same way to obtain a foot point mapping track of the evidence chain information collected by the second camera, and the foot point mapping track of the evidence chain information collected by the first camera and the foot point mapping track of the evidence chain information collected by the second camera constitute a first foot point mapping track. By selecting the key points of the image sequence, the mapping track is obtained again, compared with the prior art in which the human body is directly determined in the form of a human body frame, the acquisition of the key points in the embodiment can improve the accuracy of human body estimation, and by comparing the tracks, it is determined whether the statistics are repeated, which can reduce the situation that the target frame overlaps to cause miscounting or missing counting in the case of multiple persons, and further improve the accuracy of personnel statistics in the safety protection area.

[0073] In some embodiments, before the first foot point mapping track of the person is acquired based on the evidence chain information of the first camera and the second camera, the method further comprises:

[0074] When it is detected that the person moves in a preset first direction and touches the reference line, the counter value is triggered to increase by 1 to obtain the count value of the person, and an image sequence including a preset time period before and after the time when the counter is triggered is acquired to obtain the first camera evidence chain information; or when it is detected that the person moves in a preset second direction and touches the reference line, the counter value is triggered to decrease by 1 to obtain the count value of the person, and an image sequence including a preset time period before and after the time when the counter is triggered is acquired to obtain the first camera evidence chain information.

[0075] Specifically, Figure 4 is a schematic diagram of the relative positions of the safety protection area, the reference line and the person of a production line safety protection area personnel statistics method according to an embodiment of the application, as Figure 4As shown, the reference line 41 is used to determine whether the personnel enters or leaves the safety protection area, and the reference line 41 divides the picture into two parts: the upper area 42 of the image is the safety protection area of the production line, and the lower area 43 of the image is the area outside the safety protection area of the production. The first camera and the second camera respectively detect the personnel in the image. Taking the first camera counting as an example, when the motion direction of the personnel is the preset first direction: moving from the lower area 43 of the image to the upper area 42 of the image, and touching the reference line 41 in the process of moving, it is judged that the personnel enters the safety protection area of the production line. When the personnel touches the reference line, the counter in the first camera is started to count, and the counting value is +1, that is, the number of personnel in the safety protection area increases by 1, and the image sequence in a period of time before and after the time when the personnel triggers the counter counting is obtained, and the evidence chain information of the personnel entering the first camera is obtained. When the motion direction of the personnel is the preset second direction: moving from the upper area 42 of the image to the lower area 43 of the image, and touching the reference line 41 in the process of moving, it is judged that the personnel leaves the safety protection area of the production line. When the personnel touches the reference line, the counter in the first camera is started to count, and the counting value is -1, that is, the number of personnel in the safety protection area decreases by 1, and the image sequence in a period of time before and after the time when the personnel triggers the counter counting is obtained, and the evidence chain information of the personnel leaving the first camera is obtained. Figure 5a is a schematic diagram of personnel unobstructed by the first camera in the production line safety protection area personnel counting method of an embodiment of the present application, as shown, Figure 5a The personnel 51 appears on the right side of the safety mark 52 and is about to touch the reference line. Figure 5b is a schematic diagram of personnel obstructed by the second camera in the production line safety protection area personnel counting method of an embodiment of the present application, as shown, Figure 5b As shown, due to the existence of the safety mark 52, the personnel 51 is obstructed by the safety mark 52 in the field of view of the second camera, so that the personnel is not detected in the second camera. At this time, the detection of the first camera can avoid the problem of missed detection caused by the personnel being obstructed by other objects in the field of view. The two cameras count separately and do not interfere with each other, which can improve the accuracy of personnel detection in the safety protection area of the production line.

[0076] In another embodiment, the evidence chain information further includes identification information of the target personnel, and further includes: if the information source of the change information of the target personnel comes from the first camera, determining whether the change information of the target personnel is received from the second camera based on the identification information of the target personnel, if yes, discarding the counting value of the target personnel; otherwise, adopting the counting value of the target personnel for counting statistics.

[0077] Specifically, the joint analysis module is arranged in the first camera. When the personnel change information collected by the first camera is received and it is determined that counting is needed, the joint analysis module sets the personnel setting ID of the personnel collected by the first camera based on the first camera. For the personnel counting information received from the second camera, the joint analysis module converts the personnel ID information of the image collected by the second camera into information stored based on the first camera. Therefore, when the change information of the target personnel received by the joint analysis module comes from the first camera, whether the change information of the target personnel received from the second camera can be directly determined by comparing the stored ID of the personnel. If it is found that the change information of the target personnel received from the second camera is received, the counting value of the target personnel is not counted, otherwise, the counting value of the target personnel is counted. Regardless of whether the same personnel change information is reported by the first camera or the second camera, the joint analysis module will store the evidence chain information reported by the first camera and the second camera, so that the evidence chain information can be called at any time when it is needed to be inquired.

[0078] In the embodiment, a production line safety protection area personnel counting method is also provided. Figure 6 is a flowchart of another production line safety protection area personnel counting method according to an embodiment of the present application, as shown in Figure 6 The flowchart includes the following steps:

[0079] Step S601, personnel change counting in the safety protection area is performed by the first camera and / or the second camera; wherein the joint field of view of the first camera and the second camera is not less than the range of the safety protection area;

[0080] Step S602, the joint analysis module arranged in the first camera receives the change information of the target personnel in the safety protection area; the change information of the target personnel includes evidence chain information and a counting value; the evidence chain information includes an image sequence in a preset time period before and after the generation time of the counting value;

[0081] Step S603, it is determined whether the information source of the change information of the target personnel comes from the first camera; if yes, step S608 is performed, otherwise, step S604 is performed;

[0082] Step S604, the key points of the personnel in the image sequence collected by the first camera and the second camera are obtained; the ground in the safety protection area is calibrated to obtain a mapping matrix; the first foot point mapping track of the personnel is obtained according to the key points of the personnel and the mapping matrix; the key points of the target personnel in the image sequence collected by the second camera are obtained; the ground in the safety protection area is calibrated to obtain a mapping matrix; the second foot point mapping track of the target personnel is obtained according to the key points of the target personnel and the mapping matrix;

[0083] Step S605: Match the first foot point mapping trajectory and the second foot point mapping trajectory to determine whether there is a matching pair with a similarity not lower than a preset threshold. If yes, proceed to step S606; otherwise, proceed to step S607.

[0084] Step S606: Discard the count value of the target personnel.

[0085] Step S607: Use the count values ​​of the target personnel for counting and statistics.

[0086] Step S608: Based on the identification information of the target person, determine whether the change information of the target person has been received from the second camera. If yes, proceed to step S606; otherwise, proceed to step S607.

[0087] Through steps S601 to S608, compared with the prior art of detecting personnel changes in the safety protection area using a single camera, this embodiment sets up two cameras, a first camera and a second camera, at the entrance and exit of the safety protection area. After the first camera and the second camera are calibrated, the two cameras count the personnel entering the protection area according to the pre-set counting line statistical logic, and obtain their respective personnel change information, including evidence chain information and count value. Then, the joint analysis module in the first camera analyzes the received personnel change information to obtain the final personnel change statistics. This avoids the problems of incomplete detection, missed detection, and false detection by a single camera, thereby improving the accuracy of personnel statistics in the safety protection area of ​​the production line.

[0088] This embodiment also provides a personnel statistics system for the safety protection area of ​​a production line, which is used to implement the above embodiments and preferred embodiments.

[0089] Figure 7 This is a schematic diagram of the structure of a personnel counting system for the safety protection area of ​​a production line according to an embodiment of this application, as shown below. Figure 7 As shown, the system includes a first camera 71, a second camera 72, and a joint statistics module 73. The first camera 71 includes an information acquisition module 74 and a joint analysis module 75. The information acquisition module 74 is used to acquire change information of a first target person in the field of view of the first camera according to a preset counting logic, and report the change information of the first target person to the joint analysis module 75. The joint analysis module 75 is used to analyze and process the change information of the first target person and / or the change information of the second target person, obtain the analysis and processing results, and report the analysis and processing results to the joint statistics module 73.

[0090] The second camera 72 is used to collect the change information of the second target person in the field of view of the second camera according to the preset counting logic, and report the change information of the second target person to the joint analysis module 75.

[0091] The joint statistics module 73 is used to perform personnel change statistics within the security protection area based on the analysis and processing results reported by the joint analysis module 75.

[0092] This embodiment also provides a personnel counting device for the safety protection area of ​​a production line. This device is used to implement the above embodiments and preferred embodiments, and will not be repeated as already described. The terms "module," "unit," "subunit," etc., used below can refer to a combination of software and / or hardware that performs a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0093] Figure 8 This is a structural block diagram of a personnel counting device for a production line safety protection area according to an embodiment of this application, as shown below. Figure 8 As shown, the device 80 includes: a receiving module 81, a judging module 82, a matching module 83, and a counting module 84. The receiving module 81 is used to receive change information of target personnel within the security protection area. The change information of target personnel includes evidence chain information and count value.

[0094] The judgment module 82 is used to judge the information source of the change information of the target personnel; the information source includes the first camera and the second camera, and the combined field of view of the first camera and the second camera is not less than the range of the safety protection zone;

[0095] The matching module 83 is used to obtain the first foot point mapping trajectory of all personnel based on the evidence chain data of the counted first camera and the second camera when the information source of the change information of the target personnel comes from the second camera; and to obtain the second foot point mapping trajectory of the target personnel based on the evidence chain information of the target personnel, and to match the first foot point mapping trajectory and the second foot point mapping trajectory.

[0096] The counting module 84 is used to determine whether there is a matching pair with a similarity not lower than a preset threshold; if it exists, the count value of the target person is discarded; if it does not exist, the count value of the target person is adopted for counting statistics.

[0097] It should be noted that the above modules can be functional modules or program modules, and can be implemented through software or hardware. For modules implemented through hardware, the above modules can reside in the same processor; or the above modules can be located in different processors in any combination.

[0098] This embodiment also provides an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0099] Optionally, the electronic device described above can further include a transmission device connected with the processor, and an input and output device connected with the processor.

[0100] Optionally, in the embodiment, the processor can be configured to execute the following steps by means of a computer program:

[0101] S1, receiving the change information of the target personnel in the safety protection area; the change information of the target personnel includes the evidence chain information and the count value;

[0102] S2, judging the information source of the change information of the target personnel; the information source includes the first camera and the second camera, and the joint field of view of the first camera and the second camera is not less than the range of the safety protection area;

[0103] S3, if the information source of the change information of the target personnel is from the second camera, obtaining the first foot point mapping track of the personnel based on the counted evidence chain information of the first camera and the second camera, and obtaining the second foot point mapping track of the target personnel based on the evidence chain information of the target personnel, and matching the first foot point mapping track and the second foot point mapping track;

[0104] S4, judging whether there is a matching pair with a similarity not lower than a preset threshold; if there is, discarding the count value of the target personnel; if there is not, adopting the count value of the target personnel for counting statistics.

[0105] It should be noted that the specific examples in the embodiment can refer to the examples described in the above embodiments and optional implementation manners, which will not be described herein again.

[0106] In addition, in combination with the production line safety protection area personnel counting method provided in the above embodiments, a storage medium can also be provided to realize the method in the embodiment. The storage medium has a computer program stored thereon; the computer program is executed by the processor to realize any one of the production line safety protection area personnel counting methods in the above embodiments.

[0107] It should be understood that the specific embodiments described herein are only used to explain the application, but not to limit it. According to the embodiments provided in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0108] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties.

[0109] It is apparent that the drawings depict only some of the embodiments or examples of the present application and are therefore not to be considered limiting of the scope of the application, for the present application can admit to other similarly effective embodiments or examples not depicted in the drawings. It will also be understood that some of the embodiments or examples of the present application, although described in conjunction with specific embodiments, are not limited to such specific embodiments, but can be practiced with any of the examples described herein. It is also apparent that some of the embodiments or examples of the present application can include features that are not specifically shown in the drawings or described above. It is also apparent that some of the embodiments or examples of the present application can include features that are not specifically shown in the drawings or described above.

[0110] The word "example" is used herein to mean serving as an example, instance, or illustration. Any embodiment or example described herein as an "example" is not necessarily to be construed as having superior or inferior attributes over other embodiments or examples. Various embodiments or examples of the present application are described herein, including specific embodiments or examples, and alternate embodiments or examples. However, specific structures, controls, chemicals, formulations, etc. described in these embodiments or examples are used merely for non-limiting examples and are not intended to limit the scope of the application. Rather, specific structures, controls, chemicals, formulations, etc. are described in these embodiments or examples as being among various possible structures, controls, chemicals, formulations, etc. that can be employed, and that examples can be utilized independently of one another or in various combinations or subcombinations thereof. In addition, it is contemplated that some of the embodiments or examples described herein can include specific features, structures, or characteristics, however described in this specification, can be replaced with alternative features, structures, or characteristics having the same function or working principle. This process of optimization based on design, performance, or other criteria is to be considered within the scope of the application. Other embodiments can be used and derived from the description, concepts, and specific details disclosed herein, without departing from the spirit of the application. Therefore, it is the intent that all such alternatives, modifications, permutations, equivalents, variations, improvements, and the like, be considered to be within the scope of the present application.

[0111] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when executed, can include the processes of the above-mentioned embodiment methods. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0112] The above-mentioned embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation on the scope of patent protection. It should be noted that for those skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of protection of the present application. Therefore, the scope of protection of the present application should be subject to the appended claims.

Claims

1. A method for counting personnel in a production line safety protection area, characterized in that, Applied to a first camera, the method includes: Receive information on changes in target personnel within the security protection area; the information on changes in target personnel includes evidence chain information and count values; The information source for the change information of the target personnel is determined; the information source includes the first camera and the second camera, and the combined field of view of the first camera and the second camera is not less than the range of the security protection zone; If the information source of the change information of the target person comes from the second camera, then the first foot point mapping trajectory of the person is obtained based on the evidence chain information of the counted first camera and second camera, and the second foot point mapping trajectory of the target person is obtained based on the evidence chain information of the target person, and the first foot point mapping trajectory and the second foot point mapping trajectory are matched. Determine if there are matching pairs with a similarity of not less than a preset threshold; If the target personnel exists, their count value is discarded; if they do not exist, their count value is adopted for statistical purposes.

2. The method for personnel statistics in the safety protection area of ​​a production line according to claim 1, characterized in that, The evidence chain information includes an image sequence within a preset time period before and after the time the count value is generated.

3. The method for personnel statistics in the safety protection area of ​​a production line according to claim 2, characterized in that, The first footstep mapping trajectory of the person obtaining the evidence chain information based on the counted first and second cameras includes: Obtain key points of people in the image sequences captured by the first and second cameras that have been counted; The ground within the safety protection zone is calibrated to obtain a mapping matrix; The first foot point mapping trajectory of the person is obtained based on the person's key points and the mapping matrix.

4. The method for personnel statistics in the safety protection area of ​​a production line according to claim 3, characterized in that, The image sequence includes image information targeting a human body or image information targeting a helmet worn by a human body. Key points of the person in the counted image sequence captured by the first camera are obtained, including: When the location of a person's feet is detected in the image captured by the first camera, the location of the person's feet is taken as the key point of the person in the image; When the location of a person's feet in the image captured by the first camera is not detected, the location of the safety helmet worn by the person is used as the key point of the person in the image.

5. The method for personnel statistics in the safety protection area of ​​a production line according to claim 2, characterized in that, Before obtaining the first footstep mapping trajectory of the personnel based on the counted evidence chain information from the first and second cameras, the method further includes: When a person is detected moving in a preset first direction and touching a reference line, a counter is incremented by 1 to obtain the person's count value. An image sequence containing images within a preset time period before and after the counter trigger time is then acquired to obtain the first camera evidence chain information; or, When a person is detected moving in a preset second direction and touching a reference line, the counter value is decremented by 1 to obtain the count value of the person, and an image sequence containing the preset time period before and after the time the counter is triggered is obtained to obtain the first camera evidence chain information.

6. The method for personnel statistics in the safety protection area of ​​a production line according to claim 1, characterized in that, The chain of evidence information also includes the identification information of the target person, and the method further includes: If the information source of the target person's change information comes from the first camera, then based on the target person's identification information, it is determined whether the target person's change information is received from the second camera. If so, the target person's count value is discarded; otherwise, the target person's count value is adopted for counting statistics.

7. A personnel counting system for a production line safety protection area, characterized in that, The system includes a first camera, a second camera, and a joint statistics module, wherein, The first camera includes an information acquisition module and a joint analysis module. The information acquisition module is used to acquire change information of a first target person in the field of view of the first camera according to a preset counting logic, and report the change information of the first target person to the joint analysis module. The joint analysis module is used to analyze and process the change information of the first target person and / or the change information of a second target person, obtain the analysis and processing results, and report the analysis and processing results to the joint statistics module. The second camera is used to collect change information of the second target person in the field of view of the second camera according to a preset counting logic, and to report the change information of the second target person to the joint analysis module; The joint statistics module is used to perform personnel change statistics within the security protection area based on the analysis and processing results reported by the joint analysis module.

8. A personnel counting device for a safety protection area on a production line, characterized in that, include: The module includes a receiving module, a judging module, a matching module, and a counting module. The receiving module is used to receive change information of target personnel within the security protection area; the change information of target personnel includes evidence chain information and count value; The judgment module is used to judge the information source of the change information of the target personnel; the information source includes a first camera and a second camera, and the combined field of view of the first camera and the second camera is not less than the range of the security protection zone; The matching module is used to obtain the first foot point mapping trajectory of all persons based on the evidence chain data of the counted first camera and second camera when the information source of the change information of the target person is the second camera; and to obtain the second foot point mapping trajectory of the target person based on the evidence chain information of the target person, and match the first foot point mapping trajectory and the second foot point mapping trajectory. The counting module is used to determine whether there is a matching pair with a similarity of not less than a preset threshold; if there is, the count value of the target person is discarded; if there is not, the count value of the target person is adopted for counting statistics.

9. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to run the computer program to perform the personnel statistics method for the production line safety protection area as described in any one of claims 1 to 6.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method for counting personnel in the production line safety protection area as described in any one of claims 1 to 6.

Images