Methods, systems and devices for personnel statistics in the safety protection zone of the production line

Abstract

This application relates to a method, system, and apparatus for personnel counting in a production line safety protection area. The personnel counting method includes: receiving change information (evidence chain information and count values) of target personnel within the safety protection area; determining the information source of the change information; if the information source is a second camera, obtaining the first foot point mapping trajectory of the personnel based on all counted evidence chain information, and obtaining the second foot point mapping trajectory of the target personnel based on the evidence chain information of the target personnel, and matching the first foot point mapping trajectory and the second foot point mapping trajectory; determining whether there is a matching pair with a similarity not lower than a preset threshold; if so, discarding the count value of the target personnel; if not, adopting the count value of the target personnel for counting statistics. This application improves the accuracy of personnel counting in the production line safety protection area.

Description

Technical Field

[0001] This application relates to the field of production line safety protection, and in particular to methods, systems and devices for personnel statistics in production line safety protection areas. Background Technology

[0002] In automated production lines, robotic arms are primarily used to assemble various components. Workstations are set up on the production line. When a robotic arm needs parameter settings or requires maintenance due to a malfunction, its operation is stopped. Maintenance personnel enter the workstation to set parameters or repair the fault. After the personnel leave the workstation, the production line is reset, and the robotic arm is restarted to continue assembly. During this process, the personal safety of maintenance personnel is paramount. Production line operations can only resume after all maintenance personnel have left the site; otherwise, personal safety accidents may occur.

[0003] Currently, personnel safety protection mainly involves treating each workstation as a safety protection zone, and installing a camera at the entrance and exit of the safety protection zone to detect the number of people entering the safety protection zone, as well as to detect changes in personnel within the safety protection zone.

[0004] However, when the entrances and exits of the security zone are wide, the field of view of a single camera often cannot completely cover the entire entrance or exit, leading to omissions or errors in counting, and consequently, inaccurate personnel data within the security zone, causing safety issues. Furthermore, single-camera detection in wide-channel scenarios also has the following limitations:

[0005] (1) Blind spots: Although wide-angle lenses can expand the coverage area, distortion in the edge areas will lead to a decrease in recognition accuracy, resulting in missed detection in the edge areas;

[0006] (2) Obstruction problem: During peak hours when there is a large flow of people / vehicles, people may block each other or be blocked by other objects, which may lead to missed detection of people due to obstruction.

[0007] (3) Counting logic defects: targets moving across regions may be counted repeatedly or missed.

[0008] There is currently no effective solution to the problem of inaccurate personnel statistics in the safety protection area of ​​the production line in related technologies. Summary of the Invention

[0009] This embodiment provides a method, system, and apparatus for counting personnel in the safety protection area of ​​a production line, in order to solve the problem of inaccurate personnel counting in the safety protection area of ​​a production line in related technologies.

[0010] Firstly, this embodiment provides a method for counting personnel in a production line safety protection area, applied to a first camera, including:

[0011] Receive information on changes in target personnel within the security protection area; the information on changes in target personnel includes evidence chain information and count values;

[0012] The information source for the change information of the target personnel is determined; the information source includes the first camera and the second camera, and the combined field of view of the first camera and the second camera is not less than the range of the security protection zone;

[0013] If the information source of the change information of the target person comes from the second camera, then the first foot point mapping trajectory of the person is obtained based on the evidence chain information of the counted first camera and second camera, and the second foot point mapping trajectory of the target person is obtained based on the evidence chain information of the target person, and the first foot point mapping trajectory and the second foot point mapping trajectory are matched.

[0014] Determine if there are matching pairs with a similarity of not less than a preset threshold;

[0015] If the target personnel exists, their count value is discarded; if they do not exist, their count value is adopted for statistical purposes.

[0016] In some embodiments, the chain of evidence information includes an image sequence within a preset time period before and after the time the count value is generated.

[0017] In some embodiments, the first footstep mapping trajectory of the person acquiring evidence chain information based on the counted first and second cameras includes:

[0018] Obtain key points of people in the image sequences captured by the first and second cameras that have been counted;

[0019] The ground within the safety protection zone is calibrated to obtain a mapping matrix;

[0020] The first foot point mapping trajectory of the person is obtained based on the person's key points and the mapping matrix.

[0021] In some embodiments, the image sequence includes image information targeting a human body or image information targeting a helmet worn by a human body, and acquiring key points of a person in the counted image sequence captured by the first camera includes:

[0022] When the location of a person's feet is detected in the image captured by the first camera, the location of the person's feet is taken as the key point of the person in the image;

[0023] When the location of a person's feet in the image captured by the first camera is not detected, the location of the safety helmet worn by the person is used as the key point of the person in the image.

[0024] In some embodiments, prior to obtaining the first footstep mapping trajectory of the person based on the counted chain of evidence information from the first and second cameras, the method further includes:

[0025] When a person is detected moving in a preset first direction and touching a reference line, a counter is incremented by 1 to obtain the person's count value, and an image sequence containing images within a preset time period before and after the time the counter is triggered is acquired to obtain the first camera evidence chain information; or, when a person is detected moving in a preset second direction and touching a reference line, a counter is decremented by 1 to obtain the person's count value, and an image sequence containing images within a preset time period before and after the time the counter is triggered is acquired to obtain the first camera evidence chain information.

[0026] In some embodiments, the chain of evidence information further includes the identification information of the target person, including:

[0027] If the information source of the target person's change information comes from the first camera, then based on the target person's identification information, it is determined whether the target person's change information is received from the second camera. If so, the target person's count value is discarded; otherwise, the target person's count value is adopted for counting statistics.

[0028] Secondly, this embodiment provides a personnel counting system for a production line safety protection area. The system includes a first camera, a second camera, and a joint counting module. The first camera includes an information acquisition module and a joint analysis module. The information acquisition module is used to acquire change information of a first target person in the field of view of the first camera according to a preset counting logic, and report the change information of the first target person to the joint analysis module. The joint analysis module is used to analyze and process the change information of the first target person and / or the change information of the second target person to obtain the analysis and processing result, and report the analysis and processing result to the joint counting module.

[0029] The second camera is used to collect change information of the second target person in the field of view of the second camera according to a preset counting logic, and to report the change information of the second target person to the joint analysis module;

[0030] The joint statistics module is used to perform personnel change statistics within the security protection area based on the analysis and processing results reported by the joint analysis module.

[0031] Thirdly, this embodiment provides a personnel counting device for a production line safety protection area, including: a receiving module, a judging module, a matching module, and a counting module, wherein the receiving module is used to receive change information of target personnel within the safety protection area; the change information of target personnel includes evidence chain information and count value;

[0032] The judgment module is used to judge the information source of the change information of the target personnel; the information source includes a first camera and a second camera, and the combined field of view of the first camera and the second camera is not less than the range of the security protection zone;

[0033] The matching module is used to obtain the first foot point mapping trajectory of all persons based on the evidence chain data of the counted first camera and second camera when the information source of the change information of the target person is the second camera; and to obtain the second foot point mapping trajectory of the target person based on the evidence chain information of the target person, and match the first foot point mapping trajectory and the second foot point mapping trajectory.

[0034] The counting module is used to determine whether there is a matching pair with a similarity of not less than a preset threshold; if there is, the count value of the target person is discarded; if there is not, the count value of the target person is adopted for counting statistics.

[0035] Fourthly, this embodiment provides an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the personnel counting method for the production line safety protection area described in the first aspect above.

[0036] Fifthly, this embodiment provides a storage medium storing a computer program that, when executed by a processor, implements the personnel counting method for the production line safety protection area described in the first aspect above.

[0037] Compared with related technologies, the personnel counting method, system and device for the safety protection area of ​​the production line provided in this application detects personnel changes in the safety protection area by setting up two cameras in the safety protection area, and converts the evidence chain information of the collected personnel change information into foot point mapping trajectory. By comparing the trajectory, the method avoids double counting, omission and miscounting of personnel, solves the problem of inaccurate personnel counting in the safety protection area of ​​the production line, and improves the accuracy of personnel counting in the safety protection area of ​​the production line.

[0038] Details of one or more embodiments of this application are set forth in the following drawings and description to make other features, objects and advantages of this application more readily apparent. Attached Figure Description

[0039] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0040] Figure 1 This is a hardware structure block diagram of the terminal for a method for counting personnel in a production line safety protection area according to an embodiment of this application.

[0041] Figure 2 This is a flowchart of a method for counting personnel in the safety protection zone of a production line according to an embodiment of this application.

[0042] Figure 3 This is a calibration diagram of a method for counting personnel in the safety protection zone of a production line according to an embodiment of this application.

[0043] Figure 4 This is a schematic diagram of the relative positions of the safety protection area, reference line, and personnel in a production line safety protection area personnel statistics method according to an embodiment of this application.

[0044] Figure 5a This is a schematic diagram of personnel not being obstructed, captured by the first camera in a personnel counting method for a production line safety protection area according to an embodiment of this application.

[0045] Figure 5b This is a schematic diagram of personnel being obscured by a second camera in a method for counting personnel in a production line safety protection area according to an embodiment of this application.

[0046] Figure 6 This is a flowchart of another method for counting personnel in the safety protection area of ​​a production line, according to an embodiment of this application.

[0047] Figure 7 This is a schematic diagram of the structure of a personnel statistics system for the safety protection area of ​​a production line according to an embodiment of this application.

[0048] Figure 8 This is a structural block diagram of a personnel counting device for a production line safety protection area according to an embodiment of this application. Detailed Implementation

[0049] To better understand the purpose, technical solution, and advantages of this application, the application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0050] Unless otherwise defined, the technical or scientific terms used in this application shall have the general meaning understood by one of ordinary skill in the art to which this application pertains. Words such as “a,” “an,” “an,” “the,” “the,” and “these” used in this application do not indicate quantitative limitation and may be singular or plural. The terms “comprising,” “including,” “having,” and any variations thereof used in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that comprises a series of steps or modules (units) is not limited to the listed steps or modules (units) but may include steps or modules (units) not listed, or may include other steps or modules (units) inherent to these processes, methods, products, or devices. Words such as “connected,” “linked,” and “coupled” used in this application are not limited to physical or mechanical connections but may include electrical connections, whether direct or indirect. “Multiple” used in this application refers to two or more. “And / or” describes the relationship between related objects, indicating that three relationships may exist; for example, “A and / or B” can represent: A alone, A and B simultaneously, and B alone. Normally, the character " / " indicates that the objects before and after it are in an "or" relationship. The terms "first," "second," "third," etc., used in this application are merely to distinguish similar objects and do not represent a specific order of objects.

[0051] The method embodiments provided in this example can be executed on a terminal, computer, or similar computing device. For example, it can run on a terminal. Figure 1 This is a hardware structure block diagram of the terminal for a personnel counting method in a production line safety protection area according to an embodiment of this application. For example... Figure 1 As shown, a terminal may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 and a memory 104 for storing data are also included. The processor 102 may be, but is not limited to, a microprocessor (MCU) or a programmable logic device (FPGA). The terminal may also include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that… Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the terminal described above. For example, the terminal may also include components that are larger than... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown are illustrated.

[0052] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the personnel counting method in the production line safety protection area in this embodiment. The processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0053] The transmission device 106 is used to receive or send data via a network. This network includes a wireless network provided by the terminal's communication provider. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 can be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0054] This embodiment provides a method for counting personnel in the safety protection area of ​​a production line. Figure 2 This is a flowchart of a method for counting personnel in a production line safety protection area according to an embodiment of this application, such as... Figure 2 As shown, the process includes the following steps:

[0055] Step S201: Receive change information of target personnel within the security protection area; the change information of target personnel includes evidence chain information and count value.

[0056] Specifically, on an automated production line, there are workstations, which are semi-enclosed spaces. Each workstation has an entrance / exit and a pre-defined safety protection zone. This safety protection zone is the human-machine interaction area. When the production line malfunctions and requires repair, maintenance personnel enter the safety protection zone through this entrance / exit to perform repair work. At this time, the production line must be stopped to ensure the safety of the maintenance personnel. Currently, the main method for detecting personnel entering and exiting is to install a camera above the entrance / exit of the safety protection zone. This camera detects personnel entering and exiting and monitors the entire safety protection zone. However, some safety protection zone entrances / exits are wide, and a single camera often cannot completely cover the entire entrance / exit, easily leading to missed detections. Furthermore, if many people enter and exit simultaneously, overlapping between personnel can easily lead to false detections.

[0057] Therefore, in this embodiment, two cameras are installed above the entrance and exit of the security protection area: a first camera and a second camera. The combined field of view of the first and second cameras is not less than the entire security protection area, and the combined field of view of the first and second cameras is not less than the width of the entrance and exit of the security protection area. A joint analysis module is also provided in the first camera. The first and second cameras are each equipped with counting logic and each counts personnel change information within the security protection area. The personnel change information includes evidence chain information and a count value. The evidence chain information is evidence of personnel changes within the security protection area, which can be image sequences, personnel location information, personnel ID identifiers, etc. The count value is the change in the number of personnel entering the security protection area (+1) or the change in the number of personnel leaving the security protection area (-1). A reference line is set at the entrance and exit of the security protection area. Personnel intersecting with the reference line are identified as target personnel. Intersection with the reference line includes entering the security protection area from outside by crossing the reference line and leaving the security protection area by crossing the reference line from within the security protection area.

[0058] When a camera detects an intersection between a person and the reference line of the security zone, it triggers its own counter to count the person and obtain a count value. Simultaneously, it records the evidence chain information of the person within a certain period before and after the event. This evidence chain information and count value are then uploaded to the joint analysis module within the first camera.

[0059] Step S202: Determine the information source of the change information of the target person; the information source includes the first camera and the second camera, and the joint field of view of the first camera and the second camera is not less than the range of the security protection zone; if the information source of the change information of the target person comes from the second camera, then obtain the first foot point mapping trajectory of the person based on the evidence chain information of the counted first camera and the second camera, and obtain the second foot point mapping trajectory of the target person based on the evidence chain information of the target person, and match the first foot point mapping trajectory and the second foot point mapping trajectory.

[0060] Specifically, after receiving information about changes in target personnel within the security protection area, the joint analysis module within the first camera determines the source of this information, confirming whether it originates from the first camera or the second camera. The joint analysis module stores personnel change information from both the first and second cameras, assigning IDs to the stored personnel based on the first camera. When the joint analysis module receives information about changes in target personnel from the first camera, it can directly compare this information with the stored personnel IDs to determine if the change information was received from the second camera. If the comparison reveals that the change information was received from the second camera, the count for that target personnel is not recorded; otherwise, the count for that target personnel is recorded.

[0061] When the joint analysis module receives movement information of a target person from the second camera, according to the imaging principle, for a vertically mounted camera, the position of a person's feet in the image always faces the center of the image, representing the most accurate position of the person within the safe protection area. Therefore, in the joint analysis module, the evidence chain information in the received target person movement information is first converted into foot points, and the foot points of the target person are used to form the target person's movement trajectory, thus obtaining the second foot point mapping trajectory. Similarly, in the joint analysis module, the evidence chain information of all personnel received from the first and second cameras (in terms of counts) is converted into foot points, and the foot points of each person are used to form their movement trajectory, thus obtaining each first foot point mapping trajectory. The second foot point mapping trajectories are then matched with each of the first foot point mapping trajectories to determine whether the target person has been collected and counted.

[0062] It should be noted that by converting foot points, more accurate positional information can be obtained for moving targets with different characteristics in crowded scenarios, thereby achieving accurate matching and counting.

[0063] Step S203: Determine whether there is a matching pair with a similarity not lower than a preset threshold; if there is, discard the count value of the target person; if not, adopt the count value of the target person for counting statistics.

[0064] Specifically, after obtaining the second footpoint mapping trajectory and the first footpoint mapping trajectory in step S202 above, a similarity threshold is pre-set according to the accuracy requirements. In this embodiment, the trajectory distance difference between the second footpoint mapping trajectory and the first footpoint mapping trajectory is used as the similarity evaluation standard. Matching pairs whose trajectory distance difference is less than the set distance difference are confirmed as matching pairs that meet the similarity requirements. Thus, it is determined that the joint analysis module already contains the change information of the target person. Therefore, the count value of the target person reported by the second camera is not statistically processed and is directly discarded. If no matching pair that meets the similarity requirements is found, that is, the joint analysis module does not count the change information of the target person, the count value of the target person needs to be reported to the joint statistics module for statistics. The joint statistics module is set in the first camera, or the joint statistics module can also be set in other external terminal devices. If other external terminal devices are used for statistical display, the joint analysis module can only report the count value. The matching process can either involve matching a pair that meets the similarity threshold to process the target person's count, or it can involve matching the second footpoint mapping trajectory with all the first footpoint mapping trajectories, comparing the optimal matching pair (the one with the smallest trajectory distance difference) with the similarity threshold, and then processing the target person's count. This embodiment does not specifically limit the matching process and can be selected and set according to the actual situation. The count includes +1 for personnel entering and -1 for personnel leaving. After the joint analysis module adopts the target person's count, it reports it to the joint statistics module. The joint statistics module performs personnel statistics based on the reported count. If the camera reports a count of personnel entering the security protection area (+1), the joint statistics module adds 1 to the already counted number of people in the security protection area. If the camera reports a count of personnel leaving the security protection area (-1), the joint statistics module subtracts 1 from the already counted number of people in the security protection area, thus obtaining the total number of people in the security protection area. Meanwhile, the joint analysis module also stores evidence chain information on all personnel changes captured by the first and second cameras, which can be retrieved and used when needed.

[0065] Through steps S201 to S203 above, change information of target personnel within the security protection area is received; the change information of target personnel includes evidence chain information and count value; the information source of the change information of target personnel is determined; the information source includes a first camera and a second camera, and the joint field of view of the first camera and the second camera is not less than the range of the security protection area; if the information source of the change information of target personnel comes from the second camera, the first foot point mapping trajectory of the personnel is obtained based on the evidence chain information of the counted first camera and the second camera, and the second foot point mapping trajectory of the target personnel is obtained based on the evidence chain information of the target personnel, and the first foot point mapping trajectory and the second foot point mapping trajectory are matched; it is determined whether there is a matching pair with a similarity not lower than a preset threshold; if there is, the count value of the target personnel is discarded; if there is not, the count value of the target personnel is adopted for counting statistics. Compared with the existing technology that uses a single camera to detect changes in personnel within the safety protection area, this embodiment sets up two cameras within the safety protection area to detect personnel changes entering and leaving the safety protection area. The evidence chain information of the collected personnel change information is converted into foot point mapping trajectory. By comparing the trajectories, personnel are avoided from being counted repeatedly, missed, or miscounted, thereby improving the accuracy of personnel statistics in the safety protection area of ​​the production line.

[0066] In some embodiments, the chain of evidence information includes a sequence of images within a preset time period before and after the time the count value is generated.

[0067] Specifically, the evidence chain information collected by the first and second cameras mainly reflects evidence of personnel entering or leaving the security protection area. Therefore, in this embodiment, the image sequence within a preset time period before and after the generation time of the count value is taken as the evidence chain information. That is, when a person touches the reference line in the security protection area, the counter in the camera will be triggered, and at the same time, the image sequence within a certain period before and after the triggering time is acquired and saved as the evidence chain information. The specific length of the time period can be set according to the actual situation, and this embodiment does not make a specific limitation on it. These continuous image sequences can be used to prove the change of personnel.

[0068] In another embodiment, obtaining the first footpoint mapping trajectory of a person based on the evidence chain information of the counted first and second cameras includes: obtaining key points of the person in the image sequence captured by the counted first and second cameras; calibrating the ground within the security protection zone to obtain a mapping matrix; and obtaining the first footpoint mapping trajectory of the person based on the key points of the person and the mapping matrix.

[0069] Specifically, to make the comparison of personnel movement information collected by the first and second cameras more accurate, a world coordinate system is first established on the ground where the calibration board is located. Images are taken by the two cameras respectively, and corresponding image coordinate systems are established. Then, the image coordinates of preset points in the images of the two cameras are collected respectively, and a mapping matrix that corresponds one-to-one between the image coordinate system and the world coordinate system is calculated. The image coordinates of the corresponding points in the image of each camera can be transformed to the world coordinate system, that is, to the coordinate system of the calibration board, through the corresponding mapping matrix. In the same world coordinate system, the comparison of the foot point mapping trajectory collected by the two cameras can be realized. Figure 3 This is a calibration diagram of a method for counting personnel in a production line safety protection area according to an embodiment of this application, as shown below. Figure 3 As shown, the red-framed areas in the images from the two cameras are calibrated. The red-framed areas represent the same region captured by the two cameras from different angles. The black and white grid represents the calibration board. Within the red frame, the calibration board is placed at the upper left corner, upper right corner, center, lower left corner, and lower right corner for calibration. At each position, several points on the calibration board in the two images are taken for calibration alignment. Other calibration methods can also be used; this embodiment does not specify a particular method.

[0070] After calibration, key points of people in the image sequence captured by the first camera are obtained. Generally, people are displayed as boxes in the image sequence captured by the first camera. To improve the accuracy of personnel movement trajectories, this embodiment further obtains key points corresponding to the actual position of the person from within the box. For example, when acquiring the image sequence, image information targeting either the human body or the safety helmet worn by the person is acquired. If the camera detects a person touching a reference line, it will reconfirm whether the corresponding safety helmet has touched the reference line. If a record of the person's safety helmet touching the reference line has been recorded, the counter is not triggered for that person's touch, and the corresponding image sequence is not recorded. Conversely, if no record of the person's safety helmet touching the reference line is found, the counter is triggered when the person's touch is detected, and the image sequence of the person within a preset time period before and after the trigger time is recorded. Detecting by targeting either the human body or the safety helmet can prevent the problem of missed or false detections caused by overlapping people in crowded scenarios, thus improving the accuracy of personnel statistics within the safety protection area.

[0071] After acquiring the image sequence, the key points of the people in the image sequence captured by the first camera are acquired, including: when the foot position of the person is detected in the image captured by the first camera, the foot position of the person is used as the key point of the person in the image; when the foot position of the person is not detected in the image captured by the first camera, the position of the safety helmet worn by the person is used as the key point of the person in the image.

[0072] Specifically, after acquiring the image sequence, which includes images of a safety helmet and a human body, the location of the human's feet in the image is taken as the actual position of the human on the ground. Therefore, the foot positions in this image are used as keypoints. Images triggered by the safety helmet are generally located directly below the camera; in this case, the center point of the safety helmet is taken as the actual position of the human on the ground. Therefore, the center point of the safety helmet is used as the keypoint of the person in this image. Keypoints for each image in the image sequence are acquired in this way. All keypoints are then combined with a mapping matrix to obtain the footpoint mapping trajectory of the evidence chain information acquired by the first camera. Similarly, the same processing is applied to the evidence chain information of the target person acquired by the second camera to obtain the footpoint mapping trajectory of the evidence chain information acquired by the second camera. The footpoint mapping trajectories of the evidence chain information acquired by the first and second cameras constitute the first footpoint mapping trajectory. By selecting key points from the image sequence and then obtaining the mapping trajectory, compared with the existing technology that directly uses the human body bounding box to determine the human body, the acquisition of key points in this embodiment can improve the accuracy of human body estimation. Furthermore, by comparing the trajectories, it can be determined whether there is duplicate counting, which can reduce the situation of miscounting or omission due to overlapping target boxes when there are many people, and further improve the accuracy of personnel counting within the security protection area.

[0073] In some embodiments, prior to obtaining the trajectory of the first footsteps of the person based on the evidence chain information from the counted first and second cameras, the method further includes:

[0074] When a person is detected moving in a preset first direction and touching a reference line, the trigger counter value is incremented by 1 to obtain the person's count value, and an image sequence containing the time before and after the trigger counter time is acquired to obtain the first camera evidence chain information; or, when a person is detected moving in a preset second direction and touching a reference line, the trigger counter value is decremented by 1 to obtain the person's count value, and an image sequence containing the time before and after the trigger counter time is acquired to obtain the first camera evidence chain information.

[0075] Specifically, Figure 4 This is a schematic diagram illustrating the relative positions of the safety protection zone, reference line, and personnel in a production line safety protection zone personnel counting method according to an embodiment of this application, as shown below. Figure 4As shown, reference line 41 is used to determine whether personnel have entered or left the safety protection area. Reference line 41 divides the image into two parts: the upper region 42 of the image is the production line safety protection area, and the lower region 43 of the image is the area outside the production safety protection area. The first camera and the second camera count and detect personnel in the image. Taking the first camera counting as an example, when the personnel's movement direction is a preset first direction: moving from the lower region 43 of the image to the upper region 42 of the image, and touching reference line 41 during the movement, it is determined that the personnel have entered the production line safety protection area. When the personnel touch the reference line, the counter in the first camera is activated to count, and the count value is incremented by 1, that is, the number of people in the safety protection area increases by 1. The image sequence within a certain period of time before and after the moment when the personnel trigger the counter counting is obtained, thus obtaining the evidence chain information of personnel entry by the first camera. When a person moves in the preset second direction: from the upper region 42 of the image to the lower region 43 of the image, and touches the reference line 41 during the movement, it is determined that the person has left the safety protection area of ​​the production line. When the person touches the reference line, the counter in the first camera is activated to count, and the count value is decremented by 1, that is, the number of people in the safety protection area is reduced by 1. The image sequence within a period of time before and after the person triggers the counter count is obtained, and the evidence chain information of the person leaving the first camera is obtained. Figure 5a This is a schematic diagram of an unobstructed person captured by the first camera in a personnel counting method for a production line safety protection area according to an embodiment of this application. Figure 5a As shown, person 51 appears to the right of safety sign 52 and is touching the reference line. Figure 5b This is a schematic diagram of personnel being obscured by a second camera in a personnel counting method for a production line safety protection area according to an embodiment of this application. Figure 5b As shown, due to the presence of safety sign 52, person 51 is obscured by safety sign 52 in the field of view of the second camera, thus failing to be detected by the second camera. Combining this with the detection of the first camera avoids the problem of missed detection caused by other objects obstructing the field of view when using a single camera. Furthermore, the two cameras perform counting and statistics independently without interference, improving the accuracy of personnel detection in the safety protection area of ​​the production line.

[0076] In another embodiment, the evidence chain information also includes the identification information of the target person, and further includes: if the information source of the target person's change information comes from the first camera, then based on the target person's identification information, it is determined whether the target person's change information is received from the second camera; if so, the target person's count value is discarded; otherwise, the target person's count value is adopted for counting statistics.

[0077] Specifically, the joint analysis module is located in the first camera. When it receives personnel change information collected by the first camera and determines that it needs to be statistically analyzed, the joint analysis module sets ID identifiers for the personnel captured by the first camera and stored in the joint analysis module. For personnel statistical information received from the second camera, the joint analysis module converts the personnel ID information in the image captured by the second camera into a format based on the first camera for storage. Therefore, when the joint analysis module receives change information of a target personnel from the first camera, it can directly compare the stored personnel IDs to determine whether change information of the target personnel has been received from the second camera. If the comparison finds that change information of the target personnel has been received from the second camera, the count value of the target personnel is not counted; otherwise, the count value of the target personnel is counted. Regardless of whether the first camera or the second camera has reported the same personnel change information, the joint analysis module stores the evidence chain information reported by the first camera and the second camera for retrieval at any time when needed.

[0078] This embodiment also provides a method for counting personnel in the safety protection area of ​​a production line. Figure 6 This is a flowchart of another method for counting personnel in the safety protection area of ​​a production line, according to an embodiment of this application. Figure 6 As shown, the process includes the following steps:

[0079] Step S601: Perform personnel change statistics on the security protection area using the first camera and / or the second camera respectively; wherein the combined field of view of the first camera and the second camera is not less than the range of the security protection area;

[0080] Step S602: The joint analysis module installed in the first camera receives the change information of the target personnel within the security protection area; the change information of the target personnel includes evidence chain information and count value; the evidence chain information includes image sequences within a preset time period before and after the time when the count value is generated;

[0081] Step S603: Determine whether the information source of the target person's change information comes from the first camera; if yes, proceed to step S608; otherwise, proceed to step S604.

[0082] Step S604: Obtain key points of personnel in the image sequences captured by the first and second cameras that have been counted; calibrate the ground within the safety protection zone to obtain a mapping matrix; obtain the first foot point mapping trajectory of the personnel based on the key points of the personnel and the mapping matrix; obtain key points of the target personnel in the image sequences captured by the second camera; calibrate the ground within the safety protection zone to obtain a mapping matrix; obtain the second foot point mapping trajectory of the target personnel based on the key points of the target personnel and the mapping matrix.

[0083] Step S605: Match the first foot point mapping trajectory and the second foot point mapping trajectory to determine whether there is a matching pair with a similarity not lower than a preset threshold. If yes, proceed to step S606; otherwise, proceed to step S607.

[0084] Step S606: Discard the count value of the target personnel.

[0085] Step S607: Use the count values ​​of the target personnel for counting and statistics.

[0086] Step S608: Based on the identification information of the target person, determine whether the change information of the target person has been received from the second camera. If yes, proceed to step S606; otherwise, proceed to step S607.

[0087] Through steps S601 to S608, compared with the prior art of detecting personnel changes in the safety protection area using a single camera, this embodiment sets up two cameras, a first camera and a second camera, at the entrance and exit of the safety protection area. After the first camera and the second camera are calibrated, the two cameras count the personnel entering the protection area according to the pre-set counting line statistical logic, and obtain their respective personnel change information, including evidence chain information and count value. Then, the joint analysis module in the first camera analyzes the received personnel change information to obtain the final personnel change statistics. This avoids the problems of incomplete detection, missed detection, and false detection by a single camera, thereby improving the accuracy of personnel statistics in the safety protection area of ​​the production line.

[0088] This embodiment also provides a personnel statistics system for the safety protection area of ​​a production line, which is used to implement the above embodiments and preferred embodiments.

[0089] Figure 7 This is a schematic diagram of the structure of a personnel counting system for the safety protection area of ​​a production line according to an embodiment of this application, as shown below. Figure 7 As shown, the system includes a first camera 71, a second camera 72, and a joint statistics module 73. The first camera 71 includes an information acquisition module 74 and a joint analysis module 75. The information acquisition module 74 is used to acquire change information of a first target person in the field of view of the first camera according to a preset counting logic, and report the change information of the first target person to the joint analysis module 75. The joint analysis module 75 is used to analyze and process the change information of the first target person and / or the change information of the second target person, obtain the analysis and processing results, and report the analysis and processing results to the joint statistics module 73.

[0090] The second camera 72 is used to collect the change information of the second target person in the field of view of the second camera according to the preset counting logic, and report the change information of the second target person to the joint analysis module 75.

[0091] The joint statistics module 73 is used to perform personnel change statistics within the security protection area based on the analysis and processing results reported by the joint analysis module 75.

[0092] This embodiment also provides a personnel counting device for the safety protection area of ​​a production line. This device is used to implement the above embodiments and preferred embodiments, and will not be repeated as already described. The terms "module," "unit," "subunit," etc., used below can refer to a combination of software and / or hardware that performs a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0093] Figure 8 This is a structural block diagram of a personnel counting device for a production line safety protection area according to an embodiment of this application, as shown below. Figure 8 As shown, the device 80 includes: a receiving module 81, a judging module 82, a matching module 83, and a counting module 84. The receiving module 81 is used to receive change information of target personnel within the security protection area. The change information of target personnel includes evidence chain information and count value.

[0094] The judgment module 82 is used to judge the information source of the change information of the target personnel; the information source includes the first camera and the second camera, and the combined field of view of the first camera and the second camera is not less than the range of the safety protection zone;

[0095] The matching module 83 is used to obtain the first foot point mapping trajectory of all personnel based on the evidence chain data of the counted first camera and the second camera when the information source of the change information of the target personnel comes from the second camera; and to obtain the second foot point mapping trajectory of the target personnel based on the evidence chain information of the target personnel, and to match the first foot point mapping trajectory and the second foot point mapping trajectory.

[0096] The counting module 84 is used to determine whether there is a matching pair with a similarity not lower than a preset threshold; if it exists, the count value of the target person is discarded; if it does not exist, the count value of the target person is adopted for counting statistics.

[0097] It should be noted that the above modules can be functional modules or program modules, and can be implemented through software or hardware. For modules implemented through hardware, the above modules can reside in the same processor; or the above modules can be located in different processors in any combination.

[0098] This embodiment also provides an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0099] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0100] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0101] S1 receives information on changes in target personnel within the security protection area; the information on changes in target personnel includes evidence chain information and count values;

[0102] S2, determine the information source of the change information of the target personnel; the information source includes the first camera and the second camera, and the combined field of view of the first camera and the second camera is not less than the range of the security protection zone;

[0103] S3, if the information source of the target person's change information comes from the second camera, then obtain the first foot point mapping trajectory of the person based on the evidence chain information of the counted first camera and second camera, and obtain the second foot point mapping trajectory of the target person based on the evidence chain information of the target person, and match the first foot point mapping trajectory and the second foot point mapping trajectory.

[0104] S4. Determine if there is a matching pair with a similarity not lower than a preset threshold; if so, discard the target person's count value; if not, adopt the target person's count value for counting statistics.

[0105] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, and will not be repeated in this embodiment.

[0106] Furthermore, in conjunction with the personnel counting method for the production line safety protection area provided in the above embodiments, this embodiment can also provide a storage medium for implementation. This storage medium stores a computer program; when executed by a processor, the computer program implements any of the personnel counting methods for the production line safety protection area described in the above embodiments.

[0107] It should be understood that the specific embodiments described herein are merely illustrative of the application and not intended to limit it. All other embodiments derived by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0108] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0109] Obviously, the accompanying drawings are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar situations based on these drawings without any creative effort. Furthermore, it is understood that although the work done in this development process may be complex and lengthy, for those skilled in the art, certain design, manufacturing, or production modifications made based on the technical content disclosed in this application are merely conventional technical means and should not be considered as insufficient disclosure of this application.

[0110] The term "embodiment" in this application refers to a specific feature, structure, or characteristic described in connection with an embodiment that may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily imply the same embodiment, nor does it imply that it is mutually exclusive with or independent of other embodiments. It will be clearly or implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0111] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments described above. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0112] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of patent protection. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the appended claims.

Claims

1. A production line safety guard area personnel counting method, characterized by, The method applied to the first camera comprises: receiving the change information of the target personnel in the security protection area; the change information of the target personnel comprises evidence chain information and a count value; judging the information source of the change information of the target personnel; the information source comprises the first camera and a second camera, and the joint field of view of the first camera and the second camera is not less than the range of the security protection area; if the information source of the change information of the target personnel is from the second camera, obtaining a first foot point mapping track of personnel based on the evidence chain information of the first camera and the second camera which has been counted, and obtaining a second foot point mapping track of the target personnel based on the evidence chain information of the target personnel, and matching the first foot point mapping track and the second foot point mapping track; judging whether there is a matching pair with a similarity not less than a preset threshold; if there is, discarding the count value of the target personnel; if there is not, adopting the count value of the target personnel for counting statistics; wherein, before obtaining the first foot point mapping track of personnel based on the evidence chain information of the first camera and the second camera which has been counted, it further comprises: when detecting that a person moves in a preset first direction and touches a reference line, triggering the counter value to increase by 1 to obtain the count value of the person, and obtaining an image sequence containing a preset time period before and after the time when the counter is triggered to obtain the first camera evidence chain information; or when detecting that a person moves in a preset second direction and touches a reference line, triggering the counter value to decrease by 1 to obtain the count value of the person, and obtaining an image sequence containing a preset time period before and after the time when the counter is triggered to obtain the first camera evidence chain information.

2. The production line safety guard area personnel counting method according to claim 1, characterized by, The evidence chain information comprises an image sequence in a preset time period before and after the time when the count value is generated.

3. The production line safety guard area personnel counting method according to claim 2, characterized by, The evidence chain information comprises an image sequence in a preset time period before and after the time when the count value is generated. The evidence chain information comprises an image sequence in a preset time period before and after the time when the count value is generated. The evidence chain information comprises an image sequence in a preset time period before and after the time when the count value is generated. The evidence chain information comprises an image sequence in a preset time period before and after the time when the count value is generated.

4. The production line safety guard area personnel counting method according to claim 3, characterized by, The evidence chain information comprises an image sequence in a preset time period before and after the time when the count value is generated. The evidence chain information further comprises identification information of the target personnel, and the method further comprises: ​ 5. The production line safety guard area personnel counting method according to claim 1, characterized by, ​ If the information source of the change information of the target person is from the first camera, it is determined whether the change information of the target person is received from the second camera based on the identification information of the target person, if yes, the count value of the target person is discarded; otherwise, the count value of the target person is adopted for counting statistics.

6. A production line safety guard area personnel counting system characterized by, The system comprises a first camera, a second camera and a joint statistical module, wherein, The first camera comprises an information collection module and a joint analysis module, the information collection module is configured to collect change information of a first target person in a field of view of the first camera according to a preset counting logic, and report the change information of the first target person to the joint analysis module; the joint analysis module is configured to analyze and process the change information of the first target person and / or change information of a second target person, obtain an analysis processing result, and report the analysis processing result to the joint statistical module; The second camera is configured to collect change information of the second target person in a field of view of the second camera according to a preset counting logic, and report the change information of the second target person to the joint analysis module; wherein the change information of the target person comprises evidence chain information and a count value, and the preset counting logic comprises: When a person is detected to move in a preset first direction and touch a reference line, a counter value is triggered to increase by 1, a count value of the person is obtained, and an image sequence containing a preset time period before and after a time when the counter is triggered is obtained, to obtain first camera evidence chain information; or When a person is detected to move in a preset second direction and touch a reference line, a counter value is triggered to decrease by 1, a count value of the person is obtained, and an image sequence containing a preset time period before and after a time when the counter is triggered is obtained, to obtain the first camera evidence chain information; The joint statistical module is configured to perform personnel change statistics in a security protection area according to the analysis processing result reported by the joint analysis module.

7. A production line safety guard area personnel counting device, characterized by, Comprise: A receiving module, a judging module, a matching module and a counting module, wherein, The receiving module is configured to receive change information of a target person in a security protection area; the change information of the target person comprises evidence chain information and a count value; The judging module is configured to judge an information source of the change information of the target person; the information source comprises a first camera and a second camera, and a joint field of view of the first camera and the second camera is not less than a range of the security protection area; The matching module is configured to, when the information source of the change information of the target person is from the second camera, acquire a first foot point mapping track of all persons based on the evidence chain data of the first camera and the second camera that has been counted, acquire a second foot point mapping track of the target person based on the evidence chain information of the target person, and match the first foot point mapping track and the second foot point mapping track; and before acquiring the first foot point mapping track of the person based on the evidence chain information of the first camera and the second camera that has been counted, further comprising: when it is detected that a person moves in a preset first direction and touches a reference line, triggering a counter value to be increased by 1 to obtain a count value of the person, and acquiring an image sequence containing a preset time period before and after the time when the counter is triggered to obtain the first camera evidence chain information; or when it is detected that a person moves in a preset second direction and touches a reference line, triggering a counter value to be decreased by 1 to obtain a count value of the person, and acquiring an image sequence containing a preset time period before and after the time when the counter is triggered to obtain the first camera evidence chain information. The counting module is configured to determine whether there is a matching pair with a similarity not lower than a preset threshold; if there is, discard the count value of the target person; and if there is not, adopt the count value of the target person for counting statistics. 8.An electronic device comprising a memory and a processor, the electronic device comprising: The memory stores a computer program, and the processor is configured to run the computer program to execute the production line safety protection area person counting method in any one of claims 1 to 5.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the production line safety protection area person counting method in any one of claims 1 to 5.

Images