Personnel information identification method and system, terminal equipment and storage medium

By combining image recognition and positioning data, filtering personnel information that meets the preset walking path characteristics, the problem of low accuracy of personnel information recognition in intelligent mines is solved, high-accuracy personnel information recognition is achieved, and the safety of underground personnel management is improved Sex and accuracy.

CN118918609AInactive Publication Date: 2024-11-08JINGYING SHUZHI TECH HLDG CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411003017.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-25
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

During the construction of smart mines, it is difficult for the existing technology to accurately identify the information of underground personnel in working conditions, especially due to factors such as light, angle and coal dust coverage, the accuracy of facial recognition is low, and it is impossible to accurately confirm the identity of personnel.

Method used

By combining image recognition results and personnel positioning data, the time range for personnel to enter and leave the area is determined, and the distance characteristics of the personnel's walking path are calculated, and the personnel information that meets the characteristics of the preset walking path are filtered to achieve accurate identification of personnel information.

Benefits of technology

It realizes low-cost and high-accuracy personnel information identification, helps to manage personnel in specific areas in related scenarios, and improves safety and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118918609A_ABST
    Figure CN118918609A_ABST
Patent Text Reader

Abstract

The invention relates to a personnel information identification method and system, terminal equipment and a storage medium. The method comprises the following steps: determining a first time when each person enters an area and a second time when each person leaves the area according to an image recognition result of a set area; and according to the real-time positioning information, determining information of personnel located near the area within the time range from the first time to the second time. According to the technical scheme provided by the invention, accurate identification of personnel information is realized through a method of combining image identification and personnel positioning data, and personnel management work in a specific area in a related scene is facilitated.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of underground personnel positioning, and in particular to a personnel information recognition method, system, terminal equipment and storage medium. Background Art

[0002] At present, in the process of smart mine construction, a large number of image-based AI recognition models are empowering production safety. In some scenarios, it is necessary not only to identify whether there are people, but also to identify the information of the person. For example, in some inspection scenarios, it is dangerous for non-inspection personnel to enter the area, but it is normal for inspection personnel to enter the area for inspection. In this scenario, it is necessary to accurately identify the information of people entering the area. The commonly used method is face recognition, but in the working environment, due to factors such as light, angle, and the face of the person being covered by coal powder, the accuracy of face recognition is low, and the specific identity of the person cannot be confirmed. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present invention provides a personnel information recognition method, system, terminal device and storage medium, which combines image recognition results and personnel positioning data for fusion analysis to achieve low-cost, high-accuracy personnel information precise recognition.

[0004] According to a first aspect of an embodiment of the present invention, there is provided a method for identifying personnel information, comprising:

[0005] According to the image recognition results of the set area, determine the first time when each person enters the area and the second time when each person leaves the area;

[0006] According to the real-time positioning information, information about people whose positions are near the area within a time range from the first time to the second time is determined.

[0007] Furthermore, the method further comprises:

[0008] Calculate, based on the real-time positioning information, a first distance between the position of each person at a first time and the position at a second time, a second distance between the position at the first time and a fixed position in the area, and a third distance between the position at the second time and the fixed position;

[0009] The personnel information that meets the preset walking path characteristics is determined according to the first distance, the second distance and the third distance.

[0010] Furthermore, the preset walking path is that a person enters from one side of the set area and leaves from the other side, and the person information that meets the characteristics of the preset walking path is determined according to the first distance, the second distance, and the third distance, specifically including:

[0011] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is greater than the set value and the second distance or the third distance is less than the set value.

[0012] Furthermore, the preset walking path is that a person enters from one side of a set area and leaves from the same side, and the person information that meets the characteristics of the preset walking path is determined according to the first distance, the second distance, and the third distance, specifically including:

[0013] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is less than the set value, and the second distance and the third distance are both less than the set values.

[0014] According to a second aspect of an embodiment of the present invention, there is provided a personnel information recognition system, comprising:

[0015] An image recognition module, used to determine a first time when each person enters the area and a second time when each person leaves the area according to the image recognition result of the set area;

[0016] The personnel identification module is used to determine the personnel information located near the area within a time range from a first time to a second time according to the real-time positioning information.

[0017] Furthermore, the system includes:

[0018] A distance calculation module, used to calculate, based on the real-time positioning information, a first distance between the position of each person at a first time and the position at a second time, a second distance between the position at the first time and a fixed position in the area, and a third distance between the position at the second time and the fixed position;

[0019] The personnel identification module is also used to determine the personnel information that meets the preset walking path characteristics according to the first distance, the second distance and the third distance.

[0020] Furthermore, the preset walking path is that a person enters from one side of the set area and leaves from the other side. The person identification module is specifically used to:

[0021] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is greater than the set value and the second distance or the third distance is less than the set value.

[0022] Furthermore, the preset walking path is that a person enters from one side of the set area and leaves from the same side. The person identification module is specifically used for:

[0023] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is less than the set value, and the second distance and the third distance are both less than the set values.

[0024] According to a third aspect of an embodiment of the present invention, a terminal device is provided, including:

[0025] Processor; and

[0026] The memory stores executable codes thereon, and when the executable codes are executed by the processor, the processor is caused to execute the method as described above.

[0027] According to a fourth aspect of an embodiment of the present invention, there is provided a non-transitory machine-readable storage medium having executable code stored thereon, which, when executed by a processor of an electronic device, causes the processor to execute the method as described above.

[0028] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

[0029] By combining image recognition with personnel location data, accurate identification of personnel information is achieved, which helps with personnel management in specific areas in related scenarios.

[0030] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The above and other objects, features and advantages of the present invention will become more apparent through a more detailed description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, wherein like reference numerals generally represent like components throughout the exemplary embodiments of the present invention.

[0032] Figure 1 is a flow chart of a method for identifying personnel information according to an exemplary embodiment of the present invention;

[0033] Figure 2 It is a schematic diagram of the scene arrangement of the area where the camera shoots the personnel's inspection;

[0034] Figure 3 It is a schematic diagram of a person's walking path;

[0035] Figure 4 This is another schematic diagram of a person's walking path;

[0036] Figure 5 is a structural block diagram of a personnel information identification system according to an exemplary embodiment of the present invention;

[0037] Figure 6 It is a schematic diagram showing the structure of a computing device according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0038] The preferred embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the preferred embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present invention more thorough and complete, and to fully convey the scope of the present invention to those skilled in the art.

[0039] The terms used in the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms "a", "the" and "the" used in the present invention and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0040] It should be understood that although the terms "first", "second", "third", etc. may be used to describe various information in the present invention, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0041] The technical solutions of the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0042] Figure 1 The figure is a flow chart of a method for identifying personnel information according to an exemplary embodiment of the present invention.

[0043] See also Figure 1 , the method comprising:

[0044] 110. According to the image recognition result of the set area, determine the first time when each person enters the area and the second time when each person leaves the area.

[0045] Specifically, in one embodiment, Figure 2 As shown, images can be captured by a camera installed on-site in a set area, and people entering the area can be photographed using an existing image recognition algorithm. The time when the person is first recognized to appear in the captured image is used as the time of entering the area, and the time when the person disappears from the captured image is used as the time of leaving the area.

[0046] 120. Determine, based on the real-time positioning information, information about people whose locations are near the area within a time range from the first time to the second time.

[0047] Specifically, in one embodiment, for example, in the field of coal mine production, it is generally necessary to deploy a personnel positioning system, including substations deployed at various locations underground. Each substation will upload the information of personnel entering the substation to the underground personnel management system. The underground personnel management system records the basic information of the personnel (including card number, name, position, job title, team group, etc.) and records the historical location of the personnel (including the time of entering the substation, the distance to the current substation, time, etc.) in detail.

[0048] Combined with the time period of personnel entering and leaving the area obtained in step 110, the information of personnel entering the substation where the set area is located within the time period can be queried from the underground personnel management system, so as to facilitate further judgment on whether they are personnel allowed to enter the set area. In addition, the above time period can also be appropriately expanded to avoid time deviation, such as extracting the time period from the preset time before the personnel enters the area to the preset time after the personnel leaves the area. In the equipment area that needs to be inspected, the application of this solution can assist in judging whether the personnel entering the equipment area are qualified inspection personnel, timely discover the behavior of non-inspection personnel entering the area and conduct further processing.

[0049] Due to the accuracy limitation of the positioning information and the possibility that multiple people may enter the vicinity of the area during the above time period, in order to further filter the personnel information, optionally, in this embodiment, the method further includes:

[0050] 130. Calculate, based on the real-time positioning information, a first distance between the position of each person at the first time and the position at the second time, a second distance between the position at the first time and a fixed position in the area, and a third distance between the position at the second time and the fixed position;

[0051] 140. Determine the information of a person that meets the preset walking path characteristics according to the first distance, the second distance, and the third distance.

[0052] Specifically, the walking path characteristics can be pre-set according to the changing rules of the positions of people when walking in the area, combined with the positioning information of fixed positions in the area, so as to further extract the information of people who meet the preset walking path characteristics according to the real-time positioning information of the people. The above-mentioned fixed position can be the installation position of the camera in the area, which can be obtained by installing a positioning card on the camera.

[0053] Optionally, in this embodiment, the preset walking path is that a person enters the set area from one side and leaves from the other side, and step 140 specifically includes:

[0054] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is greater than the set value and the second distance or the third distance is less than the set value.

[0055] Specifically, Figure 3 As shown in FIG. 1 , if a person enters from one side of the set area and leaves from the other side, the distance between the person's entry and exit positions is relatively far, and the entry or exit position is close to the camera position. In one embodiment, the time when a person enters the area is recorded as T s The time when the person leaves the area is recorded as T e , in this case, the way to determine the personnel information is:

[0056] 1. Screening through the personnel positioning system in T s -n to T e All personnel passing through substation A within the time range of +n (where n is the deviation duration).

[0057] 2. Calculate each person's T s Time position and T e The distance between the current position and the current position is used to filter out personnel whose distance is greater than the set value (e.g., the distance is greater than 20m).

[0058] 3. Calculate the remaining personnel in T s The distance l between the moment position and the camera position s 、T e The distance l between the moment position and the camera position e , filter l s or e Personnel who are shorter than the set value (e.g., shorter than 5m).

[0059] 4. The remaining people are possible personnel. Through the basic information of the personnel, the personnel’s position, job title, and team group can be obtained, and further judgment can be made as to whether they are inspection personnel.

[0060] Optionally, in this embodiment, the preset walking path is that a person enters from one side of the set area and leaves from the same side, and step 140 specifically includes:

[0061] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is less than the set value, and the second distance and the third distance are both less than the set values.

[0062] Specifically, Figure 4 As shown, another situation is that a person enters from one side and leaves from the same side. In this situation, the positions where the person enters and leaves are close to each other. In one embodiment, the method for determining the person information in this situation is:

[0063] 1. Screening through the personnel positioning system in T s -n to T e All personnel who pass through substation A within the time range of +n (where n is the deviation duration).

[0064] 2. Calculate each person's T s Time position and T e Time location distance, filter out people whose distance is less than the set value (such as less than 5m).

[0065] 3. Calculate the remaining personnel in T s The distance l between the moment position and the camera position s , T e The distance l between the moment position and the camera position e , filter out s , l e People who are relatively small (such as less than 5m).

[0066] 4. The remaining people are possible personnel. Through the basic information of the personnel, the personnel's position, job title, and team group can be obtained, and further judgment can be made whether they are inspection personnel.

[0067] Figure 5 is a structural block diagram of a personnel information recognition system according to an exemplary embodiment of the present invention.

[0068] See also Figure 5 The system comprises:

[0069] An image recognition module, used to determine a first time when each person enters the area and a second time when each person leaves the area according to the image recognition result of the set area;

[0070] The personnel identification module is used to determine the personnel information located near the area within a time range from a first time to a second time according to the real-time positioning information.

[0071] Optionally, in this embodiment, the system further includes:

[0072] A distance calculation module, used to calculate, based on the real-time positioning information, a first distance between the position of each person at a first time and the position at a second time, a second distance between the position at the first time and a fixed position in the area, and a third distance between the position at the second time and the fixed position;

[0073] The personnel identification module is also used to determine the personnel information that meets the preset walking path characteristics according to the first distance, the second distance and the third distance.

[0074] Optionally, in this embodiment, the preset walking path is that a person enters from one side of the set area and leaves from the other side, and the person identification module is specifically used to:

[0075] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is greater than the set value and the second distance or the third distance is less than the set value.

[0076] Optionally, in this embodiment, the preset walking path is that a person enters from one side of a set area and leaves from the same side, and the person identification module is specifically used to:

[0077] According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is less than the set value, and the second distance and the third distance are both less than the set values.

[0078] Regarding the system in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated again here.

[0079] Figure 6 It is a schematic diagram showing the structure of a computing device according to an exemplary embodiment of the present invention.

[0080] See also Figure 6 , the computing device 600 includes a memory 610 and a processor 620 .

[0081] The processor 620 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0082] The memory 610 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage. Among them, ROM can store static data or instructions required by the processor 620 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory may store some or all instructions and data required by the processor at run time. In addition, the memory 610 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, the memory 610 may include a readable and / or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (e.g., DVD-ROM, double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (e.g., SD card, mini SD card, Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and transient electronic signals transmitted wirelessly or wired.

[0083] The memory 610 stores executable codes, and when the executable codes are processed by the processor 620 , the processor 620 can execute part or all of the above-mentioned methods.

[0084] In addition, the method according to the present invention may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing part or all of the steps in the above method of the present invention.

[0085] Alternatively, the present invention may also be implemented as a non-temporary machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) on which executable code (or computer program, or computer instruction code) is stored. When the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (or computing device, server, etc.), the processor executes part or all of the steps of the above-mentioned method according to the present invention.

[0086] The scheme of the present invention has been described in detail above with reference to the accompanying drawings. In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments. Those skilled in the art should also be aware that the actions and modules involved in the specification are not necessarily required by the present invention. In addition, it can be understood that the steps in the method of the embodiment of the present invention can be adjusted in order, merged and deleted according to actual needs, and the modules in the device of the embodiment of the present invention can be merged, divided and deleted according to actual needs.

[0087] Those skilled in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or a combination of both.

[0088] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system and method according to multiple embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or code, and the part of the module, program segment or code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0089] The embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein are selected to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A method for identifying personnel information, characterized in that: include: Determine, based on the image recognition result of the set area, a first time when each person enters the area and a second time when each person leaves the area; According to the real-time positioning information, information about people whose positions are near the area within a time range from the first time to the second time is determined.

2. A personnel information identification method according to claim 1, characterized in that: Also includes: Calculate, according to the real-time positioning information, a first distance between the position of each person at the first time and the position at the second time, a second distance between the position at the first time and a fixed position in the area, and a third distance between the position at the second time and the fixed position; The personnel information that meets the preset walking path characteristics is determined according to the first distance, the second distance and the third distance.

3. A personnel information identification method according to claim 2, characterized in that: The preset walking path is that a person enters from one side of a set area and leaves from the other side, and the person information that meets the characteristics of the preset walking path is determined according to the first distance, the second distance, and the third distance, specifically including: According to the real-time positioning information, determine the personnel information that satisfies the condition that the first distance is greater than a set value and the second distance or the third distance is less than a set value.

4. A personnel information identification method according to claim 2, characterized in that: The preset walking path is that a person enters from one side of a set area and leaves from the same side, and the person information that meets the characteristics of the preset walking path is determined according to the first distance, the second distance, and the third distance, specifically including: According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is less than the set value, and the second distance and the third distance are both less than the set values.

5. A personnel information recognition system, characterized in that: include: An image recognition module, used to determine a first time when each person enters the area and a second time when each person leaves the area according to an image recognition result of the set area; The personnel identification module is used to determine, based on the real-time positioning information, the information of personnel whose positions are near the area within a time range from the first time to the second time.

6. A personnel information identification system according to claim 5, characterized in that: Also includes: a distance calculation module, used to calculate, according to the real-time positioning information, a first distance between the position of each person at the first time and the position at the second time, a second distance between the position at the first time and a fixed position in the area, and a third distance between the position at the second time and the fixed position; The personnel identification module is further used to determine personnel information that meets the preset walking path characteristics based on the first distance, the second distance and the third distance.

7. A personnel information identification system according to claim 6, characterized in that: The preset walking path is that a person enters from one side of the set area and leaves from the other side. The person identification module is specifically used to: According to the real-time positioning information, determine the personnel information that satisfies the condition that the first distance is greater than a set value and the second distance or the third distance is less than a set value.

8. A personnel information identification system according to claim 6, characterized in that: The preset walking path is that a person enters from one side of a set area and leaves from the same side. The person identification module is specifically used to: According to the real-time positioning information, determine the personnel information that meets the requirement that the first distance is less than the set value, and the second distance and the third distance are both less than the set values.

9. A terminal device, characterized in that: include: processor; as well as A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to execute the method according to any one of claims 1 to 4.

10. A non-transitory machine-readable storage medium having executable code stored thereon, characterized in that: When the executable code is executed by a processor of an electronic device, the processor is caused to execute the method as claimed in any one of claims 1 to 4.

Citation Information

Patent Citations

  • Monitoring method and system

    CN108537088A

  • A method for tracking video recording and visual backtracking of indoor personnel behaviors

    CN109684505A

  • Method and system for determining personnel track based on camera

    CN112307912A

  • Method for early warning of emergency public health event

    CN112367622A

  • Vehicle entering and exiting station and time length calculation method and monitoring calculation equipment

    CN116503976A