Personnel information management method, device and equipment based on AR system and medium

Abstract

The application discloses a personnel information management method and device based on an AR system, equipment and a medium, and is used for solving the technical problems that personnel tracking is not real-time and effective, and personnel information management and interaction are not systematic and comprehensive in the current AR scene. The method comprises the following steps: real-time tracking of position information of a target personnel in a monitoring area, and performing coordinate transformation of the position information based on UWB origin alignment to obtain real-time positioning coordinates in an AR terminal coordinate system; extracting a UWB number from the position information, and querying personnel information of the target personnel according to the UWB number; extracting target display information from the personnel information based on the association relationship between the target personnel and personnel bound with the AR terminal; and displaying the target display information in real time on the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a method, apparatus, equipment and medium for personnel information management based on an AR system. Background Technology

[0002] With the rapid development of AR (Augmented Reality) technology and its widespread application in various fields such as industry, healthcare, retail, and education, people tracking and information management have become key requirements in AR applications. However, current people tracking technologies in AR scenarios still suffer from problems such as insufficient real-time performance, low tracking accuracy, and poor robustness in complex environments. Especially in multi-person collaborative or dynamic scenarios, most current people tracking methods rely on traditional computer vision algorithms or single sensor data, making it difficult to achieve high-precision, low-latency real-time tracking, thus limiting the user experience.

[0003] Meanwhile, personnel information management and interaction systems also face numerous challenges in AR scenarios. Current solutions lack a systematic approach, making seamless integration across platforms and devices difficult. Furthermore, personnel information interaction primarily relies on simple text or static images, lacking intuitive and efficient interaction methods and failing to meet users' needs for real-time dynamic information. These issues not only affect the effectiveness of AR technology in real-world scenarios but also limit its promotion and widespread adoption in more fields.

[0004] Therefore, there is an urgent need for a technical solution that can improve the real-time performance and accuracy of personnel tracking, while achieving systematic and comprehensive personnel information management and interaction, in order to solve the technical bottlenecks in current AR scenarios and promote the application and development of AR technology in a wider range of scenarios. Summary of the Invention

[0005] This invention provides a method, apparatus, device, and medium for personnel information management based on an AR system, which solves or partially solves the technical problems of insufficient real-time and effectiveness of personnel tracking and insufficient systematic and comprehensive personnel information management and interaction in current AR scenarios.

[0006] This invention provides a personnel information management method based on an AR system, the method comprising:

[0007] The location information of target personnel within the monitoring area is tracked in real time, and the location information is transformed based on UWB origin alignment to obtain the real-time positioning coordinates in the AR terminal coordinate system.

[0008] Extract the UWB ID from the location information, and query the personnel information of the target person based on the UWB ID;

[0009] Based on the association between the target person and the person bound to the AR terminal, target display information is extracted from the person information;

[0010] Based on the information display priority corresponding to the association relationship, the target display information is displayed in real time on the real-time positioning coordinates of the AR terminal.

[0011] Optionally, the location information of the target personnel within the real-time tracking and monitoring area includes:

[0012] Obtain the area division information of the monitoring area;

[0013] Based on the regional division information, the monitoring area is divided into a first-risk-level area, a second-risk-level area, and a third-risk-level area in descending order of risk level.

[0014] According to the preset priority tracking rules, the target personnel in the first risk level area, or the second risk level area, and / or the third risk level area are tracked in real time to obtain location information.

[0015] Optionally, the step of tracking target personnel in real time within the first risk level area, or the second risk level area, and / or the third risk level area according to a preset priority tracking rule to obtain location information includes:

[0016] Prioritize detecting whether there are any people in the area of ​​the first risk level;

[0017] If a person is detected in the first risk level area, the person detected in the first risk level area is taken as the first target person, and the first target person is tracked in real time to obtain the first location information;

[0018] If no personnel are detected in the first risk level area, then continue to detect whether there are personnel in the second risk level area;

[0019] If a person is detected in the area of ​​the second risk level, the person detected in the area of ​​the second risk level will be regarded as the second target person, and the second target person will be tracked in real time to obtain the second location information;

[0020] If no personnel are detected in the second risk level area, then continue to detect whether there are personnel in the third risk level area;

[0021] If a person is detected in the third risk level area, the person detected in the third risk level area is designated as the third target person, and the third target person is tracked in real time to obtain the third location information;

[0022] If no personnel are detected in the third risk level area, the real-time tracking action is paused until new personnel are detected again in the first risk level area, or the second risk level area, and / or the third risk level area.

[0023] Optionally, after real-time tracking of the first target person to obtain the first location information, the method further includes:

[0024] The first tracking prompt message is generated on the display interface of the AR terminal;

[0025] Based on the selection operation of the person bound to the AR terminal in response to the first tracking prompt information, it is determined whether to continue real-time tracking of the person in the second risk level area and / or the third risk level area.

[0026] Optionally, after real-time tracking of the second target person to obtain the second location information, the method further includes:

[0027] A second tracking prompt message is generated on the display interface of the AR terminal;

[0028] Based on the selection operation of the person bound to the AR terminal in response to the second tracking prompt information, it is determined whether to continue real-time tracking of the person in the third risk level area.

[0029] Optionally, the location information of the target personnel within the real-time tracking and monitoring area includes:

[0030] Obtain the personnel type information of all personnel within the monitoring area;

[0031] Based on the personnel type information, all personnel in the monitoring area are divided into at least one tracking personnel type, and a first tracking selection button corresponding to each tracking personnel type is generated on the AR terminal;

[0032] Based on the selection operation of the first tracking selection button, the target tracking personnel type is determined from each of the tracking personnel types, the personnel corresponding to the target tracking personnel type is taken as the fourth target personnel, and the fourth target personnel is tracked in real time to obtain the fourth location information.

[0033] Optionally, the fourth target person includes at least one person to be tracked; after real-time tracking of the fourth target person, the method includes:

[0034] The AR terminal generates tracking selection sub-buttons for each of the individuals to be tracked.

[0035] Based on the selection operation of the tracking selection sub-button, the target tracker is determined from each of the tracked persons, the target tracker is tracked in real time, and the tracking of the tracked persons other than the target tracker in the fourth target persons is paused.

[0036] Optionally, the location information of the target personnel within the real-time tracking and monitoring area includes:

[0037] Obtain skill score information for all personnel within the monitoring area;

[0038] Based on the skill score information, a fifth target person is identified from all personnel within the monitoring area, and the fifth target person is tracked in real time to obtain the fifth location information.

[0039] Optionally, determining the fifth target person from all personnel within the monitoring area based on the skill score information includes:

[0040] Based on the skill score information, the person with the lowest skill score is selected from all personnel in the monitoring area as the fifth target person;

[0041] or,

[0042] Based on the skill score information, individuals whose skill scores fall within a preset range are selected from all personnel within the monitoring area as the fifth target personnel.

[0043] Optionally, the location information of the target personnel within the real-time tracking and monitoring area includes:

[0044] Obtain information on the number of violations committed by all individuals within the monitored area;

[0045] Based on the violation count information, a sixth target person is identified from all personnel within the monitoring area, and the sixth target person is tracked in real time to obtain the sixth location information.

[0046] Optionally, determining the sixth target person from all personnel within the monitoring area based on the violation count information includes:

[0047] Based on the violation count information, the person with the highest number of violations is selected from all personnel in the monitoring area as the sixth target person;

[0048] or,

[0049] Based on the violation count information, individuals whose violation count falls within a preset range are selected from all personnel within the monitoring area as the sixth target personnel.

[0050] Optionally, the step of extracting target display information from the personnel information based on the association between the target person and the person bound to the AR terminal includes:

[0051] Obtain the personnel type information of the person bound to the AR terminal, and determine the viewing personnel type of the person bound to the AR terminal;

[0052] Extract the personnel type information of the target personnel from the personnel information to determine the type of the person being viewed by the target personnel;

[0053] Based on the comparison between the type of the person being viewed and the type of the person viewing, the association result between the target person and the person bound to the AR terminal is determined;

[0054] Based on the association results, target display information is extracted from the personnel information.

[0055] Optionally, the personnel types of all personnel whose information has been entered within the monitoring area are divided into four categories according to their management authority, from highest to lowest: a first personnel type, a second personnel type, a third personnel type, and a fourth personnel type. The process of determining the association between the target personnel and the personnel bound to the AR terminal by comparing the viewed personnel type with the viewed personnel type includes:

[0056] Compare the type of the person being viewed with the type of the person viewing the data;

[0057] If the type of the person being viewed is the same as the type of the person being viewed, then the target person and the person bound to the AR terminal are at the same level.

[0058] If the viewing personnel type is a first personnel type and the viewed personnel type is any one of a second, third, or fourth personnel type; or, the viewing personnel type is a second personnel type and the viewed personnel type is one of a third or fourth personnel type; or, the viewing personnel type is a third personnel type and the viewed personnel type is a fourth personnel type, then the personnel bound to the AR terminal and the target personnel have a management and managed relationship.

[0059] If the viewed person type is a first person type and the viewed person type is any one of a second, third, or fourth person type; or, the viewed person type is a second person type and the viewed person type is one of a third or fourth person type; or, the viewed person type is a third person type and the viewed person type is a fourth person type, then the target person and the person bound to the AR terminal have a management and managed relationship.

[0060] Optionally, extracting target display information from the personnel information based on the association result includes:

[0061] If the target person and the person bound to the AR terminal are at the same level, then determine whether the target person and the person bound to the AR terminal belong to the same unit.

[0062] If the target person and the person bound to the AR terminal belong to the same unit, then the personnel level relationship between the target person and the person bound to the AR terminal is determined, and the target display information is extracted from the personnel information based on the personnel level relationship determination result.

[0063] Optionally, the personnel hierarchy is such that the target personnel is a superior of the person bound to the AR terminal, or a peer of the person bound to the AR terminal, or a subordinate of the person bound to the AR terminal; the personnel information includes basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records; the extraction of target display information from the personnel information based on the personnel hierarchy judgment result includes:

[0064] When the target person is the superior of the person bound to the AR terminal, basic identity information is extracted from the person information and used as the target display information;

[0065] When the target person is at the same level as or below the person bound to the AR terminal, basic identity information, operation appointment information, dynamic tracking trajectory and historical violation records are extracted from the person information and used as target display information.

[0066] Optionally, the step of displaying the target display information in real time at the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship includes:

[0067] When the target person is the superior of the person bound to the AR terminal, the basic identity information of the target person is directly displayed on the real-time positioning coordinates of the AR terminal.

[0068] When the target person is at the same level as the person bound to the AR terminal, the display priority of the target information is based on the display order of basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0069] When the target person is a subordinate of the person bound to the AR terminal, the display priority of the target information is based on the display order of basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0070] Optionally, the step of displaying the target display information in real time at the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship includes:

[0071] When the target person is the superior of the person bound to the AR terminal, the basic identity information of the target person is directly displayed on the real-time positioning coordinates of the AR terminal.

[0072] When the target person is at the same level as or below the person bound to the AR terminal, the display interface of the AR terminal generates display selection buttons for the basic identity information, the operation appointment information, the dynamic tracking trajectory, and the historical violation records.

[0073] The information display priority is determined by the order in which the selection buttons for at least one target are selected, and the information corresponding to the at least one target selection button is displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0074] Optionally, when the target person is a peer or subordinate of the person bound to the AR terminal, the method further includes:

[0075] Based on the operation reservation information, determine at least one reservation area of ​​the target person within the monitoring area, and the reservation time period corresponding to each reservation area;

[0076] Based on the dynamic tracking trajectory, the target reservation area corresponding to the current location of the target person is monitored in real time, and it is determined whether the current time is within the reservation time period corresponding to the target reservation area;

[0077] If not, adjust the display style of the target person's current information.

[0078] Optionally, the method further includes:

[0079] After adjusting the display style of the target person's current information, obtain the first type of associated persons and the second type of associated persons of the target person, and start timing immediately;

[0080] When the timeout period exceeds the first preset timeout threshold, a timeout notification message is sent to the AR terminal held by the target person, and an assistance notification message is sent to the AR terminal held by the first type of associated person, and the timeout is restarted.

[0081] When the re-timing duration exceeds the second preset duration threshold, and no other personnel are detected approaching the target person, an assistance prompt message is sent to the AR terminal held by the second type of associated personnel;

[0082] If the re-timing duration does not exceed the second preset duration threshold, and if it is detected that other people are approaching the target person, or the target person actively leaves the target reservation area, the information display style will be switched back to the original display style, and the push of assistance prompt information will be stopped.

[0083] Optionally, the method further includes:

[0084] If the target person and the person bound to the AR terminal are not in the same unit, a message indicating that the AR terminal does not have viewing permission will be sent to the AR terminal.

[0085] Optionally, the personnel information includes basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records; the step of extracting target display information from the personnel information based on the association result includes:

[0086] If the person bound to the AR terminal and the target person have a management and being managed relationship, then basic identity information, operation appointment information, dynamic tracking trajectory and historical violation records are extracted from the personnel information and used as target display information.

[0087] Optionally, the step of displaying the target display information in real time at the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship includes:

[0088] The display priority of the target information is based on the order of displaying basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0089] or,

[0090] The display priority of the target information is based on the order of basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0091] or,

[0092] The AR terminal displays selection buttons for the basic identity information, the operation appointment information, the dynamic tracking trajectory, and the historical violation records. The selection order of the selection buttons for at least one target is used as the information display priority, and the information corresponding to the at least one target display selection button is displayed on the real-time positioning coordinates of the AR terminal in sequence.

[0093] Optionally, the method further includes:

[0094] If the target person and the person bound to the AR terminal have a management and managed relationship, a message indicating that the target person has no viewing permission will be sent to the AR terminal.

[0095] Optionally, the first personnel type corresponds to the management personnel of the monitoring area; if neither the target personnel nor the personnel bound to the AR terminal are management personnel of the monitoring area, then after the AR terminal receives a no-viewing-permission prompt, the method further includes:

[0096] The AR terminal sends an information viewing request to the AR terminal held by the manager or the AR terminal held by the target person.

[0097] If a viewing request is received via the AR terminal held by the manager or the AR terminal held by the target person, the target display information of the target person is extracted and displayed in real time.

[0098] Optionally, the method further includes:

[0099] During the movement of the target person, people within a preset radius of the target person are identified as neighboring people;

[0100] The identity of the target person and the adjacent persons are verified separately to confirm whether the person currently displaying the target information is the target person.

[0101] Optionally, the method further includes:

[0102] During the movement of the target person, the current posture information of the target person is captured in real time based on posture recognition;

[0103] Behavioral analysis is performed on the current posture information, and path recognition is combined to predict the trajectory of the target person to obtain the predicted travel path;

[0104] Pre-push information for the target display information is generated along the predicted travel path;

[0105] When the actual travel path of the target person is consistent with the predicted travel path, the pre-push information is directly displayed in real time along the actual travel path;

[0106] When the actual travel path of the target person is inconsistent with the predicted travel path, the target display information is regenerated and displayed in real time along the actual travel path.

[0107] The present invention also provides a personnel information management device based on an AR system, comprising:

[0108] The real-time tracking unit is used to track the location information of target personnel within the monitoring area in real time, and to perform coordinate transformation based on UWB origin alignment on the location information to obtain real-time positioning coordinates in the AR terminal coordinate system.

[0109] The personnel information query unit is used to extract the UWB number from the location information and query the personnel information of the target personnel based on the UWB number;

[0110] The target display information extraction unit is used to extract target display information from the personnel information based on the association between the target personnel and the personnel bound to the AR terminal;

[0111] An information display unit is used to display the target display information in real time on the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship.

[0112] The present invention also provides an electronic device, the device comprising a processor and a memory:

[0113] The memory is used to store program code and transmit the program code to the processor;

[0114] The processor is used to execute the personnel information management method based on the AR system as described above, according to the instructions in the program code.

[0115] The present invention also provides a computer-readable storage medium for storing program code for executing the personnel information management method based on the AR system as described in any of the preceding claims.

[0116] As can be seen from the above technical solutions, the present invention has the following advantages:

[0117] This paper presents a method for personnel information management based on an AR system. It tracks and monitors the location information of target personnel within a monitored area in real time, and performs a coordinate transformation based on UWB origin alignment to obtain real-time positioning coordinates in the AR terminal coordinate system. This allows for faster and more targeted location tracking of target personnel, laying the foundation for subsequent real-time display of personnel information. Utilizing the high-precision positioning of UWB provides more accurate personnel location information, and combining coordinate transformation to convert the location information in the UWB coordinate system to the equally applicable AR system coordinate system improves positioning accuracy and real-time performance. A UWB identifier is extracted from the location information, and the personnel information of the target personnel is retrieved based on the UWB identifier. Therefore, based on the unique UWB identifier, the display information corresponding to the target personnel can be accurately obtained, avoiding information errors. Based on the association between the target personnel and the personnel bound to the AR terminal, the target display information is extracted from the personnel information; based on the information display priority corresponding to the association relationship, the target display information is displayed in real time on the real-time positioning coordinates of the AR terminal. Therefore, when displaying information, by considering the relationship between the information viewer and the viewed person, as well as the information display priority, and combining appropriate information interaction, information that needs to be focused on or that is more interesting to the information viewer, as well as information that is allowed to be viewed within their permissions, can be displayed to the information viewer. This avoids the display of cluttered and redundant information, improves the user experience, and also prevents the information viewer from viewing information that they do not currently have permission to view, thus maintaining information security. Attached Figure Description

[0118] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0119] Figure 1 Here is a flowchart of the steps involved in a personnel information management method based on an AR system.

[0120] Figure 2 This is a schematic diagram of the dynamic trajectory of the target person in a specific example;

[0121] Figure 3 This is a schematic diagram of a heatmap generated based on the dynamic trajectory of a target person in a specific example;

[0122] Figure 4 This is a schematic diagram illustrating the use of different colors to distinguish different risk areas and identify personnel in a specific example;

[0123] Figure 5This is a diagram illustrating the creation of an empty object in the AreaTarget model of Unity.

[0124] Figure 6 This is a schematic diagram of the interface for instantiating a target location after receiving personnel location information;

[0125] Figure 7 This is a diagram illustrating the display of personnel information using an AR system.

[0126] Figure 8 This is a structural block diagram of a personnel information management device based on an AR system. Detailed Implementation

[0127] This invention provides a method, apparatus, device, and medium for personnel information management based on an AR system, which solves or partially solves the technical problems of insufficient real-time and effectiveness of personnel tracking and insufficient systematic and comprehensive personnel information management and interaction in current AR scenarios.

[0128] To make the objectives, features, and advantages of this invention more apparent and understandable, the technical solutions of the embodiments of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described below are only some embodiments of this invention, and not all embodiments. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0129] As an example, with the increasing prevalence of AR technology applications, people tracking and information management have become key requirements in AR applications. However, current people tracking technologies in AR scenarios still suffer from insufficient real-time performance, low tracking accuracy, and poor robustness in complex environments. Especially in multi-person collaborative or dynamic scenarios, most current people tracking methods rely on traditional computer vision algorithms or single sensor data, making it difficult to achieve high-precision, low-latency real-time tracking, thus limiting the user experience.

[0130] Meanwhile, personnel information management and interaction systems also face numerous challenges in AR scenarios. Current solutions lack a systematic approach, making seamless integration across platforms and devices difficult. Furthermore, personnel information interaction primarily relies on simple text or static images, lacking intuitive and efficient interaction methods and failing to meet users' needs for real-time dynamic information. These issues not only affect the effectiveness of AR technology in real-world scenarios but also limit its promotion and widespread adoption in more fields.

[0131] Therefore, there is an urgent need for a technical solution that can improve the real-time performance and accuracy of personnel tracking, while achieving systematic and comprehensive personnel information management and interaction, in order to solve the technical bottlenecks in current AR scenarios and promote the application and development of AR technology in a wider range of scenarios.

[0132] Therefore, one of the core inventive points of this invention is: addressing the shortcomings of current technology, and combining high-precision UWB real-time positioning technology, a personnel information management method based on an AR system is proposed. First, based on multi-dimensional considerations, tracking rules are set for different scenarios to track and monitor the location information of target personnel within the monitoring area in real time. This allows for faster and more effective targeted location tracking of target personnel, providing a foundation for subsequent real-time display of personnel information. Next, a coordinate transformation based on UWB origin alignment is performed on the location information to obtain real-time positioning coordinates in the AR terminal coordinate system. By utilizing the high-precision positioning of UWB, more accurate personnel location information can be obtained. Combining coordinate transformation to convert the location information in the UWB coordinate system into location information applicable to the AR system coordinate system improves positioning accuracy and real-time performance. Then, a UWB number is extracted from the location information, and the personnel information of the target personnel is queried based on the UWB number. Therefore, based on the unique UWB number, the display information corresponding to the target personnel can be accurately obtained, avoiding information errors. Next, based on the association between the target person and the person bound to the AR terminal, target display information is extracted from the personnel information. Based on the information display priority corresponding to the association, the target display information is displayed in real time on the real-time positioning coordinates of the AR terminal. Thus, when displaying information, by considering the association between the information viewer and the viewed person and the information display priority, and combining appropriate information interaction, information that needs to be focused on or that is more interesting to the information viewer, as well as information that is allowed to be viewed within the scope of permissions, can be displayed to the information viewer. This avoids cluttered and redundant information, improves the user experience, and also prevents the information viewer from viewing information that they do not currently have permission to view, thus maintaining information security.

[0133] Reference Figure 1 The diagram illustrates a flowchart of a personnel information management method based on an AR system provided by an embodiment of the present invention, which may specifically include the following steps:

[0134] Step 101: Track the location information of the target personnel in the monitoring area in real time, and perform coordinate transformation based on UWB origin alignment on the location information to obtain the real-time positioning coordinates in the AR terminal coordinate system.

[0135] In real-world scenarios, based on preset personnel tracking rules, mobile devices can obtain the real-time location information of the target personnel within the monitoring area via wireless network and corresponding backend interfaces. This information can then be displayed to the tracked personnel through the mobile device's personnel identification module in subsequent processes.

[0136] For example, let's take a laboratory as the monitoring area. In this scenario, the target personnel to be tracked could be students from within the university, enterprise users from outside the university, users from public institutions, research users, university leaders, management and technical personnel, equipment suppliers, or visitors, etc. Assuming the target personnel are students, the information displayed could include basic identity information, such as the student's name, student ID, and research group / unit; historical violation records, such as historical violation alerts; operation reservation information, such as a list of equipment reserved for the day, and, if multiple devices are reserved, the reservation area and time slot for each device; and dynamic tracking trajectory, such as the movement trajectory recorded after entering the laboratory (e.g., ...). Figure 2 (as shown) and heat map (as shown) Figure 3 (as shown in the image) etc.

[0137] In the specific implementation, the location information (location information) of the target personnel in the monitoring area can be received in real time through the WebSocket interface.

[0138] In this invention, the target personnel can refer to a specific type of personnel (either one or multiple types). For example, in a teaching scenario, it could refer to students; when external personnel visit, it could refer to external personnel, and so on. It can also refer to a specific individual. For instance, it could be necessary to locate a target person from among multiple individuals. During tracking, personnel can be located and tracked in real time based on characteristics, such as unique identification cards, QR codes, numbers, or a combination of colors.

[0139] In some embodiments, risk areas can be prioritized for tracking based on key monitoring areas. Within each scenario, high-risk, medium-risk, and low-risk areas can be defined based on risk level. Taking the NFF public micro / nano fabrication experimental platform as an example, high-risk areas can primarily include areas involving chemical use, areas involving specialty gas supply and valves, and areas involving pressure vessels. In this case, the AR system can prioritize tracking and viewing personnel in and around high-risk areas to enhance management.

[0140] In practical applications, risk areas can be marked not only with color or highlighting, but also with simple identification of personnel information within those areas. For example... Figure 4 As shown.

[0141] Let's take a laboratory as an example. Example 1: Suppose student A didn't book equipment involving chemical use, or supplier B didn't pre-apply for a chemical change, yet these individuals appear in the chemical use area (high-risk area). In this case, AR can be used to identify and track personnel within the chemical use area, quickly verifying their identities for immediate monitoring and preventing accidents or equipment damage. Example 2: Pressure vessel maintenance operations have high safety requirements (can be set as a high-risk area), generally requiring personnel with special equipment operation certificates; unauthorized personnel are prohibited from operating. In this case, AR can also be used to promptly identify and track personnel entering the area, prioritizing on-site monitoring.

[0142] In its specific implementation, the process of real-time tracking of the location information of target personnel within the monitoring area may include: obtaining the area division information of the monitoring area; dividing the monitoring area into a first-risk-level area (high-risk area, i.e., an area that requires priority attention), a second-risk-level area (medium-risk area, an area of ​​considerable concern), and a third-risk-level area (low-risk area, an area with relatively low risk, which generally does not require special attention) according to the pre-set priority tracking rules; and real-time tracking of target personnel within the first-risk-level area, or the second-risk-level area, and / or the third-risk-level area to obtain their location information.

[0143] Furthermore, according to preset priority tracking rules, target personnel in the first risk level area, or the second risk level area, and / or the third risk level area are tracked in real time to obtain location information, which may specifically include:

[0144] First, prioritize detecting whether there are any people in the area with the highest risk level, and then proceed with the next steps based on the detection results.

[0145] If a person is detected within the first risk level area, then the person detected within the first risk level area can be designated as the first target person, and the first target person can be tracked in real time to obtain the first location information.

[0146] If no personnel are detected in the first-risk-level area, then we can continue to detect whether there are personnel in the second-risk-level area, and take the next step based on the detection results.

[0147] If a person is detected in the area of ​​the second risk level, then the person detected in the area of ​​the second risk level can be regarded as the second target person, and the second target person can be tracked in real time to obtain the second location information.

[0148] If no personnel are detected in the second-risk area, then we can continue to detect whether there are personnel in the third-risk area and take the next step based on the detection results.

[0149] If a person is detected in the third-risk level area, then the person detected in the third-risk level area can be regarded as the third target person, and the third target person can be tracked in real time to obtain the third location information.

[0150] If no personnel are detected in the third-risk-level area, it means that there are no personnel in the current monitoring area and no tracking is required. In order to avoid unnecessary calculation costs, real-time tracking can be paused until new personnel are detected again in the first-risk-level area, or the second-risk-level area, and / or the third-risk-level area.

[0151] In one scenario, even if the system automatically selects individuals from the highest risk level region as the target for tracking based on the risk level assessment, individuals from other risk level regions can still be tracked independently based on actual tracking and information acquisition needs.

[0152] In the specific implementation, after real-time tracking of the first target person and obtaining the first location information, a first tracking prompt message can be generated on the AR terminal's display interface. Based on the selection operation of the person bound to the AR terminal in response to the first tracking prompt message, it is determined whether to continue real-time tracking of people in the second risk level area and / or, the third risk level area. That is, tracking can continue only of people in the second risk level area, only of people in the third risk level area, or simultaneously of people in both risk level areas. Alternatively, tracking can be stopped for people in neither risk level area.

[0153] In one scenario, even if the system automatically selects individuals from the second-risk-level area as the target for tracking based on the risk area classification, individuals from the third-risk-level area can still be selected for tracking based on actual tracking and information acquisition needs.

[0154] In the specific implementation, after real-time tracking of the second target person and obtaining the second location information, a second tracking prompt message can be generated on the display interface of the AR terminal; based on the selection operation of the person bound to the AR terminal in response to the second tracking prompt message, it is determined whether to continue real-time tracking of the person in the third risk level area.

[0155] In some embodiments, personnel can be categorized by type to prioritize viewing each type of personnel. There are numerous personnel types within each scenario. Taking the NFF Public Micro / Nano Fabrication Experimental Platform as an example, personnel can be categorized as follows: NFF instructors, NFF field engineers, student users, enterprise users, VIP users, original equipment manufacturer (OEM) engineers, third-party external engineers, confidential-level visitors, non-confidential-level visitors, school inspectors, etc.

[0156] For ease of management, all personnel whose information has been entered within the monitoring area are classified into four categories according to their management authority, from highest to lowest: Type 1, Type 2, Type 3, and Type 4.

[0157] The first personnel type is administrators. Administrators have the highest privileges and can view all personnel information. Examples include laboratory administrators and NFF (Non-Frequency Foreman) teachers (it's understandable that when the monitoring area is large, there may be more than one administrator responsible for the area). For personnel of the first personnel type, all other personnel types can be considered as those they manage. Personnel of the first personnel type can directly view the information of other personnel types.

[0158] The second personnel type is the service provider. Service providers have management authority subordinate to managers and can assist managers in performing certain management tasks. Examples include NFF field engineers and management technicians. For personnel of the second personnel type, personnel of the third and fourth personnel types can be considered as managed by them. Personnel of the second personnel type can directly view the information of personnel of the third and fourth personnel types, but cannot directly view the information of personnel of the first personnel type.

[0159] The third personnel type is the user. In the laboratory scenario, user types can further include enterprise users, public institution users, research users, university users, etc. These users have certain information viewing permissions. For personnel of the third personnel type, personnel of the fourth personnel type can be considered as those managed by them. Personnel of the third personnel type can directly view the information of personnel of the fourth personnel type, but cannot directly view the information of personnel of the first and second personnel types.

[0160] The fourth personnel type is the supplier. Among all personnel types, suppliers have the lowest permissions; they can generally only view information and cannot view it from higher levels. However, it is understandable that in some special circumstances, upward viewing of information can be achieved through information viewing requests, authorized viewing, and other methods.

[0161] It should be noted that while the person associated with the AR terminal can track and locate all people within the area, whether they can view or display information depends on the person's type. For example, a person of type three can track a person of type one, but cannot directly view the information of the person of type one. It is understandable that person tracking and location is not equivalent to information viewing and display.

[0162] In one example, suppose the person associated with the AR terminal is a manager who wants to know which visitors are present, along with their identities and affiliations. Assume lower-level visitors should not be present in the secure space. In this case, the person associated with the AR terminal can choose to view only the visitors listed and not other personnel.

[0163] In another example, suppose the person associated with the AR terminal acts as a service provider and wants to see which VIP users are currently using the device in order to better serve them. In this case, they can choose to track only the VIP user types and display the relevant information for these VIP users.

[0164] In another example, suppose a third-party external engineer should not be present in a certain scenario. In this case, we would also choose to track these personnel so that they can be identified in a timely manner.

[0165] When personnel are at the same level, for information confidentiality reasons, it is necessary to further determine whether the viewer and the viewed personnel belong to the same management unit or affiliated unit. For example, when both the viewer and the viewed personnel are users, it is necessary to further determine whether they are both employees of Company A or members of a specific user research group within the university. If both are employees of Company A, then the hierarchical relationships of superiors, peers, and subordinates within the company should be further considered, and information extraction and display settings should be based on these hierarchical relationships.

[0166] For example, for personnel belonging to the same affiliated unit, the personnel hierarchy may differ in each scenario. For instance, based on the personnel hierarchy between these personnel and the personnel bound to the AR terminal, these personnel can be further divided into superiors (the tracked personnel are the superiors of the personnel bound to the AR terminal, such as supervisors), peers (the tracked personnel are at the same level as the personnel bound to the AR terminal, such as colleagues), and subordinates (the tracked personnel are the subordinates of the personnel bound to the AR terminal, such as subordinates).

[0167] In one example, when tracking personnel and viewing information, each level of personnel can only view detailed information about lower-level personnel and basic information about peers. Alternatively, subordinates cannot view detailed information about superiors, but can only view information about peers or basic identification information about superiors. For flexibility, if a subordinate truly needs to view detailed information about a superior, they can do so by sending a request.

[0168] In a specific implementation, real-time tracking of the location information of target personnel within the monitoring area may include: obtaining personnel type information of all personnel within the monitoring area; based on the personnel type information, classifying all personnel within the monitoring area into at least one tracking personnel type, and generating a first tracking selection button corresponding to each tracking personnel type on the AR terminal; based on the selection operation of the first tracking selection button, determining the target tracking personnel type from each tracking personnel type, taking the personnel corresponding to the target tracking personnel type as the fourth target personnel, and performing real-time tracking on the fourth target personnel to obtain the fourth location information.

[0169] Based on the preceding discussion, the fourth target personnel can include at least one person to be tracked. After real-time tracking of the fourth target personnel, a further selection operation can be performed to choose a specific person from these to be tracked (e.g., someone you want to pay special attention to) for tracking.

[0170] In the specific implementation, after real-time tracking of the fourth target person, a tracking selection sub-button can be generated for each person to be tracked on the AR terminal; based on the selection operation of the tracking selection sub-button, the target person to be tracked is determined from each person to be tracked, real-time tracking of the target person to be tracked continues, and tracking of the other people to be tracked in the fourth target person is paused.

[0171] In some embodiments, individuals requiring special attention can be prioritized for tracking.

[0172] In one example, still using the NFF scenario, NFF assigns a skill score to each user. If a violation or other point deduction occurs, skill points will be deducted. In this case, you can choose to prioritize viewing or tracking the user with the lowest skill score among all users, or those whose skill scores fall within a certain range (e.g., 60-70 points). Alternatively, you can select the user with the highest number of violations, or those with more than 3 violations.

[0173] In another example, suppose a supplier frequently makes mistakes or slacks off, resulting in a low skill score and numerous violations. In this case, they can be given extra priority attention. In another scenario, during the initial management phase, suppose user A has a violation record in a certain area. Even if the number of violations is low or the skill score is high, when user A reappears in that area, a notification or reminder message will automatically pop up or be sent to the administrator to increase attention to that user.

[0174] In a specific implementation, real-time tracking of the location information of target personnel within the monitoring area may include: obtaining skill score information of all personnel within the monitoring area; determining the fifth target personnel from all personnel within the monitoring area based on the skill score information, and tracking the fifth target personnel in real time to obtain the fifth location information.

[0175] Furthermore, based on skill score information, the fifth target person is determined from all personnel within the monitoring area. Specifically, this may include: selecting the person with the lowest skill score from all personnel within the monitoring area as the fifth target person; or, selecting the person whose skill score falls within a preset range from all personnel within the monitoring area as the fifth target person.

[0176] In a specific implementation, real-time tracking of the location information of target personnel within the monitoring area may also include: obtaining information on the number of violations by all personnel within the monitoring area; based on the number of violations, identifying the sixth target personnel from all personnel within the monitoring area, and tracking the sixth target personnel in real time to obtain the sixth location information.

[0177] Furthermore, based on the number of violations, a sixth target person is determined from all personnel within the monitoring area. Specifically, this may include: selecting the person with the highest number of violations from all personnel within the monitoring area as the sixth target person; or, selecting the person whose number of violations falls within a preset range from all personnel within the monitoring area as the sixth target person.

[0178] Therefore, during personnel tracking, priority and classification methods can be used to achieve focused tracking, high-priority tracking, and real-time tracking (millisecond-level location information updates, etc.). Tracking other personnel not displayed can tolerate a certain delay, be displayed in different colors, or not displayed at all, to avoid information overload that would prevent the personnel bound to the AR terminal from quickly and effectively viewing relevant information through personnel tracking. Furthermore, during the tracking process, alarm messages can be generated for violations to alert violators or NFF administrators, achieving interactive purposes.

[0179] Once the location information of the target personnel within the monitoring area is obtained through real-time tracking, the location information can be transformed into coordinates based on UWB origin alignment to obtain the real-time positioning coordinates in the AR terminal coordinate system.

[0180] Because AR terminals and UWB (Ultra-Wide Band) positioning systems use different maps, their map origins are inconsistent, and their coordinate systems are different. Therefore, if you want to use the coordinates provided by the UWB positioning system in the AR system, you should first ensure that the map origin (0, 0, 0) is the same.

[0181] The implementation scheme provided by this invention is as follows: a new coordinate system is created in the AR system, and the coordinate system (0, 0, 0) point is aligned with the origin of the UWB map to solve the problem of inconsistent coordinate origins.

[0182] Unity uses a left-handed coordinate system, so to use UWB coordinates, the X-axis of the new coordinate system should be rotated 90°. In Unity, the default unit is a meter; therefore, assuming UWB coordinates use centimeters, unit conversion should be performed before applying it to the newly created coordinate system in AR. In the AR system, based on the personnel coordinates obtained from the interface, a 3D UI is instantiated to display the personnel's name; clicking on it expands to view detailed information.

[0183] Specifically, in the AreaTarget model of Unity, find the coordinates that are the same as the origin of the UWB map, create a new empty object, rotate it 90° on the X-axis so that the Z-axis is upward, such as... Figure 5 As shown.

[0184] After receiving the location information of the person, instantiate a 3D UI at the target location and use it as a child object of the newly created empty object. This process only uses the X / Z axes of the local coordinate system. The Y-axis is the height, which can be set to a default value. Figure 6 As shown.

[0185] Once the personnel recognition function is enabled, the location coordinates (including UWB numbers) of the staff present are received via the WebSocket interface. After the coordinate system is transformed and aligned with the map, the interface coordinates can be directly assigned and then displayed on the AR terminal.

[0186] Step 102: Extract the UWB number from the location information, and query the personnel information of the target person based on the UWB number;

[0187] Based on the preceding discussion, the location information of personnel present, received in real time via the WebSocket interface, includes their UWB IDs. Personnel information can then be queried via HTTP requests based on these UWB IDs.

[0188] The UWB used in this embodiment of the invention is not just simple positioning, but multimodal positioning. It can be applied to metallic spaces, while many existing positioning systems on the market cannot perform positioning in spaces containing a large amount of metal.

[0189] Step 103: Based on the association between the target person and the person bound to the AR terminal, extract the target display information from the person information;

[0190] During personnel movement, relevant information is displayed for individuals scanned in real-time by AR. This involves dynamic display and adjustment of acquired information. The displayed information mainly includes basic identity information (primarily for understanding the person's identity), operation and appointment information (what they booked for a specific time period and their location), dynamic tracking trajectory (for monitoring their movements), and historical violation records (for focused monitoring). In practical applications, not all of this information needs to be displayed. The information display priority can be preset based on personnel identity, or the information can be selectively displayed according to actual needs to avoid excessive information clutter.

[0191] To better display the information that the people bound to the AR terminal want or need to see, or the information that is considered more suitable to be displayed to them, based on the preceding content, information can be displayed to different people according to priority and relationship.

[0192] In specific implementation, based on the association between the target person and the person bound to the AR terminal, the target display information is extracted from the personnel information. This may include: obtaining the personnel type information of the person bound to the AR terminal and determining the viewing personnel type of the person bound to the AR terminal; extracting the personnel type information of the target person from the personnel information and determining the viewing personnel type of the target person; comparing the viewing personnel type with the viewing personnel type to determine the association result between the target person and the person bound to the AR terminal; and extracting the target display information from the personnel information based on the association result.

[0193] Based on the preceding discussion, all personnel whose information has been entered within the monitoring area are categorized into four personnel types according to their management authority, from highest to lowest: Type 1, Type 2, Type 3, and Type 4. The association between the target personnel and the personnel bound to the AR terminal is determined by comparing the type of the person being viewed with the type of the person viewing the information. Specifically, this can include: first, comparing the type of the person being viewed with the type of the person viewing the information; based on the comparison results, one of the following three association scenarios can be derived:

[0194] In the first scenario, if the type of the person being viewed matches the type of the person viewing, then the target person and the person bound to the AR terminal are at the same level.

[0195] In the second scenario, if the viewing personnel type is the first personnel type and the viewed personnel type is any one of the second, third, or fourth personnel types, or if the viewing personnel type is the second personnel type and the viewed personnel type is one of the third or fourth personnel types, or if the viewing personnel type is the third personnel type and the viewed personnel type is the fourth personnel type, then the personnel bound to the AR terminal and the target personnel have a management and managed relationship.

[0196] In the third scenario, if the viewed person is of type 1 and the viewed person is of type 2, 3, or 4, or if the viewed person is of type 2 and the viewed person is of type 3 or 4, or if the viewed person is of type 3 and the viewed person is of type 4, then the target person and the person bound to the AR terminal have a management and managed relationship.

[0197] For the first scenario, based on the association results, target display information is extracted from personnel information. Specifically, this may include: if the target personnel and the personnel bound to the AR terminal are at the same level, then it is determined whether the target personnel and the personnel bound to the AR terminal belong to the same affiliated unit; if the target personnel and the personnel bound to the AR terminal belong to the same affiliated unit, then it is determined whether the personnel level relationship between the target personnel and the personnel bound to the AR terminal is determined, and based on the personnel level relationship determination result, target display information is extracted from personnel information.

[0198] For example, when the target person and the person bound to the AR terminal are in the same unit, the priority corresponding to the personnel hierarchy can be divided into superior (the target person manages the person bound to the AR terminal, and the target person is the superior of the person bound to the AR terminal), peer (the target person and the person bound to the AR terminal are at the same level, have a project cooperation, or are colleagues, etc.), and subordinate (the target person is managed by the person bound to the AR terminal, and the target person is the subordinate of the person bound to the AR terminal).

[0199] For example, if the target person is the instructor or a teacher at the school whom the AR terminal is bound to (in this case, the target person can be regarded as a superior), the information displayed for this teacher only needs to show "Teacher xx" or some other simple basic information with the consent of the person concerned, without displaying dynamic information, violation information, etc.

[0200] For subordinates who need to be managed by the personnel bound to the AR terminal or whose projects or experiments are related to those personnel, such as assistants, students, or beginners, more relevant information needs to be displayed. For example, project information, access equipment information, etc.; or, for personnel (at the same level) who have made appointments today and need to cooperate with the personnel bound to the AR terminal to complete specific equipment maintenance within a restricted scope, information such as the reserved equipment, preset time slot, and restricted access scope can be displayed.

[0201] Based on the preceding discussion, the personnel hierarchy proposed in this embodiment of the invention refers to the target personnel being either the superior of the person bound to the AR terminal, or the peer of the person bound to the AR terminal, or the subordinate of the person bound to the AR terminal. Personnel information mainly includes basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records.

[0202] In some embodiments, target display information is extracted from personnel information based on the personnel hierarchy determination result. Specifically, this may include: when the target personnel is the superior of the personnel bound to the AR terminal, basic identity information is extracted from the personnel information and used as target display information; when the target personnel is the same level or subordinate of the personnel bound to the AR terminal, basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records are extracted from the personnel information and used as target display information.

[0203] When the target person and the person bound to the AR terminal are not in the same unit, for information security reasons, a message indicating that the AR terminal does not have permission to view the target person's information is sent to the AR terminal.

[0204] In the second scenario, based on the association results, target display information is extracted from the personnel information. Specifically, if the person bound to the AR terminal and the target person have a management and being managed relationship, then basic identity information, operation appointment information, dynamic tracking trajectory and historical violation records are extracted from the personnel information as target display information.

[0205] In the third scenario, if the target person and the person bound to the AR terminal have a management and managed relationship, a message indicating that the target person does not have permission to view the information will be sent to the AR terminal to remind the person bound to the AR terminal that they do not currently have permission to view the target person's information.

[0206] In scenarios where access to information is restricted, if neither the target person nor the person bound to the AR terminal is a manager of the monitored area, the person bound to the AR terminal, upon receiving a permission restriction message on their AR terminal, can send a viewing request to either the manager's or the target person's AR terminal. If the person bound to the AR terminal receives a permission request via either the manager's or the target person's AR terminal, the AR terminal system extracts and displays the target person's information in real time. Otherwise, the request fails, the information cannot be obtained, and it is not displayed.

[0207] Based on the association between the target user and the user bound to the AR terminal, the information displayed at the target user's location can be further filtered. This allows the AR terminal's bound user to see information they need more, avoiding information redundancy. Simultaneously, it prevents the AR terminal's bound user from directly seeing information they do not have permission to access or are unable to view, improving the effectiveness, flexibility, and selectivity of information display.

[0208] Step 104: Based on the information display priority corresponding to the association relationship, display the target display information in real time on the real-time positioning coordinates of the AR terminal.

[0209] Finally, based on the information display priority corresponding to the relationship between the target person and the person bound to the AR terminal, the target display information can be displayed in real time on the real-time positioning coordinates of the AR terminal.

[0210] In some embodiments, when the viewer and the viewed person are at the same level and belong to the same unit, the target display information is displayed in real time on the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship. This may include:

[0211] When the target person is the superior of the person bound to the AR terminal, the target person's basic identity information is displayed directly on the AR terminal's real-time positioning coordinates.

[0212] When the target person is at the same level as the person bound to the AR terminal, the display priority of the target information is based on the following order: basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records. These information are then displayed on the real-time positioning coordinates of the AR terminal.

[0213] When the target person is a subordinate of the person bound to the AR terminal, the display priority of the target information is based on the order of displaying basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and they are displayed on the real-time positioning coordinates of the AR terminal in sequence.

[0214] In some embodiments, still targeting situations where the viewer and the viewed person are at the same level and belong to the same unit, the target display information is displayed in real time on the AR terminal's real-time positioning coordinates based on the information display priority corresponding to the association relationship. This may include:

[0215] When the target person is the superior of the person bound to the AR terminal, the target person's basic identity information is displayed directly on the AR terminal's real-time positioning coordinates.

[0216] When the target person is at the same level or a subordinate of the person bound to the AR terminal, the AR terminal's display interface generates display selection buttons for basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records. The order in which the display selection buttons for at least one target are selected is used as the information display priority, and the information corresponding to at least one target display selection button is displayed on the AR terminal's real-time positioning coordinates in sequence.

[0217] For example, a diagram illustrating the display of personnel information via an AR system is shown below. Figure 7 As shown.

[0218] In some embodiments, when the target person is a peer or subordinate of the person bound to the AR terminal, the system can also determine at least one reservation area of ​​the target person within the monitoring area and the reservation time period corresponding to each reservation area based on the operation reservation information; monitor the target reservation area corresponding to the current location of the target person in real time based on the dynamic tracking trajectory, and determine whether the current time is within the reservation time period corresponding to the target reservation area; if not, adjust the display style of the current information of the target person; if so, keep the display style of the information unchanged.

[0219] For example, in a laboratory scenario, suppose the supplier of machines A and C comes to the laboratory for maintenance today. For machine A, the supplier's operating authority and activity range are within machine A and machine B (reservation area 1), with the operation time scheduled from 9:00 AM to 10:00 AM (reservation time slot 1). For machine C, the supplier's operating authority and activity range are within machine C and machine D (reservation area 2), with the operation time scheduled from 10:00 AM to 11:00 AM (reservation time slot 2). Based on the dynamic tracking trajectory, the target personnel's current target location and corresponding target reservation area are monitored in real time. Assuming the current time is 10:02 AM, or the AR terminal only starts tracking the supplier around 10:15 AM, the supplier is still in reservation area 1, exceeding the reservation time slot of 9:00 AM to 10:00 AM. At this time, the display style of the supplier's current information can be adjusted, such as by darkening the color or changing it to other more eye-catching colors such as yellow or red, to attract the attention of surrounding personnel or those currently using AR terminals to view the laboratory situation.

[0220] Alternatively, if the supplier is neither in reservation area 1 nor reservation area 2 at the current time, and the trajectory or AR terminal shows that the supplier is outside the reservation range corresponding to reservation area 1 and reservation area 2 for a preset time (such as 10 minutes), an alarm can be immediately triggered to notify the laboratory personnel or managers to handle the situation.

[0221] For example, a particular student or group of students might be required to appear in multiple areas according to their appointment information (arranged in different areas based on different time slots, e.g., time slot 1 should be in area A, time slot 2 in area B, and time slot 3 in area C). However, if a student is detected spending too much time in area A, exceeding the preset time slot, and not appearing in areas B or C, it indicates that the student may have encountered an emergency, such as encountering a problem they cannot solve, or having difficulty understanding something during instruction, resulting in wasted time. In this case, the student's information display style can be changed so that nearby patrolling managers or instructors can see it and promptly check on them to assist in resolving the issue, thereby strengthening the management and interaction within the area. Alternatively, if no managers or instructors are present in the current area, or have not yet noticed, a reminder can be sent via push notification after a waiting period.

[0222] Furthermore, after adjusting the display style of the target person's current information, it is also possible to obtain the target person's first-class and second-class related persons and start timing immediately.

[0223] When the timeout exceeds the first preset timeout threshold (e.g., 10 minutes), a timeout notification is sent to the AR terminal held by the target person, and an assistance notification is sent to the AR terminal held by the first type of associated person, and the timeout is restarted.

[0224] When the re-timing duration exceeds the second preset duration threshold (e.g., 5 minutes), and no other personnel are detected approaching the target person, an assistance prompt message is sent to the AR terminal held by the second type of associated personnel.

[0225] If the re-timing duration does not exceed the second preset duration threshold, and if it is detected that other people are approaching the target person, or the target person actively leaves the target appointment area, the display style of the information will be switched back to the original display style, and the push of assistance prompts will be stopped.

[0226] The first category of related personnel can be the target individual's direct superiors. For example, for a student, their first-category related personnel could be their advisor. Similarly, for a workshop worker, their first-category related personnel could be their supervisor or team leader. The second category of related personnel can be the managers of the monitoring area or the person in charge of the equipment corresponding to the reserved area. For example, the laboratory manager, or the person in charge of equipment A corresponding to the reserved area, etc.

[0227] For example, in a laboratory setting, if a student stays in area A beyond their scheduled time, the display style of the student's information is first changed (e.g., the background color is changed from transparent to a red background with 50% transparency). The student's associated personnel are identified, namely the instructor and the person in charge of area A or the laboratory administrator, and a timer is started. If no one is detected approaching the student after 10 minutes (i.e., no one comes to assist), an overdue reminder is automatically sent to the student, and an assistance prompt is sent to the associated personnel. The recipients of these messages can also be prioritized. For example, the instructor may be prioritized over the administrator. Specifically, an assistance prompt is first sent to the instructor's AR terminal. If the instructor handles the situation within 5 minutes, or another person assists, or the student leaves area A, no further messages are sent to the administrator to avoid inconveniencing others, and the display style is switched back to its original state, deactivating the risk warning. If no one assists after 5 minutes, an assistance prompt is then sent to the administrator.

[0228] Furthermore, if the administrator fails to respond within 5 minutes of receiving the alert, they can send an assistance alert to people in the nearby area. These people can then notify the administrator or instructor, or, if they are able to handle the situation themselves, assist in preventing an accident from occurring.

[0229] When the person bound to the AR terminal and the target person have a management and managed relationship, the target information is displayed in real time on the AR terminal's real-time location coordinates based on the information display priority corresponding to the association relationship. Specifically, this can include: displaying the target information in the order of basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records, and displaying it sequentially on the AR terminal's real-time location coordinates; or, displaying the target information in the order of basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and displaying it sequentially on the AR terminal's real-time location coordinates; or, generating display selection buttons for basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records on the AR terminal's display interface, and using the selection order of at least one target display selection button as the information display priority, displaying the information corresponding to at least one target display selection button sequentially on the AR terminal's real-time location coordinates.

[0230] In real-world scenarios, when people are very close, location errors can easily occur when displaying information. For example, if person A and person B are very close, perhaps only a few centimeters apart, person A's information might be displayed at person B's location. To avoid this error, identity verification can be enabled when the two are very close to confirm whether person A is the person being located. If the verification passes, the person is confirmed as the target and their information can be displayed. When the distance is greater, identity verification can be omitted to reduce computational load.

[0231] Alternatively, if person A moves while person B approaches person A, resulting in a very close distance, person A's information might be displayed at person B's location. In this case, identity verification can be enabled to confirm that the currently displayed information is indeed from person A.

[0232] In the specific implementation, during the movement of the target person, people within a preset radius of the target person are identified as neighboring people; the identity of the target person and neighboring people are verified separately to verify whether the person currently displaying the target information is the target person.

[0233] Considering the latency error of real-time tracking, this embodiment of the invention introduces trajectory prediction to assist in the tracking and display of personnel information to further enhance real-time performance. Specifically, by combining the person's current body turning, head movements, and other body movements, the possible path the person might take next is predicted. Information about the person is pre-generated on the predicted trajectory (which can be the path with the highest prediction probability or multiple paths sorted by prediction probability). This information can be generated in the background and not displayed immediately. When the person's actual walking path matches the predicted path, the generated information is directly pushed and displayed to reduce latency. When the actual walking path does not match the predicted path, information can still be generated at the corresponding location in real time. Compared to displaying information when the paths match, there may be a slight latency error in this case, but overall, it improves the real-time performance of the information display.

[0234] In the specific implementation, during the movement of the target person, the current posture information of the target person is captured in real time based on posture recognition; the current posture information is analyzed for behavior, and the trajectory of the target person is predicted by combining path recognition to obtain the predicted travel path; pre-push information for target display is generated on the predicted travel path; when the actual travel path of the target person is consistent with the predicted travel path, the pre-push information is directly displayed in real time along the actual travel path; when the actual travel path of the target person is inconsistent with the predicted travel path, the target display information is regenerated along the actual travel path and displayed in real time.

[0235] Regarding the information displayed on the information interface, combined with Figure 7 Users can click on the trajectory link to view the trajectory information of all personnel in the current area. To view the trajectory information of a specific person, users can enter their name. When displaying a single person's information, the system shows the trajectory information retrieved from the backend, with the dwell time shown on the trajectory (which can be determined based on the activity area and specific devices) displayed on the trajectory using specific icons (e.g., circles of different sizes). Simultaneously, the system retrieves the preset trajectory and trajectory time allocation determined based on the experiments and projects the person participated in. If the time exceeds the allocation threshold, the display format of the specific icons is adjusted (e.g., changing color) so that relevant personnel on patrol can understand the situation and intervene promptly.

[0236] Therefore, from a global perspective, it provides a general understanding of the current activities of people in the area. From a local perspective, it allows for the rapid location of a specific individual, enabling quick understanding of that person's movements.

[0237] This invention proposes a personnel information management method based on an AR system. First, considering multiple dimensions, tracking rules are set for different scenarios to track and monitor the location information of target personnel within a monitoring area in real time. This allows for faster and more effective targeted location tracking, laying the foundation for subsequent real-time display of personnel information. Next, a coordinate transformation based on UWB origin alignment is performed on the location information to obtain real-time positioning coordinates in the AR terminal coordinate system. Utilizing the high-precision positioning of UWB allows for more accurate personnel location information. Combining coordinate transformation converts the location information in the UWB coordinate system to the equally applicable positioning information in the AR system coordinate system, improving positioning accuracy and real-time performance. Then, a UWB ID is extracted from the location information, and the personnel information of the target personnel is queried based on the UWB ID. Therefore, based on the unique UWB ID, the display information corresponding to the target personnel can be accurately obtained, avoiding information errors. Next, based on the association between the target person and the person bound to the AR terminal, target display information is extracted from the personnel information. Based on the information display priority corresponding to the association, the target display information is displayed in real time on the AR terminal's real-time positioning coordinates. Thus, when displaying information, by considering the association between the information viewer and the viewed person and the information display priority, and combining appropriate information interaction, information that needs to be focused on or that is more interesting to the information viewer, as well as information that is allowed to be viewed within their permissions, can be displayed to the information viewer. This avoids cluttered and redundant information, improves the user experience, and also prevents the information viewer from viewing information that they do not currently have permission to view, thus maintaining information security.

[0238] By adopting the technical solution provided by this invention, it is possible not only to achieve better real-time and effective tracking and positioning of people in a certain area, but also to optimize the information display and interaction methods of the tracked and positioned personnel, and to conduct more systematic and comprehensive management of the personnel and their information in the area.

[0239] Reference Figure 8 The diagram illustrates a structural block diagram of a personnel information management device based on an AR system provided by an embodiment of the present invention, which may specifically include:

[0240] The real-time tracking unit 801 is used to track the location information of target personnel within the monitoring area in real time, and to perform coordinate transformation based on UWB origin alignment on the location information to obtain real-time positioning coordinates in the AR terminal coordinate system.

[0241] Personnel information query unit 802 is used to extract the UWB number from the location information and query the personnel information of the target personnel based on the UWB number;

[0242] The target display information extraction unit 803 is used to extract target display information from the personnel information based on the association between the target personnel and the personnel bound to the AR terminal.

[0243] The information display unit 804 is used to display the target display information in real time on the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship.

[0244] In one embodiment, the real-time tracking unit 801 includes:

[0245] A region division information acquisition unit is used to acquire region division information of the monitoring area;

[0246] The risk level area division unit is used to divide the monitoring area into a first risk level area, a second risk level area, and a third risk level area in descending order of risk level according to the area division information.

[0247] The risk level area tracking unit is used to track target personnel in real time within the first risk level area, or the second risk level area, and / or the third risk level area according to preset priority tracking rules, and obtain location information.

[0248] In one embodiment, the risk level area tracking unit includes:

[0249] The first-risk-level area personnel detection unit is used to prioritize the detection of whether there are personnel in the first-risk-level area;

[0250] The first location information acquisition unit is used to, when a person is detected in the first risk level area, take the person detected in the first risk level area as the first target person, and track the first target person in real time to obtain the first location information.

[0251] The second risk level area personnel detection unit is used to continue detecting whether there are personnel in the second risk level area when no personnel are detected in the first risk level area.

[0252] The second location information acquisition unit is used to, when a person is detected in the second risk level area, identify the person detected in the second risk level area as the second target person, and track the second target person in real time to obtain the second location information;

[0253] The third-risk-level area personnel detection unit is used to continue detecting whether there are personnel in the third-risk-level area when no personnel are detected in the second-risk-level area.

[0254] The third location information acquisition unit is used to, when a person is detected in the third risk level area, identify the person detected in the third risk level area as the third target person, and track the third target person in real time to obtain the third location information;

[0255] The pause tracking unit is used to pause real-time tracking when no personnel are detected in the third risk level area, until new personnel are detected again in the first risk level area, or, the second risk level area, and / or, the third risk level area.

[0256] In one embodiment, the device further includes:

[0257] The first tracking prompt information generation unit is used to generate first tracking prompt information on the display interface of the AR terminal;

[0258] The first continuing tracking unit is used to determine whether to continue real-time tracking of personnel in the second risk level area and / or the third risk level area based on the selection operation of the personnel bound to the AR terminal in response to the first tracking prompt information.

[0259] In one embodiment, the device further includes:

[0260] The second tracking prompt information generation unit is used to generate second tracking prompt information on the display interface of the AR terminal;

[0261] The second continued tracking unit is used to determine whether to continue real-time tracking of personnel within the third risk level area based on the selection operation of the person bound to the AR terminal in response to the second tracking prompt information.

[0262] In one embodiment, the real-time tracking unit 801 includes:

[0263] Personnel type information acquisition unit, used to acquire personnel type information of all personnel within the monitoring area;

[0264] The tracking personnel type classification unit is used to classify all personnel in the monitoring area into at least one tracking personnel type based on the personnel type information, and generate a first tracking selection button corresponding to each tracking personnel type on the AR terminal;

[0265] The fourth location information acquisition unit is used to determine the target tracking personnel type from each of the tracking personnel types based on the selection operation of the first tracking selection button, take the personnel corresponding to the target tracking personnel type as the fourth target personnel, and track the fourth target personnel in real time to obtain the fourth location information.

[0266] In one embodiment, the fourth target person includes at least one person to be tracked; the fourth location information acquisition unit includes:

[0267] A tracking selection sub-button generation unit is used to generate tracking selection sub-buttons corresponding to each of the tracked persons on the AR terminal.

[0268] The target tracking personnel determination unit is used to determine the target tracking personnel from among the various personnel to be tracked based on the selection operation of the tracking selection sub-button, continue to track the target tracking personnel in real time, and pause the tracking of the personnel to be tracked other than the target tracking personnel among the fourth target personnel.

[0269] In one embodiment, the real-time tracking unit 801 includes:

[0270] The skill score information acquisition unit is used to acquire the skill score information of all personnel within the monitoring area;

[0271] The fifth location information acquisition unit is used to determine the fifth target person from all people in the monitoring area based on the skill score information, and to track the fifth target person in real time to obtain the fifth location information.

[0272] In one embodiment, the fifth location information acquisition unit is specifically used for:

[0273] Based on the skill score information, the person with the lowest skill score among all personnel in the monitoring area is selected as the fifth target person; or, based on the skill score information, the person whose skill score falls within a preset score range among all personnel in the monitoring area is selected as the fifth target person.

[0274] In one embodiment, the real-time tracking unit 801 includes:

[0275] The violation count information acquisition unit is used to acquire violation count information of all personnel within the monitoring area;

[0276] The sixth location information acquisition unit is used to determine the sixth target person from all people in the monitoring area based on the violation count information, and to track the sixth target person in real time to obtain the sixth location information.

[0277] In one embodiment, the sixth location information acquisition unit is specifically used for:

[0278] Based on the violation count information, the person with the highest number of violations is selected from all personnel in the monitoring area as the sixth target person; or, based on the violation count information, the person whose number of violations falls within a preset range is selected from all personnel in the monitoring area as the sixth target person.

[0279] In one embodiment, the target display information extraction unit 803 includes:

[0280] The personnel type determination unit is used to obtain personnel type information of the personnel bound to the AR terminal and determine the viewing personnel type of the personnel bound to the AR terminal.

[0281] The viewed person type determination unit is used to extract the person type information of the target person from the person information and determine the viewed person type of the target person;

[0282] The personnel type comparison unit is used to compare the type of the viewed personnel with the type of the viewing personnel to determine the association result between the target personnel and the personnel bound to the AR terminal;

[0283] The target display information extraction subunit is used to extract target display information from the personnel information based on the association results.

[0284] In one embodiment, the personnel types of all personnel whose information has been entered within the monitoring area are classified into a first personnel type, a second personnel type, a third personnel type, and a fourth personnel type according to their management authority from highest to lowest; the personnel type comparison unit is specifically used for:

[0285] Compare the type of the person being viewed with the type of the person viewing the data;

[0286] If the type of the person being viewed is the same as the type of the person being viewed, then the target person and the person bound to the AR terminal are at the same level.

[0287] If the viewing personnel type is a first personnel type and the viewed personnel type is any one of a second, third, or fourth personnel type; or, the viewing personnel type is a second personnel type and the viewed personnel type is one of a third or fourth personnel type; or, the viewing personnel type is a third personnel type and the viewed personnel type is a fourth personnel type, then the personnel bound to the AR terminal and the target personnel have a management and managed relationship.

[0288] If the viewed person type is a first person type and the viewed person type is any one of a second, third, or fourth person type; or, the viewed person type is a second person type and the viewed person type is one of a third or fourth person type; or, the viewed person type is a third person type and the viewed person type is a fourth person type, then the target person and the person bound to the AR terminal have a management and managed relationship.

[0289] In one embodiment, the target display information extraction subunit is specifically used for:

[0290] If the target person and the person bound to the AR terminal are at the same level, then determine whether the target person and the person bound to the AR terminal belong to the same unit.

[0291] If the target person and the person bound to the AR terminal belong to the same unit, then the personnel level relationship between the target person and the person bound to the AR terminal is determined, and the target display information is extracted from the personnel information based on the personnel level relationship determination result.

[0292] In one embodiment, the personnel hierarchy is such that the target personnel is a superior of the personnel bound to the AR terminal, or a peer of the personnel bound to the AR terminal, or a subordinate of the personnel bound to the AR terminal; the personnel information includes basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records; the target display information extraction subunit is specifically used for:

[0293] When the target person is the superior of the person bound to the AR terminal, basic identity information is extracted from the person information and used as the target display information;

[0294] When the target person is at the same level as or below the person bound to the AR terminal, basic identity information, operation appointment information, dynamic tracking trajectory and historical violation records are extracted from the person information and used as target display information.

[0295] In one embodiment, the information display unit 804 is specifically used for:

[0296] When the target person is the superior of the person bound to the AR terminal, the basic identity information of the target person is directly displayed on the real-time positioning coordinates of the AR terminal.

[0297] When the target person is at the same level as the person bound to the AR terminal, the display priority of the target information is based on the display order of basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0298] When the target person is a subordinate of the person bound to the AR terminal, the display priority of the target information is based on the display order of basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0299] In one embodiment, the information display unit 804 is further specifically used for:

[0300] When the target person is the superior of the person bound to the AR terminal, the basic identity information of the target person is directly displayed on the real-time positioning coordinates of the AR terminal.

[0301] When the target person is at the same level as or below the person bound to the AR terminal, the display interface of the AR terminal generates display selection buttons for the basic identity information, the operation appointment information, the dynamic tracking trajectory, and the historical violation records.

[0302] The information display priority is determined by the order in which the selection buttons for at least one target are selected, and the information corresponding to the at least one target selection button is displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0303] In one embodiment, the device further includes:

[0304] The appointment information determination unit is used to determine, based on the operation appointment information, at least one appointment area of ​​the target person in the monitoring area, and the appointment time period corresponding to each appointment area;

[0305] The reservation time period determination unit is used to monitor the target reservation area corresponding to the current location of the target person in real time based on the dynamic tracking trajectory, and determine whether the current time is within the reservation time period corresponding to the target reservation area.

[0306] The display style adjustment unit is used to adjust the display style of the current information of the target person.

[0307] In one embodiment, the device further includes:

[0308] The associated personnel acquisition unit is used to acquire the first type of associated personnel and the second type of associated personnel of the target personnel after adjusting the display style of the current information display of the target personnel, and immediately start timing;

[0309] The first notification unit is used to send a timeout notification to the AR terminal held by the target person when the timeout duration exceeds a first preset timeout threshold, and at the same time send an assistance notification to the AR terminal held by the first type of associated person, and restart the timeout.

[0310] The second notification unit is used to send assistance notification information to the AR terminal held by the second type of associated person when the re-timing duration exceeds the second preset duration threshold and no other person is detected approaching the target person.

[0311] The display style switching unit is used to switch the information display style back to the original display style and stop pushing assistance prompt information if it detects that other people are approaching the target person or the target person actively leaves the target reservation area, provided that the re-timing duration does not exceed the second preset duration threshold.

[0312] In one embodiment, the device further includes:

[0313] The first unit for sending a "no viewing permission" message is used to send a "no viewing permission" message to the AR terminal when the target person and the person bound to the AR terminal are not in the same affiliated unit.

[0314] In one embodiment, the personnel information includes basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records; the target display information extraction subunit is specifically used for:

[0315] If the person bound to the AR terminal and the target person have a management and being managed relationship, then basic identity information, operation appointment information, dynamic tracking trajectory and historical violation records are extracted from the personnel information and used as target display information.

[0316] In one embodiment, the information display unit 804 is specifically used for:

[0317] The display priority of the target information is based on the order of displaying basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0318] or,

[0319] The display priority of the target information is based on the order of basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

[0320] or,

[0321] The AR terminal displays selection buttons for the basic identity information, the operation appointment information, the dynamic tracking trajectory, and the historical violation records. The selection order of the selection buttons for at least one target is used as the information display priority, and the information corresponding to the at least one target display selection button is displayed on the real-time positioning coordinates of the AR terminal in sequence.

[0322] In one embodiment, the device further includes:

[0323] The second unit for sending a "no viewing permission" message is used to send a "no viewing permission" message to the AR terminal when the target person and the person bound to the AR terminal have a management and being managed relationship.

[0324] In one embodiment, the first personnel type corresponds to the management personnel of the monitoring area; the device further includes:

[0325] The information viewing request sending unit is used to send an information viewing request to the AR terminal held by the manager or the AR terminal held by the target person through the AR terminal;

[0326] The viewing request feedback execution unit is used to extract the target display information of the target person and display it in real time when it receives a viewing request from the AR terminal held by the manager or the AR terminal held by the target person.

[0327] In one embodiment, the device further includes:

[0328] The neighboring person determination unit is used to determine people within a preset radius of the target person as neighboring persons during the movement of the target person.

[0329] The identity verification unit is used to verify the identity of the target person and the adjacent persons respectively, so as to verify whether the person currently displaying the target display information is the target person.

[0330] In one embodiment, the device further includes:

[0331] The posture recognition unit is used to capture the current posture information of the target person in real time based on posture recognition during the movement of the target person;

[0332] The trajectory prediction unit is used to perform behavioral analysis on the current posture information and combine it with path recognition to predict the trajectory of the target person and obtain the predicted travel path.

[0333] A pre-push information generation unit is used to generate pre-push information for the target display information on the predicted travel path;

[0334] The pre-push information generation unit is used to directly display the pre-push information in real time along the actual travel path when the actual travel path of the target person is consistent with the predicted travel path;

[0335] The information regeneration unit is used to regenerate and instantly display the target display information along the actual travel path when the actual travel path of the target person is inconsistent with the predicted travel path.

[0336] As the device embodiment is basically similar to the method embodiment, it is described in a relatively simple way. For relevant details, please refer to the description of the method embodiment above.

[0337] It should be noted that, in order to enable those skilled in the art to better distinguish data of the same type but with different actual meanings, the embodiments of the present invention use terms such as "first" and "second" to distinguish and describe some technical features. The terms "first" and "second" are used only for data differentiation and have no other special meanings. It is understood that the present invention does not impose any limitations on them.

[0338] This invention also provides an electronic device, which includes a processor and a memory:

[0339] The memory is used to store program code and transfer the program code to the processor;

[0340] The processor is used to execute the AR-based personnel information management method of any embodiment of the present invention according to the instructions in the program code.

[0341] This invention also provides a computer-readable storage medium for storing program code for executing the AR-based personnel information management method of any embodiment of the invention.

[0342] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0343] In the embodiments provided by this invention, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units through some interfaces, and may be electrical, mechanical, or other forms.

[0344] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0345] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0346] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0347] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A personnel information management method based on an AR system, characterized in that, include: The location information of target personnel within the monitoring area is tracked in real time, and the location information is transformed based on UWB origin alignment to obtain the real-time positioning coordinates in the AR terminal coordinate system. Extract the UWB ID from the location information, and query the personnel information of the target person based on the UWB ID; Based on the association between the target person and the person bound to the AR terminal, target display information is extracted from the person information; wherein, the association is determined by comparing the personnel types of the target person and the person bound to the AR terminal based on the management permission priority. Based on the information display priority corresponding to the association relationship, the target display information is displayed in real time on the real-time positioning coordinates of the AR terminal.

2. The personnel information management method based on an AR system according to claim 1, characterized in that, The location information of target personnel within the real-time tracking and monitoring area includes: Obtain the area division information of the monitoring area; Based on the regional division information, the monitoring area is divided into a first-risk-level area, a second-risk-level area, and a third-risk-level area in descending order of risk level. According to the preset priority tracking rules, the target personnel in the first risk level area, or the second risk level area, and / or the third risk level area are tracked in real time to obtain location information.

3. The personnel information management method based on an AR system according to claim 2, characterized in that, The step of tracking target personnel in real time within the first risk level area, or the second risk level area, and / or the third risk level area according to a preset priority tracking rule, and obtaining their location information, includes: Prioritize detecting whether there are any people in the area of ​​the first risk level; If a person is detected in the first risk level area, the person detected in the first risk level area is taken as the first target person, and the first target person is tracked in real time to obtain the first location information; If no personnel are detected in the first risk level area, then continue to detect whether there are personnel in the second risk level area; If a person is detected in the area of ​​the second risk level, the person detected in the area of ​​the second risk level will be regarded as the second target person, and the second target person will be tracked in real time to obtain the second location information; If no personnel are detected in the second risk level area, then continue to detect whether there are personnel in the third risk level area; If a person is detected in the third risk level area, the person detected in the third risk level area is designated as the third target person, and the third target person is tracked in real time to obtain the third location information; If no personnel are detected in the third risk level area, the real-time tracking action is paused until new personnel are detected again in the first risk level area, or the second risk level area, and / or the third risk level area.

4. The personnel information management method based on an AR system according to claim 3, characterized in that, After real-time tracking of the first target person and obtaining the first location information, the method further includes: The first tracking prompt message is generated on the display interface of the AR terminal; Based on the selection operation of the person bound to the AR terminal in response to the first tracking prompt information, it is determined whether to continue real-time tracking of the person in the second risk level area and / or the third risk level area.

5. The personnel information management method based on an AR system according to claim 3, characterized in that, After real-time tracking of the second target person and obtaining the second location information, the method further includes: A second tracking prompt message is generated on the display interface of the AR terminal; Based on the selection operation of the person bound to the AR terminal in response to the second tracking prompt information, it is determined whether to continue real-time tracking of the person in the third risk level area.

6. The personnel information management method based on an AR system according to claim 1, characterized in that, The location information of target personnel within the real-time tracking and monitoring area includes: Obtain the personnel type information of all personnel within the monitoring area; Based on the personnel type information, all personnel in the monitoring area are divided into at least one tracking personnel type, and a first tracking selection button corresponding to each tracking personnel type is generated on the AR terminal; Based on the selection operation of the first tracking selection button, the target tracking personnel type is determined from each of the tracking personnel types, the personnel corresponding to the target tracking personnel type is taken as the fourth target personnel, and the fourth target personnel is tracked in real time to obtain the fourth location information.

7. The personnel information management method based on an AR system according to claim 6, characterized in that, The fourth target person includes at least one person to be tracked; after real-time tracking of the fourth target person, the method includes: The AR terminal generates tracking selection sub-buttons for each of the individuals to be tracked. Based on the selection operation of the tracking selection sub-button, the target tracker is determined from each of the tracked persons, the target tracker is tracked in real time, and the tracking of the tracked persons other than the target tracker in the fourth target persons is paused.

8. The personnel information management method based on an AR system according to claim 1, characterized in that, The location information of target personnel within the real-time tracking and monitoring area includes: Obtain skill score information for all personnel within the monitoring area; Based on the skill score information, a fifth target person is identified from all personnel within the monitoring area, and the fifth target person is tracked in real time to obtain the fifth location information.

9. The personnel information management method based on an AR system according to claim 8, characterized in that, The process of identifying the fifth target person from all personnel within the monitoring area based on the skill score information includes: Based on the skill score information, the person with the lowest skill score is selected from all personnel in the monitoring area as the fifth target person; or, Based on the skill score information, individuals whose skill scores fall within a preset range are selected from all personnel within the monitoring area as the fifth target personnel.

10. The personnel information management method based on an AR system according to claim 1, characterized in that, The location information of target personnel within the real-time tracking and monitoring area includes: Obtain information on the number of violations committed by all individuals within the monitored area; Based on the violation count information, a sixth target person is identified from all personnel within the monitoring area, and the sixth target person is tracked in real time to obtain the sixth location information.

11. The personnel information management method based on an AR system according to claim 10, characterized in that, Based on the violation count information, the sixth target person is identified from all personnel within the monitoring area, including: Based on the violation count information, the person with the highest number of violations is selected from all personnel in the monitoring area as the sixth target person; or, Based on the violation count information, individuals whose violation count falls within a preset range are selected from all personnel within the monitoring area as the sixth target personnel.

12. The personnel information management method based on an AR system according to claim 1, characterized in that, The step of extracting target display information from the personnel information based on the association between the target person and the person bound to the AR terminal includes: Obtain the personnel type information of the person bound to the AR terminal, and determine the viewing personnel type of the person bound to the AR terminal; Extract the personnel type information of the target personnel from the personnel information to determine the type of personnel being viewed by the target personnel; Based on the comparison between the type of the person being viewed and the type of the person viewing, the association result between the target person and the person bound to the AR terminal is determined; Based on the association results, target display information is extracted from the personnel information.

13. The personnel information management method based on an AR system according to claim 12, characterized in that, The personnel types of all personnel whose information has been entered within the monitoring area are divided into four categories according to their management authority, from highest to lowest: Type 1, Type 2, Type 3, and Type 4. The process of determining the association between the target personnel and the personnel bound to the AR terminal by comparing the type of the personnel being viewed with the type of the personnel being viewed includes: Compare the type of the person being viewed with the type of the person viewing the data; If the type of the person being viewed is the same as the type of the person being viewed, then the target person and the person bound to the AR terminal are at the same level. If the viewing personnel type is a first personnel type and the viewed personnel type is any one of a second, third, or fourth personnel type; or, the viewing personnel type is a second personnel type and the viewed personnel type is one of a third or fourth personnel type; or, the viewing personnel type is a third personnel type and the viewed personnel type is a fourth personnel type, then the personnel bound to the AR terminal and the target personnel have a management and managed relationship. If the viewed person type is a first person type and the viewed person type is any one of a second, third, or fourth person type; or, the viewed person type is a second person type and the viewed person type is one of a third or fourth person type; or, the viewed person type is a third person type and the viewed person type is a fourth person type, then the target person and the person bound to the AR terminal have a management and managed relationship.

14. The personnel information management method based on an AR system according to claim 13, characterized in that, The step of extracting target display information from the personnel information based on the association results includes: If the target person and the person bound to the AR terminal are at the same level, then determine whether the target person and the person bound to the AR terminal belong to the same unit. If the target person and the person bound to the AR terminal belong to the same unit, then the personnel level relationship between the target person and the person bound to the AR terminal is determined, and the target display information is extracted from the personnel information based on the personnel level relationship determination result.

15. The personnel information management method based on an AR system according to claim 14, characterized in that, The personnel hierarchy is defined as follows: the target personnel is the superior of the person bound to the AR terminal; or, the target personnel is the same level as the person bound to the AR terminal; or, the target personnel is the subordinate of the person bound to the AR terminal. The personnel information includes basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records. The extraction of target display information from the personnel information based on the personnel hierarchy determination result includes: When the target person is the superior of the person bound to the AR terminal, basic identity information is extracted from the person information and used as the target display information; When the target person is at the same level as or below the person bound to the AR terminal, basic identity information, operation appointment information, dynamic tracking trajectory and historical violation records are extracted from the person information and used as target display information.

16. The personnel information management method based on an AR system according to claim 15, characterized in that, The step of displaying the target information in real time at the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship includes: When the target person is the superior of the person bound to the AR terminal, the basic identity information of the target person is directly displayed on the real-time positioning coordinates of the AR terminal. When the target person is at the same level as the person bound to the AR terminal, the display priority of the target information is based on the display order of basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal. When the target person is a subordinate of the person bound to the AR terminal, the display priority of the target information is based on the display order of basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal.

17. The personnel information management method based on an AR system according to claim 15, characterized in that, The step of displaying the target information in real time at the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship includes: When the target person is the superior of the person bound to the AR terminal, the basic identity information of the target person is directly displayed on the real-time positioning coordinates of the AR terminal. When the target person is at the same level as or below the person bound to the AR terminal, the display interface of the AR terminal generates display selection buttons for the basic identity information, the operation appointment information, the dynamic tracking trajectory, and the historical violation records. The information display priority is determined by the order in which the selection buttons for at least one target are selected, and the information corresponding to the at least one target selection button is displayed sequentially on the real-time positioning coordinates of the AR terminal.

18. The personnel information management method based on an AR system according to claim 15, characterized in that, When the target person is at the same level as or below the person bound to the AR terminal, the method further includes: Based on the operation reservation information, determine at least one reservation area of ​​the target person within the monitoring area, and the reservation time period corresponding to each reservation area; Based on the dynamic tracking trajectory, the target reservation area corresponding to the current location of the target person is monitored in real time, and it is determined whether the current time is within the reservation time period corresponding to the target reservation area; If not, adjust the display style of the target person's current information.

19. The personnel information management method based on an AR system according to claim 18, characterized in that, Also includes: After adjusting the display style of the target person's current information, obtain the first type of associated persons and the second type of associated persons of the target person, and start timing immediately; When the timeout period exceeds the first preset timeout threshold, a timeout notification message is sent to the AR terminal held by the target person, and an assistance notification message is sent to the AR terminal held by the first type of associated person, and the timeout is restarted. When the re-timing duration exceeds the second preset duration threshold, and no other personnel are detected approaching the target person, an assistance prompt message is sent to the AR terminal held by the second type of associated personnel; If the re-timing duration does not exceed the second preset duration threshold, and if it is detected that other people are approaching the target person, or the target person actively leaves the target reservation area, the information display style will be switched back to the original display style, and the push of assistance prompt information will be stopped.

20. The personnel information management method based on an AR system according to claim 14, characterized in that, Also includes: If the target person and the person bound to the AR terminal are not in the same unit, a message indicating that the AR terminal does not have viewing permission will be sent to the AR terminal.

21. The personnel information management method based on an AR system according to claim 13, characterized in that, The personnel information includes basic identity information, operation appointment information, dynamic tracking trajectory, and historical violation records; the extraction of target display information from the personnel information based on the association results includes: If the person bound to the AR terminal and the target person have a management and being managed relationship, then basic identity information, operation appointment information, dynamic tracking trajectory and historical violation records are extracted from the personnel information and used as target display information.

22. The personnel information management method based on an AR system according to claim 21, characterized in that, The step of displaying the target information in real time at the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship includes: The display priority of the target information is based on the order of displaying basic identity information, operation appointment information, dynamic tracking trajectory information, and historical violation records, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal. or, The display priority of the target information is based on the order of basic identity information, operation appointment information, historical violation records, and dynamic tracking trajectory information, and they are displayed sequentially on the real-time positioning coordinates of the AR terminal. or, The AR terminal displays selection buttons for the basic identity information, the operation appointment information, the dynamic tracking trajectory, and the historical violation records. The selection order of the selection buttons for at least one target is used as the information display priority, and the information corresponding to the at least one target display selection button is displayed on the real-time positioning coordinates of the AR terminal in sequence.

23. The personnel information management method based on an AR system according to claim 21, characterized in that, Also includes: If the target person and the person bound to the AR terminal have a management and managed relationship, a message indicating that the target person has no viewing permission will be sent to the AR terminal.

24. The personnel information management method based on an AR system according to claim 20 or 23, characterized in that, The first personnel type corresponds to the management personnel of the monitoring area; if neither the target personnel nor the personnel bound to the AR terminal are management personnel of the monitoring area, then after the AR terminal receives a no-viewing-permission prompt, the method further includes: The AR terminal sends an information viewing request to the AR terminal held by the manager or the AR terminal held by the target person. If a viewing request is received via the AR terminal held by the manager or the AR terminal held by the target person, the target display information of the target person is extracted and displayed in real time.

25. The personnel information management method based on an AR system according to claim 1, characterized in that, Also includes: During the movement of the target person, people within a preset radius of the target person are identified as neighboring people; The identity of the target person and the adjacent persons are verified separately to confirm whether the person currently displaying the target information is the target person.

26. The personnel information management method based on an AR system according to claim 1, characterized in that, Also includes: During the movement of the target person, the current posture information of the target person is captured in real time based on posture recognition; Behavioral analysis is performed on the current posture information, and path recognition is combined to predict the trajectory of the target person to obtain the predicted travel path; Pre-push information for the target display information is generated along the predicted travel path; When the actual travel path of the target person is consistent with the predicted travel path, the pre-push information is directly displayed in real time along the actual travel path; When the actual travel path of the target person is inconsistent with the predicted travel path, the target display information is regenerated and displayed in real time along the actual travel path.

27. A personnel information management device based on an AR system, characterized in that, include: The real-time tracking unit is used to track the location information of target personnel within the monitoring area in real time, and to perform coordinate transformation based on UWB origin alignment on the location information to obtain real-time positioning coordinates in the AR terminal coordinate system. The personnel information query unit is used to extract the UWB number from the location information and query the personnel information of the target personnel based on the UWB number; The target display information extraction unit is used to extract target display information from the personnel information based on the association relationship between the target personnel and the personnel bound to the AR terminal; wherein the association relationship is determined after comparing the personnel types of the target personnel and the personnel bound to the AR terminal based on the management permission priority. An information display unit is used to display the target display information in real time on the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship.

28. An electronic device, characterized in that, The device includes a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is used to execute the personnel information management method based on the AR system according to any one of the instructions in the program code.

29. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store program code for executing the personnel information management method based on the AR system according to any one of claims 1-26.

Images