A multi-person collaborative digital twin simulation method and electronic device

Abstract

Embodiments of the present application provide a multi-person collaborative digital twin simulation method and electronic equipment, the method comprising: constructing a digital twin virtual scene of a laboratory to be monitored, and generating a virtual avatar bound to a permission for a plurality of users in the digital twin virtual scene; confirming that the plurality of users meet a preset multi-person collaboration access condition according to real-time state information of the virtual avatar; starting and executing a multi-person collaborative business process based on a collaborative session, and automatically checking process compliance according to a preset rule during execution of the multi-person collaborative business process to obtain a checking result; and providing real-time teaching feedback or generating a training effect evaluation report according to the checking result. Embodiments of the present application enable high-risk multi-person collaborative operation drills to be performed at any time without occupying a physical laboratory, thereby reducing safety risks, training costs, and cycle time.

Description

Technical Field

[0001] This application relates to the field of training, and more specifically, the embodiments of this application relate to a digital twin simulation method and electronic device for multi-person collaborative operation. Background Technology

[0002] Currently, in many work environments requiring high levels of safety protection, safety procedures based on multi-person on-site supervision and operational checks and balances are generally adopted. For example, in biosafety level 4 (BSL-4) laboratories, the two-person, two-lock system for dealing with the risk of highly pathogenic pathogens is an example of such a procedure.

[0003] However, existing virtual education technologies generally suffer from the following defects when simulating such multi-user collaborative safety procedures: inaccurate virtual location determination, lack of multi-user collaborative logic, and lack of process compliance verification.

[0004] Therefore, how to provide an efficient method and system for simulating multi-person collaborative operation has become an urgent technical problem to be solved. Summary of the Invention

[0005] The purpose of this application is to provide a digital twin simulation method and electronic device for multi-person collaborative operation. The embodiments of this application construct a digital twin virtual environment and integrate collaborative access verification, collaborative process logic verification and information feedback functions to transform high-security multi-person collaborative operation procedures into a virtual training system with high realism, strong interactivity and quantifiable evaluation. This allows for high-risk multi-person collaborative operation drills to be conducted at any time without occupying a physical laboratory, thereby reducing safety risks and further reducing training costs and shortening the cycle.

[0006] In a first aspect, embodiments of this application provide a digital twin simulation method for multi-user collaborative operation. The digital twin simulation method includes: constructing a digital twin virtual scene of a laboratory to be monitored, and generating virtual avatars bound to permissions for multiple users in the digital twin virtual scene, wherein one virtual avatar corresponds to one user; confirming that the multiple users meet preset multi-user collaborative access conditions based on the real-time status information of the virtual avatars; initiating and executing a multi-user collaborative business process based on a collaborative session, and automatically verifying the compliance of the process according to preset rules during the execution of the multi-user collaborative business process to obtain a verification result; and providing real-time teaching feedback or generating a training effect evaluation report based on the verification result.

[0007] The embodiments of this application construct a digital twin virtual environment and integrate collaborative access verification and collaborative process logic verification functions. This transforms high-security multi-person collaborative physical operation procedures into a highly realistic, highly interactive, and quantifiable virtual training system. This allows for high-risk multi-person collaborative operation drills to be conducted at any time without occupying a physical laboratory. This reduces security risks while further reducing training costs and shortening the cycle.

[0008] In some embodiments, confirming that the multiple users meet the preset multi-user collaborative access conditions based on the real-time status information of the virtual avatar includes: confirming that the preset spatial relationship requirements are met based on the location information of the virtual avatar; confirming that the preset behavioral coordination requirements are met based on the interaction events and action sequences generated by the virtual avatar in the digital twin virtual scene; and / or confirming that the user bound to the virtual avatar has the permission level required to perform the current operation.

[0009] The embodiments of this application improve the authenticity and teaching effectiveness of virtual training by introducing an access determination mechanism that integrates three dimensions: space, behavior, and permissions. This prevents violations such as unauthorized access, single-person operation, or lack of supervision from entering the core process, thus providing a reliable security foundation for subsequent high-fidelity business process simulation.

[0010] In some embodiments, confirming that the preset spatial relationship requirements are met based on the location information of the virtual avatar includes: confirming that the three-dimensional spatial coordinates of the virtual avatar are located within the functional area boundary of the target device; confirming that the distance between the virtual avatar and the target device is located within an interaction area preset for the target device; and confirming that the collider of the virtual avatar collides with the collision detection area of ​​the target device.

[0011] The embodiments of this application achieve high-precision and high-efficiency simulation of multi-user collaborative positions in a virtual environment through a three-layer progressive spatial relationship determination process of functional area screening, interaction distance determination, and collision posture confirmation. It strictly determines whether multiple users in a virtual scene meet the spatial relationship criteria to improve training effectiveness.

[0012] In some embodiments, confirming that the behavioral coordination degree preset requirements are met based on the interaction events and action sequences generated by the virtual avatars in the digital twin virtual scene includes: collecting the operation event streams generated by the virtual avatars of the multiple users in the digital twin virtual scene, wherein the operation event streams at least include target device identifiers and action types; constructing a temporally sequenced behavioral feature sequence for each user based on the operation event streams; confirming that the target operations of the multiple users are synchronized in time and that the operation order of the multiple users conforms to a preset standard operating procedure based on the behavioral feature sequence corresponding to each user; calculating the similarity between the behavioral feature sequences, and confirming that the multiple users constitute an effective collaborative unit based on the similarity.

[0013] The embodiments of this application collect and analyze the operation event flow of multiple people in a virtual environment, transforming abstract collaborative supervision into quantifiable behavioral sequence similarity and process compliance verification, thereby achieving objective quantification of supervision quality, enhancing the intelligence of violation identification, and enabling trainees to intuitively understand that multi-person checks and balances are not only spatially present, but also closely coordinated in terms of timing and logic, thus deepening trainees' understanding of the essence of safety procedures.

[0014] In some embodiments, confirming that the user bound to the virtual avatar has the permission level required to perform the current operation includes: confirming that the real-time distance between the virtual avatars of the multiple users is within a preset proximity threshold range; and confirming that the permission levels bound to the multiple users all meet the permission level required to perform the current operation.

[0015] The embodiments of this application provide an environment-aware dynamic permission checking mechanism by using spatial proximity verification as a prerequisite for permission compliance verification, thereby improving the effectiveness of security procedure teaching.

[0016] In some embodiments, the multiple users include an operator and a supervisor; while the operator is performing the current operation, the method further includes: locking the observation focus of the virtual camera on the supervisor's client to an area centered on the operating part of the virtual avatar corresponding to the operator and the current interaction point of the target device.

[0017] Embodiments of this application provide a mechanism that forces the supervisor's viewpoint to focus on the operating area, ensuring the supervisor's full-process supervision of the operator. This technical solution addresses the problem of supervisors' gaze wandering in virtual training by introducing an active, programmatic viewpoint locking mechanism, making the effectiveness of supervision measurable and feedback-able, and enabling the teaching evaluation system to form a closed loop.

[0018] In some embodiments, locking the observation focus of the virtual camera on the supervisor's client to an area centered on the operating part of the virtual avatar corresponding to the operator and the current interaction point of the target device includes: dynamically determining a virtual attention area associated with the current operation; sending a control command to the client corresponding to the supervisor so that the observation focus of the supervisor's virtual camera is locked to the virtual attention area; and monitoring the deviation of the observation focus from the virtual attention area in real time, and if the deviation exceeds a preset tolerance, triggering a violation feedback and pausing the current operation.

[0019] The embodiments of this application control the supervisory perspective through dynamic tracking, active enforcement, and real-time monitoring processes. In virtual training, this can solve the teaching problem of wandering supervisory gaze and achieve the goal of moving from passive notification to active intervention. In this way, on the one hand, it can simulate operation, and on the other hand, it can reshape behavioral patterns that meet high safety standards.

[0020] In some embodiments, the method further includes: generating and providing a log interface to be filled in; receiving operation records and virtual signatures input by the operator and the supervisor into the log interface respectively to obtain an electronic operation log; and binding and storing the electronic operation log with a unique identifier for this multi-person collaborative session.

[0021] Some embodiments of this application introduce electronic logs and virtual signature mechanisms to construct tamper-proof digital operation files in virtual training, thereby achieving virtual anchoring of security responsibilities, ensuring the complete closed loop and auditability of the teaching process, and cultivating the professional habit of recording every operation by designing log filling as an unskippable process node. This is a deep teaching goal that traditional demonstration-type or free operation-type virtual training cannot achieve.

[0022] Secondly, some embodiments of this application provide a digital twin simulation device for multi-user collaborative operation. The digital twin simulation device includes: a construction module configured to construct a digital twin virtual scene of a laboratory to be monitored, and generate virtual avatars bound to permissions for multiple users in the digital twin virtual scene, wherein one virtual avatar corresponds to one user; a verification module configured to confirm that the multiple users meet preset multi-user collaborative access conditions based on the real-time status information of the virtual avatars; a validation module configured to initiate and execute a multi-user collaborative business process based on a collaborative session, and automatically validate the compliance of the process according to preset rules during the execution of the multi-user collaborative business process to obtain a validation result; and a feedback module configured to provide real-time teaching feedback or generate a training effect evaluation report based on the validation result.

[0023] Thirdly, some embodiments of this application provide an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, can implement the method as described in any one of the embodiments of the first aspect. Attached Figure Description

[0024] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 A training system for multi-person collaborative operation based on digital twins, provided for embodiments of this application;

[0026] Figure 2 A flowchart of a digital twin simulation method for multi-person collaborative operation provided in this application embodiment;

[0027] Figure 3 A block diagram illustrating the composition of a digital twin simulation device for multi-user collaborative operation provided in this application embodiment;

[0028] Figure 4 This is a schematic diagram of the electronic device provided in the embodiments of this application. Detailed Implementation

[0029] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0030] It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. Furthermore, in the description of this application, terms such as "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0031] Unlike related technologies, some embodiments of this application provide a digital twin simulation method for multi-person collaborative operation. This method constructs a digital twin virtual environment and integrates collaborative access verification and collaborative process logic verification. It transforms high-security multi-person collaborative entity operation procedures into a virtual training system with high realism, strong interactivity, and quantifiable evaluation. This allows for high-risk multi-person collaborative operation drills to be conducted at any time without occupying a physical laboratory, reducing safety risks and further lowering training costs.

[0032] Please refer to Figure 1 , Figure 1 The digital twin simulation system for multi-user collaborative operation provided in this application includes: a training terminal and a training simulation server.

[0033] Training terminals can be equipped with devices such as head-mounted displays, tablets, or PCs.

[0034] Training terminals include student client software ( Figure 1 (Not shown), the student client is an immersive operating interface (e.g., VR headset) or desktop operating interface provided for multi-person collaborative processing scenarios (e.g., a two-person, two-lock scenario including an operator and a supervisor), responsible for collecting user input commands, head / hand tracking data and rendering digital twin scenarios. Figure 1 The example showcases a single client and does not demonstrate multi-user collaboration. Understandably, multiple training terminals can be set up for multi-user collaboration.

[0035] The training terminals also include instructor monitoring terminals ( Figure 1 (Not shown), this instructor monitoring terminal allows instructors to monitor multiple training sessions in real time and view compliance status and assessment reports.

[0036] Figure 1 The training terminals and training simulation servers use a network ( Figure 1 (Not shown) communicates with the network, which is used to transmit the real-time coordinates, control commands, synchronization status and audio and video streams of the virtual avatar, and can ensure the synchronous authorization and real-time verification of multiple users in multi-user collaborative scenarios.

[0037] Figure 1 The training simulation server includes an access and communication server ( Figure 1 (not shown) and collaborative sensing and determination server ( Figure 1 (Not shown), wherein the access and communication server is used to manage user connections, session establishment and message routing, and the collaborative perception and judgment server includes a virtual perception system, a behavior pattern system and a permission engine, which performs fusion calculations on real-time data from the training terminal to complete accurate location determination of multiple people and behavior coordination analysis. The training simulation server in this embodiment of the application also includes a business process and state management server, which is used to drive and maintain the state machine of the collaborative business process in the multi-person collaborative scenario, control the process advancement according to the judgment result (e.g., trigger the authorization interface or unlock the device), and manage the collaborative session ID and its full lifecycle state. Figure 1 The training simulation server also includes a compliance verification and teaching feedback server, which can perform full-process compliance verification and generate violation judgments in real time based on the rule set. It can also serve as an education outcome feedback and optimization module responsible for generating feedback instructions containing business logic explanations and the final training evaluation report.

[0038] The training simulation server in some embodiments of this application further includes a data storage layer ( Figure 1 (Not shown), this data storage layer includes a scenario and rules database, a user and permissions database, and an operation log and training record database.

[0039] The scenario and rule database stores digital twin scenario models, device interaction area definitions, effective collaboration distance thresholds, and process rules, supporting scenario-based adaptation of the system. The user and permission database stores user accounts, virtual avatar information, and permission levels, providing a basis for permission verification. The operation log and training record database stores complete operation logs, virtual signature records, and evaluation reports for each training session, enabling long-term archiving of traceable records and providing a data foundation for teaching analysis.

[0040] The following is combined with Figure 2 This paper exemplifies a digital twin simulation method for multi-user collaborative operations performed by a training simulation server.

[0041] like Figure 2 As shown, the digital twin simulation method includes:

[0042] S110, construct a digital twin virtual scene of the laboratory to be monitored, and generate virtual avatars bound to permissions for multiple users in the digital twin virtual scene, wherein one virtual avatar corresponds to one user.

[0043] S120, based on the real-time status information of the virtual avatar, confirm that the multiple users meet the preset multi-user collaborative access conditions.

[0044] S130, initiate and execute a multi-person collaborative business process based on a collaborative session, and automatically verify the compliance of the process according to preset rules during the execution of the multi-person collaborative business process to obtain the verification result.

[0045] S140, based on the verification results, provide real-time teaching feedback or generate a training effectiveness evaluation report.

[0046] The implementation process of the above-mentioned steps is illustrated below.

[0047] In some embodiments of this application, the step S120, which confirms that the multiple users meet the preset multi-user collaborative access conditions based on the real-time status information of the virtual avatar, includes performing at least one of the following steps:

[0048] The first step is to confirm that the preset spatial relationship requirements are met based on the location information of the virtual avatar.

[0049] For example, in some embodiments of this application, the first step includes: confirming that the three-dimensional spatial coordinates of the virtual avatar are within the functional area boundary of the target device; confirming that the distance between the virtual avatar and the target device is within a preset interaction area for the target device; and confirming that the collider of the virtual avatar (e.g., a hand model) collides with the collision detection area of ​​the target device to ensure that the user can actually operate the device and not just approach it. It should be noted that in some embodiments of this application, the above three aspects need to be confirmed sequentially.

[0050] The second step is to confirm that the preset requirements for behavioral coordination are met based on the interaction events and action sequences generated by the virtual avatar in the digital twin virtual scene.

[0051] For example, in some embodiments of this application, the second step includes: collecting operation event streams generated by the virtual avatars of the multiple users in the digital twin virtual scene, wherein the operation event streams at least include target device identifiers and action types; constructing a temporally sequenced behavioral feature sequence for each user based on the operation event streams; confirming that the target operations of the multiple users are synchronized in time according to the two behavioral feature sequences, and that the operation order of the multiple users conforms to a preset standard operating procedure; calculating the similarity between the two behavioral feature sequences, and confirming that the multiple users constitute an effective collaborative unit based on the similarity.

[0052] It should be noted that the target operation can refer to any high-security operation that requires a fixed procedure, multiple people present, and mutual supervision and checks and balances. For example, the current operation is a target operation. For instance, if the target operation is a two-person, two-lock operation, then the target operation synchronously includes two people completing the unlocking authorization within a specified time window; if the target operation is the transfer of high-risk samples, then the target operation synchronously includes two people completing the transfer of high-risk samples / items within a specified time window; if the target operation is the treatment and inactivation of biological waste, then the target operation synchronously includes two people performing the treatment and inactivation of biological waste separately within a specified time window. For example, if the target operation is to perform unlocking and locking operations, then the preset standard operating procedure refers to performing the following steps in sequence: requesting collaboration, jointly unlocking, handling the sample, and jointly locking.

[0053] The third step is to confirm that the user bound to the virtual avatar has the necessary permission level to perform the current operation.

[0054] For example, in some embodiments of this application, the third step includes: confirming that the real-time distance between the virtual avatars of the multiple users is within a preset proximity threshold range; and confirming that the permission levels bound to the multiple users all meet the permission levels required to perform the current operation.

[0055] It should be noted that in some embodiments of this application, the multiple users include an operator and a supervisor; during the period when the verification is successful and the operator is performing the current operation, the method further includes: locking the observation focus of the virtual camera on the supervisor's client to an area centered on the operation part of the virtual avatar corresponding to the operator and the current interaction point of the target device. For example, in some embodiments of this application, locking the observation focus of the virtual camera on the supervisor's client to an area centered on the operation part of the virtual avatar corresponding to the operator and the current interaction point of the target device includes: dynamically determining a virtual attention area associated with the target operation; sending a control command to the client corresponding to the supervisor to forcibly lock the observation focus of the supervisor's virtual camera to the virtual attention area; and monitoring the deviation of the observation focus from the virtual attention area in real time. If the deviation exceeds a preset tolerance, a violation feedback is triggered and the target operation is suspended.

[0056] To enhance the traceability of the training process, some embodiments of this application further include: generating and providing a log interface to be filled in; receiving operation records and virtual signatures input by the operator and the supervisor into the log interface respectively, to obtain an electronic operation log; and binding and storing the electronic operation log with a unique identifier for this multi-person collaborative session.

[0057] The following example, using a simulated BSL-4 laboratory two-person, two-lock collaborative operation (as an example of multi-person collaborative operation), illustrates the digital twin simulation method for multi-person collaborative operation provided in some embodiments of this application.

[0058] The digital twin simulation method for multi-person collaborative operation provided in some embodiments of this application can be applied to the implementation process of simulating the BSL-4 laboratory two-person, two-lock system in a digital twin virtual environment. It is suitable for high-level biosafety laboratory operation training, safety procedure teaching, and emergency response drills, focusing on the educational goals of multi-person collaboration, checks and balances of authority, and process compliance.

[0059] The SL-4 laboratory's two-person, two-lock system is a safety measure to address the risk of highly pathogenic pathogens. Its logic is to achieve operational redundancy protection through dual-person supervision and dual-lock authorization checks and balances. The inventors of this application have discovered the following technical problems with existing virtual education scenarios during simulated training:

[0060] 1. The simulation training system provided by the relevant technology only simply determines whether the user has entered the designated area. The accuracy of virtual location determination is insufficient and it is difficult to meet the constraints of spatial position relationships for multi-person collaborative operation.

[0061] 2. The relevant technologies only verify user authorization and do not simulate synchronous triggering processes, resulting in a lack of multi-user collaborative logic and a large deviation from real two-person, two-lock operations.

[0062] 3. The relevant technologies do not cover the entire process of operation verification, focusing only on the unlocking step and ignoring the supervision and checks and balances during the operation, resulting in weak process compliance verification and the lack of traceability of the entire simulation process.

[0063] 4. For violations (e.g., a single person attempting to unlock, low-privilege user collaboration, or asynchronous operations), only a simple warning is given, without providing specific explanations of the business logic or guidance for corrective actions. This results in insufficient educational feedback and error correction mechanisms, and limited teaching effectiveness.

[0064] In summary, the existing technologies cannot accurately reproduce the physical barriers, operational supervision, and process traceability logic of the two-person, two-lock system. There is an urgent need to build a virtual simulation technology training system and method that fits the educational scenario and balances realism and pedagogy.

[0065] Unlike related technologies, the digital twin simulation method for multi-person collaborative operation provided in this application can accurately determine the position of two people in a virtual environment, and restore the same interaction area and the requirement of effective supervision distance for two people to be present based on virtual coordinates and collaborative distance algorithms.

[0066] The digital twin simulation method for multi-person collaborative operation provided in this application embodiment can construct a three-dimensional collaborative verification mechanism for permissions, operations, and locations, simulating the logic of independent authorization and synchronous triggering of dual locks, conforming to the real two-person, dual-lock business process. The digital twin simulation method for two-person collaborative operation provided in this application embodiment can establish a full-process compliance verification system, covering the entire process from collaborative application to joint locking, strengthening the educational goals of operational traceability and supervisory checks and balances. The digital twin simulation method for multi-person collaborative operation provided in this application embodiment can design a targeted educational feedback module, providing business logic explanations and step-by-step correction guidance for violations, improving training effectiveness. The digital twin simulation method for multi-person collaborative operation provided in this application embodiment is adaptable to various application scenarios in BSL-4 laboratories, supports differentiated simulation process configurations, and meets diverse training needs.

[0067] The digital twin simulation method for multi-person collaborative operation provided in some embodiments of this application accurately reproduces the logic and operation process of the BSL-4 laboratory's two-person, two-lock system through virtual coordinate positioning, three-dimensional collaborative verification, full-process compliance verification, and targeted educational feedback. This effectively solves the problems of insufficient realism and weak pedagogical value in existing virtual education scenarios. The technology corresponding to this multi-person collaborative operation digital twin simulation method can be directly applied to high-level biosafety laboratory operation training, related university professional teaching, and emergency drills, improving trainees' understanding and practical skills of the two-person, two-lock system, and providing reliable virtual teaching support for biosafety talent training.

[0068] This application provides a digital twin simulation method for multi-user collaborative operation in some embodiments, including:

[0069] Step 1: Construction of Digital Twin Virtual Environment and Elements

[0070] 1. Virtual Scene Modeling: Based on the actual layout of the BSL-4 laboratory, a digital twin scene is constructed, including areas and equipment such as the core area, sample storage area, biosafety cabinet, ultra-low temperature freezer, and liquid nitrogen tank, and the physical space size is restored at a 1:1 scale.

[0071] 2. Virtual coordinates and region definition:

[0072] ① Assign each user's virtual avatar real-time updated 3D coordinates (x, y, z) and orientation information, with a coordinate accuracy of 0.1 units to ensure accurate position tracking.

[0073] ② Divide the functional area boundaries and collision detection area, set up a dedicated interaction area for each device (e.g., a refrigerator at -80℃) (e.g., the area is within a radius of 1.5 meters with the device as the center), and define the effective collaboration distance (e.g., the effective collaboration distance is the distance between the coordinates of two people is less than or equal to 1 meter).

[0074] 3. Element configuration:

[0075] ① Permission system: Three levels of permissions are set according to the BSL-4 standard (Level 1: Clean area, Level 2: Semi-contaminated area, Level 3: Contaminated area / sample storage area). Only users with Level 3 permissions can participate in two-person, two-lock operations.

[0076] ② Virtual devices: Configure dual-lock modules for storage devices (e.g., refrigerators, liquid nitrogen tanks, etc.) or core area access control. Each lock corresponds to an independent authorization credential (virtual key / password) and is bound to different users.

[0077] ③ Operation Log Template: A standardized record template with preset operator, supervisor, time, scenario, operation content, and sample information, supporting virtual signature confirmation.

[0078] Step Two: Two-Person Position Determination Technology

[0079] This step utilizes multi-level module collaboration to achieve real-time location determination and compliance verification for two individuals in a virtual environment. The specific process includes:

[0080] 1. Preliminary procedures and system initialization

[0081] ① Constructing a digital twin world scenario: Based on the actual layout of the BSL-4 laboratory, a 1:1 virtual scene model was completed, including equipment and various areas, including: the core area and the sample storage area.

[0082] ② User Virtual Avatar: Generate a unique virtual avatar for each user participating in the training, and simultaneously bind permission levels and operation permissions.

[0083] ③ Virtual location tracking system starts: Tracks the user's location information in the virtual space and updates the three-dimensional coordinates (x, y, z) and orientation information of the user's virtual avatar. For example, the coordinate update frequency is up to 10 times / second and the accuracy is controlled within 0.1 units.

[0084] 2. Multi-dimensional analysis of virtual space

[0085] When a user initiates a request for a two-person, two-lock operation, the system launches three analysis subsystems in parallel to verify the location of the two people and the compliance of the operation from different dimensions:

[0086] First, the virtual perception system determines whether the user's spatial position meets the requirements through a three-layer verification system of 3D spatial coordinates, functional area boundaries, and collision detection areas. For example, the virtual perception system is used to determine whether the user has entered the interactive area of ​​the target device (within a radius of 1.5 meters).

[0087] It should be noted that 3D spatial coordinates refer to the three-dimensional coordinates (x, y, z) of each user's virtual avatar in the virtual scene. Embodiments of this application divide the virtual scene into different functional areas (such as a core area, a sample storage area, etc.) and set predefined boundaries for each functional area, i.e., functional area boundaries (for example, these boundaries can be polygonal regions in three-dimensional space). In some embodiments of this application, the collision detection area is a spherical region (interaction area) with a set radius defined around the target device (such as a -80℃ refrigerator). Simultaneously, the target device itself can also correspond to a smaller collider (for precise interaction).

[0088] For example, in some embodiments of this application, the processing flow of the virtual perception system includes the following steps:

[0089] For functional area screening, the system first compares the user's 3D spatial coordinates with the boundary of the functional area (such as the "sample storage area") of the target device. If the user is outside the functional area, it is directly determined that the user has not entered and no further calculation is required; otherwise, the system performs precise determination of the interactive area.

[0090] Interaction area determination: When the user is within the functional area, the system calculates the Euclidean distance between the user's coordinates and the center point of the target device. If the distance is ≤ 1.5 meters, the system determines that the user has entered the interaction area of ​​the device, and further collision detection and attitude verification are performed.

[0091] Collision detection and posture verification: For users who have entered the interaction area, the system further uses the collision detection object of their virtual avatar and the device model to perform fine collision detection, and verifies whether the user avatar is facing the device, so as to confirm whether the user is in a reasonable position and posture for physical interaction, and avoid misjudgment due to pure mathematical errors in coordinate calculation.

[0092] Second, the behavior pattern system: analyzes three types of behavioral data: equipment and facility interaction, operation action recognition, and user clustering analysis, to determine whether the user's operation intention and collaboration status meet the requirements of the two-person, two-lock system.

[0093] The goal of the behavior pattern system is to analyze user behavior data to determine whether the operational intent and collaborative status meet the requirements of the two-person, two-lock system.

[0094] a. Device / Facility Interaction: Records user interaction events with virtual devices, such as opening a refrigerator door or clicking a keypad. b. Action Recognition: Identifies specific actions by capturing user input (e.g., mouse clicks, keyboard input, or VR controller movements), such as entering a password or turning a key. c. User Cluster Analysis: This refers to clustering the behavioral data of two users to determine if they are working collaboratively. For example, analyzing whether the operation sequences of two users are similar or whether they perform key steps at the same time.

[0095] The behavior pattern system is configured to perform the following operations: collect operation event streams generated by the virtual avatars of two users in the digital twin virtual scene, wherein the operation event streams at least include target device identifiers and action types; construct a temporally sequenced behavior feature sequence for each user based on the operation event streams; confirm that the target operations of the two users are synchronized in time according to the two behavior feature sequences, and that the operation order of the two users conforms to a preset standard operating procedure; calculate the similarity between the two behavior feature sequences, and confirm that the two users constitute an effective collaborative unit based on the similarity.

[0096] Third, the permission engine is configured to execute a two-person proximity detection algorithm to determine whether a preset collaborative operation process has been triggered. When the triggering conditions are met, the engine synchronously performs permission and role verification, operation compliance checks, and verifies whether both users have the required permission levels and the real-time synchronization of their operation authorizations.

[0097] The permission engine is used to execute the two-person proximity detection algorithm to perform permission role verification and operation compliance rule checks, and to verify the synchronization of user permission levels and operation authorizations.

[0098] a. By implementing a two-user proximity detection algorithm, a series of verifications and checks are triggered when two users are close together (i.e., when a certain distance condition is met). b. Permission role verification checks whether both users have level 3 permissions (only users with level 3 permissions can perform two-user, two-lock operations). c. Operation compliance rule checks verify whether the operations of the two users comply with predetermined rules, such as whether authorization is initiated simultaneously or whether the time difference between authorization operations is within an allowed range (e.g., within 30 seconds).

[0099] 3. Virtual Location Relationship Analysis and Determination

[0100] Based on the output results of the above three subsystems, the system performs a comprehensive positional relationship analysis to determine whether the following conditions are met:

[0101] ① The virtual coordinates of both users are within the interaction area of ​​the target device, and the boundary error of the area is ≤0.05 meters.

[0102] ② Effective collaboration distance: The distance between the coordinates of two users is calculated based on the Euclidean distance formula. When the distance is ≤1 meter, it is determined to be an effective collaboration distance, which meets the supervision requirements; when the distance is >1 meter, an early warning of excessive distance is triggered.

[0103] ③ Within the device's operating range: The user's virtual avatar's actions (such as the interaction between the hand model and the virtual lock) must be within the device's effective operating range to ensure the realistic simulation of the operation.

[0104] In other words, based on the outputs of the three subsystems mentioned above, the virtual location relationship analysis and determination system needs to determine the following three conditions:

[0105] a. Both users are within the interaction area of ​​the target device (within 1.5 meters of the device center), and the boundary error does not exceed 0.05 meters.

[0106] b. Effective collaboration distance: The distance between two users shall not exceed 1 meter.

[0107] c. Within the device's operating range: The user's actions (such as hand models) are within the device's effective operating range (for example, the hand model is close enough to the virtual lock to perform the unlocking action).

[0108] The above three systems and the virtual integrated processing steps for virtual location relationship analysis and determination include:

[0109] Step 1: The virtual sensing system checks whether each user has entered the interaction area of ​​the target device. If so, proceed to Step 2.

[0110] Step 2: The behavior pattern system monitors the behavior of the two users in real time to determine whether their operational intentions and collaboration status comply with the two-person, two-lock system (e.g., whether they operate synchronously or according to the procedure). If they do, proceed to Step 3.

[0111] Step 3: The permission engine is triggered when two people are close together (meeting the collaboration distance requirement) to verify permissions and operation synchronization. If successful, proceed to Step 4.

[0112] Step 4: Determine the overall positional relationship:

[0113] a. Check if both users are within the interaction area (same-interaction area).

[0114] b. Check that the distance between the two users is less than or equal to 1 meter (effective collaboration distance).

[0115] c. Check whether the user's actions are within the effective operating range of the device (e.g., the distance between the hand model and the lock).

[0116] If all the above conditions are met, it is deemed compliant (i.e., the two users are confirmed to meet the preset two-person collaboration access conditions), and subsequent operations are allowed; otherwise, a corresponding warning or educational feedback is triggered.

[0117] It should be noted that in some embodiments of this application, the three subsystems mentioned above operate in parallel, and their outputs are transmitted to the location relationship analysis and determination module in real time (or at certain time intervals) for comprehensive judgment. This parallel workflow includes: First, the user initiates a two-person, two-lock operation request. Second, the system launches three subsystems in parallel: a virtual perception system (continuously tracking the user's location and determining whether they have entered the interaction area); a behavior pattern system (continuously analyzing user behavior data and determining the operation intent and collaboration status); and a permission engine (triggering permission and synchronization checks when the two-person proximity condition is met). Third, the three subsystems output their respective judgment results (Boolean values ​​or status codes) to the virtual location relationship analysis and determination module. Fourth, this module makes a final judgment based on the outputs of the three subsystems, combined with specific distance calculations (same interaction area, effective collaboration distance, device operating range).

[0118] 4. Dual-person precise positioning verification and feedback

[0119] When the location relationship analysis meets all the conditions, the system determines that the operation is compliant and allows it to proceed to the dual-lock authorization process. If there is a violation (such as single-person operation, insufficient permissions, or exceeding distance limits), the system will trigger a prediction and teaching feedback mechanism, simultaneously outputting the violation type, business logic explanation, and correction steps. It also supports a secondary verification process for applying for collaborative authorization and correcting the learning scenario, ensuring that users understand the checks and balances logic of dual-person dual-lock.

[0120] Some embodiments of this application employ a complete technical process from scene construction and location tracking to multi-dimensional analysis and verification.

[0121] Step 3: Dual-lock authorization and multi-user collaborative operation mechanism

[0122] 1. Collaborative application process:

[0123] ① The initiating user (operator) selects the target operation scenario (such as sample storage and retrieval). The system automatically retrieves currently online users with the same permissions (supervisors) and sends a collaboration request, including the operation scenario, target device, and estimated operation time. The operator and supervisor are the two individuals confirmed in step two who meet the conditions.

[0124] ② After receiving the request, the supervisor confirms the response, and the system generates a unique collaborative session ID, binding the operation permissions and location information of the two users.

[0125] 2. Dual-lock synchronous authorization:

[0126] In the first step, after two users enter the target device's interaction area and meet the collaboration distance, the system will pop up a dedicated authorization interface for each user (the operator corresponds to lock A and the supervisor corresponds to lock B).

[0127] The second step is authorization verification: the user enters a virtual password or clicks a virtual key to complete the authorization. The system simultaneously verifies the synchronization between the two users' permission levels (both need level 3 permissions) and the authorization operation (time window ≤ 30 seconds, if it exceeds this time, the authorization will be invalid).

[0128] The third step is dual-lock linkage: the target device (such as the refrigerator door) will only be unlocked and subsequent operations will be allowed after both lock A and lock B have completed authorization and verification. If either authorization fails or is out of sync, an invalid authorization prompt will be triggered.

[0129] The implementation process corresponding to the first, second, and third steps above is as follows:

[0130] S3.2.1: Triggering and Interface Assignment

[0131] When the system detects that the bound operator and supervisor simultaneously enter the target device's interaction area and maintain an effective collaborative distance, the authorization process is automatically triggered.

[0132] Based on the role information recorded in the collaborative session, the system displays the operator's and supervisor's respective exclusive authorization operation interfaces (corresponding to virtual locks A and B, respectively).

[0133] S3.2.2: Synchronous Authorization Verification

[0134] Each user completes their authorization process (e.g., entering a password). The system performs two checks in real time: permission check, confirming that both users have level 3 permissions (this information is obtained from the collaborative session); and synchronization check, calculating the timestamp difference between the two authorization operations to determine if it falls within a preset authorization synchronization time window (e.g., ≤30 seconds). These checks are performed synchronously and in parallel in the background.

[0135] S3.2.3: Collaborative Decision-Making and Execution

[0136] The system determines that the dual-lock synchronization authorization is successful only when all permission and synchronization checks pass.

[0137] The system then sends an unlock command to the target device (such as a refrigerator), allowing subsequent core operations to proceed. If any verification fails (insufficient permissions or timeout), the process is immediately terminated, an invalid authorization message is displayed, and the violation is recorded in the current collaborative session log.

[0138] 3. Supervision of operations and records:

[0139] When the operator performs the target operation (such as sample retrieval), the system uses the virtual viewpoint locking function to force the supervisor's viewpoint to focus on the operation area, ensuring full supervision.

[0140] When the operator performs the target operation, the system modifies the target parameters (including coordinates and orientation) of the virtual camera on the supervisor's client, continuously fixing the supervisor's viewpoint focus within the spherical area defined by the interaction point between the operator's handheld model and the device. This forces the supervisor's viewpoint to focus on the operation area, ensuring continuous monitoring. If the system detects that the focus deviates beyond a threshold, it pauses the operation and issues a warning.

[0141] Step S3.3.1: Active viewpoint locking based on coordinate binding

[0142] 1. Dynamic determination of focus area: When the operator begins the target operation (e.g., the target operation is to grasp the sample tube), the system calculates the average coordinates of the key bone points of the hand in real time, and defines a forced attention sphere with radius R centered on these coordinates.

[0143] 2. Forced intervention of viewpoint parameters: The system sends a command to the supervisor's client to override the local viewpoint control input, set the virtual camera's observation focus to the above-mentioned sphere center coordinates, and add a smooth interpolation transition to form a natural viewpoint focusing effect.

[0144] 3. Deviation Monitoring and Feedback: Continuously calculates the deviation between the supervisor's viewpoint center and the target sphere's center. If the deviation continues to exceed the angle threshold θ for T seconds, it is determined that the supervisor is out of focus. The system highlights this warning on the supervisor's interface and pauses the operator's current action until the viewpoint returns to focus.

[0145] After the operation is completed, the system will pop up a standardized operation log interface. Both people need to fill in the operation content and complete the virtual signature. The log will be automatically associated with the collaborative session ID to generate a traceable record.

[0146] After the operation is completed, the system displays a standardized operation log form with pre-defined fields (such as the operation object, action, and result). Both individuals must fill in or confirm the content separately, and complete the virtual signature by drawing a signature trace in the designated area using a pointer device or clicking a unique confirmation button bound to their identities. The system then encrypts and associates the log data, signature trace data, and timestamp using the collaborative session ID as the primary key, generating an immutable and traceable record.

[0147] In other words, in the embodiments of this application, the operation under mandatory supervision includes: after successful dual-lock authorization, the target device is virtually unlocked. The operator begins to perform core operations (such as retrieving a sample). Simultaneously, the system actively intervenes, locking the orientation and viewing angle of the supervisor's virtual camera, forcing its image to continuously focus on the area where the operator's hand interacts with the device. The system continuously monitors this mandatory supervision state; if the supervisor's viewing angle abnormally deviates, a violation warning will be triggered.

[0148] Step S3.3.2: Structured Logs and Biological Behavioral Signatures

[0149] 1. Scenario-adaptive form: The system loads the corresponding structured log form from the template library based on the operation scenario recorded in the collaborative session ID (such as "sample access"), and automatically fills in some fields (such as device ID: BIO-002, operation type: retrieval).

[0150] 2. Two-factor virtual signature:

[0151] a. Identity verification: The form header automatically displays the operator: Zhang San (Level 3) and supervisor: Li Si (Level 3).

[0152] b. Behavioral Signature: Users need to continuously write their preset name or number in the signature area using a touchscreen or mouse. The system not only records the final signature image, but also collects the temporal pressure and speed sequence of the handwriting as biometric behavioral characteristics, which are then compared and verified with baseline data in the user's profile.

[0153] 3. Blockchain-style associated storage: The system packages complete log data, signature behavior feature data, current timestamp, and authorization event hash values ​​of previous steps together, uses the current collaborative session ID as the index primary key, and writes it into a tamper-proof chain-structured training record database.

[0154] In other words, some embodiments of this application provide the following for generating structured traceability records: After the target operation is completed, the system automatically pops up a pre-set template operation log interface. The operator and supervisor fill in the necessary operation details and complete the virtual signature confirmation on the log. The system automatically binds the log with information such as the collaborative session ID, operation timestamp, and user identity of this task to generate a complete and tamper-proof electronic record, which is then archived and stored.

[0155] 4. Joint locking procedure:

[0156] ①After the operator puts the sample back or turns off the equipment, the system prompts the two people to perform the locking operation simultaneously, locking lock A and lock B respectively.

[0157] ②The system verifies the device's off state and double-locked state. Once both are confirmed, the collaborative session ends, and the operation process is closed.

[0158] Step 4: Full-process compliance verification system

[0159] 1. Pre-verification:

[0160] Before initiating the operation, verify the permission levels of the two users (both must have level 3 permissions), whether they are online, and whether the target device is idle.

[0161] 2. Process verification:

[0162] ①Location verification: Real-time monitoring to ensure that the two people are continuously within the interaction area and effective collaboration distance.

[0163] ② Operation verification: Whether the supervisor's perspective is focused on the operation area and whether the operation steps comply with the SOP specifications (such as sample label verification and the order of picking and putting).

[0164] 3. Synchronous verification:

[0165] Whether the time difference between the authorization operation and the locking operation is within the allowed window.

[0166] 4. Post-verification:

[0167] Check the completeness of the operation log, whether the virtual signature is completed, and whether the device status has been restored to a secure (locked) state.

[0168] 5. Violation Determination and Classification:

[0169] ① Category 1 violation: Single person attempting to initiate an operation, low-privilege user collaboration, or asynchronous authorization (e.g., one person not authorizing), the process will be terminated directly.

[0170] ② Category II violations: During the operation, the distance between the two people exceeds the threshold, the supervisor's perspective deviates, or the log is not filled out completely. The process will be suspended and a correction will be prompted.

[0171] Step 5: Educational Feedback and Optimization Module

[0172] 1. Real-time feedback mechanism:

[0173] ① Violation Feedback: When a violation is triggered, the system will pop up a feedback window, including the violation type, explanation of the business logic, and correction steps. For example, the reason for a violation of single-person attempt to unlock is: violation of the two-person supervision and checks and balances requirement, requiring the invitation of a user with the same permissions to assist. Correction steps: 1. Exit the current operation 2. Send a collaboration request 3. Wait for the supervisor's response.

[0174] ② Compliance guidance: Real-time prompts for key steps during the operation, such as: Please confirm that the supervisor has entered the interaction area, please complete the authorization operation simultaneously, please fill in the operation log and sign it.

[0175] 2. Training effectiveness evaluation:

[0176] ① After the operation is completed, the system generates an evaluation report, which includes the process compliance rate, number and type of violations, operation time, and supervision effectiveness score.

[0177] ② Targeted exercises are recommended for weak areas, such as "authorization synchronization training" and "supervision perspective focusing training".

[0178] It's important to note that the assessment report generated in step five (based on the aggregated data from step four) serves not only the trainees but also the system. It identifies common weaknesses among the trainee group (such as widespread errors in synchronization authorization), thus providing data support for optimizing training course design. Simultaneously, it recommends targeted training for each trainee (such as perspective-focusing training), achieving an upgrade from standardized process training to data-driven personalized teaching.

[0179] Some embodiments of this application construct an intelligent teaching feedback chain from violation detection to root cause explanation and then to personalized correction, elevating program verification to educational intervention and solving the pain point of traditional virtual training that only judges errors but does not teach the correct methods.

[0180] It is easy to understand that the embodiments of this application provide a digital twin simulation method for multi-person collaborative operation. This method can achieve dual determination of interaction area and collaborative distance based on three-dimensional coordinates and Euclidean distance formula, restoring the physical requirements of multi-person supervision. The technical solution of the embodiments of this application implements a three-dimensional collaborative mechanism of permissions, operation, and location, linking user permissions, dual-lock authorization operation, and real-time location status for verification, simulating the logic of independent control and synchronous effect of dual locks. The technical solution of the embodiments of this application integrates full-process compliance verification with education, covering the complete process from application to locking, and deeply combining compliance verification with business logic explanation and operation correction guidance, taking into account both realism and teaching effectiveness. The technical solution of the embodiments of this application can achieve scenario-based adaptation design, supporting multiple BSL-4 core scenarios such as sample storage, core area access, and waste disposal, and can configure differentiated process parameters (such as authorization time window and operation steps). The method provided by the embodiments of this application can improve the realism of simulation and teaching effect, and improve operational compliance and training efficiency.

[0181] Please refer to Figure 3 , Figure 3 This application illustrates a digital twin simulation device for multi-user collaborative operation, as provided in an embodiment. It should be understood that this digital twin simulation device is similar to the one described above. Figure 2 Corresponding to the method embodiments, it is capable of executing the various steps involved in the above method embodiments. The specific functions of the device can be found in the description above, and detailed descriptions are omitted here to avoid repetition. The device includes at least one software function module that can be stored in a memory or embedded in the device's operating system in the form of software or firmware. The digital twin simulation device includes: a construction module 210, a verification module 220, a validation module 230, and a feedback module 240.

[0182] The module is configured to construct a digital twin virtual scene of the laboratory to be monitored, and generate virtual avatars bound to permissions for multiple users in the digital twin virtual scene, wherein one virtual avatar corresponds to one user; the verification module is configured to confirm that the multiple users meet the preset multi-user collaborative access conditions based on the real-time status information of the virtual avatars; the validation module is configured to initiate and execute a multi-user collaborative business process based on a collaborative session, and automatically validate the compliance of the process according to preset rules during the execution of the multi-user collaborative business process, and obtain the validation result; the feedback module is configured to provide real-time teaching feedback and generate a training effect evaluation report based on the validation result.

[0183] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the device described above can be referred to the corresponding process in the aforementioned method, and will not be elaborated further here.

[0184] like Figure 4 As shown, some embodiments of this application provide an electronic device 400, which includes a memory 410, a processor 420, and a computer program stored in the memory 410 and executable on the processor 420. When the processor 420 reads and executes the computer program via a bus 430, it can implement any of the embodiments of the digital twin simulation method for multi-person collaborative operation described above.

[0185] Processor 420 can process digital signals and may include various computing architectures. For example, it may be a complex instruction set computer architecture, a reduced instruction set computer architecture, or an architecture that implements multiple instruction set combinations. In some examples, processor 420 may be a microprocessor.

[0186] Memory 410 can be used to store instructions executed by processor 420 or data related to the execution of instructions. These instructions and / or data may include code used to implement some or all of the functions of one or more modules described in the embodiments of this application. The processor 420 of the embodiments of this disclosure can be used to execute the instructions in memory 410 to implement… Figure 2 The method shown. Memory 410 includes dynamic random access memory, static random access memory, flash memory, optical memory, or other memory well known to those skilled in the art.

[0187] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can also be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0188] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0189] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0190] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application. It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0191] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0192] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A digital twin simulation method for multi-user collaborative operation, characterized in that, The digital twin simulation method includes: Construct a digital twin virtual scene of the laboratory to be monitored, and generate virtual avatars bound to permissions for multiple users in the digital twin virtual scene, wherein one virtual avatar corresponds to one user; Based on the real-time status information of the virtual avatar, it is confirmed that the multiple users meet the preset multi-user collaboration access conditions; Initiate and execute a multi-person collaborative business process based on a collaborative session, and automatically verify the compliance of the process according to preset rules during the execution of the multi-person collaborative business process to obtain the verification result; Based on the verification results, provide real-time teaching feedback or generate a training effectiveness evaluation report.

2. The digital twin simulation method as described in claim 1, characterized in that, The step of confirming that the multiple users meet the preset multi-user collaboration access conditions based on the real-time status information of the virtual avatar includes: Based on the location information of the virtual avatar, it is confirmed that the preset spatial relationship requirements are met; Based on the interaction events and action sequences generated by the virtual avatar in the digital twin virtual scene, it is confirmed that the preset requirements for behavioral coordination are met; and / or Confirm that the user bound to the virtual avatar has the necessary permission level to perform the current operation.

3. The digital twin simulation method as described in claim 2, characterized in that, The step of confirming that the preset spatial relationship requirements are met based on the location information of the virtual avatar includes: Confirm that the three-dimensional spatial coordinates of the virtual avatar are located within the boundary of the functional area of ​​the target device; Confirm that the distance between the virtual avatar and the target device is within the preset interaction area for the target device; It is confirmed that the collider of the virtual avatar collides with the collision detection area of ​​the target device.

4. The digital twin simulation method as described in claim 2, characterized in that, The step of confirming that the behavioral coordination degree preset requirements are met based on the interaction events and action sequences generated by the virtual avatar in the digital twin virtual scene includes: The system collects operation event streams generated by the virtual avatars of the multiple users in the digital twin virtual scene, wherein the operation event streams at least include target device identifiers and action types; based on the operation event streams, it constructs a temporally sequenced behavioral feature sequence for each user; based on the behavioral feature sequence corresponding to each user, it confirms that the target operations of the multiple users are synchronized in time, and that the operation order of the multiple users conforms to a preset standard operating procedure; it calculates the similarity between the behavioral feature sequences, and based on the similarity, it confirms that the multiple users constitute an effective collaborative unit.

5. The digital twin simulation method as described in claim 2, characterized in that, The confirmation that the user bound to the virtual avatar has the necessary permission level to perform the current operation includes: Confirm that the real-time distance between the virtual avatars of the multiple users is within a preset proximity threshold range; Confirm that the permission levels of the multiple users bound to them all meet the permission levels required to perform the current operation.

6. The digital twin simulation method as described in claim 5, characterized in that, The multiple users include operators and supervisors; During the period when the operator performs the current operation, the method further includes: The virtual camera on the supervisor's client is focused on an area centered on the operating part of the operator's virtual avatar and the current interaction point of the target device.

7. The digital twin simulation method as described in claim 6, characterized in that, The step of locking the observation focus of the virtual camera on the supervisor's client to an area centered on the operating part of the operator's virtual avatar and the current interaction point of the target device includes: Dynamically determine a virtual region of interest associated with the current operation; Send control commands to the client corresponding to the supervisor so that the observation focus of the supervisor's virtual camera is locked on the virtual area of ​​interest; monitor the deviation of the observation focus from the virtual area of ​​interest in real time, and if the deviation exceeds a preset tolerance, trigger violation feedback and suspend the current operation.

8. The digital twin simulation method as described in claim 7, characterized in that, The method further includes: Generate and provide a log interface for users to fill in; The system receives operation records and virtual signatures input into the log interface by the operator and the supervisor respectively, and obtains an electronic operation log; the electronic operation log is then bound and stored with a unique identifier for this multi-person collaborative session.

9. A digital twin simulation device for multi-user collaborative operation, characterized in that, The digital twin simulation device includes: The construction module is configured to construct a digital twin virtual scene of the laboratory to be monitored, and generate virtual avatars bound to permissions for multiple users in the digital twin virtual scene, wherein one virtual avatar corresponds to one user; The verification module is configured to confirm, based on the real-time status information of the virtual avatar, that the multiple users meet the preset multi-user collaborative access conditions. The verification module is configured to initiate and execute a multi-person collaborative business process based on a collaborative session, and to automatically verify the compliance of the process according to preset rules during the execution of the multi-person collaborative business process, and obtain the verification result. The feedback module is configured to provide real-time teaching feedback or generate a training effectiveness evaluation report based on the verification results.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein, When the processor executes the computer program, it can implement the method as described in any one of claims 1-8.

Images