Physical simulation experiment system based on auxiliary teaching

Abstract

The invention discloses a physical simulation experiment system based on auxiliary teaching, and belongs to the field of teaching equipment. Comprising a 5G gateway, AR glasses, a physical simulation calculation box, a gesture recognition glove, a tactile feedback ring, an experiment bench, a circuit board and a teacher end large screen, an SLAM positioning module is arranged in the AR glasses, environment data is directly transmitted to the physical simulation calculation box through a high-speed interface, and meanwhile the AR glasses additionally receive a smoke rendering instruction from the physical simulation calculation box through an HDM I 2.1 cable. A real circuit board model is identified through AR glasses, a corresponding fault library is loaded, virtual detection prompt information is accurately superposed to a PCB welding spot, a virtual multimeter probe is operated through a gesture glove, touch feedback simulates contact resistance, a physical engine calculates a short-circuit point temperature rise curve in real time, virtual smoke generation is driven, and the real-time detection of the PCB welding spot is realized. Through a high-precision sensing-calculation-feedback closed loop, the abstract theory of a traditional circuit experiment is concrete, and the fault diagnosis thinking training effect is remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of teaching equipment, and in particular to a physical simulation experiment system based on auxiliary teaching. Background Art

[0002] Electronic engineering teaching involves dangerous operations such as high voltage electricity and short circuits, and virtual simulation technology is needed to replace more than 60% of physical dangerous experiments.

[0003] Traditional physics experiment teaching has the following defects:

[0004] Virtual-reality registration deviation: Conventional AR teaching equipment has a position deviation of >3mm when superimposing virtual information on circuit board solder joints, resulting in inaccurate operation guidance.

[0005] Lack of interactive feedback: Virtual testing tools (such as multimeters) have no tactile feedback, so students cannot sense the resistance of the operation, which reduces the authenticity of the practical operation.

[0006] Dynamic processes are not visible: Existing simulation software only displays numerical changes and cannot visualize physical processes such as temperature rise and smoke diffusion.

[0007] Safety risks: High-voltage circuit experiments pose risks such as electric shock and short-circuit explosion. More than 60% of high-risk experiments require virtual replacement.

[0008] Although some solutions use basic AR technology, they lack multimodal sensing collaboration and high-precision physics engines, making it difficult to achieve a closed teaching loop.

[0009] Therefore, there is an urgent need for an experimental device that integrates precise positioning, tactile feedback and dynamic simulation. Summary of the Invention

[0010] The present invention provides a physical simulation experiment system based on auxiliary teaching, which can solve the problems of virtual-real registration deviation, lack of interactive feedback and invisible dynamic process in basic AR technology teaching in the existing technology.

[0011] To achieve the above objectives, the technical solutions adopted by the present invention are as follows:

[0012] A physical simulation experiment system based on assisted teaching includes a 5G gateway, AR glasses, a physical simulation computing box, gesture recognition gloves, a tactile feedback ring, an experimental bench, a circuit board and a large screen on the teacher's side.

[0013] The 5G gateway is connected to a cloud-based fault knowledge base via a 5G network or fiber optic cable. It is also connected to a teaching management server via Wi-Fi 6 or Ethernet cable. Furthermore, the 5G gateway establishes two-way communication with AR glasses via USB-C or Bluetooth 5.2, synchronizing fault database data in real time.

[0014] The AR glasses have a built-in SLAM positioning module, which is used to interact with the user. The edge computing chipset of the AR glasses preprocesses the data of the SLAM positioning module and sends it to the physical simulation computing box through the multi-mode communication module via Wi-Fi / 5G. At the same time, the AR glasses also receive smoke rendering instructions from the physical simulation computing box through an HDMI 2.1 cable.

[0015] The gesture recognition glove sends motion data to the physical simulation computing box via a private 2.4GHz wireless protocol. After processing, the physical simulation computing box reversely controls the tactile feedback ring to generate resistance through the same protocol.

[0016] The physical simulation calculation box transmits the temperature rise data to the virtual smoke generator in real time through the PCIe bus, and simultaneously sends the coordinate compensation value to the SLAM positioning module through the USB3.2 interface.

[0017] The experimental bench has a built-in position sensor that sends circuit board positioning calibration signals to the SLAM positioning module via the anti-interference RS-485 bus.

[0018] An adjustable mounting plate is provided on the experimental bench. The circuit board is placed horizontally on the upper surface of the mounting plate. The physical simulation computing box and the 5G gateway are both installed on the experimental bench.

[0019] The teacher's large screen is installed on the wall of the laboratory and communicates with other devices. The teacher's large screen displays a quantitative report on the fault location efficiency and the false touch risk index in real time and pushes it to the student AR glasses.

[0020] Furthermore, the experimental bench includes a bench, a three-dimensional calibration base station group, a multimodal sensor array, a programmable load matrix, an industrial-grade synchronization backplane, a safety emergency stop control unit and a data aggregation gateway.

[0021] The three-dimensional calibration base station group includes millimeter-wave radars and laser positioning modules deployed at the four corners of the desktop of the experimental bench. The multimodal sensor array integrates temperature, vibration, and current sensors. The programmable load matrix uses a 128-channel digital twin load to simulate the circuit board fault injection scenario. The industrial-grade synchronization backplane is an intelligent switching system based on a time-sensitive network, in which the intelligent switching system is used to ensure that the data collected by the multimodal sensor array and the positioning data of the three-dimensional calibration base station group are transmitted on the industrial-grade synchronization backplane with low latency and low jitter, so that the time of receiving data by the physical simulation calculation box is synchronized. The safety emergency stop control unit directly cuts off the power supply of the actuator through hard wiring. The data aggregation gateway integrates sensor data and uploads it to the physical simulation calculation box through optical fiber.

[0022] Furthermore, the AR glasses include a glasses frame, an optical waveguide display module, a SLAM positioning module, a MEMS micro-projection unit, an edge computing chipset, a multi-mode communication module, and an eye-tracking system. The optical waveguide display module, SLAM positioning module, MEMS micro-projection unit, edge computing chipset, multi-mode communication module, and eye-tracking system are all built into the glasses frame. All AR glasses can share their display interface to the teacher's large screen. The SLAM positioning module includes a set of binocular RGB cameras and a ToF depth sensor.

[0023] The eye tracking system captures the user's gaze in real time and sends the data to the edge computing chipset, optimizing AR rendering efficiency. The edge computing chipset is the core processing unit and is connected via a MIPICS I-2 high-speed cable. The multimode communication module connects to the edge computing chipset via an external interface and is used to receive and send data.

[0024] The AR glasses also include a built-in lithium battery, which can automatically switch with the wireless charging of the experimental bench. When the Wi-Fi signal is interfered with, the 5G-SA network is automatically enabled to maintain the SLAM positioning module data flow.

[0025] Furthermore, the physical simulation computing box includes a virtual smoke generator, a heterogeneous computing unit, a 5G edge computing module, a multi-protocol switching backplane, a solid-state cache array, and a synchronous timing module.

[0026] The heterogeneous computing unit is directly connected to the backplane via PCIe4.0, with its integrated GPU and FPGA working in collaboration. The 5G edge computing module is connected to the backplane via USB4, specifically receiving data streams from the AR glasses' SLAM positioning module and forwarding them to the heterogeneous computing unit via the backplane. A solid-state cache array is directly connected to the backplane via the NVMe protocol, storing the circuit board's fault database and physical model database for millisecond-level access by the heterogeneous computing unit. The synchronous timing module is connected to the backplane via Fiber Channel, using the IEEE 1588v2 protocol to set the physical simulation computing box as the master clock source, achieving time synchronization with the experimental bench's 3D calibration base station group. The virtual smoke generator, a software module, runs on the GPU, generating smoke rendering commands that are output to the AR glasses via the backplane's HDM I 2.1 interface.

[0027] Furthermore, the back panel of the physical simulation computing box has a reserved M.2 interface for installing an AI inference acceleration card to support the TensorRT / OpenVINO framework.

[0028] Furthermore, the gesture recognition glove includes a flexible glove, a sensor module, a main control unit, a power module, a glove tactile feedback module and a glove communication module.

[0029] The sensor module is used to detect the movement and posture of the finger, including an accelerometer, a gyroscope and a flexible sensor. The movement and posture of the finger include at least one of clicking, grabbing and rotating. The accelerometer, gyroscope and flexible sensor are all used to assist in detecting the state of the movement and posture of the finger.

[0030] The flexible sensor is connected to the main control unit via a flexible cable or wireless module. The main control unit processes data from the sensor module, executes the gesture recognition algorithm, and transmits the data to other devices. The main control unit is connected to the sensor module via a GPIO interface and to the physical simulation computing box via a low-latency wireless protocol. The power module is connected to the main control unit, the glove tactile feedback module is connected to the main control unit via a wireless protocol, and the glove communication module is connected to the main control unit via Bluetooth or Wi-Fi.

[0031] Furthermore, the gesture recognition glove integrates a 9-axis IMU on the back of the hand and embeds piezoresistive sensors on the fingertips.

[0032] Furthermore, the tactile feedback ring includes a ring body, a ring tactile feedback module, a ring unit, a ring built-in power supply and a sensing module.

[0033] The ring's tactile feedback module is connected to the ring unit via a cable or wireless connection. The ring unit is connected to the ring's tactile feedback module via GPIO or wireless protocol, and to other devices via wireless protocol. The ring's built-in power supply is connected to the main control unit. The sensing module is connected to the main control unit via a cable or wireless connection, feeding back sensing module data to the ring unit. The communication interface is connected to the main control unit via Bluetooth or other wireless protocols. The ring's tactile feedback module uses a linear resonant actuator to simulate vibration feedback and pulse feedback. The ring unit is a microcontroller that interprets tactile commands sent by the physical simulation computing box. The sensing module detects the ring's wearing status and automatically goes into sleep mode to save power.

[0034] Beneficial effects of the present invention:

[0035] (1) The present invention uses AR glasses to identify the real circuit board model, loads the corresponding fault database from the cloud, and the SLAM positioning module accurately superimposes the virtual detection prompt information on the PCB solder joints, controlling the virtual information superposition deviation to less than 1mm, achieving submillimeter virtual-real registration;

[0036] (2) Students use gesture gloves to operate virtual multimeter probes. Tactile feedback simulates contact resistance. The physics engine calculates the temperature rise curve of the short-circuit point in real time, drives the generation of virtual smoke, and the management center automatically records the time consumed in fault location. Through a high-precision sensing-computing-feedback closed loop, the abstract theory of traditional circuit experiments is visualized to realize a multimodal interactive closed loop.

[0037] (3) The programmable load matrix uses a 128-channel digital twin load to simulate circuit board fault injection scenarios. While ensuring teaching safety, it significantly improves the training effect of fault diagnosis thinking and supports risk-free practical training. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The present invention will be further described below with reference to the accompanying drawings.

[0039] Figure 1 It is a structural diagram of a physical simulation experiment system based on auxiliary teaching of the present invention.

[0040] Figure 2 Schematic diagram of the front view of the AR glasses structure of the present invention.

[0041] Figure 3 Schematic diagram of the rear view of the AR glasses structure of the present invention.

[0042] Figure 4 It is a structural schematic diagram of the gesture recognition gloves of the present invention.

[0043] Figure 5 This is a side view of the gesture recognition glove structure of the present invention.

[0044] Figure 6 It is a structural schematic diagram of the tactile feedback ring of the present invention.

[0045] Figure 7 The present invention is a flow chart of a physical simulation experiment system based on auxiliary teaching.

[0046] In the figure: 100, experimental bench; 110, safety emergency stop control unit; 120, programmable load matrix; 130, multimodal sensor array; 140, three-dimensional calibration base station group; 150, mounting plate; 200, physical simulation computing box; 300, AR glasses; 310, glasses frame; 320, SLAM positioning module; 321, binocular RGB camera; 322, ToF depth sensor; 330, MEMS micro-projection unit; 340, multi-mode communication module; 350, eye tracking system; 400, gesture recognition gloves; 410, flexible gloves; 420, glove tactile feedback module; 430, main control unit; 440, power module; 450, glove communication module; 500, tactile feedback ring; 510, ring body; 520, sensing module; 530, ring tactile feedback module; 600, teacher-end large screen; 700, 5G gateway; 800, circuit board. DETAILED DESCRIPTION

[0047] The following is a clear and complete description of the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of the present invention.

[0048] See also Figure 1-6 As shown, an embodiment of the present invention provides a physical simulation experiment system based on assisted teaching, including a 5G gateway 700, AR glasses 300, a physical simulation computing box 200, gesture recognition gloves 400, a tactile feedback ring 500, an experimental bench 100, a circuit board 800, and a large screen 600 on the teacher's end.

[0049] The teacher's large screen 600 is installed on the wall of the laboratory and connected to other devices through telecommunications.

[0050] An adjustable mounting plate 150 is provided on the experimental bench 100 , the circuit board 800 is placed horizontally on the upper surface of the mounting plate 150 , and the physical simulation computing box 200 and the 5G gateway 700 are both installed on the experimental bench 100 .

[0051] In one embodiment of the present invention, a cloud-based fault knowledge base establishes a bidirectional connection with the 5G gateway 700 via a 5G network or optical fiber, enabling real-time access and updating of the fault library. The 5G gateway 700 connects to the teaching management server via a Wi-Fi 6 wireless network or Ethernet cable, and interacts with the AR glasses 300 via the USB-C / Bluetooth 5.2 protocol. The cloud-based fault knowledge base stores a large amount of real electronic equipment failure case data, including fault phenomenon descriptions, possible cause analysis, diagnostic steps, repair plans, and corresponding fault simulation parameters, such as short-circuit resistance values, open-circuit locations, abnormal capacitance ranges, and typical temperature rise curves.

[0052] The AR glasses 300 have a built-in SLAM positioning module 320, which directly transmits environmental data to the physical simulation computing box 200 through a high-speed interface. At the same time, the AR glasses 300 additionally receive smoke rendering instructions from the physical simulation computing box through an HDMI 2.1 cable.

[0053] The gesture recognition glove 400 sends motion data to the physical simulation computing box 200 via a private 2.4GHz wireless protocol. After processing, the physical simulation computing box uses the same protocol to reversely control the tactile feedback ring 500 to generate resistance. The physical simulation computing box 200 transmits temperature rise data to the virtual smoke generator in real time via the PCIe bus, and simultaneously sends coordinate compensation values ​​to the SLAM positioning module 320 via the USB3.2 interface.

[0054] The experimental bench 100 has a built-in position sensor, which sends the circuit board 800 positioning calibration signal to the SLAM positioning module through the anti-interference RS-485 bus.

[0055] The physical simulation computing box 200 runs a real-time circuit simulation engine, dynamically calculating the circuit operating status, predicting and visualizing potential fault effects (such as component temperature rise and virtual smoke) based on the real-time operating data (temperature, current, etc.) of the circuit board 800 obtained from the multimodal sensor array 130, the fault model injected from the programmable load matrix 120, and the preset circuit board physical model database.

[0056] The physical simulation computing box 200 integrates a gesture recognition engine, receives motion data from the gesture recognition glove 400, identifies the user's operating intention (such as virtual toggle switch, rotating potentiometer, replacing components), and maps the intention into control instructions for the virtual circuit model or programmable load matrix 120.

[0057] The physical simulation calculation box 200 includes a tactile feedback engine, which calculates the resistance pattern (strength, direction, frequency) to be applied based on the physical properties of the virtual operation object (such as switch damping, knob resistance, component weight) and the current simulation state, and drives the tactile feedback ring 500 through a control protocol to generate corresponding feedback.

[0058] The heterogeneous computing unit of the physical simulation computing box 200 runs a real-time circuit simulation engine and processes data through the following process:

[0059] Fault simulation: parsing fault parameters (such as short-circuit impedance values) from the cloud fault knowledge base, and controlling the programmable load matrix 120 to inject faults into target nodes of the circuit board 800;

[0060] Haptic feedback generation: Based on the gesture operation type (e.g., rotating a virtual potentiometer) and the physical characteristics of the component, the resistance curve (strength / frequency) is calculated and sent to the haptic feedback ring 500 via a proprietary 2.4GHz protocol;

[0061] Smoke rendering: When the temperature rise data exceeds the threshold, the virtual smoke generator generates dynamic particle parameters based on the fluid mechanics model and outputs them to the AR glasses 300 via HDMI 2.1.

[0062] In one embodiment of the present invention, all AR glasses 300 can share their display interfaces on the teacher's large screen 600.

[0063] See also Figure 2 As shown, in one embodiment of the present invention, the balanced loading acoustic (SLAM positioning module 320 ) module includes a set of binocular RGB cameras 321 and a ToF depth sensor 322 .

[0064] The Balanced Loading Acoustics Module provides two-way interaction:

[0065] Input: Voice commands (such as displaying the parameters of component 3) are received through the microphone array, and the edge computing chipset interprets them and triggers the AR display.

[0066] Output: Generates directional spatial audio through bone conduction speakers (such as alarm sounds emitted from the direction of the virtual fault point).

[0067] See also Figure 4 、 Figure 5 As shown, in one embodiment of the present invention, the gesture recognition glove 400 includes a flexible glove 410 , a sensor module, a main control unit 430 , a power module 440 , a glove tactile feedback module 420 and a glove communication module 450 .

[0068] The sensor module is used to detect finger movement and posture, including an accelerometer, a gyroscope, and a flexible sensor. The flexible sensor is connected to the main control unit 430 via a flexible cable or a wireless module (such as Bluetooth). The main control unit 430 is used to process data from the sensor module, execute the gesture recognition algorithm, and send the data to other devices. The main control unit 430 is connected to the sensor module via a GPIO (general input and output) interface and is also connected to the physical simulation computing box 200 via a low-latency wireless protocol (such as 2.4GHz). The power module 440 provides power for the electronic components of the gesture recognition glove 400 and uses a rechargeable lithium battery. The power module 440 is connected to the main control unit 430. The glove tactile feedback module 420 provides tactile feedback based on the results of gesture recognition to enhance the user experience. The glove tactile feedback module 420 is connected to the main control unit 430 via a wireless protocol to receive feedback instructions. The glove communication module 450 is used to communicate with other devices (such as AR glasses 300 or physical simulation computing box 200). The glove communication module 450 is connected to the main control unit 430 via Bluetooth or Wi-Fi and is responsible for wireless data transmission.

[0069] It should also be added that the gesture recognition glove 400 has an integrated 9-axis IMU on the back of the hand and piezoresistive sensors embedded in the fingertips.

[0070] The gesture recognition algorithm is based on sensor fusion technology, combining the posture data of the 9-axis IMU and the bending data of the fingertip piezoresistive sensor. It uses a predefined gesture template library or machine learning model (such as CNN, RNN) for real-time classification and recognition, and identifies gestures such as "click", "drag", "rotate", "grab", and "release" for operating virtual circuit components.

[0071] See also Figure 2 、 Figure 3As shown, in one embodiment of the present invention, AR glasses 300 include a glasses frame 310, an optical waveguide display module, a SLAM positioning module 320, a MEMS micro-projection unit 330, an edge computing chipset, a multi-mode communication module 340 and an eye tracking system 350.

[0072] The optical waveguide display module, SLAM positioning module 320, MEMS micro-projection unit 330, edge computing chipset, multi-mode communication module 340, and eye tracking system 350 are all built into the eyeglass frame 310. The optical waveguide display module is used to overlay virtual fault annotations / smoke effects on the real circuit board 800. The SLAM positioning module 320 includes a binocular RGB camera 321 and a Time of Flight (ToF) depth sensor 322, which constructs a three-dimensional spatial model of the test bench in real time. The MEMS micro-projection unit 330 projects the virtual image generated by the physical simulation computing box 200 onto the optical waveguide display module. The edge computing chipset has a built-in NPU for local SLAM operations and image preprocessing. The multi-mode communication module 340 includes an integrated Wi-Fi 6E / Bluetooth 5.3 / 5G module, which is responsible for communicating with the 5G gateway 700 and peripherals. The eye tracking system 350 includes an infrared camera and a micro-LED array to capture the user's gaze for interaction.

[0073] In one embodiment of the present invention, the AR glasses 300 also include a built-in lithium battery, which can automatically switch with the wireless charging of the experimental bench 100. When the Wi-Fi 6E signal is interfered with, the 5G-SA network is automatically enabled to maintain the data flow of the SLAM positioning module 320.

[0074] When it is detected that the Wi-Fi 6E signal quality is lower than the threshold, causing the data stream of the SLAM positioning module 320 to be unstable, the multi-mode communication module 340 of the AR glasses 300 automatically switches to the 5G-SA (standalone networking) network, where the SA network provides ultra-low latency (URLLC) characteristics, which can effectively ensure that the high-bandwidth, low-latency (<20ms) continuous data required by the SLAM positioning module 320 is uploaded to the physical simulation computing box 200 for real-time processing and feedback.

[0075] The physical simulation computing box 200 includes a virtual smoke generator, a heterogeneous computing unit, a 5G edge computing module, a multi-protocol switching backplane, a solid-state cache array, and a synchronous timing module. The heterogeneous computing unit integrates GPU (graphics rendering) and FPGA (physical engine acceleration) to perform high-precision simulation of virtual effects such as smoke / faults. The 5G edge computing module receives data from the SLAM positioning module 320 of the AR glasses 300 through the 5GSA network to achieve low-latency spatial computing. The multi-protocol switching backplane is used to manage various interface protocol conversions, including HDMI2.1 / USB4 / fiber channel. The solid-state cache array stores the pre-loaded circuit board 800 fault library and physical model database, and the synchronous timing module maintains microsecond time synchronization with the test bench calibration base station through the IEEE1588v2 protocol.

[0076] The synchronous timing module uses the IEEE1588v2 precision time protocol to take the clock of the physical simulation computing box 200 as the master clock, and performs sub-microsecond time synchronization with slave devices such as the three-dimensional calibration base station group 140 and the high-speed data acquisition unit on the experimental bench 100.

[0077] The virtual smoke generator is a physics-based fluid simulation software module (running on the GPU of the heterogeneous computing unit). It receives temperature rise data and position information of specific components output by the physical simulation computing engine. When the component temperature exceeds a preset safety threshold, it simulates the generation, diffusion form, and concentration changes of smoke in real time based on parameters such as component power consumption and heat dissipation conditions. It generates corresponding three-dimensional smoke particle data or rendering parameters (smoke rendering instructions) and sends them to the optical waveguide display module of the AR glasses 300 via the HDMI2.1 interface for visual overlay.

[0078] The SLAM positioning module 320 data runs on the edge computing chipset of the AR glasses 300. The SLAM positioning module 320 is the sensor input source. The 3D calibration base station group 140 of the test bench 100 provides a high-precision spatial anchor point or reference coordinate system. The physical simulation computing box 200 may run global SLAM optimization or receive fused data. The AR glasses 300 and the SLAM positioning module 320 generate the device's own 6DOF pose.

[0079] The three-dimensional calibration base station group 140 of the experimental bench 100 continuously scans and locates the marking points or features on the circuit board 800, and sends the precise position / posture of the circuit board in the bench coordinate system to the SLAM positioning module 320 of the AR glasses 300 (or the physical simulation computing box 200 for transfer and fusion) via RS-485.

[0080] The SLAM positioning module 320 in the AR glasses 300 uses the received precise position information of the circuit board 800 to calibrate its own positioning or directly calculate the position of the circuit board 800 in the field of view coordinate system of the AR glasses 300, thereby achieving stable superposition of virtual information on the real circuit board.

[0081] The "coordinate compensation value" sent by the physical simulation calculation box 200 may be used to correct the deviation between the calibration base station data and the SLAM coordinate system, or for other compensation (such as thermal drift). Its function and source need to be clarified.

[0082] It should be noted that the three-dimensional calibration base station group 140 continuously detects the reflective marking points fixed on the circuit board 800, calculates the three-dimensional position and rotation angle of the circuit board 800 in the table coordinate system, and transmits it as a "positioning calibration signal" through the RS-485 bus to the SLAM positioning module 320 of the AR glasses 300 for real-time correction of the position accuracy of the virtual information superimposed on the real circuit board.

[0083] The heterogeneous computing unit is directly connected to the backplane via PCIe4.0, integrating GPU and FPGA for collaboration - the GPU handles smoke fluid simulation and AR rendering, while the FPGA performs real-time circuit physics calculations (such as temperature rise analysis and tactile feedback instruction generation).

[0084] The 5G edge computing module is connected to the backplane via USB4, and is responsible for receiving the data stream of the SLAM positioning module 320 of the AR glasses 300 and forwarding it to the heterogeneous computing unit through the backplane.

[0085] The solid-state cache array is directly connected to the backplane via the NVMe protocol, storing the fault library (short circuit / open circuit parameters) and physical model database (thermodynamic / electromagnetic model) of circuit board 800 for millisecond-level call by heterogeneous computing units.

[0086] The synchronous timing module is connected to the backplane through the optical fiber channel, and the physical simulation computing box 200 is set as the main clock source using the IEEE1588v2 protocol to achieve ±0.5μs time synchronization with the three-dimensional calibration base station group 140 of the experimental bench 100.

[0087] The virtual smoke generator runs as a software module on the GPU, and the generated smoke rendering instructions are output to the AR glasses 300 via the back panel HDMI 2.1 interface.

[0088] In one embodiment of the present invention, the M.2 interface reserved on the backplane of the physical simulation computing box 200 can be used to install an AI reasoning acceleration card (supporting TensorRT / OpenVINO). The physical simulation computing box 200 serves as the "digital twin hub" of the system, achieving a deep integration of physical law simulation and augmented reality interaction;

[0089] See also Figure 6 As shown, the tactile feedback ring 500 includes a ring body 510, a ring tactile feedback module 530, a ring unit, a built-in power supply for the ring, and a sensing module 520. The ring tactile feedback module 530 provides different types of tactile feedback, such as vibration, pressure, or temperature changes. The ring tactile feedback module 530 is connected to the ring unit via a cable or a wireless connection (such as Bluetooth); the ring unit processes instructions from other devices (such as gesture recognition gloves 400 or AR glasses 300) and controls the behavior of the ring tactile feedback module 530. The ring unit is connected to the ring tactile feedback module 530 via GPIO (general input and output) or wireless protocol, and is connected to other devices (such as computers or mobile phones) via wireless protocols (such as Bluetooth or Wi-Fi) to receive data and Instructions; The built-in power supply of the ring provides power for the electronic components of the ring body 510, usually using a small rechargeable battery, which is directly connected to the main control unit 430 to ensure stable operation of the device; the sensing module 520 detects the user's gestures and movements, provides real-time data for tactile feedback, is connected to the main control unit 430 via a cable or wireless connection, and feeds the data of the sensing module 520 back to the ring unit. The communication interface is used to communicate with external devices (such as AR glasses 300 or physical simulation computing box 200). It is connected to the main control unit 430 via Bluetooth or other wireless protocols and is responsible for data transmission.

[0090] The ring tactile feedback module 530 of the tactile feedback ring 500 adopts a linear resonant actuator (LRA) or an eccentric rotary motor (ERM), which can generate vibration feedback of different frequencies and intensities.

[0091] The ring unit is a microcontroller with the following functions:

[0092] Parsing the tactile instructions sent by the physical simulation calculation box 200;

[0093] The haptic feedback module 530 driving the ring uses a linear resonant motor (LRA) and supports:

[0094] Vibration feedback: frequency 50-200Hz simulates operating resistance;

[0095] Pulse feedback: short-term strong vibration simulates electric shock warning;

[0096] The sensing module 520 is used to detect the wearing status of the ring and automatically go into sleep mode to save power.

[0097] When the physical simulation computing box 200 detects that the user operates a virtual high-temperature component through gestures, it generates corresponding control instructions based on the simulated temperature level of the component and sends them to the tactile feedback ring 500, driving it to generate continuous medium and high-frequency vibrations to simulate a burning warning; when the user virtually flips a switch, short pulse vibrations or simulated damping sensations are generated (continuous low-frequency vibrations accompany the operation process) depending on the switch type (such as button type or lever type).

[0098] See also Figure 1 As shown, the experimental bench 100 includes a bench, a three-dimensional calibration base station group 140, a multimodal sensor array 130, a programmable load matrix 120, an industrial-grade synchronization backplane, a safety emergency stop control unit 110 and a data aggregation gateway.

[0099] The three-dimensional calibration base station group 140 includes millimeter-wave radars and laser positioning modules deployed at the four corners of the tabletop of the test bench to build a submillimeter spatial coordinate system. The multimodal sensor array 130 integrates temperature / vibration / current sensors to collect the physical status of the experimental equipment in real time. The programmable load matrix 120 uses a 128-channel digital twin load to simulate the fault injection scenario of the circuit board 800. The industrial-grade synchronous backplane is based on the TSN (time-sensitive network) intelligent switching system to achieve microsecond-level deterministic data transmission. The safety emergency stop control unit 110 directly cuts off the power supply of the actuator through hard wiring, meeting the SIL3 safety level. The data aggregation gateway integrates sensor data and uploads it to the physical simulation computing box 200 via optical fiber.

[0100] The intelligent switching system is used to ensure that the data collected by the multimodal sensor array 130 and the positioning data of the three-dimensional calibration base station group 140 are transmitted on the industrial-grade synchronization backplane with low latency and low jitter, so that the physical simulation computing box 200 can receive data in strict time synchronization.

[0101] This physical simulation experiment device based on auxiliary teaching takes the AR circuit board 800 teaching as an example. The specific usage process is as follows:

[0102] Device startup:

[0103] Fix the circuit board 800 on the test bench 100 → Use AR glasses 300 to scan the board's signature code → 5G gateway 700 downloads the corresponding fault database from the cloud to the local server;

[0104] Teachers can select specific fault cases from the cloud-based fault knowledge base through the teaching management server.

[0105] The physical simulation calculation box 200 generates corresponding control instructions based on the fault simulation parameters of the selected case, driving the programmable load matrix 120 to dynamically inject simulated fault conditions at specific nodes of the circuit board 800, such as: injecting a simulated short-circuit resistor of X ohms between node A and ground; reducing the supply voltage of node B by Y%; and injecting noise interference with a frequency of ZHz on signal line C. At the same time, the physical simulation engine loads the corresponding fault model for state prediction and visualization (such as virtual smoke; where X and Y are set according to the usage).

[0106] Virtual-real registration stage:

[0107] In the SLAM positioning module 320, a three-dimensional coordinate system is established on the experimental bench 100 → the physical simulation computing box 200 pre-loads the digital twin model of the circuit board 800 → the AR glasses 300 project the virtual detection coordinate grid.

[0108] Practical teaching stage:

[0109] The student's gesture operation is captured by the gesture recognition glove 400 → the tactile feedback ring 500 applies a reaction force according to the probe position → the physics engine calculates the short-circuit point temperature in real time → the virtual smoke generator renders abnormal phenomena in layers.

[0110] Evaluation and feedback phase:

[0111] The management server compares the standard operating sequence (SOP) → generates a quantitative report including "fault location efficiency" and "mistouch risk index" → pushes it to the teacher's large screen 600 and the students' and teachers' AR glasses 300.

[0112] The above detailed description of the preferred embodiments of the present invention should not be considered to limit the scope of the present invention. All equivalent changes and improvements made within the scope of the present invention should still fall within the scope of the patent of the present invention.

Claims

1. A physical simulation experiment system based on auxiliary teaching, characterized by: Including 5G gateway, AR glasses, physical simulation computing box, gesture recognition gloves, tactile feedback ring, experimental bench, circuit board, and teacher's large screen; The experimental bench has a built-in position sensor that sends circuit board positioning calibration signals to the AR glasses. An adjustable mounting plate is provided on the experimental bench, and the circuit board is placed horizontally on the upper surface of the mounting plate. The physical simulation computing box and 5G gateway are both installed on the experimental bench. The 5G gateway communicates with the cloud-based fault knowledge base and teaching management server, and interacts with the AR glasses. The AR glasses communicate with the physical simulation computing box and receive smoke rendering instructions from the physical simulation computing box; The gesture recognition glove sends the motion data to the physical simulation computing box, which processes it and then reversely controls the tactile feedback ring to generate resistance. The physical simulation calculation box transmits the temperature rise data to the virtual smoke generator in real time and simultaneously sends the coordinate compensation value to the AR glasses; The teacher's large screen is installed on the wall of the laboratory to display all AR glasses interfaces in real time.

2. A physical simulation experiment system based on auxiliary teaching according to claim 1, characterized in that: The experimental bench is equipped with a three-dimensional calibration base station group, a multimodal sensor array, a programmable load matrix, an industrial-grade synchronization backplane, and a data aggregation gateway. The three-dimensional calibration base station group includes a millimeter-wave radar and a laser positioning module installed at the four corners of the experimental bench desktop. The multimodal sensor array is installed on the experimental bench and integrates temperature, vibration, and current sensors. The programmable load matrix simulates 128 types of circuit board faults. The industrial-grade synchronization backplane achieves microsecond-level data synchronization based on a time-sensitive network. The data aggregation gateway is used to upload sensor data to the physical simulation computing box.

3. The physical simulation experiment system based on auxiliary teaching according to claim 1 is characterized in that: The AR glasses include a glasses frame and an optical waveguide display module, a SLAM positioning module, a MEMS micro-projection unit, an edge computing chipset, a multi-mode communication module and an eye tracking system integrated in the glasses frame. The AR glasses can share their display interface to the large screen on the teacher's side.

4. The physical simulation experiment system based on auxiliary teaching according to claim 1 is characterized in that: The physical simulation calculation box includes: Heterogeneous computing unit, integrating GPU and FPGA, processing smoke rendering and physical calculation respectively; 5G edge computing module, receiving data stream from the SLAM positioning module of AR glasses; Solid-state cache array, which stores circuit board fault database and physical models; Synchronous timing module, synchronized with the experimental bench clock.

5. The physical simulation experiment system based on auxiliary teaching according to claim 1 is characterized in that: The gesture recognition glove includes a flexible glove, a sensor module, a main control unit, a power module, a glove tactile feedback module and a glove communication module; the sensor module is used to detect the movement and posture of the fingers, the sensor module is communicatively connected to the main control unit, the main control unit is used to process data from the sensor module, the main control unit is also communicatively connected to the physical simulation computing box, the power module is connected to the main control unit, the glove tactile feedback module is communicatively connected to the main control unit, and the glove communication module is connected to the main control unit via communication.

6. A physical simulation experiment system based on auxiliary teaching according to claim 5, characterized in that: The gesture recognition glove integrates a 9-axis IMU on the back of the hand and piezoresistive sensors on the fingertips.

7. A physical simulation experiment system based on auxiliary teaching according to claim 6, characterized in that: The tactile feedback ring includes a ring body, a ring tactile feedback module, a ring unit, a ring built-in power supply and a sensing module; The built-in power supply of the ring is connected to the main control unit, and the sensing module is connected to the main control unit for communication, and the data of the sensing module is fed back to the ring unit; the ring unit is used to analyze the tactile instructions sent by the physical simulation calculation box; the sensing module is used to detect the wearing status of the ring.

8. The physical simulation experiment system based on auxiliary teaching according to claim 1 is characterized in that: The backplane of the physical simulation computing box reserves an M.2 interface for installing an AI inference acceleration card.

9. The physical simulation experiment system based on auxiliary teaching according to claim 1 is characterized in that: The 5G gateway establishes two-way communication with the AR glasses via USB-C or Bluetooth 5.2 protocol to synchronize fault library data in real time.

10. The physical simulation experiment system based on auxiliary teaching according to claim 1 is characterized in that: The teacher's large screen displays a quantitative report on fault location efficiency and false touch risk index in real time, and pushes it to the students' AR glasses.

Images