A three-dimensional touchscreen remote control experimental system and method

Abstract

This invention belongs to the field of Internet technology and discloses a 3D touchscreen remote control experimental system, including a 3D touchscreen module, a dual-mode communication module, an operating cart module, and a sensing and information processing module. The 3D touchscreen module provides physical buttons, a 3D touchscreen interface, and remote control functionality, and sends touchscreen information. The dual-mode communication module transmits information between the 3D touchscreen module and the operating cart module at high speed. The operating cart module enables device interconnection, receives touchscreen remote control commands to patrol the laboratory, and executes experimental operations. The sensing and information processing module acquires sensory information from the laboratory and evaluates the experimental operations. This invention allows users to conduct experiments with just a computer, meeting the needs of remote experiments without time or location restrictions, offering convenience and efficiency. Using a robotic cart instead of a user to enter the laboratory provides a realistic experimental experience, enhancing the user's learning.

Description

Technical Field

[0001] This invention belongs to the field of Internet technology, and in particular relates to a three-dimensional touch screen remote control experimental system and method. Background Technology

[0002] In the scientific field, experiments and trials play a crucial role in advancing scientific progress. In education, experimental teaching is a process that cultivates students' hands-on, observational, and critical thinking skills; therefore, the importance of experiments is self-evident. Laboratories are the most important platform for students' holistic education, and the intelligent construction and safe management of laboratories are essential components of scientific research. Traditional physical laboratories, to meet teaching needs, have been built with identical experimental equipment, incurring significant economic costs for supervision, and requiring users to physically visit the laboratory, consuming unnecessary human and material resources.

[0003] With the rapid development of modern internet technology, many traditional offline education methods can no longer meet the needs of efficient experiments, leading to the emergence of remote virtual experiments. When faced with complex situations, users no longer need to go to a physical laboratory; they can obtain a realistic experimental experience with just a smart device. Remote virtual experiments not only save manpower and resources and improve experimental efficiency, but also reduce the consumption of physical resources. All data during the experiment is recorded and stored in the cloud for future reference, greatly enhancing the teaching quality of the experiments.

[0004] However, current remote experiments are mostly limited to simulation and two-dimensional control. Users do not start real physical equipment or perform actual operations, which greatly reduces the real quality of the experiment and greatly affects the overall experience of the experiment. It does not achieve true remote control experiment. Summary of the Invention

[0005] The purpose of this invention is to provide a three-dimensional touchscreen remote control experimental system and method to solve the above-mentioned technical problems.

[0006] To solve the above-mentioned technical problems, the specific technical solution of the three-dimensional touch screen remote control experimental system and method of the present invention is as follows:

[0007] A stereoscopic touchscreen remote control experimental system includes a stereoscopic touchscreen module, a dual-mode communication module, an operating cart module, and a sensing and information processing module. The stereoscopic touchscreen module provides physical buttons, a stereoscopic touchscreen, and remote control functionality, and sends touchscreen information. The dual-mode communication module transmits information between the stereoscopic touchscreen module and the operating cart module at high speed. The operating cart module enables IoT connectivity, receives touchscreen remote control commands to patrol the laboratory, and executes experimental operations. The sensing and information processing module acquires sensory information from the laboratory and evaluates the experimental operations.

[0008] Furthermore, the stereoscopic touchscreen module includes a deformable screen, a microelectromechanical system (MEMS), a camera, a remote control panel, and a microcontroller. The deformable screen is electrically connected to the MEMS, the camera is communicatively connected to the dual-mode communication module, and the remote control panel is electrically connected to the microcontroller. Based on the device panel diagram of the AGV module, the deformable screen identifies the button areas and their corresponding depths using a target detection algorithm. The MEMS then controls the screen to protrude the button areas, creating a stereoscopic tactile experience. The remote control panel, through the microcontroller, reads the state of the buttons or joysticks on the AGV module and converts them into wireless signals, which are then sent to the dual-mode communication module for controlling the movement of the AGV and the positioning and grasping of objects by the industrial robot. The camera monitors the user's attention level and gaze point, transmitting the data to the system processor for behavior recognition using natural language processing algorithms.

[0009] Furthermore, the dual-mode communication module includes a BeiDou dual-mode communication module, a Wi-Fi module, a router, and a Bluetooth module.

[0010] Furthermore, the operating vehicle module includes an AGV vehicle, an industrial robot, and a binocular camera. The industrial robot is mounted on the AGV vehicle to form an integrated experimental operating vehicle. The binocular camera is used to acquire 3D images of the laboratory from the perspective of the AGV vehicle. The AGV vehicle is used to receive remote control signals from the remote control panel to perform obstacle avoidance movement and robotic arm grasping within the room.

[0011] Furthermore, the sensing and information processing module includes temperature and humidity, pressure, gas, light or smoke sensors, as well as a processor loaded with data processing and natural language processing evaluation algorithms.

[0012] This invention also discloses a remote control experimental method for a stereoscopic touchscreen remote control experimental system. The method includes: a user remotely controls an AGV (Automated Guided Vehicle) vehicle to enter a designated laboratory device using a dual-mode communication module. Before the AGV enters the designated equipment, the stereoscopic touchscreen module displays a simulated operation panel based on the device number. The user's operation information is forwarded to the AGV module via the dual-mode communication module. The information is then sent to the experimental device using IoT technology to respond to the user's operation. The AGV assists in the experiment. The sensing and information processing module is responsible for acquiring the output of the experimental instruments and the sensor data of the experimental platform, recording the experimental process, and providing a system evaluation.

[0013] Furthermore, the method includes the following steps:

[0014] Remote control touchscreen steps: The 3D touchscreen module includes remote control and touchscreen functions. The remote control panel includes an STM32-based microcontroller that reads the state of the buttons or joysticks and converts them into wireless signals to be sent to the dual-mode communication module for controlling the movement of the AGV and the positioning and grasping of objects by the industrial robot. The 3D touchscreen uses the image of the equipment panel taken by the AGV to identify the button area and its corresponding depth through a target detection algorithm. It uses MEMS technology to control the deformable screen to raise the corresponding button area pixel by pixel according to the depth to form a 3D touch.

[0015] Remote communication steps: The communication between the 3D touch screen module and the operating car module adopts two parallel lines, satellite and Wi-Fi, which serve as primary and backup for each other. The output of the microcontroller in the 3D touch screen module is simultaneously connected to the Beidou dual-mode communication module and the Wi-Fi module, and is sent in real time to the remote smart device and the operating car module, respectively executing button responses and AGV car movement and grasping. The 3D images acquired by the operating car module and the sensor perception data are also sent to the 3D touch screen in real time.

[0016] Experimental Operation Steps: An industrial robotic arm is mounted on an AGV (Automated Guided Vehicle) to form an integrated experimental operation vehicle. A binocular camera is used to acquire a 3D image of the laboratory from the AGV's perspective. The AGV receives remote control signals from the remote control panel to perform obstacle avoidance movement and robotic arm grasping within the room. When the distance to a designated device is less than a threshold, it requests to activate the device's remote control mode. Based on the received encrypted touchscreen data, the device locates the designated I / O port on the device panel diagram and responds with an output. Evaluation and Perception Steps: Various sensors in the perception and information processing module are installed in the laboratory. The perceived data and the device's output data are transmitted to the processor for system processing. The binocular camera in the stereo touchscreen module monitors the user's attention level and gaze point, transmitting the data to the processor for behavior recognition and scoring through natural language processing algorithms. After the experiment, an experimental report and a performance evaluation report are generated for the user.

[0017] Furthermore, the remote control touchscreen step includes the following specific methods:

[0018] The 3D touchscreen identifies the button area Ki (i = 1 to n) based on the device panel image captured by the car using a target detection algorithm. Ki is represented by pixels, and its corresponding depth Dj (j = 1 to n). MEMS technology is used to control the deformable screen to raise the corresponding Ki area pixel by pixel according to the depth Dj, forming a 3D touch sensation. When the virtual button is pressed, the pressure sensor digital quantity Kpm changes, m = 1 to n1, Kpm = 0 or 1. When the virtual knob is rotated, the gyroscope records the angle ΔRo change, o = 1 to n2, and encrypts it according to the following formula (1). The remote information transmission format is |t / Ki / m / Kpm* / o / ΔRo*|, where t is time.

[0019] Kp m * =Kp m e mod N, ΔR o * =ΔR o e mod N (1)

[0020] Where e and N are randomly generated key pairs, and Kp m * ΔR o * It is an encrypted physical quantity. According to the remote control experiment method of claim 7, the remote control touchscreen step includes the following specific method: the evaluation perception step scores according to formula (2), and after the experiment, an experiment report and a performance evaluation report are generated for the user;

[0021]

[0022] Where c1>c2>c3 are the weights of the scores for each part, E i E0 and T are the actual output value and standard output value, respectively. j T0 and F represent the actual sensing data and the standard sensing value, respectively. k and F m These are the number of fixations in the task area and the total number of fixations, t k and t m These are the task area fixation time and the total fixation time, respectively.

[0023] The three-dimensional touchscreen remote control experimental system and method of the present invention have the following advantages:

[0024] 1. Users only need one computer device to conduct experiments, which can meet the needs of remote experiments without time and location restrictions, making it convenient and efficient;

[0025] 2. There is no need to provide many identical physical laboratories; users only need internet access to achieve limited resource sharing.

[0026] 3. It has reduced the construction costs of infrastructure such as laboratories, and cloud-based experiments have greatly enriched teaching resources;

[0027] 4. Using robotic vehicles to replace users in entering the laboratory for operation and assembly of various sensing facilities brings users a realistic experimental experience, which helps to deepen users' learning impression;

[0028] 5. Multiple users can conduct collaborative experiments online, saving time and resources and enhancing academic exchange;

[0029] 6. The entire experiment can be recorded and stored in the cloud, which not only enables effective supervision and reasonable evaluation, but also facilitates user review and error correction;

[0030] 7. Dual communication methods ensure the reliability of information transmission, while encrypted transmission ensures the security of information, providing users with a safe and reliable remote experimental environment. Attached Figure Description

[0031] Figure 1 This is a block diagram of the modular components of a 3D touchscreen remote control experimental system;

[0032] Figure 2 This is a block diagram showing the specific components of the 3D touchscreen module;

[0033] Figure 3 This is a block diagram showing the specific components of the operating car module;

[0034] Figure 4 This is a real-world schematic diagram of a three-dimensional touchscreen remote control experimental method;

[0035] Figure 5 This is a flowchart for the comprehensive evaluation of a 3D touchscreen remote control experimental system. Detailed Implementation

[0036] To better understand the purpose, structure, and function of this invention, the following detailed description of a three-dimensional touchscreen remote control experimental system and method is provided in conjunction with the accompanying drawings.

[0037] like Figure 1 As shown, the present invention discloses a stereoscopic touchscreen remote control experimental system, comprising a stereoscopic touchscreen module, a dual-mode communication module, an operating cart module, and a sensing and information processing module. The stereoscopic touchscreen module provides a physical button stereoscopic touchscreen and remote control functionality, and sends touchscreen information. The dual-mode communication module transmits information between the stereoscopic touchscreen module and the operating cart module at high speed. The operating cart module enables device interconnection, receives touchscreen remote control commands to patrol the laboratory, and executes experimental operations. The sensing and information processing module acquires sensory information from the laboratory and evaluates the experimental operations.

[0038] like Figure 2As shown, specifically, the 3D touchscreen module includes a deformable screen, a microelectromechanical system (MEMS), a camera, a remote control panel, and a microcontroller. The deformable screen is electrically connected to the MEMS, the camera is communicatively connected to the dual-mode communication module, and the remote control panel is electrically connected to the microcontroller. Based on the device panel diagram of the AGV module, the deformable screen identifies the button areas and their corresponding depths using a target detection algorithm. The MEMS then controls the screen to protrude the button areas, creating a 3D tactile experience. The remote control panel, through the microcontroller, reads the state of the buttons or joysticks on the AGV module and converts them into wireless signals, which are then sent to the dual-mode communication module for controlling the AGV's movement and the industrial robot's object positioning and grasping. The camera monitors the user's attention level and gaze point, transmitting the data to the system processor for behavior recognition using natural language processing algorithms.

[0039] The dual-mode communication module includes a BeiDou dual-mode communication module, a Wi-Fi module, a router, and a Bluetooth module.

[0040] like Figure 3 As shown, the operating vehicle module includes an AGV vehicle, an industrial robot, a lifting rod, and a binocular camera. The industrial robot is mounted on the AGV vehicle to form an integrated experimental operating vehicle. The binocular camera is used to acquire 3D images of the laboratory from the perspective of the AGV vehicle. The AGV vehicle is used to receive remote control signals from the remote control panel to perform obstacle avoidance movement and robotic arm grasping within the room.

[0041] The sensing and information processing module includes sensors for temperature and humidity, pressure, gas, light, and smoke, as well as a processor loaded with evaluation algorithms for data processing and natural language processing.

[0042] The stereoscopic touchscreen remote control experimental system is described below. The user uses the stereoscopic touchscreen module for remote control. Before the AGV (Automated Guided Vehicle) enters the designated equipment in the laboratory, the stereoscopic touchscreen module retrieves a simulated operation panel based on the equipment number. The user's operation information is forwarded to the AGV module via the dual-mode communication module, and then transmitted to the experimental equipment using IoT technology to respond to the user's operation. The AGV assists in the experiment. The sensing and information processing module is responsible for acquiring the output of the experimental instruments and the sensor data of the experimental platform, recording the experimental process, and providing a system evaluation. The specific steps are as follows:

[0043] (1) Remote control touchscreen: The stereo touchscreen module includes remote control and touchscreen functions. The remote control panel includes an STM32-based microcontroller that reads the state of the buttons or joysticks and converts them into wireless signals to be sent to the dual-mode communication module for controlling the movement of the AGV and the positioning and grasping of objects by the industrial robot. The stereo touchscreen identifies the button area K based on the equipment panel image taken by the AGV and through a target detection algorithm. i (i = 1 ~ n, K)i (represented by pixels) and their corresponding depth D j (j=1~n), using MEMS technology to control the deformable screen to move the corresponding K i The region is arranged according to depth D j The pixels are raised one by one to create a three-dimensional tactile feel. When the virtual button is pressed, it triggers the pressure sensor to output a digital value Kp. m (m=1~n1,Kp m The value changes (=0 or 1), and the gyroscope records the angle ΔR when the virtual knob is rotated. o (o=1~n2) changes and is encrypted according to the following formula (1), the remote information transmission format is |t / K i / m / Kp m * / o / ΔR o * (t is time),

[0044] Kp m * =Kp m e mod N, ΔR o * =ΔR o e mod N (1)

[0045] Where e and N are randomly generated key pairs, and Kp m * ΔR o * It is an encrypted physical quantity;

[0046] (2) Remote communication: The communication between the 3D touch screen module and the operating car module adopts two parallel lines of satellite and wifi, which serve as the main backup for each other. The output of the microcontroller in the 3D touch screen module is connected to both the Beidou dual-mode communication module and the wifi module, and is sent to the remote smart device and the operating car module in real time to execute button response and AGV car movement and grasping respectively. The 3D image and various perception data acquired by the operating car module will also be sent to the 3D touch screen in real time.

[0047] (3) Experimental operation: The industrial robotic arm is installed on the AGV to form an integrated experimental operation vehicle. The binocular camera is used to acquire 3D images of the laboratory from the perspective of the AGV. The AGV receives remote control signals from the remote control panel to perform obstacle avoidance movement and robotic arm grasping in the room. When the distance to the designated device is less than the threshold, it requests to open the remote control mode of the device. The device locates the designated I / O port on the device panel diagram according to the received encrypted touch screen data and responds with the output.

[0048] (4) Evaluation of perception: Various sensors in the perception and information processing module are installed in the laboratory. The perceived data and the output data of the device are transmitted to the processor for system processing. The binocular camera in the stereo touch screen module monitors the user's focus and gaze point, which is transmitted to the processor to identify the behavior through natural language processing algorithm and scored according to formula (2). After the experiment, an experiment report and a performance evaluation report are generated for the user.

[0049]

[0050] Where c1>c2>c3 are the weights of the scores for each part, E i E0 and T are the actual output value and standard output value, respectively. j T0 and F represent the actual sensing data and the standard sensing value, respectively. k and F m These are the number of fixations in the task area and the total number of fixations, t k and t m These are the task area fixation time and the total fixation time, respectively.

[0051] Example 1: Power system analysis experiment using the three-dimensional touch screen remote control experimental system of the present invention.

[0052] like Figure 4 As shown, the remote control experimental system in this embodiment consists of a stereoscopic display screen and remote control panel 1, a satellite module 2 and a Wi-Fi module 3, an experimental operation vehicle 4, a router 5, and an intelligent laboratory 6 composed of smart devices. The experimental steps are as follows: The user activates the stereoscopic touch screen module and sends a "request experiment" signal to the remote location. The remote operation vehicle module receives the signal and distributes the experimental operation vehicle. After the user enters a password for verification, the operation can begin. The user controls the experimental operation vehicle to move using the remote control panel. When the vehicle reaches the front of a designated device, such as a power system integrated automation experimental platform, the user presses the "request remote" button. The experimental operation vehicle searches for and connects to the Wi-Fi signal of the device, and the device enters the "remote control" mode. The experimental operation vehicle transmits the device panel diagram to the simulation end. The stereoscopic touch screen module displays a MEMS-based simulated controllable panel. The user performs corresponding operations, and the changes in button presses are transmitted to the device controller in real time, driving the internal response output. If external wiring is required, a remote-controlled industrial robot can perform the gripping, moving, and other operations. After the experiment, the system automatically calculates the score according to the scoring criteria and provides an evaluation.

[0053] Example 2: Experimental Evaluation of a Three-Dimensional Touchscreen Remote Control Experimental System and Method

[0054] This embodiment uses the same remote-controlled experimental device as Embodiment 1, where the sensing and information processing module is responsible for the overall evaluation of the experiment. For example... Figure 5As shown, the specific steps for experimental data processing and evaluation are as follows:

[0055] (1) Generate scoring criteria: Quantify the experimental objectives and requirements according to expected results, operating procedures, etc., and add precautions to automatically generate scoring criteria;

[0056] (2) Experimental Records: The input information transmitted by the user when operating the stereo touch screen module will be used for remote communication and will also be backed up to the sensing and information processing module for scoring and storage.

[0057] (3) Calculate the score of each part: calculate the difference between the device output and the reference result, the error between the sensor data and the reference range, identify the user's eye movement using the CamShift algorithm, and finally calculate the comprehensive score according to formula (2).

[0058] (4) Analyze the cause of error: If the output of the equipment is not qualified, the Transformer algorithm is used to compare and identify the error according to the teaching plan. If the sensor data is not qualified, the source is traced to the specific instrument and the LSTM algorithm is used to predict the possible cause.

[0059] (5) Comprehensive evaluation: Compile the comprehensive score and the reasons for the error, and output the final score and comments.

[0060] It is understood that the present invention has been described through some embodiments, and those skilled in the art will recognize that various changes or equivalent substitutions can be made to these features and embodiments without departing from the spirit and scope of the invention. Furthermore, under the teachings of the present invention, these features and embodiments can be modified to adapt to specific situations and materials without departing from the spirit and scope of the invention. Therefore, the present invention is not limited to the specific embodiments disclosed herein, and all embodiments falling within the scope of the claims of this application are within the protection scope of the present invention.

Claims

1. A three-dimensional touchscreen remote control experimental method, characterized in that, include: Users use the 3D touchscreen module for remote control. Before the AGV car enters the designated equipment in the laboratory, the 3D touchscreen module brings up the simulated operation panel according to the equipment number. The user's operation information is forwarded to the operation car module through the dual-mode communication module. The IoT technology is used to send the information to the experimental equipment to respond to the user's operation. The AGV car assists in the experiment. The sensing and information processing module is responsible for acquiring the output of the experimental instruments and the sensor data of the experimental platform, recording the experimental process and providing a system evaluation. Remote control touchscreen steps: The 3D touchscreen module includes remote control and touchscreen functions. The remote control panel includes an STM32-based microcontroller that reads the state of the buttons or joysticks and converts them into wireless signals to be sent to the dual-mode communication module for controlling the movement of the AGV and the positioning and grasping of objects by the industrial robot. The 3D touchscreen uses the image of the equipment panel taken by the AGV to identify the button area and its corresponding depth through a target detection algorithm. It uses MEMS technology to control the deformable screen to raise the corresponding button area pixel by pixel according to the depth to form a 3D touch. The remote control touchscreen steps include the following specific methods: The 3D touchscreen identifies the button area Ki (i = 1 to n) based on the device panel image captured by the car using a target detection algorithm. Ki is represented by pixels, and its corresponding depth Dj (j = 1 to n). MEMS technology is used to control the deformable screen to raise the corresponding Ki area pixel by pixel according to the depth Dj, forming a 3D touch sensation. When the virtual button is pressed, the pressure sensor digital quantity Kpm changes, m = 1 to n1, Kpm = 0 or 1. When the virtual knob is rotated, the gyroscope records the angle ΔRo change, o = 1 to n2, and encrypts it according to the following formula (1). The remote information transmission format is |t / Ki / m / Kpm* / o / ΔRo*|, where t is time. Kp m * =Kp m e mod N ,ΔR o * =ΔR o e mod N (1) Where e and N are randomly generated key pairs, and Kp m * ΔR o * It is an encrypted physical quantity; After the 3D touchscreen module forms 3D buttons, the pressure operation of the 3D buttons generates a change in quantity, which is sent to the device. The device can respond and output, so as to achieve the purpose of remote control. Remote communication steps: The communication between the 3D touch screen module and the operating car module adopts two parallel lines, satellite and Wi-Fi, which serve as primary and backup for each other. The output of the microcontroller in the 3D touch screen module is simultaneously connected to the Beidou dual-mode communication module and the Wi-Fi module, and is sent in real time to the remote smart device and the operating car module, respectively executing button responses and AGV car movement and grasping. The 3D images acquired by the operating car module and the sensor perception data are also sent to the 3D touch screen in real time. Experimental Operation Steps: An industrial robotic arm is mounted on an AGV (Automated Guided Vehicle) to form an integrated experimental operation vehicle. A binocular camera is used to acquire a 3D image of the laboratory from the AGV's perspective. The AGV receives remote control signals from the remote control panel to perform obstacle avoidance movement and robotic arm grasping within the room. When the distance to a designated device is less than a threshold, it requests to activate the device's remote control mode. Based on the received encrypted touchscreen data, the device locates the designated I / O port on the device panel diagram and responds with an output. Evaluation and Perception Steps: Various sensors in the perception and information processing module are installed in the laboratory. The perceived data and the device's output data are transmitted to the processor for system processing. The binocular camera in the stereo touchscreen module monitors the user's attention level and gaze point, transmitting the data to the processor for behavior recognition and scoring through natural language processing algorithms. After the experiment, an experimental report and a performance evaluation report are generated for the user.

2. The remote control experimental method according to claim 1, characterized in that, The remote control touch screen steps include the following specific methods: the evaluation perception step is scored according to formula (2), and an experiment report and a performance evaluation report are generated for the user after the experiment is completed; Where c1>c2>c3 are the weights of the scores for each part, E i E0 and T are the actual output value and standard output value, respectively. j T0 and F represent the actual sensing data and the standard sensing value, respectively. k and F m These are the number of fixations in the task area and the total number of fixations, t k and t m These are the task area fixation time and the total fixation time, respectively.

3. A stereoscopic touchscreen remote control experimental system for performing the remote control experimental method as described in any one of claims 1-2, characterized in that, The system includes a 3D touchscreen module, a dual-mode communication module, an operating cart module, and a sensing and information processing module. The 3D touchscreen module provides physical buttons, a 3D touchscreen interface, and remote control functionality, and sends touchscreen information. The dual-mode communication module transmits information between the 3D touchscreen module and the operating cart module at high speed. The operating cart module enables IoT connectivity, receives touch remote control commands to patrol the laboratory, and executes experimental operations. The sensing and information processing module acquires sensory information from the laboratory and evaluates the experimental operations.

4. The stereoscopic touchscreen remote control experimental system according to claim 3, characterized in that, The 3D touchscreen module includes a deformable screen, a microelectromechanical system (MEMS), a camera, a remote control panel, and a microcontroller. The deformable screen is electrically connected to the MEMS, the camera is communicatively connected to a dual-mode communication module, and the remote control panel is electrically connected to the microcontroller. Based on the device panel diagram of the AGV module, the deformable screen identifies the button areas and their corresponding depths using a target detection algorithm. The MEMS then controls the screen to protrude the button areas, creating a 3D tactile experience. The remote control panel, through the microcontroller, reads the state of the buttons or joysticks on the AGV module and converts them into wireless signals, which are then sent to the dual-mode communication module for controlling the AGV's movement and enabling the industrial robot to locate and grasp objects. The camera monitors the user's attention level and gaze point, transmitting the data to the system processor for behavior recognition using natural language processing algorithms.

5. The stereoscopic touchscreen remote control experimental system according to claim 3, characterized in that, The dual-mode communication module includes a BeiDou dual-mode communication module, a Wi-Fi module, a router, and a Bluetooth module.

6. The stereoscopic touchscreen remote control experimental system according to claim 3, characterized in that, The operation vehicle module includes an AGV vehicle, an industrial robot, and a binocular camera. The industrial robot is mounted on the AGV vehicle to form an integrated experimental operation vehicle. The binocular camera is used to acquire 3D images of the laboratory from the perspective of the AGV vehicle. The AGV vehicle is used to receive remote control signals from the remote control panel to perform obstacle avoidance movement and robotic arm grasping within the room.

7. The stereoscopic touchscreen remote control experimental system according to claim 3, characterized in that, The sensing and information processing module includes temperature and humidity, pressure, gas, light or smoke sensors, as well as a processor loaded with data processing and natural language processing evaluation algorithms.

Images