Numerical control intelligent experiment platform

Through the CNC intelligent experimental platform, combined with robotic robot arms, webcams and deep learning algorithms, students' experimental behaviors are identified and feedback, which solves the random movement and immobility in experimental teaching in secondary vocational and higher vocational education, and improves experimental safety and interactivity, realize objective evaluation and digital management of experimental results.

CN119049374APending Publication Date: 2024-11-29BIGO (BEIJING) TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411276957.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-12
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

In secondary vocational education and higher vocational education, students face chaotic, immobile and pre-moving phenomena in experimental teaching, resulting in experimental safety threats, insufficient self-checking ability and lack of experimental interest. Traditional experimental equipment operation is a formality and lacks digital management. Tools and interactive teaching methods.

Method used

Design a CNC intelligent experimental platform, including experimental boxes, robotic robot arms, webcams, simulation boards, remote network controllers, somatosensory devices and digital human explanation system, identify students' operating behaviors through deep learning algorithms, and provide intelligent feedback and interaction Teaching to realize automation and precise control of the experimental process.

Benefits of technology

It improves students' experimental interest and self-reflection ability, enhances the safety and interactivity of experimental teaching, realizes objective evaluation and digital management of experimental results, and promotes students' professional skills cultivation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119049374A_ABST
    Figure CN119049374A_ABST
Patent Text Reader

Abstract

The invention discloses a numerical control intelligent experiment platform, which belongs to the technical field of experiment platforms, can adapt to common actions of different specialties and different experiments by adopting an experiment box, improves the flexibility of the platform, can conveniently perform customized services according to professional characteristics and experiment requirements, and improves the experiment efficiency through interaction of somatosensory equipment. The experiment enthusiasm of students is improved, the students can see schematic diagrams generated by own operation and then perform self-correction modification, finally correct wiring is completed, teachers judge corresponding internal relations related to knowledge after experiment operation of the students according to behavior portraits of the students, experiment scores are more objective, and the teaching efficiency is improved. According to the intelligent experiment platform, digital evaluation of experiment results is achieved, the intelligent experiment platform solves the problems of disordered movement, immobile movement and immobile movement existing in the experiment of students, meanwhile, teaching assistance is formed for the experiment of the students, the experiment interest of the students is improved, and the experiment effect is guaranteed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an experimental platform, in particular to a numerical control intelligent experimental platform, and belongs to the technical field of experimental platforms. Background Art

[0002] In the current secondary vocational education (SVE), higher vocational education (HVE) and applied higher education systems, students generally face a series of challenges in learning and practical ability. Specifically, they do not have a solid grasp of basic skills, their independent thinking and innovation abilities are gradually weakened, and their ability to transform theoretical knowledge into practical skills needs to be strengthened. The integration between theory and practice is not close enough. These problems are particularly prominent in experimental teaching, which not only affects the cultivation of students' professional skills, but also poses a potential threat to experimental safety.

[0003] The specific problems in experimental teaching are as follows:

[0004] The phenomenon of tampering: Some students show a fearless and ignorant attitude during the experiment and operate arbitrarily, especially when it comes to professional fields such as high voltage. This behavior can easily lead to safety accidents and become a hidden danger that cannot be ignored.

[0005] Inactivity phenomenon: Another group of students lack enthusiasm in the experiment or even do not participate in the experiment at all due to fear, the complexity of the preparation and recovery process, and resistance to the monotony of the experimental content, which seriously hinders the improvement of their practical ability.

[0006] The phenomenon of fixed operation: the operation procedures provided by most experimental equipment manufacturers on the market are too rigid, and students can only follow the established steps, which makes the experimental process become a formality and lacks exploration and innovation. In addition, the homogeneity of experimental reports is serious, which cannot truly reflect the students' actual operation ability and depth of understanding, and the experimental effect is greatly reduced.

[0007] Limitations of the existing experimental teaching model:

[0008] At present, students generally follow strict schematic diagrams and setting steps to connect and operate the equipment, and only turn on the power after the instructor confirms that everything is correct, in order to avoid risks such as short circuit, overload, leakage and instrument damage. However, this method that relies heavily on teacher inspections limits the cultivation of students' self-inspection and correction abilities.

[0009] In fact, if we can use technical means to record and analyze the students' operation process, reversely draw the corresponding schematic diagram, and compare it with the standard schematic diagram, it will greatly promote students' self-reflection and ability improvement. Unfortunately, there is currently a lack of effective means to achieve a comprehensive portrait of students' wiring and operation process.

[0010] Development trends and demands of digital education:

[0011] With the rapid development of AI technology, digital empowerment of education has become an irreversible trend, providing unlimited possibilities for the innovation of educational models. However, traditional experimental teaching is still insufficient in digital transformation. It lacks both efficient digital management tools and interactive teaching methods that can stimulate students' experimental interest and enhance interactive experience. Therefore, it is particularly important to develop a new type of digital intelligent experimental box that can integrate digital and intelligent technologies, effectively solve the above problems, and improve the quality and effect of experimental teaching. For this purpose, a CNC intelligent experimental platform is designed to solve the above problems. Summary of the invention

[0012] The main purpose of the present invention is to provide a numerical control intelligent experimental platform.

[0013] The purpose of the present invention can be achieved by adopting the following technical solutions:

[0014] A numerical control intelligent experiment platform comprises an experiment box, the experiment box is coupled to a robot mechanical arm, the robot mechanical arm is coupled to a router via a network camera, the router is coupled to a host computer, a simulation board and a server, the server is coupled to a remote network controller, a somatosensory device and the experiment box, and the experiment box is coupled to the simulation board.

[0015] 2. A numerical control intelligent experiment platform according to claim 1, characterized in that: the experiment box is used to perform wiring / unwiring, start / stop and variable adjustment operations through preset switch buttons;

[0016] A robotic arm, which is used to receive instructions from the host computer and accurately perform various actions required for the experiment through its end effector;

[0017] The network camera is used to capture the key actions and scenes in the experiment in real time and transmit the high-definition video stream to the host computer.

[0018] 3. A numerical control intelligent experiment platform according to claim 2, characterized by: a simulation board, which is used to simulate the real environment of the experiment and upload the experimental actions and results to the host computer in real time;

[0019] Remote network controller, which is used by the host computer to remotely power on / off the experimental box through the remote network controller to ensure the safety and controllability of the experimental process;

[0020] Somatosensory device: This somatosensory device is used in the local experiment mode. It can accurately capture the students' experimental operations and roll call information, and generate interactive scenes on the host computer;

[0021] Digital human explanation and intelligent prompts. The digital human equipped with the host computer can explain according to the preset experimental objectives, steps and requirements, and provide intelligent prompts and feedback based on the students' actual operating behaviors.

[0022] 4. According to claim 3, a numerical control intelligent experimental platform is characterized by: it also includes the following control method:

[0023] S1: The experiment starts, which is a remote experiment and a local experiment;

[0024] If the experiment is done remotely, after the students log in to the experimental system, they can operate through the virtual interface of the experimental box in the host computer, including wiring, powering on, conducting experiments according to the experimental manual, disconnecting wires, and powering off. Wiring and disconnecting wires are achieved through button switches;

[0025] If the experiment is conducted locally, students can directly operate the button switch of the experiment box to connect wires, power on, conduct experiments, disconnect wires, and power off.

[0026] Students first interacted through the somatosensory device, and their body and hand contours were recorded;

[0027] In the host computer virtual interface, there are two options: robot completion and manual completion;

[0028] Whether it is a remote experiment or a local experiment, the robot arm can only choose to complete it automatically or manually, and a lock is formed;

[0029] It is better to let the robot arm complete the experiment automatically first, and then do the experiment manually;

[0030] If you encounter difficulties during the experiment and need the demonstration support of the robotic arm, you can pause the experiment, choose the robotic arm to complete it automatically, and then continue to complete it manually after understanding it.

[0031] S2: When the experiment starts, the network camera is started to collect students' experimental images; the auxiliary switch feedback information of the experimental box button is also received through the remote network controller, and the simulation board receives the sensor information and experimental results of the experimental box and uploads them to the host computer.

[0032] S3: Use the deep learning yoloV5 algorithm to perform video image recognition, including students’ facial expressions and body movements;

[0033] At the same time, the timestamp of the video image is recorded to form the duration value of the student's behavior;

[0034] S4: If students have questions during the experiment, they can ask AI questions and answer them. The voice module receives the students’ voices, finds information in the knowledge model library and gives a reply. If it cannot answer the students’ questions, it gives a polite reply.

[0035] S5: During the student experiment, the digital human explains the experimental principles and analyzes the experimental results, and gives prompts if any obvious abnormalities occur.

[0036] Beneficial technical effects of the present invention:

[0037] The present invention provides a numerical control intelligent experiment platform, which adopts an experiment box to adapt to the common actions of different experiments in different majors, improves the flexibility of the platform, and can conveniently provide customized services according to the required professional characteristics and experimental requirements. Through the interaction of somatosensory equipment, the students' experimental enthusiasm is improved. Students can see the schematic diagram generated by their own operation and then make self-corrective modifications to finally complete the correct wiring. Teachers can judge the intrinsic relationship between the students' experimental operations and the knowledge associated with them based on the students' behavioral portraits. The experimental scoring is more objective, and digital evaluation of experimental results is realized. The numerical control intelligent experiment platform solves the problems of random movement, stillness, and movement in students' experiments, and at the same time forms a teaching aid for students' experiments, improves students' experimental interest, and ensures the experimental effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 A system diagram of a preferred embodiment of a numerical control intelligent experiment platform according to the present invention;

[0039] Figure 2 A simulation schematic diagram of a preferred embodiment of a numerical control intelligent experimental platform according to the present invention;

[0040] Figure 3 It is an experimental schematic diagram of a preferred embodiment of a numerical control intelligent experimental platform according to the present invention;

[0041] Figure 4 The present invention provides a student experiment action association diagram according to a preferred embodiment of a numerical control intelligent experiment platform. DETAILED DESCRIPTION

[0042] In order to make the technical solution of the present invention more clear and specific to those skilled in the art, the present invention is further described in detail below in conjunction with embodiments and drawings, but the implementation manner of the present invention is not limited thereto.

[0043] like Figure 1-Figure 4 As shown, this embodiment provides a CNC intelligent experiment platform, and the core function of the experiment box: the experiment box, as the core component of this system, has been deeply transformed and optimized based on the traditional experiment box. The preset switch button replaces the traditional manual wiring method, and the operations such as wiring / disconnecting, starting / stopping and variable adjustment are accelerated and standardized. Students only need to press the button switch of the corresponding wire to complete the complex wiring or disconnecting process, which not only improves the experimental efficiency, but also reduces the difficulty of operation and safety risks.

[0044] In addition to the main switch, the push button switch also has auxiliary contacts, which are connected to the DI terminal of the network remote controller as digital input, and connected to the host computer through its communication port. In this way, the action information of the button is fed back to the host computer. The push button switch is a lock switch. When it is open, pressing it is closed, and when it is closed, pressing it is turned off.

[0045] The experimental box also has sensors that transmit information such as current value and experimental results to the simulation board in the form of analog and switch quantities.

[0046] Robotic arm execution: As the executor of the experimental operation, the robotic arm receives instructions from the host computer and accurately executes various actions required for the experiment through its end effector. This includes but is not limited to wiring / unwiring, starting / stopping experimental equipment, and adjusting experimental variables, etc., realizing the automation and precise control of the experimental process.

[0047] The robot can perform experiments in single steps according to commands, or automatically complete the entire experiment in sequence according to the program, playing the role of a teaching assistant for loop demonstration. The robot arm can stimulate the interest of students who are "immobile" better than the supervision of the experimental teacher, and play the role of teaching guidance such as supervision, guidance and comparison, and promote the formation of a competitive environment, which encourages students to move, so that students can at least observe the experimental steps of the robot and imitate them.

[0048] Camera and video transmission: The webcam captures the key actions and scenes in the experiment in real time and transmits the high-definition video stream to the host computer. This not only facilitates teachers to remotely monitor the experiment, but also provides valuable video data for subsequent experimental analysis and evaluation.

[0049] The video images obtained by the webcam are transmitted to the cloud, firstly as a record of the students' experimental process, and secondly as the original data of the students' experimental behavior as a test set. The cloud saves a large number of samples of students' behavior (including moving around, not moving, and moving) as a training set.

[0050] Simulation board and data upload: The simulation board, which is closely related to the experimental content, can simulate the real environment of the experiment and upload the experimental actions and results to the host computer in real time. Through the synchronous operation of the simulation board and the experimental box, students can intuitively observe the experimental phenomena and results and deepen their understanding of theoretical knowledge.

[0051] The simulation board has analog and switch ports, and receives sensor information and experimental results from the experimental box and uploads them to the host computer.

[0052] Remote network control and safety assurance: The host computer controls the power on / off of the experimental box remotely through the network controller to ensure the safety and controllability of the experimental process. At the same time, the dynamic operation information of the experimental box is transmitted back to the host computer in real time in the form of switch quantity, providing a reliable data source for experimental monitoring and data analysis.

[0053] The remote network controller also receives the auxiliary switch feedback information of the experimental box button and connects to the host computer.

[0054] Knetic somatosensory devices and interactive scenes: In the local experiment mode, Knetic somatosensory devices can accurately capture students' experimental operations and roll call information, and generate interactive scenes on the host computer. This immersive interaction method greatly improves students' participation and learning interest, making the experimental process more vivid and interesting.

[0055] Digital human explanation and intelligent prompts: The digital human equipped with the host computer can explain according to the preset experimental objectives, steps and requirements, and provide intelligent prompts and feedback based on the students' actual operation behaviors. This personalized guidance method helps students correct mistakes in time and deeply understand the experimental principles and processes.

[0056] The host computer obtains video image data from the cloud through a router, controls the operation of the robot through the router, and connects the simulation board, remote network controller, and Knetic somatosensory device. The host computer recognizes students' facial expressions and body movements through machine learning algorithms. The host computer obtains the sensor data corresponding to the results of the students' experimental process and uses this data to profile the students' behavior.

[0057] The experimental box also has a voice module that receives voice information and gives students certain guidance and suggestions based on the information in the model library.

[0058] The platform's operation process and the algorithms and criteria used for action behavior evaluation are as follows:

[0059] S1: The experiment starts, which is divided into two situations: one is remote experiment and the other is local experiment.

[0060] If it is a remote experiment, after the students log in to the experimental system, they can operate through the virtual interface of the experimental box in the host computer, including wiring, power on, experiment according to the experimental manual, disconnection, and power off. Wiring and disconnection are achieved through button switches;

[0061] If it is a local experiment, students directly operate the button switches of the experiment box to connect wires, turn on the power, conduct experiments, remove wires, and turn off the power.

[0062] Students first interacted through the somatosensory device, and their body and hand contours were recorded.

[0063] In the host computer virtual interface, there is a choice between robot arm completion and manual completion. Whether it is a remote experiment or a local experiment, the robot arm can only complete the experiment automatically or manually, and a lock is formed. It is better to let the robot arm complete the experiment automatically first, and then do the experiment manually. If you encounter difficulties during the experiment and need the demonstration support of the robot arm, you can pause the experiment and choose the robot arm to complete it automatically. After understanding, continue to complete it manually.

[0064] S2: Start the experiment, then start the network camera to collect students' experimental images. And receive the auxiliary switch feedback information of the experimental box button through the remote network controller, the simulation board receives the sensor information and experimental results of the experimental box, and uploads them to the host computer.

[0065] S3: Use the deep learning yoloV5 algorithm to perform video image recognition, including students' facial expressions and body movements. At the same time, the timestamp of the video image is recorded to form the duration value of the student's behavior.

[0066] The algorithm criteria are as follows

[0067]

[0068] S4: If students have questions during the experiment, they will ask AI questions and the voice module will receive the students' voices, find information in the knowledge model library and give answers. If the student's question cannot be answered, a polite reply will be given.

[0069] S5: During the student experiment, the digital human completes the explanation of the experimental principle and analysis of the experimental results. If there is any obvious abnormality, a prompt will be given.

[0070] In the experimental box, without loss of generality, taking the series circuit experiment as an example, the adjustable DC power supply is connected in series with a switch, two resistors and an ammeter in sequence. To be more specific, the positive pole of the adjustable DC power supply E is electrically connected to the resistor R1, the resistor R2, and the positive pole A of the ammeter in sequence, and the negative pole of the ammeter is electrically connected to the negative pole of the adjustable DC voltage E.

[0071] The robot arm adopts the RM65 industrial-grade six-axis robot arm with an Ethernet port, which is connected to the cloud through a router and executes the control commands of the host computer. The end effector adopts an electric gripper with soft rubber at the end, and the power supply voltage is DC24V, which can easily press the button switch. The robot arm can reach the specified spatial position through API function calls, and the rotation of the electric gripper can be completed through the rotation of the sixth axis. The end effector can complete the opening and closing actions through RS485 communication commands, thus completing the pressing / opening action of the button switch, completing the wiring / unwiring group; at the same time, the knob adjustment work is completed, and the variable adjustment work is completed. The robot arm can also operate the virtual buttons on the host computer, and the host computer uses a touch screen.

[0072] The camera uses a JM-W5073T-Y network camera, which supports POE power supply and RTSP video streaming. It is connected to the cloud through a router and the video is displayed in real time on the host computer.

[0073] The simulation board is the simulation board corresponding to the experimental box, that is, it has both the actual experimental circuit and the corresponding simulation development board, which can complete the simulation of the experimental circuit, so as to facilitate the combination of theory and practice and achieve the experimental purpose. The host computer is installed with the corresponding simulation software. Taking the automatic control principle experiment as an example, its simulation interface is as follows Figure 2 As shown;

[0074] The virtual buttons in the diagram are "Disconnect", "1V Step", "3V Step", "Unit Speed", "Unit Acceleration", "Clear Waveform", "Stop", etc.

[0075] During the remote experiment, for safety reasons, the experimental box needs to be powered off remotely, which is done through a remote network controller, which is connected to the computer. The network controller uses the corx-16DI / 8DO type. It can ensure safety and transmit the dynamic operation information of the experimental box back to the host computer in the form of switch quantity. The experimental schematic diagram is shown in Figure 3.

[0076] The upper computer interface is divided into three parts: the left side is the information management area, the middle is the real-time image area, and the rightmost is the operation area. The upper part of the operation area corresponds to the buttons and knobs of the experimental box, and the lower part is in the form of a game controller to control the position adjustment of the robot arm and the execution rotation and clamping / relaxation of the end effector.

[0077] Kinect somatosensory devices use Xbox. When students are called, they do not use hand signatures or scan QR codes, but somatosensory interactive devices, and the images and outlines of students are presented. At the same time, all the actions of students during the experiment are given an association. For example, in the figure below, the actions of students during the experiment are converted into an artistic form. Only when the students' experimental steps are complete and correct can they be given positive artistic representations in the end, otherwise they will be negative, so as to improve the initiative of students' experiments. The form of artistic presentation is set according to the content of the experiment.

[0078] The host computer is equipped with a digital human to explain the preset experimental purpose, steps and experimental requirements, and provide prompts based on the students' operating behaviors.

[0079] The method for digitally evaluating students' performance based on the schematic diagram formed by the experimental students' wiring is as follows:

[0080] During the student experiment, the wiring was done by pressing buttons. In theory, the connections could be made arbitrarily before the power was turned on. However, the recorded traces were judged according to three categories:

[0081] The first category is the wiring process that may cause a short circuit and burn the instrument. At this time, a red alarm will be given on the upper computer screen, and the digital human will give a reminder. This means that the student has not understood the experimental content in principle. Then the principle explanation will be pushed.

[0082] The second type is that students may not have formed a corresponding relationship between the schematic symbols and the physical terminals. In this case, a yellow alarm will be given on the upper computer screen, and the digital human will give a reference reminder. This means that students should strengthen their recognition of objects, and then push the physical appearance diagram and physical terminal diagram.

[0083] The third category is the wiring process that may cause an open circuit. This type of problem can be modified by discovering the problem, so it can be ignored.

[0084] This digital evaluation method represents the underlying logic of students' experiments through phenomena, thereby improving experimental results.

[0085] The above description is only a further embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical solutions and concepts of the present invention within the scope disclosed by the present invention, which belong to the protection scope of the present invention.

Claims

1. A numerical control intelligent experimental platform, characterized by: It includes an experimental box, the experimental box is coupled to a robot arm, the robot arm is coupled to a router via a network camera, the router is coupled to a host computer, a simulation board and a server, the server is coupled to a remote network controller, a somatosensory device and the experimental box, and the experimental box is coupled to the simulation board.

2. A numerical control intelligent experimental platform according to claim 1, characterized in that: The experiment box is used to perform wiring / unwiring, start / stop and variable adjustment operations through preset switch buttons; A robotic arm, which is used to receive instructions from the host computer and accurately perform various actions required for the experiment through its end effector; The network camera is used to capture the key actions and scenes in the experiment in real time and transmit the high-definition video stream to the host computer.

3. A numerical control intelligent experimental platform according to claim 2, characterized in that: Simulation board, which is used to simulate the real environment of the experiment and upload the experimental actions and results to the host computer in real time; Remote network controller, which is used by the host computer to remotely power on / off the experimental box through the remote network controller to ensure the safety and controllability of the experimental process; Somatosensory device: This somatosensory device is used in the local experiment mode. It can accurately capture the students' experimental operations and roll call information, and generate interactive scenes on the host computer; Digital human explanation and intelligent prompts. The digital human equipped with the host computer can explain according to the preset experimental objectives, steps and requirements, and provide intelligent prompts and feedback based on the students' actual operating behaviors.

4. A numerical control intelligent experimental platform according to claim 3, characterized in that: Also includes the following control methods: S1: The experiment starts, which is a remote experiment and a local experiment; If the experiment is done remotely, after the students log in to the experimental system, they can operate through the virtual interface of the experimental box in the host computer, including wiring, powering on, conducting experiments according to the experimental manual, disconnecting wires, and powering off. Wiring and disconnecting wires are achieved through button switches; If the experiment is conducted locally, students can directly operate the button switch of the experiment box to connect wires, power on, conduct experiments, disconnect wires, and power off. Students first interacted through the somatosensory device, and their body and hand contours were recorded; In the host computer virtual interface, there are two options: robot completion and manual completion; Whether it is a remote experiment or a local experiment, the robot arm can only choose to complete it automatically or manually, and a lock is formed; It is better to let the robot arm complete the experiment automatically first, and then do the experiment manually; If you encounter difficulties during the experiment and need the demonstration support of the robotic arm, you can pause the experiment, choose the robotic arm to complete it automatically, and then continue to complete it manually after understanding it. S2: When the experiment starts, the network camera is started to collect students' experimental images; the auxiliary switch feedback information of the experimental box button is also received through the remote network controller, and the simulation board receives the sensor information and experimental results of the experimental box and uploads them to the host computer. S3: Use the deep learning yoloV5 algorithm to perform video image recognition, including students’ facial expressions and body movements; At the same time, the timestamp of the video image is recorded to form the duration value of the student's behavior; S4: If students have questions during the experiment, they can ask AI questions and answer them. The voice module receives the students’ voices, finds information in the knowledge model library and gives a reply. If it cannot answer the students’ questions, it gives a polite reply. S5: During the student experiment, the digital human explains the experimental principles and analyzes the experimental results, and gives prompts if any obvious abnormalities occur.