Multi-mode composite robot teaching system and platform

Abstract

The invention discloses a multi-mode composite robot teaching system and platform, and relates to the technical field of robot teaching, and the robot teaching system comprises a robot mechanical module, a robot electric control module and a teaching demonstration end. A perfect robot teaching system is constructed, image-text teaching videos and text information related to an instruction are automatically generated by inputting the operation instruction corresponding to the robot to be inquired, the robot teaching function can be achieved, the mechanical arm motion path data collection and action reproduction function can be achieved according to the actual operation requirement, the system design is flexible, and the operation is convenient. The robot teaching data and corresponding analysis results are managed, visualized and stored, robot teaching management can be achieved through internet cloud management and control, the intelligent level of robot teaching management is improved, and meanwhile relevant information of corresponding robots can be learned according to different types of assembled finished robots.

Description

Technical Field

[0001] The present invention relates to the technical field of robot teaching, and in particular to a multi-modal composite robot teaching system and platform. Background Art

[0002] Currently known similar robot products have shortcomings such as few structural cases, insufficient application scenarios, few technical applications, and low system integration. They can only meet some teaching needs. Once the teaching needs change, they cannot flexibly match the teaching objectives, resulting in low utilization of equipment resources.

[0003] The following problems exist when using robots in the prior art: there are certain thresholds for assembling, getting started, and operating robots required for different scenarios. No teaching and learning has been conducted, which affects the subsequent management of robots. The selection, construction, and use of robots in different teaching scenarios is also a problem that needs to be solved. The learning content cannot be guaranteed to be updated and fed back in a timely manner, which makes it difficult to quickly query the most suitable video and graphic learning data for learners during teaching, which lengthens the overall teaching operation cycle.

[0004] Therefore, the present invention needs to design a multi-modal composite robot teaching system and platform to solve the above-mentioned problems. Summary of the invention

[0005] The purpose of the present invention is to provide a multi-modal composite robot teaching system and platform in order to solve the above problems, thereby solving the problems mentioned in the background technology.

[0006] In order to solve the above problems, the present invention provides a technical solution:

[0007] A multi-modal composite robot teaching system, the robot teaching system comprises a robot mechanical module, a robot electric control module and a teaching demonstration terminal, the teaching demonstration terminal maintains real-time data communication and sharing with the robot mechanical module and the robot electric control module through the Internet of Things, and a staff member logs into the Internet of Things to enter the robot teaching system and query the real-time operation data of the robot mechanical module and the robot electric control module one by one;

[0008] The robot mechanical module is used to receive instructions for the movement of the robot, and thus control the robot to move horizontally, reciprocate, swing, adjust the angle, and adjust the height according to the instructions until the robot moves to a position that meets the requirements, and to depict and record the surrounding environment during the movement of the robot;

[0009] The robot electric control module is used to synchronize and visualize the matters and data currently being processed by the robot device, and is also used to monitor the internal power supply change data when the robot moves in real time, and predict the time point when the power is about to run out by means of a bar chart;

[0010] The teaching demonstration end is used to provide the required power equipment, assembly videos, usage scenarios and function introductions for the robots that need to be assembled into corresponding models. By inputting the corresponding operation instructions of the robot to be queried, graphic teaching videos and text information related to the instructions are automatically generated.

[0011] As a preferred technical solution, the output end of the robot mechanical module is communicatively connected to the input end of the robot electric control module, and the robot electric control module is bidirectionally communicatively connected to the teaching demonstration end.

[0012] As a preferred technical solution, the robot mechanical module includes a linear module control unit, a robotic arm control unit, a chassis control unit and a visual capture unit, and the output ends of the linear module control unit, the robotic arm control unit, the chassis control unit and the visual capture unit are all communicatively connected to the input end of the robot electronic control module.

[0013] As a preferred technical solution, the linear module control unit is used to receive instructions for the movement of the robot, thereby controlling the robot to move laterally and reciprocate according to the instructions until it moves to a position that meets the requirements;

[0014] The robot arm control unit is used to receive instructions for the robot to swing, and then control the robot to swing, adjust the angle, and adjust the height according to the instructions until it moves to a position that meets the requirements, so as to meet the robot's various operating scenarios and improve the flexibility of the device.

[0015] The chassis control unit is used to control the chassis elevation process according to the requirements of the moving scene, and is also used to buffer the vibration generated during the movement, and at the same time record the damage caused to the chassis to facilitate manual unified maintenance;

[0016] The visual capture unit is used to depict and record the surrounding environment of the robot during its movement. When manually input keywords are retrieved, they are marked and visual queries are performed by generating a table. In this way, even if the keywords retrieved at the beginning are not in the depicted record, the keywords can be changed later and searched again in the record until the required content is found.

[0017] As a preferred technical solution, the robot electronic control module includes a main control display unit, a drive unit, a power management unit and a wireless control unit, and the output end of the wireless control unit is communicatively connected to the input ends of the main control display unit, the drive unit and the power management unit respectively.

[0018] As a preferred technical solution, the main control display unit is used to synchronously visualize the matters and data currently being processed by the robot device, so that on-site operators can observe which stage the operation is in progress;

[0019] The drive unit is used to monitor and control various devices for the movement of the robot in real time, including a steering gear drive device and a drive motor;

[0020] The power management unit is used to monitor the internal power change data of the robot in real time when it moves, and predict the time node when the power is about to run out in the form of a bar graph, so as to remind the remote staff to replace the battery immediately or perform autonomous charging;

[0021] The wireless control unit is used to remotely control the robot equipment, including controlling the robot's steering, stopping operation, autonomous charging, planning new routes, synchronous display of panel data, ultrasonic on-site detection, and laser radar real-time positioning.

[0022] As a preferred technical solution, the teaching demonstration end includes an assembly demonstration unit, an operation teaching unit, a learning achievement feedback unit and a mobile control end, and the assembly demonstration unit and the operation teaching unit are both connected to the learning achievement feedback unit in two-way communication.

[0023] As a preferred technical solution, the assembly demonstration unit is used to provide the required power equipment, assembly video, usage scenarios and function introduction for the robots that need to be assembled into corresponding models. The robots that can be assembled include ROS handling robots, ROS service robots, ROS basic robots, ROS autonomous driving robots, intelligent collaborative robots, high-precision coordinate robots, smart security inspection robots, smart agricultural picking robots, smart logistics handling robots, and smart logistics palletizing robots.

[0024] The operation teaching unit is used to input the corresponding operation instructions of the robot to be queried, and automatically generate graphic teaching videos and text information related to the instructions;

[0025] The learning achievement feedback unit is used to perform optional feedback processing on the graphic teaching video and text information after learning, explain the defects therein, and push the modified graphic teaching video and text information again during the next learning, and perform secondary feedback after manual re-learning, so as to achieve the purpose of continuously improving the teaching quality;

[0026] The mobile control terminal is used by learners to control robots, assemble demonstration units, and operate teaching units by using mobile control devices. When entering different control areas, they need to authenticate the same level of authority and intercept unidentified information.

[0027] As a preferred technical solution, the robot teaching system also includes an Internet data access module, which updates the teaching video in real time and classifies and annotates the added teaching video. The annotated content includes information such as the time of joining, the teaching category to which it belongs, and feedback from other people after learning. These information can be sorted out one by one in a table, making it convenient for manual search of keywords to search for relevant content that needs to be learned.

[0028] A multi-modal composite robot teaching platform comprises the multi-modal composite robot teaching system as described above.

[0029] The beneficial effects of the present invention are as follows: the present invention constructs a complete robot teaching system by setting up a robot mechanical module, a robot electronic control module and a teaching demonstration terminal. In actual use, the robot mechanical module receives instructions for robot movement, thereby controlling the robot to move horizontally, reciprocate, swing, adjust the angle and adjust the height according to the instructions until it moves to a position that meets the requirements. The surrounding environment during the movement of the robot is depicted, recorded and processed. The robot electronic control module synchronously visualizes the matters and data currently processed by the robot device, and is used to monitor the internal power supply change data of the robot in real time when it moves. The bar graph is used to predict the time node when the power is about to run out, and the teaching demonstration terminal is used to assemble the robot into the corresponding model. The robot provides the required power equipment, assembly videos, usage scenarios and function introductions. By inputting the corresponding operation instructions of the robot to be queried, it automatically generates graphic teaching videos and text information related to the instructions. The present invention can realize the machine teaching function, and realize the collection of robot arm motion path data and action reproduction functions through actual operation requirements. The system design is flexible, supports multiple teaching modes and content updates, and is easy to expand and upgrade to meet future educational needs. It manages, visualizes and stores robot teaching data and corresponding analysis results, which helps to realize robot teaching management through Internet cloud management and control, and improve the intelligence level of robot teaching management. At the same time, the relevant information of the corresponding robot can be learned according to the different categories of the finished robots after assembly. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] For ease of explanation, the present invention is described in detail with reference to the following specific implementations and the accompanying drawings.

[0031] Figure 1 It is a topological diagram of the overall system structure of the multi-modal composite robot teaching system and platform of the present invention. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0033] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, and "multiple" generally includes at least two.

[0034] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0035] It should be understood that although the terms first, second, third, etc. may be used to describe in the embodiments of the present application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, without departing from the scope of the embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first.

[0036] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0037] It should also be noted that the term "includes", "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, so that a commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the commodity or device including the elements.

[0038] It should be particularly noted that any symbols and / or numbers in the specification that are not marked in the accompanying drawings are not drawing marks.

[0039] The optional embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0040] like Figure 1 As shown, this specific implementation adopts the following technical solutions:

[0041] A multi-modal composite robot teaching system, the robot teaching system comprises a robot mechanical module, a robot electric control module and a teaching demonstration end, the teaching demonstration end maintains real-time data intercommunication and sharing with the robot mechanical module and the robot electric control module through the Internet of Things, and a staff member logs into the Internet of Things to enter the robot teaching system and query the real-time operation data of the robot mechanical module and the robot electric control module one by one; the output end of the robot mechanical module is communicatively connected with the input end of the robot electric control module, and the robot electric control module and the teaching demonstration end are bidirectionally communicatively connected;

[0042] The robot mechanical module is used to receive instructions for the movement of the robot, and thus control the robot to move horizontally, reciprocate, swing, adjust the angle, and adjust the height according to the instructions until the robot moves to a position that meets the requirements, and to depict and record the surrounding environment during the movement of the robot;

[0043] The robot electric control module is used to synchronize and visualize the matters and data currently being processed by the robot device, and is also used to monitor the internal power supply change data when the robot moves in real time, and predict the time point when the power is about to run out by means of a bar chart;

[0044] The teaching demonstration end is used to provide the required power equipment, assembly videos, usage scenarios and function introductions for the robots that need to be assembled into corresponding models. By inputting the corresponding operation instructions of the robot to be queried, graphic teaching videos and text information related to the instructions are automatically generated.

[0045] In this solution, the robot mechanical module includes a linear module control unit, a mechanical arm control unit, a chassis control unit and a visual capture unit. The output ends of the linear module control unit, the mechanical arm control unit, the chassis control unit and the visual capture unit are all connected to the input end of the robot electronic control module. The linear module control unit is used to receive the robot movement instruction, thereby controlling the robot to move horizontally and reciprocate according to the instruction until it moves to a position that meets the requirements; the mechanical arm control unit is used to receive the robot swing instruction, thereby controlling the robot to swing, adjust the angle and adjust the height according to the instruction until it moves to a position that meets the requirements, meeting the robot's various scene operations and improving the flexibility of the equipment; the chassis control unit is used to control the chassis elevation processing according to the needs of the mobile scene, and is also used to buffer the vibration generated during the movement, and record the damage caused to the chassis at the same time, so as to facilitate manual unified maintenance processing; the visual capture unit is used to depict and record the surrounding environment during the robot movement, and mark when the manually input keywords are retrieved, and perform visual query by generating a table, so that even if the keywords retrieved at the beginning are not in the depicted record, the keywords can be changed later and can be retrieved again in the record until the required content is found.

[0046] In this solution, the robot electronic control module includes a main control display unit, a drive unit, a power management unit and a wireless control unit. The output end of the wireless control unit is respectively connected to the input end of the main control display unit, the drive unit and the power management unit. The main control display unit is used for synchronous visualization of the matters and data currently being processed by the robot device, so as to facilitate on-site workers to observe which stage the operation is in progress; the drive unit is used for real-time monitoring of various devices that control the movement of the robot, including a servo drive device and a drive motor; the power management unit is used for real-time monitoring of the internal power change data when the robot moves, and predicting the time node when the power is about to run out by means of a bar chart, so as to remind the remote staff to replace the battery immediately or perform autonomous charging; the wireless control unit is used for remote control of the robot device, including controlling the robot to turn, stop running, autonomously charge, plan a new route, synchronously display panel data, ultrasonic on-site detection, and real-time positioning of the laser radar.

[0047] In this solution, the teaching demonstration end includes an assembly demonstration unit, an operation teaching unit, a learning outcome feedback unit and a mobile control end. The assembly demonstration unit and the operation teaching unit are both connected to the learning outcome feedback unit for two-way communication. The assembly demonstration unit is used to provide the required power equipment, assembly videos, usage scenarios and function introductions for the robots that need to be assembled into corresponding models. The robots that can be assembled include ROS handling robots, ROS service robots, ROS basic robots, ROS autonomous driving robots, intelligent collaborative robots, high-precision coordinate robots, smart security inspection robots, smart agricultural picking robots, smart logistics handling robots, and smart logistics stacking robots; the operation teaching unit It is used to input the corresponding operation instructions of the robot to be queried, and automatically generate graphic teaching videos and text information related to the instructions; the learning achievement feedback unit is used to perform optional feedback processing on the graphic teaching videos and text information after learning, explain the defects therein, and push the modified graphic teaching videos and text information again during the next learning, and perform secondary feedback after manual re-learning, so as to achieve the purpose of continuously improving the teaching quality; the mobile control terminal is used for learners to control robots, assemble demonstration units, and operate teaching units by using mobile control devices. When entering different control areas, they need to authenticate the same level of authority and intercept unidentified information.

[0048] In this solution, the robot teaching system also includes an Internet data access module, which updates the teaching video in real time and classifies and annotates the added teaching video. The annotated content includes information such as the time of joining, the teaching category to which it belongs, and feedback from other people after learning. These information can be sorted out one by one in a table, making it convenient for manual search of keywords to search for relevant content that needs to be learned.

[0049] A multi-modal composite robot teaching platform comprises the multi-modal composite robot teaching system as described above.

[0050] Example

[0051] When the teaching system is connected to the robot management:

[0052] S1. The staff checks the equipment required for remote and on-site operations one by one. After verifying that there are no problems, the robot teaching system is started. The linear module control unit receives the robot's movement instructions, and controls the robot's lateral movement and reciprocating motion according to the instructions. The robotic arm control unit receives the robot's swing instructions, and controls the robot's swing, angle adjustment, and height adjustment according to the instructions until it moves to a position that meets the requirements, meeting the robot's various scene operations and improving the equipment's flexibility. The chassis control unit controls the chassis elevation process according to the needs of the mobile scene, buffers the vibration generated during the movement, and records the damage caused to the chassis at the same time, facilitating manual unified maintenance. The visual capture unit depicts and records the surrounding environment during the robot's movement, annotates when manually input keywords are retrieved, and generates a table for visual query. In this way, even if the keywords retrieved at the beginning are not in the depicted record, the keywords can be changed later and searched again in the record until the required content is found;

[0053] S2. The main control display unit synchronously visualizes the matters and data currently being processed by the robot device, making it convenient for on-site operators to observe which stage the operation is in progress. The drive unit is used to monitor in real time the various devices that control the movement of the robot, including the steering gear drive device and the drive motor. The power management unit monitors in real time the internal power change data when the robot moves, and predicts the time node when the power is about to run out in the form of a bar chart, so as to remind the remote staff to replace the battery immediately or perform autonomous charging. The wireless control unit is used to remotely control the robot device, including controlling the robot to turn, stop running, autonomously charge, plan a new route, synchronously display panel data, ultrasonic on-site detection, and laser radar real-time positioning;

[0054] S3. The assembly demonstration unit provides the required power equipment, assembly videos, usage scenarios and function introductions for the robots that need to be assembled into the corresponding models. The robots that can be assembled include ROS handling robots, ROS service robots, ROS basic robots, ROS autonomous driving robots, intelligent collaborative robots, high-precision coordinate robots, smart security inspection robots, smart agricultural picking robots, smart logistics handling robots, and smart logistics stacking robots. The operation teaching unit inputs the corresponding operation instructions of the robot to be queried, and automatically generates graphic teaching videos and text information related to the instructions. The learning achievement feedback unit performs optional feedback processing after learning graphic teaching videos and text information, explains the defects therein, and pushes the modified graphic teaching videos and text information again during the next learning. After manual re-learning, secondary feedback is given to achieve the purpose of continuously improving the teaching quality. The mobile control terminal is used for learners to control robots, assembly demonstration units, and operation teaching units by using mobile control devices. When entering different control areas, it is necessary to authenticate the same level of authority and intercept unknown identity information;

[0055] S4. Internet data access module updates teaching videos in real time through the Internet data access module, classifies and annotates the added teaching videos. The annotated content includes information such as the time of joining, the teaching category to which it belongs, and feedback from other people after learning. These information can be sorted out one by one in a table, so that it is convenient for manual use to search for relevant content that needs to be learned by searching for keywords.

[0056] Specifically: In actual applications, there are multiple teaching demonstration terminals, which are respectively used in conjunction with the robot mechanical module and the robot electronic control module. The multiple teaching demonstration terminals are located in different geographical locations. The present invention constructs a complete robot teaching system by setting a robot mechanical module, a robot electronic control module and a teaching demonstration terminal. In actual use, the robot mechanical module receives instructions for robot movement, thereby controlling the robot to move horizontally, reciprocate, swing, adjust the angle, and adjust the height according to the instructions until it moves to a position that meets the requirements. The surrounding environment during the movement of the robot is depicted, recorded, and processed. The robot electronic control module synchronously visualizes the matters and data currently processed by the robot device, and is used to monitor the internal power supply change data when the robot moves in real time, and predict the power in the form of a bar graph. At the time point that is about to run out, the teaching demonstration terminal provides the robot that needs to be assembled into the corresponding model with the required power equipment, assembly video, usage scenario and function introduction. By inputting the corresponding operation instructions of the robot to be queried, the graphic teaching video and text information related to the instructions are automatically generated. The present invention can realize the machine teaching function, and realize the collection and action reproduction functions of the robot arm motion path data through actual operation requirements. The system design is flexible, supports multiple teaching modes and content updates, and is easy to expand and upgrade to meet future educational needs. The robot teaching data and the corresponding analysis results are managed, visualized and stored, which is helpful to realize robot teaching management through Internet cloud management and control, and improve the intelligent level of robot teaching management. At the same time, the relevant information of the corresponding robot can be learned according to the different categories of the finished robots after assembly.

[0057] Those of ordinary skill in the art will appreciate that the modules and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0058] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, equipment and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0059] In the several embodiments provided in the present application, it should be understood that the disclosed devices, systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or units can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or equipment, which can be electrical, mechanical or other forms.

[0060] The modules as the robot mechanical module, the robot electric control module and the teaching demonstration end may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0061] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

[0062] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program instructions, such as a USB flash drive, a mobile hard disk, a read-only storage server, a random access storage server, a magnetic disk or an optical disk.

[0063] In addition, it should be noted that the combination of the various technical features in this case is not limited to the combination described in the claims of this case or the combination described in the specific embodiments. All technical features described in this case can be freely combined or combined in any way unless there is a contradiction between them.

[0064] It should be noted that the above examples are only specific embodiments of the present invention, and the present invention is obviously not limited to the above examples, and there are many similar variations. All variations directly derived or associated from the contents disclosed by the technicians in this field should fall within the protection scope of the present invention.

[0065] The above are only preferred embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A multi-modal composite robot teaching system, characterized in that: The robot teaching system includes a robot mechanical module, a robot electric control module and a teaching demonstration terminal. The teaching demonstration terminal maintains real-time data communication and sharing with the robot mechanical module and the robot electric control module through the Internet of Things. The staff logs into the Internet of Things to enter the robot teaching system and query the real-time operation data of the robot mechanical module and the robot electric control module one by one. The robot mechanical module is used to receive instructions for the movement of the robot, and thus control the robot to move horizontally, reciprocate, swing, adjust the angle, and adjust the height according to the instructions until the robot moves to a position that meets the requirements, and to depict and record the surrounding environment during the movement of the robot; The robot electric control module is used to synchronize and visualize the matters and data currently being processed by the robot device, and is also used to monitor the internal power supply change data when the robot moves in real time, and predict the time point when the power is about to run out by means of a bar chart; The teaching demonstration end is used to provide the required power equipment, assembly videos, usage scenarios and function introductions for the robots that need to be assembled into corresponding models. By inputting the corresponding operation instructions of the robot to be queried, graphic teaching videos and text information related to the instructions are automatically generated.

2. The multi-modal composite robot teaching system according to claim 1, characterized in that: The output end of the robot mechanical module is communicatively connected to the input end of the robot electric control module, and the robot electric control module is bidirectionally communicatively connected to the teaching demonstration end.

3. The multi-modal composite robot teaching system according to claim 1, characterized in that: The robot mechanical module includes a linear module control unit, a robotic arm control unit, a chassis control unit and a visual capture unit, and the output ends of the linear module control unit, the robotic arm control unit, the chassis control unit and the visual capture unit are all communicatively connected to the input end of the robot electronic control module.

4. The multi-modal compound robot teaching system according to claim 3, characterized in that: The linear module control unit is used to receive instructions for the movement of the robot, thereby controlling the robot to move horizontally and reciprocate according to the instructions; The robot arm control unit is used to receive instructions for the robot to swing, thereby controlling the robot to swing, adjust the angle, and adjust the height according to the instructions; The chassis control unit is used to control the chassis elevation process according to the requirements of the moving scene, and is also used to buffer the vibration generated during the moving process; The visual capture unit is used to depict, record and process the surrounding environment of the robot during its movement.

5. The multi-modal compound robot teaching system according to claim 1, characterized in that: The robot electric control module includes a main control display unit, a drive unit, a power management unit and a wireless control unit. The output end of the wireless control unit is communicatively connected with the input ends of the main control display unit, the drive unit and the power management unit respectively.

6. The multi-modal compound robot teaching system according to claim 5, characterized in that: The main control display unit is used for synchronous visualization of the matters and data currently being processed by the robot device; The driving unit is used to monitor and control various devices that move the robot in real time; The power management unit is used to monitor the internal power change data of the robot in real time when it moves; The wireless control unit is used for remotely controlling the robot device.

7. The multi-modal compound robot teaching system according to claim 1, characterized in that: The teaching demonstration end comprises an assembly demonstration unit, an operation teaching unit, a learning achievement feedback unit and a mobile control end. Both the assembly demonstration unit and the operation teaching unit are connected to the learning achievement feedback unit for two-way communication.

8. The multi-modal compound robot teaching system according to claim 7, characterized in that: The assembly demonstration unit is used to provide the required power equipment, assembly videos, usage scenarios and function introductions for the robot that needs to be assembled into the corresponding model; The operation teaching unit is used to input the corresponding operation instructions of the robot to be queried, and automatically generate graphic teaching videos and text information related to the instructions; The learning achievement feedback unit is used to perform optional feedback processing after learning graphic teaching videos and text information, and explain the defects therein; The mobile control terminal is used by learners to control the robot, assemble the demonstration unit, and operate the teaching unit by using the mobile control device.

9. The multi-modal compound robot teaching system according to claim 1, characterized in that: The robot teaching system also includes an Internet data access module, through which the teaching videos are updated in real time and the added teaching videos are classified and labeled.

10. A multi-modal composite robot teaching platform, characterized in that: It comprises a multi-modal composite robot teaching system as described in any one of claims 1 to 9.

Images