Robot remote real-time control method, system, electronic device and storage medium

By double-division processing of real-time position instructions and feedback information blocking control in the lower computer, the problem of poor real-time performance in robot remote control is solved, and the precise and stable control of the robot is achieved, and the real-time and accuracy of remote control is improved. .

CN114598729BActive Publication Date: 2024-11-26SHANGHAI JIEKA ROBOT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210209183.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-04
Publication Date
2024-11-26
Estimated Expiration
2042-03-04

AI Technical Summary

Technical Problem

In the prior art, the real-time nature of remote control of robots is affected by network fluctuations and the speed at which the host computer generates real-time instructions, resulting in the command sending and execution being out of synchronization, affecting the control effect.

Method used

By splitting real-time position instructions using double-point parameters in the lower computer, a motion control instruction that meets the instruction processing cycle is generated, and gradually sends it in the instruction call cycle, precise control of the control robot is achieved, and blocking with feedback information. Control to ensure synchronization of the command call cycles of the upper and lower computers.

Benefits of technology

The accuracy and stability of remote real-time control of the robot is achieved, and the control is not synchronized due to network fluctuations and command speed differences is avoided, and the real-time and accuracy of remote control is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114598729B_ABST
    Figure CN114598729B_ABST
Patent Text Reader

Abstract

The present application provides a robot remote real-time control method, system, electronic device and storage medium. Applied to a lower computer, the method includes: receiving a remote command call request sent by a host computer, the remote command call request includes parameter configuration and real-time position command, the parameter configuration includes a multiple parameter n, and the real-time position command is a position command executed by the host computer within an instruction call cycle nT; splitting the real-time position command according to the multiple parameter n, obtaining n motion control commands, and generating feedback information; sending n motion control commands to the robot to be controlled in sequence according to the instruction processing cycle T; returning the feedback information to the host computer. The lower computer receives the remote command call request of the host computer, realizes real-time control of the robot according to the multiple parameter and feedback information, and uses the feedback information to control the host computer to send the next request, thereby realizing remote real-time control of the robot and improving the accuracy of instruction execution.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a robot remote real-time control method, system, electronic device and storage medium. Background Art

[0002] As the cost of human resources in society increases, robots are being widely used in various fields, replacing humans in some dangerous and heavy labor, thus changing the way of life. For some complex motion trajectories, the real-time requirements for robot remote control are very high.

[0003] In the prior art, the upper computer sends the real-time instructions to be executed to the lower computer, and the lower computer directly controls the movement of the robot to achieve the effect of remote real-time control. However, due to network fluctuations and the speed at which the upper computer generates real-time instructions, it is easy to cause the sending and execution of real-time instructions to be out of sync, affecting the remote real-time control effect of the robot. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a method, system, electronic device and storage medium for remote real-time control of a robot, so as to achieve precise remote real-time control of the robot.

[0005] In the first aspect, an embodiment of the present application provides a robot remote real-time control method, which is applied to a lower computer, and the method includes: receiving a command remote call request sent by a host computer, the command remote call request including a parameter configuration and a real-time position command, the parameter configuration including a multiple parameter n, the real-time position command is a position command executed by the host computer within an command call cycle nT, T is the command processing cycle of the lower computer, n is a positive integer, and T is a positive number; the real-time position command is split according to the multiple parameter n to obtain n motion control commands, and feedback information is generated; n motion control commands are sent to the robot to be controlled in sequence according to the command processing cycle T, so that the robot to be controlled executes n motion control commands respectively; the feedback information is returned to the host computer, so that the host computer sends the next command remote call request to the lower computer.

[0006] In the embodiment of the present application, the lower computer receives the remote call request of the command sent, and then splits the real-time command according to the multiple parameter n in the remote call request of the command, obtains n motion control commands that meet the processing cycle T of the lower computer, and sends the motion control commands to the robot to be controlled in sequence according to the command processing cycle T, realizes the control of the robot to be controlled, and generates feedback information so that the upper computer continues to send the next remote call request of the command. The splitting process of the real-time position command is realized by the lower computer, and the blocking control sent by the upper computer is realized by using the feedback information, thereby realizing the remote and real-time precise control of the robot to be controlled.

[0007] Furthermore, the real-time position instruction is split according to the division parameter n to obtain motion control instructions and generate feedback information, including: within the instruction call cycle nT, starting timing from a flag time processing point preset in the lower computer; after receiving the instruction remote call request, setting the instruction flag preset in the lower computer; splitting the real-time position instruction according to the division parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T; performing kinematic calculations on the n sub-motion instructions respectively to generate n motion control instructions; when the timing reaches nT, resetting the instruction flag and generating feedback information.

[0008] In the embodiment of the present application, within the instruction cycle nT, the timing is started from the flag time processing point preset in the lower computer. After receiving the instruction remote call request, the lower computer sets the instruction flag preset in the lower computer. During the timing process, the instruction remote call request is not ended and remains blocked. During the timing process, the lower computer can also split the real-time position instruction according to the multiple parameter n to obtain n motion control instructions. Since the instruction processing cycle of the lower computer is T, the generated sub-motion instructions are processed respectively in each T cycle, and n motion control instructions are sent to the robot to be controlled respectively. After the timing reaches nT, the instruction flag is reset and feedback information is generated. The lower computer is used to split and calculate the real-time position instruction to obtain the motion control instruction, and the blocked sending of the feedback information is completed by modifying and resetting the instruction flag, so as to achieve the consistency between the instruction call cycle of the upper computer and the total instruction processing cycle of the lower computer.

[0009] Furthermore, the parameter configuration also includes a filtering configuration. After the real-time position instruction is split according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T, the method also includes: judging whether to start filtering processing according to the filtering configuration; if so, obtaining the filter or filtering algorithm preset in the lower computer according to the filtering configuration; smoothing the n sub-motion instructions according to the filtering or the filtering algorithm to obtain sub-smooth motion instructions corresponding to the sub-motion instructions; accordingly, performing kinematic calculations on the n sub-motion instructions respectively, including: performing kinematic calculations on the n sub-smooth motion instructions respectively.

[0010] In an embodiment of the present application, the parameter configuration also includes a filtering configuration. After the real-time position instruction is split according to the multiple parameter n and the sub-motion instruction that meets the instruction processing cycle T is obtained, it is first determined whether to start the filtering process according to the filtering configuration. If so, the preset filtering or filtering algorithm in the lower computer is obtained, and then each sub-motion instruction is smoothed according to the filtering or filtering algorithm, and then the generated sub-smoothed motion instruction is continued to be kinematically calculated, thereby achieving smooth processing of the motion control instruction, achieving the fitting of the robot's motion trajectory and the preset trajectory, and ensuring the smooth transition of each real-time position coordinate point.

[0011] In a second aspect, an embodiment of the present application provides a method for remote real-time control of a robot, which is applied to a host computer, and the method includes: obtaining a position instruction to be executed and a parameter configuration, wherein the position instruction to be executed is an instruction for controlling the robot to be controlled to reach a preset position, and the parameter configuration includes a multiple parameter n, wherein n is a positive integer; generating a plurality of real-time position instructions that conform to the instruction call period nT of the host computer according to the position instruction to be executed and the multiple parameter n, wherein T is the instruction processing period of the lower computer, and T is a positive number; generating a plurality of instruction remote call requests according to the plurality of real-time position instructions and the parameter configuration; sending the instruction remote call request to the lower computer, and sending the next instruction remote call request after receiving the feedback information sent by the lower computer, so as to realize the real-time control of the robot to be controlled by the lower computer.

[0012] In the embodiment of the present application, the host computer obtains the position instruction to be executed and the parameter configuration, and generates multiple real-time position instructions that meet the command call cycle nT of the host computer according to the position instruction to be executed and the multiple parameter n, and then generates a command call request according to the real-time position instruction and the multiple parameter n. The command call cycle of the host computer is n times the command processing cycle of the lower computer, and the command remote call is sent to the lower computer, and finally the next command remote call request is sent after receiving the feedback message sent by the lower computer. The host computer obtains the command call request according to the position instruction to be executed and the multiple parameter n, and completes the command sending of the host computer to the lower computer, thereby realizing the configuration of the multiple parameter n and the sending of the command call request, and through the synchronization of the command call cycle and the command processing cycle, the host computer uses the lower computer to realize the precise control of the robot to be controlled.

[0013] Furthermore, the method of generating multiple real-time position instructions that comply with the instruction call period nT of the host computer according to the position instructions to be executed and the multiple parameter n includes: planning the motion trajectory of the robot to be controlled according to the position instructions to be executed and the multiple parameter n, and generating multiple real-time position instructions that comply with the instruction call period nT of the host computer.

[0014] In an embodiment of the present application, the host computer performs motion trajectory planning based on the acquired position instructions to be executed and the multiple parameters, determines multiple real-time position instructions under each instruction call cycle nT, and then interpolates the position instructions to be executed according to the instruction call cycle, thereby realizing the motion trajectory planning of the robot to be controlled by the host computer and realizing precise control of the robot to be controlled.

[0015] Furthermore, the parameter configuration also includes one or more of a control mode, a filtering parameter and a real-time position parameter.

[0016] In an embodiment of the present application, the parameter configuration of the upper computer also includes one or more of the control mode, filtering parameters and real-time position parameters. The lower computer can process the real-time position instruction according to the parameter configuration of the upper computer, thereby realizing flexible processing of the real-time position instruction in the lower computer.

[0017] Furthermore, the method also includes: acquiring position and posture information of the robot to be controlled; and performing 3D real-time display of the position and posture information.

[0018] In the embodiment of the present application, by acquiring the posture information of the robot and displaying the posture information in 3D real time, real-time information feedback is achieved, which is beneficial for the staff to view the current status of the robot in real time and quickly deal with abnormal situations in the robot's work.

[0019] In the third aspect, an embodiment of the present application provides a lower computer, which includes: an instruction receiving module and a real-time instruction processing module; the instruction receiving module is used to receive an instruction remote call request sent by an upper computer, and send the instruction remote call request to the real-time instruction processing module, the instruction remote call request includes parameter configuration and real-time position instruction, the parameter configuration includes a multiple parameter n, the real-time position instruction is a position instruction executed by the upper computer within an instruction call cycle nT, T is the instruction processing cycle of the lower computer, n is a positive integer, and T is a positive number; the real-time instruction processing module is used to split the real-time position instruction according to the multiple parameter n, obtain motion control instructions, and generate feedback information; it is used to send n motion control instructions to the robot to be controlled respectively, so that the robot to be controlled executes n motion control instructions respectively; the instruction receiving module is also used to return the feedback information to the upper computer, so that the upper computer sends the next instruction remote call request to the lower computer.

[0020] In a fourth aspect, an embodiment of the present application provides a host computer, which includes: a real-time control module, a virtual simulation module and a remote control drive module; the real-time control module is used to receive parameter configuration and send the parameter configuration to the remote control drive module; the virtual simulation module is used to obtain the position instruction to be executed, generate multiple real-time position instructions that meet the instruction call cycle nT of the host computer according to the position instruction to be executed and the multiple parameter n, and send the real-time position instruction to the remote control drive module, the position instruction to be executed is an instruction to control the robot to be controlled to reach a preset position, and the parameter configuration includes the multiple parameter n, and n is a positive integer; the remote control drive module is used to generate multiple instruction remote call requests according to the multiple real-time position instructions and the parameter configuration; it is also used to send the instruction remote call request to the lower computer, and after receiving the feedback information sent by the lower computer, send the next instruction remote call request to the lower computer, so as to realize the real-time control of the robot to be controlled by the lower computer.

[0021] In the fifth aspect, an embodiment of the present application provides a robot remote real-time control system, the system comprising an external command input source, a lower computer, a host computer and a robot to be controlled; wherein the host computer is respectively communicatively connected to the external command input source and the lower computer, and the lower computer is communicatively connected to the robot to be controlled; the external command input source is used to input instructions to be executed to the upper computer; the robot to be controlled is used to receive motion control instructions sent by the lower computer and execute the motion control instructions.

[0022] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising: a processor, a memory, and a bus, wherein the processor and the memory interact with each other through the bus;

[0023] The memory stores program instructions that can be executed by the processor, and the processor can execute the method of the first aspect or the second aspect by calling the program instructions.

[0024] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, including:

[0025] The computer-readable storage medium stores computer instructions, and the computer instructions cause the computer to execute the method of the first aspect or the second aspect.

[0026] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the embodiments of the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0028] Figure 1 A schematic diagram of a robot remote control method flow chart provided in an embodiment of the present application;

[0029] Figure 2 A schematic diagram of a method flow for processing instructions of a lower computer provided in an embodiment of the present application;

[0030] Figure 3 A schematic flow chart of a method for switching a robot remote control mode provided in an embodiment of the present application;

[0031] Figure 4 A schematic flow chart of another robot remote control method provided in an embodiment of the present application;

[0032] Figure 5 A schematic diagram of a method flow of real-time control of a host computer provided in an embodiment of the present application;

[0033] Figure 6 A schematic diagram of a lower computer structure provided in an embodiment of the present application;

[0034] Figure 7 A schematic diagram of the structure of a host computer provided in an embodiment of the present application;

[0035] Figure 8 A schematic diagram of the structure of a robot remote real-time control system provided in an embodiment of the present application;

[0036] Fig. 9 A schematic diagram of the working process of a robot remote control system provided in an embodiment of the present application;

[0037] Fig.10 A schematic diagram of a real-time position instruction calling cycle flow provided in an embodiment of the present application;

[0038] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] Before introducing a robot remote real-time control method provided in an embodiment of the present application, some concepts involved in the embodiment of the present application are first introduced:

[0040] Host computer: A computer that can directly send operation instructions, such as a PC. In some embodiments of the present application, the user can operate the host computer to send real-time position instructions, and can also plan the path of the robot according to the motion trajectory.

[0041] Lower computer: A computer that can directly control the robot to obtain the robot's status, usually a PLC (Programmable Logic Controller) / single-chip microcomputer. The command sent by the upper computer will be sent to the lower computer, which will interpret the command into a corresponding timing signal to directly control the corresponding robot. The lower computer will read the robot's status data from time to time, and then convert it into a digital signal and feed it back to the upper computer.

[0042] Robot control system: includes a host computer and a slave computer. The host computer receives user command calls and plans motion trajectories according to the user's commands, obtains multiple discrete position points, and obtains corresponding real-time position commands based on each discrete position point. Then, each real-time position command is sent to the slave computer for processing according to the command call cycle. The slave computer then processes the real-time position command to obtain commands that the robot can recognize, and sends them to the robot for execution, completing the entire remote control process.

[0043] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0044] Figure 1 A schematic diagram of a robot remote real-time control method provided in an embodiment of the present application is shown in FIG. Figure 1As shown, the method can be applied to the lower computer, which receives the instruction request from the upper computer and sends it to the robot, and the robot executes the instruction. The method includes:

[0045] Step 101: Receive a remote command call request sent by a host computer, the remote command call request includes parameter configuration and real-time position command, the parameter configuration includes a multiple parameter n, the real-time position command is a position command executed by the host computer within an instruction call cycle nT, T is the instruction processing cycle of the lower computer, n is a positive integer, and T is a positive number.

[0046] The host computer can send remote call requests to the slave computer through a variety of communication methods, such as through TCP / IP (Transmission Control Protocol / Internet Protocol) sockets. The data transmission between the host computer and the slave computer can be carried out using flexible application layer communication protocols, including but not limited to json, xml and other formats.

[0047] The remote call request for the command includes parameter configuration and real-time position command, and the parameter configuration includes a multiple parameter n, which is a positive integer used to represent the multiple relationship between the command call cycle of the host computer and the command processing cycle of the lower computer. The command call cycle can be the time interval for each time the host computer sends a remote call request for the command, and the command processing cycle can be the cycle for each time the lower computer processes the real-time position command sent by the host computer. The host computer provides a configuration method for the multiple parameter to avoid network fluctuations or the influence of the real-time position command reading speed. For example, the lower computer command processing cycle T can be a decimal, which is related to the unit of the cycle, such as 0.008s, or 8ms, and the command call cycle of the host computer can be 8ms, 16ms, 24ms, etc., and the corresponding multiple parameters are 1, 2, and 3, respectively. By setting the command call cycle of the host computer, the rough interpolation of complex motion trajectories can be realized on the host computer, and multiple instructions that meet the command processing cycle of the lower computer can be transmitted at one time to avoid the remote control of the robot being out of sync due to the host computer reading the real-time position command speed not being able to keep up with the transmission speed. This application does not limit the size of the multiple parameter.

[0048] Step 102: split the real-time position instruction according to the multiple parameter n, obtain n motion control instructions, and generate feedback information.

[0049] Among them, since the instruction calling cycle of the upper computer is in a multiple relationship with the instruction processing cycle of the lower computer, the received real-time position instruction needs to be split in the lower computer, which is a more accurate robot interpolation position instruction to meet the instruction processing cycle of the lower computer, and n motion control instructions are obtained. The feedback information can be the information sent by the lower computer to the upper computer to maintain cycle synchronization to end the current instruction, so that the upper computer can send the next instruction remote call request. For example: when the lower computer receives the instruction remote call sent by the upper computer through the TCP Socket socket, the upper computer will not immediately end the instruction remote call request before receiving the feedback information sent by the lower computer, but will wait until the feedback information is received before ending the instruction remote call request and sending the next instruction remote call request.

[0050] Step 103: sending n motion control instructions to the robot to be controlled in sequence according to the instruction processing cycle T, so that the robot to be controlled executes the n motion control instructions respectively.

[0051] Among them, the motion control instructions can be actual instructions that can be recognized by the robot to be controlled, and are sent to the robot to be controlled by the lower computer in the order of instruction execution. The robot to be controlled executes the above motion control instructions in sequence according to the motion control instructions to reach a preset position or perform a preset action.

[0052] Step 104: Return feedback information to the upper computer so that the upper computer sends a next instruction remote call request to the lower computer.

[0053] The lower computer returns feedback information to the upper computer. After receiving the feedback information, the upper computer ends the remote call request of the instruction and sends the next remote call request of the instruction to the lower computer. By configuring the multiple parameter n in the instruction call request and sending the feedback information, the instructions of the upper computer and the lower computer are kept synchronized, and the precise control of the robot to be controlled is achieved.

[0054] On the basis of the above embodiment, within the instruction calling cycle nT, the timing starts from the flag time processing point preset in the lower computer. After receiving the remote calling request of the instruction sent by the upper computer, the lower computer first modifies the instruction flag preset in the lower computer; during the timing process, the real-time position instruction needs to be split and kinematically calculated according to the multiple parameter n to generate motion control instructions that can be recognized by the robot; after the timing reaches nT, the instruction flag is reset and feedback information is generated.

[0055] Among them, a fixed-period flag time processing point is pre-set in the lower computer, and timing starts from the fixed flag time processing point each time. The timing period is consistent with the instruction call period nT. The instruction flag can be a state identifier preset in the memory of the lower computer. For example, it can be identified by 0 and 1. 0 is used to identify the initial state of the instruction flag after it has not been modified or reset, and 1 is used to identify the modified state of the instruction flag after it has been modified. The lower computer confirms whether to generate feedback information to send to the upper computer by detecting the state of the instruction flag. When the timing reaches nT, feedback information is generated and sent to the upper computer after detecting that the instruction flag is reset, so that the period of the lower computer detecting the instruction flag and resetting it also reaches nT, which is synchronized with the instruction call period of the upper computer, thereby realizing the delayed blocking of the upper computer request.

[0056] When the lower computer modifies the instruction flag, it also splits the real-time position instruction according to the multiple parameter n to obtain n sub-motion instructions. These sub-motion instructions also need kinematic calculations to be converted into motion control instructions that can be recognized by the robot to be controlled. Kinematic calculations can convert the absolute coordinate system of the robot's motion trajectory into the robot's own coordinate system, and realize the calculation of effective positions such as Cartesian space position and joint space position.

[0057] On the basis of the above embodiment, the parameter configuration also includes a filtering configuration. After the real-time position instruction is split according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T, the upper computer can also obtain the filtering algorithm preset in the lower computer according to the filtering configuration, and then continue to smooth the n sub-motion instructions separately according to the filtering algorithm to obtain corresponding sub-smoothed motion instructions, and finally perform kinematic calculations on the smoothed sub-motion instructions to obtain corresponding motion control instructions.

[0058] Figure 2 A flowchart of a method for processing instructions of a lower computer provided in an embodiment of the present application is shown as follows: Figure 2 As shown, it includes real-time position instruction splitting, filtering processing and kinematic calculation process. The filtering configuration may include whether to start filtering and the type of filtering or filtering algorithm started. The filtering types include but are not limited to Cartesian posture filtering, joint space filtering, etc. The filtering algorithms include but are not limited to first-order low-pass filtering, speed look-ahead filtering and nonlinear filtering, etc. These filtering algorithms can smooth the external input position instructions, which is especially suitable for some remote control communication cycle fluctuations. The filtering process can be a filtering and smoothing process of the split sub-motion instructions, so as to smoothly transition some instructions that are difficult to complete for the robot to be controlled, so that the actual motion trajectory or action of the robot to be controlled is closer to the preset motion trajectory or preset action.

[0059] Among them, the parameter configuration also includes switching of control modes and remote real-time position control. Figure 3 A schematic flow chart of a method for switching a robot remote control mode provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the robot's control mode includes real-time instruction processing mode and internal motion control mode. The real-time instruction processing mode can be a way for the current upper computer to send a remote call request to the lower computer to realize control, while the internal motion control mode can be a control mode for the current lower computer to realize the control of the robot to be controlled according to the internal preset motion control instructions. When the lower computer switches to the real-time instruction processing mode, the robot to be controlled can complete the motion control according to the real-time position instructions sent remotely.

[0060] Remote real-time position control includes the types of real-time position instructions, which can include Cartesian space position, joint space position, absolute position, incremental position, etc., so as to realize flexible control of the robot to be controlled. In remote real-time control mode, the internal control mode of the robot will be turned off. In this mode, the position instructions issued by the user will be directly issued to the robot after being multiplied or smoothed according to the parameter configuration. In the remote real-time control mode, if the robot servo communication master station does not receive the user's motion control instruction, the robot to be controlled will keep the last position instruction input until the next motion instruction is received.

[0061] Figure 4 A flowchart of another robot remote real-time control method provided in an embodiment of the present application is shown as follows: Figure 4 As shown, the method can be applied to the host computer, by obtaining the instructions to be executed to generate an instruction call request, and then send it to the lower computer, which directly controls the robot, thereby realizing remote control of the robot. The method includes:

[0062] Step 401: Obtain the position instruction to be executed and parameter configuration. The position instruction to be executed is an instruction for controlling the robot to be controlled to reach a preset position. The parameter configuration includes a multiple parameter n, where n is a positive integer.

[0063] Among them, the instructions to be executed can be input by the real-time position instruction input source, such as the position point to be reached by the robot to be controlled or the preset action to be completed, which can be set by the user. The real-time position instruction source includes but is not limited to a custom trajectory planner or other online active devices such as master-slave robots, joysticks, etc.; when using a custom trajectory planner, the user only needs to send the interpolated discrete position of the corresponding motion trajectory according to the periodic call request; when using an external active device, real-time sampling is required to obtain the position instruction and send it to the lower computer. The parameter configuration includes the configuration of the multiple parameter n. After the upper computer configures the multiple parameter, it is sent to the lower computer, and the lower computer can realize the splitting and processing of the real-time position instruction according to the multiple parameter n.

[0064] Step 402: Generate multiple real-time position instructions that meet the instruction calling cycle nT of the upper computer according to the position instruction to be executed and the multiple parameter n, where T is the instruction processing cycle of the lower computer and T is a positive number.

[0065] Among them, the upper computer can generate multiple real-time position instructions according to the acquired position instructions to be executed and the multiple parameter n. Each real-time position instruction is used to identify the instruction that the robot to be controlled needs to execute within the instruction calling cycle nT. By sending the position instructions within the instruction calling cycle nT at one time, the speed of reading the real-time position instructions by the upper computer and the speed of network transmission can be avoided to affect the processing of instructions in the lower computer. Generally, the instruction processing cycle of the lower computer can be a very short time, such as 8ms. If the cycle of the upper computer instruction calling is consistent with the cycle of the lower computer instruction processing, it is easy to cause the lower computer to wait for the arrival of the next instruction before continuing to process due to the unstable transmission of the upper computer's instruction remote calling request, resulting in control errors between the lower computer and the upper computer.

[0066] Step 403: Generate multiple command remote call requests according to multiple real-time position commands and parameter configurations.

[0067] Step 404: Send the instruction remote call request to the lower computer, and send the next instruction remote call request after receiving feedback information sent by the lower computer, so as to realize the real-time control of the robot to be controlled by the lower computer.

[0068] Among them, each instruction remote call request includes the corresponding real-time position instruction and parameter configuration. The upper computer can send the instruction remote call request to the lower computer in the form of TCP / IP Socket blocking socket, thereby realizing delayed blocking of the instruction remote call request. The upper computer cannot actively end the request. Only when it receives the feedback information sent by the lower computer can it send the next instruction remote call request, thereby realizing the control of the request sending cycle of the upper computer, keeping the control cycle of the upper computer and the lower computer synchronized, and completing the precise control of the robot to be controlled.

[0069] For example, the host computer can plan the motion trajectory of the robot to be controlled, such as walking route or action planning, according to the position instruction to be executed and the multiple parameter n. For example, if the position instruction to be executed is from position A to position B, the host computer first plans the path according to the positions of A and B, generates each discrete position point according to the position change within each instruction call cycle, and then sends the real-time position instruction of the robot to be controlled to each discrete position point to the lower computer, so as to realize remote control of the robot to be controlled.

[0070] Based on the above embodiment, the parameter configuration may include one or more of the control mode, filtering parameters and real-time position parameters. The types of the above parameter configurations can refer to Figure 1 The relevant contents in the corresponding embodiments. The upper computer can adjust the configuration information in the lower computer according to the parameters set by the user, for example, switching the control mode in the lower computer from the internal control mode to the remote real-time control mode, adding filtering processing to the real-time position processing, etc. The lower computer can adjust its own configuration at any time according to the parameter configuration in the upper computer, thereby breaking the limitation of the working environment and realizing remote and flexible control of the robot to be controlled.

[0071] On the basis of the above embodiment, the upper computer can also obtain the posture information of the robot and display it in 3D real time. The source of the posture information can be an external command input source or a real-time feedback message from the lower computer to the upper computer. By obtaining the posture information and displaying it in 3D real time, the intuitive display of the posture information is realized, and the online status of the robot can be adjusted at any time according to the posture information, so as to complete the real-time control of the robot.

[0072] Figure 5 A schematic diagram of a method flow of real-time control of a host computer provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, a specific implementation method for establishing real-time control between the upper computer and the lower computer is provided. The specific real-time method can be:

[0073] Step 501: The upper computer establishes a communication connection with the lower computer remote control receiving terminal through the remote control driver, wherein the communication connection may be a TCP / IP communication connection mode.

[0074] Step 502: The host computer calls the interface to switch to the remote control mode. The method of switching the control mode of the host computer can refer to Figure 1 The control mode switching process provided in the corresponding embodiment.

[0075] Step 503: The host computer calls the interface to set the relevant parameters of the remote control, where these parameters can refer to Figure 1Corresponding to the multiple parameter n, filtering configuration and remote real-time position control in the embodiment.

[0076] Step 504: The host computer obtains the planned robot position instruction from the real-time position instruction input source, wherein the robot position instruction may be an instruction to be executed input by the user.

[0077] Step 505: The host computer calls the interface to set the real-time position instruction of the robot. The real-time position instruction can be obtained by planning the motion trajectory according to the instruction to be executed. The specific planning process can refer to Figure 4 The motion trajectory planning process provided by the corresponding embodiment.

[0078] After obtaining the real-time position instruction, the upper computer generates an instruction remote call request according to the real-time position instruction and parameter configuration, and sends the instruction remote call request to the lower computer; after receiving the instruction remote call request, the lower computer performs real-time instruction processing on the real-time position instruction according to the multiple parameter n in the parameter configuration, and obtains the motion control instruction and feedback information; then the lower computer sends the motion control instruction to the robot to be controlled, and sends feedback information to the upper computer after the timing reaches the instruction call cycle, so as to realize the upper computer sending the next instruction remote call process, complete the interaction between the upper computer and the lower computer, and thus realize remote real-time control of the robot.

[0079] Figure 6 This is a schematic diagram of the structure of a lower computer provided in an embodiment of the present application. The device may be a module, program segment or code on an electronic device. It should be understood that the device is similar to the above Figure 1 The method embodiment corresponds to and can be executed Figure 1 The various steps involved in the method embodiment and the specific functions of the device can be found in the above description. To avoid repetition, detailed description is appropriately omitted here. The embodiment of the present application provides a lower computer, which includes:

[0080] The instruction receiving module 601 is used to receive an instruction remote call request sent by the upper computer, and send the instruction remote call request to the real-time instruction processing module, wherein the instruction remote call request includes parameter configuration and real-time position instruction, wherein the parameter configuration includes a multiple parameter n, and the real-time position instruction is a position instruction executed by the upper computer within an instruction call cycle nT, wherein T is the instruction processing cycle of the lower computer, wherein n is a positive integer, and wherein T is a positive number;

[0081] The real-time instruction processing module 602 is used to split the real-time position instruction according to the multiple parameter n, obtain the motion control instruction, and generate feedback information; and to send n motion control instructions to the robot to be controlled in sequence according to the instruction processing cycle T, so that the robot to be controlled executes the n motion control instructions respectively;

[0082] The instruction receiving module 601 is further used to return the feedback information to the upper computer, so that the upper computer sends the next instruction remote call request to the lower computer.

[0083] Based on the above embodiment, the real-time instruction processing module 602 is specifically used for:

[0084] Within the instruction call cycle nT, timing starts from the flag time processing point preset in the lower computer;

[0085] After receiving the remote call request of the instruction, setting the instruction flag bit preset in the lower computer;

[0086] Splitting the real-time position instruction according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T;

[0087] Perform kinematic calculations on the n sub-motion instructions respectively to generate n motion control instructions;

[0088] When the timing reaches nT, the instruction flag is reset and feedback information is generated.

[0089] Based on the above embodiment, the device further includes a filtering processing module, which is used to:

[0090] Determining whether to start filtering processing according to the filtering configuration;

[0091] If so, obtaining the filter or filtering algorithm preset in the lower computer according to the filtering configuration;

[0092] Smoothing the n sub-motion instructions respectively according to the filtering or the filtering algorithm to obtain sub-smoothed motion instructions corresponding to the sub-motion instructions;

[0093] Accordingly, the kinematic calculations are performed on the n sub-motion instructions respectively, including:

[0094] Kinematic calculations are performed on the n sub-smooth motion instructions respectively.

[0095] Figure 7 This is a schematic diagram of the structure of a host computer provided in an embodiment of the present application. The device may be a module, program segment or code on an electronic device. It should be understood that the device is similar to the above Figure 1The method embodiment corresponds to and can be executed Figure 4 The various steps involved in the method embodiment and the specific functions of the device can be found in the above description. To avoid repetition, detailed description is appropriately omitted here. The present application embodiment provides a host computer, which includes:

[0096] The real-time control module 701 is used to receive parameter configuration and send the parameter configuration to the remote control driving module; it is also used to obtain the position instruction to be executed, generate multiple real-time position instructions that meet the instruction call cycle nT of the host computer according to the position instruction to be executed and the multiple parameter n, and send the real-time position instruction to the remote control driving module, the position instruction to be executed is an instruction to control the robot to be controlled to reach a preset position, the parameter configuration includes the multiple parameter n, and n is a positive integer;

[0097] The remote control drive module 702 is used to generate multiple command remote call requests based on the multiple real-time position instructions and the parameter configuration; it is also used to send the command remote call request to the lower computer, and after receiving the feedback information sent by the lower computer, send the next command remote call request to the lower computer, so as to realize the real-time control of the robot to be controlled by the lower computer.

[0098] Based on the above embodiment, the real-time control module 701 is specifically used for:

[0099] According to the position instruction to be executed and the multiple parameter n, the motion trajectory of the robot to be controlled is planned to generate a plurality of real-time position instructions within the instruction calling cycle nT of the host computer.

[0100] Based on the above embodiment, the parameter configuration also includes one or more of a control mode, a filtering parameter and a real-time position parameter.

[0101] On the basis of the above embodiment, the device further includes a virtual simulation module, which is specifically used for:

[0102] Obtain the position and posture information of the robot to be controlled;

[0103] The posture information is displayed in 3D real time.

[0104] Figure 8 This is a schematic diagram of the structure of a robot remote real-time control system provided in an embodiment of the present application. This embodiment of the present application provides a robot remote real-time control system, which includes: an external command input source, a lower computer, a host computer and a robot to be controlled; the specific module introduction of the above host computer can refer to Figure 5 The detailed module functions provided in the corresponding embodiments and the specific module introduction of the above lower computer can refer to the following Figure 6The detailed module functions provided in the corresponding embodiments are not described in detail here.

[0105] Wherein, the upper computer is respectively connected to the external command input source and the lower computer for communication, and the lower computer is connected to the robot to be controlled for communication;

[0106] The external instruction input source is used to input instructions to be executed to the host computer;

[0107] The robot to be controlled is used to receive the motion control instructions sent by the lower computer and execute the motion control instructions.

[0108] Fig. 9 A schematic diagram of the operation flow of a robot remote control system provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, Fig. 9 The schematic diagram specifically shows the process of real-time position command calling and returning in the robot remote control system. The specific implementation process can be: the host computer first starts the real-time position command calling process through the remote control driver service, and sends a TCP Socket command to the lower computer. Among them, the remote driver service is installed on the above host computer, and a Socket communication request is established between the host computer and the lower computer. Then the lower computer sets and queries the real-time command flag bit, and processes the real-time command flag bit. The above settings can refer to Figure 1 The instruction flag bit modification process of the corresponding embodiment can refer to the above query Figure 1 The instruction flag reset process of the corresponding embodiment. Finally, after the lower computer detects the reset of the instruction flag, it generates feedback information and sends it to the upper computer. The upper computer receives the feedback information through TCP Socket blocking, thereby completing the cycle synchronization between the upper computer and the lower computer. The above process can refer to Figure 1 and Figure 4 The specific implementation method of remote real-time control of the lower computer and the upper computer in the corresponding embodiment.

[0109] Fig.10 A schematic diagram of a real-time position instruction calling cycle flow provided in an embodiment of the present application is shown in FIG. Fig.10 As shown in the figure, it can be seen that due to the parameter configuration of the multiple parameter n in the upper computer, the time period of instruction call and instruction return is nT. In any period nT, one instruction return and one instruction call will be completed, so as to keep the instruction call cycle in the upper computer consistent. The time interval of instruction return is achieved by setting the real-time instruction flag in the lower computer. The specific implementation method can refer to Figure 1 In the corresponding embodiment, feedback information is returned after the timing reaches nT, so that the host computer starts the process of calling the next instruction.

[0110] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application, such as Fig.11 As shown, the electronic device includes: a processor (processor) 1101, a memory (memory) 1102 and a bus 1103; wherein,

[0111] The processor 1101 and the memory 1102 interact with each other via the bus 1103;

[0112] The processor 1101 is used to call the program instructions in the memory 1102 to execute the robot remote real-time control method provided by the above-mentioned method embodiments.

[0113] The processor 1101 may be an integrated circuit chip with signal processing capabilities. The processor 1101 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. It may implement or execute various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0114] The memory 1102 may include, but is not limited to, random access memory (RAM), read only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable read-only memory (EEPROM), etc.

[0115] This embodiment discloses a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the robot remote real-time control method provided by the above-mentioned method embodiments.

[0116] This embodiment provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions enable the computer to execute the robot remote real-time control method provided by the above-mentioned method embodiments.

[0117] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or interactive connection shown or discussed can be through some interactive interfaces, and the indirect coupling or interactive connection of devices or units can be electrical, mechanical or other forms.

[0118] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0119] Furthermore, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0120] In this document, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any such actual relationship or order between these entities or operations.

[0121] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A robot remote real-time control method, It is characterized in that Applied to the lower computer, including: Receive a remote command call request sent by a host computer, wherein the remote command call request includes a parameter configuration and a real-time position command, wherein the parameter configuration includes a multiple parameter n, wherein the real-time position command is a position command executed by the host computer within an instruction call cycle nT, wherein T is an instruction processing cycle of the slave computer, wherein n is a positive integer, and T is a positive number; wherein the multiple parameter n is used to indicate a multiple relationship between the instruction call cycle of the host computer and the instruction processing cycle of the slave computer; The real-time position instruction is split according to the multiple parameter n to obtain n motion control instructions, and feedback information is generated; Sending n motion control instructions to the robot to be controlled in sequence according to the instruction processing cycle T, so that the robot to be controlled executes the n motion control instructions respectively; Returning the feedback information to the host computer so that the host computer sends the next remote call request of the instruction to the slave computer; The real-time position instruction is split according to the multiple parameter n to obtain the motion control instruction and generate feedback information, including: Within the instruction call cycle nT, timing starts from the flag time processing point preset in the lower computer; the timing cycle is consistent with the instruction call cycle nT; After receiving the remote call request for the instruction, the preset instruction flag in the lower computer is set; the instruction flag is a preset status identifier; the lower computer confirms whether to generate the feedback information through the status of the instruction flag; the feedback information is the information for ending the current instruction sent by the lower computer to the upper computer to maintain cycle synchronization, so that the upper computer sends the next remote call request for the instruction; Splitting the real-time position instruction according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T; Perform kinematic calculations on the n sub-motion instructions respectively to generate n motion control instructions; When the timing reaches nT, the instruction flag is reset and feedback information is generated.

2. The method according to claim 1, It is characterized in that The parameter configuration also includes a filtering configuration. After the real-time position instruction is split according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T, the method further includes: Determining whether to start filtering processing according to the filtering configuration; If so, obtaining the filter or filtering algorithm preset in the lower computer according to the filtering configuration; Smoothing the n sub-motion instructions respectively according to the filtering or the filtering algorithm to obtain sub-smoothed motion instructions corresponding to the sub-motion instructions; Accordingly, the kinematic calculations are performed on the n sub-motion instructions respectively, including: Kinematic calculations are performed on the n sub-smooth motion instructions respectively.

3. A robot remote real-time control method, It is characterized in that Applied to the host computer, including: Obtaining a position instruction to be executed and a parameter configuration, wherein the position instruction to be executed is an instruction for controlling the robot to be controlled to reach a preset position, and the parameter configuration includes a multiple parameter n, wherein n is a positive integer; the multiple parameter n is used to represent a multiple relationship between the instruction calling cycle of the upper computer and the instruction processing cycle of the lower computer; Generate multiple real-time position instructions that meet the instruction call period nT of the host computer according to the position instruction to be executed and the multiple parameter n, where T is the instruction processing period of the slave computer and T is a positive number; Generate multiple command remote call requests according to the multiple real-time position instructions and the parameter configuration; Sending the command remote call request to the lower computer, and sending the next command remote call request after receiving feedback information sent by the lower computer, so as to realize the real-time control of the robot to be controlled by the lower computer; The steps of the lower computer for real-time control of the robot to be controlled include: the lower computer starts timing from a flag time processing point preset in the lower computer within the instruction call cycle nT; the timing cycle is consistent with the instruction call cycle nT; after receiving the instruction remote call request, the instruction flag preset in the lower computer is set; the instruction flag is a preset state identifier; the lower computer confirms whether to generate the feedback information through the state of the instruction flag; the feedback information is the information sent by the lower computer to the upper computer to end the current instruction in order to maintain cycle synchronization, so that the upper computer sends the next instruction remote call request; the real-time position instruction is split according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T; kinematic calculations are performed on the n sub-motion instructions respectively to generate n motion control instructions; when the timing reaches nT, the instruction flag is reset, and feedback information is generated and returned to the upper computer.

4. The method according to claim 3, It is characterized in that The method of generating a plurality of real-time position instructions that conform to the instruction calling cycle nT of the host computer according to the position instruction to be executed and the multiple parameter n includes: According to the position instruction to be executed and the multiple parameter n, the motion trajectory of the robot to be controlled is planned to generate a plurality of real-time position instructions within the instruction calling cycle nT of the host computer.

5. The method according to claim 3, It is characterized in that The parameter configuration also includes one or more of a control mode, a filtering parameter, and a real-time position parameter.

6. A lower computer, It is characterized in that The lower computer includes an instruction receiving module and a real-time instruction processing module; The instruction receiving module is used to receive an instruction remote call request sent by the host computer, and send the instruction remote call request to the real-time instruction processing module, wherein the instruction remote call request includes parameter configuration and real-time position instruction, wherein the parameter configuration includes a multiple parameter n, and the real-time position instruction is a position instruction executed by the host computer within an instruction call cycle nT, wherein T is the instruction processing cycle of the lower computer, n is a positive integer, and T is a positive number; the multiple parameter n is used to represent the multiple relationship between the instruction call cycle of the host computer and the instruction processing cycle of the lower computer; The real-time instruction processing module is used to split the real-time position instruction according to the multiple parameter n, obtain the motion control instruction, and generate feedback information; and is used to send n motion control instructions to the robot to be controlled in sequence according to the instruction processing cycle T, so that the robot to be controlled executes n motion control instructions respectively; The instruction receiving module is also used to return the feedback information to the host computer, so that the host computer sends the next instruction remote call request to the slave computer; The real-time instruction processing module is specifically used for: within the instruction call cycle nT, starting timing from the flag time processing point preset in the lower computer; the timing cycle is consistent with the instruction call cycle nT; after receiving the instruction remote call request, setting the instruction flag preset in the lower computer; splitting the real-time position instruction according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T; performing kinematic calculations on the n sub-motion instructions respectively to generate n motion control instructions; when the timing reaches nT, resetting the instruction flag and generating feedback information. The instruction flag is a preset status identifier; the lower computer confirms whether to generate the feedback information through the status of the instruction flag; The feedback information is information for ending the current instruction sent by the lower computer to the upper computer to maintain cycle synchronization, so that the upper computer sends a next instruction remote call request.

7. A host computer, It is characterized in that The host computer includes a real-time control module, a virtual simulation module and a remote control drive module; The real-time control module is used to receive parameter configuration and send the parameter configuration to the remote control drive module; it is also used to obtain the position instruction to be executed, generate multiple real-time position instructions that meet the instruction call cycle nT of the host computer according to the position instruction to be executed and the multiple parameter n, and send the real-time position instruction to the remote control drive module, the position instruction to be executed is an instruction to control the robot to be controlled to reach a preset position, the parameter configuration includes the multiple parameter n, n is a positive integer, and T is a positive number; the multiple parameter n is used to represent the multiple relationship between the instruction call cycle of the host computer and the instruction processing cycle of the slave computer; The remote control driving module is used to generate a plurality of remote command call requests according to the plurality of real-time position instructions and the parameter configuration; and is also used to send the remote command call request to the lower computer, and after receiving the feedback information sent by the lower computer, send the next remote command call request to the lower computer, so as to realize the real-time control of the robot to be controlled by the lower computer; The steps of the lower computer for real-time control of the robot to be controlled include: the lower computer starts timing from a flag time processing point preset in the lower computer within the instruction call cycle nT; the timing cycle is consistent with the instruction call cycle nT; after receiving the instruction remote call request, the instruction flag preset in the lower computer is set; the instruction flag is a preset state identifier; the lower computer confirms whether to generate the feedback information through the state of the instruction flag; the feedback information is the information sent by the lower computer to the upper computer to end the current instruction in order to maintain cycle synchronization, so that the upper computer sends the next instruction remote call request; the real-time position instruction is split according to the multiple parameter n to obtain n sub-motion instructions that meet the instruction processing cycle T; kinematic calculations are performed on the n sub-motion instructions respectively to generate n motion control instructions; when the timing reaches nT, the instruction flag is reset, and feedback information is generated and returned to the upper computer.

8. A robot remote real-time control system, It is characterized in that The system comprises an external command input source, a lower computer for executing the method according to any one of claims 1 to 2, an upper computer for executing the method according to any one of claims 3 to 5, and a robot to be controlled; Wherein, the upper computer is respectively connected to the external command input source and the lower computer for communication, and the lower computer is connected to the robot to be controlled for communication; The external instruction input source is used to input instructions to be executed to the host computer; The robot to be controlled is used to receive the motion control instructions sent by the lower computer and execute the motion control instructions.

9. An electronic device, It is characterized in that include: processor, memory and bus, wherein, The processor and the memory communicate with each other via the bus; The memory stores program instructions executable by the processor, and the processor calls the program instructions to execute the method according to any one of claims 1-2 or any one of claims 3-5.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a computer, the computer is caused to perform the method according to any one of claims 1 to 2 or any one of claims 3 to 5.