Dynamic attitude information acquisition method, device and equipment in man-machine operation environment
By using radar to obtain beacon position in the human-computer operating environment, the complex problem of sensor assembly is solved, and the accuracy of robot operations and data acquisition is achieved.
Patent Information
- Application Number
- CN202510607991.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-12
- Publication Date
- 2025-08-05
Smart Images

Figure CN120428219A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the fields of robotics and data acquisition technology, and in particular to a method, device, equipment, and storage medium for acquiring dynamic hand-tool posture information in a human-machine operating environment. Background Art
[0002] In manufacturing processes such as welding, assembly, and inspection, robots are now widely used to replace human operators who typically use handheld tools for processing. When robots are used to perform these tasks, factors such as the robot arm and tool's posture, trajectory, and speed are key factors affecting the quality of the work. Therefore, trajectory control during robot operations is particularly important.
[0003] Conventional technology typically collects robot trajectory data by attaching multiple sensors to different parts of the human body (e.g., CN107582062A). This method, however, requires sensors to be attached to various locations on the human body, resulting in complex equipment and inaccurate collected operational data, which in turn affects the quality of the robot's work. Summary of the Invention
[0004] In view of this, the present disclosure proposes a method, device, equipment and storage medium for collecting dynamic posture information in a human-machine operation environment, which can accurately obtain the dynamic posture information of the operator through simple equipment, thereby improving the accuracy of robot operations.
[0005] According to a first aspect of the present disclosure, a method for collecting dynamic posture information in a human-machine operating environment is provided, comprising:
[0006] Acquiring the beacon position of a beacon set in the human-machine operating environment by radar; wherein the beacon is respectively attached to the wearable gloves and the tool working part used in the human-machine operating environment;
[0007] The acquired beacon position is calculated and processed to obtain the working trajectory and working posture of the tool working part.
[0008] In a possible implementation, the radars include three, and the three radars are respectively arranged on the X-axis, Y-axis, and Z-axis of the human-machine operation environment coordinate system to detect the beacon position of each beacon in the human-machine operation environment coordinate system.
[0009] In a possible implementation, the beacon includes:
[0010] At least two beacons are mounted on the tool working part, and at least two beacons and an operating base point on the tool working part are located on the same straight line, and the straight line coincides with or is parallel to the axis of the tool working part;
[0011] At least five beacons are attached to the glove, and at least five beacons are attached to different positions of the back of the hand and / or wrist area of the glove.
[0012] In a possible implementation, two beacons are mounted on the tool operating part, which are respectively marked as a first beacon and a second beacon.
[0013] In a possible implementation, when calculating and processing the acquired beacon position to obtain the operation trajectory of the tool operation part, the method includes:
[0014] Obtaining the beacon positions of the first beacon and the second beacon at each collection time;
[0015] Calculating the position of the operation base point at each of the collection moments based on the beacon positions of the first beacon and the second beacon at each of the collection moments in combination with the distance between the first beacon and the second beacon and the distance between the first beacon and the operation base point;
[0016] Based on the position of the operation base point at each of the acquisition moments, the operation trajectory of the tool operation part is determined.
[0017] In a possible implementation, when calculating and processing the acquired beacon position to obtain the working posture of the tool working part, the method includes:
[0018] Obtaining the beacon positions of the first beacon, the second beacon, and each beacon on the worn glove at each collection moment;
[0019] Based on the beacon positions of the first beacon, the second beacon, and the beacons on the worn glove at each collection moment, constructing an operating plane where each beacon on the worn glove is located at each collection moment;
[0020] Calculating the rotation angle of the axis of the working tool portion relative to the human-machine operating environment coordinate system at each collection moment based on the working plane where each beacon on the worn glove is located at each collection moment;
[0021] The rotation angle of the axis of the working tool part relative to the human-machine operation environment coordinate system at each collection moment is used as the working posture of the tool working part at each collection moment.
[0022] In a possible implementation, after calculating the working posture of the tool working part at each collection moment, it also includes: obtaining the initial working posture of the tool working part, and calibrating the working posture of the tool working part at each collection moment based on the initial working posture.
[0023] According to a second aspect of the present disclosure, a dynamic posture information collection device in a human-machine operation environment is provided, comprising:
[0024] A data acquisition module, which acquires the beacon positions of beacons set in the human-machine operating environment through radar; wherein the beacons are respectively attached to the gloves and tool working parts used in the human-machine operating environment;
[0025] The data processing module calculates and processes the acquired beacon position to obtain the trajectory and posture data of the tool working part.
[0026] According to a third aspect of the present disclosure, a dynamic posture information acquisition device in a human-machine operating environment is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the method described in the first aspect of the present disclosure.
[0027] According to a fourth aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions, when executed by a processor, implement the method described in the first aspect of the present disclosure.
[0028] The present disclosure provides a method, apparatus, device, and storage medium for collecting dynamic posture information in a human-machine operating environment. The method comprises: obtaining the positions of beacons set in the human-machine operating environment via radar; wherein the beacons are respectively attached to a glove and a tool working part used in the human-machine operating environment; and calculating and processing the obtained beacon positions to obtain an operating trajectory and operating posture of the tool working part. In the present disclosure, the positions of the beacons on the glove reflect the standard hand posture during the operation process, and the positions of the beacons on the working tool reflect the working posture of the tool during the operation process. Therefore, by simply comprehensively analyzing the positions of the beacons on the glove and the beacon positions on the working tool, the combined working posture of the hand and the working tool during the standard operation can be accurately reflected, thereby improving the accuracy of the operation data collection. That is, in the present disclosure, the accuracy of the operation data collection can be accurately obtained through simple assembly.
[0029] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.
[0031] Figure 1 A flow chart showing a method for collecting dynamic posture information in a human-machine operating environment according to an embodiment of the present disclosure is shown;
[0032] Figure 2 A diagram showing a radar deployment layout in a human-machine operating environment according to an embodiment of the present disclosure is shown;
[0033] Figure 3 A diagram illustrating beacon deployment in a human-machine operating environment according to an embodiment of the present disclosure is shown;
[0034] Figure 4 A schematic diagram showing an operating plane where a beacon on a glove is located according to an embodiment of the present disclosure;
[0035] Figure 5 A schematic block diagram of a dynamic posture information acquisition device in a human-machine operation environment according to an embodiment of the present disclosure is shown;
[0036] Figure 6 A schematic block diagram of a dynamic posture information acquisition device in a human-machine operating environment according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0037] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise indicated.
[0038] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.
[0039] In addition, numerous specific details are provided in the following detailed description to better illustrate the present disclosure. Those skilled in the art will appreciate that the present disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art are not described in detail in order to highlight the main points of the present disclosure.
[0040] <Method Example>
[0041] Figure 1 FIG. 1 is a flow chart showing a method for collecting dynamic posture information in a human-machine operating environment according to an embodiment of the present disclosure. Figure 1As shown, the method includes steps S1100-S1200.
[0042] S1100, obtains the beacon position set in the human-machine operation environment through radar.
[0043] What needs to be explained here first is that before executing the method disclosed in the present invention, a human-machine operating environment needs to be constructed first. Specifically, a space that is convenient for operators to demonstrate their work is first selected as the human-machine operating space. Then, a spatial rectangular coordinate system O-XYZ is constructed in the human-machine operating space as the human-machine operating environment coordinate system and radars are respectively arranged at designated positions of the X-axis, Y-axis and Z-axis of the human-machine operating environment coordinate system (as shown in Figure 2), thereby constructing a human-machine operating environment with three-dimensional radar signal coverage. Figure 2 In the diagram, the radar at the top collects Z-axis data, the radar on the left collects X-axis data, and the radar on the right collects Y-axis data. These three radars in the human-machine operating environment can be used to determine the beacon positions of each beacon set up in the human-machine operating environment. To improve the accuracy of beacon position acquisition, high-precision radars are used for deployment. Preferably, high-precision microwave radars with a recognition accuracy of 0.1 mm can be selected for deployment.
[0044] After the human-machine operating environment is constructed, beacons can be deployed within it. In this disclosure, the beacons are passive radar beacons that achieve positioning within the human-machine operating environment by reflecting radar signals. To improve beacon identification accuracy, beacons with distinct characteristics can be selected for deployment. For example, beacons with high brightness and / or distinct temperature characteristics can be selected for deployment.
[0045] In order to accurately capture the working posture and working trajectory of the workers, beacons are placed on the workers' gloves and the working parts of the tools they operate in locations that are convenient for receiving radar signals, to ensure that the radar signals of each beacon are not blocked during the operation.
[0046] When placing beacons on the tool working part, at least two beacons can be mounted on the tool working part, and at least two beacons and the working base point on the tool working part are located on the same straight line, and the straight line coincides with or is parallel to the axis of the tool working part. In this way, the posture of the operating tool can be determined based on the straight line determined by the two beacons. Among them, the working part base point refers to the reference point used to calibrate its key operating position or the starting point of the motion trajectory when the tool working part performs the operation. For example, when the operating tool is Figure 3 When the welding gun is shown, the root position of the welding wire is clamped by the welding gun (i.e. Figure 3 The triangular area in the figure is the operating base point of the welding gun as a working tool.
[0047] When deploying beacons on a glove, at least five beacons may be mounted on the glove, with the at least five beacons being mounted at different locations on the back of the hand and / or wrist of the glove. For example, all of the at least five beacons may be mounted on the back of the hand of the glove; all of the at least five beacons may be mounted on the wrist of the glove; or some of the beacons may be mounted on the back of the hand of the glove, while the remaining beacons may be deployed on the wrist of the glove.
[0048] The following combination Figure 3 The beacon deployment scheme is explained again. Specifically, Figure 3 As shown, the tool's working part is a welding gun. When deploying beacons, beacons A and B are placed along the axis of the welding gun's handpiece, near each end. This prevents the operator from blocking their radar signals during operation. Furthermore, when deploying beacons on gloves, beacons C and G are placed on the back of the glove, while beacons D, E, and F are placed on the wrist. This allows the positions of these five beacons to reflect the operator's hand and wrist posture during operation, more accurately reflecting their posture.
[0049] After the beacons are deployed, the operator can enter the human-machine operation environment, put on gloves, pick up tools and perform a standard operation demonstration. During the operation demonstration, the radar deployed in the human-machine operation environment can obtain the beacon position of the beacon set in the human-machine operation environment.
[0050] After obtaining the beacon data of the beacon set in the human-machine operating environment, step S1200 can be executed to calculate and process the obtained beacon position to obtain the operating trajectory and operating posture of the tool operating part.
[0051] In one possible implementation, calculating and processing the acquired beacon positions to obtain the operating trajectory of the tool operating unit may include the following steps: acquiring the beacon positions of the first beacon A and the second beacon B at each acquisition time. Based on the beacon positions of the first beacon A and the second beacon B at each acquisition time, combined with the distance between the first beacon A and the operating base point, and the distance between the second beacon B and the operating base point, the position of the operating base point at each acquisition time is calculated. Based on the position of the operating base point at each acquisition time, the operating trajectory of the tool operating unit is determined.
[0052] It should be noted that the radar collects the positions of each beacon at a preset frequency, which can be set to 1000 Hz (i.e., 1000 times per second). Each time a beacon's position is collected, the position of the operating base point at that moment is calculated. The trajectory formed by the calculated base point positions at each moment serves as the operating trajectory of the tool's operating unit during operation.
[0053] Since the calculation method of the position of the operation base point at each moment is the same, the following takes the current moment t as an example to explain in detail the calculation process of the position of the operation base point at each moment. Specifically, the beacon position Point3D(A, t) of the first beacon A and the beacon position Point3D(B, t) of the second beacon B at time t are obtained. According to the beacon position Point3D(A, t) of the first beacon A and the beacon position Point3D(B, t) of the second beacon B, the straight line where the two beacons are located is determined and recorded as ToolSpaceLine. Since the operation base point of the tool operation part and the first beacon A and the second beacon B are located on the same straight line, that is, the operation base point is also located on the straight line ToolSpaceLine, therefore, the position ToolBasePoint of the operation base point at time t can be calculated by the straight line ToolSpaceLine combined with the distance ToolSpaceLineAConst between the first beacon A and the operation base point and the distance ToolSpaceLineBConst between the second beacon B and the operation base point.
[0054] When calculating the position of the work base point ToolBasePoint at time t using the straight line ToolSpaceLine combined with the distance ToolSpaceLineAConst between the first beacon A and the work base point and the distance ToolSpaceLineBConst between the second beacon B and the work base point, the following steps may be included: first, two points on the straight line ToolSpaceLine that are at a distance ToolSpaceLineAConst from the first beacon A are determined as candidate base points; then, from the two candidate base points, the base point at a distance ToolSpaceLineBConst from the second beacon B is selected as the work base point at time t, and its position is recorded as ToolBasePoint. The expression of ToolBasePoint at time t is as follows:
[0055] ToolBasePoint=Point3D(ToolX,ToolY,ToolZ,t)
[0056] Among them, Point3D(ToolX, ToolY, ToolZ, t) is the position coordinate of the work unit base point at time t.
[0057] It should be noted here that the distance ToolSpaceLineAConst between the first beacon A and the work base point and the distance ToolSpaceLineBConst between the second beacon B and the work base point are determined through the initialization process and pre-stored in the system. In this way, when calculating the position of the work base point ToolBasePoint at time t, they can be directly read from the system.
[0058] Initializing the ToolSpaceLineAConst distance between the first beacon A and the work base point and the ToolSpaceLineBConst distance between the second beacon B and the work base point can include the following steps: First, when the operator is preparing to perform the operation, the operator assumes an initial posture and remains motionless in the initial posture, and the initial beacon positions of the first beacon A and the second beacon B are detected by radar. Then, based on the initial beacon positions of the first beacon A and the second beacon B, the Euclidean distance between the first beacon A and the second beacon B is calculated. Finally, based on the Euclidean distance between the first beacon A and the second beacon B and the previously determined Euclidean distance Dist0 between the first beacon A and the work base point, the ToolSpaceLineAConst distance between the first beacon A and the work base point and the ToolSpaceLineBConst distance between the second beacon B and the work base point are calculated. Since the work base point of the tool operation unit, the first beacon A, and the second beacon B are located on the same straight line ToolSpaceLine, the calculation formulas for the ToolSpaceLineAConst distance between the first beacon A and the work base point and the ToolSpaceLineBConst distance between the second beacon B and the work base point are as follows:
[0059] ToolSpaceLineAConst=Dist0;
[0060] ToolSpaceLineBConst=Dist0+||A,B||;
[0061] Where Dist0 is the Euclidean distance Dist0 between the first beacon A and the operating base point, and ||A,B|| is the Euclidean distance between the first beacon A and the second beacon B. ||*|| is used to calculate the Euclidean distance between two points in three-dimensional space.
[0062] The position of the operating base point at each moment can be calculated by referring to the above method. Based on the position of the operating base point at each moment, the trajectory of the operating part base point can be determined and the trajectory of the operating part base point can be used as the operating trajectory of the tool operating part.
[0063] In one possible implementation, calculating and processing the acquired beacon positions to obtain the working posture of the tool working unit may include the following steps: acquiring the beacon positions of the first beacon A, the second beacon B, and each beacon on the glove at each acquisition moment; constructing an operating plane where each beacon on the glove is located at each acquisition moment based on the beacon positions of the first beacon A, the second beacon B, and each beacon on the glove at each acquisition moment; calculating the rotation angle of the axis of the working tool relative to the human-machine operating environment coordinate system at each acquisition moment based on the operating plane where each beacon on the glove is located at each acquisition moment; and using the rotation angle of the axis of the working tool relative to the human-machine operating environment coordinate system at each acquisition moment as the working posture of the tool working unit at each acquisition moment.
[0064] First, it's important to note that even if the straight line formed by A, B, and ToolBasePoint is measured and determined at any given moment, the spatial posture of the tool will change as it rotates along its working axis. This posture is often crucial to the precision and accuracy of the work. Therefore, simply forming a line with three points cannot accurately reflect the posture changes of the tool's working part. A deeper understanding of planar relationships and angles is necessary to measure these changes.
[0065] Since the calculation method of the rotation angle of the axis of the working tool relative to the human-machine operating environment coordinate system at each moment is the same, the following takes the current moment t as an example to explain in detail the calculation process of the rotation angle of the axis of the working tool relative to the human-machine operating environment coordinate system at each moment. Specifically, the following steps may be included:
[0066] First, the beacon positions of the first beacon A, the second beacon B, and the beacons on the glove at time t are obtained. The specific acquisition method is described above and will not be repeated here.
[0067] Second, based on the beacon positions of the first beacon A, the second beacon B, and the beacons on the worn gloves at time t, the operating plane where the beacons on the worn gloves are located at time t is constructed.
[0068] Specifically, the beacons on the glove are traversed. For the current beacon, the positions of the current beacon, first beacon A, and second beacon B at time t are obtained. Based on the positions of the current beacon, first beacon A, and second beacon B at time t, the current plane on which the current beacon, first beacon A, and second beacon B are located is determined, and this current plane is used as the operating plane for the current beacon. Upon completion of the traversal, the operating plane for each beacon on the glove at time t is obtained.
[0069] In the beacon deployment plan, Figure 3In the example shown, the glove includes five beacons C, G, D, E and F. Therefore, you can first Figure 4 As shown, the beacon positions of beacon C, first beacon A, and second beacon B at time t are obtained. Then, based on the beacon positions of beacon C, first beacon A, and second beacon B, the plane on which beacon C, first beacon A, and second beacon B are located is determined, and this plane is used as the operating plane GlovePlaneC where beacon C is located at time t. Using the above method, the operating plane GlovePlaneD where beacon D is located, the operating plane GlovePlaneE where beacon E is located, the operating plane GlovePlaneF where beacon F is located, and the operating plane GlovePlaneG where beacon G is located can be further determined at time t.
[0070] Third, based on the working plane where each beacon on the glove is located at time t, calculate the rotation angle of the axis of the work tool relative to the human-machine operation environment coordinate system at time t. Among them, the rotation angle of the axis of the work tool relative to the human-machine operation environment coordinate system includes the heading angle ToolBasePointYaw, the pitch angle ToolBasePointPitch, and the roll angle ToolBasePointRoll. The heading angle ToolBasePointYaw is the rotation angle of the axis of the work tool around the Z axis of the human-machine operation environment coordinate system, the pitch angle ToolBasePointPitch is the rotation angle of the axis of the work tool around the Y axis of the human-machine operation environment coordinate system, and the roll angle ToolBasePointRoll is the rotation angle of the axis of the work tool around the X axis of the human-machine operation environment coordinate system.
[0071] Specifically, the system traverses each beacon on each glove. For the currently traversed beacon, the working plane of the current beacon at time t is obtained. Based on the working plane, the corresponding rotation angle of the current beacon is calculated. Once the traversal is complete, the corresponding rotation angle of each beacon on the glove at time t is obtained. A weighted average of the rotation angles corresponding to each beacon on the glove at time t is taken to determine the rotation angle of the tool axis relative to the human-machine operating environment coordinate system at that time.
[0072] Continued Figure 3In the embodiment shown, the working plane GlovePlaneC where the beacon C is located at time t is first obtained, and based on the working plane GlovePlaneC where the beacon C is located at time t, the heading angle ToolBasePointYaw(GlovePlaneD,t), the heading angle ToolBasePointPitch(GlovePlaneC,t), and the roll angle ToolBasePointRoll(GlovePlaneC,t) of the axis of the working tool relative to the human-machine operating environment coordinate system at time t are calculated. Referring to the calculation process of beacon C, the rotation angles corresponding to beacons D, E, F, and G at time t can be further calculated, and then the rotation angles corresponding to beacons C, D, E, F, and G at time t are weighted averaged to obtain the rotation angle of the axis of the working tool relative to the human-machine operating environment coordinate system at time t. The specific calculation formula is as follows:
[0073] The heading angle of the axis of the working tool relative to the human-machine operating environment coordinate system at time t is ToolBasePointYaw(*, t) =
[0074] mean
【ToolBasePointYaw(GlovePlaneC,t),
[0075] ToolBasePointYaw(GlovePlaneD,t),
[0076] ToolBasePointYaw(GlovePlaneE,t),
[0077] ToolBasePointYaw(GlovePlaneF,t),
[0078] ToolBasePointYaw(GlovePlaneG,t) 】;
[0080] Where, ToolBasePointYaw(GlovePlaneC,t) is the heading angle corresponding to beacon C at time t, ToolBasePointYaw(GlovePlaneD,t) is the heading angle corresponding to beacon D at time t, ToolBasePointYaw(GlovePlaneE,t) is the heading angle corresponding to beacon E at time t, ToolBasePointYaw(GlovePlaneF,t) is the heading angle corresponding to beacon F at time t, and ToolBasePointYaw(GlovePlaneG,t) is the heading angle corresponding to beacon G at time t.
[0081] The pitch angle of the axis of the working tool relative to the human-machine operating environment coordinate system at time t is ToolBasePointPitch(*, t) =
[0082] mean[ToolBasePointPitch(GlovePlaneC,t),
[0083] ToolBasePointPitch(GlovePlaneD,t),
[0084] ToolBasePointPitch(GlovePlaneE,t),
[0085] ToolBasePointPitch(GlovePlaneF,t),
[0086] ToolBasePointPitch(GlovePlaneG,t) 】;
[0088] Where, ToolBasePointPitch(GlovePlaneC,t) is the pitch angle corresponding to beacon C at time t, ToolBasePointPitch(GlovePlaneD,t) is the pitch angle corresponding to beacon D at time t, ToolBasePointPitch(GlovePlaneE,t) is the pitch angle corresponding to beacon E at time t, ToolBasePointPitch(GlovePlaneF,t) is the pitch angle corresponding to beacon F at time t, and ToolBasePointPitch(GlovePlaneG,t) is the pitch angle corresponding to beacon G at time t.
[0089] The roll angle of the axis of the working tool relative to the human-machine operating environment coordinate system at time t is ToolBasePointRoll(*, t) =
[0090] mean
【ToolBasePointRoll(GlovePlaneC,t),
[0091] ToolBasePointRoll(GlovePlaneD,t),
[0092] ToolBasePointRoll(GlovePlaneE,t),
[0093] ToolBasePointRoll(GlovePlaneF,t),
[0094] ToolBasePointRoll(GlovePlaneG,t) 】;
[0096] Where ToolBasePointRoll(GlovePlaneC,t) is the roll angle corresponding to beacon C at time t, ToolBasePointRoll(GlovePlaneD,t) is the roll angle corresponding to beacon D at time t, ToolBasePointRoll(GlovePlaneE,t) is the roll angle corresponding to beacon E at time t, ToolBasePointRoll(GlovePlaneF,t) is the roll angle corresponding to beacon F at time t, and ToolBasePointRoll(GlovePlaneG,t) is the roll angle corresponding to beacon G at time t.
[0097] Note: In the above formula, mean[*] is the weighted average of multiple values.
[0098] By referring to the above method, the rotation angle of the axis of the working tool relative to the human-machine operation environment coordinate system at each moment can be obtained. It should be noted here that since the working base point is collinear with the first beacon A and the second beacon B, the working base point is also located on the plane determined by the beacons on the wearing gloves. Therefore, the rotation angle of the plane determined by the beacons on the wearing gloves relative to the human-machine operation environment coordinate system can reflect the working posture of the tool working part during the operation. Therefore, after obtaining the rotation angle of the axis of the working tool relative to the human-machine operation environment coordinate system at each moment, the rotation angle of the axis of the working tool relative to the human-machine operation environment coordinate system at each moment can be directly used as the working posture of the tool working part at each acquisition moment.
[0099] During the above acquisition process, the trajectory and posture data of the operation are calculated, including the six degrees of freedom data at any acquisition time:
[0100] 1) When collecting the tool operation trajectory, obtain the ToolBasePoint spatial position data (i.e., the three coordinate values of x, y, and z) at any collection time;
[0101] 2) When collecting the working posture of the tool working part, the three Euler angle values of ToolBasePointYaw, ToolBasePointPitch, and ToolBasePointRoll at any collection time are obtained;
[0102] Integrating all the 6-DOF data collected at all times represents the complete trajectory and posture of the tool's operating unit. This 6-DOF data accurately reflects the operator's operational state. Further integration and processing of this data can be used to control the robot's trajectory and posture.
[0103] In one possible implementation, in order to improve the accuracy of the working trajectory and working posture, before measuring and calculating the working trajectory and working posture of the tool working part during operation, the following steps are also included: obtaining the initial working posture of the tool working part, and based on the initial working posture, calibrating the working posture of the tool working part at each collection moment.
[0104] The initial working posture of the tool working part is measured through an initialization process and pre-stored in the system. In this way, when calibrating the working posture, the initial working posture of the tool working part can be obtained from the system.
[0105] In one possible implementation, when determining the initial working posture of the tool working part through an initialization process, it includes: when the operator is in the above-mentioned initial posture, obtaining the beacon positions of each beacon on the tool working part and the gloves worn, and then referring to the calculation process of the rotation angle of the axis of the working tool relative to the human-machine operation environment coordinate system at each moment in the above text, calculating the rotation angle of the axis of the working tool in the initial state relative to the human-machine operation environment coordinate system, and this rotation angle is the initial working posture of the tool working part.
[0106] After obtaining the initial working posture of the tool working part, the working posture of the tool working part at each collection moment can be calibrated based on the initial working posture. Specifically, the deviation between the working posture at each collection moment and the initial working posture is calculated, and a determination is made as to whether the deviation meets a preset deviation requirement. If so, the working posture collected at each collection moment is determined to be accurate. If not, it indicates that the working posture collected at each collection moment is abnormal (for example, the operator's hand trembled abnormally during the demonstration), and the abnormal value is processed.
[0107] For example, when performing a welding operation on a linear weld (a multi-layer welding process), the operation has the following characteristics: 1) the welding trajectory of any layer moves slowly along the radial position of the weld; 2) the ToolBasePointYaw, ToolBasePointPitch, and ToolBasePointRoll of any layer remain essentially unchanged; and 3) the height of the weld between two adjacent layers slowly increases. In this example, the deviation between the collected work posture at each moment and the initial work posture is required to be essentially zero. If the deviation is large, it indicates that the operator's hand was shaking during the demonstration, and the work posture value at that moment needs to be eliminated or smoothed.
[0108] In one possible implementation, in order to improve the accuracy of the working trajectory and working posture, after obtaining the beacon position of the beacon set in the human-machine operation environment at each moment, it also includes verifying the accuracy of the beacon position. If the verification passes, the obtained beacon position is calculated and processed to obtain subsequent calculations of the working trajectory and working posture of the tool working part.
[0109] Specifically, when verifying the accuracy of the acquired beacon positions, it includes: acquiring the beacon positions of the first beacon A and the second beacon B at each acquisition moment, calculating the Euclidean distance between the first beacon A and the second beacon B based on the beacon positions of the first beacon A and the second beacon B at each acquisition moment, and judging whether the Euclidean distance between the first beacon A and the second beacon B at each acquisition moment is consistent with ||A, B|| calculated during the initialization process. If they are consistent, it means that the beacon positions collected at each moment are accurate. If they are inconsistent, it means that the beacon positions collected at each moment have deviations, and it is necessary to first denoise and correct the beacon positions collected at each moment before performing subsequent calculations to ensure the accuracy of subsequent calculations.
[0110] In one possible implementation, after obtaining the beacon positions of the beacons set in the human-machine operating environment at each moment, the accuracy of each acquired beacon position is first verified. Once verified, the working position and working posture at each moment are calculated. After the working posture calculation is completed at each moment, the working posture at each moment is further verified to ensure the accuracy of the working posture calculation. In this way, the dual calibration of each beacon position and working posture can greatly ensure that the collected data is accurate and precisely reflects the actual operating process of the operator. This data is input into the robot to achieve accurate restoration of dynamic postures.
[0111] The present disclosure provides a method for collecting dynamic posture information in a human-machine operating environment. The method comprises: obtaining the beacon positions of beacons installed in the human-machine operating environment via radar; wherein the beacons are respectively attached to gloves and tool working parts used in the human-machine operating environment; and calculating and processing the obtained beacon positions to obtain the operating trajectory and operating posture of the tool working part. In the present disclosure, the beacon positions of each beacon on the glove reflect the standard hand posture during the operation process, and the beacon positions of each beacon on the working tool reflect the working posture of the tool during the operation process. Therefore, by simply comprehensively analyzing the beacon positions of each beacon on the glove and each beacon on the working tool, the combined operating posture of the hand and working tool during standard operation can be accurately reflected, thereby improving the accuracy of operation data collection.
[0112] Furthermore, the beacon in the present disclosure only needs to be attached to gloves and work tools, and does not need to be installed on the whole body. That is, in the present disclosure, the accuracy of work data collection can be accurately obtained through simple assembly.
[0113] <Device Example>
[0114] Figure 5 FIG. 1 is a schematic block diagram of a dynamic posture information acquisition device in a human-machine operation environment according to an embodiment of the present disclosure. Figure 5 As shown, the device 100 includes:
[0115] The data acquisition module 110 acquires the beacon positions of beacons set in the human-machine operating environment through radar; wherein the beacons are respectively attached to the gloves and tool working parts used in the human-machine operating environment;
[0116] The data processing module 120 calculates and processes the acquired beacon position to obtain the trajectory and posture data of the tool working part.
[0117] <Equipment Example>
[0118] Figure 6 FIG. 1 is a schematic block diagram of a dynamic posture information acquisition device in a human-machine operation environment according to an embodiment of the present disclosure. Figure 6 As shown, the dynamic posture information collection device 200 in a human-machine operating environment includes: a processor 210 and a memory 220 for storing executable instructions of the processor 210. The processor 210 is configured to implement any of the above-mentioned dynamic posture information collection methods in a human-machine operating environment when executing the executable instructions.
[0119] It should be noted that there may be one or more processors 210. Furthermore, the dynamic posture information acquisition device 200 in the human-machine operating environment of the present embodiment may also include an input device 230 and an output device 240. The processor 210, memory 220, input device 230, and output device 240 may be connected via a bus or other means, which are not specifically limited herein.
[0120] Memory 220, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and various modules, such as the programs or modules corresponding to the method for collecting dynamic posture information in a human-machine operating environment according to the embodiments of the present disclosure. Processor 210 executes the software programs or modules stored in memory 220 to perform various functional applications and data processing of device 200 for collecting dynamic posture information in a human-machine operating environment.
[0121] The input device 230 may be used to receive input numbers or signals. The signals may be key signals related to user settings and function control of the device / terminal / server. The output device 240 may include a display device such as a display screen.
[0122] <Storage Medium Embodiment>
[0123] According to a fourth aspect of the present disclosure, a non-volatile computer-readable storage medium is also provided, on which computer program instructions are stored. When the computer program instructions are executed by the processor 210, the dynamic posture information collection method in any of the above-mentioned human-computer operation environments is implemented.
[0124] While various embodiments of the present disclosure have been described above, the foregoing description is intended to be illustrative, non-exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is selected to best explain the principles of the embodiments, their practical applications, or technical improvements to existing technologies, or to enable others skilled in the art to understand the embodiments disclosed herein.
Claims
1. A method for collecting dynamic posture information in a human-machine operating environment, characterized in that: include: Acquiring the beacon position of a beacon set in the human-machine operating environment by radar; wherein the beacon is respectively attached to the wearable gloves and the tool working part used in the human-machine operating environment; The acquired beacon position is calculated and processed to obtain the working trajectory and working posture of the tool working part.
2. The method according to claim 1, characterized in that The radars include three, and the three radars are respectively arranged on the X axis, Y axis and Z axis of the human-machine operation environment coordinate system to detect the beacon position of each beacon in the human-machine operation environment coordinate system.
3. The method according to claim 1, characterized in that The beacon includes: At least two beacons are mounted on the tool working part, and at least two beacons and an operating base point on the tool working part are located on the same straight line, and the straight line coincides with or is parallel to the axis of the tool working part; At least five beacons are attached to the glove, and at least five beacons are attached to different positions of the back of the hand and / or wrist area of the glove.
4. The method according to claim 3, characterized in that Two beacons are attached to the tool working portion, which are respectively referred to as a first beacon and a second beacon.
5. The method according to claim 4, characterized in that When calculating and processing the acquired beacon position to obtain the operation trajectory of the tool operation part, the method includes: Obtaining the beacon positions of the first beacon and the second beacon at each collection time; Calculating the position of the operation base point at each collection time based on the beacon positions of the first beacon and the second beacon at each collection time in combination with the distance between the first beacon and the operation base point and the distance between the second beacon and the operation base point; Based on the position of the operation base point at each of the acquisition moments, the operation trajectory of the tool operation part is determined.
6. The method according to claim 5, characterized in that When the acquired beacon position is calculated and processed to obtain the working posture of the tool working part, the method includes: Obtaining the beacon positions of the first beacon, the second beacon, and each beacon on the worn glove at each collection moment; Based on the beacon positions of the first beacon, the second beacon, and the beacons on the worn glove at each collection moment, constructing an operating plane where each beacon on the worn glove is located at each collection moment; Calculating the rotation angle of the axis of the working tool portion relative to the human-machine operating environment coordinate system at each collection moment based on the working plane where each beacon on the worn glove is located at each collection moment; The rotation angle of the axis of the working tool part relative to the human-machine operation environment coordinate system at each collection moment is used as the working posture of the tool working part at each collection moment.
7. The method according to claim 6, characterized in that After calculating the working posture of the tool working part at each collection moment, the method further includes: obtaining an initial working posture of the tool working part, and calibrating the working posture of the tool working part at each collection moment based on the initial working posture.
8. A device for collecting dynamic posture information in a human-machine operating environment, characterized in that: include: A data acquisition module, which acquires the beacon positions of beacons set in the human-machine operating environment through radar; wherein the beacons are respectively attached to the gloves and tool working parts used in the human-machine operating environment; The data processing module calculates and processes the acquired beacon position to obtain the trajectory and posture data of the tool working part.
9. A device for collecting dynamic posture information in a human-machine operating environment, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method according to any one of claims 1 to 7 when executing the executable instructions.
10. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Indoor human motion trajectory and gesture collection presentation method and device
CN107582062A
Cited By
Dynamic relative positioning system and method for deepwater collaborative operation platform
CN121763208A
A deep water co-operation platform dynamic relative positioning system and method
CN121763208B
