Irregular timber positioning method, device and equipment, storage medium and product

By setting marking points on irregular wood and determining the target line using processing table, robotic arms and visual camera systems, the problems of low efficiency and high cost of positioning of irregular wood in the prior art are solved, and efficient and accurate positioning effect is achieved.

CN119027503APending Publication Date: 2024-11-26TONGJI UNIV +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411084960.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-08
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing non-regular wood positioning methods are inefficient and cost-effective, making it difficult to meet the accuracy requirements of automated processing of building wood, especially due to the high cost of sensors and cumbersome operation, resulting in poor production efficiency and cost-effectiveness.

Method used

By obtaining the electronic model of irregular wood, setting up several marking points, and using the processing table, robotic arms and visual camera positioning system, the target line corresponding to the marking points is determined, avoiding the calculation errors caused by perspective division, and achieving low-cost and efficient positioning.

Benefits of technology

It realizes efficient and accurate positioning of irregular wood under the premise of low cost, reduces the accuracy dependence and operational complexity in traditional methods, and improves production efficiency and cost-effectiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119027503A_ABST
    Figure CN119027503A_ABST
Patent Text Reader

Abstract

The invention discloses an irregular timber positioning method and device, equipment, a storage medium and a product, and relates to the technical field of material localization, the method comprises the following steps: obtaining an electronic model of irregular timber, and setting a plurality of mark points on the surface of the irregular timber according to the electronic model; the irregular timber is put into a positioning system; determining a target straight line corresponding to each mark point in the irregular timber through a positioning system; and positioning the irregular timber according to the target straight lines corresponding to all the mark points arranged on the surface of the irregular timber. According to the method, the target straight line corresponding to each mark point in the irregular timber is determined by applying the positioning system comprising the processing table, the mechanical arm and the visual camera, and the points on the target straight line are imaged at the target pixel point of the visual camera; and then the irregular timber is positioned according to all the corresponding target straight lines on the surface of the irregular timber, so that the irregular timber is efficiently and accurately positioned on the premise of low cost.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of material positioning, and in particular to a method, device, equipment, storage medium and product for positioning irregular wood. Background Art

[0002] In the process of automated processing and customization of building wood, automatic positioning of materials is an important link. However, for irregular wood, due to its diverse geometric shapes, it is difficult to describe and locate it by simple length, width and height. For processing, the robotic arm system needs to first measure the precise position of the wood to be processed based on sensors, and the accuracy requirement is generally about 1mm. To achieve the positioning of irregular wood, there are generally two technical routes:

[0003] The first is to use a high-precision point cloud camera or laser displacement sensor in conjunction with a point cloud matching algorithm to complete workpiece positioning. The sensors required for this technical route are expensive and require a lot of calculations, especially when the accuracy needs to reach the millimeter level;

[0004] The second is a positioning method based on visual cameras and multi-view geometry algorithms. This method calculates the spatial position by shooting visual markers preset on the workpiece from multiple angles (such as pasting a QR code, etc.). This method is low-cost, but the positioning accuracy achieved by the prior art is not high, mainly because the calibration and positioning of visual cameras involve the PnP algorithm, in which the perspective division (an inevitable mathematical operation when converting three-dimensional and two-dimensional projections to each other) is very sensitive to camera depth errors. Therefore, millimeter-level errors require very high-precision cameras and professional calibration tools (high-precision calibration plates, etc.), which is not conducive to the efficiency and stability of production. At the same time, this method also needs to determine the precise positional relationship between the preset markers and the workpiece, which is not conducive to actual operation.

[0005] In summary, existing methods require high-cost sensors and cumbersome operations to meet the wood processing accuracy requirements (usually around 1 mm), making it difficult to achieve satisfactory production efficiency and cost-effectiveness. Summary of the invention

[0006] The main purpose of the present application is to provide a method, device, equipment, storage medium and product for positioning irregular wood, aiming to solve the technical problems of low efficiency and high cost of existing irregular wood positioning methods.

[0007] To achieve the above object, the present application provides a method for positioning irregular wood, the method comprising the following steps:

[0008] Acquire an electronic model of the irregular wood material, and set a number of marking points on the surface of the irregular wood material according to the electronic model;

[0009] Put the irregular wood into a positioning system, wherein the positioning system includes a processing table, a mechanical arm and a visual camera, and the visual camera is installed at the end of the mechanical arm;

[0010] Determine the target straight line corresponding to each marking point in the irregular wood by the positioning system, wherein the target straight line is a set of points corresponding to the marking points and imaged at the target pixel points in the visual camera;

[0011] The irregular wood is positioned according to the target straight line corresponding to all the marking points set on the surface of the irregular wood.

[0012] In one embodiment, the step of determining the target straight line corresponding to each marking point in the irregular wood by the positioning system includes:

[0013] Constructing a coordinate system in the positioning system, and controlling the visual camera to shoot the marking point at different shooting positions through the mechanical arm;

[0014] When it is detected that the marking point is imaged at the target pixel point of the visual camera, a target straight line is fitted based on the coordinate value of the marking point in the coordinate system.

[0015] In one embodiment, the step of constructing a coordinate system in the positioning system and controlling the visual camera to shoot the marking point at different shooting positions by the robotic arm includes:

[0016] In the positioning system, a coordinate system is constructed with the end of the mechanical arm as the origin, and the origin of the coordinate system moves with the end of the mechanical arm;

[0017] The robot arm posture of the robot arm is adjusted so that the robot arm controls the visual camera to shoot the marking point at different shooting positions based on the robot arm posture.

[0018] In one embodiment, when it is detected that the marker point is imaged at the target pixel point of the visual camera, the step of fitting the target straight line based on the coordinate value of the marker point in the coordinate system includes:

[0019] When it is detected that the marking point is imaged at the target pixel point of the visual camera, the coordinate value of the marking point in the coordinate system is determined according to the positional relationship between the marking point and the end of the robotic arm;

[0020] A plurality of coordinate points are determined according to the coordinate values ​​of the marking points corresponding to the visual camera at different shooting positions, and a target straight line is obtained after fitting the plurality of coordinate points.

[0021] In one embodiment, the step of positioning the irregular wood according to the target straight line corresponding to all the marking points set on the surface of the irregular wood includes:

[0022] Determine the target ray corresponding to the current marking point at different shooting angles according to the target straight line corresponding to the current marking point, and set the intersection of the target ray to the spatial coordinate of the current marking point;

[0023] The irregular wood is positioned based on the spatial coordinates corresponding to all the marking points set on the surface of the irregular wood.

[0024] In one embodiment, the step of positioning the irregular wood based on the spatial coordinates corresponding to all the marking points set on the surface of the irregular wood includes:

[0025] Matching the spatial coordinates corresponding to all the marking points set on the irregular wood surface with the electronic model;

[0026] If all the marking points fall on the points of the electronic model, it is determined that the irregular wood has been positioned;

[0027] If all the marking points do not fall on the points of the electronic model, the position of the electronic model is adjusted until all the marking points fall on the points of the adjusted electronic model.

[0028] In addition, to achieve the above purpose, the present application also proposes an irregular wood positioning device, the irregular wood positioning device comprising:

[0029] A positioning marking module, used for obtaining an electronic model of the irregular wood material and setting a plurality of marking points on the surface of the irregular wood material according to the electronic model;

[0030] A positioning preparation module, used for placing the irregular wood into a positioning system, wherein the positioning system comprises a processing table, a mechanical arm and a visual camera, wherein the visual camera is mounted at the end of the mechanical arm;

[0031] A first execution module is used to determine the target straight line corresponding to each marking point in the irregular wood through the positioning system, wherein the target straight line is a set of points corresponding to the marking points and imaged at target pixel points in the visual camera;

[0032] The second execution module is used to locate the irregular wood according to the target straight line corresponding to all the marking points set on the surface of the irregular wood.

[0033] In addition, to achieve the above-mentioned purpose, the present application also proposes an irregular wood positioning device, which includes: a memory, a processor, and an irregular wood positioning program stored in the memory and executable on the processor, wherein the irregular wood positioning program is configured to implement the steps of the irregular wood positioning method described above.

[0034] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and stores an irregular wood positioning program. When the irregular wood positioning program is executed by a processor, the steps of the irregular wood positioning method described above are implemented.

[0035] In addition, to achieve the above objectives, the present invention also provides a computer program product, which includes an irregular wood positioning program, and when the irregular wood positioning program is executed by a processor, the steps of the irregular wood positioning method described above are implemented.

[0036] The present application obtains an electronic model of irregular wood, and sets a number of marking points on the surface of the irregular wood according to the electronic model; the irregular wood is placed in a positioning system, the positioning system includes a processing table, a mechanical arm and a visual camera, and the visual camera is installed at the end of the mechanical arm; the target straight line corresponding to each marking point in the irregular wood is determined by the positioning system, and the target straight line is a set of points corresponding to all the marking points imaged at the target pixel points in the visual camera; the irregular wood is positioned according to the target straight lines corresponding to all the marking points set on the surface of the irregular wood. Compared with the traditional irregular wood positioning method, the above method of the present application determines the target straight line corresponding to each marking point in the irregular wood by applying a positioning system including a processing table, a mechanical arm and a visual camera, and the points on the target straight line are all imaged at the target pixel points of the visual camera, and then the irregular wood is positioned according to all the corresponding target straight lines on the surface of the irregular wood, thereby avoiding the direct calculation error caused by the traditional perspective division, and thus achieving efficient and accurate positioning of irregular wood at a low cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A schematic diagram of the structure of an irregular wood positioning device in the hardware operating environment involved in the embodiment of the present application;

[0038] Figure 2 This is a schematic diagram of the process of the first embodiment of the irregular wood positioning method of the present application;

[0039] Figure 3 A schematic diagram of a positioning system for the irregular wood positioning method of the present application;

[0040] Figure 4 This is a schematic diagram of the flow chart of the second embodiment of the irregular wood positioning method of the present application;

[0041] Figure 5 A schematic diagram of the camera calibration and calibration process in the irregular wood positioning method of the present application;

[0042] Figure 6 This is a schematic diagram of the process of the third embodiment of the irregular wood positioning method of the present application;

[0043] Figure 7 A schematic diagram for obtaining the spatial coordinates of the marking points in the irregular wood positioning method of the present application;

[0044] Figure 8 This is a structural block diagram of the first embodiment of the irregular wood positioning device of the present application.

[0045] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0046] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0047] Reference Figure 1 , Figure 1 This is a schematic diagram of the structure of an irregular wood positioning device in the hardware operating environment involved in the embodiment of the present application.

[0048] like Figure 1 As shown, the irregular wood positioning device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (Wireless-Fidelity, Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM), or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk storage. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

[0049] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the irregular wood positioning device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0050] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and an irregular wood positioning program.

[0051] exist Figure 1 In the irregular wood positioning device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the irregular wood positioning device of the present application can be set in the irregular wood positioning device, and the irregular wood positioning device calls the irregular wood positioning program stored in the memory 1005 through the processor 1001, and executes the irregular wood positioning method provided in the embodiment of the present application.

[0052] The present application embodiment provides a method for positioning irregular wood. Figure 2 , Figure 2 This is a schematic flow chart of the first embodiment of the irregular wood positioning method of the present application.

[0053] In this embodiment, the irregular wood positioning method includes the following steps:

[0054] Step S10: obtaining an electronic model of the irregular wood material, and setting a plurality of marking points on the surface of the irregular wood material according to the electronic model.

[0055] It should be noted that the execution subject of the method of this embodiment can be a terminal device with model building, data processing and program running functions, such as a smart phone, a computer, etc., or an electronic device with the same or similar functions, such as the above-mentioned irregular wood positioning device. The following takes the irregular wood positioning device (hereinafter referred to as the positioning device) as an example to illustrate this embodiment and the following embodiments.

[0056] It is understandable that the shapes of the above-mentioned marking points can be defined by the user, such as a "cross" shape, a "M" shape, a water drop shape, an irregular pattern shape, etc., and this embodiment does not impose any limitation on this.

[0057] It should be understood that the number of the above-mentioned marking points can be determined according to the shape of the electronic model. Generally speaking, the number is not less than 6 to ensure that the marking points can cover all directions of the irregular wood.

[0058] In a specific implementation, the irregular wood can be modeled or simulated by using tools such as modeling software or simulation software, so as to obtain an electronic model of the irregular wood. According to the preset marking point positions in the electronic model, visual marking points are posted at the corresponding approximate positions of the real wood, and they do not need to be posted very accurately. (In order to facilitate the subsequent search for marking points, marking points with information such as QR codes can also be used to prevent the marking points from being confused with each other).

[0059] Step S20: placing the irregular wood into a positioning system, wherein the positioning system comprises a processing table, a robotic arm and a visual camera, wherein the visual camera is installed at the end of the robotic arm.

[0060] It is understandable that the above-mentioned robot arm can perform complex motion trajectories, including linear movement, rotation, extension, etc., to achieve accurate grasping, handling and placement of materials, and is usually used to move materials from one location to another specified location, or to connect materials with other equipment or production lines. The above-mentioned visual camera is the core component of the machine vision system. It captures images and analyzes them to provide feedback to the robot arm on information such as the location, shape, size, etc. of the material.

[0061] It should be understood that reference can be made to Figure 3 , Figure 3 This is a schematic diagram of the positioning system of the irregular wood positioning method of this application. Figure 3 In the process, the irregular wood with the marking points affixed can be moved to the processing table, and the rough position of the irregular wood can be informed to the robotic arm system, so that the visual camera at the end of the robotic arm can shoot around the irregular wood and find the marking points.

[0062] Step S30: determining the target straight line corresponding to each marking point in the irregular wood by the positioning system, wherein the target straight line is a set of points corresponding to the marking points and imaged at target pixel points in the visual camera.

[0063] It should be noted that the above-mentioned target pixel point may be the center point of the shooting area of ​​the visual camera.

[0064] In a specific implementation, the movement of the visual camera can be controlled by adjusting the posture of the robot arm in the above-mentioned positioning system, so as to shoot each marking point in the above-mentioned irregular wood at different positions to obtain the target straight line corresponding to each marking point.

[0065] Step S40: positioning the irregular wood according to the target straight line corresponding to all the marking points set on the surface of the irregular wood.

[0066] In a specific implementation, the irregular wood can be positioned by determining the difference between the irregular wood on the processing table and the irregular wood in the virtual space (i.e., the electronic model) according to the target straight line corresponding to all the marking points set on the surface of the irregular wood. Compared with the conventional technology, the marking points preset on the irregular wood in this embodiment are relatively random, and do not need to be very accurate, but can also accurately position the irregular wood.

[0067] In this embodiment, an electronic model of irregular wood is obtained, and a number of marking points are set on the surface of the irregular wood according to the electronic model; the irregular wood is placed in a positioning system, the positioning system includes a processing table, a mechanical arm and a visual camera, and the visual camera is installed at the end of the mechanical arm; the target straight line corresponding to each marking point in the irregular wood is determined by the positioning system, and the target straight line is a set of points corresponding to the marking point and imaged at the target pixel point in the visual camera; the irregular wood is positioned according to the target straight lines corresponding to all marking points set on the surface of the irregular wood. Compared with the traditional irregular wood positioning method, the above method of this embodiment determines the target straight line corresponding to each marking point in the irregular wood by applying a positioning system including a processing table, a mechanical arm and a visual camera, and the points on the target straight line are all imaged at the target pixel point of the visual camera, and then the irregular wood is positioned according to all the corresponding target straight lines on the surface of the irregular wood, thereby avoiding the direct calculation error caused by the traditional perspective division, and thus realizing the efficient and accurate positioning of irregular wood at a low cost.

[0068] refer to Figure 4 , Figure 4 This is a schematic flow chart of the second embodiment of the irregular wood positioning method of the present application.

[0069] In a feasible implementation manner, the step S30 may include:

[0070] Step S301: constructing a coordinate system in the positioning system, and controlling the visual camera through the robotic arm to shoot the marking point at different shooting positions.

[0071] It should be noted that the above coordinate system may be a three-dimensional coordinate system.

[0072] Step S302: When it is detected that the marking point is imaged at the target pixel point of the visual camera, a target straight line is fitted based on the coordinate value of the marking point in the coordinate system.

[0073] In a specific implementation, when it is detected that the marker point is imaged at the target pixel point of the visual camera, it can be said that the marker point is now within the better field of view of the visual camera. Therefore, the target straight line can be fitted based on the coordinate value of the marker point in the coordinate system, thereby obtaining a set of all possible points observed from a specific pixel point of the visual camera (i.e., the above-mentioned target pixel point).

[0074] In a feasible implementation manner, the step S301 may include:

[0075] Step S3011: constructing a coordinate system in the positioning system with the end of the robotic arm as the origin, and the origin of the coordinate system moves with the end of the robotic arm.

[0076] Step S3012: adjusting the robot arm posture of the robot arm so that the robot arm controls the visual camera to shoot the marking point at different shooting positions based on the robot arm posture.

[0077] In a feasible implementation manner, the step S302 may include:

[0078] Step S3021: When it is detected that the marking point is imaged at the target pixel point of the visual camera, the coordinate value of the marking point in the coordinate system is determined according to the positional relationship between the marking point and the end of the robotic arm.

[0079] Step S3022: determining a plurality of coordinate points according to the coordinate values ​​of the marking points corresponding to different shooting positions of the visual camera, and obtaining a target straight line after fitting the plurality of coordinate points.

[0080] In a specific implementation, the above target straight line can be obtained based on the following steps (which can be combined with Figure 5 Come and see, Figure 5Schematic diagram of the calibration and calibration process of the camera in the irregular wood positioning method of this application). The first step is to set a stationary marking point P within the range of the robot arm (for example, print a cross center on paper), and measure the relative position relationship between the marking point P and the robot arm based on the 4-point method (a common robot TCP calibration method). The second step is to adjust the posture of the robot arm so that the marking point P appears in the camera field of view, set it to be imaged at pixel p, and calculate the coordinates of point P relative to the robot arm end coordinate system F at this time, recorded as X1. The third step is to adjust the posture of the robot arm so that the camera shoots the marking point P from more different distances and images it at the same pixel p. At this time, the position of the marking point P relative to the robot arm end coordinate system F is recorded as X2, X3, X4, etc. The fourth step is that the coordinate points X1, X2, X3, X4, etc. are roughly collinear, and a straight line L can be fitted (the straight line L is stationary relative to the robot arm end coordinate system F). It is the straight line in the actual space corresponding to the pixel p, that is, the points on the straight line L will be imaged at the pixel p. Because the straight line L is calculated from the pixel position and the robot arm posture without involving perspective division, its accuracy is relatively high. Specifically, its accuracy depends on the accuracy of the robot arm, and the actual measurement is less than 0.5mm. Step 5, repeat steps 2 to 4 to measure the corresponding straight lines L1, L2, L3... for more pixels p1, p2, p3... of the camera, and form the relationship between the pixel points and the corresponding straight lines {p1, L1}, {p2, L2}, {p3, L3}... At this point, the calibration process of the camera is completed (that is, the set of pixel points and corresponding straight line relationships as the calibration result). In subsequent use, for any pixel pi, the weighted average (linear interpolation) of its adjacent known pixels and corresponding rays can be used to calculate the straight line Li. The above steps can be automatically completed under the conditions of robot programming, with high efficiency (the entire calibration process can be completed within 30 minutes in actual measurement). The above calibration method is different from the traditional calibration method, is highly related to the robot arm, and has higher accuracy.

[0081] This embodiment constructs a coordinate system with the end of the robot arm as the origin in the positioning system, and the origin of the coordinate system moves with the end of the robot arm; adjusts the robot arm posture so that the robot arm controls the visual camera to shoot the marked point at different shooting positions based on the robot arm posture; when it is detected that the marked point is imaged at the target pixel point of the visual camera, the coordinate value of the marked point in the coordinate system is determined according to the positional relationship between the marked point and the end of the robot arm; a number of coordinate points are determined according to the coordinate values ​​of the marked point corresponding to the visual camera at different shooting positions, and the target straight line is obtained after fitting the several coordinate points. Compared with the traditional irregular wood positioning method, the above method of this embodiment makes full use of the information of the robot arm posture in both the camera calibration and the positioning of irregular wood, thereby effectively improving the positioning accuracy from the method, so that the low-cost positioning method can also achieve the accuracy required for wood processing.

[0082] refer to Figure 6 , Figure 6 This is a schematic flow chart of the third embodiment of the irregular wood positioning method of the present application.

[0083] In a feasible implementation manner, the step S40 may include:

[0084] Step S401: determining the target ray corresponding to the current marking point at different shooting angles according to the target straight line corresponding to the current marking point, and setting the intersection of the target ray as the spatial coordinate of the current marking point.

[0085] Step S402: positioning the irregular wood based on the spatial coordinates corresponding to all the marking points set on the surface of the irregular wood.

[0086] In a feasible implementation manner, the step S402 may include:

[0087] Step S4021: performing point matching between the spatial coordinates corresponding to all the marking points set on the irregular wood surface and the electronic model.

[0088] Step S4022: If all the marking points fall on the points of the electronic model, it is determined that the irregular wood has been positioned.

[0089] Step S4023: If all the marking points do not fall on the points of the electronic model, the position of the electronic model is adjusted until all the marking points fall on the points of the adjusted electronic model.

[0090] In a specific implementation, the above irregular wood can be positioned based on the following steps (can be combined with Figure 7Come and see, Figure 7 Schematic diagram of obtaining the spatial coordinates of the marking points in the irregular wood positioning method of this application). The first step is to move the irregular wood with the marking points pasted to the processing table, inform the robotic arm system of the rough position of the irregular wood, and make the camera at the end of the robotic arm take pictures around the wood and find the marking points (this process can be done manually or automatically based on algorithms such as AI machine vision). The second step is to adjust the posture of the robotic arm so that the marking points appear at the appropriate position in the camera's field of view. Assume that at this time a certain marking point P is imaged at a certain pixel p of the camera, corresponding to a straight line L emitted from the camera (the correspondence between pixel p and straight line L is calculated based on the results of the camera calibration link). The third step is that the robotic arm moves so that the camera shoots the same marking point P from multiple angles, and each shot obtains pixel points p1, p2, p3..., and calculates that the marking point is located on rays L1, L2, L3... These rays converge at a certain point M, and the position of the marking point P in the robotic arm coordinate system is considered to be point M. This process involves elementary geometric calculations of the intersection of straight lines, and the error is controllable. The closer the rays are to the perpendicular relationship, the smaller the error of M (the actual measurement accuracy can meet 0.5mm). The fourth step is to repeat the second and third steps to complete the positioning of all the marking points P1, P2, P3... on the wood, and obtain their spatial coordinates M1, M2, M3... In the fifth step, the position of the electronic model is repeatedly adjusted in the computer so that all the measured marking points M1, M2, M3... fall on the surface of the electronic model, and the matching is completed (this process can be completed manually or automatically based on the registration algorithm). At this time, the position of the electronic model of the wood in the robot arm coordinate system is the position of the real wood relative to the real robot arm. In summary, the above steps can be summarized as: finding marking points, measuring marking points, and matching marking points with electronic models. Because the matching process has loose requirements for the posting position of the marking points (just stick them on the surface), the operation is simple and has good fault tolerance.

[0091] This embodiment determines the target ray corresponding to the current marking point at different shooting angles based on the target straight line corresponding to the current marking point, and sets the intersection of the target ray as the spatial coordinate of the current marking point; the spatial coordinates corresponding to all the marking points set on the surface of the irregular wood are matched with the electronic model; if all the marking points fall on the points of the electronic model, it is determined that the irregular wood has been positioned; if all the marking points do not fall on the points of the electronic model, the position of the electronic model is adjusted until all the marking points fall on the points of the adjusted electronic model. Compared with the traditional irregular wood positioning method, the above method of this embodiment improves the process and steps of matching the measurement results and the electronic model, and is simple to operate and has good fault tolerance. The marking points preset on the surface of the workpiece are relatively arbitrary, and do not need to be very accurate to accurately position the wood.

[0092] In addition, an embodiment of the present application further proposes a storage medium, on which is stored an irregular wood positioning program, and when the irregular wood positioning program is executed by a processor, the steps of the irregular wood positioning method described above are implemented.

[0093] Reference Figure 8 , Figure 8 This is a structural block diagram of the first embodiment of the irregular wood positioning device of the present application.

[0094] like Figure 8 As shown, the irregular wood positioning device proposed in the embodiment of the present application includes:

[0095] The positioning marking module 801 is used to obtain an electronic model of the irregular wood and set a number of marking points on the surface of the irregular wood according to the electronic model;

[0096] A positioning preparation module 802 is used to place the irregular wood into a positioning system, wherein the positioning system includes a processing table, a mechanical arm and a visual camera, wherein the visual camera is installed at the end of the mechanical arm;

[0097] The first execution module 803 is used to determine the target straight line corresponding to each marking point in the irregular wood through the positioning system, and the target straight line is a set of points corresponding to all the marking points imaged at the target pixel points in the visual camera;

[0098] The second execution module 804 is used to locate the irregular wood according to the target straight line corresponding to all the marking points set on the surface of the irregular wood.

[0099] In this embodiment, an electronic model of irregular wood is obtained, and a number of marking points are set on the surface of the irregular wood according to the electronic model; the irregular wood is placed in a positioning system, the positioning system includes a processing table, a mechanical arm and a visual camera, and the visual camera is installed at the end of the mechanical arm; the target straight line corresponding to each marking point in the irregular wood is determined by the positioning system, and the target straight line is a set of points corresponding to the marking point and imaged at the target pixel point in the visual camera; the irregular wood is positioned according to the target straight lines corresponding to all marking points set on the surface of the irregular wood. Compared with the traditional irregular wood positioning method, the above method of this embodiment determines the target straight line corresponding to each marking point in the irregular wood by applying a positioning system including a processing table, a mechanical arm and a visual camera, and the points on the target straight line are all imaged at the target pixel point of the visual camera, and then the irregular wood is positioned according to all the corresponding target straight lines on the surface of the irregular wood, thereby avoiding the direct calculation error caused by the traditional perspective division, and thus realizing the efficient and accurate positioning of irregular wood at a low cost.

[0100] Based on the first embodiment of the irregular wood positioning device of the present application, a second embodiment of the irregular wood positioning device of the present application is proposed.

[0101] In this embodiment, the first execution module 803 is also used to construct a coordinate system in the positioning system, and control the visual camera to shoot the marked point at different shooting positions through the robotic arm; when it is detected that the marked point is imaged at the target pixel point of the visual camera, the target straight line is fitted based on the coordinate value of the marked point in the coordinate system.

[0102] Furthermore, the first execution module 803 is also used to construct a coordinate system with the end of the robotic arm as the origin in the positioning system, and the origin of the coordinate system moves with the end of the robotic arm; adjust the robotic arm posture of the robotic arm so that the robotic arm controls the visual camera to shoot the mark point at different shooting positions based on the robotic arm posture.

[0103] Furthermore, the first execution module 803 is also used to determine the coordinate value of the marking point in the coordinate system according to the positional relationship between the marking point and the end of the robotic arm when it is detected that the marking point is imaged at the target pixel point of the visual camera; determine a number of coordinate points according to the coordinate values ​​of the marking point corresponding to the visual camera at different shooting positions, and obtain the target straight line after fitting the number of coordinate points.

[0104] Furthermore, the second execution module 804 is also used to determine the target ray corresponding to the current marking point at different shooting angles based on the target straight line corresponding to the current marking point, and set the intersection of the target ray as the spatial coordinate of the current marking point; and locate the irregular wood based on the spatial coordinates corresponding to all marking points set on the surface of the irregular wood.

[0105] Furthermore, the second execution module 804 is also used to match the spatial coordinates corresponding to all the marking points set on the surface of the irregular wood with the electronic model; if all the marking points fall on the points of the electronic model, it is determined that the irregular wood has been positioned; if all the marking points do not fall on the points of the electronic model, the position of the electronic model is adjusted until all the marking points fall on the points of the adjusted electronic model.

[0106] Other embodiments or specific implementations of the irregular wood positioning device of the present application can refer to the above-mentioned method embodiments, which will not be repeated here.

[0107] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0108] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0109] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory / random access memory, a disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0110] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for positioning irregular wood, characterized in that: The method comprises the following steps: Acquire an electronic model of the irregular wood material, and set a number of marking points on the surface of the irregular wood material according to the electronic model; Put the irregular wood into a positioning system, wherein the positioning system includes a processing table, a mechanical arm and a visual camera, and the visual camera is installed at the end of the mechanical arm; Determine the target straight line corresponding to each marking point in the irregular wood by the positioning system, wherein the target straight line is a set of points corresponding to the marking points and imaged at the target pixel points in the visual camera; The irregular wood is positioned according to the target straight line corresponding to all the marking points set on the surface of the irregular wood.

2. The irregular wood positioning method according to claim 1, characterized in that: The step of determining the target straight line corresponding to each marking point in the irregular wood by the positioning system comprises: Constructing a coordinate system in the positioning system, and controlling the visual camera to shoot the marking point at different shooting positions through the mechanical arm; When it is detected that the marking point is imaged at the target pixel point of the visual camera, a target straight line is fitted based on the coordinate value of the marking point in the coordinate system.

3. The irregular wood positioning method according to claim 2, characterized in that: The step of constructing a coordinate system in the positioning system and controlling the visual camera to shoot the marking point at different shooting positions by the mechanical arm includes: In the positioning system, a coordinate system is constructed with the end of the mechanical arm as the origin, and the origin of the coordinate system moves with the end of the mechanical arm; The robot arm posture of the robot arm is adjusted so that the robot arm controls the visual camera to shoot the marking point at different shooting positions based on the robot arm posture.

4. The irregular wood positioning method according to claim 2, characterized in that: The step of fitting a target straight line based on the coordinate value of the marker point in the coordinate system when it is detected that the marker point is imaged at the target pixel point of the visual camera comprises: When it is detected that the marking point is imaged at the target pixel point of the visual camera, the coordinate value of the marking point in the coordinate system is determined according to the positional relationship between the marking point and the end of the robotic arm; A plurality of coordinate points are determined according to the coordinate values ​​of the marking points corresponding to the visual camera at different shooting positions, and a target straight line is obtained after fitting the plurality of coordinate points.

5. The irregular wood positioning method according to claim 1, characterized in that: The step of positioning the irregular wood according to the target straight line corresponding to all the marking points set on the surface of the irregular wood comprises: Determine the target ray corresponding to the current marking point at different shooting angles according to the target straight line corresponding to the current marking point, and set the intersection of the target ray to the spatial coordinate of the current marking point; The irregular wood is positioned based on the spatial coordinates corresponding to all the marking points set on the surface of the irregular wood.

6. The irregular wood positioning method according to claim 5, characterized in that: The step of positioning the irregular wood based on the spatial coordinates corresponding to all the marking points set on the surface of the irregular wood includes: Matching the spatial coordinates corresponding to all the marking points set on the irregular wood surface with the electronic model; If all the marking points fall on the points of the electronic model, it is determined that the irregular wood has been positioned; If all the marking points do not fall on the points of the electronic model, the position of the electronic model is adjusted until all the marking points fall on the points of the adjusted electronic model.

7. An irregular wood positioning device, characterized in that: The irregular wood positioning device comprises: A positioning marking module, used for obtaining an electronic model of the irregular wood material and setting a plurality of marking points on the surface of the irregular wood material according to the electronic model; A positioning preparation module, used for placing the irregular wood into a positioning system, wherein the positioning system comprises a processing table, a mechanical arm and a visual camera, wherein the visual camera is mounted at the end of the mechanical arm; A first execution module is used to determine the target straight line corresponding to each marking point in the irregular wood through the positioning system, wherein the target straight line is a set of points corresponding to the marking points and imaged at target pixel points in the visual camera; The second execution module is used to locate the irregular wood according to the target straight line corresponding to all the marking points set on the surface of the irregular wood.

8. An irregular wood positioning device, characterized in that: The device comprises: a memory, a processor, and an irregular wood positioning program stored in the memory and executable on the processor, wherein the irregular wood positioning program is configured to implement the steps of the irregular wood positioning method according to any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and an irregular wood positioning program is stored on the storage medium. When the irregular wood positioning program is executed by a processor, the steps of the irregular wood positioning method according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that The computer program product comprises an irregular wood positioning program, and when the irregular wood positioning program is executed by a processor, the steps of the irregular wood positioning method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Method for positioning and grabbing irregular workpiece based on single-frame RGB-D image deep learning

    CN111553949A

  • Method and device for carrying out full-automatic equal-area partitioning on flakes in any shape based on machine vision

    CN112643755A

  • Positioning system

    US20200209953A1