A Binocular Vision-Based Robotic Production Line Monitoring System

Through binocular vision technology and automated clamping exchange system, the error problem in intelligent robot production line monitoring is solved, efficient monitoring and management is achieved, and the intelligence and stability of the production line are improved.

CN115741790BActive Publication Date: 2024-12-06GUANGZHOU CHENGTIAN TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210709824.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-22
Publication Date
2024-12-06
Estimated Expiration
2042-06-22

AI Technical Summary

Technical Problem

The visual monitoring technology of the existing intelligent robot production line is affected by factors such as angle and light, resulting in large errors in the detection results, which cannot efficiently monitor quality, and is low in intelligence, so it cannot effectively improve the monitoring efficiency of the production line.

Method used

Adopt a robot production line monitoring system based on binocular vision, obtain and analyze images through binocular cameras, identify the working conditions of the robot, automatically recall and replace abnormal robots, and use adsorption discs and clamping mechanisms to achieve stable fixation and automatic exchange of robots on the production line. , combined with pressure sensors and distance sensors to ensure ground fixation stability, and achieve accurate monitoring and management of robot work.

Benefits of technology

The detection accuracy of the robot production line has been improved, the field of robot use has been expanded, the automated management of the robot working area in the production line has been realized, manual intervention has been reduced, and the overall efficiency and safety of the production line has been improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115741790B_ABST
    Figure CN115741790B_ABST
Patent Text Reader

Abstract

The present invention provides a robot production line monitoring system based on binocular vision. Compared with the robot production line monitoring system in the prior art, the robot production line monitoring system of the present invention further includes a workstation of the robot at the work position corresponding to the robot production line, a visual module for acquiring images of the production line and further processing the images to obtain the working conditions of the robot on the production line, a processing module for recalling the robot with abnormal working conditions detected by the visual module, an association module for binding and entering abnormal information of the recalled robot into a server, and a transportation module for receiving the driving instructions of the processing module and then replacing the abnormal robot on the corresponding workstation in a directional manner. The present invention effectively identifies the robot with abnormal working conditions and replaces it in time by monitoring the working robots on the robot production line.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of production line monitoring, and in particular to a robot production line monitoring system based on binocular vision. Background Art

[0002] The production line is the route that the product production process passes through, that is, the route formed by a series of production line activities such as processing, transportation, assembly, and inspection, starting from the raw materials entering the production site. Artificial intelligence technology uses intelligent robot equipment to replace manual work in the manufacturing production line to form an intelligent robot production line. The use of intelligent industrial production equipment has greatly reduced the demand for manpower, and the more dangerous processing processes will also be replaced by intelligent robots, which on the one hand ensures the safety of the production process, and on the other hand greatly improves the efficiency of production. Intelligent industrial equipment brings precise and efficient production. In industry, product quality inspection is generally divided into manual inspection and machine vision inspection. Due to the fault error of intelligent robots in intelligent production lines, monitoring the robots of existing intelligent robot production lines is the main technology for intelligent production line inspection. However, the existing visual monitoring technology has influencing factors such as angle and light on the actual shooting images in the actual production line, which leads to differences in the parts or parameters of the displayed image and the preset target reference image, resulting in errors in the detection results.

[0003] This experimental team has been browsing and studying a large amount of relevant records and materials on production line monitoring structure and related technologies of visual monitoring for a long time. At the same time, relying on relevant resources and conducting a large number of relevant experiments, after a large number of searches, it was found that existing prior arts such as US08056700B2, US09269151B2, KR100860652B1 and CN110697412B, such as a timer detection production line in the prior art, the production line includes a conveyor line with a slide rail, a tray driven to move by a power device is slid on the slide rail, a plurality of placement slots are arranged in the tray, and timers to be detected are placed in the placement slots, a truss is arranged above the conveyor line, and a timing manipulator and a detection manipulator driven up and down by a power device are fixed on the truss in sequence along the conveying direction, a timing disk is connected below the timing manipulator, a motor-driven twister is arranged in the timing disk, a detection disk is connected below the detection manipulator, and a connection electrode for detecting the power-on state of the timer is arranged in the detection disk, and the present invention also provides a method for detecting a timer using the above-mentioned device.

[0004] The present invention is made to solve the problems of generally low intelligence in this field, inability to perform efficient quality monitoring on product production lines, large errors in the judgment results of visual monitoring of production line products, etc. Summary of the invention

[0005] The purpose of the present invention is to propose a robot production line monitoring system based on binocular vision in view of the shortcomings of the current prior art.

[0006] In order to overcome the shortcomings of the prior art, the present invention adopts the following technical solutions:

[0007] Optionally, a robot production line monitoring system based on binocular vision, the robot production line includes robots that perform automated processing on products on the production line according to preset action programming information, the robot production line monitoring system includes a workstation of the robot at a work position corresponding to the robot production line, a vision module that acquires images of the production line and further processes the images to obtain the working conditions of the robots on the production line, a processing module that recalls the robots that have working abnormalities detected by the vision module, an association module that binds and enters abnormal information of the recalled robots into a server, and a drive instruction from the processing module is received to direct the abnormal machines on the corresponding workstations. A transport module for replacement processing by personnel, wherein the robot includes a body, a driving wheel for driving the body to be displaced relative to the ground and a matching mechanism for fixing the body to the corresponding workstation, the association module includes an identification unit for identifying the information code on the abnormal machine and a recording unit for binding the specific abnormal situation of the abnormal robot with its information code and uploading it to the server, the transport module includes at least two clamping mechanisms for clamping and transferring the robots respectively, an exchange mechanism for driving the two clamping mechanisms to perform position conversion to further realize the exchange of the abnormal robot with a new robot, a main body for fixing and supporting the fixing mechanism and the exchange mechanism, and a displacement drive mechanism for driving the main body to move.

[0008] Optionally, the vision module includes a binocular camera for acquiring images of the robot working in different production processes on the robot production line, and a judgment unit for receiving the image information captured by the binocular camera device and further analyzing and processing it to determine the working condition of the robot on the production line.

[0009] Optionally, the matching mechanism includes an adsorption plate arranged at the bottom of the body to adsorb and fix the ground, an open cavity arranged at the bottom of the body to accommodate the adsorption plate, a channel extending from the top of the open cavity to the inside of the body, an air duct connected to the top of the adsorption plate and extending from the channel to the inside of the body, a negative pressure driving mechanism arranged in the body and connected with the air duct to generate negative pressure to drive the adsorption plate to generate adsorption force, a fixed ring on the outer ring arranged at the middle horizontal position of the adsorption plate, at least one abutment member with one end fixedly connected to the fixed ring and the other end abutting against the open cavity, a pressure sensor arranged at the contact end of the adsorption plate and the ground, a control end for controlling various electrical equipment in the body, a determination unit for further obtaining the stability of the body fixed on the ground according to the pressure condition of the pressure sensing group, and a distance sensor arranged on the fixed ring for further monitoring the distance between the fixed ring and the ground.

[0010] Optionally, the abutment member includes a driving rod at one end of which is at least partially fixed on the body and the other end is correspondingly connected to the fixing ring, a compression spring arranged on the other end of the driving rod and bufferingly connected to the contact ring, and a miniature linear damper evenly arranged on the side wall of the open cavity and arranged parallel to the ground and perpendicularly abutting against the side rod wall of the driving rod.

[0011] Optionally, the judging unit includes the following processing steps:

[0012] S101: marking corresponding markers on the rotary joints and mechanical arms corresponding to the driving groups of each robot in advance,

[0013] S102: training each of the markers to obtain recognition of the markers on each of the rotational joints and the robotic arm, using the robot under different lighting conditions as training samples, and obtaining the RGB and / or grayscale value ranges of the markers corresponding to the rotational joints and the robotic arm of the robot as recognition feature parameters of the rotational joints and the robotic arm,

[0014] S103: acquiring image information captured by the binocular camera device at a predetermined time interval, and taking the time of each image acquisition as an extraction point, identifying information of the rotary joint and the mechanical arm of the robot in the image information according to the input of the recognition feature parameter,

[0015] S104: Calibrate the two camera devices and further establish a world coordinate system O W -X W Y W Z W , where the world coordinate system O W XW Axis, O W Y W Axis, O W Z W The corresponding unit vectors are i, j, and k, respectively, to achieve the conversion and fusion of the robot's rotation joints in different coordinate systems, and obtain the three-dimensional motion data of the robot in the world coordinate system.

[0016] S105: Each of the rotary joints and the corresponding rotary driven mechanical arms are respectively regarded as a driving group, and the driving groups corresponding to each robot connected in sequence from the bottom to the top of the robot body are respectively represented as RotaryA, RotaryB...RotaryN,

[0017] S106: Obtain the spatial coordinates of the markers of each drive group, and the marker corresponding to the rotary joint of RotaryN is Nb (XbN, YbN, ZbN), and the marker on the robot arm of RotaryN is Nc (XcN, YcN, ZcN), and obtain the reference vector n of the drive group RotaryN:

[0018]

[0019] S107: Obtain the angle N(τ) between the reference vector of RotaryN and the unit vector i, the angle N(ω) between the reference vector of RotaryN and the unit vector j, and the angle N(θ) between the reference vector of RotaryN and the unit vector k. Meanwhile, N(τ), N(ω) and N(θ)∈[0, 2π]:

[0020]

[0021]

[0022]

[0023] S108: Input the specific production process position of the production line where the robot is located into the action library to further obtain the standard action parameters of each drive group of the robot in the action library.

[0024] S109: Obtain the angles between the corresponding reference vectors of each of the drive groups corresponding to the robot and i, j, and k, and compare the angles with the standard motion parameters corresponding to each drive group. Specifically, and , it is determined that there is an error in the execution of the action of RotaryN of the corresponding robot.

[0025] Yet another aspect of the present invention provides a computer-readable storage medium, which includes the robot production line monitoring system control method and data calculation processing program. When the robot production line monitoring system control method program is executed by the processor, the robot production line monitoring system control method and data calculation steps are implemented.

[0026] The beneficial effects achieved by the present invention are:

[0027] 1. Through visual monitoring of the existing intelligent robot production line, the accuracy of the robot production line can be effectively improved.

[0028] 2. By automatically replacing abnormal machines in the robot production line, the scope of use of the robot production line can be effectively improved and expanded.

[0029] 3. The unified management of the robots in the robot production line can be effectively improved by automatically fixing the intelligent robots in the robot production line to the corresponding working areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The present invention can be further understood from the following description in conjunction with the accompanying drawings. The components in the figures are not necessarily drawn to scale, but the emphasis is placed on illustrating the principles of the embodiments. In different views, the same reference numerals designate corresponding parts.

[0031] Figure 1 It is a modular schematic diagram of the robot production line monitoring system of the present invention.

[0032] Figure 2 It is a structural schematic diagram of the clamping mechanism of the present invention.

[0033] Figure 3 It is a schematic structural diagram of the clamping group of the present invention.

[0034] Figure 4 It is a structural schematic diagram of the matching mechanism of the present invention.

[0035] Figure 5 It is a schematic diagram of the flow of the judgment unit of the present invention.

[0036] Figure 6 It is a schematic diagram of the working steps of the exchange mechanism of the present invention.

[0037] Figure 7 It is an experimental schematic diagram of the robot production line monitoring system of the present invention.

[0038] Description of the drawings: 1- linear drive motor; 2- fixed plate; 3- linear guide rail; 4- arc clamp; 5- moving block; 6- linear drive rod; 7- opening cavity; 8- drive rod; 9- compression spring; 10- fixed ring; 11- adsorption plate. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention is further described in detail in conjunction with its embodiments below; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. For those skilled in the art, other systems, methods and / or features of the present embodiment will become apparent after reviewing the following detailed description. It is intended that all such additional systems, methods, features and advantages are included in this specification, included within the scope of the present invention, and protected by the appended claims. Additional features of the disclosed embodiments are described in the following detailed description, and these features will be apparent from the following detailed description.

[0040] The same or similar numbers in the drawings of the embodiments of the present invention correspond to the same or similar parts; in the description of the present invention, it should be understood that if the terms "upper", "lower", "left", "right" and the like indicate the orientation or position relationship based on the orientation or position relationship shown in the drawings, it is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or component referred to must have a specific orientation. It is constructed and operated in a specific orientation. Therefore, the terms describing the position relationship in the drawings are only used for illustrative purposes and cannot be understood as a limitation on this patent. For ordinary technicians in this field, the specific meanings of the above terms can be understood according to specific circumstances.

[0041] Embodiment 1:

[0042] This embodiment constructs a monitoring system that automatically monitors a robot parts production line based on binocular vision technology;

[0043] A robot production line monitoring system based on binocular vision, the robot production line includes robots that perform automated processing on products on the production line according to preset action programming information, the robot production line monitoring system includes a workstation for the robot at a work position corresponding to the robot production line, a visual module for acquiring images of the production line and further processing the images to obtain the working conditions of the robots on the production line, a processing module for recalling the robots with abnormal working conditions detected by the visual module, an association module for binding and entering abnormal information of the recalled robots into a server, and a drive instruction for receiving the processing module to direct the processing module. A transport module for replacing the abnormal robot on the corresponding workstation, wherein the robot includes a body, a driving wheel for driving the body to move relative to the ground, and a matching mechanism for fixing the body to the corresponding workstation, the association module includes an identification unit for identifying the information code on the abnormal machine and a recording unit for binding the specific abnormal situation of the abnormal robot with its information code and uploading it to a server, the transport module includes at least two clamping mechanisms for clamping and transferring the robots respectively, an exchange mechanism for driving the two clamping mechanisms to perform position conversion to further realize the exchange of the abnormal robot with a new robot, and a fixing mechanism and a replacement mechanism. The main body is fixedly supported by a taking mechanism, and a displacement driving mechanism is used to drive the main body to move, the visual module includes binocular cameras for respectively acquiring images of the robots working on different production processes on the robot production line, and a judgment unit for receiving the image information captured by the binocular camera device and further analyzing and processing the image information to judge the working condition of the robot on the production line, the matching mechanism includes an adsorption plate arranged at the bottom of the body to adsorb and fix the ground, an open cavity arranged at the bottom of the body to accommodate the adsorption plate, a channel extending from the top of the open cavity to the inside of the body, and a channel connected to the top of the adsorption plate and extending from the channel to the The air duct inside the body, a negative pressure driving mechanism arranged in the body and connected with the air duct to generate negative pressure to drive the adsorption plate to generate adsorption force, a fixing ring on the outer ring arranged at the middle horizontal position of the adsorption plate, at least one abutting member with one end fixedly connected to the fixing ring and the other end abutting against the open cavity, a pressure sensor arranged at the contact end between the adsorption plate and the ground, a control end for controlling various electrical devices in the body, a determination unit for further obtaining the stability of the body fixed on the ground according to the pressure condition of the pressure sensing group, and a distance sensor arranged on the fixing ring for further monitoring the distance between the fixing ring and the ground.The abutment member includes a driving rod at one end of which is at least partially fixedly arranged on the body and the other end is correspondingly connected to the fixing ring, a compression spring arranged on the other end of the driving rod and connected to the contact ring for buffering, and a miniature linear damper evenly arranged on the side wall of the opening cavity and arranged parallel to the ground and perpendicularly abutting against the side rod wall of the driving rod. In another aspect, the present invention provides a computer-readable storage medium, which includes the control method and data calculation processing program of the robot production line monitoring system. When the control method program of the robot production line monitoring system is executed by the processor, the control method and data calculation steps of the robot production line monitoring system are implemented;

[0044] The matching mechanism includes an adsorption plate disposed at the bottom of the body for adsorbing and fixing the ground, an open cavity disposed at the bottom of the body for accommodating the adsorption plate, a channel extending from the top of the open cavity to the inside of the body, an air duct connected to the top of the adsorption plate and extending from the channel to the inside of the body, a negative pressure driving mechanism disposed in the body and communicating with the air duct to generate negative pressure to drive the adsorption plate to generate adsorption force, a fixing ring surrounding an outer ring disposed at a middle horizontal position of the adsorption plate, at least one abutting member having one end fixedly connected to the fixing ring and the other end abutting against the open cavity, a pressure sensor disposed at a contact end between the adsorption plate and the ground, a control end for controlling various electrical devices in the body, a determination unit for further obtaining the stability of the body being fixed on the ground according to the pressure condition of the pressure sensing group, and a distance sensor disposed on the fixing ring for further monitoring the distance between the fixing ring and the ground, wherein the pressure sensing group includes a plurality of pressure sensors mounted around each of the adsorption plates, and the pressure sensors are pre-programmed with identification numbers according to their installation positions;

[0045] The abutment member includes a driving rod at one end of which is at least partially fixedly arranged in the body and the other end is connected to the fixing ring, a compression spring arranged on the other end of the driving rod and connected to the contact ring for buffering, and a miniature linear damper evenly arranged on the side wall of the opening cavity and arranged parallel to the ground and perpendicularly abutting against the side rod wall of the driving rod, wherein the miniature linear damper is of prior art, and includes a cylinder body, a piston movably matched with the inner wall of the cylinder body, and a connecting rod connected to the piston and extending from the cylinder body, wherein the cylinder body is at least partially embedded and horizontally arranged in the inner wall of the body by welding, clamping and / or bolts, and a number of reinforcing rods are connected and fixed between the opening cavity and the cylinder body to improve the fixing stability of the cylinder body on the body, and the connecting rod of the miniature linear damper The connecting rod is connected and fixed to the rod wall of the driving rod through a matching piece, thereby effectively buffering the horizontal movement of the driving rod to improve the stability of the matching mechanism in adsorbing and fixing the ground. In the prior art, when the robot clamps the moving equipment on the production line, it is affected by the inertia of the equipment, thereby affecting the stability of the robot. The robot of the present invention effectively improves the replacement management of abnormal robots on the robot production line through its own drivable displacement and fixing effect. At the same time, the stability of the mobile robot in the working process is effectively solved through the matching mechanism. The determination unit respectively receives data information of each pressure sensor of the pressure sensing group on each adsorption disk on the robot, and determines that the adsorption disk is adsorbed to the ground when each pressure sensor in the pressure sensing group reaches a preset pressure value;

[0046] The working conditions of each robot on the robot production line are judged based on the determination unit to ensure the stability of the robot in processing large parts. At the same time, when the robot is displaced, the abutment member is used to effectively avoid the influence of the adsorption plate on the movement of the robot, and the linear damper and compression spring are used to effectively reduce the influence of the outside world on the robot during work.

[0047] Embodiment 2:

[0048] Combined with Figure 1-7 , in addition to the contents of the above embodiments, also includes:

[0049] The visual module includes binocular cameras for respectively acquiring images of working robots in different production processes on the robot production line, and a judgment unit for receiving image information captured by the binocular camera device and further analyzing and processing the image information to judge the product structure on the production line, wherein the binocular camera device is two camera devices for capturing images at different angles of the robots in the same production process and having the same instructions on the robot production line;

[0050] The binocular camera device is two camera devices that shoot robots in the same production process at different angles, and the camera device establishes three-dimensional coordinates of the same preset specifications for the images corresponding to the acquired images. The monitoring system also includes a robot motion library, which includes motion features of the robot motions in the production process. The robot body includes a plurality of mechanical arms that can rotate and work independently of each other and a rotating joint that connects the mechanical arms and further drives the mechanical arms to rotate. The judgment unit performs kinematic analysis on the rotating joints and mechanical arms of the robot, and uses each rotating joint as a reference point to refine the motion of each mechanical arm of the robot into the spatial rotation motion of each mechanical arm. The motion vectors of the corresponding rotating joints on the mechanical arms in each horizontal plane of the three-dimensional coordinates are used as the motion features of the robot. The present invention collects robot motion information by using two camera devices distributed at different positions as binocular uncalibrated visual sensors.

[0051] The judging unit includes the following processing steps:

[0052] S101: marking corresponding markers on the rotary joints and mechanical arms corresponding to the driving groups of each robot in advance,

[0053] S102: training each of the markers to obtain recognition of the markers on each of the rotational joints and the robotic arm, using the robot under different lighting conditions as training samples, and obtaining the RGB and / or grayscale value ranges of the markers corresponding to the rotational joints and the robotic arm of the robot as recognition feature parameters of the rotational joints and the robotic arm,

[0054] S103: acquiring image information captured by the binocular camera device at a predetermined time interval, and taking the time of each image acquisition as an extraction point, identifying information of the rotary joint and the mechanical arm of the robot in the image information according to the input of the recognition feature parameter,

[0055] S104: Calibrate the two camera devices and further establish a world coordinate system O W -X W Y W Z W , where the world coordinate system O W X W Axis, O W Y W Axis, O W Z W The corresponding unit vectors are i, j, and k, respectively, to achieve the conversion and fusion of the robot's rotation joints in different coordinate systems, and obtain the three-dimensional motion data of the robot in the world coordinate system.

[0056] S105: Each of the rotary joints and the corresponding rotary driven mechanical arms are respectively regarded as a driving group, and the driving groups corresponding to each robot connected in sequence from the bottom to the top of the robot body are respectively represented as RotaryA, RotaryB...RotaryN,

[0057] S106: Obtain the spatial coordinates of the markers of each drive group, and the marker corresponding to the rotary joint of RotaryN is Nb (XbN, YbN, ZbN), and the marker on the robot arm of RotaryN is Nc (XcN, YcN, ZcN), and obtain the reference vector n of the drive group RotaryN:

[0058]

[0059] S107: Obtain the angle N(τ) between the reference vector of RotaryN and the unit vector i, the angle N(ω) between the reference vector of RotaryN and the unit vector j, and the angle N(θ) between the reference vector of RotaryN and the unit vector k. Meanwhile, N(τ), N(ω) and N(θ)∈[0, 2π]:

[0060]

[0061]

[0062]

[0063] S108: Input the specific production process position of the production line where the robot is located into the action library to further obtain the standard action parameters of each drive group of the robot in the action library.

[0064] S109: Obtain the angles between the corresponding reference vectors of each of the drive groups corresponding to the robot and i, j, and k, and compare the angles with the standard motion parameters corresponding to each drive group. Specifically, and , it is judged that there is an error in the execution of the corresponding robot's RotaryN action.

[0065] The monitoring system includes an action library of action features corresponding to the robots of each production process in the robot production line, and the action library includes the numerical range of the angle τ between the reference vector of each drive group and i, namely |τ'|, the numerical range of the angle ω between the reference vector of the corresponding drive group and j, and the numerical range of the angle θ between the reference vector of the corresponding drive group and k, namely |θ'|, obtained by technicians in the field through a large number of repeated experimental training. The standard action parameters of the robot corresponding to RotaryN are expressed as |Nτ'|, |Nω'| and |Nθ'|.

[0066] The processing module receives the monitoring information of each robot on the robot production line from the judgment unit, and generates relevant instruction information including the location information of the workstation of the abnormal robot according to the number of abnormal robots, and sends it to the transportation module. The transportation module receives the relevant instruction information of the processing module and moves to the corresponding workstation in sequence to replace the abnormal robot;

[0067] The association module obtains the identification number and abnormal information of the robot judged abnormal by the judgment unit, records and uploads them to the corresponding server, and at the same time, the management module prints a label on the abnormal evaluation result of the abnormal robot by the judgment unit and sticks it on the abnormal robot to facilitate the subsequent maintenance work of the abnormal robot by the staff;

[0068] The present invention obtains the corresponding action parameters of the action behaviors of the robots in the production line, and further determines the working conditions of the corresponding robots according to the action parameters of each driving group of the actual robots and the corresponding standard action parameters.

[0069] Embodiment three:

[0070] Combined with Figure 1-7 , in addition to the contents of the above embodiments, also includes:

[0071] The robot includes a body, a driving wheel for driving the body to move relative to the ground, and a matching mechanism for fixing the body to the corresponding workstation. The association module includes an identification unit for identifying the information code on the abnormal machine and a recording unit for associating the specific abnormal situation of the abnormal machine with its information code and uploading it to the server. The transportation module includes at least two clamping mechanisms for clamping and transferring the robots respectively, a replacement mechanism for driving the two clamping mechanisms to perform position conversion to further realize the replacement of the abnormal robot with a new robot, a main body for fixing and supporting the fixing mechanism and the replacement mechanism, and a displacement driving mechanism for driving the main body to move. Each of the clamping mechanisms includes a fixed frame of a closed frame structure arranged vertically on the ground, linear guide rails arranged vertically on the ground and at opposite ends of the height direction of the fixed frame, sliders respectively limited and movable on each of the linear guide rails, and two ends respectively connected to the fixed frame. A fixing plate connected to the sliders on different linear rails and perpendicular to the linear rails and parallel to the ground, a linear drive motor whose two ends are respectively fixedly connected to the top of the fixing frame and the fixing plate and drives the lifting movement of the fixing frame through telescopic movement, a guide mechanism fixed by bolts to at least two linear guides parallel to the ground and connected and fixed to the fixing plate, a plurality of moving blocks respectively slidably limited on each of the linear guides of the guide mechanism, at least one group of clamping members including two arc-shaped clamping members symmetrically arranged at two ends of the guide mechanism and at the same horizontal height, which can be linearly slidably displaced along the guide mechanism by being respectively fixedly connected to some of the moving blocks, and a plurality of linear drive rods whose two telescopic ends are respectively connected to two arc-shaped clamping members arranged opposite to each other in the same clamping group and drive the arc-shaped clamping members arranged opposite to each other to move toward and / or away from each other along the guide mechanism;

[0072] The linear guides are fixedly arranged on the fixed plate at a preset interval, and at least two of the linear guides arranged adjacent to each other in the direction from the top of the fixed plate to the bottom of the fixed plate form a guide group, each linear guide is slidably equipped with at least two moving blocks, and each guide group is fixedly equipped with a group of clamping groups, and each clamping group is equipped with at least one linear drive rod, wherein the linear drive motor is pre-programmed with a preset clamping height corresponding to the height of driving the fixed frame when the displacement mechanism performs preliminary clamping work on the robot and a preset clamping height when the transport module clamps the robot and drives the displacement drive mechanism to move. The corresponding transfer drive height, the transfer drive height and the preset clamping height corresponding to the linear drive motor can be selected by technicians in this field according to actual needs, the site of the actual robot production line and the specifications of the corresponding robot, and are not limited here. The exchange mechanism is a rotating table with a rotation function, and the two clamping mechanisms are symmetrically fixed on the rotating table relative to the rotation axis of the rotating motion of the rotating table. One of the clamping mechanisms clamps the abnormal robot and the other clamps the new robot. The abnormal robot and the new robot are further exchanged by the rotation of the exchange mechanism;

[0073] The linear drive rods located at different horizontal heights respectively drive the corresponding clamping groups to have the largest distance to be clamped, and the clamping end of each clamping group is provided with a force monitoring group for monitoring the clamping force of the corresponding clamping group on the clamped robot, wherein the force monitoring group includes a plurality of stress sensors respectively provided at the contact ends of the arc-shaped clamping member on the corresponding clamping group and the robot, and when the monitoring values ​​of a plurality of the stress sensors in the force monitoring group are greater than a preset value, it is judged that the corresponding clamping group completes the clamping work, and when the clamping group completes the clamping work, the linear drive rod corresponding to the clamping group stops the contraction work, wherein the preset value of the monitoring value of the stress sensor is obtained by a technician in this field through a large number of repeated training to obtain the range of the monitoring value of the stress sensor corresponding to the time when the clamping group effectively clamps the corresponding horizontal part of the robot;

[0074] The steps of replacing the abnormal robot by the replacement mechanism are as follows:

[0075] S201: Sending a command to the abnormal robot to further release the fixing of the matching mechanism of the abnormal robot to the ground.

[0076] S202: The linear drive motor drives the fixing frame to rise and fall to a preset clamping height, and the linear drive rod drives the corresponding clamping groups to a distance to be clamped, and further the displacement drive mechanism drives the clamping mechanism to wrap around the robot.

[0077] S203: After the main body is directional-displaced to the target workstation and relatively cooperates with the robot, the clamping mechanism is further driven to contract and clamp the body of the robot until each clamping group completes the clamping work.

[0078] S204: Control the linear drive motor to drive the fixed plate to rise to a preset transfer height,

[0079] S205: driving the exchange mechanism to rotate so as to exchange the new robot to the original workstation of the abnormal robot,

[0080] S206: Sending a command to the new matching mechanism of the robot to adsorb and fix to the ground of the corresponding working point;

[0081] The arc-shaped clamping member is an arc-shaped block with an arc, an opening evenly arranged on the arc-shaped block and at one end in contact with the robot, and a rubber bag with a deformation recovery function respectively embedded in the opening. The rubber bag has a certain deformation ability and can effectively prevent the robot from being scratched when the clamping mechanism clamps the robot. At the same time, the rubber bag effectively increases the contact area between the clamping member and the robot, thereby improving the stability of the clamping mechanism clamping the robot.

[0082] The present invention effectively identifies abnormal robots with threshold deviations in their working motion paths by acquiring and analyzing visual images of robots in the robot production line, and replaces them in a timely manner by identifying the abnormal robots and acquiring the corresponding workstation positions, thereby effectively realizing the work monitoring of robots in the robot production line of the prior art.

[0083] Although the present invention has been described above with reference to various embodiments, it should be understood that many changes and modifications may be made without departing from the scope of the present invention. That is, the methods, systems and devices discussed above are examples. Various configurations may appropriately omit, replace or add various processes or components. For example, in alternative configurations, the method may be performed in an order different from the order described, and / or various components may be added, omitted and / or combined. Moreover, the features described with respect to certain configurations may be combined in various other configurations, such as different aspects and elements of the configurations may be combined in a similar manner. In addition, the elements therein may be updated as the technology develops, i.e., many elements are examples and do not limit the scope of the present disclosure or claims.

[0084] Specific details are given in the specification to provide a thorough understanding of the exemplary configurations including implementations. However, the configurations can be practiced without these specific details. For example, well-known circuits, processes, algorithms, structures, and techniques have been shown without unnecessary details to avoid obscuring the configurations. This description provides only example configurations and does not limit the scope, applicability, or configurations of the claims. On the contrary, the foregoing description of the configurations will provide those skilled in the art with an enabling description for implementing the described techniques. Various changes may be made to the functions and arrangements of the elements without departing from the spirit or scope of the present disclosure.

[0085] In summary, it is intended that the above detailed description is considered to be illustrative rather than restrictive, and it should be understood that the above embodiments should be understood to be only used to illustrate the present invention and not to limit the scope of protection of the present invention. After reading the contents of the present invention, the technician can make various changes or modifications to the present invention, and these equivalent changes and modifications also fall within the scope defined by the claims of the present invention.

Claims

1. A robot production line monitoring system based on binocular vision, the robot production line includes robots that perform automated processing on the products of the production line according to preset action programming information, characterized in that: The robot production line monitoring system includes a workstation where the robot is at a work position corresponding to the robot production line, a visual module that acquires images of the production line and further processes the images to obtain the working conditions of the robots on the production line, a processing module that recalls the robots with abnormal working conditions detected by the visual module, an association module that binds and enters abnormal information of the recalled robots into a server, and a transportation module that receives driving instructions from the processing module and then replaces the abnormal robots on the corresponding workstations. Wherein, the robot comprises a body, a driving wheel for driving the body to move relative to the ground, and a matching mechanism for fixing the body to the corresponding workstation, the association module comprises an identification unit for identifying the information code on the abnormal machine and a recording unit for binding the specific abnormal situation of the abnormal robot with its information code and uploading it to the server, the transportation module comprises at least two clamping mechanisms for clamping and transferring the robots respectively, a replacement mechanism for driving the two clamping mechanisms to perform position conversion to further realize the replacement of the abnormal robot with a new robot, a main body for fixing and supporting the clamping mechanism and the replacement mechanism, and a displacement driving mechanism for driving the main body to move; The visual module includes a binocular camera for respectively acquiring images of the robots working in different production processes on the robot production line, and a judgment unit for receiving the image information captured by the binocular camera and further analyzing and processing the image information to judge the working condition of the robots on the production line; The matching mechanism includes an adsorption plate arranged at the bottom of the body to adsorb and fix the ground, an open cavity arranged at the bottom of the body to accommodate the adsorption plate, a channel extending from the top of the open cavity to the inside of the body, an air duct connected to the top of the adsorption plate and extending from the channel to the inside of the body, a negative pressure driving mechanism arranged in the body and connected with the air duct to generate negative pressure to drive the adsorption plate to generate adsorption force, a fixing ring on an outer ring arranged at a middle horizontal position of the adsorption plate, at least one abutment member with one end fixedly connected to the fixing ring and the other end abutting against the open cavity, a pressure sensor arranged at the contact end of the adsorption plate and the ground, a control end for controlling various electrical devices in the body, a determination unit for further obtaining the stability of the body fixed on the ground according to the pressure condition of the pressure sensor, and a distance sensor arranged on the fixing ring for further monitoring the distance between the fixing ring and the ground.

2. The robot production line monitoring system according to claim 1, characterized in that: The abutment member includes a driving rod at one end of which is at least partially fixed on the body and the other end is correspondingly connected to the fixing ring, a compression spring arranged on the other end of the driving rod and connected to the fixing ring for buffering, and a miniature linear damper evenly arranged on the side wall of the open cavity and arranged parallel to the ground and perpendicularly abutting against the side rod wall of the driving rod.

3. The robot production line monitoring system according to claim 2, characterized in that: The judging unit includes the following processing steps: S101: marking corresponding markers on the rotary joints and mechanical arms corresponding to the driving groups of each robot in advance, S102: training each marker to obtain recognition of the markers on each rotating joint and the robotic arm, using the robot under different lighting conditions as training samples, and obtaining the RGB and / or grayscale value ranges of the markers corresponding to the rotating joints and the robotic arm of the robot as recognition feature parameters of the rotating joints and the robotic arm, S103: acquiring image information captured by the binocular camera at a predetermined time interval, and taking the time of each image acquisition as an extraction point, identifying information of the rotary joint and the mechanical arm of the robot in the image information according to the input of the recognition feature parameter, S104: Calibrate the two camera devices and further establish a world coordinate system O W -X W Y W Z W , where the world coordinate system O W X W Axis, O W Y W Axis, O W Z W The corresponding unit vectors are i, j, and k, respectively, to achieve the conversion and fusion of the robot's rotation joints in different coordinate systems, and obtain the three-dimensional motion data of the robot in the world coordinate system. S105: Each of the rotary joints and the corresponding rotary driven mechanical arms are respectively regarded as a driving group, and the driving groups corresponding to each robot connected in sequence from the bottom to the top of the robot body are respectively represented as RotaryA, RotaryB...RotaryN, S106: Obtain the spatial coordinates of the markers of each drive group, and the marker corresponding to the rotary joint of RotaryN is Nb (XbN, YbN, ZbN), and the marker on the robot arm of RotaryN is Nc (XcN, YcN, ZcN), and obtain the reference vector n of the drive group RotaryN: n= , S107: Obtain the angle N(τ) between the reference vector of RotaryN and the unit vector i, the angle N(ω) between the reference vector of RotaryN and the unit vector j, and the angle N(ϑ) between the reference vector of RotaryN and the unit vector k. Meanwhile, N(τ), N(ω) and N(ϑ) : cosN(τ)= , cosN(ω)= , cosN(ϑ)= , S108: Input the specific production process position of the production line where the robot is located into the action library to further obtain the standard action parameters of each drive group of the robot in the action library. S109: Obtain the angles between the corresponding reference vectors of each drive group corresponding to the robot and i, j, k, and compare the angles with the standard action parameters corresponding to each drive group. Specifically, when N(τ)∉|Nτ'|, N(ω)∉|Nω'| and N(ϑ)∉|Nϑ'| exist, it is determined that there is an error in the execution of the action of RotaryN of the corresponding robot.

4. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a robot production line monitoring system control method and a data calculation processing program. When the robot production line monitoring system control method program is executed by the processor, the processing steps of the robot production line monitoring system as described in claim 3 are implemented.