Fastening device and fastening method
The fastening device and method improve bolt fastening efficiency by using image-based positioning and sensor feedback to automate the process, reducing time and ensuring accurate alignment and insertion.
Patent Information
- Application Number
- JP2023057155
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-03-31
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2043-03-31
AI Technical Summary
Existing fastening technologies, such as those described in Patent Document 1, require time-consuming spiral searches for fastening holes, which prolong the bolt fastening process.
A fastening device and method that utilizes an imaging means to capture the positions of fastening holes, calculates their positions based on captured images, and controls a robot to precisely insert and fasten bolts, incorporating force and displacement sensors to ensure accurate alignment and insertion.
This approach significantly reduces the time required for bolt fastening by enabling precise, efficient alignment and insertion of bolts, enhancing automation and reducing the risk of damage to components.
Smart Images

Figure 0007588673000001 
Figure 0007588673000002 
Figure 0007588673000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a fastening device and a fastening method. [Background technology]
[0002] There is a demand for automation of processes in the manufacture of products such as battery packs for electric vehicles. One process that requires automation is the bolt fastening process, in which fastening means such as bolts and screws are inserted into fastening holes on a workpiece to fasten it. An example of automating the fastening process is disclosed in Patent Document 1. Patent Document 1 discloses a process for searching for the position of a fastening hole in a wide range by calculating coordinates so that the movement trajectory of a fastening part is a spiral trajectory. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2012-20345 A Summary of the Invention [Problem to be solved by the invention]
[0004] Patent Document 1 discloses a fastening device that searches for a fastening hole in a spiral shape that spreads outward from a certain point when a screw is not inserted in the fastening hole. This spiral search has the problem that it takes time to search for the fastening hole.
[0005] The present invention has been made in consideration of the above circumstances, and one of its objects is to provide a fastening device and fastening method that shortens the time required for bolt fastening processing. [Means for solving the problem]
[0006] The fastening device and fastening method according to the present invention employ the following configuration. (1): A fastening device according to one aspect of the present invention is a fastening device that assembles a part to be assembled to a part to be assembled by fastening a fastening means. The fastening device includes an imaging means and a control means. The imaging means captures an image of an area including at least the first fastening hole in a state in which the part to be assembled, which has a first fastening hole, is placed on top of the part to be assembled, which has a second fastening hole. The control means calculates a first position of the first fastening hole and a second position of the second fastening hole based on the captured image. The control means controls a robot to move and insert the fastening means into the first fastening hole based on the first position, moves the part to be assembled with the fastening means inserted into the first fastening hole in the direction of the second position, and controls the robot to fasten the fastening means in response to detection of the insertion of the fastening means into the second fastening hole.
[0007] (2): In the above aspect (1), when the captured image includes an image of at least a portion of the second fastening hole, the control means calculates the second position of the second fastening hole based on the image of the second fastening hole in the captured image.
[0008] (3): In the above aspect (1) or (2), the fastening means includes a storage means for storing distance information indicating a distance from the contour of the assembled part to the second fastening hole. When the captured image does not include an image of at least a part of the second fastening hole, the control means calculates the second position based on the position of the contour of the assembled part in the captured image and the distance information.
[0009] (4): In any one of the above aspects (1) to (3), the fastening device further includes a force sensor that measures a force applied to the fastening means, and the control means stops the movement of the assembly part in a state where the fastening means is inserted into the first fastening hole toward the second position when a sensor value of the force sensor exceeds a first threshold value.
[0010] (5): In one of the above embodiments (1) to (4), the fastening device includes at least one of a force sensor that measures a force applied to the fastening means and a displacement sensor that measures a movement amount of the fastening means. The control means detects that the fastening means has been inserted into the second fastening hole when a sensor value or a change in the sensor value by the sensor exceeds a second threshold value.
[0011] (6): In any one of the above embodiments (1) to (5), when the control means moves the assembly part with the fastening means inserted in the first fastening hole in the direction of the second position and does not detect that the fastening means has been inserted into the second fastening hole, the control means controls the robot to cause the assembly part with the fastening means inserted in the first fastening hole to reciprocate while changing the moving direction.
[0012] (7): In any one of the above embodiments (1) to (6), when the calculated distance between the first position and the second position is less than a predetermined value, the control means moves and inserts the fastening means into the first fastening hole based on the first position, and fastens the fastening means without moving the assembly part with the fastening means inserted into the first fastening hole in the direction of the second position.
[0013] (8): In any one of the above (1) to (7), the assembly part has a plurality of the first fastening holes. Among the plurality of first fastening holes, some of the first fastening holes are subjected to a fastening process after the other first fastening holes. The control means moves the assembly part with the fastening means inserted into some of the first fastening holes toward the second position while loosening the fastening state of the fastening means of the other first fastening holes.
[0014] (9): A fastening method according to one embodiment of the present invention includes an imaging step of imaging an area including at least the first fastening hole while the assembly part having a first fastening hole is placed on top of the assembled part having a second fastening hole; a calculation step of calculating a first position of the first fastening hole and a second position of the second fastening hole based on the captured image; a moving step of controlling a robot to move and insert the fastening means into the first fastening hole based on the first position and to move the assembly part with the fastening means inserted into the first fastening hole toward the second position; and a fastening step of controlling the robot in response to detection that the fastening means has been inserted into the second fastening hole to fasten the fastening means. Effect of the Invention
[0015] According to (1) to (9), the time required for the bolt tightening process can be reduced. [Brief description of the drawings]
[0016] [Figure 1] 1 is an overall view of a fastening device according to an embodiment of the present invention; [Diagram 2] 2 is a hardware configuration diagram of a fastening device according to the present embodiment. [Diagram 3] 4 is a flowchart illustrating a process flow of the fastening device in the present embodiment. [Figure 4] FIG. 4 is a diagram illustrating a schematic positional relationship between an upper hole and a lower hole. [Diagram 5] 10A to 10C are diagrams illustrating an example of a correction process. [Figure 6] 13 is a flowchart illustrating a flow of a correction process. [Figure 7] 11A and 11B are diagrams illustrating a process of detecting an insertion state. [Figure 8] 10A to 10C are diagrams illustrating an example of a correction process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] An embodiment of the present invention will be described below with reference to Figs. 1 to 8.
[0018] (Configuration of fastening device) The configuration of the fastening device according to the embodiment will be described with reference to Figures 1 and 2. Figure 1 is an overall view of a fastening device 10 in this embodiment. Figure 2 shows a hardware configuration diagram of the fastening device in this embodiment. The fastening device 10 in this embodiment includes, for example, a robot hand 15, a control device 11, a nut runner control unit 13, and a control panel 14. The robot hand 15 includes, for example, an imaging device 51, a nut runner 52, a socket 53, a force sensor 54, and a displacement sensor 55.
[0019] A base member 20 (part to be assembled) is placed on a workpiece mounting portion 60 shown in Fig. 1. A robot hand 15 is installed on a stand. The fastening device 10 in this embodiment assembles a bus bar 30 (part to be assembled, not shown in Figs. 1 and 2) to the base member 20, as an example.
[0020] In this embodiment, the X-axis direction and the Y-axis direction are directions parallel to two mutually perpendicular straight lines on a plane perpendicular to the insertion direction of the fastening means, and the Z-axis direction is a direction parallel to the screw insertion direction.
[0021] The robot hand 15 is, for example, a six-axis articulated robot hand. The robot hand 15 is configured as an articulated arm having a plurality of links and joints that rotatably connect the links. Each joint is provided with an actuator (not shown) that drives the joint. The actuator is, for example, a motor, or a hydraulic or pneumatic drive unit.
[0022] The imaging device 51 has an imaging element such as a charge coupled device (CCD) and a lens unit as an optical system. The imaging device 51 captures an image of a member placed on the work placement unit 60 and generates captured image data.
[0023] The nut runner 52 is a hand tool or the like attached to the tip of the robot hand 15. The nut runner 52 has a socket 53 that can rotate about its axis by being driven by a drive unit. The socket 53 is attached to the tip of the nut runner 52. The socket 53 has, for example, a magnetic adsorption function using a magnet (or a vacuum adsorption function) and holds the bolt 40 using this function.
[0024] The nut runner 52 rotates the socket 53 about its axis in response to a control signal from the control device 11. The nut runner 52 also stops the rotation of the socket 53 in response to a control signal from the nut runner control section 13. This causes the recess of the socket 53 to fit onto the head of the bolt 40.
[0025] The force sensor 54 and the displacement sensor 55 are attached to the tip of the robot hand 15. The force sensor 54 is a contact sensor capable of detecting, for example, six-axis components (force components in three axial directions of the X-axis, Y-axis, and Z-axis, and moment components in three axial directions of the X-axis, Y-axis, and Z-axis).
[0026] The force sensor 54 detects a change in the contact state of the socket 53 with respect to the bolt 40 when the socket 53 of the nut runner 52 comes into contact with the bolt 40. That is, the force sensor 54 sequentially detects three-axis components of the contact force (reaction force) that the socket 53 receives from the bolt 40 and three-axis components of the moment of the contact force. The force sensor 54 sequentially outputs the detection results of the six-axis components to the control device 11.
[0027] The force sensor 54 may be a torque sensor that detects the torque of the motor. In this case, the multiple torque sensors detect the torque of the motor and output the detection results to the control device 11. The detection unit of the control device 11 estimates a change in the contact force of the socket 53 with respect to the bolt 40 based on the detection results of the multiple torque sensors.
[0028] The displacement sensor 55 measures the distance from the sensor to an object. The displacement sensor 55 measures the amount of movement (displacement) when an object moves from one position to another position based on the measured position information. The displacement sensor 55 in this embodiment measures, for example, the amount of movement of the bolt 40 in the Z-axis direction.
[0029] The control device 11 is configured using a processor such as an IPU (Intelligence Processing Unit) and a memory. The memory is, for example, a semiconductor memory, and includes a ROM (Read Only Memory) that stores various control programs, and a RAM (Random Access Memory) that provides a temporary working area. The control device 11 reads out the programs stored in the memory and controls the operation of each device.
[0030] The control device 11 operates the robot hand 15 by supplying a control signal to the robot hand 15. Specifically, the control device 11 drives an actuator of the robot hand 15 to rotate the shaft of the actuator. The control device 11 detects the contact state and the displacement over time between the socket 53 and the bolt 40 as waveform data from the detection results of the sensor. The control device 11 performs processing based on the captured image data generated by the imaging device 51.
[0031] The nut runner control unit 13 controls the rotation of the nut runner 52. For example, when the nut runner control unit 13 detects a torque increase accompanying the rotation of the socket 53, it transmits a fastening completion signal to the control device 11. The control panel 14 has, for example, an amplifier, a power supply, and a PLC (Programmable Logic Controller).
[0032] Fig. 3 is a flowchart illustrating the flow of processing by fastening device 10 in this embodiment. Fig. 3 illustrates a process of assembling bus bar 30 to base member 20 by fastening bolt 40. Each of base member 20 and bus bar 30 has a fastening hole. Fastening device 10 inserts bolt 40 into the fastening hole of base member 20 and the fastening hole of bus bar 30 to fasten them together.
[0033] Hereinafter, the fastening holes 21 of the base member 20 are also referred to as lower holes, and the fastening holes 31 of the busbar 30 are also referred to as upper holes. In this embodiment, the busbar 30 is exemplified as an assembly part, and the base member 20 is exemplified as an assembled part, but the present invention is not limited to this example. The present invention is also applicable to the case where other members are assembled together. The busbar 30 is an example of an assembly part in this embodiment. The assembly part in this embodiment may be a bracket or other co-fastening part. A bracket is a support or mounting fixture used to connect members together. In this embodiment, the bolt 40 is exemplified as the fastening means, but the present invention is not limited to this example. It may be a screw or other member.
[0034] The base member 20 is transported and placed on the work placement section 60. The robot hand 15 places the bus bar 30, which is a component to be assembled, on the base member 20 placed on the work placement section 60 (step S11). The control device 11 controls the robot hand 15 to grip the bus bar 30 and place the bus bar 30 at a target coordinate specified in advance.
[0035] With the bus bar 30 placed on the base member 20, the imaging device 51 captures an image of at least an area including the upper hole 31 of the bus bar 30 from above (step S12). The imaging device 51 thereby generates captured image data of the area including at least the upper hole 31.
[0036] The control device 11 detects an image of the upper hole 31 from the generated captured image data, and calculates the center position of the upper hole 31 in the captured image data (step S13). The control device 11 detects the contour of the upper hole 31 from the captured image data. The memory stores, for example, information on the distance (X-axis distance, Y-axis distance) from the contour of the upper hole 31 in the bus bar 30 to the center coordinates. The control device 11 calculates the center position of the upper hole 31 in the captured image data based on the position information of the detected contour of the upper hole 31 and the distance information read from the memory. The control device 11 converts the calculated center position of the upper hole 31 into spatial coordinates, and calculates the center coordinates of the upper hole 31.
[0037] The control device 11 determines whether or not an image of at least a part of the pilot hole 21 of the base member is included in the captured image data (step S14). When there is little misalignment between the busbar 30 and the base member 20 and the distance between the upper hole 31 and the pilot hole 21 is small, for example, a part or the whole of the pilot hole 21 is visible from the inside of the upper hole 31. In this case, the captured image data includes an image of at least a part of the pilot hole 21.
[0038] During the process of transporting the base member 20, the position of the placed base member 20 may shift due to various influences. Alternatively, during the process of placing the bus bar 30, the position of the base member 20 or the bus bar 30 may shift. In such cases, the distance between the upper hole 31 and the lower hole 21 may become large. When the positional shift between the bus bar 30 and the base member 20 is large and the distance between the upper hole 31 and the lower hole 21 is large, for example, the lower hole 21 is hidden by the bus bar 30 or is located on the periphery (outside) of the bus bar 30.
[0039] When the pilot hole 21 is covered by the bus bar 30, an image of the pilot hole 21 is not detected from the captured image data. On the other hand, when the pilot hole 21 is located around the bus bar 30, an image of at least a part of the pilot hole 21 outside the bus bar 30 is detected from the captured image data.
[0040] Fig. 4 is a diagram showing a schematic positional relationship between the upper hole 31 and the lower hole 21. Fig. 4(a) shows a state in which a part of the lower hole 21 is visible from inside the upper hole 31. When the upper hole 31 is imaged from above in this state, an image of at least a part of the lower hole 21 is included in the captured image data. On the other hand, Fig. 4(b) shows a state in which the lower hole 21 is covered by the bus bar 30 due to a shift in the placement position of the bus bar 30. When the upper hole 31 is imaged from above in this state, an image of the lower hole 21 is not included in the captured image data.
[0041] In this way, whether or not the image of the pilot hole 21 is included in the captured image data depends on the positional relationship between the upper hole 31 and the pilot hole 21. Returning to the flowchart of Fig. 3, the control device 11 calculates the center coordinates of the pilot hole 21 based on the generated captured image data.
[0042] When an image of the pilot hole is detected from the captured image data (Yes in step S14), the control device 11 calculates the center coordinate of the pilot hole 21 based on the image of the pilot hole 21 in the captured image data (step S15). For example, the control device 11 detects the outline of a part or the whole of the pilot hole 21 from the captured image data. The control device 11 calculates the center position of the pilot hole 21 based on the positional relationship between the outline of the upper hole 31 and the outline of the pilot hole 21 in the captured image data. For example, the control device 11 acquires the distance between the upper hole 31 and the pilot hole 21, and calculates the center position of the pilot hole 21 based on the center position of the upper hole 31 and the acquired distance. The control device 11 converts the calculated center position of the pilot hole 21 into spatial coordinates to calculate the center coordinate of the pilot hole 21.
[0043] On the other hand, if an image of the pilot hole is not detected from the captured image data (No in step S14), the control device 11 calculates the center coordinates of the pilot hole 21 based on, for example, the contour of the base member 20 detected from the captured image data. The contour in this embodiment indicates, for example, the outer shape or form of the base member 20. The outer contour is also called a character line.
[0044] The control device 11 detects the contour of the base member 20 from the captured image data (step S16). The control device 11 detects the contour by using a technique such as pattern matching. The control device 11 may detect the contour based on another analysis process of the captured image data.
[0045] For example, the memory stores information on the distance (X-axis distance, Y-axis distance) from the contour of the base member 20 to the center coordinates of the pilot hole 21. The control device 11 calculates the center position of the pilot hole 21 in the captured image data based on the position information of the detected contour and the distance information read from the memory. The control device 11 converts the calculated center position of the pilot hole 21 into spatial coordinates to calculate the center coordinates of the pilot hole 21 (step S17).
[0046] The control device 11 may calculate the central coordinates of the pilot hole 21 based on the amount of positional deviation of the base member 20. In this case, the memory stores, for example, information on the position of the outline and the position of the pilot hole 21 when the base member 20 is appropriately positioned. The control device 11 acquires the amount of positional deviation of the base member 20 by comparing the position of the outline detected based on the captured image data with the stored position. The control device 11 calculates the central position of the pilot hole 21 in the captured image data based on the acquired amount of positional deviation and the position information of the pilot hole 21 when it is appropriately positioned. This allows the control device 11 to calculate the central coordinates of the pilot hole 21 in space.
[0047] In the illustrated example, when the pilot hole 21 is located around the bus bar 30, an image of the pilot hole is detected from the captured image data, and the central coordinate of the pilot hole 21 is calculated according to step S15. However, when the pilot hole 21 is located around the bus bar 30, the control device 11 may calculate the central coordinate of the pilot hole 21 according to steps S16 and S17. That is, the control device 11 may obtain the central coordinate of the pilot hole 21 by detecting the outline of the base member 20, similar to the case where the pilot hole 21 is hidden by the bus bar 30.
[0048] The control device 11 controls the robot hand 15 to grip the bolt 40 and move it to the central coordinates of the upper hole 31 calculated in step S13 (step S18). The control device 11 controls the robot hand 15 to move the gripped bolt 40 to the calculated central coordinates of the upper hole 31, thereby inserting it into the upper hole 31. In this way, by detecting the position of the upper hole 31 based on the captured image data, the bolt 40 can be inserted into the upper hole 31 with high accuracy and high speed.
[0049] The control device 11 performs a correction process (step S19). The control device 11 controls the robot hand 15 to move the bus bar 30 with the bolt 40 inserted in the upper hole 31 of the bus bar 30. When the upper hole 31 and the lower hole 21 are aligned as a result of the movement, the bolt 40 falls into the lower hole 21 of the base member 20, and the bolt 40 is inserted into the upper hole 31 and the lower hole 21. Details of the correction process will be described with reference to the flowchart in FIG.
[0050] When it is detected as a result of the correction process that the bolt 40 has been inserted into the pilot hole 21, the control device 11 controls the robot hand 15 to tighten the bolt 40 (step S20). The control device 11 instructs the nut runner control unit 13 to rotate the socket 53, thereby tightening the bolt 40.
[0051] 5 is a diagram showing a schematic diagram of an example of the correction process. The bolt 40a is inserted into the upper hole 31 of the busbar 30, and the upper hole 31 and the lower hole 21 do not match. The correction process moves the busbar 30 together with the bolt 40a so that the upper hole 31 and the lower hole 21 match. As a result of the movement, the bolt 40b falls into the lower hole 21 of the base member 20 while remaining inserted into the upper hole 31 of the busbar 30. It can be seen that the bolt 40 is now in a state where it can be fastened by the bolt 40b falling into the lower hole 21.
[0052] 6 is a flow chart for explaining the flow of the correction process. The control device 11 judges whether or not the distance between the center coordinates of the upper hole 31 and the center coordinates of the lower hole 21 is within a predetermined threshold value (step S31). If the distance is within the threshold value (Yes in step S31), this indicates that the positions of the upper hole 31 and the lower hole 21 are almost the same, and it is judged that alignment of the upper hole 31 and the lower hole 21 is not necessary. In this case, the control device 11 omits the processes of S32 to S37. This allows for omitting unnecessary processes and improving efficiency.
[0053] The predetermined threshold value in step S31 is, for example, 0.5 mm. However, it is not limited to this example. The predetermined threshold value may be set according to, for example, the diameter of the bolt 40, the size and material of the member, etc.
[0054] On the other hand, if the distance between the center coordinates of the upper hole 31 and the center coordinates of the lower hole 21 exceeds the predetermined threshold value (No in step S31), this indicates that the positions of the upper hole 31 and the lower hole 21 are misaligned. Therefore, the control device 11 controls the robot hand 15 to start moving the bus bar 30 with the bolt 40 inserted in the upper hole 31 (step S32). Specifically, the control device 11 moves the bus bar 30 linearly in the direction of the center coordinates of the lower hole 21 calculated in step S15 or S17 in FIG. 3.
[0055] The robot hand 15 in this embodiment includes a bolt chuck mechanism. By chucking the portion that grips the bus bar 30, the bus bar 30 can be gripped in a rigid state during movement. This makes it possible to prevent the bolt 40 from twisting or falling off. Furthermore, by including the bolt chuck mechanism, not only a relatively light component such as the bus bar 30 but also a heavy component can be moved.
[0056] The control device 11 starts the movement of the bus bar 30 and acquires a sensor value measured by the force sensor 54. The control device 11 determines whether or not the acquired sensor value exceeds a threshold value (step S33). When the bus bar 30 is moved together with the bolt 40, a large load may be applied to the bolt 40 due to the bolt getting caught on another component, etc. The application of the load may cause scratches on the bolt 40 or the base member 20, or the respective members may be deformed, depending on the weight of the members.
[0057] Therefore, the control device 11 measures the magnitude of the force acting on the bolt 40 using the force sensor 54 when the busbar 30 starts to move. If the force acting on the bolt 40 is equal to or greater than a predetermined threshold value (Yes in step S33), the control device 11 determines that an abnormal state has occurred. Then, the control device 11 issues a warning (step S34) and ends the correction process. In this way, by determining the load on the bolt 40 when the busbar 30 starts to move, the occurrence of an abnormal state can be suppressed early.
[0058] On the other hand, if the sensor value is less than the threshold value (No in step S33), the control device 11 continues to move the bus bar 30. The control device 11 detects the insertion state of the bolt 40 into the pilot hole 21 while moving the bus bar 30 (step S35). That is, the control device 11 detects whether the bolt 40 has fallen into the pilot hole 21.
[0059] 7 is a diagram illustrating the insertion state detection process. The control device 11 in this embodiment detects whether the bolt 40 is inserted into the pilot hole 21 based on the sensor values of the force sensor 54 and the displacement sensor 55.
[0060] The force sensor 54 measures a force (reaction force value) in the direction indicated by the arrow Y1 in FIG. 7. When the bolt 40 is not dropped into the pilot hole 21 during movement, the bolt 40 is in contact with the base member 20, so that the reaction force in the Z-axis direction from the base member 20 is maintained within a certain range. On the other hand, when the bolt 40 falls into the pilot hole 21, the reaction force value decreases. The control device 11 acquires the reaction force value in the Z-axis direction from the force sensor 54, and detects that the force applied to the bolt 40 in the Z-axis direction has changed when the reaction force value exceeds a predetermined threshold value. Alternatively, the control device 11 may detect that the force applied to the bolt 40 in the Z-axis direction has changed when the amount of change in the reaction force value exceeds a predetermined threshold value. In this way, the control device 11 detects that the bolt 40 has fallen into the pilot hole 21, i.e., that the bolt 40 has been inserted into the pilot hole 21.
[0061] The displacement sensor 55 measures the displacement in the Z-axis direction, for example, indicated by the arrow Y2 in FIG. 7. When the bolt 40 is not dropped into the pilot hole 21 during movement, the position of the bolt 40 in the Z-axis direction does not change significantly. On the other hand, when the bolt 40 falls into the pilot hole 21, the amount of displacement temporarily increases as the position changes significantly. The control device 11 detects that the position of the bolt 40 has changed rapidly when the amount of displacement exceeds a predetermined threshold. Alternatively, the control device 11 may detect that the position of the bolt 40 has changed rapidly when the degree of change in the amount of displacement exceeds a predetermined threshold. In this way, the control device 11 detects that the bolt 40 has fallen into the pilot hole 21, i.e., that the bolt 40 has been inserted into the pilot hole 21.
[0062] In this way, by detecting the insertion state using the sensor values of the force sensor 54, the displacement sensor 55, etc., it is possible to detect with high accuracy whether the bolt 40 is properly inserted. This makes it possible to avoid a situation in which the fastening process is performed when the bolt 40 is not properly or sufficiently inserted, and the member is damaged or broken. In this embodiment, moving the bus bar 30 together with the bolt 40 may cause the bolt 40 to tilt or twist during the movement. Therefore, a detection process based on the sensor value of the force sensor 54 and a detection process based on the sensor value of the displacement sensor 55 are combined. This makes it possible to detect the insertion state of the bolt 40 with high accuracy when moving the bus bar 30 together with the bolt 40.
[0063] In the present embodiment, the control device 11 performs the detection process based on the sensor values measured by the force sensor 54 and the displacement sensor 55. However, the present invention is not limited to this example. The control device 11 may perform the detection process based on the sensor value measured by either the force sensor 54 or the displacement sensor 55. Alternatively, the detection device may determine that the bolt 40 has been inserted based on the torque value at the time of fastening the bolt 40.
[0064] When it is detected that the bolt 40 has been inserted into the pilot hole 21 (Yes in step S36), the control device 11 ends the correction process. On the other hand, when it is not detected that the bolt 40 has been inserted into the pilot hole 21 even when the bolt 40 moves linearly in the direction of the calculated center coordinate of the pilot hole 21 (No in step S36), the control device 11 performs alignment according to another method (step S37). The control device 11 performs the correction process by aligning the upper hole 31 and the pilot hole 21 while searching for the position of the pilot hole 21 from the surrounding area.
[0065] The following situations may occur, for example, when the bolt 40 does not fall even if a correction process is performed according to the position of the pilot hole 21 calculated based on the captured image data. This may be the case when the base member 20 is displaced in conjunction with the movement of the bus bar 30, or when the base member 20 itself is positioned at an angle. In these cases, the position coordinates of the pilot hole 21 calculated from the captured image data may not be appropriate. Or, the position of the pilot hole 21 in the base member 20 may be misaligned due to a manufacturing error. In such cases, the control device 11 searches for the position of the pilot hole 21 by switching to another method.
[0066] For example, the control device 11 controls the robot hand 15 to reciprocate the bus bar 30 with the bolt 40 inserted therein while changing the direction of movement. Specifically, the control device 11 controls the robot hand 15 to reciprocate the bus bar 30 while changing the direction of movement centered on the current position of the bolt 40. That is, the control device 11 searches for the position of the pilot hole 21 from the surrounding area in all directions. By performing such a search, the position of the pilot hole 21 can be detected even when the position of the pilot hole 21 is unknown.
[0067] In this way, even if the control device 11 in this embodiment calculates the position of the pilot hole 21 based on the captured image data, if the insertion state is not detected, alignment is performed by another method. In this way, by combining a plurality of different methods for the pilot hole 21, the success rate of the correction process can be increased.
[0068] When the control device 11 detects that the bolt 40 has been inserted into the pilot hole 21 according to the process of step S37 (Yes in step S36), the control device 11 ends the straightening process. On the other hand, when the control device 11 does not detect that the bolt 40 has been inserted into the pilot hole 21 even when another search method is used, the control device 11 issues a warning and ends the straightening process.
[0069] 8 is a diagram illustrating an example of the correction process, in which a part of lower hole 21 is not visible from the inside of upper hole 31 and lower hole 21 is covered by bus bar 30.
[0070] 8(a), since the pilot hole 21 of the base member 20 is covered by the bus bar 30, an image of the pilot hole 21 is not detected from the captured image data. Since the captured image data includes an image of the upper hole 31, the control device 11 calculates the center coordinates of the upper hole 31 based on the captured image data. In addition, the control device 11 detects the outline of the base member 20 from the captured image data, and calculates the center coordinates of the pilot hole 21 based on distance information between the outline and the pilot hole 21.
[0071] The control device 11 controls the robot hand 15 to move the bolt 40 to the calculated central coordinate of the upper hole 31. As a result, the bolt 40 is inserted into the upper hole 31 of the bus bar 30, as shown in Fig. 8(b). The control device 11 moves the bus bar 30, with the bolt 40 inserted into the upper hole 31, linearly in the direction of the calculated central coordinate of the lower hole 21 (Y3).
[0072] As a result, as shown in Fig. 8(c), bolt 40 moves to the position of pilot hole 21 on the XY plane. As the positions of upper hole 31 and pilot hole 21 on the XY plane overlap, bolt 40 falls into pilot hole 21 as shown in Fig. 8(d). This results in a state in which bolt 40 is inserted into upper hole 31 and pilot hole 21. By fastening bolt 40 in this state, bus bar 30 is assembled to base member 20.
[0073] As described above, the fastening device 10 of the present embodiment includes the imaging means 51 and the control means 11. The imaging means captures an image of an area including at least the first fastening hole in a state where an assembly part (e.g., a bus bar) having a first fastening hole (upper hole) is placed on an upper part of an assembly-received part (e.g., a base member) having a second fastening hole (lower hole). The control means calculates a first position of the first fastening hole and a second position of the second fastening hole based on the captured image. The control means controls the robot to move and insert the fastening means into the first fastening hole based on the first position, and moves the assembly part with the fastening means inserted into the first fastening hole toward the second position. The control means controls the robot to fasten the fastening means in response to detection of the insertion of the fastening means (e.g., a bolt) into the second fastening hole. As described above, the bus bar is an example of an assembly part in the present embodiment, and the base member is an example of an assembly-received part in the present embodiment. Similarly, the bolt is an example of a fastening means in the present embodiment.
[0074] In this way, the fastening device 10 captures an image of at least an area including the upper hole 31 while the busbar 30 is placed on the base member 20. As a result, the positional relationship between the upper hole 31 and the lower hole 21 can be detected based on the captured image data acquired by one image capture. The upper hole 31 and the lower hole 21 can be calculated with high accuracy based on the positional relationship in the captured image data. Therefore, based on the calculated position information of the upper hole 31 and the lower hole 21, the bolt 40 can be inserted into the upper hole 31 of the busbar 30, and the busbar 30 can be moved linearly in the position direction of the lower hole 21 with the bolt 40 inserted into the upper hole 31. This makes it unnecessary to perform a search process from the peripheral range of the lower hole 21. In this way, the alignment between the upper hole 31 and the lower hole 21 can be achieved with a small number of steps, high accuracy, and high speed. Therefore, the fastening process can be automated and the time required for the fastening process can be reduced.
[0075] Furthermore, in the present embodiment, when the captured image includes an image of at least a portion of the second fastening hole, the control means calculates the second position of the second fastening hole based on the image of the second fastening hole in the captured image. In this manner, by capturing an image of at least the area including the upper hole 31 while the busbar 30 is placed on the base member 20, when the captured image data includes an image of the upper hole 31 and at least a portion of the image of the lower hole, the positions of the upper hole 31 and the lower hole 21 can be detected. This makes it possible to calculate the respective positions of the upper hole 31 and the lower hole 21 by capturing an image once.
[0076] The fastening device in this embodiment also includes a storage means for storing distance information indicating the distance from the contour of the assembled part to the second fastening hole. When the captured image does not include an image of at least a portion of the second fastening hole, the control means calculates the second position based on the position of the contour of the assembled part in the captured image and the distance information. As a result, even if the pilot hole 21 is hidden by the bus bar 30, the position of the pilot hole 21 can be calculated based on the captured image data. In this way, even if the positions of the upper hole 31 and the pilot hole 21 are misaligned, the position of the upper hole 31 and the pilot hole 21 can be calculated by capturing an image once.
[0077] The fastening device in this embodiment further includes a force sensor that measures the force applied to the fastening means. When the component to be assembled is moved toward the second position with the fastening means inserted in the first fastening hole, if the sensor value of the force sensor exceeds a first threshold value, the control means stops the movement. This makes it possible to detect the occurrence of an abnormal state early when the busbar 30 is moved with the bolt 40 inserted in the upper hole 31. This makes it possible to suppress the occurrence of deformation or damage to the bolt 40 when facilitating automation of the fastening process.
[0078] The fastening device in this embodiment also includes at least one of a force sensor that measures the force applied to the fastening means and a displacement sensor that measures the movement of the fastening means. The control means detects that the fastening means has been inserted into the second fastening hole when the sensor value or the change in the sensor value by the sensor exceeds a second threshold value. This makes it possible to detect with high accuracy whether the bolt 40 has been inserted into the pilot hole 21. This makes it possible to avoid a situation in which the fastening process is performed when the bolt 40 is not properly or insufficiently inserted, resulting in damage or breakage of the component. This therefore facilitates automation of the fastening process and makes it possible to achieve the fastening process with high accuracy.
[0079] Furthermore, in the present embodiment, when the control means moves the assembly part with the fastening means inserted in the first fastening hole toward the second position and does not detect that the fastening means has been inserted into the second fastening hole, the control means controls the robot to reciprocate the assembly part with the fastening means inserted in the first fastening hole while changing the moving direction. In this way, if the bolt 40 cannot be inserted even when the assembly part is moved to the position of the pilot hole 21 calculated based on the captured image data, a different search method can be switched to. In this way, by combining a plurality of different search methods for the pilot hole 21, the success rate of the correction process can be increased.
[0080] Furthermore, the control means in this embodiment performs the following process when the calculated distance between the first position and the second position is less than a predetermined value. That is, the control means moves and inserts the fastening means into the first fastening hole based on the first position, and fastens the fastening means without moving the assembly part with the fastening means inserted into the first fastening hole toward the second position. This makes it possible to omit unnecessary steps when alignment of the upper hole 31 and the lower hole 21 is not required, thereby making the process more efficient.
[0081] (Modification) In the above embodiment, the case where a single fastening hole of the busbar 30 is fastened with the bolt 40 has been exemplified, but the present invention can also be applied to the case where a plurality of fastening holes are fastened. For example, the busbar 30 has a plurality of fastening holes. For example, when some of the fastening holes are fastened with the bolt 40, the busbar 30 is fixed to the base member 20. When the busbar 30 is fixed, it may not be possible to move the busbar 30 when performing correction processing for other fastening holes.
[0082] Therefore, when the busbar 30 has multiple fastening holes, the control device 11 may control the fastening holes to be fastened first to a provisionally fastened state (floating state). The provisionally fastened state indicates, for example, a state in which the degree of fastening is loosened. After provisional fastening is completed for the multiple fastening holes, the control device 11 may increase the degree of fastening of the bolts 40 for each fastening hole. This makes it possible to promote automation of the fastening process even when an assembly part has multiple fastening holes.
[0083] In the above embodiment, a separate search process (step S37) is performed when the upper hole 31 and the pilot hole 21 cannot be aligned based on the position of the pilot hole 21 calculated based on the captured image data. When the busbar 30 has multiple fastening holes, the following process may be performed. For example, when an insertion state is not detected in the correction process of a fastening hole that is the second or subsequent fastening target among the multiple fastening holes (No in S36), the control device 11 may issue a warning and end the fastening process. This allows an abnormality in the correction process to be detected early, making the process more efficient.
[0084] In addition to the case where the busbar 30 has multiple fastening holes, there are also cases where multiple components (assembly components) are assembled to a single base member 20 (assembled component). In such cases, some of the multiple components may be fixed to the base member 20 and may not be able to move during the correction process of the other components. In such cases, the control device 11 may also control the fastening holes of each of the multiple components to a provisionally fastened state. The control device 11 may increase the degree of fastening of the fastening holes of each of the multiple components after provisional fastening of the fastening holes of each of the multiple components has been completed.
[0085] The control device 11 may determine the order in which multiple fastening holes are fastened. The control device 11 performs the fastening process according to a predetermined fastening order. At this time, the control device 11 fastens the other fastening holes so that they are in a provisionally fastened state until the last fastening hole is fastened with the bolt 40. After the last fastening hole is fastened, the control device 11 controls the other fastening holes to change from the provisionally fastened state to the fully fastened state.
[0086] In this manner, the assembly component in the modified example has a plurality of first fastening holes. Of the plurality of first fastening holes, some of the first fastening holes are fastened after the other first fastening holes. In such a case, the control means moves the assembly component with the fastening means inserted into some of the first fastening holes toward the second position while loosening the fastening state of the fastening means of the other first fastening holes. This allows the bus bar 30 to be moved for each of the plurality of upper holes 31 even when the bus bar 30 has a plurality of fastening holes. Therefore, even when the bus bar 30 has a plurality of fastening holes, automation of the fastening process can be promoted.
[0087] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]
[0088] Reference Signs List 10...fastening device, 11...control device, 13...nut runner control unit, 14...control panel, 15...robot hand, 20...base member, 21...fastening hole (pre-hole), 30...bus bar, 31...fastening hole (upper hole), 40...bolt, 51...imaging device, 52...nut runner, 53...socket, 54...force sensor, 55...displacement sensor, 60...workpiece placement unit
Claims
1. A fastening device that assembles an assembly part to a receiver part by fastening a fastening means, an imaging means for imaging an image of at least a region including the first fastening hole in a state in which the assembly part having a first fastening hole is placed on top of the assembled part having a second fastening hole; A control means for calculating a first position of the first fastening hole and a second position of the second fastening hole based on a captured image; Equipped with the control means controls the robot to move and insert the fastening means into the first fastening hole based on the first position, and moves the assembly part with the fastening means inserted into the first fastening hole toward the second position, and controls the robot to fasten the fastening means in response to detection of the fastening means being inserted into the second fastening hole. Fastening device.
2. The control means calculates the second position of the second fastening hole based on the image of the second fastening hole in the captured image when the captured image includes an image of at least a part of the second fastening hole. The fastening device according to claim 1 .
3. a storage means for storing distance information indicating a distance from a contour of the assembled part to the second fastening hole, the control means, when the captured image does not include an image of at least a portion of the second fastening hole, calculates the second position based on a position of the contour of the assembled part in the captured image and the distance information. A fastening device according to claim 1 or 2.
4. Further comprising a force sensor for measuring a force applied to the fastening means, the control means stops the movement of the component to be attached in a state in which the fastening means is inserted into the first fastening hole and the component is moved toward the second position when a sensor value of the force sensor exceeds a first threshold value. A fastening device according to claim 1 or 2.
5. a force sensor that measures a force acting on the fastening means, and / or a displacement sensor that measures a movement amount of the fastening means; The control means detects that the fastening means has been inserted into the second fastening hole when a sensor value by the sensor or a change in the sensor value by the sensor exceeds a second threshold value. A fastening device according to claim 1 or 2.
6. when it is not detected that the fastening means has been inserted into the second fastening hole after the assembly part with the fastening means inserted into the first fastening hole is moved toward the second position, the control means controls the robot to reciprocate the assembly part with the fastening means inserted into the first fastening hole while changing the moving direction. A fastening device according to claim 1 or 2.
7. when the calculated distance between the first position and the second position is less than a predetermined value, the control means moves and inserts the fastening means into the first fastening hole based on the first position, and fastens the fastening means without moving the assembly part with the fastening means inserted into the first fastening hole in the direction of the second position. A fastening device according to claim 1 or 2.
8. The assembly part has a plurality of the first fastening holes, Among the plurality of first fastening holes, some of the first fastening holes are fastened after the other first fastening holes, the control means moves the assembly part in a state in which the fastening means are inserted into the part of the first fastening holes toward the second position while the fastening states of the fastening means of the other first fastening holes are loosened, A fastening device according to claim 1 or 2.
9. A fastening method for assembling an assembly part to a receiver part by fastening a fastening means, comprising the steps of: an imaging step of imaging an area including at least the first fastening hole in a state in which the assembly part having a first fastening hole is placed on top of the assembled part having a second fastening hole; A calculation step of calculating a first position of the first fastening hole and a second position of the second fastening hole based on the captured image; a moving step of controlling a robot to move and insert the fastening means into the first fastening hole based on the first position, and to move the assembly part with the fastening means inserted into the first fastening hole toward the second position; a fastening step of controlling the robot to fasten the fastening means in response to detection of insertion of the fastening means into the second fastening hole; A fastening method comprising the steps of:
Citation Information
Patent Citations
Workpiece detection and assembly method and equipment and storage medium
CN110836637A
Position correction type automatic screw tightening machine
JP1993008614U
Automatic screw fastening device
JP1993237729A
Bolt fitting method in bolt-nut fastener
JP1993346099A
Automatic screwing up device
JP2005022006A
