Work support device, work support method, and work support program

The work support device addresses the issue of workbench shaking by using an arm mechanism and control system to adjust tool positioning based on captured images, ensuring accurate alignment with work targets in environments like elevator shafts.

JP7581125B2Active Publication Date: 2024-11-12KK TOSHIBA
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021088903
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-05-27
Publication Date
2024-11-12
Estimated Expiration
2041-05-27

AI Technical Summary

Technical Problem

Conventional workbench systems in workspaces, such as elevator shafts, experience shaking which leads to difficulties in accurate positioning of tools, resulting in reduced work accuracy.

Method used

A work support device equipped with an arm mechanism, imaging and distance sensors, and a control system that adjusts the position of a tool relative to a work target part based on captured images, compensating for workbench shaking by deriving and offsetting the movement of the workbench using a shaking amount sensor.

Benefits of technology

The device ensures precise alignment of the tool with the work target despite workbench shaking, enhancing work accuracy by maintaining the tool's position relative to the work target.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007581125000003
    Figure 0007581125000003
  • Figure 0007581125000004
    Figure 0007581125000004
  • Figure 0007581125000005
    Figure 0007581125000005
Patent Text Reader

Abstract

To improve work accuracy.SOLUTION: A work supporting device 10 comprises an arm mechanism 18, a second determination unit 22D, an acquisition unit 22E, a derivation unit 22F, and a drive control unit 22G. The arm mechanism 18 is mounted on a worktable located in a work space and provided with a tool part at the end. The acquisition unit 22E acquires captured images of a work target and the tool part in the work space. The derivation unit 22F derives a relative position of the work target and a relative position of the tool part based on the captured image. The drive control unit 22G controls a drive unit 30 of the arm mechanism 18 based on the relative positions so that the position of the work target and the position of the tool part match with each other.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] An embodiment of the present invention relates to a work assistance device, a work assistance method, and a work assistance program. [Background technology]

[0002] Devices that support work in a work space such as an elevator shaft are known. For example, a system that supports work using a robot mechanism or the like mounted on a workbench in the work space has been disclosed. Also disclosed is a system that estimates the position of a work target part such as a hole or a bolt from a 3D model of the work space and supports work at the estimated position. Also disclosed is a technology that supports work on a work target part on a wall surface by adjusting the inclination of a tool so that the axis of the tool is perpendicular to the wall surface using the detection result of the angle between the wall surface and the tool. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-7095 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the work table arranged in the work space may shake within the work space. In the conventional technology, accurate alignment may be difficult due to the shaking of the work table, resulting in a decrease in work accuracy. [Means for solving the problem]

[0005] A work support device according to an embodiment includes an arm mechanism, an acquisition unit, a derivation unit, and a drive control unit. The arm mechanism is mounted on a work table arranged in a work space, and a tool unit is provided at an end of the arm mechanism. The acquisition unit acquires photographed images of a work target and the tool unit in the work space. The derivation unit derives a relative position between the work target and the tool unit based on the photographed images. The drive control unit controls the drive unit of the arm mechanism based on the relative position so that the position of the work target and the position of the tool unit coincide with each other. The arm mechanism has one or more arm sections and the tool section connected by a joint section, and the derivation section further derives the amount of movement of the work table relative to the work target section based on the amount of sway of the work table with the arm mechanism mounted thereon, detected by a sway amount sensor that detects the amount of sway of the work table, and the drive control section further controls the position of the joint section so as to offset the derived amount of movement. [Brief description of the drawings]

[0006] [Figure 1] Schematic diagram of a work support system. [Diagram 2] FIG. [Diagram 3] FIG. 2 is a functional block diagram of the work assistance device. [Figure 4] Schematic diagram of a captured image. [Diagram 5] FIG. [Figure 6] Schematic diagram of a captured image. [Figure 7] Schematic diagram of a template image. [Figure 8] FIG. [Figure 9A] FIG. 13 is an explanatory diagram of control according to the amount of shaking of the work platform. [Figure 9B] FIG. 13 is an explanatory diagram of control according to the amount of shaking of the work platform. [Figure 10] 1 is a flowchart of information processing. [Figure 11] Hardware configuration diagram. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] The work assistance device, the work assistance method, and the work assistance program will be described in detail below with reference to the accompanying drawings.

[0008] FIG. 1 is a schematic diagram showing an example of a task support system 1 according to the present embodiment.

[0009] The work support system 1 is a system for supporting a user working in a work space 2.

[0010] The work space 2 is a space large enough for a user to work inside. For example, the work space 2 is an elevator shaft, a tunnel inside which an object such as a vehicle moves, a sewer, etc. In this embodiment, a case where the work space 2 is an elevator shaft will be described as an example. An elevator shaft may be called an elevator shaft.

[0011] An elevator that moves along the extension direction of the work space 2 (arrow Z' direction) is arranged in the work space 2, and the elevator moves along the extension direction. In the following, the extension direction of the work space 2 may be referred to as extension direction Z'. In this embodiment, a case in which the extension direction Z' coincides with the vertical direction will be described as an example. Note that the extension direction Z' may be any direction as long as it is the extension direction of the passage of the work space 2, and is not limited to a form in which it coincides with the vertical direction.

[0012] In this embodiment, a case will be described in which a work table 3 is installed in a work space 2 and a user stands on the work table 3 and works in the work space 2 during maintenance of the work support system 1 or the like.

[0013] The work table 3 is arranged in the work space 2 during maintenance and the like, and is configured to be removable from the work space 2. The work table 3 arranged in the work space 2 is supported by a displacement member 5 arranged at the top of the work space 2 via a wire 4. The displacement member 5 allows the work table 3 to move in the extension direction Z' within the work space 2. In other words, the work table 3 is an example of a movable member that moves within the work space 2. Note that FIG. 1 shows an example in which the work table 3 is supported by two wires 4. However, the work table 3 is not limited to being supported by two wires 4 as long as it is supported by one or more wires 4.

[0014] The work platform 3 may be installed in a gondola unit used when assembling a normal elevator or the like. The work platform 3 may also be a gondola unit. The work platform 3 may also be a unit prepared exclusively for the work assistance system 1. The work platform 3 may also be configured to be installed in an elevator car that moves in the work space 2. The work platform 3 may also be an elevator car.

[0015] The work support device 10 is installed on a workbench 3 arranged in the work space 2. By being installed on the workbench 3, the work support device 10 is arranged in a state where it can move in the extension direction Z' within the work space 2.

[0016] FIG. 2 is a schematic diagram of an example of the work support device 10. As shown in FIG.

[0017] The work support device 10 includes a robot mechanism unit 11 and a laser irradiation unit 20. The robot mechanism unit 11 and the laser irradiation unit 20 are connected to each other so as to be able to communicate with each other.

[0018] The robot mechanism unit 11 is the main body of the work support device 10. The robot mechanism unit 11 is mounted on the work table 3.

[0019] The laser irradiation unit 20 irradiates the laser light L. For example, the laser irradiation unit 20 is fixed to the inner wall surface of the working space 2. The laser irradiation unit 20 may be mounted on the workbench 3 or the robot mechanism unit 11. However, from the viewpoint of improving the irradiation accuracy, it is preferable that the laser irradiation unit 20 is fixed to the inner wall surface of the working space 2.

[0020] In this embodiment, the laser irradiation unit 20 irradiates the laser light L onto the work target portion T of the work target 50 under the control of the control unit 22 described later.

[0021] The work target 50 is a component to be worked on by the robot mechanism unit 11. The work target 50 is, for example, a structure such as a wall in the work space 2. The work target part T is an area of ​​the work target 50 or an object to be worked on. The work target part T is, for example, an area of ​​the work target 50 where a hole or aperture is to be made, or a component such as a screw or bolt to be attached to the work target 50. FIG. 2 shows, as an example, a form in which the work target part T is an area T1 to be drilled.

[0022] The robot mechanism unit 11 includes an imaging unit 12, a distance sensor 14, a force sensor 16, an arm mechanism 18, a control unit 22, and a shaking amount sensor 24.

[0023] The arm mechanism 18 is an assist mechanism for holding the tool part 18A. In other words, the arm mechanism 18 is a mechanism for assisting the handling of the tool part 18A. The arm mechanism 18 is mounted on the work table 3. In this embodiment, the arm mechanism 18 is installed on the work table 3 via a support table 23.

[0024] The tool part 18A is a member used during work in the work space 2. The tool part 18A is provided at the end of the arm mechanism 18 in the extension direction. The tool part 18A is, for example, various tools or implements such as an electric drill or an impact driver, or various mounting members for mounting brackets, guide rails, counterweights, and parts. FIG. 1 shows an example in which the tool part 18A is an electric drill 18A1.

[0025] The arm mechanism 18 includes, for example, a tool part 18A, an arm part 18B, an arm part 18C, and an arm part 18D. The tool part 18A and the multiple arm parts (18B, 18C, 18D) are connected by one or multiple joint parts 19. In this embodiment, the tool part 18A and the arm part 18B are connected by a joint part 19A. The arm part 18B and the arm part 18C are connected by a joint part 19B. The arm part 18C and the arm part 18D are connected by a joint part 19C.

[0026] The joint portion 19 is provided with a drive portion 30. By driving the joint portion 19 by driving the drive portion 30, the positions of each of the joint portions 19, the position of the tool portion 18A of the arm mechanism 18, and the attitude of the arm mechanism 18 are adjusted.

[0027] The joint unit 19A is provided with an imaging unit 12, a distance sensor 14, and a force sensor 16.

[0028] The photographing unit 12 acquires photographed image data by photographing. Hereinafter, the photographed image data will be described as a photographed image. In this embodiment, the photographing unit 12 acquires photographed images of the tool unit 18A and the work target part T. The photographing unit 12 is not limited to being provided in the joint part 19A as long as it is provided at a position where it can acquire photographed images of the tool unit 18A and the work target part T. The work support device 10 may be configured to include a plurality of photographing units 12. In this case, photographed images of the tool unit 18A and the work target part T may be captured by the plurality of photographing units 12.

[0029] The distance sensor 14 is a sensor for measuring the distance between the tool part 18A and the work object 50. In detail, the distance sensor 14 measures the shortest distance between the tip of the tool part 18A and the work object 50. A known sensor capable of measuring distance may be used as the distance sensor 14. The distance sensor 14 may be disposed at a position where it is possible to measure the distance between the tool part 18A and the work object 50, and is not limited to being provided at the joint part 19A.

[0030] The force sensor 16 is a sensor that detects a force applied to the tool part 18A from the outside of the tool part 18A. In this embodiment, the force sensor 16 detects a force applied to the tool part 18A from the work target part T. The force applied to the tool part 18A from the work target part T corresponds to a first force. The force sensor 16 is an example of a detection part that detects the first force. The force sensor 16 may be a known sensor that can detect a force applied to the tool part 18A from the outside of the tool part 18A. In addition, the force sensor 16 may be disposed at a position where it can detect a force applied to the tool part 18A from the outside of the tool part 18A, and is not limited to being provided at the joint part 19A.

[0031] The shaking amount sensor 24 is a sensor that detects the amount of shaking of the workbench 3. The shaking amount sensor 24 is provided on the workbench 3. The shaking amount sensor 24 is, for example, an acceleration sensor, a gyro sensor, or the like.

[0032] The control unit 22 controls the robot mechanism unit 11. The control unit 22 will be described in detail later.

[0033] FIG. 3 is a functional block diagram of an example of the work support device 10 of the present embodiment.

[0034] The work support device 10 includes a robot mechanism unit 11 and a laser irradiation unit 20. The robot mechanism unit 11 and the laser irradiation unit 20 are connected to each other so as to be able to communicate with each other.

[0035] The laser irradiation section 20 includes a laser irradiator 20A, a communication section 20B, and a control section 20C. The laser irradiator 20A, the communication section 20B, and the control section 20C are connected to each other so as to be able to communicate with each other.

[0036] The laser irradiator 20A is a device that irradiates laser light L. The laser irradiator 20A is, for example, but is not limited to, a laser pointing device, a projector, etc. The laser pointing device is, for example, a laser marking device, etc.

[0037] The communication unit 20B is a communication function unit that communicates with the robot mechanism unit 11 and other information processing devices.

[0038] The control unit 20C controls the laser irradiator 20A so as to irradiate the laser light L to a work position defined by design information corresponding to the work content. Through this control, the control unit 20C causes the laser irradiator 20A to irradiate the laser light L to the work target T. The control unit 20C acquires the design information, for example, from the robot mechanism unit 11 via the communication unit 20B. The design information will be described in detail later. The control unit 20C may acquire the design information via the communication unit 20B from an information processing device such as a server device.

[0039] Next, the robot mechanism 11 will be described.

[0040] The robot mechanism unit 11 includes an imaging unit 12, a distance sensor 14, a force sensor 16, an arm mechanism 18, a control unit 22, a shaking amount sensor 24, a communication unit 26, a memory unit 28, a drive unit 30, and a UI (user interface) unit 32.

[0041] The imaging unit 12, the distance sensor 14, the force sensor 16, the shaking amount sensor 24, the communication unit 26, the storage unit 28, the drive unit 30, and the control unit 22 are connected to each other so as to be able to communicate with each other via a bus or the like.

[0042] The communication unit 26 is a communication function unit that communicates with the laser irradiation unit 20 and other information processing devices.

[0043] The storage unit 28 stores various types of information. For example, the storage unit 28 stores management information. The management information is information for managing work. For example, the management information is information that specifies the position of the work target part T for each of one or more work contents. In detail, for example, the management information is information that associates a work ID with design information.

[0044] The work ID is identification information of a work. For example, the work ID is expressed by a number indicating the order of the work. The design information is information related to the work identified by the corresponding work ID.

[0045] The design information includes, for example, work position information, work target part information, and work content information.

[0046] The work position information is information that indicates the work position of the work identified by the corresponding work ID. In other words, the work position information is information that indicates the position of the work target part T.

[0047] The work target part information is information that indicates the work target part T. For example, the work target part information is information that indicates the type of the work target part T, the shape of the work target part T, the presence or absence of reflection by the laser light L, and the like.

[0048] The type of work target part T is information representing the type of work target part T, such as an area T1 to be drilled, a bolt T2, etc. The information indicating the presence or absence of reflection by the laser light L is information representing the presence or absence of reflection. The presence of reflection means that when the laser light L is irradiated onto the work target part T, the work target part T is not photographed by the photographing unit 12 due to reflection from the work target part T. The absence of reflection means that even if the work target part T is irradiated with the laser light L, the work target part T is photographed by the photographing unit 12. The work content information is information representing the work content for the work target part T. The work content information is information representing, for example, drilling a hole in the area T1 to be drilled, which is the work target part T, or tightening the bolt T2, which is the work target part T, etc.

[0049] The storage unit 28 may store management information received from an external information processing device or the like via the communication unit 26 .

[0050] The storage unit 28 is, for example, a semiconductor memory element such as a random access memory (RAM), a flash memory, a hard disk, an optical disk, etc. The storage unit 28 may be a storage device provided outside the robot mechanism unit 11 or the work support device 10.

[0051] The UI unit 32 has a function of receiving an operation input by a user and a function of outputting various information. For example, the UI unit 32 includes a display 32A and an input unit 32B.

[0052] The display 32A displays various types of information. The display 32A is, for example, a known organic EL (Electro-Luminescence) display, LCD (Liquid Crystal Display), etc. The input unit 32B accepts various instructions from a user. The input unit 32B is, for example, a keyboard, a mouse, a touch panel, a microphone, etc.

[0053] The control unit 22 may be a dedicated or general purpose computer.

[0054] At least one of the storage unit 28 and the control unit 22 may be mounted on an information processing device such as a server device connected to the communication unit 26 via a network. At least one of the functional units included in the control unit 22, which will be described later, may be mounted on an information processing device such as a server device connected to the control unit 22 via the network and the communication unit 26.

[0055] The control unit 22 executes information processing. The control unit 22 includes a receiving unit 22A, a first determination unit 22B, a laser control unit 22C, a second determination unit 22D, an acquiring unit 22E, a derivation unit 22F, and a drive control unit 22G.

[0056] At least one of the reception unit 22A, the first judgment unit 22B, the laser control unit 22C, the second judgment unit 22D, the acquisition unit 22E, the derivation unit 22F, and the drive control unit 22G is realized, for example, by one or more processors. For example, each of the above units may be realized by having a processor such as a CPU (Central Processing Unit) execute a program, that is, by software. Each of the above units may be realized by a processor such as a dedicated IC (Integrated Circuit), that is, by hardware. Each of the above units may be realized by using both software and hardware. When multiple processors are used, each processor may realize one of the units, or may realize two or more of the units.

[0057] The reception unit 22A receives a work ID from the UI unit 32. When starting a work, the user selects a desired work ID included in the management information by operating the UI unit 32. The reception unit 22A receives the work ID selected by the user.

[0058] The first judgment unit 22B judges whether or not laser irradiation is possible. Judging whether or not laser irradiation is possible means judging whether or not laser light L can be irradiated to the work target part T. For example, the first judgment unit 22B judges whether or not laser irradiation is possible using information indicating the presence or absence of reflection by the laser light L, which is included in the design information corresponding to the work ID received by the reception unit 22A. In detail, the first judgment unit 22B judges that laser irradiation is impossible when the information indicating the presence or absence of reflection by the laser light L, which is included in the work target part information, indicates that reflection is present. Furthermore, the first judgment unit 22B judges that laser irradiation is possible when the information indicating the presence or absence of reflection by the laser light L, which is included in the work target part information, indicates that reflection is absent.

[0059] The first judgment unit 22B may determine whether or not laser irradiation is possible based on the material of the work target portion T. In this case, the management information may be configured such that material information indicating the material of the work target portion T is further registered as work object information. The first judgment unit 22B may determine whether or not laser irradiation is possible by determining whether or not the material information corresponding to the work ID is a material that reflects laser light L.

[0060] Furthermore, the first determination unit 22B may determine that laser irradiation is impossible when it determines that the laser irradiator 20A is malfunctioning. Furthermore, the first determination unit 22B may determine that laser irradiation is possible when it determines that the laser irradiator 20A is operating normally.

[0061] When it is determined that the laser irradiation is possible, the laser control unit 22C controls the laser irradiation unit 20 to irradiate the work target part T with the laser light L. For example, the laser control unit 22C identifies the work position information included in the design information corresponding to the work ID in the management information. Then, the laser control unit 22C outputs the identified work position information and information indicating the start of laser irradiation to the laser irradiation unit 20 via the communication unit 26. When the control unit 20C of the laser irradiation unit 20 receives information indicating the start of laser irradiation from the robot mechanism unit 11 via the communication unit 20B, it controls the laser irradiator 20A to irradiate the laser light L to the work position represented by the received work position information. Therefore, under the control of the laser control unit 22C, the laser irradiator 20A of the laser irradiation unit 20 irradiates the laser light L to the work position of the work target part T.

[0062] Specifically, as shown in Fig. 2, laser light L1 is irradiated from laser irradiation unit 20 to a work position, which is the position of work target portion T. Laser light L1 is an example of laser light L irradiated to work target portion T. By irradiating laser light L1, a spot area P1 is formed by laser light L1 at the work position of work target 50. Spot area P1 is an example of spot area P. Spot area P is an area on work target 50 irradiated with laser light L.

[0063] Returning to FIG. 3, the explanation will be continued.

[0064] If the first judgment unit 22B judges that laser irradiation is impossible, the second judgment unit 22D judges whether or not template matching processing is possible. The template matching processing refers to processing for identifying the work target part T included in the captured image by searching for a template image from the captured image.

[0065] The second judgment unit 22D, for example, acquires a captured image from the photographing unit 12. Then, the second judgment unit 22D determines whether or not the work target part T exists in the acquired captured image, thereby determining whether or not the template matching process is possible. In detail, the second judgment unit 22D may determine whether or not the work target part T identified by the work target part information included in the design information corresponding to the work ID accepted by the accepting unit 22A exists in the captured image by using known image processing or the like.

[0066] The acquisition unit 22E acquires captured images of the work target part T and the tool part 18A in the work space 2. For example, the control unit 22 drives the drive unit 30 to move the tool part 18A of the arm mechanism 18 to the vicinity of the work position represented by the work position information corresponding to the work ID whose selection has been accepted. The control unit 22 controls the drive unit 30 based on the work position information and the detection result of the distance sensor 14 to move the arm mechanism 18 to a position where the work target part T can be photographed by the imaging unit 12. The acquisition unit 22E acquires the captured images captured by the imaging unit 12 in a state where the arm mechanism 18 has been moved to a position where the work target part T can be photographed.

[0067] 4 is a schematic diagram of an example of a captured image 40. The captured image 40 is an example of an image captured in a state in which it has been determined by the first determination unit 22B that laser irradiation is possible and the work target portion T is irradiated with laser light L by the laser control unit 22C.

[0068] As shown in Fig. 4, the captured image 40 includes the tool part 18A and a spot area P1. Fig. 4 shows a state in which an electric drill 18A1 is captured as the tool part 18A. The spot area P1 is a spot area P of the laser light L1 formed on the work target 50 by irradiating the work target part T with the laser light L1.

[0069] The derivation unit 22F derives the relative position between the work target part T and the tool part 18A based on the captured image.

[0070] It is assumed that the captured image 40 is acquired by the acquisition unit 22E. That is, it is assumed that the first determination unit 22B determines that laser irradiation is possible, and the captured image is acquired in a state in which the work target T is irradiated with the laser light L by the laser control unit 22C. In this case, the derivation unit 22F specifies the spot area P1 of the laser light L1 included in the captured image 40 as the work target T. Then, the derivation unit 22F derives the relative position between the specified spot area P1 and the tool unit 18A.

[0071] In detail, the derivation unit 22F specifies the position (Xr, Yr) of the spot area P1 in the captured image 40. The derivation unit 22F also specifies the position (Xt, Yt) of the tool part 18A in the captured image 40. The derivation unit 22F specifies the position of the tip of the tool part 18A in the captured image 40 as the position of the tool part 18A. Then, the derivation unit 22F specifies the relative position of the spot area P1 and the tool part 18A by specifying these positions (Xr, Yr) and (Xt, Yt).

[0072] In addition, when it is determined that the work target area T cannot be irradiated with laser, the laser control unit 22C may control the laser irradiation unit 20 to irradiate laser light L to a position spaced a first distance from the work target area T in a first direction.

[0073] Explained with reference to FIG. 2. In this case, the laser control unit 22C controls the laser irradiation unit 20 to irradiate the laser light L2 to a position separated by the first distance E in the first direction Z1 from the spot area P1, which is the position of the work target part T. In detail, the laser control unit 22C identifies the work position information corresponding to the work ID received by the reception unit 22A in the management information. Then, the laser control unit 22C may transmit information representing a position separated by the first distance E in the first direction Z1 from the work position represented by the identified work position information to the laser irradiation unit 20 as new work position information. The laser irradiation unit 20 irradiates the laser light L2 to a position separated by the first distance E in the first direction Z1 from the spot area P1, which is the position of the work target part T, based on the received work position information. Therefore, a spot area P2 by the laser light L2 is formed on the work target 50 at a position separated by the first distance E in the first direction Z1 from the spot area P1.

[0074] In this case, the derivation unit 22F may specify an area separated by the first distance E in the opposite direction of the first direction Z1 from the spot area P2 of the laser light L2 included in the captured image 40 as the position of the work target part T. In particular, the derivation unit 22F specifies an area separated by the first distance E in the opposite direction of the first direction Z1 from the spot area P2 of the laser light L2 included in the captured image 40 as the position of the work target part T. Then, the derivation unit 22F may specify the relative position between the specified work target part T and the tool part 18A in the same manner as described above. That is, the derivation unit 22F may derive the position (Xr, Yr) of the work target part T and the position (Xt, Yt) of the arm mechanism 18.

[0075] Continuing the description by returning to Fig. 3, on the other hand, it is assumed that the first judging section 22B judges that laser irradiation is impossible, and the second judging section 22D judges that template matching processing is possible.

[0076] For example, in the following cases, it is determined that laser irradiation is impossible and template matching processing is possible.

[0077] FIG. 5 is a schematic diagram of another example of the work support device 10. The work support device 10 shown in FIG. 5 includes an impact driver 18A2 as the tool unit 18A instead of the electric drill 18A1. FIG. 5 also shows an embodiment in which the work target part T is a bolt T2 instead of the region T1 to be drilled. The bolt T2 is, for example, a bolt that connects the member 50C provided to protrude from each of the work target 50A and the work target 50B. The work target 50A, the work target 50B, and the member 50C are examples of the work target 50.

[0078] The work support device 10 shown in FIG. 5 further includes a work object 50A, a work object 50B, and a part 50C as the work object 50, and has the same configuration as the work support device 10 shown in FIG. 2, except that an impact driver 18A2 is used instead of the electric drill 18A1, and a bolt T2 is used instead of the area T1 to be drilled.

[0079] 5, when the work target part T is a bolt T2, there are cases where the bolt T2 is not photographed due to reflection. For this reason, information indicating the presence of reflection by the laser light L is registered in advance as work target part information in the design information related to the work on the bolt T2. For this reason, in this case, the first judgment unit 22B judges that laser irradiation is impossible. Furthermore, the second judgment unit 22D judges that template matching processing is possible by processing to determine that the bolt T2, which is the work target part T, is present in the acquired photographed image.

[0080] In this case, the captured image acquired by the acquisition unit 22E includes the bolt T2 and the impact driver 18A2 as the work target part T and the tool part 18A.

[0081] 6 is a schematic diagram showing an example of a captured image 42. The captured image 42 is an example of a captured image captured by the imaging unit 12 when the first determination unit 22B determines that laser irradiation is impossible and the second determination unit 22D determines that template matching processing is possible.

[0082] As shown in Fig. 6, the captured image 42 includes the tool part 18A and the work target part T. Fig. 6 shows a state in which an impact driver 18A2 is captured as the tool part 18A, and a bolt T2 is captured as the work target part T.

[0083] In this case, the derivation unit 22F specifies, as the work target portion T, an area that matches or is similar to the template image included in the photographed image .

[0084] 7 is a schematic diagram showing an example of a template image 44. The template image 44 is registered in advance as information representing the shape of the work target part T, for example, in design information corresponding to the work ID. The derivation unit 22F searches for the template image 44 in the captured image 40, and identifies an area that matches or is similar to the template image 44 as the bolt T2. In detail, the derivation unit 22F identifies an area in the captured image 40 that matches or is similar to the feature amount of the template image 44 as the bolt T2. Any feature amount may be used.

[0085] Then, the derivation unit 22F may derive the relative position between the identified work target part T and the tool part 18A in the same manner as described above. That is, the derivation unit 22F derives the position (Xr, Yr) of the bolt T2 and the position (Xt, Yt) of the impact driver 18A2 in the captured image 42.

[0086] Returning to Fig. 3, the description will continue. The drive control unit 22G controls the drive unit 30 of the arm mechanism 18 based on the relative positions of the work target part T and the tool part 18A derived by the lead-out unit 22F, so that the position of the work target part T and the position of the tool part 18A coincide with each other.

[0087] In detail, the drive control unit 22G controls the position of each of the joints 19 of the arm mechanism 18 by controlling the drive unit 30 so that the position of the tool unit 18A coincides with the position of the work target part T. The drive control unit 22G derives a target position for each of the joints 19 for each time, and controls the drive unit 30 so that each of the joints 19 is located at the derived target position at each time. Through these controls, the drive control unit 22G controls the drive unit 30 of the arm mechanism 18 so that the position of the work target part T coincides with the position of the tool unit 18A.

[0088] This will be described with reference to Fig. 4. For example, it is assumed that the position (Xr, Yr) of the work target part T and the position (Xt, Yt) of the tool part 18A are derived as relative positions by the derivation part 22F.

[0089] In this case, the drive control unit 22G controls the drive unit 30 of the arm mechanism 18 so that the position (Xr, Yr) of the work target part T coincides with the position (Xt, Yt) of the tool part 18A. Therefore, the position of the tip of the tool part 18A moves to the position of the work target part T by the drive control of the drive control unit 22G.

[0090] Then, when the position of the tip of the tool part 18A reaches the position of the work target part T, the drive control part 22G moves the tool part 18A closer to the work target part T. The drive control part 22G may move the tool part 18A closer to the work target part T using the distance detection result by the distance sensor 14. Then, the drive control part 22G may control the tool part 18A to execute the work content represented by the work content information corresponding to the work ID received by the reception part 22A. For example, it is assumed that the work content is drilling a hole in the region T1 of the work target. In this case, the drive control part 22G may drive and control the electric drill 18A1 so as to execute a hole drilling process perpendicular to the work target 50 in the region T1 of the work target 50. It is also assumed that the work content is bolt tightening of the bolt T2. In this case, the drive control part 22G may drive and control the bolt T2 to execute a bolt tightening process of the bolt T2.

[0091] In addition, when controlling the drive unit 30 of the arm mechanism 18 so that the position (Xr, Yr) of the work target part T coincides with the position (Xt, Yt) of the tool part 18A, it is preferable that the drive control unit 22G further executes the following speed control processing.

[0092] This will be explained with reference to Fig. 4. It is preferable that the drive control unit 22G executes a speed control process on the drive unit 30 so that the tool unit 18A moves from position (Xt, Yt) toward position (Xr, Yr) of the work target part T at a predetermined speed.

[0093] Specifically, the drive control unit 22G controls the drive unit 30 to move the position of the tool unit 18A to the position of the work target part T at a speed according to the distance between the work target part T and the tool unit 18A.

[0094] In detail, the drive control unit 22G controls the drive unit 30 to move the position of the tool unit 18A to the position of the work target part T at a faster speed the farther the distance between the work target part T and the tool unit 18A is, and at a slower speed the closer the distance is.

[0095] That is, the drive control unit 22G controls the drive unit 30 so that the drive unit 30 moves at a speed (Vx, Vy) that satisfies the following formulas (1) and (2).

[0096]

number

[0097] In formula (1), Vx is the moving speed in the X-axis direction in the captured image. In formula (2), Vy is the moving speed in the Y-axis direction in the captured image. K is a control gain, and may be set to any value.

[0098] By controlling the drive control unit 22G to move at a speed that satisfies the above relationship, the tool part 18A can be moved toward the work target part T with high precision even if the work table 3 shakes while the tool part 18A is moving toward the work target part T.

[0099] The drive control unit 22G may control the drive unit 30 to move the position of the tool unit 18A to the position of the work target part T at a speed according to the variation in the distance between the work target part T and the tool unit 18A. In other words, the drive control unit 22G may control the drive unit 30 by proportional and integral speed control.

[0100] Specifically, the drive control unit 22G may control the drive unit 30 so as to move at a speed (Vx, Vy) that satisfies the following formulas (3) and (4).

[0101]

number

[0102] In formula (3), Vx is the moving speed in the X-axis direction in the captured image. In formula (4), Vy is the moving speed in the Y-axis direction in the captured image. K is a control gain and may be set to any value. Ki is an integral gain and may be set to any value.

[0103] There are cases where the work table 3 shakes unsteadily and repeatedly. In such cases, it may be difficult to reduce the alignment error to zero using the proportional control shown in equations (1) and (2). For this reason, in this case, by controlling the drive unit 30 so that the drive control unit 22G moves at a speed that satisfies the relationship shown in equations (3) and (4) above, it is possible to move the tool unit 18A toward the work target unit T with high accuracy, even if the work table 3 shakes unsteadily and repeatedly during the movement of the tool unit 18A toward the work target unit T.

[0104] In addition, during movement control to move the tool part 18A to the work target part T, and during execution of work content on the work target part T by the tool part 18A, a deviation in position between the tool part 18A and the work target part T may occur due to shaking of the work table 3, etc.

[0105] For this reason, it is preferable that the drive control unit 22G repeatedly executes drive control of the drive unit 30 according to the captured image acquired by the acquisition unit 22E during drive control of both the movement of the tool unit 18A to the work target unit T and the execution of the work content by the tool unit 18A on the work target unit T. In other words, it is preferable that the drive control unit 22G repeatedly executes drive control for controlling the drive unit 30 so that the position of the tool unit 18A based on the above-mentioned relative position derived from the captured image coincides with the position of the work target unit T during both the period when the movement of the tool unit 18A is controlled and the period when the work content is executed by the tool unit 18A.

[0106] Through these processes, the drive control unit 22G can control the drive unit 30 to move the tool part 18A toward the work target part T with high precision even if the work table 3 shakes, and to maintain the position of the tool part 18A aligned with the position of the work target part T.

[0107] It should be noted that, under the control of the drive control unit 22G, the work table 3 may shake when the tool unit 18A is performing the work content on the work target unit T. This shaking may cause a force to be applied from the work target unit T to the tool unit 18A.

[0108] The following description will be given with reference to Fig. 8. Fig. 8 is a schematic diagram showing an example of a bolt tightening operation of the bolt T2 being performed by the impact driver 18A2. When the position of the impact driver 18A2 with respect to the bolt T2 is shifted due to shaking of the workbench 3 or the like, a force may be applied from the bolt T2 to the impact driver 18A2. As described above, the force sensor 16 detects a force applied to the tool part 18A from the outside, such as the work target part T. For example, assume that the force sensor 16 detects a first force Fb as the force applied from the bolt T2 to the impact driver 18A2.

[0109] In this case, it is preferable that the drive control unit 22G controls the drive unit 30 so as to offset the first force Fb detected by the force sensor 16. Specifically, the drive control unit 22G controls the drive unit 30 of the arm mechanism 18 so that a force Ft having the same strength and direction as the detected first force Fb is applied from the impact driver 18A2 to the bolt T2.

[0110] Therefore, the first force Fb applied from the bolt T2 to the impact driver 18A2 is offset. That is, in this case, the drive control unit 22G can drive the arm mechanism 18, which is the impact driver 18A2, so as to absorb the shaking of the workbench 3.

[0111] In addition, by using a direct drive motor or other motor with high backdrivability as the joint portion 19, adjustments may be made so that the posture of the arm mechanism 18 changes smoothly in response to the shaking of the workbench 3.

[0112] The drive control unit 22G may further control the drive unit 30 according to the amount of shaking of the workbench 3.

[0113] 9A and 9B are explanatory diagrams of an example of control according to the amount of shaking of the workbench 3. FIG.

[0114] For example, assume that the position of the work table 3 relative to the work target part T has shifted from the position shown in FIG. 9A to the position shown in FIG. 9B.

[0115] The drive control unit 22G further derives the amount of movement of the work table 3 relative to the work target part T based on the amount of shaking of the work table 3. The drive control unit 22G time-integrates the amount of shaking detected by the shaking amount sensor 24 to derive the direction and amplitude of shaking of the work table 3 at each time as the amount of movement of the work table 3. Then, the drive control unit 22G further controls the position of the joint part 19 so as to cancel out the derived amount of movement.

[0116] In detail, when the tool unit 18A works on the work target T, it is preferable that the alignment error between the tool unit 18A and the work target T is zero. For this reason, the drive control unit 22G uses the oscillation direction and amplitude of the work table 3 derived as the movement amount of the work table 3 as the target movement amount of the robot mechanical unit 11 relative to the tip of the tool unit 18A. Then, the drive control unit 22G derives the target positions of each of the joints 19 of the robot mechanical unit 11 by using this target movement amount and inverse kinematics.

[0117] When moving tool unit 18A to coincide with the position of work target part T, and while tool unit 18A is working on work target part T, drive control unit 22G superimposes the above-derived target position on the target position of joint unit 19 calculated for the drive processing of this movement and work. Through these processes, drive control unit 22G can further reduce the influence of alignment errors between tool unit 18A and work target part T caused by shaking of work table 3.

[0118] Next, an example of information processing executed by the work support device 10 of this embodiment will be described.

[0119] FIG. 10 is a flowchart showing an example of information processing executed by the work support device 10 of this embodiment.

[0120] The reception unit 22A receives a work ID from the UI unit 32 (step S100). When starting a work, the user operates the UI unit 32 to select a desired work ID included in the management information. The reception unit 22A receives the work ID selected by the user.

[0121] The first determination unit 22B determines whether or not laser irradiation is possible (step S102). The first determination unit 22B determines whether or not laser irradiation is possible using information indicating the presence or absence of reflection by the laser light L, which is included in the design information corresponding to the job ID accepted by the acceptance unit 22A.

[0122] If it is determined that laser irradiation is possible (step S102: Yes), the process proceeds to step S104. In step S104, the laser control unit 22C controls the laser irradiation unit 20 to irradiate the work target T with laser light L (step S104). The laser control unit 22C identifies work position information included in the design information corresponding to the work ID in the management information. Then, the laser control unit 22C controls the laser irradiator 20A to irradiate the laser light L to the work position represented by the identified work position information. Therefore, under the control of the laser control unit 22C, the laser light L is irradiated from the laser irradiator 20A of the laser irradiation unit 20 to the work position of the work target T.

[0123] Next, the acquisition unit 22E acquires a captured image of the work target part T and the tool part 18A in the work space 2 (step S106). For example, the acquisition unit 22E acquires a captured image 40 shown in FIG.

[0124] Next, the derivation unit 22F derives the relative position between the work target part T and the tool part 18A based on the captured image 40 (step S108). For example, the derivation unit 22F derives the position (Xr, Yr) of the spot area P1 and the position (Xt, Yt) of the power drill 18A1 in the captured image 40 as the relative position. Then, the process proceeds to step S118, which will be described later.

[0125] On the other hand, if it is determined in step S102 that laser irradiation is not possible (step S102: No), the process proceeds to step S110.

[0126] In step S110, the second determination unit 22D determines whether or not template matching processing is possible (step S110). The second determination unit 22D determines whether or not template matching processing is possible, for example, by determining whether or not a work target portion T exists in the captured image.

[0127] If it is determined that template matching processing is possible (step S110: Yes), the process proceeds to step S112.

[0128] In step S112, the acquisition unit 22E acquires a captured image of the work target part T and the tool part 18A in the work space 2 (step S112). For example, the acquisition unit 22E acquires the captured image 42 shown in FIG.

[0129] Next, the derivation unit 22F derives the relative position between the work target part T and the tool part 18A based on the captured image 42 (step S114). For example, the derivation unit 22F identifies an area that matches or is similar to the template image 44 included in the captured image 42 as the bolt T2. Then, the derivation unit 22F derives the position (Xr, Yr) of the identified bolt T2 and the position (Xt, Yt) of the impact driver 18A2 as the relative position. Then, the process proceeds to step S118.

[0130] In step S118, the drive control unit 22G controls the drive unit 30 of the arm mechanism 18 so that the position of the work target part T and the position of the tool part 18A coincide with each other based on the relative positions of the work target part T and the tool part 18A derived in step S108 or step S114 (step S118).

[0131] The drive control unit 22G determines whether the position of the tool unit 18A has reached the work position, which is the position of the work target part T (step S120). If a negative determination is made in step S120 (step S120: No), the process returns to step S106 or step S112. In particular, if the derivation unit 22F has derived the relative position from the captured image 40 in the immediately preceding process, the process returns to step S106. On the other hand, if the derivation unit 22F has derived the relative position from the captured image 42 in the immediately preceding process, the process may return to step S112.

[0132] If the determination in step S120 is affirmative (step S120: Yes), the process proceeds to step S122.

[0133] In step S122, drive control unit 22G controls tool unit 18A to approach work target T and perform the work content represented by the work content information corresponding to the work ID received in step S100 (step S122). By the processing of step S122, work such as drilling a hole in area T1 to be drilled with electric drill 18A1 and fastening bolt T2 with impact driver 18A2 is performed.

[0134] The control unit 22 repeats the negative determination (step S124: No) until it determines that the work of step S122 is completed (step S122: Yes). When it determines that the work of step S122 is completed (step S124: Yes), this routine is terminated.

[0135] If a negative determination is made in step S124 (step S124: No), the process may return to step S106 or step S112. In particular, if the derivation unit 22F has derived the relative position from the photographed image 40 in the immediately preceding process, the process returns to step S106. On the other hand, if the derivation unit 22F has derived the relative position from the photographed image 42 in the immediately preceding process, the process may return to step S112.

[0136] As described above, in the processes of steps S118 to S120, it is preferable that the drive control section 22G executes a speed control process on the drive section 30 so that the tool section 18A moves at a predetermined speed from position (Xt, Yt) toward position (Xr, Yr) of the work target section T. As described above, the predetermined speed is, for example, a speed that satisfies equations (1) and (2), or equations (3) and (4).

[0137] As described above, it is preferable that the drive control section 22G further controls the drive section 30 to cancel out the first force Fb detected by the force sensor 16 during the execution of the task of step S122.

[0138] On the other hand, if a negative determination is made in step S110, the process proceeds to step S116. In step S116, a manual process is executed in which the user manually adjusts the position and posture of the arm mechanism 18 to perform a task (step S116). Then, this routine ends.

[0139] As described above, the work support device 10 of this embodiment includes the arm mechanism 18, the second judgment unit 22D, the acquisition unit 22E, the derivation unit 22F, and the drive control unit 22G. The arm mechanism 18 is mounted on the work table 3 arranged in the work space 2, and is a mechanism having the tool unit 18A at its end. The acquisition unit 22E acquires photographed images of the work target part T and the tool unit 18A in the work space 2. The derivation unit 22F derives the relative position between the work target part T and the tool unit 18A based on the photographed images. The drive control unit 22G controls the drive unit 30 of the arm mechanism 18 so that the position of the work target part T and the position of the tool unit 18A coincide with each other based on the relative position.

[0140] Here, in the conventional technology, the position of the work target part T is estimated from a 3D model of the work space 2, and work is performed at the estimated position. Also, in the conventional technology, the tilt of the tool is adjusted using the detection result of the angle between the wall surface and the tool, thereby supporting the work on the work target part T on the wall surface.

[0141] However, the work table 3 arranged in the work space 2 may shake within the work space 2. For this reason, the work position estimated in advance using a 3D model of the work space or the like may deviate from the actual work position due to the shaking of the work table 3 or the like. Furthermore, even if the angle between the work target 50 and the tool unit 18A is detected, the position of the work target unit T on the work target 50 may deviate from the position of the tool unit 18A due to the shaking of the work table 3. For this reason, in the conventional technology, accurate alignment may be difficult due to the shaking of the work table 3 or the like, and the work accuracy may decrease.

[0142] On the other hand, the work support device 10 of this embodiment derives the relative position from a captured image of the work target part T and the tool part 18A, and controls the drive unit 30 based on the relative position so that the position of the work target part T and the position of the tool part 18A coincide with each other.

[0143] Therefore, the work support device 10 of this embodiment can accurately align the tool part 18A and the work target part T even if the work table 3 shakes.

[0144] Therefore, the work support device 10 of this embodiment can improve the work accuracy.

[0145] Next, an example of the hardware configuration of the control unit 22 and the control unit 20C in the work support device 10 of the above embodiment will be described.

[0146] FIG. 11 is a diagram showing an example of a hardware configuration of the control unit 22 and the laser control unit 22C.

[0147] The control unit 22 and the laser control unit 22C in the above embodiment are equipped with a control device such as a CPU 86, storage devices such as a ROM (Read Only Memory) 88, a RAM (Random Access Memory) 90, and a HDD (Hard Disk Drive) 92, an I / F unit 82 which interfaces with various devices, and a bus 96 which connects each unit, and are configured as hardware using a conventional computer.

[0148] In the control unit 22 and the laser control unit 22C of the above embodiment, the CPU 86 reads out a program from the ROM 88 onto the RAM 90 and executes it, thereby realizing each of the above units on the computer.

[0149] The programs for executing the above-mentioned processes executed by the control unit 22 and the laser control unit 22C in the above-mentioned embodiment may be stored in the HDD 92. The programs for executing the above-mentioned processes executed by the control unit 22, the laser control unit 22C, and the main control unit 30 in the above-mentioned embodiment may be provided by being pre-installed in the ROM 88.

[0150] The programs for executing the above processes executed by the control unit 22 and the laser control unit 22C of the above embodiment may be stored in a computer-readable storage medium such as a CD-ROM, a CD-R, a memory card, a DVD (Digital Versatile Disk), or a flexible disk (FD) in an installable or executable format file and provided as a computer program product. The programs for executing the above processes executed by the control unit 22 and the laser control unit 22C of the above embodiment may be stored on a computer connected to a network such as the Internet and provided by downloading the programs via the network. The programs for executing the above processes executed by the control unit 22 and the laser control unit 22C of the above embodiment may be provided or distributed via a network such as the Internet.

[0151] Although the embodiment of the present invention has been described above, the embodiment is presented as an example and is not intended to limit the scope of the invention. This new embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. This embodiment and its modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0152] 10 Work support device 12. Photography Department 18 Arm mechanism 19 Joint 20 Laser irradiation unit 22B 1st Judgment Department 22C Laser control unit 22D 2nd Judgment Department 22E Acquisition Department 22F Derivation part 22G Drive control unit 30 Drive unit

Claims

1. an arm mechanism mounted on a work table arranged in the work space and having a tool portion at an end thereof; an acquisition unit that acquires a photographed image of a work target portion and the tool portion in the work space; A derivation unit that derives a relative position between the work target portion and the tool portion based on the captured image; a drive control unit that controls a drive unit of the arm mechanism based on the relative position so that a position of the work target part and a position of the tool part coincide with each other; Equipped with the arm mechanism has one or more arm portions and the tool portion connected by a joint portion, The lead-out portion is a movement amount of the work table relative to the work target portion based on a swing amount of the work table with the arm mechanism mounted thereon, the swing amount being detected by a swing amount sensor that detects a swing amount of the work table; The drive control unit is Further controlling the position of the joint portion so as to cancel out the derived amount of movement. Work support equipment.

2. The arm mechanism is installed on the work table via a support base and is configured as a separate entity from the work table. The work support device according to claim 1 .

3. The drive control unit is controlling the drive unit to move the position of the tool unit to the position of the work target part at a speed according to a distance between the work target part and the tool unit; The work support device according to claim 1 or 2.

4. The drive control unit is controlling the drive unit to move the position of the tool part to the position of the work target part at a speed faster as the distance becomes larger and at a speed slower as the distance becomes smaller; The work support device according to claim 3.

5. The drive control unit is controlling the drive unit to move the position of the tool unit to the position of the work target part at a speed corresponding to a change in the distance between the work target part and the tool unit; The work support device according to claim 3.

6. The drive control unit: A movement amount of the work table relative to the work target part is further derived based on the shaking amount of the work table, and a position of the joint part is further controlled so as to offset the derived movement amount. The work support device according to any one of claims 1 to 5.

7. A robot mechanism unit mounted on the workbench and including the arm mechanism and the swing amount sensor, The drive control unit is a swing direction and amplitude of the work table derived as the movement amount of the work table are used as a target movement amount of the robot mechanical unit relative to the tip of the tool unit, a target position of the joint unit of the robot mechanical unit is derived based on the target movement amount and inverse kinematics, and the drive unit is controlled so that the joint unit is positioned at the derived target position. The work support device according to claim 6.

8. A laser irradiation unit that irradiates laser light; a first determination unit that determines whether laser irradiation is possible; a laser control unit that controls the laser irradiation unit to irradiate the work target with laser light when it is determined that laser irradiation is possible; Equipped with The lead-out portion is If it is determined that laser irradiation is possible, a spot area of ​​the laser light included in the captured image is specified as the work target portion, and the relative position between the specified work target portion and the tool portion is derived. The work support device according to any one of claims 1 to 7.

9. The laser control unit includes: When it is determined that the work target portion cannot be irradiated with a laser, the laser irradiation unit is controlled so as to irradiate a laser beam to a position spaced a first distance from the work target portion in a first direction; The lead-out portion is When it is determined that the work target portion cannot be irradiated with a laser, an area separated by the first distance in a direction opposite to the first direction from a spot area of ​​the laser light included in the captured image is identified as the work target portion, and the relative position between the identified work target portion and the tool portion is derived. The work support device according to claim 8.

10. a second determination unit that determines whether or not template matching processing is possible when it is determined that laser irradiation is impossible; The lead-out portion is If it is determined that template matching processing is possible, a region that matches or is similar to a template image included in the captured image is specified as the work target portion, and a relative position between the specified work target portion and the tool portion is derived. The work support device according to any one of claims 1 to 9.

11. a detection unit that detects a first force applied to the tool unit from the work target portion, The drive control unit is controlling the drive unit to cancel out the first force; The work support device according to any one of claims 1 to 10.

12. The working space is The elevator shaft, The work support device according to any one of claims 1 to 11.

13. Acquire photographic images of a work target in a working space and a tool part of an arm mechanism mounted on a work table arranged in the working space and having a tool part at an end thereof; Deriving a relative position between the work target portion and the tool portion based on the captured image; and controlling a drive unit of the arm mechanism based on the relative position so that the position of the work target part and the position of the tool part coincide with each other. the arm mechanism has one or more arm parts and the tool part connected by a joint part, and further derives a movement amount of the work table relative to the work target part based on a sway amount of the work table with the arm mechanism mounted thereon, the movement amount being detected by a sway amount sensor that detects the sway amount of the work table, and further controls a position of the joint part so as to offset the derived movement amount. Work support method.

14. A work assistance program for causing a computer to execute the work assistance program, an acquisition step of acquiring photographed images of a work target in a working space and a tool part of an arm mechanism mounted on a work table arranged in the working space and having a tool part provided at an end of the arm mechanism; a deriving step of deriving a relative position between the work target portion and the tool portion based on the captured image; a control step of controlling a drive unit of the arm mechanism based on the relative position so that a position of the work target part and a position of the tool part coincide with each other; Including, the arm mechanism has one or more arm portions and the tool portion connected by a joint portion, The deriving step includes: a movement amount of the work table relative to the work target portion based on a swing amount of the work table with the arm mechanism mounted thereon, the swing amount being detected by a swing amount sensor that detects a swing amount of the work table; The control step includes: Further controlling the position of the joint portion so as to cancel out the derived amount of movement. Occupational support programs.

Citation Information

Patent Citations

  • Micro manipulation device for minute operation

    JP2004255493A

  • Information processing device and information processing method

    JP2016099257A

  • Control device, robot, and robot system

    JP2018126796A

  • Elevator installation device

    JP2020007095A

  • Work support device and work support method

    JP2021042073A