Information providing device
Patent Information
- Application Number
- JP2023172404
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-10-04
- Publication Date
- 2025-02-21
- Estimated Expiration
- 2037-12-28
AI Technical Summary
【0008】 この情報提供装置は、作業ロボットに関連する2以上の構造体の情報と、構造体に関連する1以上の処理モデルの情報とを登録している。また、この情報提供装置は、構造体の情報と構造体に関連する処理モデルの情報とを用いて仮想空間上で作業システムの動作を実現する動作プログラムを有している。そして、この情報提供装置は、2以上の構造体の情報及び構造体に関連する処理モデルを選択した選択情報を取得し、選択情報に含まれる構造体の情報及び処理モデルの情報を読み出し、動作プログラムにより2以上の構造体を接続した状態で処理モデルの処理を仮想空間上で実現し、実現した処理結果を出力する。顧客又は製造者である作業者は、実際に作業システムを構築することなく、出力された処理結果に基づいて複数の構造体を組み合わせた場合にどのように処理が実行されるかを仮想空間上で確認することができる。したがって、この情報提供装置では、作業システムの構築をより容易に実現することができる。ここで、「構造体」には、例えば、作業ロボットの一部又は全部のほか、作業ロボットに装着される部材、作業ロボットの周辺に配置される部材などが含まれる。また、「処理結果」には、例えば、構造体の動作や撮像画像の状態、画像処理での判定結果などが含まれ、具体的には、作業ロボット(構造体)同士の干渉の有無、ワークの採取、保持、移動が可能か否か、ワークの落下の有無、撮像画像の画質、画像処理の精度などのうち1以上が挙げられる。
Smart Images

Figure 0007634627000001 
Figure 0007634627000002 
Figure 0007634627000003
Abstract
Description
[Technical field]
[0001] This specification discloses an information providing device, an information providing method, and a program. [Background technology]
[0002] A conventional method for constructing a manufacturing system that performs work on a workpiece involves preparing a main unit equipped with a mainframe and a control device, and work element execution devices, assembling the work element execution devices in the mainframe of the main unit, and configuring the control device to centrally control the work element execution devices (see, for example, Patent Document 1). This construction method makes it possible to construct a highly versatile manufacturing system. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2012-56002 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, for example, when constructing a work system equipped with one or more work robots that perform a specific task on a specific workpiece, an engineer must select a work robot suitable for the task, purchase the work robot, align the robot using a teaching pendant, and then set the operation of the work robot by on-site teaching. In this way, constructing a work system requires high teaching skills from an engineer. In addition, since the work range and content of a work robot may be limited, an engineer may not be able to know whether the work can be performed unless he or she purchases a work robot and assembles the system. If it is found that there is a problem in executing the task after assembling the work system, the engineer must make further changes, and therefore it is not easy to construct a work system.
[0005] The present disclosure has been made in consideration of such problems, and has as its main object to provide an information providing device and an information providing method that can more easily realize the construction of an operation system. [Means for solving the problem]
[0006] In this disclosure, the following means are taken to achieve the above-mentioned main object.
[0007] The information providing device of the present disclosure includes: An information providing device used in a work system including a work robot that performs a predetermined work on a workpiece, a storage unit that registers and stores information on two or more structures related to the working robot and information on one or more processing models related to the structures; an operation program for implementing the operation of the work system in a virtual space using information on the structure and information on a processing model related to the structure; a control unit that acquires information on two or more of the structures stored in the storage unit and selection information that selects a processing model related to the structures, reads out the information on the structures and the information on the processing model included in the selection information from the storage unit, realizes processing of the processing model in a virtual space with the two or more structures connected by the operation program, and outputs a result of the realized processing; It is equipped with the following:
[0008] This information providing device registers information on two or more structures related to a work robot and information on one or more processing models related to the structures. This information providing device also has an operation program that realizes the operation of a work system in a virtual space using the information on the structures and the information on the processing models related to the structures. Then, this information providing device acquires selection information that selects the information on the two or more structures and the processing models related to the structures, reads out the information on the structures and the information on the processing models included in the selection information, realizes the processing of the processing models in a virtual space with the two or more structures connected by the operation program, and outputs the realized processing results. A customer or a worker who is a manufacturer can check in a virtual space how the processing is executed when multiple structures are combined based on the output processing results without actually constructing a work system. Therefore, this information providing device can more easily realize the construction of a work system. Here, the "structure" includes, for example, a part or all of the work robot, as well as a member attached to the work robot and a member disposed around the work robot. In addition, the "processing results" include, for example, the operation of the structure, the state of the captured image, and the judgment results of image processing, and specifically include one or more of the following: whether or not there is interference between work robots (structures), whether or not it is possible to pick up, hold, or move the workpiece, whether or not the workpiece has fallen, the image quality of the captured image, and the accuracy of image processing. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a schematic diagram showing an example of an ecosystem 10. [Diagram 2] FIG. 2 is a perspective view showing an example of a working system 50. [Diagram 3] FIG. 4 is an explanatory diagram of information stored in a storage unit 23. [Figure 4] 10 is a flowchart showing an example of an information provision processing routine. [Diagram 5] FIG. [Figure 6] FIG. 7 is an explanatory diagram of a processing condition input screen 72. [Figure 7]An explanatory diagram of the image display field 67 in the process of configuring the system. [Figure 8] FIG. 13 is an explanatory diagram showing an abnormal operation of the working system 50 in the virtual space. [Figure 9] FIG. 4 is an explanatory diagram showing normal operation of the work system 50 in a virtual space. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] A preferred embodiment of the information providing device 20 disclosed in this specification will be described below with reference to the drawings. FIG. 1 is a schematic explanatory diagram of an ecosystem 10 including the information providing device 20. FIG. 2 is a perspective view showing an example of a work system 50 that performs a predetermined process on a workpiece W. FIG. 3 is an explanatory diagram of a device database (DB) 31, a peripheral device DB 32, and an application DB 33 stored in a storage unit 23. As shown in FIG. 1, the ecosystem 10 includes a plurality of design personal computers (PCs) 13 connected to a LAN 12, and an information providing device 20 connected to the LAN 12. The design PC 13 is a computer that designs a structure to be incorporated in the work system 50 shown in FIG. 2, for example, an arrangement device 52 as a work robot and peripheral devices to be attached thereto.
[0011] The information providing device 20 is configured as a server that handles information about a work system including a work robot that performs a predetermined work on a workpiece W. The information providing device 20, for example, receives orders for a work system 50 and receives orders and delivers peripheral devices to be attached to an arrangement device 52. The information providing device 20 transmits data to a store PC 40 (information processing device) via a network 11 such as the Internet, and receives information from the store PC 40. The information providing device 20 includes a control device 21 that controls the entire device, a storage unit 23 that stores various application programs and various data files, a display unit 24 that displays various information, an input device 25 such as a keyboard and a mouse through which a worker inputs various commands, and a communication unit 26 that communicates with external devices such as a design PC 13. The control device 21 is configured as a microprocessor centered on a CPU 22. The communication unit 26 is a network interface that communicates with external devices.
[0012] Here, the working system 50 will be described. As shown in FIG. 2, the working system 50 includes an arrangement device 52 as a working robot that performs a predetermined process on the object (workpiece W) to be processed. The working system 50 includes a transport device 51 that transports an arrangement member 18 such as a pallet on which the workpiece W is arranged, one or more arrangement devices 52, a supply device 54 that supplies the workpiece W, and a control device 52a that controls the device. Here, an example will be described in which the working system 50 performs an operation of moving the workpiece W from a supply position to the arrangement member 18. The workpiece W to be worked on is not particularly limited, but examples thereof include various parts such as mechanical parts, electrical parts, electronic parts, and chemical parts, as well as food, bio, and biological products. Examples of the predetermined work include, for example, a moving operation of collecting, moving, and arranging from a supply position to a target position, an assembly operation of assembling parts, a processing operation of performing processing, a coating operation of applying a viscous material, a heating operation of performing heating, a processing operation of performing a predetermined chemical and / or physical processing, and an inspection operation of performing an inspection. The arrangement device 52 is configured as an articulated arm robot, and includes a base 53, an arm member 55, an end effector 56, and a pedestal 57. The base 53 is a rectangular parallelepiped member having a connection portion for connecting to an adjacent device (such as the arrangement device 52), and the arm member 55 and other devices (the transport device 51 and the supply device 54) are disposed on the upper portion of the base 53. The arm member 55 has a first arm member 55a, a second arm member 55b, and a third support portion 55c. The end effector 56 is detachably disposed at the tip of the arm member 55. On the lower surface side of the end effector 56, a collection member 58 for gripping and collecting the workpiece W and an imaging device 59 for recognizing the processing target are disposed. The collection member 58 may be a suction nozzle for collecting the workpiece W by negative pressure. According to this operation system 50, the processing operation for the workpiece W can be automated.
[0013] As shown in Figs. 1 and 3, the storage unit 23 of the information providing device 20 stores a device DB 31, a peripheral device DB 32, an application DB 33, an operation program 34, and the like. The device DB 31 is a database including information on various devices handled by the information providing device 20. The device DB 31 includes device identification information (ID), device use information, device structure data including structural data such as the external shape of the device, information on a processing model associated with the device, processing capacity data including basic specifications of the device, attachment target information including information on items connectable to the device, and price data regarding the price of the device. The work system 50 includes a device (main device) as a structure and a peripheral device. For example, the main device includes an arrangement device 52 and a base 53 as a work robot, and the peripheral device includes a transport device 51, a supply device 54, an end effector 56, and an imaging device 59. The use of the device includes information that can roughly extract the functions of the device, and includes, for example, "placement," "movement," "transport," "fixation," "collection," and "direction change." The device structure data includes structure data, movable part data, connection part data, etc. The structure data is data that specifies the structure of each part that constitutes the device by its shape, size, material, etc. This structure data may further include shape data, structure condition data, material data, etc. The shape data may be, for example, three-dimensional CAD data. The structure condition data may include information such as the strength, Young's modulus, weight, conductivity, and insulation of the structure. The material data may include information on the material that is constituted, such as resin, metal, ceramic, etc. For example, in the arrangement device 52, the structure data includes information on the shape, structure condition, material, etc. of the skeleton of the first arm member 55a, the skeleton of the second arm member 55b, and the connection member that connects the two. The movable part data includes, for example, information on the positions, directions, and movable ranges of the rotation axis of the end effector 56, the rotation axis of the first arm member 55a, the rotation axis of the second arm member 55b, and the like, as well as information on the position, direction, and movable range of the rotation axis (vertical axis) of the third support part 55c. This movable part data specifies, for example, the movable range and movable direction of the arm member 55.The connection part data includes information such as the fixed part of the base part 57, the connection part of the end effector 56, the connection part of the collection member 58, and the size, position, and size of the connection part of the image capture device 59. This connection part data defines, for example, the connectable arrangement device 52, the collection member 58 and the image capture device 59 that can be attached to the end effector 56, and the like. The information of the processing model includes, for example, information on one or more of a moving process, a collection process, a placement process, a direction change process, an installation process, an image capture process, and an image process using the work W. This processing model is defined in relation to the process executed by the structure, and, for example, in the device, the conveying device 51 is associated with a "transport process", and the arrangement device 52 is associated with a "moving process, collection process, placement process", and the like. In addition, in the peripheral devices, the collection member 58 is associated with a "collection process", the image capture device 59 is associated with an "image capture process", and the control device 52a is associated with an "image process", and the like. Furthermore, within each processing model, for example, "imaging processing" may include multiple processing concepts such as still image capture, video capture, and continuous capture, and processing conditions are set according to each of them. The processing capacity data includes, for example, the size and mass of the workpiece W that can be processed by the device, the operating speed and acceleration of the device, the pressure (pressure, negative pressure) that can be applied to the workpiece, the load, the available current, voltage, and energy amount. The attachment target information includes information on other devices that can be connected to the device and / or peripheral devices that can be connected to the device, such as device IDs and peripheral device IDs. This attachment target information is set based on the above-mentioned connection part data. The size, shape, range of motion, processing content, etc. of the device are specified by the information included in this device DB31.
[0014] The peripheral device DB32 includes identification information (ID) of the peripheral device, use information of the peripheral device, component structure data including structural data such as the external shape of the peripheral device, information on a processing model associated with the peripheral device, processing capacity data including basic specifications of the peripheral device, attachment target information including information on a device to which the peripheral device can be connected and / or other peripheral devices to which the peripheral device can be connected, and price data regarding the price of the peripheral device. The information included in the peripheral device DB32 is the same as the above-mentioned device DB31, and detailed description thereof will be omitted. The size, shape, movable range, processing content, etc. of the peripheral device are defined by the information included in the peripheral device DB32. The application DB33 is a database including information on control software (applications) including a processing model used for a device or peripheral device. The application DB33 includes, for example, identification information (ID) of the application, use information of the application, application target information including information on a device and / or peripheral device that the application can be used for, information on a processing model associated with the application, and price data regarding the price of the peripheral device. The app is used for a structure such as a specific device or peripheral device, and is produced and sold together with the structure or separately from the structure. Specific examples of such apps include the control content of an image capture process used for a specific image capture device 59. The app may also be a traceability tool, an image processing data creation tool, an analysis tool, or the like for a structure such as a device or peripheral device used in the work system 50. By applying an app included in this app DB 33 to a structure, the control of the structure for a specific workpiece W or the like is optimized.
[0015] The operation program 34 is a program that realizes the operation of the work system (the operation of the structure) in a virtual space using information on the structure and information on the processing model related to this structure. The operation program 34 is a so-called simulation program that makes the structure operate with the processing of the processing model. This operation program 34 acquires information contained in the device DB 31 and the peripheral device DB 32, executes the operation, and displays and outputs the results of the execution as, for example, a video, in a state in which a peripheral device is attached to the device, a state in which the devices are connected, or a combination of these. At this time, the operation program 34 applies the processing conditions that are applied to the structure and the processing model, and realizes the processing of the processing model in the structure in a virtual space.
[0016] As shown in FIG. 1, the store PC 40 is installed in a store 15 operated by a company that operates the ecosystem 10. The store PC 40 provides information on the operation system 50 to customers who are considering introducing the operation system 50. For example, an explainer who understands the technology of the operation system 50 is arranged in the store 15, and the explainer operates the store PC 40. The store PC 40 is configured as an information processing device and includes a control device 41 including a CPU 42, a storage unit 43, a display unit 44, an input device 45, and a communication unit 46. The control device 41, the storage unit 43, the display unit 44, the input device 45, and the communication unit 46 may be the same as those described for the information providing device 20. The store PC 40 exchanges data with the information providing device 20 via the network 11 and the communication unit 46.
[0017] Next, the operation of the ecosystem 10 of this embodiment, particularly the operation of providing customers with information on automation using work robots, will be described. Here, the processing executed by the information providing device 20 based on information acquired from the store PC 40 will be mainly described. Also, a specific example of the processing executed by the information providing device 20 to construct a work system 50 (see FIG. 2) will be described. FIG. 4 is a flowchart showing an example of an information provision processing routine executed by the CPU 22 of the information providing device 20. This routine is stored in the storage unit 23, and is executed upon receiving a start instruction from a worker (explanator) of the store 15. When this routine is started, the CPU 22 of the control device 21 outputs an information provision screen 60 to the store PC 40 (step S100).
[0018] FIG. 5 is an explanatory diagram showing an example of an information provision screen 60 displayed on the display unit 44 of the store PC 40. The information provision screen 60 is provided with a cursor 61, a use input field 62, a device input field 63, a peripheral device input field 64, an application input field 65, a work input field 66, an image display field 67, and the like. The cursor 61 is used by the worker to select and input instructions for the input fields arranged on the screen, and moves on the screen by operating the input device 45. The use input field 62 is a field for inputting information that specifies the use of the system to be constructed. When a use is input in the use input field 62, devices and peripheral devices that fit the use are preferentially displayed based on the device DB 31 and the peripheral device DB 32. In the use input field 62 and other input fields, selection items are displayed by a pull-down menu. In this information provision screen 60, when a specific item is input, the selection items increase or decrease accordingly. For example, when a device is specified, other devices that can be connected to the device are displayed as selectable, and devices that cannot be connected are not selectable. Moreover, when the size or mass of the workpiece is input, the device or peripheral device that cannot handle it cannot be selected. As a mode of non-selection, for example, it may be deleted from the selection items, or it may be displayed in a non-selection mode. Such display control is performed based on information output from the information providing device 20, and may be realized by the control device 21 or the control device 41. The device input field 63 is a field for selecting and inputting a desired device. In this device input field 63, when a device is selected, a processing model associated with the device can be displayed, and an image of the device is displayed in an area next to the input field. The peripheral device input field 64 is a field for inputting a peripheral device to be attached to the device. In this peripheral device input field 64, when a peripheral device is selected, a processing model associated with the device can be displayed, and an image of the peripheral device is displayed in an area next to the input field. The application input field 65 is a field for selecting and inputting an application to be applied to a structure such as a device and a peripheral device. In this application input field 65, when an application is selected, a processing model associated with the application can be displayed, and details of the processing content are displayed in an area next to the input field.The work input field 66 is a field for inputting information about the work to be handled, and for example, the type of the work, physical properties such as mechanical strength, mass, size, shape, etc. of the work can be input. The image display field 67 is a field in which the selected device or peripheral device is displayed in a connected and attached state. In this image display field 67, an image or video of the operation system 50 is displayed. In addition, a specification output key 68, a virtual processing execution key 69, a processing condition input key 70, a stop key 71, etc. are arranged on the information providing screen 60. The specification output key 68 is a key that is pressed (clicked) when outputting a specification. The virtual processing execution key 69 is a key that is pressed when the operation of the operation system 50 by the operation program 34 is displayed on the image display field 67. The processing condition input key 70 is a key that is pressed when inputting processing conditions to be executed by the operation program 34. The stop key 71 is a key that is pressed when the current processing is stopped. When the processing condition input key 70 is pressed, the CPU 22 displays a processing condition input screen 72 on the display unit 44.
[0019] FIG. 6 is an explanatory diagram of a processing condition input screen 72 displayed on the display unit 44 of the store PC 40. When the processing condition input key 70 is pressed, the processing condition input screen 72 is displayed overlaid on the information provision screen 60. The processing condition input screen 72 has a processing list input field 73, an operation condition list input field 74, and a decision key 75. The processing list input field 73 is a field for inputting a processing model to be processed by the operation system 50 in list form as a command. The processing list input field 73 includes an input field for the processing model and an input field for the target coordinate in the movement process. This processing list is executed by the operation program 34, and is configured to be usable as an execution job in the operation system 50 after the operation system 50 is manufactured. The list shown in FIG. 6 specifies the processing of moving the collection member 58 to position A, then moving it to position B (collection position) lower than position A, performing collection processing there, and moving it to position C higher than position B. The operation condition list input field 74 is a field for inputting operation conditions of the processing model, and for example, the speed and acceleration in the movement processing, the gripping force and suction force when picking up the workpiece W, etc. can be input. The decision key 75 is a key that is pressed when input to the processing list input field 73 or the operation condition list input field 74 is completed. The worker makes various necessary inputs to the information provision screen 60 or the processing condition input screen 72.
[0020] After S100, the CPU 22 determines whether or not the system use has been input based on the input contents in the use input field 62 (S110). When the system use has been input, the CPU 22 extracts a structure, a processing model, and an application that are suitable for the input use (S120). The CPU 22 extracts the structure, the processing model, and the application by using the device DB 31, the peripheral device DB 32, and the application DB 33. The CPU 22 also uses the extracted information for display control of the information providing screen 60. After S120, or when there is no input in S110, the CPU 22 determines whether or not a device and a processing model related thereto have been selected based on whether or not selection information has been acquired from the store PC 40 (S130), and when a device and a processing model have not been selected, the CPU 22 waits as it is. The store PC 40 transmits the input contents in the device input field 63 to the information providing device 20 as selection information. On the other hand, when a device has been selected in S130, the CPU 22 determines whether or not multiple devices have been selected (S140). When multiple devices are not selected, i.e., when one device is selected, the CPU 22 extracts a processing model related to the device (S150), and extracts other devices and peripheral devices that can be connected to the selected device (S160). At this time, the CPU 22 sets devices and peripheral devices that cannot be connected as unselectable. On the other hand, when multiple devices are selected in S140, a connection is made to the previously selected device at a connection site or the like (S170). Although the process is not illustrated, the CPU 22 may determine whether an app has been selected, and when an app has been selected, the app may be applied to the device or peripheral member.
[0021] After S160 or S170, the CPU 22 determines whether the processing condition input key 70 has been pressed and the processing condition has been input on the processing condition input screen 72 based on whether processing condition information including the processing condition has been acquired from the store PC 40 (S180), and when the processing condition has been input, the CPU 22 registers the contents in the processing list (S190). After S190, or when the processing condition has not been input in S180, the CPU 22 determines whether a peripheral device has been selected based on the input contents in the peripheral device input field 64 (S200), and when a peripheral device has been selected, the peripheral device is attached, connected, or fixed to a connection portion of the device or the like (S210). Although the process is not illustrated, the CPU 22 may determine whether an app has been selected, and when an app has been selected, apply the app to the device or the peripheral device.
[0022] After S210, or when no peripheral device is selected in S200, the CPU 22 judges whether the currently constructed working system 50 is in an operable state, that is, whether the above-mentioned various data have been correctly selected or input (S220). For example, the CPU 22 judges that the working system 50 is not operable when there is a defect, such as when the operating conditions have not been input or when the peripheral device for executing the process has not been selected. When it is determined that the working system 50 is not operable, the virtual process execution key 69 may be made unselectable (for example, grayed out) so that it cannot be pressed. The CPU 22 also makes the judgment in S220 based on whether the virtual process execution key 69 has been pressed when the working system 50 is in an operable state. When a negative judgment is made in S220, for example, when the working system 50 is not operable, or when the working system 50 is changed even if it is operable, the CPU 22 executes the processes from S110 onward. That is, when the working system 50 cannot be caused to execute the operation process in the virtual space, the operator modifies the currently constructed working system 50. Furthermore, the CPU 22 connects a newly selected device, connects a newly selected peripheral device, and registers input processing conditions in the processing list.
[0023] FIG. 7 is an explanatory diagram of the image display field 67 in the process of configuring the system, where FIG. 7A shows the selection of the arrangement device 52, FIG. 7B shows a connection of multiple arrangement devices 52, FIG. 7C shows the selection of the transport device 51, and FIG. 7D shows the construction of the work system 50 with the supply device 54 arranged. When the worker selects a device, the selection is reflected in the image display field 67. Also, since the storage unit 43 stores information on the connection points of each device, the CPU 22 uses this information to display the devices in the image display field 67 in a state in which the connection points are connected to each other. At this time, the information providing screen 60 displays devices that can be connected at the connection points in a selectable manner, making it easy for the worker to select the device.
[0024] Now, when an operation input is made in S220 while the device is in an operable state, the CPU 22 executes the operation processing of the working system 50 in the virtual space (S230). The CPU 22 operates the working system 50 in the virtual space by applying the registered processing conditions in the selected structure and the processing model related thereto, and outputs the operation result as a video to the image display field 67. At this time, the CPU 22 performs calculations including whether or not the work W falls or the gripping position shifts during the movement depending on the gripping force and the mass of the work W when the work W is moved at the speed and acceleration of the set processing conditions. The CPU 22 also calculates whether or not the structure interferes (comes into contact) with another structure when the device is operated. Furthermore, the CPU 22 calculates the time required for processing when the set processing list is executed. After S230, the CPU 22 judges whether or not the working system 50 has operated normally based on the above calculation results (S240). That is, the CPU 22 judges whether or not a predetermined task to be executed by the work system 50 was performed normally in the virtual space. If the operation was not normal, the CPU 22 notifies the worker of the malfunction (S250) and executes the process from S110 onwards. The worker who has confirmed the malfunction corrects the currently constructed work system 50, for example, by changing the device in S130 or by changing the peripheral device in S200.
[0025] FIG. 8 is an explanatory diagram showing an abnormal operation of the working system 50 in a virtual space, in which FIG. 8A shows the workpiece W being picked up, FIG. 8B shows the workpiece W being moved, and FIG. 8C shows the workpiece W being placed. FIG. 9 is an explanatory diagram showing a normal operation of the working system 50 in a virtual space, in which FIG. 9A shows the workpiece W being picked up, FIG. 9B shows the workpiece W being moved, and FIG. 9C shows the workpiece W being placed. As shown in FIG. 8, when the arrangement device 52 moves the workpiece W, if the gripping force is insufficient, the workpiece W may fall from the picking member 58. If an operator confirms this, the picking member 58 is replaced with a picking member with a higher gripping force and the operation is performed again. As shown in FIG. 9, when the picking member 58 with a higher gripping force is used, it is possible to confirm that the picking, moving, and placement processing of the workpiece W operates normally. In addition, in this ecosystem 10, even if it is confirmed that the working system 50 can operate normally, it is possible to consider, for example, the total processing time, and the optimal device environment can be verified without preparing an actual machine. Also, when checking the operation of the work system 50 in the virtual space, it is possible to consider, for example, the work to be performed when switching to a different type of work W that is expected, and to verify the results of changing the arrangement member 18 that arranges the work. Furthermore, in the ecosystem 10, for example, by checking the operation of the work system 50 in the virtual space in a state where an application that optimizes the supply conditions of the work W of the supply device 54 is incorporated, it is also possible to verify the effects of efficiency improvements such as shortening processing time.
[0026] On the other hand, when the operation system operates normally in S240, the currently registered process list and the device configuration of the operation system 50 are saved (S260). Next, the CPU 22 judges whether or not a request for outputting the design specifications has been input based on whether or not the specification output key 68 has been pressed (S270). When a request for outputting the design specifications has been input, the CPU 22 causes the store PC 40 to output design specification information including the information on the design specifications based on the configuration of the operation system 50 saved in S260 (S280). The store PC 40 may print out the design specifications included in the design specification information. Then, the CPU 22 judges whether or not an input to end the information provision has been input based on the input on the information provision screen 60 (S290), and if the input to end the information provision has not been input, the CPU 22 executes the processing from S110 onward. On the other hand, when an input to end the information provision has been input in S290, this routine is terminated. After the design specifications are output, when the operation system 50 is ordered, the CPU 22 may output the stored processing list to the manufactured operation system 50 as an execution job.
[0027] Here, the correspondence between the components of this embodiment and the components of the present invention will be clarified. The memory unit 23 of this embodiment corresponds to the memory unit of the present disclosure, the CPU 22 corresponds to the control unit, and the arrangement device 52 corresponds to the work robot. Note that in this embodiment, an example of the control method of the present disclosure is also clarified by explaining the operation of the information providing device 20.
[0028] In the information providing device 20 of the present embodiment described above, information on two or more structures related to the work robot and information on one or more processing models related to the structures are registered. In addition, the information providing device 20 has an operation program 34 that realizes the operation of a work system in a virtual space using the information on the structures and the information on the processing models related to the structures. The information providing device 20 acquires selection information that selects the information on two or more structures and the processing models related to the structures, reads out the information on the structures and the information on the processing models included in the selection information, realizes the processing of the processing model in a virtual space with two or more structures connected by the operation program, and outputs the realized processing result. A customer or a manufacturer, who is an operator, can check in a virtual space how the processing is executed when multiple structures are combined based on the output processing result without actually constructing a work system. Therefore, the information providing device 20 can more easily realize the construction of a work system.
[0029] The control device 21 also constructs a work system combining the selected structure and the processing model in a virtual space, operates the constructed work system in the virtual space by an operation program, judges whether the operation by the work system is executed normally, and outputs the judgment result. In this information providing device 20, the construction of the work system 50 can be realized more easily by using the judgment result of whether the work system 50 is executed normally in the virtual space. In addition, when the operation of the work system 50 in the virtual space is performed normally, the control device 21 outputs design specification information of the work system 50 based on the information of the structure and the information of the processing model. In this information providing device 20, when the work system 50 in the virtual space can be operated correctly, the work system 50 can be constructed, so that the design specification can be automatically created as it is. Furthermore, the control device 21 may output the processing result, and then, when it acquires the specification output information, output the design specification information based on the information of the structure of the processing result and the information of the processing model. With this information providing device 20, if it is confirmed that the work system 50 in the virtual space is in line with the customer's intentions, the information necessary to construct the work system 50 is gathered, so that a design specification can be automatically created.
[0030] In the information providing device 20, the information on the structure includes information on the connection portion for connecting to other structures, and the control device 21, after acquiring the selection information, outputs information on other structures that can be connected to the structure based on the information on the connection portion. In this information providing device 20, it is easy to select a connectable structure. In addition, the control device 21 makes it impossible to select other structures that cannot be connected, so that it is easy to select a connectable structure. Furthermore, the control device 21 acquires processing condition information including processing conditions to be applied to the structure and the processing model, and realizes processing of the processing model in a virtual space with two or more structures connected by applying the acquired processing conditions. In this information providing device 20, since processing based on the processing conditions is realized in a virtual space, various processing states can be confirmed by changing the processing conditions. Furthermore, the operation system 50 executes actual processing by applying a processing list that lists information on the processing model as it is, and the control device 21 outputs the processing result and then acquires order information, and outputs a list of the processing model of the processing result as an execution job to be incorporated into the operation system 50. With this information providing device 20, it is possible to directly incorporate the processing model confirmed in the virtual space into the actual work system 50, and since there is no need to create a new program to control the work system 50, construction of the work system 50 can be realized even more easily.
[0031] In addition, since the structure includes one or more of a work robot, a supply device, a transport device, an imaging device, an end effector, and parts thereof, the information providing device 20 can confirm the processing state, etc., of each of the above structures in the virtual space. Furthermore, since the information of the structure includes one or more of shape data, structural condition data, and material data, the information providing device 20 can realize a structure in the virtual space according to the contents of the data by defining the shape, structural condition, and material. Furthermore, since the processing model includes one or more of a movement process, a collection process, a placement process, a direction change process, an installation process, an imaging process, and an image process using the work W, the information providing device 20 can confirm these processes in the virtual space.
[0032] It goes without saying that the present disclosure is in no way limited to the above-described embodiment, and can be embodied in various forms as long as it falls within the technical scope of the present disclosure.
[0033] For example, in the above embodiment, the control device 21 realizes the operation of the operation system 50 in a virtual space by the operation program 34, outputs the processing result as a video, and outputs the judgment result as to whether the operation was performed normally or not, but the processing result may be output only as a video, or may be output only as the judgment result. Either of these information providing devices makes it easier to construct an operation system.
[0034] In the above embodiment, the information providing device 20 outputs the processing result of the operation program 34, and then outputs the design specification information when it acquires the specification output information from the store PC 40, but this may be omitted. Also, in the above embodiment, when the operation of the operation system 50 in the virtual space is performed normally, the design specification information of the operation system 50 is output based on the structure information and the processing model information, but the output of this design specification information may be omitted. Either of these information providing devices can make it easier to build an operation system.
[0035] In the above-described embodiment, the control device 21 acquires the selection information of the structure, and then outputs other structures that can be connected to the structure based on the information of the connection portion so that they can be selected, but this is not particularly limited, and this process may be omitted. Also, in the above-described embodiment, structures that cannot be connected are made unselectable, but this process may be omitted. Each time the control device 21 acquires selection information from the store PC 40, it is sufficient to determine whether a newly selected structure can be connected to the already selected structure.
[0036] In the above embodiment, the work system 50 is capable of executing actual processing by directly applying the processing list executed by the operation program 34, but the present invention is not limited to this, and the work system 50 may execute a newly created execution job separately from the processing list of the operation program 34. This information providing device also makes it easier to build an operation system. Note that it is preferable to build a processing list that can be executed by the operation program 34 and the work work system 50, because this makes it easier to build an operation system.
[0037] In the above-described embodiment, the present disclosure has been described as an information providing device 20 that executes operation processing by an operation program 34, but is not particularly limited thereto, and may be an information providing method or an information providing program. In particular, the present disclosure may be realized not only as an information providing device 20, but also on the cloud. In addition, in the above-described embodiment, the CPU 22 of the information providing device 20 executes an operation program to realize processing by a structure in a virtual space, but is not limited thereto, and the CPU 42 of the store PC 40 may execute an operation program to realize processing by a structure in a virtual space. For example, the store PC 40 may function as an information providing device.
[0038] Here, in the information providing device of the present disclosure, the control unit may construct the work system in the virtual space by combining the selected structure and a processing model, operate the constructed work system in the virtual space by the operation program, determine whether the operation by the work system is normally executed, and output the determination result. In this information providing device, the construction of the work system can be more easily realized by using the determination result of whether the work system in the virtual space is normally executed.
[0039] Alternatively, the information providing device of the present disclosure includes: An information providing device used in a work system including a work robot that performs a predetermined work on a workpiece, a storage unit that registers and stores information on two or more structures related to the working robot and information on one or more processing models related to the structures; an operation program for implementing the operation of the work system in a virtual space using information on the structure and information on a processing model related to the structure; a control unit that acquires information on two or more of the structures stored in the storage unit and selection information that selects a processing model related to the structures, constructs the operation system in the virtual space by combining the selected structures and processing models, operates the constructed operation system in the virtual space using the operation program, judges whether the operation by the operation system has been normally executed, and outputs the judgment result; The above configuration may also be adopted.
[0040] This information providing device obtains information on two or more structures and selection information for selecting a processing model related to the structures, constructs an operation system in a virtual space that combines the selected structures and processing models, operates the constructed operation system in the virtual space using an operation program, and outputs a determination result as to whether the operation by the operation system was performed normally. By using the determination result as to whether the operation system in the virtual space is executed normally, this information providing device can more easily realize the construction of the operation system.
[0041] In the information providing device of the present disclosure for determining the operation of a work system, the control unit may output design specification information of the work system based on the information of the structure and the information of the processing model when the operation of the work system in the virtual space is performed normally. When the work system in the virtual space can operate normally, this information providing device can construct the work system, and therefore can automatically create design specification information as it is.
[0042] In the information providing device of the present disclosure, the control unit may output the processing result, and then, when it acquires specification output information, output design specification information based on the information of the structure in the processing result and the information of the processing model. In this information providing device, when it is confirmed that the work system in the virtual space is in line with the customer's intention, the information necessary to construct the work system is gathered, and therefore the design specification information can be automatically created as it is.
[0043] In the information providing device of the present disclosure, the information on the structure may include information on a connection portion for connecting to another structure, and the control unit may output information on another structure that can be connected to the structure based on the information on the connection portion after acquiring the selection information. In this information providing device, it is easy to select a connectable structure. In this information providing device, the control unit may make it possible to select another connectable structure when outputting the information on the other connectable structure. Also, the control unit may make it impossible to select another structure that cannot be connected when outputting the information on the other connectable structure. Alternatively, the control unit may output the structure that can be connected to the selected structure in a selectable manner based on the information on the connection portion after one of the structures is selected. In this information providing device, it is easy to select a connectable structure.
[0044] In the information providing device of the present disclosure, the control unit may acquire processing condition information including processing conditions to be applied to the structure and the processing model, and may apply the acquired processing conditions to realize processing of the processing model in a virtual space with two or more structures connected. In this information providing device, since processing based on the processing conditions is realized in a virtual space, various processing states can be confirmed by changing the processing conditions. Here, the "processing conditions" include, for example, physical quantities used in processing, and specifically include size, mass, speed, acceleration, pressure, current, voltage, energy, time, and the like.
[0045] In the information providing device of the present disclosure, the operation system applies the information of the processing model as is to execute actual processing, and the control unit may output the processing result and then, upon acquiring order information, output a list of the processing models of the processing result as an execution job to be incorporated into the operation system. With this information providing device, the processing model confirmed in the virtual space can be incorporated into the actual operation system as is, and there is no need to create a new program to control the operation system, making it even easier to build the operation system.
[0046] In the information providing device of the present disclosure, the structure may include one or more of the work robot, the supply device, the transport device, the imaging device, the end effector that performs processing on the workpiece, and their parts. With this information providing device, the processing state, etc. of each of the above structures can be confirmed in a virtual space.
[0047] In the information providing device of the present disclosure, the information on the structure may include one or more of shape data, structural condition data, and material data. In this information providing device, by defining the shape, structural condition, and material, a structure corresponding to the content of the data can be realized in a virtual space.
[0048] In the information providing device of the present disclosure, the processing model may include one or more of a moving process, a collecting process, a placing process, a direction changing process, an embedding process, an imaging process, and an image processing using the work. In this information providing device, these processes can be confirmed in a virtual space.
[0049] The information providing method of the present disclosure includes: 1. An information providing method used in a work system including a work robot that performs a predetermined work on a workpiece, comprising: an operating program exists which registers and holds information on two or more structures related to the work robot and information on one or more processing models related to the structures, and which realizes the operation of the work system in a virtual space using the information on the structures and the information on the processing models related to the structures; (a) acquiring selection information which selects the information on two or more structures and the processing models related to the structures; (b) reading out information on the structure and information on the processing model included in the selection information, and implementing processing of the processing model in a virtual space with two or more of the structures connected by the operation program; (c) outputting the realized processing result; It includes.
[0050] In this information providing method, similarly to the above-mentioned information providing device, a customer or a worker who is a manufacturer can check in a virtual space how a process will be executed when a plurality of structures are combined based on the output processing result without actually constructing a work system. Therefore, this information providing device can more easily realize the construction of a work system. Note that this information providing method may employ the aspects of the above-mentioned information providing device, or may include a step of realizing the functions of the above-mentioned information providing device.
[0051] Alternatively, the information providing method of the present disclosure includes: 1. An information providing method used in a work system including a work robot that performs a predetermined work on a workpiece, comprising: an operating program exists which registers and holds information on two or more structures related to the work robot and information on one or more processing models related to the structures, and which realizes the operation of the work system in a virtual space using the information on the structures and the information on the processing models related to the structures; (a) acquiring selection information which selects the information on two or more structures and the processing models related to the structures; (b) constructing the operation system in the virtual space by combining the selected structures and processing models; (c) operating the constructed operation system in the virtual space by the operation program, and determining whether the operation by the operation system has been normally executed; (d) outputting the result of the determination; It may also include.
[0052] In this information provision method, similarly to the above-mentioned information provision device, the construction of the work system can be more easily realized by using the determination result of whether the work system in the virtual space is normally executed. Note that, in this information provision method, the aspect of the above-mentioned information provision device may be adopted, or the information provision method may include a step of realizing the function of the above-mentioned information provision device.
[0053] The program of the present disclosure is one or more computers that execute each step of the information provision method described above. This program may be recorded on a computer-readable recording medium (e.g., a hard disk, a ROM, a FD, a CD, a DVD, etc.), may be distributed from one computer to another computer via a transmission medium (a communication network such as the Internet or a LAN), or may be transmitted and received in any other form. By having one computer execute this program or having multiple computers share and execute each step, each step of the information provision method described above is executed, and the same effect as this method can be obtained. [Industrial Applicability]
[0054] The information providing device, the information providing method, and the program therefor disclosed in this specification can be used in the technical field of devices that perform a predetermined task on a workpiece. [Explanation of symbols]
[0055] 10 Ecosystem, 11 Network, 12 LAN, 13 Design PC, 15 Store, 18 Placement member, 20 Information providing device, 21 Control device, 22 CPU, 23 Memory unit, 24 Display unit, 25 Input device, 26 Communication unit, 31 Device DB, 32 Peripheral device DB, 33 Application DB, 34 Operation program, 40 Store PC, 41 Control device, 42 CPU, 43 Memory unit, 44 Display unit, 45 Input device, 46 Communication unit, 50 Work system, 51 Transport device, 52 Arrangement device, 52a Control device, 53 Base, 54 Supply device, 55 Arm member, 55a First arm member, 55b Second arm member, 55c Third support unit, 56 End effector, 57 Base unit, 58 Collection member, 59 Imaging device, 60 Information providing screen, 61 Cursor, 62 Purpose input field, 63 Device input field, 64 Peripheral device input field, 65 Application input field, 66 Work input field, 67 Image display field, 68 Specification output key, 69 Virtual processing execution key, 70 Processing condition input key, 71 Cancel key, 72 Processing condition input screen, 73 Processing list input field, 74 Operation condition list input field, 75 Confirm key, W work.
Claims
1. An information providing device used in a work system including a work robot that performs a predetermined work on a workpiece, a storage unit that stores device structure data including connection part data including at least one piece of information regarding the size, position, and size of a connection part of each of a plurality of devices used in the operation system; a device input field for selecting and inputting a device to be used in the operation system, and a display unit for displaying, when a plurality of devices are selected in the device input field, a state in which the selected plurality of devices are connected to each other at connection sites based on the connection site data, as an operation system; The display unit displays other devices that can be connected to the selected device in a selectable manner based on the connection site data of the selected device.
2. The information providing device according to claim 1 , wherein the display unit displays the operation system as a moving image in a virtual space when the processing conditions for the selected plurality of devices are correctly selected or input.
3. 3. The information providing device according to claim 2, wherein the processing conditions include a processing model executed by an operation program and target coordinates in a movement process.
Citation Information
Patent Citations
Virtual plant simulation device and its method
JP2000081906A
Robot programming device for palletizing operation by robot
JP2009070078A
Manufacturing system construction method
JP2012056002A
Robot simulation device, program, recording medium and method
JP2015100866A
Simulation device, simulation method and recording media for recording computer program, for simulating robot system operation
JP2018069367A