Information processing device, information processing method, method for controlling robot system, robot system, method for manufacturing articles, program, and recording media
The information processing device addresses the challenge of maintaining specific parameters in processing flows by using a reflection process within a programming support system, ensuring efficient and automated updates of templates and duplicate jobs.
Patent Information
- Application Number
- JP2023073768
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-27
- Publication Date
- 2024-11-08
AI Technical Summary
Existing information processing devices struggle to maintain specific parameters when updating processing flows copied from templates, as they often require manual re-setting of these parameters after reflecting changes in the template.
An information processing device and method that allows for the creation of processing flows based on templates, with a reflection process that maintains or updates specific parameters by setting information to be reflected or not reflected, using a programming support system to manage and update templates and duplicate jobs.
Ensures that arbitrary information in processing flows created from templates is maintained, reducing the need for manual re-setting of parameters and improving user efficiency by automating the reflection and update process.
Smart Images

Figure 2024158512000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, an information processing method, a robot system control method, a robot system, an article manufacturing method, a program, and a recording medium. [Background technology]
[0002] In order to detect the position of a part, it is common to use images acquired by a camera or a sensor and perform image processing. When a processing flowchart (processing flow) for detecting the position of one part is created, the processing flow can be duplicated as a template to create a processing flow capable of detecting the positions of other parts. A technology has been disclosed that changes information included in a template and reflects the changed contents in a processing flow that includes the template (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2009-164972 A Summary of the Invention [Problem to be solved by the invention]
[0004] The information processing device described in Patent Document 1 is configured to reflect template information regardless of information set in a process flow including the template. However, depending on the process flow copied from the template, specific information such as parameters specific to the process task of the process flow may be set. In such a case, it is required to maintain the specific information even when reflecting the change in the template in the process flow copied from the template.
[0005] Therefore, an object of the present invention is to provide a technique that can maintain any information contained in a process flow created from a template when reflecting at least a portion of the information of the template in the process flow created from the template. [Means for solving the problem]
[0006] A first aspect of the present invention is an information processing device characterized by executing a creation process that creates a processing flow based on a template, a reflection process that can reflect at least a part of information of the template in the processing flow when at least one of the template and the processing flow is updated, and a setting process that sets information to be reflected in the reflection process and information that is not to be reflected in the reflection process in the template.
[0007] Moreover, a second aspect of the present invention is an information processing method comprising: executing a creation process for creating a processing flow based on a template; a reflection process capable of reflecting at least a part of information of the template in the processing flow when at least one of the template and the processing flow is updated; and a setting process for setting information to be reflected in the reflection process and information not to be reflected in the reflection process in the template. Effect of the Invention
[0008] According to the present invention, when at least a portion of the information of the template is reflected in a process flow created from the template, any information contained in the process flow created from the template can be maintained. [Brief description of the drawings]
[0009] [Figure 1] 1A and 1B are a schematic diagram of a robot system according to an embodiment of the present invention and a control block diagram of an information processing device. [Diagram 2] 1 is a schematic diagram of a programming support system according to an embodiment of the present invention. [Diagram 3]FIG. 2 is a diagram showing a main screen of the programming support system according to the embodiment of the present invention. [Figure 4] FIG. 13 is a diagram showing a flowchart setting screen according to the embodiment of the present invention. [Diagram 5] FIG. 11 is a diagram showing a processing flow of a template job according to the embodiment of the present invention. [Figure 6] FIG. 4 is a diagram showing a JOB setting screen according to the embodiment of the present invention. [Figure 7] 11A and 11B are diagrams illustrating how a template JOB is reflected in a duplicate JOB according to an embodiment of the present invention. [Figure 8] FIG. 13 is a diagram showing a template JOB setting screen according to the embodiment of the present invention. [Figure 9] 1A to 1C are diagrams illustrating a template JOB, a duplicated JOB, and the duplicated JOB after reflection according to an embodiment of the present invention. [Figure 10] FIG. 13 is a diagram showing a template development screen according to the embodiment of the present invention. [Figure 11] 10 is a flowchart showing a reflection process executed by the information processing apparatus according to the embodiment of the present invention. [Figure 12] 11 is a flowchart showing a reflection process executed by an information processing apparatus according to an embodiment of the present invention, the reflection process including a process of deleting a processing task that only a child JOB has. [Figure 13] FIG. 13 is a diagram showing a job maintenance information setting screen according to a modified example of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, the embodiment of the present invention will be described in detail with reference to the drawings. Note that the configuration shown below is merely an example, and the details of the configuration can be appropriately changed by those skilled in the art without departing from the spirit of the invention. Also, the numerical values used in the following description are for reference only and are merely examples.
[0011] <Robot system configuration> 1 is a diagram showing a schematic diagram of a robot system 1, which is an example of a system according to this embodiment, and a control block diagram of an information processing device 100. The robot system 1 includes the information processing device 100 and a plurality of FA devices used for automatic production. The robot system 1 is used, for example, in the manufacture of an article.
[0012] The robot system 1 includes, as FA devices, for example, a programmable logic controller (PLC) 110, a camera 111, a suction hand 112, a sensor device 113, a robot 114, and an image processing device 115. The robot system 1 also includes a camera controller 121, a hand controller 122, a sensor controller 123, and a robot controller 124.
[0013] The robot 114 is, for example, an industrial robot arm. The suction hand 112 is an example of an end effector, and is attached to the robot 114. The suction hand 112 is configured to be able to hold a workpiece. The sensor device 113 is built into the suction hand 112. The camera 111 is an example of an imaging device, and is used to capture an image of, for example, a workpiece or a component.
[0014] The PLC 110 comprehensively controls various controllers, such as a camera controller 121 , a hand controller 122 , a sensor controller 123 , and a robot controller 124 , as well as an image processing device 115 .
[0015] The camera controller 121 is a controller that controls the camera 111. The hand controller 122 is a controller that controls the suction hand 112. The sensor controller 123 is a controller that controls the sensor device 113. The robot controller 124 is a controller that controls the robot 114. The image processing device 115 is composed of a computer.
[0016] The PLC 110, the camera controller 121, the hand controller 122, the sensor controller 123, the robot controller 124, and the image processing device 115 are each connected to the information processing device 100 by a connection method conforming to a predetermined standard.
[0017] As a case where an article is manufactured using the robot system 1 configured as above, for example, a case where control is executed for the robot 114 to pick up a part, which is a workpiece, will be described.
[0018] The camera controller 121 causes the camera 111 to capture an image of a component, which is a workpiece, and outputs the captured image to the image processing device 115. The image processing device 115 obtains position information of the component from the captured image. The robot controller 124 acquires the position information of the component from the image processing device 115 and moves the robot 114 to the position of the component. The hand controller 122 operates the suction hand 112 to cause the suction hand 112 to hold the component. At that time, the sensor controller 123 determines whether the suction hand 112 has held the component, based on the sensing result of the sensor device 113.
[0019] The information processing device 100 is configured with a computer. The information processing device 100 includes a CPU (Central Processing Unit) 151, which is an example of a processor. The CPU 151 functions as an information processing unit by executing a program 161. The information processing device 100 also includes a ROM (Read Only Memory) 152, a RAM (Random Access Memory) 153, and an SSD (Solid State Drive) 154 as storage units. The information processing device 100 also includes an I / O 155, which is an input / output interface. The information processing device 100 also includes a display 156, which is an example of a display unit, and a keyboard 158 and a mouse 157, which are examples of an input unit. The CPU 151, the ROM 152, the RAM 153, the SSD 154, the I / O 155, the display 156, the keyboard 158, and the mouse 157 are connected to each other via a bus so as to be able to perform data communication with each other.
[0020] The ROM 152 stores a basic program related to the operation of the computer. The RAM 153 is a storage device that temporarily stores various data such as the results of the calculation processing of the CPU 151. The SSD 154 records the results of the calculation processing of the CPU 151 and various data acquired from the outside, and also records a program 161 for causing the CPU 151 to execute various processes. The program 161 is application software that can be executed by the CPU 151.
[0021] The I / O 155 is an interface with external devices. In addition, a removable memory 162 such as a recording disk or a storage device can be connected to the I / O 155. The I / O 155 can read various data, programs, and the like recorded in the removable memory 162.
[0022] The information processing device 100 includes an SSD 154 as a storage device, but is not limited to this. The storage device included in the information processing device 100 may be, for example, a hard disc drive (HDD).
[0023] In this embodiment, the SSD 154 is provided as a non-transient recording medium readable by a computer, and the program 161 is recorded in the SSD 154, but this is not limiting. The program 161 may be recorded in any recording medium as long as it is a non-transient recording medium readable by a computer. As a recording medium for supplying the program 161 to a computer, a removable memory 162, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a magnetic tape, a non-volatile memory, etc. can be used.
[0024] In this embodiment, the information processing device 100 is used by a user, for example an end user, to program system control of the robot system 1.
[0025] <Programming support system configuration> 2 is a schematic diagram showing a programming support system 10 executed in an information processing device 100 according to an embodiment of the present invention. A CPU 151 of the information processing device 100 is configured to be able to execute the programming support system 10. The processing executed in the programming support system 10 based on a user input is executed by the CPU 151 of the information processing device 100.
[0026] The programming support system 10 allows an end user to easily control the system of an information processing device 100. In the programming support system 10, a process flowchart (hereinafter also referred to as a "process flow") can be arbitrarily constructed on a GUI basis by executing a process flowchart program 101. In the process flowchart program 101, a process flow is created by arbitrarily combining tasks selected by the end user from process tasks 103 in a flowchart format.
[0027] The processing task 103 has a function of controlling various FA devices 107. Here, examples are given in which a PLC 110, a camera 111, a suction hand 112, a sensor device 113, and a robot 114 as a robot manipulator are connected as the FA devices 107, but any device that can receive communication commands from the outside can be connected. Specifically, it may be a conveyor, a linear actuator, an air cylinder, or a device capable of three-dimensional distance measurement.
[0028] Moreover, the FA device 107 is usually controlled through a dedicated software development kit (SDK) 106 for control. For this reason, the processing task 103 converts a control command in a conversion unit 104, and exchanges control command data with the SDK 106 via a communication management unit 105 to control the FA device 107.
[0029] Data is exchanged between tasks via the data conversion unit 102. Here, the sensor device 113 has a CC-Link (registered trademark) interface in the communication management unit 105, but this may be an IO interface or another field bus. Also, the sensor device 113 can be directly connected to the programming support system 10, but may also be connected to the programming support system 10 via the PLC 110, for example.
[0030] 2, PLC control, camera control, hand control, sensor control, robot control, image processing, and AI control tasks are given as examples of the processing task 103, but are not limited to these. The processing task 103 may be a processing task for other FA devices, a task for performing arithmetic operations, logical operations, and matrix operations, a task for acquiring environmental information of a computer, a task for saving images and various data in a log, and the like.
[0031] <Configuration of the main screen of the programming support system> 3 shows a main screen 300 of the programming support system 10. On the main screen 300, a list display section 301, a flowchart setting screen button 302, a template setting screen button 303, a JOB setting button 304, and a JOB selection field 320 are displayed.
[0032] Here, a JOB is a compilation of a process flow created by a user and information required for control using the process flow (e.g., variables that hold parameters and models for detecting the positions of parts). By managing JOBs, the programming support system 10 can separately manage the information required for each part to be detected, making it possible to manage processes suited to various situations. Note that, in the programming support system 10, since the process flow itself may contain information such as variables, a JOB and a process flow may be considered to be the same concept.
[0033] On the main screen 300, by selecting a job selection field 320, a list of jobs created by the user is displayed in a combo box or the like. On the main screen 300, by selecting a job from the job selection field 320, the processing flow of the selected job is displayed in the list display section 301. On the main screen 300, by selecting a job from the job selection field 320 and selecting the flowchart setting screen button 302, the screen transitions to a flowchart setting screen 400 (see FIG. 4) in which various settings of the processing flow of the selected job can be made. On the main screen 300, by selecting a job from the job selection field 320 and selecting the template setting screen button 303, the screen transitions to a template job setting screen 900 (see FIG. 8) in which settings of the job to be a template can be made.
[0034] List display section 301 displays, in a list format, information on processing tasks belonging to a processing flow arbitrarily created by the user in the JOB selected in JOB selection field 320. For example, camera control task display section 310, which displays a processing task (camera control task) for controlling camera 111, displays camera control task screen confirmation section 311, which displays a captured image acquired by camera 111, and task name display section 312, which displays the task name. Camera control task display section 310 also displays processing time display section 313, which displays the time required to process the camera control task.
[0035] An image processing task display section 314 that displays a processing task (image processing task) that controls the image processing device 115 displays an image processing task screen confirmation section 315 that displays the result of determining part position information from the captured image acquired by the camera 111. The image processing task screen confirmation section 315 displays the contours of detected parts and the number of detections as the result of the image processing device 115 determining the part position information from the captured image.
[0036] A robot control task display section 316 that displays the processing task (robot control task) for controlling the robot 114 displays a robot control task screen confirmation section 317 that displays the coordinates of the destination where the robot will move.
[0037] A hand control task display section 318, which displays the processing task (hand control task) for controlling the suction hand 112, displays a hand control screen confirmation section 319 which displays information such as the positional relationship between the suction hand 112 and the detected part when suction is turned on and other information.
[0038] In the programming support system 10, selecting the flowchart setting screen button 302 causes a transition from the main screen 300 to a flowchart setting screen 400 (see FIG. 4). Also, in the programming support system 10, selecting the template setting screen button 303 causes a transition from the main screen 300 to a template JOB setting screen 900 (see FIG. 9). And in the programming support system 10, selecting the JOB setting button 304 causes a transition from the main screen 300 to a JOB setting screen 600 (see FIG. 6).
[0039] <Flowchart setting screen> 4 shows a flowchart setting screen 400 which transitions from main screen 300 when flowchart setting screen button 302 displayed on main screen 300 is selected. On flowchart setting screen 400, a processing flowchart setting section 401, a parameter setting section 402, a processing result confirmation section 403, an image confirmation section 404, and a task name display section 405 are displayed.
[0040] The process flow setting unit 401 is a mechanism for creating a process flow. The user appropriately selects process tasks to be used from a process task list 450, and appropriately arranges the process tasks in the process flow setting unit 401 by dragging and dropping the process tasks. The user can freely set control branching and the like by connecting the process tasks arranged in the process flow setting unit 401 with each other or by using a conditional branch task 410.
[0041] For example, if you want to check the parameter settings or processing results of the camera control task 210, you can select the camera control task 210 on the screen, and the results will be reflected in the parameter setting section 402, processing result confirmation section 403, image confirmation section 404, and task name display section 405.
[0042] The parameter setting section 402 displays the task name displayed in the task name display section 312 (see FIG. 3) and settings according to the selected task, and allows the user to set parameters required for the selected task on a UI (User Interface). For example, when a camera control task is selected, an exposure time setting UI 420 and a gain setting UI 421 are displayed, and the user can set required parameters on the UI.
[0043] Furthermore, in the programming support system 10, a process is executed to create a parameter list, which is a list of parameters set for each process task, by arranging the process tasks in the process flow chart setting unit 401. The parameter list is referred to when referring to the parameters of a template job on a template job setting screen 900 (see FIG. 6) described later or for a job copied from the template job.
[0044] The processing result confirmation section 403 is a section where the processing result is displayed, and displays, for example, the processing time display section 313, the judgment result display section 430, and the thumbnail display section 431. The processing time display section 313 displays, for example, the time required to process a task. The judgment result display section 430 displays the judgment result for judging whether the task has been operated correctly, for example, by characters such as OK or NG. The thumbnail display section 431 displays a thumbnail of the captured image, and can also display data other than the processing result in the form of a numerical value or a character string.
[0045] On the flowchart setting screen 400, when the one cycle operation button 440 is selected, the process flow created in the process flowchart setting section 401 is operated for one cycle from start to end. Also, on the flowchart setting screen 400, when the step operation button 441 is selected, the process flow created in the process flowchart setting section 401 is operated step by step. On the flowchart setting screen 400, when the step operation button 441 is selected, the intermediate progress when the process flow is operated can be confirmed.
[0046] <Template JOB processing flow> Fig. 5 shows the processing flow of a part detection job. The processing flow can be created from the flowchart setting screen 400 shown in Fig. 4. In the processing flow of the part detection job shown in Fig. 5, a camera control task 510, a filter processing task 520, and a part detection task 530 are executed.
[0047] The camera control task 510 sends an image capture command to the camera 111 to obtain an image.
[0048] The filter processing task 520 causes the image processing device 115 to apply filter processing to the image acquired by the camera control task 510. The filter processing task 520 can, for example, process the image captured by the camera 111 into a black and white state by binarization processing, thereby highlighting the positions of parts in the image.
[0049] The part detection task 530 performs processing to detect parts from the image that has been filtered by the filtering task 520. The part detection task 530 includes processing such as performing pattern matching processing to detect the positions of parts from contour information of the image.
[0050] On the flowchart setting screen 400, by connecting the camera control task 510, the filter processing task 520, and the component detection task 530 and processing them in order, a processing flow can be created to detect the position of components from the image acquired by the camera 111.
[0051] In the programming support system 10, the JOB of the created processing flow is used as a template JOB, and while duplicating the template JOB, a JOB (duplicated JOB) with the parameters in the flowchart of the duplicated template JOB 500 changed can be created. In the programming support system 10, by creating a duplicated JOB, JOBs capable of detecting the positions of various components can be created.
[0052] In other words, the template JOB includes a processing flow as shown in FIG. 5 as processing flow information that is the basis of the processing flow of the duplicated JOB.
[0053] Thereby, the robot system 1 can easily create a duplicated JOB from the processing flow information included in the template JOB.
[0054] Below, taking the case of creating a duplicated JOB with the JOB of the processing flow shown in FIG. 5 as the template JOB 500 and changing the parameters in the flowchart of the duplicated template JOB 500 as an example, an explanation will be given.
[0055] <JOB Setting Screen> FIG. 6 shows the JOB setting screen 600. On the JOB setting screen 600, a JOB list 601, a JOB creation button 610, a duplication button 611, a deletion button 612, and an expansion button 613 are displayed.
[0056] A job list 601 displays in list form the numbers and names of jobs created by the user. When a job creation button 610 is selected on the job setting screen 600, a new job is created and added to the job list 601, and the name and number of the new job can be set. A newly created job is created with an empty processing flow, etc., and can be used by the user when creating a job from scratch.
[0057] In the JOB setting screen 600, when an existing JOB displayed in a JOB list 601 is selected, the selected existing JOB can be duplicated by selecting a duplicate button 611. The duplicated and added JOB (duplicated JOB) is added to the JOB list 601 with the name "original JOB name + -copy". The name of the duplicated JOB is not limited to the above-mentioned notation, and any specific setting method is acceptable as long as the copied state can be understood. In the example shown in FIG. 6, template JOB 500 is duplicated, and the name of the duplicated JOB is changed to duplicate JOB 700.
[0058] In the programming support system 10, jobs created from the process flow set on the flowchart setting screen 400, template jobs set in a template, and duplicate jobs created by duplicating a template job are displayed in a job list 601. In other words, in the programming support system 10, the CPU 151 of the information processing device 100 executes a process of creating the job list 601 every time various jobs including template jobs and duplicate jobs are created.
[0059] Furthermore, when creating the JOB list 601, the CPU 151 is configured to execute processing for creating a template list, which is a list of template JOBs, and a process flow list, which is a list of duplicated JOBs.
[0060] In the programming support system 10, by duplicating a template JOB by using a duplication method using the duplication button 611 on the JOB setting screen 600, it is possible to easily create JOBs corresponding to various works.
[0061] In other words, the programming support system 10 is configured so that, when the copy button 611 is selected on the job setting screen 600, a copy job is created based on the template job.
[0062] This process in which CPU 151 of information processing apparatus 100 creates a job by duplicating a process flow included in the template job as a process flow based on the template job constitutes a creation process.
[0063] The delete button 612 is a button for deleting a job that has already been created. On the job setting screen 600, a job is selected from the job list 601, and the delete button 612 is selected, whereby the selected job is deleted.
[0064] When the develop button 613 is selected, the screen transitions from the JOB setting screen 600 to a template development screen 1000 (see FIG. 10) which reflects the created template JOB in an existing JOB. The template development screen 1000 will be described in detail later.
[0065] <Configuration for reflecting changes made to a template JOB in a duplicate JOB> Fig. 7 is a diagram showing how parameters are changed for a template JOB 500 and a duplicate JOB 700 obtained by duplicating the template JOB 500. In the example shown in Fig. 7, a parameter for exposure time that sets the time for which the image sensor of the camera 111 is exposed is set in the camera control task 510 as a parameter when the camera 111 captures an image to obtain the image. Also, a parameter for gain that sets the amount of amplification when the light received by the image sensor is converted into an electrical signal is set in the camera control task 510.
[0066] The filter processing task 520 has set therein the parameters used when performing binarization processing on the captured image: a minimum gray threshold that sets the minimum value of a pixel to be converted to white, and a maximum gray threshold that sets the maximum value of a pixel to be converted to white.
[0067] In part detection task 530, a score threshold parameter is set as a parameter for evaluating the similarity between a predefined template image and an image that has been subjected to filtering in part detection by pattern matching processing. In addition, in part detection task 530, a matching accuracy parameter is set as a parameter for setting the accuracy of part detection in pattern matching processing.
[0068] In template JOB 500, the parameters of the camera control task 510, namely, the exposure time, are changed from 10 to 500, and the gain, from 0 to 30. In addition, in template JOB 500, the parameters of the filter processing task 520, namely, the minimum gray threshold, are changed from 0 to 10, and the maximum gray threshold, from 100 to 127. In template JOB 500, the parameters of the part detection task 530, namely, the score threshold, are changed from 70 to 80, and the matching accuracy, from 0.6 to 0.7.
[0069] The duplicated JOB 700 is a JOB created by duplicating the template JOB 500, and therefore has the same types and execution order of the processing tasks constituting the processing flow, and the same types of parameters set for each processing task. Specifically, in the duplicated JOB 700, the processing tasks are executed in the order of a camera control task 710, a filter processing task 720, and a part detection task 730.
[0070] The camera control task 710, similar to the camera control task 510, is a processing task that sends an image capture command to the camera 111 and acquires an image. The filter processing task 720, similar to the filter processing task 520, is a processing task that causes the image processing device 115 to apply filter processing to the image acquired by the camera control task 710. The part detection task 730, similar to the part detection task 530, is a processing task that performs processing to detect parts on the image filtered by the filter processing task 720.
[0071] In the duplicated JOB 700, the parameters of the camera control task 710, that is, the exposure time, are changed from 10 to 250, and the gain is changed from 0 to 10. Furthermore, in the duplicated JOB 700, the parameters of the filter processing task 720 are not changed. Furthermore, in the duplicated JOB 700, the parameters of the part detection task 730, that is, the score threshold, are changed from 70 to 72, and the matching accuracy is changed from 0.6 to 0.9.
[0072] Due to these changes, there are differences in the parameter values of the processing tasks of the template JOB 500 and the duplicated JOB 700 obtained by duplicating the template JOB 500.
[0073] The programming support system 10 is configured so that parameter information of each processing task changed in the template JOB 500 can be reflected in the duplicated JOB 700. In the following explanation, the template JOB 500 which reflects the changes is referred to as the parent, the duplicated JOB 700 which has the changes reflected is referred to as the child, and the duplicated JOB after the reflection which reflects the changes of the parent while maintaining the child information is referred to as the duplicated JOB 800 (see FIG. 9).
[0074] 8 shows a template job setting screen 900 to which the user transitions from the main screen 300 when the template setting screen button 303 is selected after a job is selected in the job selection field 320 on the main screen 300. On the template job setting screen 900, the user can set parameters that the user wants to maintain from among the parameters set in the child jobs for the template job that the user has created.
[0075] The template job setting screen 900 displays a flowchart tab 901 that displays processing tasks included in the processing flow of the template job on the template job setting screen 900. The template job setting screen 900 also displays a local variable tab 902 that displays information on local variables such as numeric variables and image variables other than the parameters set in the processing flow of the template job. The template job setting screen 900 is initially displayed with the flowchart tab 901 selected.
[0076] On the template JOB setting screen 900, when the Flowchart tab 901 is selected, information on processing tasks and information on parameters set for the processing tasks can be displayed in a list based on information on the processing flow of a pre-selected JOB.
[0077] Fig. 8 shows an example of a state in which template JOB 500 created in Fig. 5 has been selected, and for example, for camera control task 510 of template JOB 500, the task number and name are displayed like camera control task 910. Furthermore, filter processing task 520 of template JOB 500 is displayed on template JOB setting screen 900 like filter processing task 920, and part detection task 530 is displayed on template JOB setting screen 900 like part detection task 930.
[0078] Each processing task is provided with a + button and a - button, and by selecting the + button, a parameter list, which is a list of parameters set in each processing task, is linked and displayed. For example, camera control parameter list 911 is linked and displayed in camera control task 910. Furthermore, by selecting the - button provided in each processing task, the displayed parameter list is hidden.
[0079] By allowing the selection of whether to display or not display the parameter list, the programming support system 10 can prevent all parameter lists from being displayed, thereby preventing the template JOB setting screen 900 from becoming cluttered.
[0080] The template job setting screen 900 may be configured to have a button for simultaneously displaying the parameter lists of all processing tasks, and a button for simultaneously hiding the parameter lists of all processing tasks.
[0081] Camera control parameter list 911 displays a list of parameters owned by camera control task 910. Camera control parameter list 911 displays an exposure time parameter, a gain parameter, and a Next unit number parameter indicating the task number of the processing task to be executed next after camera control task 510. In template JOB 500, filter processing task 520 set to task number 02 is executed next after camera control task 510 set to task number 01, so "02" is set as the Next unit number parameter.
[0082] The filter processing parameter list 921 displays a list of parameters owned by the filter processing task 920. The filter processing parameter list 921 displays a minimum gray threshold parameter, a maximum gray threshold parameter, and a Next unit number parameter indicating the task number of the processing task to be executed next after the filter processing task 520. In the template JOB 500, the part detection task 530 set to task number 03 is executed next after the filter processing task 520 set to task number 02, so "03" is set as the Next unit number parameter.
[0083] Part detection parameter list 931 displays a list of parameters owned by part detection task 930. Part detection parameter list 931 displays a score threshold parameter, a matching accuracy parameter, and a Next unit number parameter indicating the task number of the processing task to be executed next after part detection task 530. In template JOB 500, the processing flow ends when part detection task 530 set to task number 03 is executed. For this reason, the Next unit number parameter in part detection parameter list 931 is set to "- ", which indicates that there is no processing task to be executed following part detection task 530.
[0084] Each parameter is provided with a check box 912, 922, or 932. When the programming support system 10 reflects the information of a parent template JOB in a child JOB, the information of the parameters of the child JOB corresponding to the parameters with the check boxes 912, 922, or 932 checked is maintained.
[0085] 8, check boxes 912 for the exposure time parameter in camera control parameter list 911 and check boxes 932 for the matching accuracy parameter in part detection parameter list 931 are checked. As a result, in the programming support system 10, when the information of template JOB 500 is reflected in duplicated JOB 700, the parameter information set in duplicated JOB 700 is maintained for the exposure time parameter and the matching accuracy parameter.
[0086] The task list in which the processing tasks displayed on the template JOB setting screen 900 are listed, and the parameter list constitute an information list having information set in the template.
[0087] When the local variables tab 902 is selected on the template job setting screen 900, information on local variables can be displayed in a list. Local variables can include all variables that a job can possess, such as numerical variables and image variables other than parameters set in the process flow of the template job, decision variables indicating true or false, and model variable information when detecting parts.
[0088] When the local variable information of a parent template JOB is reflected in other child JOBs, the local variable information of the child JOB that corresponds to the local variable information with a checked check box is maintained.
[0089] On the template JOB setting screen 900, a template JOB can be saved as a template by selecting a template creation button 903. As a result, the settings of the information to be maintained among the child JOB information are saved in the parent template JOB set on the template JOB setting screen 900 when the information is reflected in other child JOBs.
[0090] In the template JOB setting screen 900, when saving as a template, information such as the template name, template version, date, creator, comments, etc., as shown in template information 950, can be saved. The template name, date, creator, and comments can be set arbitrarily by the user. Meanwhile, the template version is incremented each time a template is saved, with a larger number indicating a newer version. In the template JOB setting screen 900, a template that holds the template information 950 is created by selecting a template creation button 903 after setting the template information 950.
[0091] In this manner, when saving a job as a template on the template job setting screen 900, the robot system 1 sets information such as the version, date, creator, and comments of the template.
[0092] With this configuration, the robot system 1 can easily manage templates based on information such as the version, date, creator, and comments of the template that are set when the template is saved.
[0093] Moreover, the robot system 1 is configured to update the version of the template by incrementing the version of the template every time it is saved as a template.
[0094] With this configuration, the robot system 1 can easily identify whether the template is of an updated new version when reflecting the template in a child JOB by updating the version information of the template.
[0095] This template information 950 constitutes management information for managing the templates. Furthermore, when saving as a template, a process in which CPU 151 of information processing device 100 sets template information 950 constitutes a process in which management information for managing the template is set in the template. Furthermore, a process in which the version of the template is updated when saving as a template constitutes a process in which CPU 151 of information processing device 100 updates the management information of the template.
[0096] As described above, the template JOB setting screen 900 is configured to transition from the main screen 300 when a JOB is selected in the JOB selection field 320 of the main screen 300 and then the template setting screen button 303 is selected. In the programming support system 10, a template is created by operating the template JOB setting screen 900. In the programming support system 10, a parameter that is not to be reflected in a child JOB can be set by checking a check box provided for each parameter of the parent template JOB.
[0097] In other words, the programming support system 10 is configured to be able to set parameters to be reflected in the child JOB and parameters not to be reflected in the child JOB before creating the child JOB by duplicating the parent template JOB.
[0098] With this configuration, when it is known in advance that a specific parameter set in a child JOB should have priority, the robot system 1 can set the parameters of the parent template JOB not to be reflected before creating the child JOB. This eliminates the need for the robot system 1 to edit the parent template JOB again after creating the child JOB and set parameters that are not to be reflected in the child JOB, improving the work efficiency of the user when reflecting the parent template JOB.
[0099] Furthermore, in the programming support system 10, a parameter list of the parent template JOB is displayed on the template JOB setting screen 900, and a check box is provided for each parameter displayed in the parameter list. In the programming support system 10, a parameter that is not to be reflected in the child JOB can be set by checking the check box. In other words, the programming support system 10 is configured to be able to set parameters that are to be reflected in the child JOB and parameters that are not to be reflected in the child JOB based on the parameter list.
[0100] With this configuration, the robot system 1 can refer to a parameter list that allows easy identification of parameter types and perform settings so that the parameters of a parent template JOB are not reflected in the parameters of a child JOB.
[0101] The process in which the CPU 151 of the information processing device 100 sets the parameters to be reflected from the parent template JOB to the child JOB and the parameters not to be reflected to the child JOB depending on whether or not the check box is checked constitutes the setting process.
[0102] Fig. 9 is a diagram showing a duplicated JOB 800 after reflecting the changes of the template JOB 500 in the duplicated JOB 700 while maintaining the information required for the duplicated JOB 700. In the example shown in Fig. 9, the exposure time, which is a parameter of the camera control task 710 in the child duplicated JOB 700, and the matching accuracy, which is a parameter of the part detection task 730, are the information to be maintained in the child duplicated JOB 700. The parameter of the child duplicated JOB 700 to be maintained can be set by checking the check box of the parameter in the parameter list corresponding to the parameter of the child duplicated JOB 700 to be maintained on the template JOB setting screen 900 shown in Fig. 8.
[0103] In other words, the parameters of the child duplicated JOB 700 that you want to maintain can be explicitly indicated by checking a check box in the parameter list corresponding to the parameter of the child duplicated JOB 700 that you want to maintain on the template JOB setting screen 900. Also, by not checking a check box in the parameter list on the template JOB setting screen 900, you can explicitly indicate that you do not want to maintain the parameter in the child duplicated JOB 700 for that parameter.
[0104] When a change in a parent template JOB is reflected in a child duplicate JOB, the information explicitly indicating that the change is to be maintained in the child duplicate JOB is maintained while the change is reflected. In the example shown in Fig. 9, it is explicitly stated that the exposure time of the camera control task 510 of the parent template JOB 500 is to be maintained as information of the camera control task 710 of the child duplicate JOB 700. For this reason, the programming support system 10 maintains the information of the exposure time of the child camera control task 710, that is, reflects the information of the exposure time of the child camera control task 710 in the camera control task 810 of the duplicate JOB 800 after reflection.
[0105] 9, it is explicitly stated that the matching accuracy of the component detection task 530 of the parent template JOB 500 maintains the information of the component detection task 730 of the child duplicated JOB 700. For this reason, the programming support system 10 maintains the information of the matching accuracy of the child component detection task 730, that is, reflects the information of the matching accuracy of the child component detection task 730 in the component detection task 830 of the duplicated JOB 800 after reflection.
[0106] On the other hand, information that explicitly indicates that the change in the child duplicated JOB is not maintained reflects the change in the parent template JOB as is. In the example shown in Fig. 9, it is explicitly stated that the gain of the camera control task 510 in the parent template JOB 500 is not to maintain the information of the camera control task 710 in the child duplicated JOB 700. For this reason, in the programming support system 10, the gain information of the camera control task 510 in the parent template JOB 500 is reflected in the camera control task 810 in the duplicated JOB 800 after reflection.
[0107] Similarly, it is explicitly stated that the score threshold of the component detection task 530 of the parent template JOB 500 does not maintain the information of the component detection task 730 of the child duplicated JOB 700. For this reason, in the programming support system 10, the score threshold information of the component detection task 530 of the parent template JOB 500 is reflected in the component detection task 830 of the duplicated JOB 800 after reflection.
[0108] Also, it is explicitly stated that the minimum and maximum gray thresholds, which are parameters of the filter processing task 520 of the parent template JOB 500, do not maintain the information of the filter processing task 720 of the child duplicated JOB 700. For this reason, in the programming support system 10, the information of the minimum and maximum gray thresholds of the filter processing task 520 of the parent template JOB 500 is reflected in the filter processing task 820 of the duplicated JOB 800 after reflection.
[0109] In FIG. 9, a solid line indicates a case where information of the child duplicated JOB 700 is maintained and reflected in the post-reflection duplicated JOB 800, and a dotted line indicates a case where information of the parent template JOB 500 is reflected in the post-reflection duplicated JOB 800.
[0110] In Fig. 9, the relationship between the parent template JOB and the child duplicate JOB is shown as one-to-one for the sake of simplicity, but there may be multiple child duplicate JOBs for a parent template JOB. When there are multiple child duplicate JOBs, the same process is repeated for each child duplicate JOB. As a result, in the programming support system 10, even when the relationship between the parent template JOB and the child duplicate JOB is one-to-multiple, the changes in the parent template JOB can be reflected in the child duplicate JOB while maintaining the information that is specified to be maintained in the child duplicate JOB.
[0111] 10 shows a template expansion screen 1000 which is transitioned to from the JOB setting screen 600 when the expansion button 613 on the JOB setting screen 600 is selected. On the template expansion screen 1000, a process for reflecting a created template in an existing JOB can be executed. On the template expansion screen 1000, a template selection screen 1010 and a JOB selection screen 1040 are displayed.
[0112] Template selection screen 1010 is a screen for selecting a template to be reflected, and a template created by the user is selected in template selection unit 1020. Template selection unit 1020 is configured to display the list of templates in a combo box or the like by acquiring a list of templates from a template list, and to enable template selection.
[0113] This process of selecting a template based on a user operation on the template selection screen 1010 constitutes a process in which the CPU 151 of the information processing apparatus 100 selects a template to be reflected in a child JOB from the template list.
[0114] On the template selection screen 1010, by selecting a template in the template selection section 1020, information about the selected template is displayed in the template information display section 1030. The information displayed in the template information display section 1030 is information such as the template name, template version, date, creator, and comments indicated in the template information 950 held at the time the template was created.
[0115] In the programming support system 10, the template information 950 displayed in the template information display section 1030 can inform the user of what the selected template is like.
[0116] With this configuration, the robot system 1 can allow the user to easily recognize whether the selected template is the template desired by the user.
[0117] This process of displaying the template information 950 by the template information display unit 1030 constitutes a process in which the CPU 151 notifies the user of the management information of the template selected in the template selection process.
[0118] On the JOB selection screen 1040, the JOBs created by the user are displayed in a list, and it is possible to select a child JOB to be reflected from the parent template JOB selected on the template selection screen 1010. The JOB can be selected by using the check boxes in the selection field, and multiple JOBs can be selected.
[0119] In addition to the job number and job name, the latest information on the template reflected in the job is displayed on the job selection screen 1040. The template information displayed includes the template name, template version, date, creator, comment information, etc., shown in the template information 950.
[0120] With this configuration, the robot system 1 can allow the user to easily recognize a child JOB that is appropriate for reflecting the selected template, based on the template information.
[0121] This process of displaying template information 950 of the template reflected in the child JOB on the JOB selection screen 1040 constitutes a process in which the CPU 151 notifies the user of the management information of the template on which the process flow selected in the process flow selection process is based.
[0122] If the template has not been reflected, the template name is displayed as "default" and the version is displayed as "0" on the JOB selection screen 1040, such as JOB1. Also, if the JOB itself is a template, the created template information is updated as the latest template information on the JOB selection screen 1040.
[0123] Based on the template information displayed on the JOB selection screen 1040, the user can select a JOB in which to reflect the template. For example, if the template name of the selected template is the same as the template name displayed on the JOB side, and the version on the template side is a larger value, this indicates that the JOB has a track record of reflecting the template in the past. Therefore, the user can infer that the selected template can be used to update the version of the JOB.
[0124] Furthermore, in the JOB selection screen 1040, when the JOB is inappropriate for reflecting the selected template, an inappropriate selection warning 1050 can be displayed to notify the user. Here, when the JOB is inappropriate for reflecting the selected template, for example, the template name of the template selected in the template selection screen 1010 is different from the template name of the JOB selected in the JOB selection screen 1040. When the JOB is inappropriate for reflecting the selected template, for example, a template for a different purpose may be used. When the JOB is inappropriate for reflecting the selected template, for example, a version of the JOB selected in the JOB selection screen 1040 is equal to or higher than the version of the template selected in the template selection screen 1010. In this case, the JOB selected in the JOB selection screen 1040 may be an already updated template.
[0125] On the JOB selection screen 1040, if the selected JOB has never had its template updated, the name and version are not checked, and the inappropriate selection warning 1050 is not displayed.
[0126] In this way, in the programming support system 10, the association between the template information of the template selected on the template selection screen 1010 and the template information of the template on which the JOB selected on the JOB selection screen 1040 is based is notified. In the programming support system 10, when it is an appropriate JOB to reflect the selected template, the inappropriate selection warning 1050 is notified to the user that the association is appropriate. Also, in the programming support system 10, when it is an inappropriate JOB to reflect the selected template, the inappropriate selection warning 1050 is displayed to notify the user that the association is inappropriate.
[0127] With this configuration, the robot system 1 allows the user to easily recognize which job should reflect the selected template.
[0128] The process of displaying this inappropriate selection warning 1050 constitutes a process in which the CPU 151 notifies the user of the relationship between the management information of the template on which the process flow selected in the process flow selection process is based and the management information of the template to be reflected.
[0129] On the template expansion screen 1000, a template can be reflected by selecting a template on the template selection screen 1010 and selecting an appropriate JOB to be reflected on the JOB selection screen 1040. In this state, by selecting a template reflection button 1001 on the template expansion screen 1000, processing is started to reflect the changes to the template selected on the template selection screen 1010 to the JOB selected on the JOB selection screen 1040.
[0130] This process of selecting a job based on a user operation on the job selection screen 1040 constitutes a process in which the CPU 151 of the information processing apparatus 100 selects, from the process flow list, a child job in which the template is to be reflected.
[0131] 11 is a flowchart showing a reflection process for reflecting information changed in a template (parent template JOB) selected on the template selection screen 1010 to a JOB (child JOB) selected on the JOB selection screen 1040. When at least one of the parent template JOB and the child JOB is updated, the CPU 151 of the information processing device 100 executes a reflection process capable of reflecting at least a part of the information of the parent template JOB to the child JOB shown in FIG.
[0132] In the following description, a case will be described in which the template JOB 500 is selected on the template selection screen 1010 and the copy JOB 700 is selected on the job selection screen 1040.
[0133] First, CPU 151 of information processing device 100 acquires (S1) a task list, which is a list of processing tasks included in a processing flow, from the processing flow of a parent template JOB selected on template selection screen 1010. In this processing, CPU 151 acquires three tasks, namely, camera control task 510, filter processing task 520, and part detection task 530, from the processing flow of template JOB 500 as a task list.
[0134] Next, the CPU 151 acquires (S2) a task list from the processing flow of the child JOB selected on the JOB selection screen 1040. In this processing, the CPU 151 acquires three tasks, a camera control task 710, a filter processing task 720, and a part detection task 730, from the processing flow of the duplicated JOB 700 as a task list.
[0135] Next, CPU 151 starts repetitive processing based on the task list in which the processing from steps S3 to S12 is repeated the number of times equal to the number of processing tasks included in the task list of the parent template JOB selected on template selection screen 1010 (S3). CPU 151 executes the processing from steps S3 to S12 three times because template JOB 500 has three task lists. CPU 151 executes the processing from steps S3 to S12 in order from the processing task with the JOB number set to the smallest value in the task list.
[0136] CPU 151 executes the processes from steps S3 to S12 for camera control task 510, to which JOB number 01 is set in template JOB 500. After executing the processes from steps S3 to S12 for camera control task 510, CPU 151 executes the processes from steps S3 to S12 for filter processing task 520, to which JOB number 02 is set. After executing the processes from steps S3 to S12 for filter processing task 520, CPU 151 executes the processes from steps S3 to S12 for part detection task 530, to which JOB number 03 is set.
[0137] Next, CPU 151 acquires a processing task of a child JOB in which the same task number as the task number of the processing task targeted in the processing of step S3 is set (S4). In this processing, CPU 151 performs the processing to match information of the processing task set as the target among the processing tasks of the parent template JOB with information of the processing task of the child JOB. When the camera control task 510 of the template JOB 500 is set as the target in the processing of step S3, CPU 151 acquires camera control task 710 in the duplicated JOB 700 in which JOB number 01 is set. In the processing of step S4, CPU 151 may be configured to determine whether or not the task name of the processing task of the parent template JOB matches the task name of the processing task of the child JOB.
[0138] Next, CPU 151 determines whether or not the processing task of the child JOB has been acquired in the processing of step S4 (S5). In this processing, if CPU 151 determines that the processing task of the child JOB has been acquired (Yes), the processing proceeds to step S6, and if CPU 151 determines that the processing task of the child JOB has not been acquired (No), the processing proceeds to step S11.
[0139] In the process of step S6, CPU 151 performs parameter-based repetitive processing in which the processes of steps S6 to S10 are repeated the number of times equal to the number of parameters included in the parameter list of the processing task targeted in the process of step S3 (S6). As shown in camera control parameter list 911 in Fig. 8, the parameter list of camera control task 510 includes three parameters, so CPU 151 performs the processes of steps S6 to S10 three times. CPU 151 performs the processes of steps S6 to S10 in order from the parameter with the smallest parameter number set as the parameter number in the parameter list.
[0140] CPU 151 executes the processes from steps S6 to S10 starting from the exposure time for which parameter number 01 is set in the parameter list of camera control task 510. After executing the processes from steps S6 to S10 for the exposure time, CPU 151 executes the processes from steps S6 to S10 for the gain for which parameter number 02 is set. After executing the processes from steps S6 to S10 for the gain, CPU 151 executes the processes from steps S6 to S10 for the Next unit number for which parameter number 03 is set.
[0141] Next, CPU 151 determines whether or not the parameters targeted in the process of step S6 are set to maintain the parameters of the child JOB (S7). In this process, CPU 151 determines whether or not a check box provided for each parameter in the parameter list of the processing task of the parent template JOB is checked. If it is determined in the process of step S7 that the parameters of the child JOB are set to maintain (Yes), CPU 151 proceeds to the process of step S8. Also, if it is determined in the process of step S7 that the parameters of the child JOB are set not to maintain (No), CPU 151 proceeds to the process of step S9.
[0142] In the process of step S8, the CPU 151 maintains the parameter information in the processing task of the child JOB, and does not make any changes based on the reflection of the parent template JOB (S8).
[0143] In the process of step S9, since the CPU 151 does not maintain information on parameters in the processing task of the child JOB, the parameters targeted in the process of step S6 are reflected in the parameters of the child JOB (S9).
[0144] After executing the processes of steps S8 and S9, CPU 151 judges whether or not the processes of steps S6 to S10 have been executed for all parameters included in the parameter list of the processing task targeted in the process of step S3 (S10). In this process, if there is a parameter that has been set as a target and has not been processed in steps S6 to S10, CPU 151 returns the process to step S6. On the other hand, if CPU 151 has executed the processes of steps S6 to S10 for all parameters, CPU 151 advances the process to step S12.
[0145] In the process of step S11, CPU 151 adds information of the processing task set as the target in step S3 to the task list of the child JOB (S11). In this process, CPU 151 can add a processing task that exists in the task list of the parent template JOB but does not exist in the task list of the child JOB to the task list of the child JOB.
[0146] In the process of step S12, CPU 151 determines whether or not the processes from S3 to S12 have been executed for all processing tasks included in the task list of the parent template JOB (S12). In this process, if there is a processing task that has been set as a target and has not yet been executed for the processes from S3 to S12, CPU 151 returns the process to step S3. Furthermore, if CPU 151 has executed the processes from S3 to S12 for all processing tasks, it ends the reflection process of reflecting information changed in the parent template JOB to the child JOB.
[0147] 12 is a flowchart showing a process for deleting information of a processing task that exists only in a child JOB in a reflection process for reflecting information of a parent template JOB to a child JOB. Note that the process from steps S1 to S12 is the same as the process from steps S1 to S12 in the flowchart shown in FIG. 11, and therefore a description thereof will be omitted.
[0148] After executing the process of step S12, CPU 151 deletes information of the processing tasks that exist only in the child JOB (S14) and ends the reflection process. In this process, CPU 151 compares the task list of the parent template JOB with the task list of the child JOB, and deletes information of processing tasks that are included in the task list of the child JOB but not included in the task list of the parent template JOB. Specifically, CPU 151 realizes the process of step S14 by deleting processing tasks other than the processing tasks that were the targets of the processes from steps S1 to S12 from among the processing tasks included in the task list of the child JOB.
[0149] This allows the robot system 1 to avoid a state in which a processing task that is not set in the parent template JOB is added to the child JOB. The robot system 1 can achieve normal processing based on the parent template JOB within the processing flow of the reflected child JOB, thereby improving the versatility of the parent template JOB.
[0150] <Summary of this embodiment> As described above, the robot system 1 of the present embodiment can reflect at least a part of the information of the parent template JOB after updating at least one of the parameters of the parent template JOB and the parameters of the child JOB. At this time, the robot system 1 can set any parameter of the child JOB not to reflect the parameters of the parent template JOB.
[0151] As a result, when the robot system 1 wants to maintain a specific parameter in the processing flow of a child JOB, the specific parameter can be maintained even when the parent template JOB is reflected. Furthermore, the robot system 1 updates the specific parameter by reflecting the parameters of the parent template JOB, eliminating the need for processing to update the specific parameter again. As a result, the robot system 1 can prevent in advance the occurrence of an error such as a user forgetting to set processing for updating again the specific parameter of a child JOB that has been updated by the reflection processing.
[0152] Furthermore, when changing parameters other than specific parameters in the processing flow of a child JOB from the template, the robot system 1 can quickly deploy the changed parameters of the template to the child JOB as well.
[0153] <Modification> In this embodiment, the CPU 151 of the information processing device 100 is configured to delete information of a processing task that exists only in a child JOB in a reflection process for reflecting information of a parent template JOB to a child JOB, but is not limited to this. The CPU 151 may be configured to be able to maintain information of a processing task that exists only in a child JOB when reflecting information of a parent template JOB to a child JOB.
[0154] The configuration of the programming support system 10 in this case will be described with reference to Fig. 13. Fig. 13 is a diagram showing a job maintenance information setting screen 1100 that allows the user to select information that the user wishes to maintain from information set in a child job. The job maintenance information setting screen 1100 is displayed from the main screen 300 when a child job is selected in the job selection field 320 of the main screen 300 and then a job maintenance information selection screen button 305 is selected.
[0155] The job maintenance information setting screen 1100 displays a flowchart tab 1101 that displays processing tasks included in the processing flow of a child job on the job maintenance information setting screen 1100. The job maintenance information setting screen 1100 also displays a local variable tab 1102 that displays information on local variables such as numerical variables and image variables other than the parameters set in the processing flow of the child job. The job maintenance information setting screen 1100 is initially displayed with the flowchart tab 1101 selected.
[0156] On the JOB maintenance information setting screen 1100, when the flowchart tab 1101 is selected, it is possible to display a list of processing task information and parameter information set for the processing task from the processing flow information of the child JOB selected in advance.
[0157] Fig. 13 illustrates a state in which the duplicated JOB 700 created in Fig. 7 is selected as a child JOB. For example, for a camera control task 710 of the duplicated JOB 700, a task number, a name, and a task check box 1110a are displayed like a camera control task 1110. Also, a filter processing task 720 of the duplicated JOB 700 is displayed on the JOB maintenance information setting screen 1100 like a filter processing task 1120, and a part detection task 730 is displayed on the JOB maintenance information setting screen 1100 like a part detection task 1130.
[0158] Each processing task displayed on the JOB maintenance information setting screen 1100 is provided with a + button and a - button having substantially the same functions as the + button and - button provided on each processing task displayed on the template JOB setting screen 900 shown in FIG. 8.
[0159] Each parameter is provided with a check box 1112, 1122, or 1132. When the information of a parent template JOB is reflected in a child JOB in the programming support system 10, the information of the parameters of the child JOB corresponding to the parameters with the check boxes 1112, 1122, or 1132 checked is maintained.
[0160] Furthermore, each process task is provided with task check boxes 1110a, 1120a, and 1130a. In the programming support system 10, when information of a parent template JOB is reflected in a child JOB, information of a process task whose task check box is checked is maintained.
[0161] In the programming support system 10, even if the processing task is not included in the processing flow of the parent template JOB, the processing task with the task check box checked is maintained when reflecting the information of the parent template JOB to the child JOB. Also, in the programming support system 10, all parameters of the processing task with the task check box checked are maintained when reflecting the information of the parent template JOB to the child JOB, regardless of whether the check box of each parameter is checked or not.
[0162] In other words, the processing task of the child duplicated JOB 700 that is to be maintained can be specified by checking the task check box corresponding to the processing task of the child duplicated JOB 700 that is to be maintained on the JOB maintenance information setting screen 1100. Also, by not checking the task check box of a processing task on the JOB maintenance information setting screen 1100, it is possible to specify that the processing task will not be maintained in the child duplicated JOB 700 when the parent template JOB does not have a processing task corresponding to that processing task.
[0163] 13, a check mark is placed in the check box 1112 for the exposure time parameter in the camera control parameter list 1111, and in the check box 1132 for the matching accuracy parameter in the part detection parameter list 1131. As a result, in the programming support system 10, when the information of the template JOB 500 is reflected in the duplicated JOB 700, the parameter information set in the duplicated JOB 700 is maintained for the exposure time parameter and the matching accuracy parameter.
[0164] 13, the task check box 1120a of the filter processing task 1120 is checked. As a result, in the programming support system 10, when the information of the template JOB 500 is reflected in the duplicated JOB 700, the information set in the duplicated JOB 700 is maintained for the information of the filter processing task 720. Also, in the programming support system 10, when the information of the template JOB 500 is reflected in the duplicated JOB 700, the information set in the duplicated JOB 700 is maintained for the information of all parameters of the filter processing task 720.
[0165] When the local variables tab 1102 is selected, the local variable information can be displayed in a list on the JOB maintenance information setting screen 1100. The local variable information is substantially the same as the local variable information of the template JOB, and can cover all variables that the child JOB can possess, other than parameters that are set in the process flow of the child JOB.
[0166] On the JOB maintenance information setting screen 1100, when the JOB maintenance information setting button 1103 is selected, the settings of the child JOB information to be maintained are saved when the information of the parent template JOB set on the JOB maintenance information setting screen 1100 is reflected in the child JOB.
[0167] With this configuration, the robot system 1 can reflect at least a part of the information of the parent template JOB after updating at least one of the information of the parent template JOB and the information of the child JOB. At this time, the robot system 1 can perform a setting so that the processing tasks and parameters of the parent template JOB are not reflected in any processing tasks and parameters of the child JOB.
[0168] As a result, when the robot system 1 wants to maintain a specific processing task or parameter in the processing flow of a child JOB, the specific processing task or parameter can be maintained even when the parent template JOB is reflected. Furthermore, the robot system 1 updates the specific processing task or parameter by reflecting the parent template JOB, and does not need to perform processing to update the specific processing task or parameter again. As a result, the robot system 1 can prevent in advance the occurrence of an error such as a user forgetting to set processing for updating again the specific processing task or parameter of the child JOB updated by the reflection processing.
[0169] Furthermore, when information other than specific processing tasks and parameters within the processing flow of a child JOB is changed from the template, the robot system 1 can quickly deploy the changed template information to the child JOB.
[0170] Furthermore, in the programming support system 10 of this embodiment, the parameters of the child JOB that are to be maintained can be clearly indicated by checking a check box displayed in the parameter list of the child JOB on the template JOB setting screen 900, but this is not limiting. The information that is to be maintained in the child JOB may be expressed by providing a flag or in any other manner that allows clear indication.
[0171] Furthermore, the inappropriate selection warning 1050 of this embodiment is displayed based on, but is not limited to, the template name and version set for the template selected on the template selection screen 1010 and the JOB selected on the JOB selection screen 1040. The inappropriate selection warning 1050 may be configured to be displayable based on the template information set for the template JOB selected on the template selection screen 1010 and the JOB selected on the JOB selection screen 1040.
[0172] Furthermore, the inappropriate selection warning 1050 is not limited to a configuration in which the warning is displayed with a mark. The inappropriate selection warning 1050 may be configured to display the warning by displaying the text of the job selected on the job selection screen 1040 in red.
[0173] In addition, the CPU 151 of this embodiment is configured to execute the processes from steps S3 to S12 in the reflection process in the order of the process tasks having the smallest JOB numbers set as JOB numbers in the task list, but is not limited to this. The CPU 151 only needs to be configured to be able to execute the processes from steps S3 to S12 for all the process tasks in the task list, and the order of execution of the processes for each process task may be any order.
[0174] Furthermore, in the reflection process, CPU 151 in this embodiment is configured to execute the processes from steps S6 to S10 in order from the parameter with the smallest parameter number set as the parameter number in the parameter list, but is not limited to this. CPU 151 only needs to be configured to be able to execute steps S6 to S10 for all parameters in the parameter list, and the order of execution of the processes for each parameter may be any order.
[0175] Furthermore, the CPU 151 of this embodiment is configured to be able to reflect the parameters of the parent template JOB in the child JOB if there is a difference between the parameters of the parent template JOB and the parameters of the child JOB, but is not limited to this. The CPU 151 determines whether or not there are any parameters (changes) that have been changed since the child JOB was created by duplicating in the processing task of the parent template JOB. Then, the CPU 151 may be configured to be able to reflect the parameters of the parent template JOB in the child JOB if it is determined that there are changes.
[0176] Furthermore, the information processing method and information processing device of the present invention can be applied to software design and program creation for various machines and equipment, such as industrial robots, service robots, and processing machines that operate under computer numerical control, in addition to production equipment. For example, machines and equipment that can automatically perform operations such as expansion and contraction, bending and stretching, vertical movement, horizontal movement, or rotation, or a combination of these operations, based on information in a storage device provided in a control device. Furthermore, in the above embodiment, the robot is a vertical multi-joint robot, but this is not limited to this. The robot body may be, for example, a horizontal multi-joint robot, a parallel link robot, or an orthogonal robot.
[0177] The present invention also includes a control method for a robot system that executes the above-described information processing method and includes a robot manipulator as a controlled object. The present invention also includes a manufacturing method for an article using a robot system that operates by executing the above-described information processing method. The present invention also includes a program that can execute the above-described information processing and a computer-readable recording medium that stores the program.
[0178] The disclosure of this embodiment includes the following configuration.
[0179] (Configuration 1) A creation process for creating a process flow based on the template; a reflection process capable of reflecting at least a part of information of the template in the process flow when at least one of the template and the process flow is updated; a setting process for setting information to be reflected in the reflection process and information not to be reflected in the reflection process in the template; 23. An information processing apparatus comprising:
[0180] (Configuration 2) The template includes process flow information on which the process flow is based. 2. The information processing device according to configuration 1.
[0181] (Configuration 3) The setting process is executed before the creation process is executed. 3. The information processing device according to configuration 1 or 2.
[0182] (Configuration 4) Executing a process of creating an information list having information set in the template; the setting process sets information to be reflected in the reflection process and information not to be reflected in the reflection process in the template based on the information list. 4. The information processing device according to any one of configurations 1 to 3.
[0183] (Configuration 5) creating a template list of the templates; a template selection process for selecting from the template list the template to be reflected in the processing flow by the reflection process; 5. The information processing device according to any one of configurations 1 to 4.
[0184] (Configuration 6) creating a process flow list of the process flow; a process flow selection process for selecting, from the process flow list, the process flow in which the template is to be reflected in the reflection process; 6. The information processing device according to any one of configurations 1 to 5.
[0185] (Configuration 7) executing a process of setting management information for managing the template in the template; 7. The information processing device according to any one of configurations 1 to 6.
[0186] (Configuration 8) Perform a process to update the template; The management information is updated based on an update of the template. 8. The information processing device according to configuration 7.
[0187] (Configuration 9) creating a template list of the templates; a template selection process for selecting from the template list the template to be reflected in the processing flow by the reflection process; and notifying a user of the management information of the template selected in the template selection process. 9. The information processing device according to configuration 7 or 8.
[0188] (Configuration 10) creating a process flow list of the process flow; a process flow selection process for selecting, from the process flow list, the process flow in which the template is to be reflected in the reflection process; and notifying a user of the management information of the template on which the process flow selected in the process flow selection process is based. 10. The information processing device according to any one of configurations 7 to 9.
[0189] (Configuration 11) execute a process of notifying a user of the association between the management information of the template on which the process flow selected in the process flow selection process is based and the management information of the template reflected in the reflection process; 11. The information processing device according to configuration 10.
[0190] (Configuration 12) The reflection process deletes a task that is not included in the template when the task is included in the process flow. 12. The information processing device according to any one of configurations 1 to 11.
[0191] (Method 13) A creation process for creating a process flow based on the template; a reflection process capable of reflecting at least a part of information of the template in the process flow when at least one of the template and the process flow is updated; a setting process for setting information to be reflected in the reflection process and information not to be reflected in the reflection process in the template; 23. An information processing method comprising:
[0192] (Method 14) The information processing unit executes the information processing method according to the method 13 to control the robot. A method for controlling a robot system comprising:
[0193] (Configuration 15) An information processing device according to any one of configurations 1 to 12, A robot controlled by the information processing device. A robot system comprising:
[0194] (Configuration 16) Manufacture an article using the robot system according to configuration 15. A method for producing an article.
[0195] (Configuration 17) A program for causing a computer to execute the information processing method described in Method 13.
[0196] (Configuration 18) A computer-readable recording medium storing the program according to configuration 17. [Explanation of symbols]
[0197] 1...Robot system: 100...Information processing device: 114...Robot: 151...Information processing unit (CPU): 500...Template (template JOB): 700...Processing flow (replication JOB)
Claims
1. A creation process for creating a process flow based on the template; a reflection process capable of reflecting at least a part of information of the template in the process flow when at least one of the template and the process flow is updated; a setting process for setting information to be reflected in the reflection process and information not to be reflected in the reflection process in the template; 23. An information processing apparatus comprising:
2. The template includes process flow information on which the process flow is based.
2. The information processing apparatus according to claim 1,
3. The setting process is executed before the creation process is executed.
2. The information processing apparatus according to claim 1,
4. Executing a process of creating an information list having information set in the template; the setting process sets information to be reflected in the reflection process and information not to be reflected in the reflection process in the template based on the information list.
2. The information processing apparatus according to claim 1,
5. creating a template list of the templates; a template selection process for selecting from the template list the template to be reflected in the processing flow by the reflection process; 2. The information processing apparatus according to claim 1,
6. creating a process flow list of the process flow; a process flow selection process for selecting, from the process flow list, the process flow in which the template is to be reflected in the reflection process; 2. The information processing apparatus according to claim 1,
7. executing a process of setting management information for managing the template in the template; 2. The information processing apparatus according to claim 1,
8. Perform a process to update the template; The management information is updated based on an update of the template.
8. The information processing apparatus according to claim 7,
9. creating a template list of the templates; a template selection process for selecting from the template list the template to be reflected in the processing flow by the reflection process; and notifying a user of the management information of the template selected in the template selection process.
8. The information processing apparatus according to claim 7,
10. creating a process flow list of the process flow; a process flow selection process for selecting, from the process flow list, the process flow in which the template is to be reflected in the reflection process; and notifying a user of the management information of the template on which the process flow selected in the process flow selection process is based.
8. The information processing apparatus according to claim 7,
11. execute a process of notifying a user of the association between the management information of the template on which the process flow selected in the process flow selection process is based and the management information of the template reflected in the reflection process; 11. The information processing apparatus according to claim 10,
12. The reflection process deletes a task that is not included in the template when the task is included in the process flow.
2. The information processing apparatus according to claim 1,
13. A creation process for creating a process flow based on the template; a reflection process capable of reflecting at least a part of information of the template in the process flow when at least one of the template and the process flow is updated; a setting process for setting information to be reflected in the reflection process and information not to be reflected in the reflection process in the template; 23. An information processing method comprising:
14. The information processing unit executes the information processing method according to claim 13 to control the robot. A method for controlling a robot system comprising:
15. An information processing device according to any one of claims 1 to 12, A robot controlled by the information processing device. A robot system comprising:
16. Manufacturing an article using the robot system according to claim 15. A method for producing an article comprising the steps of:
17. A program for causing a computer to execute the information processing method according to claim 13.
18. A computer-readable recording medium storing the program according to claim 17.
Citation Information
Patent Citations
Information processing apparatus and control method thereof
JP2009164972A
