Information processing device and program

Abstract

In the present invention, an interface is able to communicate with a plurality of robots, and is also able to communicate with a server device that has a plurality of robot-identifying information items identifying the plurality of robots. A control unit acquires, via the interface, the plurality of robot-identifying information items and the status of communication connection of the plurality of robots with the server device. The control unit causes a display unit to display the plurality of robot-identifying information items and the communication connection status in a viewable manner so that at least one robot can be selected by means of an input unit, the one robot being caused to perform at least one work to be performed that is selected by a user from among a plurality of works indicated by a plurality of work information items generated through the use of any of the plurality of robots.

Description

Information processing device and program

[0001] The present disclosure relates to an information processing device.

[0002] Patent Document 1 describes a technique for giving work instructions to a robot.

[0003] JP 2008-68348 A

[0004] An information processing device and a program are disclosed. In one embodiment, the information processing device includes a display unit, an input unit that accepts user input, an interface, and a control unit. The interface is capable of communicating with a plurality of robots and a server device that has a plurality of robot identification information that identifies the plurality of robots. The control unit acquires the plurality of robot identification information and the communication connection status of the plurality of robots with the server device via the interface. The control unit causes the display unit to display the plurality of robot identification information and the communication connection status in a viewable manner so that the input unit can be used to select at least one robot to perform at least one target task selected by a user from a plurality of tasks indicated by a plurality of task information generated using any of the plurality of robots.

[0005] In one embodiment, the program is a program for causing a computer device to function as the information processing device.

[0006] FIG. 1 is a schematic diagram showing an example of an information processing device. FIG. 1 is a schematic diagram showing an example of a robot system. FIG. 2 is a schematic diagram showing an example of a display of an information processing device. FIG. 3 is a schematic diagram showing an example of a display of an information processing device. FIG. 4 is a schematic diagram showing an example of a display of an information processing device. FIG. 5 is a schematic diagram showing an example of a display of an information processing device. FIG. 6 is a schematic diagram showing an example of a display of an information processing device. FIG. 7 is a schematic diagram showing an example of a display of an information processing device. FIG. 8 is a schematic diagram showing an example of a display of an information processing device. FIG. 9 is a schematic diagram showing an example of a display of an information processing device. FIG. 10 is a schematic diagram showing an example of a display of an information processing device. FIG. 11 is a schematic diagram showing an example of a display of an information processing device. FIG. 12 is a schematic diagram showing an example of a display of an information processing device. FIG. 13 is a schematic diagram showing an example of a display of an information processing device. FIG. 1 is a schematic diagram showing an example of a display of an information processing device. FIG. 1 is a schematic diagram showing an example of a display of an information processing device. FIG. 2 is a schematic diagram showing an example of a display of an information processing device. FIG. 3 is a schematic diagram showing an example of a display of an information processing device. FIG. 4 is a schematic diagram showing an example of a display of an information processing device. FIG. 5 is a schematic diagram showing an example of a display of an information processing device. FIG. 6 is a schematic diagram showing an example of a display of an information processing device. FIG. 7 is a schematic diagram showing an example of a display of an information processing device. FIG. 8 is a schematic diagram showing an example of a display of an information processing device. FIG. 9 is a schematic diagram showing an example of a display of an information processing device. FIG. 10 is a schematic diagram showing an example of a display of an information processing device. FIG. 11 is a schematic diagram showing an example of a display of an information processing device. FIG. 12 is a schematic diagram showing an example of a display of an information processing device.

[0007] Fig. 1 is a schematic diagram showing an example of the configuration of an information processing device 1. Fig. 2 is a schematic diagram showing an example of the configuration of a robot system 5 including the information processing device 1. As shown in Fig. 2, the robot system 5 includes, for example, a plurality of robots 3, a server device 2, and the information processing device 1. The plurality of robots 3, the server device 2, and the information processing device 1 are connected to a network 4 including the Internet or the like.

[0008] Each robot 3 includes, for example, a robot mechanism 3b and a robot controller 3a that controls the robot mechanism 3b. The robot controller 3a is, for example, a computer device. The robot controller 3a of each robot 3 is connected to a network 4. The server device 2 and the robot controller 3a of each robot 3 can communicate with each other through the network 4. The server device 2 and the information processing device 1 can also communicate with each other through the network 4. The information processing device 1 and the robot controller 3a of each robot 3 may also be able to communicate with each other through the network 4.

[0009] The robot system 5 may also have multiple information processing devices 1. The multiple information processing devices 1 may be capable of communicating with the same robot 3 among the multiple robots 3. The multiple information processing devices 1 may also output control commands to the same robot 3. This allows another user to reserve work for the same robot 3 using another information processing device 1 after a user has instructed a robot 3 to perform work using the instructed robot 3 using an information processing device 1.

[0010] The robot mechanisms 3b of the multiple robots 3 include, for example, arm-type robot mechanisms and AGV (Automatic Guided Vehicle)-type robot mechanisms. The multiple robot mechanisms 3b may include, for example, multiple robot mechanisms of different types, or multiple robot mechanisms of the same type. The multiple robot mechanisms 3b may also include, for example, multiple types of arm-type robot mechanisms with different numbers of joints (in other words, the number of axes). The multiple robot mechanisms 3b may also include, for example, single-arm arm-type robot mechanisms or double-arm arm-type robot mechanisms. The multiple robots 3 may also be manufactured by different manufacturers, may be different products, or may have different versions indicating performance or specifications. Information capable of identifying the multiple robots 3 may be included in robot-related information described below and displayed on the information processing device 1.

[0011] Furthermore, the multiple robots 3 may be, for example, collaborative robots capable of working in collaboration with humans. A collaborative robot refers to, for example, a robot that meets specific safety standards and can operate without a physical safety fence. The multiple robots 3 may be portable by a user, such as an instructor who issues work instructions to the multiple robots 3 or a worker who works collaboratively with the multiple robots 3. Each of the multiple robots 3 may be attached to a support base that supports the robot 3 and has a movement mechanism such as wheels, and may be movable by moving the support base.

[0012] Hereinafter, a robot 3 in which the robot mechanism 3b is an arm-type robot mechanism may be referred to as an arm robot 3. A robot 3 in which the robot mechanism 3b is an AGV-type robot mechanism may be referred to as an AGV robot 3. A robot 3 in which the robot mechanism 3b is a single-arm arm-type robot mechanism may be referred to as a single-arm arm robot 3. A robot 3 in which the robot mechanism 3b is a double-arm arm-type robot mechanism may be referred to as a double-arm arm robot 3.

[0013] The server device 2 manages the operation of the entire robot system 5. The server device 2 can be, for example, a computer device. The server device 2 can be, for example, a cloud server. The server device 2 may be configured as one computer device or multiple computer devices.

[0014] The server device 2 acquires various information and stores and manages the acquired information. The information stored in the server device 2 also includes programs (in other words, software). The server device 2 stores, for example, robot-related information related to the robot 3 for each robot 3. The robot-related information (also referred to as registered robot-related information) stored in the server device 2 includes, for example, robot identification information for identifying the robot 3. The robot identification information includes, for example, the name of the robot 3, the model of the robot 3, a graphic that schematically shows the appearance of the robot 3, and information indicating the type of robot 3. The registered robot-related information also includes robot performance information that indicates the performance of the robot 3 and robot status information that indicates the status of the robot 3. The robot performance information includes, for example, identification information for identifying each piece of software installed in each robot controller 3a for each robot 3 and information indicating the hardware configuration of the robot 3. The robot performance information may also include version information of each piece of software or hardware. The robot status information includes, for example, a communication connection status that indicates whether the robot controller 3a is connected to the server device 2 and information indicating the operating status of the robot 3.

[0015] The information managed by the server device 2 may also include past information. Furthermore, the information managed by the server device 2 may be configured to enable tracing of past information in the event of an incident. Furthermore, the information managed by the server device 2 may be encrypted. Furthermore, the server device 2 may periodically conduct risk or vulnerability investigations on the information managed by the server device 2. As a result, the server device 2 can selectively notify users of robots 3 that have risks or vulnerabilities of alerts via the information processing device 1. Furthermore, the server device 2 can uniformly notify owners of robots 3 via the information processing device 1 depending on the risks or vulnerabilities.

[0016] The server device 2 also stores, for example, work-related information related to work performed by the robot 3. The server device 2 stores work-related information for each work. The work-related information stored by the server device 2 (also referred to as registered work-related information) includes, for example, work information indicating the content of the work. The work information may include, for example, the name of the work and an overview of the work. The registered work-related information also includes, for example, work status information indicating the status of the work performed by the robot 3 and work result information indicating the results of the work performed by the robot 3. The server device 2 also stores various software (in other words, programs) required for the robot 3 to perform the work. The information stored by the server device 2 is not limited to this.

[0017] In each robot 3, the robot controller 3a acquires information necessary to execute a task, such as task information, from the server device 2. The robot controller 3a then controls the robot mechanism 3b based on the information acquired from the server device 2, thereby enabling the robot 3 to execute a task instructed to be executed by the server device 2. The arm robot 3 can perform tasks such as recognizing an object from among multiple objects placed in a predetermined location, and moving the recognized object to another location while holding it. In each robot 3, the robot controller 3a generates task status information, task result information, robot status information, etc., and transmits them to the server device 2. The server device 2 stores and registers the various pieces of information received from each robot 3.

[0018] Of the information required for each robot 3 to perform a task, information such as software or a program that defines the behavior of each robot 3 may be information generated based on, for example, any one of the multiple robots 3. Specifically, the information generated based on any one of the multiple robots 3 may be, for example, information generated using any one of the multiple robots 3, information generated by teaching using any one of the multiple robots 3, or information generated by simulation based on information from any one of the multiple robots 3. Furthermore, one piece of task information may be generated based on any one robot 3 of the multiple robots 3. Furthermore, the task indicated by the generated task information may be performed by at least one robot 3 different from the robot 3 used in generating the task information.

[0019] The robot system 5 employs, for example, a multi-tenant system in which resources provided by the server device 2 are shared by multiple tenants. One tenant may be, for example, an organization such as a company, or a factory or business establishment owned by a company. Multiple users belong to one tenant. A tenant can also be considered a user group. Multiple tenants who use the resources provided by the server device 2 are registered in the server device 2. Furthermore, for each tenant, each user belonging to that tenant is registered in the server device 2.

[0020] The server device 2 includes a database for storing various types of information. The database includes, for example, a common database shared by multiple tenants and an individual database prepared for each tenant. The database includes multiple individual databases corresponding to each of the multiple tenants.

[0021] The common database stores information that can be commonly used by multiple tenants. The common database stores, for example, software required for the robot 3 to perform work (also referred to as work-required software). The work-required software includes, for example, software for the robot 3 to recognize the location where an object held by the robot 3 is placed, software for the robot 3 to recognize the object held by the robot 3, and software for the robot 3 to recognize the location where the object held by the robot 3 is to be placed. The individual database stores information that can only be used by the tenant corresponding to the individual database. In the server device 2, information stored in an individual database corresponding to a certain tenant cannot be used by other tenants.

[0022] Hereinafter, the information stored in the common database may be referred to as registered common information. Also, the information stored in the individual database may be referred to as registered tenant-specific information. A user belonging to a certain tenant can use the registered tenant-specific information corresponding to that tenant, but cannot use the registered tenant-specific information corresponding to other tenants.

[0023] The registered tenant-specific information includes, for example, registered robot-related information about each robot owned, possessed, or managed by a tenant that can use the registered tenant-specific information, and registered task-related information about each task performed by each robot. The registered tenant-specific information also includes, for example, software required for a robot managed by a tenant that uses the registered tenant-specific information to perform a task (i.e., task-required software).

[0024] The information processing device 1 is capable of receiving input from a user and executing processing in accordance with the received input. The information processing device 1 is, for example, a computer device. The information processing device 1 may be, for example, a desktop or notebook personal computer, a tablet terminal, a mobile phone such as a smartphone, or another device.

[0025] <Configuration Example of Information Processing Apparatus> As shown in FIG. 1, an information processing apparatus 1 includes, for example, a control unit 10, a storage unit 11, an input unit 12, a display unit 13, and an interface 14.

[0026] The interface 14 is capable of communicating with the network 4 based on a communication standard such as Wi-Fi. The interface 14 can also be referred to as, for example, an interface circuit. The interface 14 can also be referred to as, for example, a communication unit or a communication circuit. The interface 14 may be connected to the network 4 by wire or wirelessly. The interface 14 inputs information received from the network 4 to the control unit 10. The interface 14 also outputs information from the control unit 10 to the network 4.

[0027] The control unit 10 can comprehensively manage the operation of the information processing device 1 by controlling the other components of the information processing device 1. The control unit 10 can also be referred to as, for example, a control circuit. The control unit 10 includes at least one processor to provide control and processing power for performing various functions, as described in more detail below.

[0028] According to various embodiments, the at least one processor may be implemented as a single integrated circuit (IC) or as multiple communicatively connected integrated circuits ICs and / or discrete circuits. The at least one processor may be implemented according to various known techniques.

[0029] In one embodiment, a processor includes one or more circuits or units configured to perform one or more data computational procedures or processes, for example, by executing instructions stored in associated memory. In other embodiments, a processor may be firmware (e.g., discrete logic components) configured to perform one or more data computational procedures or processes.

[0030] According to various embodiments, the processor may include one or more processors, controllers, microprocessors, microcontrollers, application specific integrated circuits (ASICs), digital signal processors, programmable logic devices, field programmable gate arrays, or any combination of these devices or configurations, or other known combinations of devices and configurations, to perform the functions described below.

[0031] The control unit 10 may include, for example, a CPU (Central Processing Unit) as a processor. The storage unit 11 may include a non-transitory recording medium readable by the CPU of the control unit 10, such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage unit 11 stores, for example, multiple types of programs 11a for controlling the information processing device 1. Various functions of the control unit 10 are realized, for example, by the CPU of the control unit 10 executing the programs 11a in the storage unit 11. The multiple types of programs 11a include a GUI (Graphical User Interface) program 11a and the like.

[0032] The configuration of the control unit 10 is not limited to the above example. For example, the control unit 10 may include multiple CPUs. The control unit 10 may also include at least one DSP (Digital Signal Processor). All or some of the functions of the control unit 10 may be realized by a hardware circuit that does not require software to realize the function. The storage unit 11 may also include a computer-readable non-transitory recording medium other than ROM and RAM. The storage unit 11 may also include, for example, a small hard disk drive or SSD (Solid State Drive).

[0033] The input unit 12 can accept various inputs from the user. The input unit 12 may include, for example, a mouse and a keyboard. The input unit 12 may also include a touch sensor that accepts touch operations by the user. The input unit 12 may also include a microphone that accepts voice input by the user. The control unit 10 recognizes the content of the user input accepted by the input unit 12 based on the output signal from the input unit 12.

[0034] The display unit 13 is capable of displaying various types of information under the control of the control unit 10. The display unit 13 has a display surface that displays various types of information. The display unit 13 may be, for example, a liquid crystal display, an organic electroluminescence (EL) display, or a plasma display. Furthermore, if the input unit 12 includes a touch sensor, the touch sensor and the display surface of the display unit 13 may constitute a touch panel display having a display function and a touch detection function. In this case, the input unit 12 can detect a touch operation on the display surface of the display unit 13. The input unit 12 and the display unit 13 constitute a user interface. Hereinafter, the display surface refers to the display surface of the display unit 13.

[0035] The server device 2 may have the same configuration as the information processing device 1. The robot controller 3a may have the same configuration as the information processing device 1.

[0036] <Example of Operation of Robot System> The information processing device 1 can, for example, accept from a user a designation of a robot 3 (also referred to as a destination robot 3) to which work information is to be sent. The information processing device 1 can accept designation of one destination robot 3 from the user, or can accept designation of multiple destination robots 3 from the user. The information processing device 1 notifies the server device 2 of at least one destination robot 3 designated by the user. The server device 2 transmits work information to at least one destination robot 3 notified by the information processing device 1. In the robot 3 that has received the work information, the robot controller 3a controls the robot mechanism 3b based on the work information, thereby performing work related to the work information (i.e., work indicated by the work information).

[0037] Furthermore, the information processing device 1 can generate work content based on user input. The user can provide input to the information processing device 1 to cause the information processing device 1 to generate desired work content. From the user's perspective, it can be said that the user generates desired work content using the information processing device 1. The information processing device 1 transmits work information indicating the generated work content to the server device 2. The server device 2 stores and manages the work information received from the information processing device 1.

[0038] An example of the operation of the robot system 5 will be described in detail below, focusing on the operation of the information processing device 1.

[0039] An icon for executing a predetermined application program 11a stored in the storage unit 11 is displayed on the display surface of the information processing device 1. By the control unit 10 executing the predetermined application program 11a, the information processing device 1 can receive a destination robot 3 designation from the user and generate work information based on the input from the user.

[0040] When a user selects a predetermined icon displayed on the display surface, that is, when the input unit 12 receives a selection input for selecting a predetermined icon, the control unit 10 starts executing a predetermined application program 11a in the storage unit 11. The selection input for selecting an object displayed on the display surface, such as an icon, may be a touch operation on the object, or a predetermined operation of the mouse with the pointer positioned on the object.

[0041] When the control unit 10 starts executing a predetermined application program 11a, the display unit 13, under the control of the control unit 10, displays an input screen 20 for the user to input tenant identification information for identifying the tenant into the information processing device 1.

[0042] FIG. 3 is a schematic diagram showing an example of an input screen 20. As shown in FIG. 3, the input screen 20 includes, for example, an input area 21 for inputting tenant identification information 22 and an instruction area 25 for instructing the display of the next screen. When the user selects the input area 21, that is, when the user performs a selection input to select the input area 21 on the input unit 12, the user is able to input the tenant identification information 22 to the information processing device 1. When the user inputs the tenant identification information 22 of the tenant to which the user belongs on the input unit 12, the input tenant identification information 22 (also referred to as input tenant identification information 22) is displayed in the input area 21. In the example of FIG. 3, a company name is displayed as the input tenant identification information 22. Note that the input tenant identification information 22 may be, for example, a numerical value or a character string indicating a tenant.

[0043] After inputting the tenant identification information 22 into the input unit 12, the user performs a selection input on the input unit 12 to select the instruction area 25. When the instruction area 25 is selected and the tenant identified by the input tenant identification information 22 is registered in the server device 2, a sign-in screen 30 for using resources provided by the server device 2 is displayed on the display unit 13.

[0044] The information processing device 1 inquires of the server device 2 as to whether or not the tenant identified by the input tenant identification information 22 is registered in the server device 2. At this time, the information processing device 1 notifies the server device 2 of the input tenant identification information 22. The server device 2 determines whether or not the tenant identified by the input tenant identification information 22 is registered, and notifies the information processing device 1 of the determination result. In the information processing device 1 that has been notified of the determination result from the server device 2, if the tenant identified by the input tenant identification information 22 is registered in the server device 2, the control unit 10 causes the display unit 13 to display a sign-in screen 30. On the other hand, if the tenant identified by the input tenant identification information 22 is not registered in the server device 2, the control unit 10 does not cause the display unit 13 to display the sign-in screen 30. At this time, the control unit 10 may cause the display unit 13 to display a message that the tenant identified by the input tenant identification information 22 is not registered.

[0045] 4 is a schematic diagram showing an example of the sign-in screen 30. The sign-in screen 30 is displayed, for example, superimposed on a main screen 50 (described below) that is displayed on the display unit 13 after successful sign-in. However, since sign-in has not yet occurred in this case, the main screen 50 does not include information based on information registered in the server device 2.

[0046] The sign-in screen 30 includes, for example, an input area 32 for inputting user identification information 33 for identifying the user, and an input area 35 for inputting a password for signing in. The sign-in screen 30 also includes an instruction area 37 for instructing to sign in. Note that a passkey for signing in may be used instead of a password for signing in.

[0047] When the user performs a selection input to select the input area 32 on the input unit 12, the user becomes able to input user identification information 33 to the information processing device 1. When the user inputs the user identification information 33 assigned to the user on the input unit 12, the input user identification information 33 (also referred to as input user identification information 33) is displayed in the input area 32.

[0048] Furthermore, when the user performs a selection input to select the input area 35 on the input unit 12, the user becomes able to input a password to the information processing device 1. When the user performs a password corresponding to the input user identification information 33 on the input unit 12, the input password (also referred to as an input password) is displayed in the input area 35, for example.

[0049] After inputting the user identification information 33 and the password into the input unit 12, the user performs a selection input into the input unit 12 by selecting the instruction area 37. This causes the user to instruct the information processing device 1 to sign in.

[0050] The information processing device 1, to which a sign-in instruction has been issued, notifies the server device 2 of the input user identification information 33 and the input password. The server device 2 determines whether the user (also referred to as a specific user) identified by the notified input user identification information 33 is registered. If the specific user is registered, the server device 2 determines whether the input password corresponds to the specific user. If the input password corresponds to the specific user, the server device 2 determines that the user using the information processing device 1 has the authority to use the resources provided by the server device 2, and notifies the information processing device 1 that the sign-in was successful. On the other hand, if the specific user is not registered, the server device 2 determines that the sign-in was unsuccessful. Furthermore, even if the specific user is registered, the server device 2 determines that the sign-in was unsuccessful if the input password is not the password corresponding to the specific user. If the server device 2 determines that the sign-in was unsuccessful, it notifies the information processing device 1 that the sign-in was unsuccessful.

[0051] In the information processing device 1 that has been notified that sign-in has been successful, the control unit 10 displays the main screen 50 on the display unit 13. A user who has successfully signed in (also referred to as a sign-in user) can use registered tenant-specific information corresponding to the tenant to which the user belongs, which is managed by the server device 2. The sign-in user can also use information stored in the common database of the server device 2. On the other hand, in the information processing device 1 that has been notified that sign-in has failed, the control unit 10 does not display the main screen 50 on the display unit 13. In this case, the control unit 10 may display on the display unit 13 that sign-in has failed. Note that even if the registered tenant-specific information is the registered tenant-specific information of the tenant to which the sign-in user belongs, the control unit 10 may filter the registered tenant-specific information according to the sign-in user and display the filtered registered tenant-specific information on the display unit 13. In other words, different viewing authorities are granted to each user, and the control unit 10 can select information to be displayed on the display unit 13 according to the viewing authority.

[0052] Hereinafter, unless otherwise specified, a user refers to a user who has successfully signed in (i.e., a signed-in user). The tenant to which the signed-in user belongs may be referred to as a target tenant. An individual database corresponding to the target tenant and stored in the server device 2 may be referred to as a target individual database. Registered tenant-specific information stored in the target individual database may be referred to as target registered tenant-specific information.

[0053] 5 and 6 are schematic diagrams showing an example of the main screen 50. The information processing device 1 can generate and display the main screen 50 based on at least a part of the unique information of the target registration tenant acquired from the server device 2. The information processing device 1 can also display various screens described below other than the main screen 50 based on at least a part of the unique information of the target registration tenant, or based on at least a part of the unique information of the target registration tenant and at least a part of the registered common information stored in the server device 2.

[0054] The main screen 50 includes, for example, a right screen 51 located on the right side and a left screen 53 located on the left side. The main screen 50 also includes instruction areas 55 and 57 located at the top. The main screen 50 also includes tenant identification information 22. A user can scroll the display of the right screen 51 on the information processing device 1 by making a predetermined input to the input unit 12. A user can also scroll the display of the left screen 53 on the information processing device 1 by making a predetermined input to the input unit 12. FIG. 6 shows the main screen 50 shown in FIG. 5 after the display of the left screen 53 has been scrolled. Note that, although not specifically described below, the display of the screen or the display of information on the display unit 13 is scrolled as necessary in accordance with a user input to the input unit 12.

[0055] The right screen 51 displays, for example, a dashboard screen 60. The dashboard screen 60 displays a status graph 70 that shows the status of multiple robots 3 managed by the target tenant, and a work result screen 80 that shows the results of work performed by the multiple robots 3 managed by the target tenant. The dashboard screen 60 will be described in detail later. Note that, as will be described later, the right screen 51 may display a screen other than the dashboard screen 60. Hereinafter, each of the multiple robots 3 owned, possessed, or managed by the target tenant may be referred to as a target robot 3.

[0056] The instruction area 55 is an area for instructing switching between displaying and hiding the left screen 53. When the instruction area 55 is selected while the left screen 53 is displayed as shown in Figures 5 and 6, the left screen 53 is hidden and the right screen 51 is displayed in most of the main screen 50 as shown in Figure 7. When the instruction area 55 is then selected, the left screen 53 is displayed as shown in Figures 5 and 6.

[0057] The instruction area 57 is an area for instructing the display of a setting screen for setting the account. When the instruction area 57 is selected, the setting screen is displayed on the main screen 50, for example.

[0058] The left screen 53 includes, for example, an instruction area 90 for instructing the display of the dashboard screen 60. When the dashboard screen 60 is not displayed on the right screen 51, if the instruction area 90 is selected, the dashboard screen 60 is displayed on the right screen 51.

[0059] Also, instruction areas 92 and 94 are shown on the left screen 53. The instruction area 92 is an area for instructing the robot 3 to start processing to instruct the robot 3 to perform a task. The instruction area 94 is an area for instructing the robot 3 to start processing to create task content. The operation of the information processing device 1 after the instruction area 92 is selected will be described in detail later. The operation of the information processing device 1 after the instruction area 94 is selected will be described in detail later.

[0060] 5, the left screen 53 also displays robot list information 100, which indicates a list of multiple target robots 3 managed by the target tenant, for example. The left screen 53 also includes a designation area 101 for instructing switching between displaying and hiding the robot list information 100. As shown in FIG. 5, when the designation area 101 is selected while the robot list information 100 is displayed on the left screen 53, the robot list information 100 is hidden (see FIG. 6). Thereafter, when the designation area 101 is selected, the robot list information 100 is displayed, as shown in FIG. 5.

[0061] The robot list information 100 includes, for each target robot 3, robot-related information 110, which is information about the target robot 3. The robot-related information 110 includes, for example, robot identification information 111 for identifying the target robot 3 and a status graphic 118 that indicates the status of the target robot 3. The robot-related information 110 may also include at least one tag 119 attached to the target robot 3. The tag 119 is, for example, a character string, and is information that makes it easier to search for desired robot-related information 110 from the robot list information 100. The status graphic 118 can also be said to be information that indicates the communication connection status or operating status of the target robot 3. Note that, in the robot list information 100, the robot-related information 110 for some target robots 3 may be hidden or the display order of the robot-related information 110 may be changed based on the information included in the robot-related information 110.

[0062] The robot identification information 111 includes, for example, a name 112 of the target robot 3 , a model 113 of the target robot 3 , information 114 indicating the type of the target robot 3 , and an image 115 that schematically shows the appearance of the target robot 3 .

[0063] In this example, for example, eight types of situation graphics 118a to 118h are prepared as the situation graphics 118. The robot-related information 110 includes any one of the eight types of situation graphics 118a to 118h.

[0064] 8 is a schematic diagram showing an example of eight types of status graphics 118a to 118h. The status graphic 118a indicates that the target robot 3 can communicate with the server device 2 and that the target robot 3 is activated. Hereinafter, when the robot 3 is activated, it means that the robot 3 can communicate with the server device 2 and that the robot 3 is activated. A task execution instruction for the activated target robot 3 may be stored in the server device 2 as an execution instruction instructing the target robot 3 to execute the task after activation. In this case, the target robot 3 does not need to accept a task execution instruction.

[0065] The status graphic 118b indicates that the target robot 3 can communicate with the server device 2 and is on standby. Hereinafter, when the robot 3 is on standby, it means that the robot 3 can communicate with the server device 2 and that the robot 3 is on standby. The target robot 3 on standby can receive and execute instructions to perform a task.

[0066] The status graphic 118c indicates that the target robot 3 can communicate with the server device 2 and that the target robot 3 is in the middle of processing, i.e., is performing work. Hereinafter, when we say that the robot 3 is in the middle of processing, it means that the robot 3 can communicate with the server device 2 and that the robot 3 is in the middle of processing.

[0067] The status graphic 118d indicates that the target robot 3 can communicate with the server device 2 and that the target robot 3 is undergoing maintenance. Hereinafter, when we say that the robot 3 is undergoing maintenance, it means that the robot 3 can communicate with the server device 2 and that the robot 3 is undergoing maintenance. Note that the target robot 3 undergoing maintenance cannot, for example, receive instructions to perform work.

[0068] The status graphic 118e indicates that the target robot 3 can communicate with the server device 2, but an error has occurred in the target robot 3. Hereinafter, when we say that the robot 3 is experiencing an error, it means that the robot 3 can communicate with the server device 2, but an error has occurred in the robot 3. Note that the target robot 3 experiencing an error cannot, for example, receive instructions to perform a task.

[0069] The status graphic 118f indicates that the target robot 3 is in the process of disconnecting communication with the server device 2. Hereinafter, when the robot 3 is said to be in the process of disconnecting communication with the server device 2, it means that the robot 3 can communicate with the server device 2, but the robot 3 is in the process of disconnecting communication with the server device 2. The target robot 3 that is disconnected cannot receive instructions to perform a task. Note that although the target robot 3 cannot accept instructions to perform a task, the work instructions for the target robot 3 may be stored in the server device 2.

[0070] The status graphic 118g indicates that the target robot 3 has disconnected communication with the server device 2, that is, the target robot 3 cannot communicate with the server device 2. Hereinafter, when we say that the robot 3 is disconnected, it means that the robot 3 has disconnected communication with the server device 2. A disconnected target robot 3 cannot receive instructions to perform a task. Note that, although a disconnected target robot 3 cannot accept instructions to perform a task, the instructions to perform a task for the disconnected target robot 3 may be stored in the server device 2 as execution instructions that instruct the target robot 3 to perform the task after activation.

[0071] The status graphic 118h indicates that the target robot 3 can communicate with the server device 2, but the status of the target robot 3 is unknown. Hereinafter, when the status of the robot 3 is unknown, it means that the robot 3 can communicate with the server device 2, but the status of the robot 3 is unknown.

[0072] When the robot controller 3a is able to communicate with the server device 2, it generates robot status information indicating the status of the robot 3 and repeatedly transmits the information to the server device 2. The robot status information generated by the robot controller 3a includes, for example, information indicating that the robot 3 is starting up, information indicating that the robot 3 is on standby, or information indicating that the robot 3 is processing. The robot status information generated by the robot controller 3a also includes information indicating that the robot 3 is undergoing maintenance, information indicating that an error has occurred in the robot 3, or information indicating that the robot 3 is in the process of being cut. The server device 2 includes the robot status information transmitted from the robot 3 in the registered robot-related information for the robot 3 registered in the individual database.

[0073] If the server device 2 is unable to communicate with the robot 3, it includes information indicating that the robot 3 is disconnected in the registered robot-related information for the robot 3. Furthermore, if the server device 2 is able to communicate with the robot 3 but the status of the robot 3 is unknown, it includes information indicating that the status of the robot 3 is unknown in the registered robot-related information for the robot 3.

[0074] In addition, the server device 2 may include location information of the robot 3 obtained via a GPS (Global Positioning System) device mounted on the robot 3 or pre-stored storage location information of the robot 3 in the registered robot-related information for the robot 3.

[0075] The information processing device 1 acquires at least a portion of the registered robot-related information for the target robot 3 stored in the target individual database on the server device 2 from the server device 2, and displays robot-related information 110 based on the acquired information.

[0076] 6 , the left screen 53 displays task list information 150, which shows a list of tasks (in other words, multiple types of tasks) that can be instructed to be performed by the target robot 3. The left screen 53 also includes a designation area 151 for designating whether to display or hide the task list information 150. As shown in FIG. 6 , when the task list information 150 is displayed on the left screen 53, selecting the designation area 151 causes the task list information 150 to be hidden. Then, when the designation area 151 is selected, the task list information 150 is displayed, as shown in FIG. 6 . Each task shown in the task list information 150 is, for example, a task related to task information registered in a target individual database in the server device 2. The multiple tasks (in other words, multiple types of tasks) shown in the task list information 150 may include tasks related to task information registered in an individual database for a tenant other than the target tenant in the server device 2.

[0077] The task list information 150 includes task-related information 160, which is information about each task. The task-related information 160 includes, for example, task identification information 161 for identifying the task. The task-related information 160 may also include at least one tag 166 attached to the task. The tag 166 is, for example, a character string, and is information that makes it easier to search for desired task-related information 160 from the task list information 150. The task identification information 161 includes, for example, a task name 162, a task summary 163, and an image 164 representing the task. The task list information 150 may also include, for example, information indicating the object to be worked on. The task summary 163 may also be, for example, storage location information for a video or the like of the task recorded on the server device 2. The image or video representing the task may also be played on the right screen 51. In the task list information 150, some of the task-related information 160 may be hidden or the display order of the task-related information 160 may be changed based on the information included in the task-related information 160.

[0078] 6 , the left screen 53 also includes a search area 96 for inputting keywords to search for the robot-related information 110 and the work-related information 160 from the robot list information 100 and the work list information 150. When the user performs a selection input to select the search area 96 on the input unit 12, the user is able to input a keyword to the information processing device 1. When the user inputs a keyword on the input unit 12, the input keyword is displayed in the search area 96. In the information processing device 1, the control unit 10 searches the robot list information 100 and the work list information 150 for the robot-related information 110 and the work-related information 160 that include the input keyword. Then, the control unit 10 causes the display unit 13 to hide or delete the robot-related information 110 and the work-related information 160 other than the robot-related information 110 and the work list information 150 that include the input keyword.

[0079] <Regarding the Dashboard Screen Included in the Main Screen> The status graph 70 included in the dashboard screen 60 is, for example, a doughnut graph. The status graph 70 shows, for example, the proportion of the number of target robots 3 in each status described with reference to FIG. 8 relative to the total number of target robots 3. In the examples of FIGS. 5 to 7, the multiple target robots 3 managed by the target tenant only include disconnected target robots 3, target robots 3 experiencing errors, and target robots 3 on standby. Therefore, the status graphs 70 shown in FIGS. 5 to 7 show the proportion of the number of disconnected target robots 3 (indicated by "Disconnected" in the figures), the proportion of the number of target robots 3 experiencing errors (indicated by "Error" in the figures), and the proportion of the number of waiting target robots 3 (indicated by "Waiting" in the figures).

[0080] FIG. 9 is a schematic diagram showing the entire work result screen 80 included in the dashboard screen 60. The work result screen 80, which shows the results of work performed by multiple target robots 3 managed by the target tenant over a predetermined period, includes an input area 81 for inputting the predetermined period. When the user selects the input area 81, the user can input the predetermined period to the information processing device 1. When the user inputs the predetermined period into the input unit 12, the input predetermined period (also referred to as the input predetermined period) is displayed in the input area 81. The work result screen 80 shows the results of work performed by multiple target robots 3 managed by the target tenant over the input predetermined period. The input period may be the contract period of the target tenant.

[0081] The data shown in the status graph 70 or the work result screen 80 may be data relating to the target robot 3 displayed in the robot list information 100 on the left screen 53 among the target robots 3. The data shown in the status graph 70 or the work result screen 80 may also be data relating to the target robot 3 that previously performed the work displayed in the work list information 150 on the left screen 53 among the target robots 3, or the target robot 3 currently performing the work.

[0082] The work result screen 80 includes an instruction area 88 for instructing the display of a selection screen 120. The selection screen 120 is a screen for selecting whether to display the results of all work performed by multiple target robots 3 managed by the target tenant during an input predetermined period on the work result screen 80, or to display the results of one specific type of work performed by multiple target robots 3 managed by the target tenant during an input predetermined period on the work result screen 80. When the instruction area 88 is selected by the user, the selection screen 120 is displayed on the display unit 13.

[0083] FIG. 10 is a schematic diagram showing an example of a selection screen 120. The selection screen 120 is displayed, for example, above the work result screen 80. The selection screen 120 includes a selection area 121 for selecting a task whose results will be displayed on the work result screen 80. The selection area 121 is, for example, in a drum roll format. The user can select a task whose results will be displayed on the work result screen 80 by operating the selection area 121 with a finger, a cursor, or the like. By operating the selection area 121, the user can select whether to display on the work result screen 80 the results of all tasks performed by multiple target robots 3 managed by the target tenant during an input predetermined period, or to display on the work result screen 80 the results of one specific type of task performed by multiple target robots 3 managed by the target tenant during an input predetermined period.

[0084] The selection screen 120 also includes a designation area 123 for designating to hide the selection screen 120. When the designation area 123 is selected, the display unit 13 hides the selection screen 120.

[0085] Note that, on the work result screen 80, a pop-up menu that allows the user to select whether to display on the work result screen 80 the results of all work performed by the multiple target robots 3 managed by the target tenant during an input predetermined period, or to display on the work result screen 80 the results of one specific type of work performed by the multiple target robots 3 managed by the target tenant during an input predetermined period, may be displayed instead of the instruction area 88. In this case, the display of the selection screen 120 becomes unnecessary.

[0086] The work result screen 80 displays work time information 83 for all of the target robots 3 managed by the target tenant. The work time information 83 may be, for example, an average cycle time 83. The average cycle time refers to the average work time required to successfully complete one work operation. The average cycle time is also called takt time. The work result screen 80 may display the average cycle time 83 per day or the average cycle time 83 per hour. The work result screen 80 includes a designation area 85a for instructing the display of the average cycle time 83 per day and a designation area 85b for instructing the display of the average cycle time 83 per hour. As shown in the example of FIG. 9 , when the designation area 85b is selected in a case where the average cycle time 83 per day is displayed on the work result screen 80, the average cycle time 83 per hour is displayed on the work result screen 80. On the other hand, when the work result screen 80 shows the average cycle time 83 per hour, if the designation area 85a is selected, the work result screen 80 shows the average cycle time 83 per day. When the work result screen 80 shows the results of all work performed during the input predetermined period, the average cycle time 83 for all of the work as a whole is shown on the work result screen 80. On the other hand, when the work result screen 80 shows the results of one specific type of work performed during the input predetermined period, the work result screen 80 shows the average cycle time 83 for that specific type of work.

[0087] The work result screen 80 also includes information 84 indicating whether the average cycle time 83 shown on the work result screen 80 is the average cycle time 83 for one day or the average cycle time 83 for one hour.

[0088] The task result screen 80 also displays graph information 86 indicating the results of the task within the input predetermined period. The graph information 86 may be, for example, a two-axis graph 86. The two-axis graph 86 displays a stacked bar graph indicating the number of task errors (indicated by "error" in the figure), the number of task failures (indicated by "fail" in the figure), and the number of task successes (indicated by "success" in the figure). The number of task errors is the number of tasks in which an error occurred. If an error occurs in the robot 3 during task execution, causing the robot 3 to stop and be unable to resume the task by itself, it is considered that an error occurred in the task. The number of task failures is the number of tasks that failed. If the robot 3 failed in a task but was able to perform the next task on its own, it is considered that the task failed. The number of task successes is the number of tasks that were successful. The left axis of the two-axis graph 86 indicates the number of tasks.

[0089] The two-axis graph 86 also shows a dashed line graph indicating the task error rate (indicated as "error rate" in the figure) and a solid line graph indicating the task failure rate (indicated as "fail rate" in the figure). The task error rate means the ratio of the number of tasks in which an error occurred to the total number of tasks. The task failure rate means the ratio of the number of tasks that failed to the total number of tasks. The right axis of the two-axis graph 86 shows the rate.

[0090] 9, the number of tasks in which an error occurred during the specified input period is zero, so the broken line graph showing the task error rate is not shown.Furthermore, the number of tasks in which an error occurred is not shown in the stacked bar graph.

[0091] When the work result screen 80 shows the results of all work performed within a specified input period, the number of work errors, the number of work failures, the number of work successes, the work error rate, and the work failure rate for all of the work are shown in a two-axis graph 86. On the other hand, when the work result screen 80 shows the results of one specific type of work performed within a specified input period, the two-axis graph 86 shows the number of work errors, the number of work failures, the number of work successes, the work error rate, and the work failure rate for that specific type of work.

[0092] The work result screen 80 also includes a designation area 89 for instructing the display of an error list screen 890, which shows a list of errors. When the designation area 89 is selected, the display unit 13 displays the error list screen 890.

[0093] 11 is a schematic diagram showing an example of the display of the error list screen 890. The error list screen 890 is displayed, for example, on the dashboard screen 60. The error list screen 890 includes, for example, error information 895 related to each error. The error information 895 includes, for example, a date and time 891 when the error occurred, a name 892 of the target robot 3 in which the error occurred, and a name 893 of the operation in which the error occurred. When the error information 895 is selected, detailed information related to the error is displayed on the display unit 13. The error list screen 890 also includes an instruction area 898 for instructing to hide the error list screen 890. When the instruction area 898 is selected, the display unit 13 hides the error list screen 890.

[0094] <Regarding Creation of Work Content> When the input unit 12 receives a selection input for selecting the instruction area 94, an input screen 550 for inputting information about the work for which work content is to be created is displayed on the display unit 13. Fig. 12 is a schematic diagram showing an example of the input screen 550. The input screen 550 is displayed, for example, on the main screen 50.

[0095] The input screen 550 includes an input area 551 for inputting the name 162 of the work for which work content is to be created. When the user performs a selection input to the input unit 12 to select the input area 551, the name 162 can be input to the information processing device 1. When the user inputs the name 162 to the input unit 12, the input name 162 is displayed in the input area 551.

[0096] The input screen 550 includes an input area 553 for inputting an outline 163 of the work for which work content is to be created. When the user selects the input area 553, the outline 163 can be input to the information processing device 1. When the user inputs the outline 163 into the input unit 12, the input outline 163 is displayed in the input area 553.

[0097] The input screen 550 includes a designation area 555 for instructing the display of a selection screen 556 for selecting a tag 166 to be attached to the work for which work content is to be created. When the designation area 555 is selected, the selection screen 556 is displayed as shown in FIG. 13, for example.

[0098] Selection screen 556 is displayed, for example, on input screen 550. Selection screen 556 includes a plurality of tags 166. The user can select at least one tag 166 to be attached to the work from the plurality of tags 166 included in selection screen 556. When the user performs a selection input to input unit 12 to select a tag 166 included in selection screen 556, the selected tag 166 is set as the tag 166 to be attached to the work.

[0099] The input screen 550 includes an input area 557 for inputting notes related to the work for which work content is to be created. When the user selects the input area 557, the user can input the notes to the information processing device 1. When the user inputs the notes into the input unit 12, the input notes are displayed in the input area 557.

[0100] The input screen 550 includes a designation area 559 for instructing the display of the next screen. After the user inputs information about the task for which work content is to be created, such as the name 162, when the user selects the designation area 559, a creation screen 170 for creating work content is displayed on the display unit 13. Note that the display of the input screen 550 and the creation screen 170 may be switchable using tabs.

[0101] FIG. 14 is a schematic diagram showing an example of the creation screen 170. The creation screen 170 is displayed, for example, on the main screen 50. In this example, a task is composed of one basic process or a combination of multiple basic processes. That is, the task content is expressed by one basic process or a combination of multiple basic processes. Multiple types of basic processes are registered in the server device 2. Information about the multiple types of basic processes is stored in the database of the server device 2. The information processing device 1 displays the creation screen 170 based on information about the multiple types of basic processes acquired from the server device 2. The task content is created by the user selecting at least one basic process from the multiple types of basic processes. The basic process can also be considered a basic operation. The multiple types of basic processes may include, for example, a process for moving an object from one area to another, a process for recognizing an object, or a process for holding loose objects.

[0102] The creation screen 170 includes a basic process list screen 180 that displays a list of multiple types of basic processes, and a work content screen 171 that displays the work content being created. The basic process list screen 180 includes a basic process image 190 representing each of the multiple types of basic processes. The basic process image 190 includes, for example, a name 191 of the basic process, a version 193 of the program for executing the basic process, and a graphic 195 representing the basic process. Note that if the graphic 195 representing the basic process does not exist, for example, "NO Image" is displayed.

[0103] The basic processing image 190 also includes a designation area 197 for instructing the display of a setting screen for setting details of the basic processing. When the designation area 197 is selected, a setting screen for setting details of the basic processing is displayed. The user can use the setting screen to set details of the basic processing in the robot system 5.

[0104] The basic processing list screen 180 includes a search area 185 for inputting a keyword for searching for a desired basic processing image 190 from among the multiple basic processing images 190. When the search area 185 is selected, it becomes possible to input a search keyword to the information processing device 1. When the user inputs a search keyword into the input unit 12, the input keyword is displayed in the search area 185. In the information processing device 1, the control unit 10 searches among the multiple basic processing images 190 for basic processing images 190 that include the input keyword. Then, the control unit 10 causes the display unit 13 to hide basic processing images 190 other than the basic processing images 190 that include the input keyword.

[0105] The creation screen 170 includes a designation area 173 for designating whether or not to display the basic process list screen 180. When the designation area 173 is selected, the basic process list screen 180 is hidden.

[0106] The work content screen 171 displays, for example, a flow diagram of the work content. The work content screen 171 displays a start image 171a representing the start of the work and an end image 171b representing the end of the work. The user can select a basic process image 190 included in the basic process list screen 180 and then perform a predetermined input on the input unit 12 to place an imitation basic process image 190a, which is an imitation of the selected basic process image 190, between the start image 171a and the end image 171b on the work content screen 171. The user can place the imitation basic process image 190a between the start image 171a and the end image 171b by, for example, performing a drag-and-drop operation on the input unit 12. By placing the imitation basic process image 190a between the start image 171a and the end image 171b, work content including the basic process represented by the imitation basic process image 190a is created.

[0107] 15 is a schematic diagram showing an example of a state in which one imitation basic process image 190a is arranged between a start image 171a and an end image 171b. FIG. 16 is a schematic diagram showing an example of a state in which a plurality of imitation basic process images 190a are arranged between a start image 171a and an end image 171b. The shape and content of the imitation basic process image 190a vary from the shape and content of the basic process image 190 included in the basic process list screen 180 that corresponds to the imitation basic process image 190a. For example, the version 193 is not shown in the imitation basic process image 190a.

[0108] When the imitation basic process image 190a is placed between the start image 171a and the end image 171b, the basic process list screen 180 is automatically hidden. Furthermore, a designation area 174 (see FIGS. 15 and 16) for instructing the display of the basic process list screen 180 is shown on the creation screen 170. When the designation area 174 is selected, the basic process list screen 180 is displayed as in the example of FIG. 14.

[0109] Furthermore, when the imitation basic processing image 190a is placed between the start image 171a and the end image 171b, a name 175 of the robot 3 used to create the work content is displayed on the creation screen 170, as shown in FIGS. 15 and 16 . Furthermore, a designation area 176 for instructing the display of a setting screen for making settings related to the robot 3 used to create the work content is displayed on the creation screen 170. When the designation area 176 is selected, a setting screen for making settings related to the robot 3 used to create the work content is displayed. The user can use the setting screen to cause the robot system 5 to execute settings related to the robot 3 used to create the work content.

[0110] Furthermore, when the imitation basic process image 190a is placed between the start image 171a and the end image 171b, an instruction area 177 for instructing the user to end the creation of the work content is displayed on the creation screen 170, as shown in FIGS. 15 and 16 . When the instruction area 177 is selected, the control unit 10 ends the creation of the work content and generates work information indicating the work content displayed on the work content screen 171. At this time, the control unit 10 includes the information entered using the input screen 550 in the work information. The control unit 10 then causes the server device 2 to transmit the generated work information to the interface 14. The server device 2 includes the work information received from the information processing device 1 in the target registration tenant specific information.

[0111] <Regarding Work Execution Instructions for Robot> When the input unit 12 receives a selection input for selecting the instruction area 92, the display unit 13 displays a work selection screen 200 for selecting a work to be performed, which is a work to be performed by the robot 3. The work selection screen 200 can also be said to be a work specification screen for specifying a work to be performed.

[0112] 17 is a schematic diagram showing an example of a task selection screen 200. The task selection screen 200 is displayed, for example, on top of the main screen 50. The task selection screen 200 includes task identification information 201 that indicates task information for each task that can be instructed to be performed by the target robot 3. Similar to the task identification information 161 described above, the task identification information 201 includes, for example, a task name 162, a task summary 163, and an image 164 representing the task.

[0113] The user can select a task to be performed by selecting one piece of work identification information 201 from the plurality of pieces of work identification information 201. In other words, the user can specify a task to be performed by selecting one piece of work identification information 201 from the plurality of pieces of work identification information 201. When one piece of work identification information 201 is selected from the plurality of pieces of work identification information 201, the task identified by the selected piece of work identification information 201 becomes the task to be performed. When the input unit 12 receives a selection input selecting one piece of work identification information 201, the display unit 13 highlights the selected piece of work identification information 201. Figure 18 is a schematic diagram showing an example of how the second piece of work identification information 201 from the top of the plurality of pieces of work identification information 201 shown in Figure 17 is selected and highlighted.

[0114] The task selection screen 200 includes an instruction area 203 for instructing the display of the next screen. After the user selects one task identification information 201, that is, after selecting the task to be performed, and then selects the instruction area 203, a robot selection screen 210 is displayed on the display unit 13. Note that if the user performs a deselection input on the input unit 12 to cancel the selection of task identification information 201, the selection of that task identification information 201 is canceled. The deselection input may be, for example, the same operation as the selection input. Note that the task identification information displayed on the task selection screen 200 may be linked to the task list information 150 displayed on the left screen 53.

[0115] The robot selection screen 210 is a screen for selecting at least one target robot 3 to which work information indicating the content of the work to be performed is to be sent and which is to receive instructions to perform the work to be performed. Hereinafter, the target robot 3 to which work information indicating the content of the work to be performed is to be sent and which is to receive instructions to perform the work to be performed may be simply referred to as the destination target robot 3. The robot selection screen 210 can be said to be a specification screen for specifying at least one destination target robot 3.

[0116] FIG. 19 is a schematic diagram showing an example of the display of the robot selection screen 210. The robot selection screen 210 is displayed, for example, on the main screen 50. The robot selection screen 210 includes, for each target robot 3, robot-related information 211, which is information about the target robot 3. Similar to the robot-related information 110 described above, the robot-related information 211 includes, for example, robot identification information 111 for identifying the target robot 3 and a status graphic 118 indicating the status of the target robot 3. The robot identification information 111 includes, for example, a name 112 of the target robot 3, a model 113 of the target robot 3, information 114 indicating the type of the target robot 3, and an image 115 schematically showing the appearance of the target robot 3. Note that the robot-related information 211 does not necessarily have to include the status graphic 118. Furthermore, the robot identification information displayed on the robot selection screen 210 may be linked to the robot list information 100 displayed on the left screen 53.

[0117] The user can select at least one destination target robot 3 by selecting at least one piece of robot-related information 211 from the plurality of pieces of robot-related information 211. In other words, the user can specify at least one destination target robot 3 by selecting at least one piece of robot-related information 211 from the plurality of pieces of robot-related information 211. The selection of robot-related information 211 can also be said to be the selection of robot identification information 111 included in the robot-related information 211. When at least one piece of robot-related information 211 is selected from the plurality of pieces of robot-related information 211, at least one target robot 3 identified by the robot identification information 111 included in the selected at least one piece of robot-related information 211 is set as the destination target robot 3.

[0118] When the input unit 12 receives a selection input for selecting robot-related information 211, the display unit 13 highlights the selected robot-related information 211. Fig. 20 is a schematic diagram showing an example of how the third robot-related information 211 from the top of the plurality of pieces of robot-related information 211 shown in Fig. 19 is selected and highlighted. Fig. 21 is a schematic diagram showing an example of how the third, fourth, and fifth robot-related information 211 from the top of the plurality of pieces of robot-related information 211 shown in Fig. 19 are selected and highlighted. Note that when the user performs a deselection input on the input unit 12 to cancel the selection of robot-related information 211, the selection of that robot-related information 211 is canceled.

[0119] The robot selection screen 210 includes an instruction area 213 for instructing the display of the next screen. After the user selects at least one piece of robot-related information 211, that is, after selecting at least one destination target robot 3, when the user selects the instruction area 213, a specification screen 220 for specifying the start conditions and end conditions of the work to be performed is displayed on the display unit 13.

[0120] FIG. 22 is a schematic diagram showing an example of the display of the specification screen 220. The specification screen 220 is displayed, for example, on top of the main screen 50. The specification screen 220 includes, for example, a specification area 221 for specifying the start conditions of the work to be performed. The user can use the specification area 221 to specify the start conditions of the work to be performed. The user can specify, for example, "immediate execution" as the start condition of the work to be performed. Immediate execution means that the target robot 3 starts the work to be performed as soon as possible. The user can also specify a start time as the start condition of the work to be performed.

[0121] The specification screen 220 also includes, for example, a specification area 223 for specifying the end condition of the task to be performed. The user can use the specification area 223 to specify the end condition of the task to be performed. The user can specify, for example, the number of times the task to be performed is to be performed as the end condition of the task to be performed. The user can also specify an end time as the end condition of the task to be performed. The user can also specify that the object to be worked on no longer exists as the end condition of the task to be performed.

[0122] Furthermore, when the number of times a task to be performed is specified as a condition for completing the task, the specification screen 220 displays a plurality of setting areas 225a, 225b, 225c, and 225d for setting the number of times the task to be performed is to be performed. When the input unit 12 receives a selection input selecting setting area 225a, the set value of the number of times the task to be performed is increased by one, and when the input unit 12 receives a selection input selecting setting area 225b, the set value of the number of times the task to be performed is increased by five. When the input unit 12 receives a selection input selecting setting area 225c, the set value of the number of times the task to be performed is increased by ten. When the input unit 12 receives a selection input selecting setting area 225c, the set value of the number of times the task to be performed is reset to zero. The specification screen 220 also displays a set value 224 of the number of times the task to be performed is to be performed.

[0123] The specification screen 220 displays an input area 227 for inputting notes related to the work to be performed. When the user selects the input area 227, the user can input notes to the information processing device 1. When the user inputs notes into the input unit 12, the input notes are displayed in the input area 227.

[0124] The specification screen 220 includes a specification area 229 for specifying the display of the next screen. When the user selects the specification area 229 after specifying the start condition and the end condition, the display unit 13 displays a confirmation screen 230 for confirming the information specified using the work selection screen 200, the robot selection screen 210, and the specification screen 220.

[0125] 23 is a schematic diagram showing an example of the display of the confirmation screen 230. The confirmation screen 230 displays, for example, the name 162 of the selected task to be performed and the name 112 of at least one selected destination target robot 3. The confirmation screen 230 also displays a start condition 231 specified for the task to be performed and an end condition 232 specified for the task to be performed. The confirmation screen 230 also displays a set value 233 for the number of times the task to be performed is to be performed when the number of times the task to be performed is specified as the end condition for the task to be performed. The confirmation screen 230 also displays notes 234 entered using the input field 227 on the specification screen 220.

[0126] The confirmation screen 230 also includes an instruction area 235 for instructing the transmission of task information indicating the content of the selected task to at least one selected destination target robot 3. When the user selects the instruction area 235 after confirming the information displayed on the confirmation screen 230, the control unit 10 generates transmission instruction information instructing the transmission of task information indicating the content of the selected task to at least one selected destination target robot 3. The control unit 10 then causes the interface 14 of the server device 2 to transmit the generated transmission instruction information. The transmission instruction information includes, for example, information for identifying the selected task to be performed and information for identifying the at least one selected destination target robot 3. The transmission instruction information also includes start and end conditions for the task to be performed. When the information processing device 1 transmits the transmission instruction information to the server device 2, the display unit 13 displays a notification screen 240 notifying the completion of transmission of the transmission instruction information. The display unit 13 may also display the estimated time the task is to be completed.

[0127] 24 is a schematic diagram showing a display example of notification screen 240. Notification screen 240 is displayed, for example, on main screen 50. Notification screen 240 shows instruction area 241 for instructing to erase the display of notification screen 240. When instruction area 241 is selected, display unit 13 hides notification screen 240 and displays main screen 50.

[0128] The server device 2, which has received the transmission instruction information from the information processing device 1, generates execution instruction information instructing the execution of a task and transmits it to the destination target robot 3. The execution instruction information includes task information that indicates the content of the task to be performed, which is stored in the target individual database. The execution instruction information also includes the start conditions and end conditions of the task to be performed, which are included in the transmission instruction information that the server device 2 received from the information processing device 1. If the task information, start conditions, and end conditions are collectively referred to as task processing information, the execution instruction information includes task processing information for the task to be performed. The server device 2 transmits the execution instruction information to the robot controller 3a of at least one destination target robot 3 selected by the user.

[0129] The robot controller 3a that receives the execution instruction information controls the robot mechanism 3b based on the received execution instruction information. As a result, the destination target robot 3 executes the execution target work related to the work information included in the execution instruction information received from the server device 2. The destination target robot 3 starts the execution target work according to the start condition included in the execution instruction information, and ends the execution target work according to the end condition included in the execution instruction information. If the process from the start of a work according to the start condition to the end of a work according to the end condition is called a work process, then the execution instruction information can also be said to be information that instructs the execution of the work process. When the server device 2 sends the execution instruction information to the robot 3, it can also be said that the server device 2 instructs the robot 3 to execute the work process.

[0130] If the start condition is "immediate execution," the destination target robot 3 will execute the task to be performed as soon as possible. For example, if the destination target robot 3 is performing another task when it receives the task information, it will start the task to be performed as soon as the other task is finished. If the start condition is specified by a start time, the destination target robot 3 will start the task to be performed at the start time. If the end condition is specified by a number of executions, the destination target robot 3 will execute the task to be performed the number of executions set. If the end condition is specified by an end time, the destination target robot 3 will repeatedly execute the task to be performed until the end time. If the end condition is specified as the disappearance of the object to be worked on, the destination target robot 3 will repeatedly execute the task to be performed until the object to be worked on no longer exists.

[0131] In this way, in this example, when a task execution instruction (in other words, a task processing execution instruction) is given to the robot 3, task information indicating the content of the task to be performed, the start conditions of the task to be performed, and the end conditions of the task to be performed are notified from the server device 2 to the robot 3. Based on the notified information, the robot 3 executes the task processing in which the task to be performed is performed at least once.

[0132] As described above, in this example, the display unit 13 displays the robot selection screen 210 for selecting at least one destination target robot 3 via the input unit 12, making it easier for the user to select the destination target robot 3. This improves the convenience of the information processing device 1. Furthermore, since it is possible to select multiple destination target robots 3 on the robot selection screen 210, it is possible to issue instructions to multiple robots 3 to perform the same task.

[0133] Furthermore, in this example, for example, the robot selection screen 210 or the robot list information 100 (see FIG. 5, etc.) displays information 114 indicating the type of robot 3. Therefore, the user can select the destination target robot 3 after checking the information 114 indicating the type of robot 3. This makes it easier for the user to select the destination target robot 3.

[0134] In this example, for example, the status of the robot 3 is shown by a status graphic 118 on the robot selection screen 210 or the robot list information 100 (see FIG. 5, etc.). This allows the user to select a destination target robot 3 after checking the status of the robot 3. This makes it easier for the user to select a destination target robot 3.

[0135] In addition, in this example, the display unit 13 displays the task selection screen 200 for selecting the task to be performed via the input unit 12, making it easier for the user to select the task to be performed. This improves the convenience of the information processing device 1.

[0136] Furthermore, in this example, the control unit 10 causes the display unit 13 to display multiple pieces of robot identification information and communication connection statuses so that the user can select, via the input unit 12, at least one robot 3 to execute at least one target task selected by the user from among multiple tasks indicated by multiple pieces of task information generated using any of the multiple robots 3. This allows the user to select at least one robot 3 to execute the target task after checking the multiple pieces of robot identification information and communication connection statuses. This makes it easier for the user to select at least one robot 3 to execute the target task. As a result, the convenience of the information processing device 1 is improved.

[0137] <Displaying detailed robot information> When the user selects robot-related information 110 displayed on the main screen 50, a robot details screen 300 is displayed on the main screen 50, showing detailed information about the target robot 3 corresponding to the selected robot-related information 110. The robot-related information 110 can also be said to be an instruction area for instructing the display of the robot details screen 300. When the robot-related information 110 is selected, the display unit 13 displays the robot details screen 300 on the right screen 51 of the main screen 50, instead of the dashboard screen 60. The selected robot-related information 110 is displayed, for example, highlighted. Hereinafter, the target robot 3 corresponding to the selected robot-related information 110 may be referred to as the selected robot 3.

[0138] Fig. 25 is a schematic diagram showing a display example of the main screen 50 including the robot details screen 300. In the example of Fig. 24, the robot-related information 110 for the target robot 3, whose name 112 is "Robot 4", is selected.

[0139] The robot details screen 300 includes, for example, a basic screen 310 showing basic information about the selected robot 3, and a details screen 320 showing detailed information about the selected robot 3. The robot details screen 300 also includes a plurality of designation areas 391, 392, 393, and 394 for switching the content of the details screen 320.

[0140] The basic screen 310 includes, for example, information similar to the selected robot-related information 110. The basic screen 310 includes, for example, a name 112 of the selected robot 3, a model 113 of the selected robot 3, information 114 indicating the type of the selected robot 3, an image 115 that schematically shows the appearance of the selected robot 3, and a status graphic 118 that indicates the status of the selected robot 3. Furthermore, the basic screen 310 includes, for example, an overview 311 of the selected robot 3 and a serial number 312 of the selected robot 3.

[0141] The basic screen 310 also includes an instruction area 315 similar to the instruction area 92. The instruction area 315 is an area for instructing the start of processing for issuing an instruction to the robot 3 to perform a task. When the instruction area 315 is selected, the above-described task selection screen 200 is displayed on the display unit 13. However, in this case, when the task selection screen 200 is switched to the robot selection screen 210, the robot-related information 211 for the selected robot 3 is selected on the robot selection screen 210.

[0142] The instruction area 391 is an area for instructing the display of a list screen 330 showing a list of tasks that have been instructed to be performed in the past to the selected robot 3 as the details screen 320. The instruction area 392 is an area for instructing the display of a dashboard screen 360 showing the results of tasks that have been performed in the past by the selected robot 3. The instruction area 393 is an area for instructing the display of a performance information screen 370 showing the performance of the selected robot 3. The instruction area 394 is an area for instructing the display of a notes screen 380 showing notes regarding the selected robot 3.

[0143] When the instruction area 391 is selected, a list screen 330 is displayed as the details screen 320, as shown in FIG. 25 . The list screen 330 includes work process-related information 331 related to each work process that the selected robot 3 has been instructed to perform in the past. The work process-related information 331 includes, for example, the name 162 of the work performed in the work process, result information 333 indicating the result of the work process, and an execution instruction date and time 335 when the instruction to perform the work process was given to the selected robot 3. The execution instruction date and time 335 may be, for example, the date and time when the instruction area 235 (see FIG. 23 ) included in the confirmation screen 230 described above was selected. The result information 333 includes the number of work errors, the number of work failures, and the number of work successes for one work process. In FIG. 25 , the number of work errors is represented by the number next to "Error," the number of work failures is represented by the number next to "Fail," and the number of work successes is represented by the number next to "Success." The result information 333 can also be said to be information indicating the results of a task that was previously instructed to be performed by the selected robot 3. The result information 333 may include at least one of the number of times the task was performed in the task process and the execution time of the task process.

[0144] The work processing related information 331 also includes a status graphic 337 that represents the status of the work processing. The status graphic 337 can also be said to be information that represents the status of the work processing. In this example, ten types of status graphic 337a to 337j are prepared as the status graphic 337. The work processing related information 331 includes any one of the ten types of status graphic 337a to 337j.

[0145] 26 is a schematic diagram showing examples of ten types of status graphics 337a to 337j. Status graphic 337a indicates that an instruction to send work information indicating the content of the work to be performed in the work process has been sent to the server device 2, but an instruction to execute the work process has not been sent to the selecting robot 3. Status graphic 337b indicates that an instruction to execute the work process has been sent to the selecting robot 3, but the selecting robot 3 has not yet recognized that it has received the instruction to execute the work process. Status graphic 337c indicates that the selecting robot 3 recognizes that it has received an instruction to execute the work process from the server device 2, but the work process has not yet started.

[0146] Status graphic 337d indicates that the work process is currently being executed. Status graphic 337e indicates that the work process row was successful. Status graphic 337f indicates that the work process failed. Status graphic 337g indicates that an error occurred in the selected robot 3, causing the selected robot 3 to stop and be unable to start the work on its own, resulting in the work process being terminated midway. In this example, if the robot 3 fails a certain task in the work process but is then able to continue and perform the next task, the work process is considered to have failed. Therefore, if a task is performed multiple times in the work process and the task fails even once, the work process is considered to have failed. Furthermore, if the task does not fail even once in the work process, the work process is considered to have been successful. Therefore, if a task is performed N times in the work process (N is an integer greater than or equal to 2), and the task is successful all N times, the work process is considered to have been successful.

[0147] The status graphic 337h indicates that the server device 2 has canceled the instruction to execute the work process. The status graphic 337i indicates that the selected robot 3 has rejected the instruction to execute the work process. The selected robot 3 will reject the instruction to execute the work process if, for example, it is unable to execute the instructed work due to its own performance. For example, if the selected robot 3 is an AGV robot, it will reject the instruction to execute the instructed work if the instructed work is a work specialized for an arm robot, as it cannot execute the work. As another example, if the selected robot 3 is a single-arm robot, it will reject the instruction to execute the instructed work if the instructed work is a work specialized for a double-arm robot, as it cannot execute the work. The status graphic 337j indicates that the status of the work process is unknown.

[0148] The list screen 330 includes a designation area 339 for designating whether to display or hide work processing-related information 331 related to completed work processing. When work processing-related information 331 related to completed work processing is displayed on the list screen 330, selecting the designation area 339 causes the work processing-related information 331 related to the completed work processing to be erased from the list screen 330. On the other hand, when work processing-related information 331 related to completed work processing is not displayed on the list screen 330, selecting the designation area 339 causes the work processing-related information 331 related to the completed work processing to be displayed on the list screen 330.

[0149] When the work processing related information 331 is selected by the user, a details screen 340 showing detailed information about the work processing corresponding to the selected work processing related information 331 is displayed on the display unit 13. Figure 27 is a schematic diagram showing an example of the details screen 340.

[0150] 27, the details screen 340 is displayed, for example, on the main screen 50. The details screen 340 includes basic information 341 of the work process, detailed information 345 of the work process, and an instruction area 342.

[0151] The basic information 341 includes the name 162 of the work to be performed in the work process, and the execution instruction date and time 335 when the execution instruction for the work process was given to the selection robot 3. The basic information 341 also includes user identification information 33 of the user when the execution instruction for the work process was given to the selection robot 3.

[0152] The detailed information 345 includes the name 112 of the selecting robot 3 that received the instruction to perform the task and an image 115 that schematically illustrates the appearance of the selecting robot 3. The detailed information 345 also includes result information 333 indicating the result of the task and a status string 346 that indicates the status of the task. In FIG. 26, the status string 346, which has the same meaning as the status graphics 337a-337j, is shown to the right of the status graphics 337a-337j. In the example of FIG. 27, the status string 346 is expressed as "SUCCEEDED," and thus, like the status graphic 337e, the status string 346 indicates that the task was successful. The detailed information 345 also includes the date and time 347 when the task started and the time 348 from the start to the end of the task. The time 348 can also be considered the execution time of the task. The detailed information 345 may also include an instruction area for instructing the selecting robot 3 to interrupt the task it is currently performing. When this instruction area is selected, an instruction to interrupt the work is sent from the information processing device 1 to the selection robot 3 via the server device 2. Note that the instruction area for instructing the selection robot 3 to interrupt the work being performed by the selection robot 3 may be displayed only for work that the signed-in user has instructed to be performed by himself / herself. In other words, work that another user has instructed to be performed may be controlled so that it cannot be interrupted.

[0153] The instruction area 342 is an area for instructing not to display the details screen 340. When the instruction area 342 is selected by the user, the display unit 13 hides the details screen 340.

[0154] The details screen 340 may include instruction areas similar to the instruction areas 92 and 315. When a selection input is made to select this instruction area, an instruction to execute the work process corresponding to the selected work process related information 331 may be given to the target robot 3 shown on the details screen 340. At that time, the work conditions, such as the number of times of work, may be the same as those instructed previously.

[0155] When the detailed information 345 is selected by the user, a details screen 350 showing more detailed information about the work process is displayed on the display unit 13. Fig. 28 is a schematic diagram showing an example of the details screen 350.

[0156] 28 , the details screen 350 is displayed, for example, on top of the main screen 50. The details screen 350 includes, for example, basic information 341 of the work process, the name 112 of the selected robot 3 that has received the instruction to perform the work process, a status graphic 337 that represents the status of the work process, and a status character string 346 that represents the status of the work process. The details screen 350 also includes work-related information 351, which is information related to the work performed in the work process. The work-related information 351 includes result information 352 that indicates the result of the work, and a date and time 353 when the work started. The result information 352 is displayed, for example, as "ERROR" if an error occurs in the work, as "FAIL" if the work fails, and as "SUCCESS" if the work is successful.

[0157] When at least one of the result information 352 and the date and time 353 included in the task-related information 351 is selected, detailed task information may be displayed. The detailed task information may include result information indicating the result of the object recognition performed in that task. The result information may include a mask image or a bounding box indicating the recognized object, or a score indicating the confidence level of the object recognition. The detailed task information may also include an actual machine image captured during the object recognition performed in that task. In this case, a mask image or a bounding box indicating the recognized object may be displayed on the actual machine image, or a score indicating the confidence level of the object recognition may be displayed.

[0158] When the work-related information 351 is selected by the user, the log information of the work corresponding to the selected work-related information 351 is displayed on the display unit 13. The log information may include, for example, information representing the movement of the selected robot 3 performing the work.

[0159] The details screen 350 includes a designation area 343 for designating the display of the previous screen, the details screen 340. When the designation area 343 is selected, the display unit 13 hides the details screen 350 and displays the details screen 340 as shown in FIG.

[0160] When the instruction area 392 is selected, a dashboard screen 360 is displayed as the details screen 320. FIG. 29 is a schematic diagram showing an example of the display of the main screen 50 including the dashboard screen 360 as the details screen 320. The dashboard screen 360 has a similar configuration to the work result screen 80 shown in FIG. 9 described above. The dashboard screen 360 shows the results of work performed by the selection robot 3 during a predetermined period. The dashboard screen 360 includes an input area 361 for inputting the predetermined period, similar to the input area 81 described above.

[0161] The dashboard screen 360 includes an instruction area 368 for instructing the display of a selection screen for selecting whether to display on the dashboard screen 360 the results of all tasks (in other words, all types of tasks) performed by the selection robot 3 during a predetermined period, or the results of a specific task (in other words, a specific type of task) performed by the selection robot 3 during a predetermined period. When the instruction area 368 is selected by the user, a selection screen similar to the above-described selection screen 120 is displayed on the display unit 13. The user can use the selection screen to select tasks whose results are to be displayed on the dashboard screen 360. In other words, the user can use the selection screen to select whether to display on the dashboard screen 360 the results of all tasks performed by the selection robot 3 during a predetermined period, or the results of a specific task performed by the selection robot 3 during a predetermined period.

[0162] The dashboard screen 360 includes an average cycle time 363 for the tasks performed by the selected robot 3. The dashboard screen 360 may display the average cycle time 363 for one day, or may display the average cycle time 363 for one hour. The dashboard screen 360 includes a designation area 365a for instructing the display of the average cycle time 363 for one day, and a designation area 365b for instructing the display of the average cycle time 363 for one hour. The designation areas 365a and 365b are similar to the designation areas 85a and 85b described above. When the dashboard screen 360 displays the results of all tasks for a predetermined period, the dashboard screen 360 displays the average cycle time 363 for all tasks for the predetermined period. On the other hand, when the dashboard screen 360 displays the results of a specific task for the predetermined period, the dashboard screen 360 displays the average cycle time 363 for the specific task for the predetermined period.

[0163] The dashboard screen 360 also includes information 364 indicating whether the average cycle time 363 shown on the dashboard screen 360 is the average cycle time 363 for one day or the average cycle time 363 for one hour.

[0164] The dashboard screen 360 also displays a two-axis graph 366 that shows the results of tasks performed by the selected robot 3 over a predetermined period of time. Similar to the above-described two-axis graph 86, the two-axis graph 366 displays a stacked bar graph showing the number of task errors (shown as "error" in the figure), the number of task failures (shown as "fail" in the figure), and the number of task successes (shown as "success" in the figure). Similarly to the above-described two-axis graph 86, the two-axis graph 366 also displays a dashed line graph showing the task error rate (shown as "error rate" in the figure) and a solid line graph showing the task failure rate (shown as "fail rate" in the figure).

[0165] When the dashboard screen 360 shows the results of all tasks over a predetermined period, the number of task errors, the number of task failures, the number of task successes, the task error rate, and the task failure rate for all tasks over the predetermined period are shown in the two-axis graph 366. On the other hand, when the dashboard screen 360 shows the results of one specific task over a predetermined period, the two-axis graph 366 shows the number of task errors, the number of task failures, the number of task successes, the task error rate, and the task failure rate for that specific task over the predetermined period.

[0166] When the designation area 393 is selected, a performance information screen 370 is displayed as the details screen 320. Figure 30 is a schematic diagram showing an example of the display of the main screen 50 including the performance information screen 370 as the details screen 320.

[0167] As shown in Figure 30, the performance information screen 370 includes, for example, a software information screen 371 that shows the software installed on the selected robot 3, and a hardware information screen 375 that shows information about the hardware that the selected robot 3 is equipped with.

[0168] The software information screen 371 includes, for example, AI software identification information 372 for identifying AI software installed in the robot controller 3a of the selected robot 3, and algorithm software identification information 373 for identifying algorithm software installed in the robot controller 3a of the selected robot 3. AI is an abbreviation for Artificial Intelligence.

[0169] 30 , the software information screen 371 displays AI software identification information 372a for identifying AI software for recognizing the color of an object, AI software identification information 372b for identifying AI software for recognizing nuts, which are industrial parts, AI software identification information 372c for identifying AI software for recognizing springs, which are industrial parts, and AI software identification information 372d for identifying AI software for recognizing stationery. Also, in the example of Fig. 30 , the software information screen 371 displays algorithm software identification information 373a for identifying an algorithm software package made up of multiple algorithm software for controlling the arm of the selection robot 3, and algorithm software identification information 373b for identifying an algorithm software package made up of multiple algorithm software for controlling the hand of the selection robot 3. Note that the information included in the software information screen 371 is not limited to this.

[0170] The hardware information screen 375 includes, for example, robot mechanism configuration information 376 that indicates the hardware configuration of the robot mechanism 3b. In the example of FIG. 30 , the hardware information screen 375 displays the robot mechanism configuration information 376 indicating that the number of axes of the arm of the robot mechanism 3b is six and that the hand of the robot mechanism 3b is of a suction type. The hardware information screen 375 may also include controller hardware information 377 related to the hardware of the robot controller 3a. In the example of FIG. 30 , the hardware information screen 375 displays the controller hardware information 377 that indicates the total storage capacity of the storage unit provided in the robot controller 3a and the free space in the storage unit. However, the information included in the hardware information screen 375 is not limited to this.

[0171] When the instruction area 394 is selected, a remarks screen 380 is displayed as the details screen 320. Fig. 31 is a schematic diagram showing a display example of the main screen 50 including the remarks screen 380 as the details screen 320. As shown in Fig. 30, the remarks screen 380 includes an input area 381 for inputting a remark regarding the selected robot 3. By selecting the input area 381, the user can input a remark to the information processing device 1. When the user inputs a remark into the input unit 12, the input remark is displayed in the input area 381.

[0172] In this way, in this example, for example, on the list screen 330 (see FIG. 25), the details screen 340 (see FIG. 27), or the details screen 350 (see FIG. 28), the status of the work that the robot 3 was instructed to perform in the past is shown by the status graphic 337 or the status character string 346. Therefore, the user can select the destination target robot 3 after checking the status of the work that the robot 3 was instructed to perform in the past. This makes it easier for the user to select the destination target robot 3.

[0173] In this example, for example, the list screen 330, the details screen 340, the details screen 350, or the dashboard screen 360 (see FIG. 29) displays the results of work that the robot 3 has been instructed to perform in the past. This allows the user to select a destination target robot 3 after checking the results of work that the robot 3 has been instructed to perform in the past. This makes it easier for the user to select a destination target robot 3.

[0174] In this example, the performance of the robot 3 is also displayed on the performance information screen 370 (see FIG. 30), for example. This allows the user to select the destination robot 3 after checking the performance of the robot 3. This makes it easier for the user to select the destination robot 3.

[0175] <Displaying detailed information related to work> When a user selects work-related information 160 displayed on the main screen 50, a work details screen 400 showing detailed information related to the work corresponding to the selected work-related information 160 is displayed on the main screen 50. When the input unit 12 receives a selection input for selecting work-related information 160, the display unit 13 displays the work details screen 400 on the right screen 51 of the main screen 50, instead of the dashboard screen 60. The selected work-related information 160 is displayed, for example, in a highlighted manner. Hereinafter, the work corresponding to the selected work-related information 160 may be referred to as the selected work.

[0176] Fig. 32 is a schematic diagram showing a display example of the main screen 50 including the work details screen 400. In the example of Fig. 32, the work-related information 160 of the work whose name 162 is "Job 1" is selected.

[0177] The work details screen 400 includes, for example, a basic screen 410 that shows basic information about the selected work, and a details screen 420 that shows detailed information about the selected work. The work details screen 400 also includes a plurality of designation areas 491, 492, 493, and 494 for switching the content of the details screen 420.

[0178] The basic screen 410 includes, for example, a name 162 of the selected work and an overview 163 of the selected work. The basic screen 410 also includes a designation area 415 similar to the designation areas 92 and 315. When the designation area 415 is selected, the above-described work selection screen 200 is displayed on the display unit 13. However, in this case, the work selection screen 200 shows that the work identification information 201 for the selected work has been selected.

[0179] The instruction area 491 is an area for instructing the display of a list screen 430 showing a list of past execution instructions for the selected task as the details screen 420. The instruction area 492 is an area for instructing the display of a result screen 460 showing past execution results of the selected task. The instruction area 493 is an area for instructing the display of a task content screen 470 showing the content of the selected task. The instruction area 494 is an area for instructing the display of a remarks screen 490 showing remarks regarding the selected task.

[0180] When the instruction area 491 is selected, a list screen 430 is displayed as the details screen 420, as shown in FIG. 32 . The list screen 430 includes execution instruction-related information 431 related to each past execution instruction for the selected task. As can be understood from the above description, in this example, an instruction to execute a task for the robot 3 can also be considered to be an instruction to execute a task process in which the task is performed at least once. Therefore, the execution instruction-related information 431 can also be considered to be information about a task process (also referred to as a selected task process) in which the selected task is performed at least once. The execution instruction-related information 431 includes, for example, a date 432 on which the instruction to execute the selected task was issued (in other words, a date 432 on which the instruction to execute the selected task process was issued). The date 432 may be, for example, the date on which the instruction area 235 (see FIG. 23 ) included in the confirmation screen 230 described above was selected.

[0181] The execution instruction related information 431 also includes specification information 433 for identifying the target robot 3 that has received the execution instruction for the selected task process. The specification information 433 may include, for example, the name 112 of the target robot 3 that has received the execution instruction for the selected task process. In this example, if there are multiple target robots 3 that have received the execution instruction for the selected task process, the name 112 of only one of the multiple target robots 3 that have received the execution instruction is included in the specification information 433. Furthermore, the specification information 433 includes information 443a indicating that there are target robots 3 that have received the execution instruction other than the target robot 3 whose name 112 is included in the specification information 433.

[0182] The execution instruction related information 431 also includes a status graphic 434 that indicates the status of the selected task processing by the target robot 3 that has been instructed to execute the selected task processing. Four types of status graphic 434a to 434d are prepared as the status graphic 434. The execution instruction related information 431 includes any one of the four types of status graphic 434a to 434d.

[0183] 33 is a schematic diagram showing examples of four types of status graphics 434a to 434d. The status graphic 434a indicates that the number of target robots 3 that have been instructed to perform the selection task process is one, and that the selection task process is currently being performed (in other words, processing) on ​​one target robot 3. The status graphic 434b indicates that the number of target robots 3 that have been instructed to perform the selection task process is multiple, and that the selection task process is currently being performed on at least one of the multiple target robots 3. The status graphic 434c indicates that the number of target robots 3 that have been instructed to perform the selection task process is one, and that the selection task process has been completed on one target robot 3. The status graphic 434d indicates that the number of target robots 3 that have been instructed to perform the selection task process is multiple, and that the selection task process has been completed on all of the multiple target robots 3.

[0184] When the execution instruction related information 431 is selected by the user, a details screen 440 showing detailed information about the execution instruction corresponding to the selected execution instruction related information 411 is displayed on the display unit 13. FIG. 34 is a schematic diagram showing an example of the details screen 440.

[0185] 34, the details screen 440 is displayed, for example, on the main screen 50. The configuration of the details screen 440 is similar to the configuration of the details screen 340 (see FIG. 27) described above. The details screen 440 includes basic information 441 of the execution instruction for the selected work process, detailed information 445 of the execution instruction for the selected work process, and an instruction area 442.

[0186] The basic information 441 includes the name 162 of the selected task and the execution instruction date and time 335 when the instruction to execute the selected task process was given to the target robot 3. The basic information 441 also includes the user identification information 33 of the user when the instruction to execute the selected task process was given to the target robot 3.

[0187] The detailed information 445 includes, for each target robot 3 that has received an instruction to perform the selected task process, execution-related information 446 regarding the execution of the selected task process by the target robot 3.

[0188] The execution-related information 446 includes information similar to the detailed information 345 (see FIG. 27 ) described above. The execution-related information 446 includes the name 112 of the target robot 3 that received the instruction to perform the selection task process, and an image 115 that schematically shows the appearance of the target robot 3 that received the instruction to perform the selection task process. The execution-related information 446 also includes result information 333 that indicates the result of the selection task process in the target robot that received the instruction to perform the selection task process, and a status string 346 that indicates the status of the selection task process. The execution-related information 446 also includes the date and time 347 when the selection task process started, and the time 348 from when the selection task process started to when it ended.

[0189] In the example of Figure 34, the target robot 3 named "ROBOT 3" 112 that received the instruction to perform the selected task has not yet recognized that it has received the instruction to perform the selected task, as indicated by the status graphic 337 and status character string 346. For this reason, the date and time 347 when the selected task started is "N / A," and the time 348 from the start to the end of the selected task is "00.00.00," or 0 seconds. Furthermore, in the result information 333, the numbers next to "Error," which indicates the number of task errors, the number next to "Fail," which indicates the number of task failures, and the number next to "Success," which indicates the number of task successes, are all "0."

[0190] The instruction area 442 is an area for instructing not to display the details screen 440. When the instruction area 442 is selected, the display unit 13 hides the details screen 440.

[0191] The details screen 440 may include instruction areas similar to the instruction areas 92, 315, and 415. When a selection input is made to select this instruction area, an instruction to perform the selected task may be issued to all of the target robots 3 shown on the details screen 440. At that time, the task conditions, such as the number of tasks, may be the same as those instructed previously to the target robots 3.

[0192] When the execution-related information 446 is selected by the user, a details screen showing detailed information about the execution of the selected task process by the target robot 3 corresponding to the selected execution-related information 446 is displayed on the display unit 13. This details screen has the same configuration as the details screen 350 (see FIG. 28 ) described above.

[0193] When the instruction area 492 is selected, a result screen 460 is displayed as the details screen 320. FIG. 35 is a schematic diagram showing an example of the display of the main screen 50 including the result screen 460 as the details screen 320. The result screen 460 shows the results of the selection work performed during a predetermined period. The result screen 460 includes an input area 461a for inputting the start date of the predetermined period and an input area 461b for inputting the end date of the predetermined period. When the input area 461a is selected, it becomes possible to input the start date of the predetermined period for the information processing device 1. The input start date is shown in the input area 461a. Similarly, when the input area 461b is selected, it becomes possible to input the end date of the predetermined period for the information processing device 1. The input end date is shown in the input area 461b.

[0194] The results screen 460 may include, for example, an average cycle time 465 for the selected tasks performed over a given period of time. For example, the results screen 460 may show an average cycle time 465 for one day.

[0195] Note that the information shown on the result screen 460 is not limited to the above. For example, the result screen 460 may show a two-axis graph, such as the two-axis graphs 86 and 366 described above, that shows the number of task errors, the number of task failures, the number of task successes, the task error rate, and the task failure rate for selected tasks performed during a predetermined period.

[0196] When the designation area 493 is selected, a work content screen 470 is displayed as the details screen 320. Fig. 36 is a schematic diagram showing an example of the display of the main screen 50 including the work content screen 470 as the details screen 420. As shown in Fig. 36, the work content screen 470 includes a flow diagram 471 showing the content of the selected work, and parameter information 472 showing various parameters of the selected work.

[0197] When the instruction area 494 is selected, a remarks screen 480 is displayed as the details screen 420. FIG. 37 is a schematic diagram showing a display example of the main screen 50 including the remarks screen 480 as the details screen 420. As shown in FIG. 37, the remarks screen 480 includes an input area 481 for inputting remarks related to the selected task. By selecting the input area 481, the user can input the remarks to the information processing device 1. When the user inputs the remarks into the input unit 12, the input remarks are displayed in the input area 481.

[0198] In this way, in this example, for example, on the list screen 430 (see FIG. 32) or the details screen 440 (see FIG. 34), the status of a task on a robot 3 that was previously instructed to perform that task is shown by the status graphic 434, the status graphic 337, or the status character string 346. This allows the user to select a task to be performed after checking the status of the task on a robot 3 that was previously instructed to perform that task. This makes it easier for the user to select a task to be performed.

[0199] Furthermore, in this example, for example, the details screen 440 or the results screen 460 (see FIG. 35 ) shows the results of work that was previously instructed to be performed by the robot 3. This allows the user to select work to be performed after checking the results of work that was previously instructed to be performed by the robot 3. This makes it easier for the user to select work to be performed.

[0200] <Other Examples> The display unit 13 may display that the target robots 3 selectable on the robot selection screen 210 have failed in the target task in the past. This makes it easier for the user to select the target robot 3 as the destination.

[0201] 38 is a schematic diagram showing an example of how the display unit 13 displays that a target robot 3 has failed a task to be performed in the past. For example, on the robot selection screen 210, notification information 212 indicating that the target robot 3 has failed a task to be performed in the past is displayed near the robot-related information 211 for the target robot 3 that has failed a task to be performed in the past. This allows the display unit 13 to notify the user of the target robot 3 that has failed a task to be performed selected by the user in the past.

[0202] Furthermore, the display unit 13 may display that the software required to execute the target task is not installed in the target robot 3 selectable on the robot selection screen 210. This makes it easier for the user to select the target robot 3 as the destination.

[0203] 39 is a schematic diagram showing an example of how the display unit 13 displays a message indicating that the software required to perform the target task is not installed on a target robot 3 selectable on the robot selection screen 210. On the robot selection screen 210, notification information 214 notifying the user that the software required to perform the target task is not installed on the target robot 3 is displayed near (e.g., to the right of) the robot-related information 211 for the target robot 3 that does not have the software required to perform the target task. This allows the display unit 13 to notify the user of the target robot 3 that does not have the software required to perform the target task selected by the user. Hereinafter, the target robot 3 corresponding to the notification information 214 refers to the target robot 3 corresponding to the robot-related information 211 displayed to the left of the notification information 214.

[0204] When the information processing device 1 displays the robot selection screen 210, it inquires of the server device 2, for example, as to whether or not the software required to perform the target task selected by the user is installed in each target robot 3. The server device 2 determines whether or not the software required to perform the target task is installed in each target robot 3 based on the robot-related information stored in the target individual database, and notifies the information processing device 1 of the determination result. This allows the information processing device 1 to know whether or not the software required to perform the target task is installed in each target robot 3.

[0205] Furthermore, when notification information 214 is selected by the user, the display unit 13 may display an inquiry screen 215 that inquires of the user as to whether or not software required to execute the task to be executed (simply referred to as necessary software) may be installed in the target robot 3 corresponding to the selected notification information 214 (also referred to as selected notification information 214). Fig. 40 is a schematic diagram showing an example of the inquiry screen 215. The inquiry screen 215 is displayed, for example, on the robot selection screen 210.

[0206] The query screen 215 includes a command area 215a for issuing a command to install the required software and a command area 215b for issuing a command not to install the required software. When the command area 215a is selected, the information processing device 1 commands the server device 2 to transmit the required software to the target robot 3 corresponding to the selection notification information 214. Upon receiving the command, the server device 2 transmits the required software registered in the common database or the target individual database to the target robot 3 corresponding to the selection notification information 214. As a result, the required software is installed in the target robot 3 corresponding to the selection notification information 214. When the command area 215a is selected, the display of the query screen 215 is cleared. On the other hand, when the command area 215b is selected, the installation of the required software for the target robot 3 corresponding to the selection notification information 214 is not executed, and the display of the query screen 215 is cleared.

[0207] 41 , the inquiry screen 215 may display information 215c indicating the storage capacity required for installing the necessary software and information 215d indicating the free space in the storage of the robot controller 3a of the target robot 3 corresponding to the selection notification information 214. Furthermore, if the storage capacity required for installing the necessary software is larger than the free space in the storage of the robot controller 3a of the target robot 3 corresponding to the selection notification information 214, the instruction area 215a may be set to be unselectable on the inquiry screen 215. In this case, the instruction area 215a may be displayed grayed out. Furthermore, if the robot 3 is in a situation notified by the notification information 214, the robot-related information 211 of that robot 3 may be hidden on the robot selection screen 210.

[0208] Furthermore, the display unit 13 may display that the target robot 3 selectable on the robot selection screen 210 cannot execute the target task to be executed. This makes it easier for the user to select the target robot 3 as the destination.

[0209] 42 is a schematic diagram showing an example of how the display unit 13 displays information indicating that a target robot 3 selectable on the robot selection screen 210 cannot perform the target task. On the robot selection screen 210, notification information 216 notifying that the target robot 3 cannot perform the target task is displayed near the robot-related information 211 for the target robot 3 that cannot perform the target task. This allows the display unit 13 to notify the user of the target robot 3 that cannot perform the target task selected by the user. Note that when a robot 3 is in a situation notified by the notification information 216, the robot-related information 211 for that robot 3 may be hidden on the robot selection screen 210.

[0210] When the information processing device 1 displays the robot selection screen 210, the information processing device 1 inquires of the server device 2, for example, as to whether each target robot 3 can perform the selected task. The server device 2 determines whether each target robot 3 can perform the task based on the robot-related information stored in the target individual database, and notifies the information processing device 1 of the determination result. This allows the information processing device 1 to determine whether each target robot 3 can perform the task. Whether the target robot 3 can perform the task depends, for example, on the content of the task and the performance of the target robot 3. If the task is specialized for an arm robot, an AGV robot cannot perform the task. Furthermore, if the task is specialized for a dual-arm robot, a single-arm robot and an AGV robot cannot perform the task. Furthermore, a target robot 3 that does not have the software required to perform the task installed cannot perform the task.

[0211] Furthermore, on the robot selection screen 210, a target robot 3 that cannot perform the task to be performed may be set to be unselectable. That is, on the robot selection screen 210, the robot-related information 211 for a target robot 3 that cannot perform the task to be performed may be set to be unselectable. In this case, as shown in FIG. 43 , notification information 217 indicating that the robot-related information 211 is unselectable may be displayed near the unselectable robot-related information 211. Furthermore, as shown in FIG. 44 , the unselectable robot-related information 211 may be displayed in a grayed-out state. In the example of FIG. 44 , the third robot-related information 211 from the top is displayed in a grayed-out state.

[0212] The display unit 13 may also be able to change the order of the multiple pieces of robot-related information 211 on the robot selection screen 210. This improves the convenience of the information processing device 1. Being able to change the order of the multiple pieces of robot-related information 211 on the robot selection screen 210 means that the order of the robot identification information 111 included in each piece of robot-related information 211 on the robot selection screen 210 can be changed. For example, as shown in FIG. 45 , the robot selection screen 210 may display an instruction area 218 for instructing to change the order of the multiple pieces of robot-related information 211. When the instruction area 218 is selected by the user, the display unit 13 changes the order of the multiple pieces of robot-related information 211 in accordance with predetermined sorting criteria.

[0213] The display unit 13 may rearrange the plurality of pieces of robot-related information 211, for example, in order of the earliest planned start time of the task to be performed by the corresponding target robot 3. In this case, the server device 2 estimates the planned start time of the task to be performed by each target robot 3 based on the status of each target robot 3, and notifies the information processing device 1 of the estimated result. This allows the information processing device 1 to grasp the planned start time of the task to be performed by each target robot 3, which is necessary for rearrangement.

[0214] Furthermore, the display unit 13 may rearrange the plurality of pieces of robot-related information 211 in descending order of the past success rate of the tasks to be performed by the corresponding target robot 3. In this case, the server device 2 calculates the past success rate of the tasks to be performed by each target robot 3 and notifies the information processing device 1. This makes it possible to grasp the past success rate of the tasks to be performed by each target robot 3, which is necessary for rearrangement.

[0215] In addition, the display unit 13 may rearrange the multiple pieces of robot-related information 211 so that the robot-related information 211 about the target robot 3 that can perform the target work is positioned above the robot-related information 211 about the target robot 3 that cannot perform the target work.

[0216] Furthermore, when the designation area 218 is selected, the user may be able to input a designation to specify the sorting criteria into the input unit 12. This improves the convenience of the information processing device 1.

[0217] Similarly, the display unit 13 may be able to change the order of the multiple pieces of work identification information 201 on the work selection screen 200. This improves the convenience of the information processing device 1. For example, as shown in FIG. 46 , the work selection screen 200 may show an instruction area 208 for instructing to change the order of the multiple pieces of work identification information 201. When the instruction area 208 is selected by the user, the display unit 13 changes the order of the multiple pieces of work identification information 201 in accordance with predetermined sorting criteria.

[0218] The display unit 13 may rearrange the plurality of pieces of work identification information 201 so that the work identification information 201 for a work whose content was created closer to the present time is positioned at the top. In this case, the work identification information 201 may include information indicating the time when the content of the work identified by the work identification information 201 was created.

[0219] Furthermore, the display unit 13 may rearrange the multiple pieces of work identification information 201 so that the multiple pieces of work identification information 201 are displayed together for each corresponding user. The user corresponding to the work identification information 201 is the user who signed in when the content of the work identified by the work identification information 201 was created on the information processing device 1. In this case, the work identification information 201 may include the user identification information 33 of the corresponding user.

[0220] Furthermore, the display unit 13 may rearrange the multiple pieces of task identification information 201 so that the multiple pieces of task identification information 201 are displayed together according to the corresponding type of used robot 3. The type of used robot 3 corresponding to the task identification information 201 is the type of robot 3 that was used when the content of the task identified by the task identification information 201 was created. In this case, the task identification information 201 may include information indicating the corresponding type of used robot 3.

[0221] Furthermore, when the designation area 208 is selected, the user may be able to input a designation to specify the sorting criteria into the input unit 12. This improves the convenience of the information processing device 1.

[0222] Similarly, the display unit 13 may be able to change the order of multiple pieces of robot-related information 110 in the robot list information 100 shown in Fig. 5 etc. The display unit 13 may also be able to change the order of multiple pieces of work-related information 160 in the work list information 150 shown in Fig. 6 etc.

[0223] The display unit 13 may also display that the target robot 3 selectable on the robot selection screen 210 is currently performing a task. This makes it easier for the user to select the target robot 3 as the destination.

[0224] 47 is a schematic diagram showing an example of how the display unit 13 displays that a target robot 3 selectable on the robot selection screen 210 is currently performing a task. On the robot selection screen 210, notification information 219 indicating that the target robot 3 is currently performing a task is displayed near the robot-related information 211 for the target robot 3 currently performing a task. This allows the display unit 13 to notify the user of the target robot 3 currently performing a task. As shown in FIG. 48, the notification information 219 may include information 219a indicating the expected completion time of the task being performed.

[0225] In the above example, on the robot selection screen 210, it was possible to select a robot 3 to which the work to be performed is to be sent from multiple robots 3 managed by the target tenant, but it may also be possible to select a robot 3 to which the work to be performed is to be sent from multiple robots 3 managed only by the signed-in user among multiple users belonging to the target tenant, and not to select a robot 3 to which the work to be performed is to be sent from multiple robots 3 managed by a user other than the signed-in user. In this case, the information processing device 1 may display only information related to the robot managed by the signed-in user out of information related to the multiple robots managed by the target tenant.

[0226] Furthermore, on the work selection screen 200, work with work content generated only by the signed-in user among multiple users belonging to the target tenant may be selectable as work to be performed, and work with work content generated by users other than the signed-in user may not be selectable as work to be performed. In this case, the information processing device 1 may display only information related to work with work content generated by the signed-in user among information related to work with work content generated by multiple users belonging to the target tenant.

[0227] Furthermore, groups may be set for users belonging to the target tenant, robots managed by the target tenant, and tasks for which users belonging to the target tenant have created task content. In this case, for example, a user belonging to a certain group can select robots and tasks belonging to the same group as the certain group on the robot selection screen 210 and the task selection screen 200, but cannot select robots and tasks belonging to a group other than the certain group. In this case, not only are robots and tasks from other groups unselectable, but they may also be set to not be displayed at all. Furthermore, when a group is set, the term "target tenant" in this specification may be appropriately interpreted as "group." Furthermore, a user may be able to belong to multiple groups. In this case, for example, a user belonging to groups A and B can select robots and tasks belonging to either groups A or B on the robot selection screen 210 and the task selection screen 200. Furthermore, a robot for which no group is set may be selectable by users of any group, or may be selectable by users for which no group is set. Furthermore, a task for which no group is set may be selectable by users of any group, or may be selectable by users for which no group is set. Note that groups may be set for each base such as a factory or office owned by a company, or for each organization present at each base.

[0228] Furthermore, in the above description, an example has been described in which the information processing device 1 is used to issue an instruction to execute a task to be performed by the robot 3. However, the task to be executed using the information processing device 1 is not limited to the task to be executed by the robot 3, and may be, for example, a system task. For example, if a camera is present near the robot 3, an instruction to execute a task related to camera calibration may be issued through the information processing device 1. Furthermore, an instruction to execute a task to update software for the robot 3, the robot controller 3a, and its peripheral devices (for example, a camera or a PLC (Programmable Logic Controller)). Note that the system task may be executed using an information processing device 1 of a user different from the information processing device 1 of the user instructing the robot 3 to execute the task.

[0229] In the above example, the robot system 5 employs a multi-tenant system for using the resources provided by the server device 2, but other systems may also be employed.

[0230] Furthermore, the robot controller 3a of at least one of the plurality of robots 3 may be configured with a plurality of robot controllers. Figure 49 is a schematic diagram showing an example of a robot system 5 in this case.

[0231] In the example of Fig. 49, the robot controller 3a of each robot 3 includes robot controllers 3a1 and 3a2. The robot controllers 3a1 and 3a2 are, for example, computer devices. The robot controllers 3a1 and 3a2 may have the same configuration as the information processing device 1, for example. The various processes described above performed by the robot controller 3a may be performed by either the robot controllers 3a1 or 3a2, or by the robot controllers 3a1 and 3a2 working together. Note that both the robot controllers 3a1 and 3a2 may be installed in the installation environment of the robot 3, or the robot controller 3a1 may be located on the cloud.

[0232] The robot controller 3a1 is connected to a network 4. The robot controller 3a1 is capable of communicating with the server device 2 through the network 4. The robot controller 3a1 receives the above-mentioned execution instruction information and the like from the server device 2. The robot controller 3a1 also transmits the above-mentioned work status information, work result information, robot status information, and the like to the server device 2. The robot controller 3a1 may be capable of communicating with the information processing device 1 through the network 4, such as a WAN (Wide Area Network).

[0233] The robot controller 3a1 can communicate with the robot controller 3a2 via, for example, a local area network (LAN). In the robot controller 3a1, the WAN and LAN connections are independent of each other, preventing the robot controller 3a2 from being unintentionally connected to the WAN. The server device 2 may perform individual authentication based on a certificate issued for each robot controller 3a2. This prevents unauthorized access to the server device 2 from sources other than the robot controller 3a2. The certificate may be managed by the server device 2 for each tenant. As a result, the server device 2 is prevented from executing instructions from a tenant other than the one to which the robot controller 3a2 belongs. The robot controller 3a1 may communicate with the robot controller 3a2 via wired or wireless communication. The robot controller 3a2 can control the robot mechanism 3b. The robot controller 3a1 can control the robot controller 3a2 in response to instructions from the server device 2. Multiple robot controllers 3a2 may be connected to one robot controller 3a1.

[0234] If the robot mechanism 3b and the robot controller 3a2 that controls the robot mechanism 3b are collectively referred to as a robot device, the robot controller 3a1 may be provided by a provider different from or the same as the provider that provides the robot device. Furthermore, the robot controller 3a1 may be provided by the same provider that provides the cloud service using the server device 2, or by a different provider.

[0235] The robot controller 3a1 may execute necessary software when, for example, a task to be performed is executed. The software executed by the robot controller 3a1 may include software installed in the robot controller 3a1 from the server device 2, or may include software pre-stored in the robot controller 3a1. The software executed by the robot controller 3a1 may also include, for example, AI (Artificial Intelligence) software having a neural network. Specifically, the software executed by the robot controller 3a1 may include, for example, machine learning software that performs instance segmentation. The robot controller 3a1 that executes AI software may also be referred to as, for example, an AI controller.

[0236] The software executed by the robot controller 3a1 may include non-AI software or algorithm-based software. For example, the software executed by the robot controller 3a1 may include software that performs image recognition using template matching or the like, or may include a program coded based on a rule-based algorithm. The software executed by the robot controller 3a1 may also include, for example, an operating system (OS) for the robot mechanism 3b, a program for improving functionality, or a security program that ensures the security of the robot mechanism 3b. Software including a security program installed on the robot 3 may be automatically installed on the robot 3 by the server device 2.

[0237] Furthermore, based on a target task for which execution is instructed using the information processing device 1, the information processing device 1 or the like may check whether information (e.g., software) required to execute the target task is installed in the robot controller 3a (e.g., robot controller 3a1) that controls the robot mechanism 3b that executes the target task. In this case, if any of the required information is not installed in the robot controller 3a, the information may be installed in the robot controller 3a from the server device 2. Furthermore, the information processing device 1 or the server device 2 may determine the software to be installed in the robot controller 3a based on the manufacturer, model, or type of the robot 3 and the manufacturer, model, or type of equipment, such as cameras, installed in the surrounding environment of the robot 3. Information such as the model or type of the robot 3 (arm or end effector) and information such as the model or type of equipment, such as cameras, installed in the surrounding environment of the robot 3 may be acquired from the robot controller 3a1 or the like.

[0238] The software stored in the robot controller 3 a may be deleted or updated via the information processing device 1. The software stored in the robot controller 3 a may be updated, deleted, or added by the server device 2.

[0239] The AI ​​software executed by the robot controller 3a1 may include, for example, AI software that recognizes objects based on camera images generated by a camera (also referred to as object recognition AI software). The camera may be a camera provided on the robot mechanism 3b (for example, a camera attached to an end effector of an arm-type robot mechanism), or may be a camera provided at a fixed position away from the robot mechanism 3b. The camera images generated by the camera may include color images or depth images.

[0240] The object to be recognized by the object recognition AI software executed by the robot controller 3a1 may be an object held by the robot mechanism 3b (for example, an industrial part or stationery). Furthermore, when the robot mechanism 3b holds an object in a tray, the object to be recognized may be the tray on which the object to be held is placed. Furthermore, when the robot mechanism 3b places the held object on a tray, the object to be recognized may be the tray on which the held object is placed. Furthermore, the object to be recognized may be an object such as a person approaching the working range of the robot 3. Furthermore, the object to be recognized may be an obstacle that impedes the movement of the robot mechanism 3b.

[0241] In addition, the AI ​​software executed by the robot controller 3a1 may include, for example, AI software for determining at what position the robot mechanism 3b should hold the object based on a camera image generated by a camera.

[0242] In addition, software such as AI software stored in the robot controller 3a1 may be updated by the server device 2, deleted by the server device 2, or added by the server device 2.

[0243] Furthermore, the robot controller 3a1 may create a target motion of the robot mechanism 3b for the task to be performed based on the results of object recognition by executing object recognition AI software. In other words, the robot controller 3a1 may plan a target motion of the robot mechanism 3b. For example, consider a case where the robot mechanism 3b is an arm-type robot mechanism. In this case, the robot controller 3a1 creates a target motion of the arm of the robot mechanism 3b. Specifically, the robot controller 3a1 determines a target posture of the arm at each time. For example, the robot controller 3a1 determines a target rotation angle that each joint of the arm should have at each time, and creates a target motion of the arm.

[0244] After creating a target motion for the robot mechanism 3b, the robot controller 3a1 transmits target motion data indicating the created target motion to the robot controller 3a2. The robot controller 3a2 controls the robot mechanism 3b based on the target motion data from the robot controller 3a1. At this time, the robot controller 3a2 may determine, based on a predetermined criterion, whether the robot mechanism 3b can be moved according to the target motion indicated by the target motion data. If the robot controller 3a1 determines that the robot mechanism 3b can be moved according to the target motion indicated by the target motion data, the robot controller 3a2 controls the robot mechanism 3b based on the target motion data. On the other hand, if the robot controller 3a1 determines that the robot mechanism 3b cannot be moved according to the target motion indicated by the target motion data, the robot controller 3a1 may, for example, notify the robot controller 3a1 of the reason why the robot mechanism 3b cannot be moved according to the target motion. The robot controller 3a1, having been notified of the reason why the robot mechanism 3b cannot be moved according to the target motion, may modify the target motion data based on the reason and transmit the modified target motion data to the robot controller 3a2. The robot controller 3a2 may also monitor the motion of the robot mechanism 3b. As a result, for example, the robot controller 3a2 can support an emergency stop of the robot mechanism 3b depending on the state of the motors and the like provided in the robot mechanism 3b.

[0245] The robot controller 3a1 may also manage information such as data necessary for improving the work of the robot 3, including, for example, improving the accuracy of AI. Specifically, the robot controller 3a1 may manage, for example, log information and metrics information of the robot 3. The log information and metrics information managed by the robot controller 3a1 may include the work status information, work result information, and robot status information described above. More specifically, the log information and metrics information may include control parameters of the robot 3, setting information used for linking the robot 3 with peripheral devices and the server device 2, image data captured during the operation of the robot 3, and information resulting from image analysis of the image data. Note that, for example, the setting information may be recorded in a non-volatile area of ​​the robot controller 3a. The image data or the results of image analysis may be recorded in a volatile area or a temporary area. The setting information may be managed so that only users with access rights can access it by encryption, and the image data or the results of image analysis may be deleted from the robot controller 3a for each work. Furthermore, the image data or the image analysis results thereof may be deleted when the power supply to the robot 3 is turned off. Furthermore, log information and the like may be managed in chronological order.

[0246] The server device 2 may manage log information and metrics information related to operations on the server device 2. The server device 2 may also manage information by changing the security level depending on the information to be managed.

[0247] The robot controller 3a1 may transmit information it manages (for example, log information, metrics information, and other necessary data) to the server device 2 in response to a request from the server device 2, or periodically or irregularly. Data transmission between the robot controller 3a1 and the server device 2 may be encrypted. Data transmission between the robot controllers 3a1 and 3a2 may not be encrypted. Data transmission from the robot controller 3a1 to the server device 2 may be transmitted with a different security level depending on the information to be transmitted, or may be transmitted to an area with a different security level.

[0248] The software stored in the robot 3 may include software executed by the robot controller 3a2. The software stored in the robot controller 3a2 may be updated, deleted, or added by the server device 2.

[0249] Although the information processing device has been described in detail above, the above description is merely an example in all respects, and this disclosure is not limited thereto. Furthermore, the various examples described above can be combined and applied as long as they are not mutually contradictory. It is understood that countless examples not illustrated can be envisioned without departing from the scope of this disclosure.

[0250] This disclosure includes the following:

[0251] In one embodiment, (1) an information processing device includes a display unit, an input unit that accepts user input, an interface that is capable of communicating with a plurality of robots and is capable of communicating with a server device that has a plurality of robot identification information that identifies the plurality of robots, and a control unit, wherein the control unit acquires the plurality of robot identification information and the communication connection status of the plurality of robots with the server device via the interface, and displays the plurality of robot identification information and the communication connection status on the display unit in a viewable manner so that the input unit can select at least one robot that will perform at least one target task selected by the user from a plurality of tasks indicated by a plurality of task information generated using any one of the plurality of robots.

[0252] (2) In the information processing device of (1) above, the plurality of pieces of identification information include identification information of robots with which other information processing devices can be connected for communication.

[0253] (3) In the information processing device of (1) or (2) above, the display unit can display the types of the plurality of robots.

[0254] (4) In the information processing device according to any one of (1) to (3) above, the display unit is capable of displaying the operating status of the plurality of robots.

[0255] (5) In the information processing device according to any one of (1) to (4) above, the display unit is capable of displaying the progress of work that has been instructed to be performed by the plurality of robots in the past.

[0256] (6) In any one of the information processing devices described above in (1) to (5), the display unit can display the results of tasks that have been instructed to be performed in the past by the plurality of robots.

[0257] (7) In the information processing device according to any one of (1) to (6) above, the display unit is capable of displaying the performance of the plurality of robots.

[0258] (8) In any one of the information processing devices described above in (1) to (7), the display unit can display that the plurality of robots have failed in the task to be performed in the past.

[0259] (9) In the information processing device according to any one of (1) to (8) above, the display unit is capable of displaying identification information of software installed in each of the plurality of robots.

[0260] (10) In the information processing device according to any one of (1) to (9) above, the display unit can display that the plurality of robots cannot perform the task to be performed.

[0261] (11) In the information processing device according to any one of (1) to (10) above, the control unit sets a robot that cannot perform the target task to be performed as unselectable.

[0262] (12) In the information processing device according to any one of (1) to (11) above, the display unit is capable of changing the arrangement of the plurality of pieces of robot identification information.

[0263] (13) In the information processing device according to any one of (1) to (12) above, the display unit can display a plurality of pieces of work identification information for selecting the at least one work to be performed via the input unit.

[0264] (14) In the information processing device of (13), the display unit is capable of changing the arrangement of the plurality of pieces of work identification information.

[0265] (15) In any one of the information processing devices described in (1) to (14) above, the display unit is capable of displaying the status of a task that can be selected as the at least one task to be performed by a robot that has been instructed to perform that task in the past.

[0266] (16) In any one of the information processing devices (1) to (15) above, the display unit is capable of displaying the results of a task that can be selected as the at least one task to be performed by a robot that has been instructed to perform that task in the past.

[0267] (17) The program is a program for causing a computer device to function as any one of the information processing devices (1) to (16) above.

[0268] REFERENCE SIGNS LIST 1 Information processing device 3 Robot 12 Input unit 13 Display unit 111 Robot identification information 200 Work selection screen 201 Work identification information 210 Robot selection screen

Claims

1. A display unit; an input unit that accepts user input; an interface capable of communicating with a plurality of robots and a server device having a plurality of pieces of robot identification information for identifying the plurality of robots; Control unit and Equipped with The control unit acquiring identification information of the plurality of robots and communication connection statuses of the plurality of robots with the server device via the interface; an information processing device that displays the plurality of robot identification information and the communication connection status on the display unit so that the input unit can select at least one robot to perform at least one target task selected by the user from a plurality of tasks indicated by a plurality of task information generated using any one of the plurality of robots.

2. 2. The information processing device according to claim 1, The information processing device, wherein the plurality of pieces of identification information include identification information of robots with which other information processing devices can be connected for communication.

3. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying the types of the plurality of robots.

4. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying the operating status of the plurality of robots.

5. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying progress status of work that has been instructed to be performed in the past to the plurality of robots.

6. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying results of work that has been instructed to be performed in the past to the plurality of robots.

7. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying performance of the plurality of robots.

8. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying that the plurality of robots have failed in the task to be performed in the past.

9. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying identification information of software installed on each of the plurality of robots.

10. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying that the plurality of robots cannot perform the task to be performed.

11. 3. The information processing device according to claim 1, The control unit sets a robot that cannot perform the task to be performed as unselectable.

12. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of changing the arrangement of the plurality of pieces of robot identification information.

13. 3. The information processing device according to claim 1, The display unit is capable of displaying a plurality of pieces of work identification information for selecting the at least one work to be performed via the input unit.

14. 14. The information processing device according to claim 13, The information processing device, wherein the display unit is capable of changing the arrangement of the plurality of pieces of work identification information.

15. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying the status of the at least one task that can be selected as the task to be performed by a robot that has been instructed to perform that task in the past.

16. 3. The information processing device according to claim 1, The information processing device, wherein the display unit is capable of displaying results of a task that has been instructed to be performed by a robot in the past for the at least one task that can be selected as a task to be performed.

17. A program for causing a computer device to function as the information processing device according to claim 1 or 2.

Images