Automation Support Device and Automation Support Method

The automation support device evaluates pick and place operations' difficulty by specifying conditions and displaying necessary technical information, addressing the challenge of determining automation feasibility and reducing user burden.

JP7706121B1Active Publication Date: 2025-07-11PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2025027177
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2025-02-21
Publication Date
2025-07-11
Estimated Expiration
2045-02-21

AI Technical Summary

Technical Problem

Existing technologies struggle to accurately evaluate the difficulty level of work automation for pick and place operations, considering various conditions related to the object, picking, and placement, making it difficult to determine the feasibility and eligibility of automation systems.

Method used

An automation support device and method that includes a processor to specify object, picking, and placement conditions, determine a quantitative difficulty level based on these conditions, and display the results, utilizing databases to derive and display necessary technical information and SIer information for high-difficulty operations.

Benefits of technology

Enables accurate evaluation of automation difficulty, allowing users to determine feasibility and select appropriate processes for automation, reducing the burden on system integrators by providing necessary technical information and SIer support for high-difficulty tasks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007706121000001_ABST
    Figure 0007706121000001_ABST
Patent Text Reader

Abstract

Provided is an automation support device that can evaluate the difficulty level of work automation in consideration of various conditions related to pick and place. 【Solution means】An automation support device that includes a processor and supports the automation of pick and place work. The processor specifies an object condition related to an object to be pick and placed, a picking condition related to the picking of the object, and a placement condition related to the placement of the object, determines a quantitative difficulty level for automating the work based on the specified object condition, picking condition, and placement condition, and causes the quantitative difficulty level to be displayed on a display device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to an automation support device and an automation support method.

Background Art

[0002] Conventionally, a process planning support device for supporting the planning of processes for performing various operations has been known. This process planning support device includes a setting unit that sets work assignments for each work station on an assembly line, and, for the work assigned to each work station, a first calculation unit that calculates the work time corresponding to the work entity of the work station based on library data for each unit work that represents the unit work by combining element works each having each operation as a component, a second calculation unit that calculates an evaluation index for each work station based on the calculated work time, and an output unit that outputs the calculated evaluation index (see Patent Document 1).

[0003] Further, this second calculation unit calculates the cycle time or cost for each work station based on the calculated work time. Also, the unit work has information such as automation difficulty. The automation difficulty indicates the difficulty when performing the work by a robot. For example, when performing the work by a robot, the cost for the work is obtained based on this automation difficulty. For example, when the difficulty of the work to be performed by the robot is high, since the initial cost of the robot becomes high, the cost may be calculated higher according to the high level of the automation difficulty (see Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The present disclosure provides an automation support device and an automation support method that can evaluate the difficulty level of work automation in consideration of various conditions related to pick and place.

Means for Solving the Problems

[0006] One aspect of the present disclosure is an automation support device including a processor for supporting the automation of pick and place work, wherein the processor specifies object conditions related to an object to be picked and placed, picking conditions related to the picking of the object, and place conditions related to the placement of the object, determines a quantitative difficulty level for automating the work based on the specified object conditions, picking conditions, and place conditions, and causes the quantitative difficulty level to be displayed on a display device.

[0007] One aspect of the present disclosure is an automation support method for supporting the automation of pick and place work, including specifying object conditions related to an object to be picked and placed, picking conditions related to the picking of the object, and place conditions related to the placement of the object, determining a quantitative difficulty level for automating the work based on the specified object conditions, picking conditions, and place conditions, and causing the quantitative difficulty level to be displayed on a display device.

Advantages of the Invention

[0008] According to the present disclosure, it is possible to evaluate the difficulty level of work automation in consideration of various conditions related to pick and place.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Mode for Carrying Out the Invention

[0010] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, a more detailed description than necessary may be omitted. For example, a detailed description of well-known matters or a redundant description of substantially the same configuration may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate the understanding of those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0011] (Background of Obtaining Embodiments of the Present Disclosure) In considering the automation of work using robots, specialized knowledge regarding robots and automated equipment is required. Therefore, it is difficult for a user considering automation to grasp the difficulty level for performing automation by themselves, and it is difficult to determine whether automation is possible.

[0012] In the apparatus of Patent Document 1, the cost derived based on the automation difficulty level, which is the cost for work, can be used as an evaluation index. However, no details are mentioned regarding how to derive the automation difficulty level. Therefore, it is difficult to accurately derive the automation difficulty level, and it is difficult to ensure the eligibility of the automation system determined based on the automation difficulty level. For example, when picking and placing a predetermined object, it is desirable to consider various viewpoints regarding the object, picking, and placement.

[0013] In the following embodiments, an automation support apparatus and an automation support method that can evaluate the difficulty level of work automation in consideration of various conditions related to picking and placing will be described.

[0014] (First Embodiment)

[0015] <Configuration of Automation Support Apparatus> FIG. 1 is a block diagram showing a configuration example of an automation support device. The automation support device 100 includes a processor 110, a memory 120, a communication device 130, an input device 140, and a display device 150. The automation support device 100 supports the derivation of an automation system that executes each process (for example, a manufacturing process) included in the work. The work includes, for example, work related to pick and place.

[0016] The processor 110 may be configured using, for example, a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or a Graphics Processing Unit (GPU). The processor 110 may also be configured using various integrated circuits (for example, Large Scale Integration (LSI) or Field Programmable Gate Array (FPGA)). The processor 110 realizes various functions by executing a program held in the memory 120. The processor 110 comprehensively controls each part of the automation support device 100 and performs various processes.

[0017] The memory 120 may include a Random Access Memory (RAM), a Read Only Memory (ROM), a Hard Disk Drive (HDD), a Solid State Drive (SSD), an optical disk, or an SD card, etc. The memory 120 may also be an external storage medium and may be detachable from the automation support device 100. The memory 120 stores various data, information, images, programs, or learned models, etc.

[0018] The communication device 130 communicates various data or information, etc. according to a wired or wireless communication method. The communication method by the communication device 130 may include communication methods such as a Local Area Network (LAN), a Wide Area Network (WAN), a mobile phone network, or power line communication.

[0019] The input device 140 may include various buttons, keys, keyboards, touch panels, microphones, or other input devices. The input device 140 receives inputs such as various data or information. The input device 140 is operated by a user. The user is, for example, an operator or administrator who automates pick-and-place operations.

[0020] The display device 150 is, for example, a liquid crystal display or an organic EL display. The display device 150 displays various data or information. The display by the display device 150 may be confirmed by, for example, a user.

[0021] The processor 110 has functions as, for example, a picking condition processing unit 111, a place condition processing unit 112, an object condition processing unit 113, a peripheral condition processing unit 114, and a difficulty processing unit 115.

[0022] The picking condition processing unit 111 performs processing related to conditions for picking an object (also referred to as picking conditions). For example, the picking condition processing unit 111 receives user input via the input device 140 and specifies (e.g., selects) the picking conditions. The picking conditions may be divided into a plurality of condition items (picking condition items).

[0023] The place condition processing unit 112 performs processing related to conditions for placing an object (also referred to as place conditions). For example, the place condition processing unit 112 receives user input via the input device 140 and specifies (e.g., selects) the place conditions. The place conditions may be divided into a plurality of condition items (place condition items).

[0024] The object condition processing unit 113 performs processing related to conditions for an object to be picked and placed (also referred to as object conditions). For example, the object condition processing unit 113 receives user input via the input device 140 and specifies (e.g., selects) the object conditions. The object conditions may be divided into a plurality of condition items (object condition items).

[0025] The peripheral condition processing unit 114 performs processing related to conditions (also referred to as peripheral conditions) regarding the peripheral work associated with the pick-and-place of the object. The peripheral work includes, for example, the work of loading or unloading the object, the work of supplying parts, the work of picking from the storage shelf, or other work associated with the pick-and-place. For example, the peripheral condition processing unit 114 receives user input via the input device 140 and specifies (for example, selects) the peripheral conditions. The peripheral conditions may be classified into a plurality of condition items (peripheral condition items).

[0026] The difficulty processing unit 115 performs processing related to the difficulty (also referred to as the automation difficulty) for automating the work of the pick-and-place of the object. The difficulty processing unit 115 derives (for example, calculates) the automation difficulty based on at least one of the picking conditions specified by the picking condition processing unit 111, the place conditions specified by the place condition processing unit 112, the object conditions specified by the object condition processing unit 113, and the peripheral conditions specified by the peripheral condition processing unit 114. The difficulty processing unit 115 may calculate the automation difficulty based on the picking conditions, the place conditions, and the object conditions, or may calculate the automation difficulty based on the picking conditions, the place conditions, the object conditions, and the peripheral conditions.

[0027] The memory 120 holds various databases, for example, including a processing logic database 121, a difficulty information database 122, a necessary technical information database 123, a SIer information database 124, and a performance information database 125.

[0028] The processing logic database 121 holds information related to the processing logic for deriving the automation difficulty. The processing logic includes, for example, information on the operation flow by the automation support device 100 (for example, the information in FIGS. 2 to 7).

[0029] The difficulty information database 122 holds difficulty information regarding the difficulty for automating the conditions related to the work. The difficulty information includes, for example, a value that quantitatively indicates the difficulty. In the present embodiment, each condition related to the work includes at least a part of the specifiable picking condition, place condition, object condition, and peripheral condition, or at least a part of the specifiable picking condition items, place condition items, object condition items, and peripheral condition items, etc. The difficulty information database 122 holds, for example, for each condition related to the work, the information of each of the condition and the difficulty point of this condition in an associated manner.

[0030] The necessary technology information database 123 holds information (also referred to as necessary technology information) regarding the technology necessary for automating the work (also referred to as the necessary technology for automation). The necessary technology information database 123 holds, for example, information regarding the technology for corresponding to (for satisfying) the conditions related to the work as the necessary technology information. The necessary technology information is one of the means for solving the conditions related to the work. The necessary technology information database 123 holds, for example, for each condition related to the work, the information of each of the condition and the necessary technology for solving this condition in an associated manner.

[0031] The SIer information database 124 holds information (also referred to as SIer information) regarding the system integrator as an SIer. The SIer information holds, for example, the identification information for identifying the system integrator, the necessary technology information that the system integrator can handle, and the information regarding the contact information (for example, phone number or email address) of the system integrator, in an associated manner.

[0032] The performance information database 125 holds the automation specified information derived in the past as automation performance information, that is, as information on the performance with each condition related to the work specified. The automation specified information and the automation performance information include, for example, at least each information of work identification information for identifying the work and the specified content with each condition related to the work specified. Further, the automation specified information and the automation performance information may include, together with the work identification information and the specified content, difficulty information according to the specified content, necessary technical information according to the specified content, and the like.

[0033] Note that, although the automation support device 100 has been exemplified as having each component and each function in one device, it is not limited thereto. For example, each component and each function of the automation support device 100 may be distributed and arranged and configured as a system (automation support system). The system may be configured in a cloud type on a network or may be configured with an on-premises server device.

[0034] <Operation of the automation support device> Next, the operation of the automation support device 100 will be described.

[0035] FIG. 2 is a flowchart showing an operation example of the automation support device 100 of the present embodiment. In FIG. 2, automation of each work related to pick and place is assumed.

[0036] First, the processor 110 receives user input via the input device 140 and acquires input data (step S11). The input data includes information on the specified content specified for each condition related to the work of picking and placing the object.

[0037] Based on the input data, the processor 110 calculates difficulty points for each condition related to the operation, that is, for each of the object condition, picking condition, placement condition, and peripheral condition (step S12). The difficulty points indicate, in quantitative values, the difficulty of automating the operation while satisfying each condition related to the operation. The processor 110 totals the difficulty points for each condition related to the operation (step S13). The processor 110 causes the display device 150 to display the totaled difficulty points as the final difficulty points (step S14).

[0038] The processor 110 refers to the necessary technical information database 123 and extracts the necessary technical information corresponding to each specified condition (that is, each specified content) (step S15). Further, the processor 110 may extract, from the necessary technical information extracted from the necessary technical information database 123, the necessary technical information that has a record as the necessary technical information corresponding to the specified content in the performance information database 125 (step S15). The processor 110 causes the display device 150 to display the extracted necessary technical information (step S16). Then, the processor 110 generates automation specification information that aggregates the specified content specified for each condition related to the operation.

[0039] The user checks the displayed information, specifically, the specified content, the difficulty points for the specified content, the corresponding technical information, etc., and determines whether it is necessary to modify the input data. If it is necessary to modify the input data, the input device 140 accepts the modification of the input data from the user.

[0040] The processor 110 determines whether the input data has been modified, that is, whether there is a modification to the input data (step S17).

[0041] When the input data is modified (Yes in step S17), the processor 110 proceeds to step S12. That is, the processor 110 performs re-derivation and re-display of difficulty points, re-extraction and re-display of necessary technical information, re-generation of automation specification information, etc. based on the modified input data.

[0042] When the input data is not modified (No in step S17), the processor 110 outputs automation specification information based on the modified or unmodified input data as a result (step S18). The output of the result here includes displaying the result on the display device 150.

[0043] The processor 110 causes the generated automation specification information to be held in the performance information database 125 as automation performance information as a result (step S19).

[0044] According to the operation example shown in FIG. 2 like this, the automation support device 100 can accurately derive the automation difficulty level in consideration of various conditions related to work such as the object conditions, picking conditions, place conditions, and peripheral conditions desired by the user. Therefore, the automation support device 100 can ensure the eligibility of the automation system determined based on the automation difficulty level.

[0045] FIG. 3 is a flowchart showing an example of the input data acquisition process. Here, it is assumed that the user specifies various conditions using the input device 140 to acquire input data, assuming pick-and-place of various objects.

[0046] The processor 110 performs a picking condition specifying process for specifying picking conditions (step S21). The processor 110 performs a place condition specifying process for specifying place conditions (step S22). The processor 110 performs an object condition specifying process for specifying object conditions (step S23). The processor 110 performs a peripheral condition specifying process for specifying peripheral conditions (step S24).

[0047] Next, in FIGS. 4 to 7, the designation process for each condition will be described. In FIGS. 4 to 7, for example, in the designation process for each condition, the automation support device 100 may display a question for each condition and specify each condition by answering (designating, selecting) this question. That is, the automation support device 100 may specify each condition in the form of a question-and-answer using a UI (User Interface). In the selection of the answer to the question, the processor 110 can facilitate the selection of the answer by the user, for example, by making the selection in a pull-down format.

[0048] FIG. 4 is a flowchart showing an example of the picking condition designation process.

[0049] The processor 110 designates the total number of types of objects to be picked and placed (step S100A). In other words, the processor 110 designates the number of types of objects to be handled in a series of operations (operations related to picking and placing) by the robot device.

[0050] The processor 110 determines whether the total number of types of the designated objects is a plurality of types (multiple types) (step S100B). If the total number of types of the designated objects is one type (No in step S100B), the process proceeds to step S105.

[0051] If the total number of types of the designated objects is a plurality of types (Yes in step S100B), the processor 110 designates the types (number of types) of objects at the picking position (step S101). In other words, the processor 110 designates the number of types of objects to be recognized simultaneously during image recognition for picking. The objects at the picking position are, for example, the objects existing at the picking position and the objects to be picked. For example, the processor 110 designates whether the number of types of objects is one type or two or more types (multiple types).

[0052] In the example of step S101, the processor 110 causes the display device 150 to display question information asking how many types of objects there are, and acquires response information (i.e., the specified content) to the question information via the input device 140. Similarly, in the following steps, the processor 110 may display the question information and input the response information.

[0053] The processor 110 determines whether there is one type of object at the picking position (step S102).

[0054] If there is one type of object at the picking position (Yes in step S102), the processor 110 specifies the picking order of the one type of object, that is, which object to pick in order (step S103). For example, the processor 110 specifies whether the picking order is a predetermined order, i.e., a fixed order, or an order that is not predetermined, i.e., a random order.

[0055] If there are multiple types of objects at the picking position (No in step S102), the processor 110 specifies the arrangement of each object for each type of object (step S104). That is, for each type of object, the processor 110 specifies whether the arrangement of the object is a predetermined arrangement, i.e., a fixed arrangement, or an arrangement that is not predetermined, i.e., a free arrangement.

[0056] After the processing of step S103 or step S104, the processor 110 specifies the quantity of the objects at the picking position (step S105). For example, the processor 110 specifies the quantity of the objects to be picked at the picking position, and for example, specifies whether the quantity is one or multiple.

[0057] The processor 110 designates the picking position of the object (step S106). This picking position is, for example, the position in the picking bin in which each object to be picked is stored. For example, the processor 110 designates whether the picking position is a predetermined position, that is, a fixed position, or a position that is not predetermined, that is, a free arrangement.

[0058] The processor 110 determines whether the picking position of the object is a fixed position (step S107).

[0059] When the picking position is a fixed position (Yes in step S107), the processor 110 designates how to place the object (step S108). For example, the processor 110 designates whether to place each object without variation in the way of placement (that is, without allowing variation) or to place each object with variation in the way of placement (that is, allowing variation).

[0060] When the picking position is a free position (No in step S107), the processor 110 designates how the objects are placed (step S109). For example, the processor 110 designates whether the objects are placed in a state where they overlap (that is, allowing overlap) or in a state where they do not overlap (that is, without allowing overlap).

[0061] After step S109, the processor 110 designates the orientation in which the object is placed (step S110). For example, the processor 110 designates whether the orientation in which the object is placed is a predetermined orientation, that is, a fixed orientation, or an orientation that is not predetermined, that is, a free orientation.

[0062] After step S108 or step S110, the processor 110 designates the quantity of objects to be picked at one time (step S111). For example, the processor 110 designates how many objects to pick simultaneously, for example, designating whether the quantity is one or a plurality.

[0063] According to such picking condition specifying processing, the automation support device 100 can determine the specified content for various condition items related to picking and specify the picking conditions.

[0064] FIG. 5 is a flowchart showing an example of place condition specifying processing.

[0065] The processor 110 specifies the place position of the object (step S201). This place position is, for example, the position in the place bin where each object to be placed is stored. For example, the processor 110 specifies whether the place position is a predetermined position, that is, a fixed position, or a non-predetermined position, that is, a free position.

[0066] The processor 110 determines whether the place position is a free position (step S202).

[0067] When the place position is a free position (Yes in step S202), the processor 110 specifies the placing method of the object at the time of placement (step S203). For example, the processor 110 specifies whether to align and place each object in the space within the place bin or to place it freely within the place bin.

[0068] When the place position is a fixed position (No in step S202), the processor 110 specifies the position accuracy required for the object at the time of placement (step S204). For example, the processor 110 specifies whether the position accuracy is arbitrary (that is, not required) or the position accuracy is high.

[0069] After step S204, the processor 110 specifies the placing method of the object at the time of placement (step S205). For example, the processor 110 specifies whether to simply place the object in the place bin or to place the object by joining or fitting the object with other objects.

[0070] After step S203 or step S205, the processor 110 designates the orientation of the object at the time of placement (step S206). For example, the processor 110 designates whether to use a predetermined orientation, i.e., a fixed orientation, or an undetermined orientation, i.e., a free orientation.

[0071] The processor 110 determines whether the orientation of the object at the time of placement is a free position (step S207).

[0072] If the orientation of the object at the time of placement is a fixed position (No in step S207), the processor 110 designates information regarding the posture change of the object (step S208). The posture change of the object includes, for example, the front-back inversion of the object. For example, the processor 110 may designate whether to place the object picked during picking by inverting it vertically at the time of placement. Also, the processor 110 may designate that the presence or absence of the posture change of the object is free.

[0073] If the orientation of the object is free in step S207 (Yes in step S207), or after step S208, the processor 110 designates whether to perform an accuracy inspection of the object after placement (step S209).

[0074] According to such placement condition designation processing, the automation support device 100 can determine the designated content for various condition items regarding placement and designate the placement conditions.

[0075] FIG. 6 is a flowchart showing an example of the object condition designation processing.

[0076] The processor 110 designates whether the object to be picked and placed is a polyhedron (step S301). The polyhedron includes, for example, a rectangular parallelepiped or an object composed of many planes. The processor 110 determines whether the object is a polyhedron (step S302).

[0077] If the object is not a polyhedron (No in step S302), the processor 110 specifies whether the object is in a bag form (step S303).

[0078] If the object is a polyhedron (Yes in step S302), or after step S303, the processor 110 specifies information regarding the shape differences among all types of objects to be picked and placed (step S304). For example, the processor 110 specifies whether there are many or few shape differences among object types, or whether there are none or few.

[0079] The processor 110 specifies information regarding the softness or crushability of the object (step S305). For example, the processor 110 specifies the degree of softness or crushability of the object (e.g., whether it is much or little).

[0080] The processor 110 specifies the variation in the shape of one type of object (step S306). For example, the processor 110 specifies whether the shape variation of the object is small (e.g., regular) or large (e.g., irregular). Also, when there are multiple types of objects, the processor 110 may specify whether the shape variation of the object is small or large for each type of object.

[0081] The processor 110 specifies the presence or absence of an adhesive part on the lower surface of the object, that is, whether there is an adhesive part on the lower surface of the object (step S307).

[0082] The processor 110 specifies information regarding the range within which the object can be gripped by the hand of the robotic device (step S308). For example, the processor 110 specifies whether the range within which it can be gripped by the hand is wide or narrow.

[0083] The processor 110 specifies information regarding the uneven shape of the upper surface of the object (step S309). For example, the processor 110 may specify whether there are many or few non-smooth areas on the upper surface of the object. For example, the processor 110 may specify whether there is a non-smooth area on the upper surface of the object.

[0084] According to such object condition specifying processing, the automation support device 100 can determine the specified content for various condition items regarding the object and specify the object conditions.

[0085] FIG. 7 is a flowchart showing an example of peripheral condition specifying processing.

[0086] The processor 110 specifies whether automation of the loading or unloading of the object or the bin (pickup bin or placement bin) is necessary (step S401).

[0087] The processor 110 specifies whether automation of the supply of parts as the object or the picking of the object from the shelf is necessary (step S402).

[0088] According to such peripheral condition specifying processing, the automation support device 100 can determine the specified content for various condition items regarding the peripheral operations and specify the peripheral conditions.

[0089] Next, the difficulty points according to each condition related to the operation will be described.

[0090] FIG. 8 is a diagram showing an example of the difficulty points according to the specified content of each condition related to the operation. In FIG. 8, it is shown in the form of the difficulty point table T1.

[0091] The difficulty point table T1 associates and includes information on questions regarding each condition related to the operation, information on designated candidates (answer candidate information) for each question, information on the designated content (i.e., answer content information) designated for each question, difficulty points based on the designated content, and integrated difficulty points based on each difficulty point. Each condition related to the operation includes an object condition, a picking condition, a place condition, and a peripheral condition. The object condition is divided into 9 object condition items. The picking condition is divided into 9 picking condition items. The place condition is divided into 7 place condition items. The peripheral condition is divided into 2 peripheral condition items. Note that the number of divisions for each condition is not limited to this. In FIG. 8, hatching is added and displayed for the information on the designated content.

[0092] In FIG. 8, in the column of answer candidates, items with lower difficulty points, that is, items with lower difficulty of the necessary technologies for automation (necessary technology information), are shown in one column (for example, the left column), and items with higher difficulty, that is, items with higher difficulty of the necessary technologies for automation, are shown in the other column (for example, the right column).

[0093] In FIG. 8, for each condition item in which each condition is detailedly divided, it associates and includes information on the item number (also described as "No. 〇") for identifying the condition item, the question regarding the condition item, the designated candidates (answer candidates) that can be designated for each question, the designated content (answer content) designated for each question, and the difficulty points based on the designated content.

[0094] The processor 110 refers to the difficulty information database 122 and determines the difficulty points based on the designated content designated for each condition item. Also, for a plurality of condition items, one difficulty point may be determined collectively. The processor 110 determines the integrated difficulty point, which is the final difficulty point, based on the determined one or more difficulty points. For example, the processor 110 adds up the determined one or more difficulty points to determine the integrated difficulty point.

[0095] The processor 110 generates a difficulty point table T1 that includes at least a part of information on questions regarding each condition (each condition item) related to the work, designated candidates, designated content, difficulty points, and integrated difficulty points, and causes the display device 150 to display it.

[0096] FIG. 9 is a diagram for explaining a method of assigning difficulty points according to the designated content for each condition item of the pick-and-place work. Note that, from FIG. 9 onward, the description of the questions corresponding to each item number is omitted, but specifically, it is the same as the information described in FIG. 8.

[0097] The processor 110 assigns difficulty points according to the designated content for each condition item of the pick-and-place work. The method of assigning difficulty points differs according to the designated content. For example, based on the designated content for the condition item, 0 to 3 points are added as difficulty points. Note that the point value is not limited to this point value and may be other point values.

[0098] The difficulty points based on the designated content for each condition item for item numbers 1 to 7 are based on the information (point calculation map) shown in FIGS. 10 and 11 described later.

[0099] For the difficulty points of each condition item with item numbers 8 to 12, when a designated content with a high difficulty level is designated, 1 point is added. It can be said that the designated content with 1 point added has a higher automation difficulty than the designated content with no points added (i.e., 0 points).

[0100] For the difficulty points of the condition item with item number 13, when a designated content with a high difficulty level is designated, 2 points are added. It can be said that the designated content with 2 points added has a higher automation difficulty than the designated content with 1 point added.

[0101] For the difficulty points of the condition item with item number 14, when a designated content with a high difficulty level is designated, 1 point is added.

[0102] For the difficulty point of the condition item with item number 15, when specifying the specified content with high difficulty, 2 points are added.

[0103] For the difficulty point of the condition item with item number 16, when specifying the specified content with high difficulty, 3 points are added. It can be said that the specified content with 3 points added has a higher automation difficulty than the specified content with 2 points added.

[0104] For the difficulty points of each condition item with item numbers 17 to 19, when specifying the specified content with high difficulty, 1 point is added.

[0105] For the difficulty point of the condition item with item number 20, when specifying the specified content with high difficulty, 2 points are added.

[0106] For the difficulty points of each condition item with item numbers 21 to 24, when specifying the specified content with high difficulty, 1 point is added.

[0107] For the difficulty points of each condition item with item numbers 25 and 26, when specifying the specified content with high difficulty, 2 points are added.

[0108] Figure 10 is a diagram showing an example of the difficulty point symbols corresponding to each specified content for each condition item corresponding to item numbers 1 to 7 of the pick-and-place operation. The difficulty points are uniquely determined according to the difficulty point symbols. Figure 11 is a diagram showing an example of the technical points related to the necessary technologies for automation, the basic points, and the difficulty points corresponding to the specified content corresponding to the difficulty point symbols.

[0109] In Figure 10, all patterns of the specified contents specified in each condition item corresponding to each of item numbers 1 to 7 are associated, and one difficulty point symbol is determined according to the combination of the specified contents.

[0110] In FIG. 11, as an example of the necessary technologies for automation, each technology such as object identification by image recognition or barcodes, measurement of the position and size of an object by image recognition, hand gripping ability, and arm control ability is included. The difficulty levels for automating these technologies are indicated numerically as technical points. The difficulty point corresponding to the difficulty point symbol is the total of each technical point according to the specified content and the base point. In FIG. 11, for the locations where the technical point is 0, they are left blank and the descriptions are omitted.

[0111] In this way, the automation support device 100 can easily derive (for example, calculate) the difficulty points according to the specified content for each of the condition items numbered 1 to 7 by preparing in advance a point calculation map that takes into account the specified content for each of the condition items numbered 1 to 7 shown in FIGS. 10 and 11.

[0112] The information regarding FIGS. 10 and 11 may be held in the difficulty information database 122 and may be used for deriving the difficulty points.

[0113] FIG. 12 is a diagram showing an example of the necessary technologies for automation according to the specified content of each condition related to the work. In FIG. 12, it is shown in the form of the necessary technology table T2 for automation. In the necessary technology table T2 for automation in FIG. 12, for the information similar to that in the difficulty point table T1 shown in FIG. 8, the description thereof is omitted or simplified.

[0114] The necessary technology table T2 for automation includes, in association, each piece of information such as the question items regarding each condition related to the work, the specified content (answer content) specified for each question item, and the necessary technology for automation based on the specified content. Similar to FIG. 8, in FIG. 12, each condition is divided into each condition item. Therefore, specifically, the necessary technology table T2 for automation includes, in association, the item number for identifying each condition item, the question items regarding each condition item, the specified content specified for each question item, and the necessary technology for automation based on the specified content.

[0115] In FIG. 12, it may be possible to distinguish whether the necessary information for automation and the necessary technology for automation are technologies with past achievements or technologies without past achievements. In FIG. 12, the technologies marked with a ○ are the necessary automation technologies with achievements, and the technologies marked with a × indicate that they are not the necessary automation technologies without achievements. The technologies without a ○ or × mark do not consider the presence or absence of achievements. Note that the technologies with achievements are, for example, the technologies included in any of the automation achievement information held in the achievement information database 125. Note that the technologies without achievements are, for example, the technologies not included in any of the automation achievement information held in the achievement information database 125.

[0116] The processor 110 refers to the necessary technology information database 123 and determines the necessary technology for automation based on the specified content designated for each condition item. Also, one necessary technology for automation may be determined collectively for a plurality of condition items. Further, the processor 110 may refer to the necessary technology information database 123 and the achievement information database 125 and determine by limiting to the necessary automation technologies with achievements based on the specified content designated for each condition item.

[0117] The processor 110 generates a difficulty point table T1 including at least a part of each information of the questions regarding each condition (each condition item) related to the work, the specified content, and the necessary technology for automation, and causes the display device 150 to display it.

[0118] Even if only the numerical value of the difficulty level for the specified content is displayed, it is difficult for the user to know what kind of response should be taken for automation. In contrast, by using the necessary technology for automation table T2, the automation support device 100 can display the necessary technology information and further display that there are also achievements, thereby providing useful information regarding the necessary technology for automation to the user.

[0119] Note that the processor 110 may display the necessary technical information in other ways instead of simply displaying at least part of the information in the necessary technology list T2 for automation. For example, the processor 110 may pop up and display the necessary technical information corresponding to the specified content corresponding to this difficulty point near the display position of the difficulty point by placing the cursor on the position of the displayed difficulty point.

[0120] FIG. 13 is a diagram showing a configuration example of an automation system 200 (robot system) for automating a predetermined pick-and-place operation.

[0121] As an example, assume a pick-and-place operation of picking a plurality of types of objects stored in a plurality of picking bins and placing them in one placement bin. In this pick-and-place operation, for example, the picking order of the objects is not particularly determined (that is, it is random), and it is assumed that the objects corresponding to the order are transported. Also, in this pick-and-place operation, it is assumed that bins without partitions and with a free placement method are used as the picking bins and the placement bins. At least part of the assumptions here may be included in the specified content (answer content) specified in FIG. 8.

[0122] The automation support device 100 performs the operations as shown in FIGS. 2 to 7 described above, specifies the object conditions, picking conditions, placement conditions, and peripheral conditions required for the above pick-and-place operation, and determines the difficulty level of automating this pick-and-place operation based on these conditions. Then, the user or the SIer consulted by the user determines whether to automate or not automate each process included in the pick-and-place operation in consideration of the determined difficulty level. Based on the determination of the user or the SIer, an automation system 200 that automates the pick-and-place operation, that is, an automation system 200 that performs the pick-and-place operation, is constructed.

[0123] In FIG. 13, as an example, the configuration of the automation system 200 may be determined based on the specified content (response content) for the questions regarding the conditional items with each item number shown in FIG. 8. That is, the following may be specified for each question.

[0124] Specifically, the total number of types of objects is many. The type of object at the picking position is one type. For example, only one type of object is contained in one picking bin. The picking order of the types of objects is random. The quantity of the object at the picking position is plural. The picking position of the object is free and there is no partition. The way the object is placed (the placed side) has no overlap. The quantity of the object picked at one time is one. The place position of the object is free. The way the object is placed during placement is in an aligned arrangement and is placed in an open space. The orientation of the object during placement is free. There is no accuracy inspection of the object after placement. The shape of the object is not composed of a rectangular parallelepiped or many planes. The object has a bag-like one. The difference in shape among all types of objects is large. The degree of softness and ease of being crushed of the object is small. The variation in the shape of one type of object is not much and is regular. There is no adhesive part on the lower surface of the object. The range in which the object can be grasped by a hand (robot hand) is wide. The uneven shape (non-smooth area) on the upper surface of the object is small. Automation of the loading and unloading operations of the workpiece and the bin is not required. Automation of the supply of parts and shelf picking of goods is not required.

[0125] Based on the above-specified content, the automation system 200 in FIG. 13 is constructed. As an example, the constructed automation system 200 is provided with a conveyor 260, and a plurality of picking bins 240A are transported from the warehouse onto the conveyor 260. One type of different object 220 is stored in each of the plurality of picking bins 240A. Further, the automation system 200 is provided with, for example, an autonomous mobile robot (AMR) capable of moving within the warehouse, and the AMR can place the placement bin 240B thereon. One or more types of objects picked from the picking bin 240A are placed in the placement bin 240B. In addition, the automation system 200 is provided with a robot device 230 for picking, moving, and placing objects. The robot device 230 includes a robot arm 231 and a robot hand 232. Further, the automation system 200 is provided with a picking camera 210A and a placement camera 220B, and the picking camera 210A and the placement camera 220B are installed on the frame 280. In addition, the automation system 200 is provided with a PC 270 for performing pick-and-place operations and controlling and managing various devices within the automation system 200.

[0126] Further, based on the specified content (answer content) for the questions regarding the conditional items with each item number shown in FIG. 8, another configuration of the automation system 200 (a configuration other than the configuration shown in FIG. 13) may be determined. That is, the following specifications may be made for each question. Here, a part of the specified content is excerpted and exemplified.

[0127] Specifically, the total number of types of objects is five, such as products 1 to 5. Also, the number of types of objects at the picking position is two. The fact that the number of types of objects at the picking position here is two means that the maximum number of types of objects at the picking position is two, and it may include cases where the number of types of objects at the picking position is one. The picking position varies for each picking bin and may be the position of each picking bin. For example, it is possible that product 1 is stored in picking bin A, products 2 and 3 are stored in picking bin B, and products 4 and 5 are stored in picking bin C. Based on such specified content, it is possible to construct an automated system 200 in which a robot device can perform picking using three picking bins (for example, picking bins A to C).

[0128] As described above, in the initial stage when, for example, a user is considering automating pick-and-place work, the automation support device 100 of the present embodiment designates (for example, inputs) the object conditions of the objects to be pick-and-placed, the picking conditions and placement conditions expressed by the movement of the objects, and the peripheral conditions associated with pick-and-place. Thereby, the automation support device 100 can quantitatively evaluate the difficulty level of automation for executing work by a robot system in terms of difficulty points. Also, the automation support device 100 calculates the difficulty points of automation for each input value (specified content) of each condition, and displays information on the necessary technologies for automation as a solution method for the condition items to which difficulty points are added.

[0129] In addition, when the difficulty point is high, for example, the automation support device 100 displays the SIer information of the system integrator who can handle the pre-registered technologies necessary for automation. For example, the SIer information may be displayed to consult with the system integrator about the automation of the specified content with a difficulty point of 10 or more. As an example, the processor 110 may classify that the difficulty point is 10 or more as a high-difficulty rank. As an example, a difficulty point of 0 may be set as a low-difficulty rank, a difficulty point of 1 to 9 may be set as a medium-difficulty rank, and a difficulty point of 10 or more may be set as a high-difficulty rank.

[0130] In this way, even if the user does not have expertise in robot devices or automation, the automation support device 100 enables the user to grasp the difficulty level when automating the target manual work. Therefore, the automation support device 100 can determine whether the work can be automated and select the target process or process to be automated. In addition, when the difficulty level is high, the user can quickly confirm that automation is difficult, and when the difficulty level is low, automation is easy.

[0131] In addition, the processor 110 may, for example, while changing the specified content of each condition related to the work via the input device 140, cause the display device 150 to display the change in the difficulty point based on the specified content. Thereby, the user can easily confirm how the difficulty level changes when the specified content of which condition (condition item) is changed. Therefore, the automation support device 100 can easily enable the user to consider how to approach the difficulty point of the target line for automation (for example, 15 points) by changing the specified content.

[0132] In addition, the automation support device 100 makes it possible for the user to easily grasp the technologies necessary for automation by displaying the necessary technical information as solution means information for the items to which the difficulty points are added (that is, the condition items with a difficulty point equal to or higher than the threshold th1 (for example, 1 point)).

[0133] In addition, when the difficulty point is high, for example, when the difficulty point is equal to or higher than a threshold value th2 (e.g., 10 points), the automation support device 100 can provide SIer information of a system integrator capable of handling the necessary technologies for automation corresponding to the specified content with this difficulty point. The user can check this SIer information and consult the SIer to receive advice and support for automating pick-and-place operations that are difficult for the user to achieve on their own. Therefore, even without technical knowledge, for high-difficulty operations, the user can request appropriate SIers for support, and for low-difficulty operations, the user can choose to automate them by themselves. On the SIer side, it is no longer necessary to conduct hearings from the very beginning regarding system requirements, and after grasping the notified specified content, the SIer can conduct hearings on automation from the user or others. Therefore, the burden on the SIer for automating operations can be reduced.

[0134] (Second Embodiment) In this embodiment, regarding multiple pick-and-place operations, the comparison of the difficulty levels of automating the operations will be described.

[0135] The configuration of the automation support device 100 in this embodiment is the same as the configuration of the automation support device 100 shown in FIG. 1 of the first embodiment, so the description thereof will be omitted or simplified.

[0136] Next, the operation of the automation support device 100 in this embodiment will be described.

[0137] FIG. 14 is a flowchart showing an operation example of the automation support device 100 in this embodiment. In FIG. 14, the automation of operations related to multiple pick-and-places is assumed.

[0138] First, the processor 110 executes the processes of steps S11 to S17 shown in FIG. 2.

[0139] The processor 110 reads and obtains the automation performance information that has been generated and accumulated in the past from the performance information database 125 (step S31). This automation performance information includes information on difficulty points. The processor 110 may select desired automation performance information from a plurality of automation performance information via the input device 140.

[0140] The processor 110 causes the automation specification information generated in steps S11 to S16 and the automation performance information obtained in step S31 to be compared and displayed, for example, by arranging and displaying them on the display device 150. In this case, the processor 110 causes at least the difficulty points included in the automation specification information and the difficulty points included in the automation performance information to be compared and displayed (step S32).

[0141] The processor 110 outputs information on the comparison result between the automation specification information and the automation performance information (step S33). The output here may include transmitting the information on the comparison result to an external device via the communication device 130.

[0142] The processor 110 stores the information on the comparison result in the performance information database 125 (step S34). Further, the processor 110 may cause the automation specification information (the current automation specification information) generated in steps S11 to S16 to be held in the performance information database 125 as automation performance information.

[0143] According to the operation example shown in FIG. 14 like this, the automation support device 100 can provide the user with information such as the ease of automation and the ease of introducing necessary technical information based on the difficulty points for a plurality of pick-and-place operations.

[0144] Next, specific examples of a plurality of pick-and-place operations will be described. Here, the operations W1 and W2 of pick-and-place will be exemplified.

[0145] Operation W1 is an operation of inverting and storing components of multiple types (for example, 10 types or more) with complex shapes from a dedicated tray (an example of a picking bin) in which each type of component is placed into a blister pack (an example of a placement bin). The dedicated tray has an internal space partitioned to form a plurality of pockets. In each pocket, a plurality of types of components are stored by type, that is, one or more components of one type are stored in one pocket. Inside each pocket, there is a gap for the stored components to move. It is assumed to automate such an operation W1.

[0146] Operation W2 is an operation of taking out electronic components from a place where a plurality of electronic components are stacked and stored in a component case (an example of a picking bin) in order to mount one type of electronic component on a circuit board, and inserting and arranging the terminals of the electronic components into the via holes of the circuit board. It is assumed to automate such an operation W2.

[0147] For the purpose of automating the above two different operations W1 and W2, the processor 110 determines the specified content for each condition related to the operations W1 and W2, and calculates the difficulty points based on the specified content. Then, the processor 110 causes the display device 150 to display the difficulty points of the two operations W1 and W2 so that they can be compared. And the processor 110 causes the display device 150 to display the specified content and the difficulty points side by side for the condition items (that is, the condition items with a difficulty point of 1 or more) to which the difficulty points based on the specified content specified for each condition related to the operation are added. Thereby, the automation support device 100 can provide information on which of the two pick-and-place operations W1 and W2 is easier to automate.

[0148] For example, the automation support device 100 causes the display device 150 to compare and display information on the condition items with high difficulty points in each condition of the two pick-and-place operations W1 and W2. Thereby, the user can determine which of the two operations W1 and W2 is easier to prepare the necessary technology for automation.

[0149] FIG. 15 is a diagram showing an example of difficulty points related to operation W1. In FIG. 15, it is shown in the form of a difficulty point table T11.

[0150] Since the information included in the difficulty point table T11 is the same as the information included in the difficulty point table T1 shown in FIG. 8, a detailed description is omitted. The processor 110 generates a difficulty point table T11 including information on each condition (each condition item), designated candidate, designated content, difficulty point, and integrated difficulty point related to operation W1, and causes it to be displayed on the display device 150.

[0151] FIG. 16 is a diagram showing an example of difficulty points related to operation W2. In FIG. 16, it is shown in the form of a difficulty point table T12.

[0152] Since the information included in the difficulty point table T12 is the same as the information included in the difficulty point table T1 shown in FIG. 8, a detailed description is omitted. The processor 110 generates a difficulty point table T12 including information on each condition (each condition item), designated candidate, designated content, difficulty point, and integrated difficulty point related to operation W2, and causes it to be displayed on the display device 150.

[0153] FIG. 17 is a diagram showing a comparative display example of the difficulty points of two operations W1 and W2. In FIG. 17, it is shown in the form of a difficulty point comparison table T3. In FIG. 17, descriptions of the same matters as those in the tables described above are omitted or simplified.

[0154] In FIG. 17, each condition (condition item) in operations W1 and W2, the specified content, and the difficulty point based on the specified content are associated and held. In FIG. 17, for each of operations W1 and W2, the specified result for each condition (condition item) and the difficulty point are shown. Also, the processor 110 may determine one difficulty point collectively for a plurality of condition items. The processor 110 generates a difficulty point comparison table T3 including at least a part of each information of each condition related to the operation, the specified content for each of operations W1 and W2, and the difficulty point for each of operations W1 and W2, and causes the display device 150 to display it. The information to be displayed includes at least the information of the difficulty points of each of operations W1 and W2. The difficulty point comparison table T3 may include information on the integrated difficulty points for each of operations W1 and W2.

[0155] Therefore, by checking the display of the difficulty point comparison table T3, the user can compare and check the difficulty points and integrated difficulty points of a plurality of pick-and-place operations W1 and W2. Therefore, the user can intuitively judge which operation W1 is easy to automate.

[0156] As described above, according to the automation support device 100 of the present embodiment, since the difficulty levels of automating different operations can be quantitatively compared, it becomes easier to narrow down the operations to be automated. Further, since the automation support device 100 can accumulate the derived automation difficulty information and the necessary technical information corresponding to the high difficulty level as achievements in the achievement information database 125, the elemental technologies for automation can be developed, accumulated, and utilized as a database.

[0157] In the operation example shown in FIG. 14, it was exemplified that the two operations to be compared are the operation related to the automation specification information derived this time and the operation related to the automation performance information derived in the past. However, it is not limited to this. For example, the processor 110 may be such that any of the plurality of operations to be compared is an operation related to a plurality of automation performance information held in the performance information database 125. Also, for example, the processor 110 may be such that any of the plurality of operations to be compared is an operation related to a plurality of automation specification information derived this time.

[0158] (Other embodiments) In the first embodiment and the second embodiment, as the input data, it was exemplified that mainly data in which the specified content is specified by selecting one option from a plurality of options is acquired. However, it is not limited to this. For example, the processor 110 may acquire, as the input data, an image related to a pick-and-place operation. For example, a predetermined imaging device may image a person performing a pick-and-place operation that the user desires to automate. The automation support device 100 may acquire the imaged image as input data via the communication device 130 by the processor 110.

[0159] Then, the processor 110 may determine the specified content of each condition item for each of the object condition, the picking condition, the place condition, and the peripheral condition based on the image as the input data using a predetermined learned model. For example, the processor 110 may use the image of the pick-and-place operation being imaged and the specified content of the object condition, the picking condition, the place condition, and the peripheral condition represented by the image as a pair of learning data, and generate a learned model by causing the learning model to learn using a large number of learning data. This learned model may be, for example, a large language model (LLM) or a vision language model (VLM).

[0160] In this way, by using, as input data, an image capturing the state of the work for which automation is desired, the automation support device 100 can reduce the burden related to the user's input work (the work of determining the specified content) and evaluate the difficulty level of work automation.

[0161] (Overview of the Embodiment) As described above, the present disclosure describes at least the following matters. In the parentheses, the corresponding components, etc. in the above-described embodiment are exemplified, but the present disclosure is not limited thereto.

[0162] (Item 1) An automation support device (automation support device 100) including a processor (processor 110) and supporting the automation of pick-and-place work, wherein the processor specifies an object condition regarding an object to be pick-and-placed, a picking condition regarding the picking of the object, and a placement condition regarding the placement of the object, determines a quantitative difficulty level for automating the work based on the specified object condition, picking condition, and placement condition, and causes the quantitative difficulty level to be displayed on a display device (display device 150). Automation support device.

[0163] Accordingly, the automation support device can accurately derive the difficulty level of automation in consideration of various conditions related to the work. The automation support device can provide the user with information regarding the difficulty level when automating manual work even if the user does not have expertise in robot devices or automation. Therefore, the automation support device can determine whether work can be automated and select the target process or process to be automated. Further, the automation support device can ensure the eligibility of the automation system determined based on the difficulty level.

[0164] (Item 2) wherein the processor specifies peripheral conditions regarding peripheral work associated with the pick-and-place of the object, Determine the quantitative difficulty level based on the specified object conditions, picking conditions, placement conditions, and peripheral conditions. The automation support device according to item 1.

[0165] Thereby, the automation support device can evaluate the difficulty level of work automation, taking into account not only the processes within the pick-and-place work but also the peripheral conditions related to the peripheral work required for pick-and-place. Thereby, the automation support device can evaluate the difficulty level of work automation, taking into account the peripheral conditions related to the peripheral work required for pick-and-place.

[0166] (Item 3) The processor Calculates a first difficulty point for automating the work based on the specified object conditions. Calculates a second difficulty point for automating the work based on the specified picking conditions. Calculates a third difficulty point for automating the work based on the specified placement conditions. Calculates a fourth difficulty point for automating the work based on the specified peripheral conditions. Determines the quantitative difficulty level based on the first difficulty point, the second difficulty point, the third difficulty point, and the fourth difficulty point. The automation support device according to item 2.

[0167] Thereby, the automation support device can derive a difficulty point for each condition related to the work and quantitatively derive the final difficulty level.

[0168] (Item 4) Each of the object conditions, picking conditions, placement conditions, and peripheral conditions includes one or more condition items. The processor causes the display device to display each difficulty point corresponding to the specified content specified by the condition item for each of the condition items. The automation support device according to item 2 or 3.

[0169] As a result, the automation support device can derive each difficulty point such as a subdivided process by specifying detailed conditions according to condition items obtained by subdividing the conditions related to the work and determining the specified content. Further, the automation support device can inform the user of the difficult parts in the work by displaying the subdivided difficulty points.

[0170] (Item 5) The processor causes the display device to display information (necessary technical information) on a solution means for achieving the specified content of the condition item for which the difficulty point is equal to or greater than a threshold value (1 point). The automation support device according to item 4.

[0171] As a result, the automation support device can inform the user of, for example, the technology necessary to achieve a specified content with a high degree of difficulty.

[0172] (Item 6) The processor rank - orders according to the difficulty points for the specified content of each condition item, and when the rank in which the difficulty point is equal to or higher than a predetermined standard (a rank with a high degree of difficulty) includes the difficulty point, causes the display device to display information (SIer information) regarding a system integrator who realizes the automation of the specified content corresponding to the difficulty point. The automation support device according to item 4 or 5.

[0173] As a result, when, for example, the difficulty point for the specified content of a condition item is high, the automation support device can provide the user with information on a system integrator who is an expert in work automation. Therefore, the user can receive advice etc. from the system integrator regarding the work parts with a high degree of difficulty.

[0174] (Item 7) The processor acquires an image in which the pick - and - place of the object has been imaged, Based on the image, specify the object conditions, the picking conditions, and the placing conditions. The automation support device according to any one of items 1 to 6.

[0175] As a result, the automation support device can reduce the burden on the user for automating the work by, for example, automatically specifying the conditions related to the work based on the image in which the state of pick-and-place is imaged, rather than the user answering each question item one by one regarding the condition items.

[0176] (Item 8) An automation support method for supporting the automation of pick-and-place work, comprising: specifying object conditions related to an object to be pick-and-placed, picking conditions related to the picking of the object, and placing conditions related to the placement of the object; determining a quantitative difficulty level for automating the work based on the specified object conditions, picking conditions, and placing conditions; and causing a display device to display the quantitative difficulty level.

[0177] As a result, the same effect as in item 1 can be obtained.

[0178] As described above, various embodiments have been described with reference to the drawings. Needless to say, the present disclosure is not limited to such examples. It is obvious that those skilled in the art can conceive of various modification examples or correction examples within the scope described in the claims, and it is naturally understood that those also belong to the technical scope of the present disclosure. Also, within the scope not departing from the gist of the invention, the respective components in the above embodiments may be arbitrarily combined.

Industrial Applicability

[0179] The present disclosure is useful for an automation support device, an automation support method, etc. that can evaluate the difficulty level of work automation in consideration of various conditions related to pick-and-place.

Explanation of Signs

[0180] 100 Automated Support Device 110 Processor 111 Picking Condition Processing Unit 112 Place Condition Processing Unit 113 Object Condition Processing Unit 114 Peripheral Condition Processing Unit 120 Memory 121 Processing Logic Database 122 Difficulty Information Database 123 Required Technical Information Database 124 SIer Information Database 125 Performance Information Database 130 Communication Device 140 Input Device 150 Display Device 200 Automated System T1, T11, T12 Difficulty Point Table T2 Required Technologies for Automation Table T3 Difficulty Point Comparison Table

Claims

1. An automation support device that includes a processor and supports the automation of pick-and-place operations, wherein the processor specifies object conditions regarding an object to be pick-and-placed, picking conditions regarding the picking of the object, and place conditions regarding the placement of the object, determines a quantitative level of difficulty for automating the operation based on the specified object conditions, picking conditions, and place conditions, and causes the quantitative level of difficulty to be displayed on a display device Automation support device.

2. The processor specifies peripheral conditions regarding peripheral operations associated with the pick-and-place of the object, and determines the quantitative level of difficulty based on the specified object conditions, picking conditions, place conditions, and peripheral conditions, The automation support device according to claim 1.

3. The processor calculates a first difficulty point for automating the operation based on the specified object conditions, calculates a second difficulty point for automating the operation based on the specified picking conditions, calculates a third difficulty point for automating the operation based on the specified place conditions, calculates a fourth difficulty point for automating the operation based on the specified peripheral conditions, and determines the quantitative level of difficulty based on the first difficulty point, the second difficulty point, the third difficulty point, and the fourth difficulty point, The automation support device according to claim 2.

4. Each of the object conditions, picking conditions, place conditions, and peripheral conditions includes one or more condition items, and the processor causes each difficulty point corresponding to the specified content specified by the condition item to be displayed on the display device for each of the condition items, The automation support device according to claim 2.

5. The processor causes information on a solution means for achieving the specified content of the condition item for which the difficulty point is equal to or greater than a threshold value to be displayed on the display device, The automation support device according to claim 4.

6. The processor ranks according to the difficulty points for the specified content of each condition item, When the difficulty point is included in a rank equal to or higher than a predetermined standard, display information about a system integrator that realizes automation of the specified content corresponding to the difficulty point on the display device. The automation support device according to claim 4.

7. The processor acquires an image in which a subject including the object is imaged, specifies the object condition, the picking condition, and the place condition based on the image. The automation support device according to claim 1 or 2.

8. An automation support method for supporting automation of pick-and-place work, comprising: specifying an object condition regarding an object to be pick-and-placed, a picking condition regarding picking of the object, and a place condition regarding placement of the object; determining a quantitative difficulty level for automating the work based on the specified object condition, picking condition, and place condition; displaying the quantitative difficulty level on a display device; An automation support method having the above.

Citation Information

Patent Citations

  • Remote operation system and management server

    JP2019032589A

  • Management system and control method

    JP2019063950A

  • Process plan support device, process plan support method, and process plan support program

    JP2018026071A