Automation assistance device and automation assistance method
By acquiring information on the operation process and specifications, the performance, productivity, and cost of the automation system are evaluated, and the automation structure is optimized. This solves the problems of high cost or low precision in existing robotic operations and achieves efficient overall automation of operations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-09-23
- Publication Date
- 2026-03-31
AI Technical Summary
Existing technologies, when automating manual operations, only consider the robot's operation time and fail to comprehensively assess the operation cost and accuracy, resulting in high robot operation costs or low accuracy, making it difficult to achieve overall automation of the operation.
By acquiring information on operational processes and required specifications, the performance, productivity, and cost of automated systems are evaluated, and change assistance information is output to optimize the automation structure.
This approach optimizes process automation within a holistic automation system, improving the accuracy of robot operations and reducing costs.
Smart Images

Figure CN121756321A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to automated auxiliary devices and automated auxiliary methods. Background Technology
[0002] Previously, an information processing apparatus for assisting in the editing of work plans was known. This apparatus includes: a calculation unit that calculates the changed work time for the human and the work time for the robot when, from a state where work has been assigned to each arm of a robot with multiple arms and a human, the assignment destination of a work assigned to a human is changed to one arm of the robot; a comparison unit that compares the work time calculated by the calculation unit with the work time of the robot; and a warning unit that issues a warning when the comparison result performed by the comparison unit indicates that the work time of the robot is longer than the work time of the human (see Patent Document 1).
[0003] Existing technical documents
[0004] Patent documents
[0005] Patent Document 1: Japanese Patent No. 6935772 Summary of the Invention
[0006] The problem the invention aims to solve
[0007] This disclosure provides an automation aid device and automation aid method that can appropriately automate a process taking into account the overall operation performed by a robotic device.
[0008] Solution for solving the problem
[0009] One aspect of this disclosure is an automation assistance device comprising a processor for assisting in the automation of processes included in an operation, wherein the processor performs the following processing: acquiring operation process information related to the time sequence of processes required for human operation and requirement specification information related to the specifications required by the automation system executing the processes; determining a first structure of the automation system based on the operation process information; evaluating the performance, productivity, and cost of the automation system with the first structure based on the operation process information and the requirement specification information; and outputting first modification assistance information for assisting in changes to the first structure of the automation system based on the evaluation results.
[0010] One aspect of this disclosure is an automation assistance method for assisting in the automation of processes included in a task. The automation assistance method includes the following processing: acquiring task process information related to the time sequence of the process required for human operation and requirement specification information related to the specifications required by the automation system performing the process; determining a first structure of the automation system based on the task process information; evaluating the performance, productivity, and cost of the automation system with the first structure based on the task process information and the requirement specification information; and outputting first change assistance information to assist in changes to the first structure of the automation system based on the evaluation results.
[0011] Invention Effects
[0012] According to this disclosure, it is possible to appropriately automate the entire operation performed by robotic devices. Attached Figure Description
[0013] Figure 1 This is a block diagram illustrating a structural example of an automated auxiliary device.
[0014] Figure 2 This is a block diagram illustrating one example of the various databases that a memory may possess.
[0015] Figure 3 This is a block diagram illustrating one example of the various processes performed by the processor.
[0016] Figure 4 This is a flowchart illustrating an example of the operation of an automated auxiliary device.
[0017] Figure 5 This is a diagram illustrating an example of an initial automated structure.
[0018] Figure 6 This is a diagram showing specific examples of various countermeasures and their impact when the evaluation result is NG.
[0019] Figure 7 It is a diagram showing the process of loading a container of goods by a person.
[0020] Figure 8 This is a perspective view showing an example of an automated system with an initial automated structure.
[0021] Figure 9 This is a diagram showing an example of the display corresponding to the evaluation of the initial automation structure.
[0022] Figure 10 This is a perspective view showing an example of an automation system with the automation structure after its first modification.
[0023] Figure 11 This is a diagram showing an example of the display corresponding to the evaluation of the automation structure after the first modification.
[0024] Figure 12 This is a perspective view showing an example of an automation system with a second modified automation structure.
[0025] Figure 13 This is a diagram showing an example of the evaluation corresponding to the second modified automation structure. Detailed Implementation
[0026] The embodiments will now be described in detail with appropriate reference to the accompanying drawings. However, sometimes unnecessary details are omitted. For example, detailed descriptions of well-known matters and repetitive descriptions of substantially the same structures are sometimes omitted. This is to avoid unnecessarily lengthy descriptions and to facilitate understanding by those skilled in the art. Furthermore, the drawings and the following description are provided to enable those skilled in the art to fully understand this disclosure and are not intended to limit the subject matter of the claims.
[0027] (The process of obtaining the embodiments of this disclosure)
[0028] In the information processing device of Patent Document 1, the main comparison is between the operation time of a robot and that of a human, without considering whether automation is possible, taking into account factors other than operation time, such as the cost of the operation and the capabilities of the robot performing the operation. While automating human-performed tasks requires numerous parameters, the information processing device in Patent Document 1 only considers one parameter. Therefore, even if a shorter robot operation time is chosen, the cost of the robot's operation is high, or the robot's operational accuracy is low, making it difficult to automate the entire operation of the task performed by the robotic device.
[0029] The following embodiments describe an automation aid device and automation aid method that can appropriately automate a process taking into account the overall operation performed by a robotic device.
[0030] (First Implementation)
[0031] <Structure of Automated Auxiliary Devices>
[0032] Figure 1 This is a block diagram illustrating a structural example of an automation auxiliary device. The automation auxiliary device 100 includes a processor 110, a memory 120, a communication device 130, an input device 140, and a display device 150. The automation auxiliary device 100 assists in the derivation of an automation system for each step (e.g., a manufacturing step) included in a task.
[0033] Processor 110 may be constructed using, for example, a central processing unit (CPU), a digital signal processor (DSP), or a graphics processing unit (GPU). Processor 110 may also be constructed using various integrated circuits, such as large-scale integrated circuits (LSI) or field-programmable gate arrays (FPGAs). Processor 110 implements various functions by executing programs stored in memory 120. Processor 110 provides unified control over the various parts of the automation auxiliary device 100 to perform various processes.
[0034] The memory 120 may also include random access memory (RAM), read-only memory (ROM), hard disk drive (HDD), solid-state drive (SSD), optical disk, or SD card, etc. The memory 120 can be an external storage medium or removable from the automation auxiliary device 100. The memory 120 stores various data, information, programs, or learning models, etc.
[0035] The communication device 130 communicates various data or information using wired or wireless communication methods. The communication method of the communication device 130 may also include local area network (LAN), wide area network (WAN), mobile phone network, or power line communication.
[0036] Input device 140 may also include various buttons, keys, keyboards, touch panels, microphones, sensors, scanners, or other input devices. Input device 140 accepts input of various data or information. Input device 140 is operated by a user. The user may be, for example, an operator or manager automating various work processes.
[0037] Display device 150 is, for example, a liquid crystal display (LCD) or an organic EL display. Display device 150 displays various data or information. The display on display device 150 can also be confirmed by the user.
[0038] Furthermore, regarding the automation assistance device 100, an example is shown with various structural components and functions, but it is not limited to this. For example, the various structural components and functions of the automation assistance device 100 can also be distributed to form a system (automation assistance system). The system can be constructed as a cloud on a network or as a local server device.
[0039] Figure 2 This is a block diagram illustrating one example of the various databases possessed by memory 120.
[0040] The memory 120 has a hardware database 121 (also referred to as hardware DB) and a software database 122 (software DB).
[0041] The hardware database 121 maintains information related to the hardware that the automation system may have. The hardware information includes robot information, sensor information, hand information, and FA (Factory Automation) equipment information.
[0042] Robot information includes information related to the robot device, such as information about its structure. Robot devices include robotic arms and manipulators. Manipulators, because they are connected to the end of the robotic arm, are also called end effectors. Robot information may include, for example, structural information related to the robot device's construction, arm information related to the robotic arm, and information about the robot device's settable positions, as well as other information. Structural information may also include information indicating the type of robot device's construction (e.g., orthogonal robot, vertical articulated robot, other types of construction). Arm information may also include information such as the robotic arm's shape, size, weight, and range of motion.
[0043] Sensor information includes information about the sensors capable of detecting various events. Sensors may also include cameras. Therefore, sensor information may also include images captured by cameras. Sensor information may include, for example, the type of sensor (e.g., position detection sensor, speed sensor), the events that can be detected by the sensor, and the possible locations where the sensor can be installed.
[0044] Hand information refers to information related to the robotic arm. Hand information can include, for example, for each hand, the type of hand (e.g., gripping, two-finger, multi-finger, other types of hands), shape, size, weight, and characteristics of the objects that can be grasped by the hand (e.g., the grasping surface of the object is flat, the grasping surface of the object is smooth, the object is below a specified weight). In other words, hand information can also include information such as what the robotic arm should grasp based on its type.
[0045] FA (Factory Automation) equipment information includes information related to the equipment required for automation (FA) within a factory. FA equipment information may include, for example, conveyor information related to belt conveyors (e.g., type, shape, size, and weight of belt conveyors), platform information related to platforms (e.g., type, shape, size, and weight of platforms), container information related to containers (e.g., type, shape, size, and weight of containers), and may also include other information.
[0046] Figure 3 This is a block diagram illustrating one example of various processes performed by the processor 110.
[0047] Processor 110 performs tasks including processing job process information input, processing automated structure fabrication, processing automated structure changes, processing requirement specification information input, processing cost evaluation, processing productivity evaluation, processing performance evaluation, and processing evaluation results output. Processor 110 can also perform other processing.
[0048] Work process information input processing is the processing of inputting work process information. Work process information is information showing the sequence of steps included in various jobs (e.g., jobs within a factory), and is information related to the time sequence of steps required for a person to perform the job. Work process information is shown, for example, in the form of a work process sheet. Furthermore, a work process sheet only needs to contain information on the steps themselves, and does not necessarily need to be time-series information.
[0049] Automated structure fabrication processing is the process of creating an automated system structure (automated structure) that includes robotic devices to perform each step of the operation based on work process information. The automated system may also include, for example, robotic devices (e.g., a picking robot) that perform at least a portion of the human work steps, and other peripheral equipment (e.g., sensors, cameras, PCs, belt conveyors, containers, platforms, other devices, equipment).
[0050] The automation structure verification and change processing includes the following processes: verifying (identifying and analyzing) the detailed structure of the created or modified automation structure. The automation structure verification and change processing also includes the following processes: modifying the automation structure to create a new automation structure. At this time, the processor 110 can also receive user input via the input device 14 to make minor changes or fine adjustments to at least a portion of the automation structure, for both the initial and modified automation structures.
[0051] Requirement specification information input processing is the process of inputting requirement specification information. Requirement specification information represents the specifications required by the automated system for each process included in the execution of the operation. For example, requirement specification information includes information on specifications (requirement specifications) from various perspectives required for the implementation of the manufactured automated system. For instance, requirement specification information includes performance requirements related to whether the robot's capabilities and the performance (also called capabilities, specifications) of the automated system are met when switching from a human to a robot. Additionally, requirement specification information includes productivity requirement specifications related to the productivity of the automated system. Productivity is related to operation time and can also be expressed, for example, in terms of tact time. Furthermore, requirement specification information includes cost requirement specifications related to the cost of the automated system.
[0052] The required specification information includes, for example, information related to the items (objects, workpieces) that are the objects of the work, equipment information related to the equipment used for the work, operational information related to the operations used to perform the work, and cost information related to the costs required for the work.
[0053] Item information may also include information such as the size, weight, and material of the item being handled. Equipment information may also include the size of the container used to store the item during placement, the method of storing the item in the container (loading method), the quantity of items stored in the container, or the specifications, speed, and layout of the belt conveyor. Equipment information may also include the required specifications related to the container used to store the item during retrieval.
[0054] Operational information may also include the required accuracy for picking and placing by the automated system, the maximum number of repetitions, cycle time, production quantity, system uptime, and number of days. The maximum number of repetitions is one example of an indicator of the durability of the automated system. For instance, cycle time can also be calculated based on the production quantity and the production time required for each item.
[0055] Cost information may also include labor costs when operations are performed by humans, depreciation costs of robotic devices, or labor cost ratios. Furthermore, the information mentioned above required in the specifications is just one example and is not limited to this.
[0056] Cost evaluation processing is the process of evaluating the cost required for an automation system. As an example, in cost evaluation processing, processor 110 calculates the cost based on hardware or software information stored in memory 120 and information about the assumed automation structure. Processor 110 evaluates the cost of the automation system by comparing the calculated cost with the cost information contained in the requirements specification information. The cost evaluation here could also be, for example, whether the total cost required to construct the automation system is within the specified cost.
[0057] Productivity evaluation processing is the process of evaluating the productivity of an automated system. As an example, in productivity evaluation processing, processor 110 calculates the productivity (e.g., cycle time) based on hardware or software information stored in memory 120 and information about a assumed automation structure. Processor 110 evaluates productivity by comparing the calculated productivity with operational information (e.g., cycle time) contained in the requirement specifications. For example, productivity evaluation here could also be whether the cycle time for picking up and placing items for a task is within a specified time.
[0058] Performance evaluation processing is the process of evaluating the performance of an automated system. As an example, in performance evaluation processing, processor 110 calculates the performance based on hardware or software information stored in memory 120 and information about a hypothetical automated structure. Processor 110 evaluates the performance by comparing it with item information and equipment information included in the requirement specifications. For example, the performance evaluation could also assess whether the picking and placing of items intended for the task can be performed.
[0059] The evaluation result output processing is the process of outputting the evaluation results obtained through the various evaluation processes described above. Evaluation results may include, for example, performance evaluation results, productivity evaluation results, and cost evaluation results, and may also include other information. Furthermore, the processor 110 may also output information on improvement measures and other information along with the evaluation results. In addition, the output may be in ways other than display, and may include sound output, printing, etc.
[0060] <Operation of Automated Assistive Devices>
[0061] Next, the operation of the automated auxiliary device 100 will be explained.
[0062] Figure 4 This is a flowchart illustrating an example of the operation of the automated auxiliary device 100. Figure 4 The description also illustrates, as an example of using the automated auxiliary device 100, the automation research of the operation of loading items completed on the factory production line into containers for outbound storage.
[0063] Processor 110 acquires (inputs) job process information and requirement specification information (step S11). The job process information and requirement specification information can be stored in memory 120 and acquired from memory 120, or received via communication device 130, or acquired via input device 140.
[0064] In step S11, the work process information may include, for example, the contents of the work process sheet or instruction sheet when the operator loads the items delivered by the belt conveyor into the container. The work process information may also include basic information about the items being worked on and the equipment used to perform the work.
[0065] The processor 110 determines the initial automation structure based on the job process information (step S12). That is, the processor 110 creates the initial structure of the automation system. Details of the initial automation structure will be described later. The determination of the initial automation structure is an example of a hypothetical automation structure. Furthermore, after the processing in step S12, the processor 110 can also receive user input via the input device 14 to make minor changes or adjustments to at least a portion of the created automation structure.
[0066] The processor 110 evaluates the performance of the determined (hypothetical) automation structure based on requirement specification information (e.g., performance requirement specifications) and displays the performance evaluation result on the display device 15 (step S13). In this case, the processor 110 evaluates whether the performance of the hypothetical automation structure (e.g., the initial automation structure) is satisfied with the requirement specification information and obtains the performance evaluation result. Furthermore, the performance of the hypothetical automation structure is the performance of the automation system with that structure; in other words, it is synonymous with the performance of the automation system with the hypothetical structure.
[0067] As an example, if the performance requirements are met, the performance evaluation result may include an "OK" result indicating that the performance of the automated structure meets the requirements. Conversely, if the performance requirements are not met, the performance evaluation result may include an "NG" result indicating that the performance of the automated structure does not meet the requirements.
[0068] In performance evaluation, for example, processor 110 evaluates the positioning accuracy of the selected (hypothetical) robot device, the portable weight of the robot device, the range of motion of the robotic arm, the pickup area picked up by the robot device, the durability of the robot device, the degrees of freedom of the arm used by the robot device to grip the object, the type of gripper, the suitability of the gripper relative to the object, the necessity of image processing using a camera for position detection, and the necessity of positioning sensors, etc. The range of motion of the arm can be determined, for example, based on information such as the length and angle range of the robotic arm included in the requirements specifications. The degrees of freedom of the arm used to grip the object can vary, for example, depending on whether it is only necessary to move the robotic arm relative to the object from above, or whether rotation of the robotic arm is required. The suitability of the gripper can also be determined based, for example, on information such as the width of the smooth surface of the object included in the requirements specifications.
[0069] Processor 110 determines whether the performance evaluation result meets the performance requirements specification (i.e., the performance evaluation result is OK) (step S14).
[0070] If the performance evaluation result meets the performance requirements (step S14: "Yes"), the processor 110 evaluates the productivity of the automation structure and displays the productivity evaluation result on the display device 15 (step S15). In this case, the processor 110 evaluates whether the productivity of the assumed automation structure (e.g., the initial automation structure) is met based on the requirement specification information, and obtains the productivity evaluation result. Furthermore, the productivity of the assumed automation structure is the productivity of the automation system with that structure; in other words, it is synonymous with the productivity of the automation system with the assumed structure.
[0071] As an example, if productivity is met for the required specifications, the productivity evaluation result may include an "OK" result indicating that the productivity of the automated structure meets the required specifications. Conversely, if productivity is not met for the required specifications, the productivity evaluation result may include an "NG" result indicating that the productivity of the automated structure does not meet the required specifications.
[0072] In productivity evaluation, for example, processor 110 assumes that the robotic arm and the robotic hand move at a specified speed and acceleration within a hypothetical automated structure, and calculates the movement time of the robotic arm and the action time of the robotic hand, thereby calculating the cycle time. Then, processor 110 can also compare the cycle time based on human operation with the cycle time based on the automated structure. Furthermore, processor 110 can also compare the daily or monthly production quantity based on human operation with the daily or monthly production quantity based on the automated structure.
[0073] Processor 110 determines whether the productivity evaluation result meets the productivity requirement specification (i.e., the productivity evaluation result is OK) (step S16).
[0074] If the productivity evaluation result meets the productivity requirement specifications (step S16: "Yes"), the processor 110 evaluates the cost of the automation structure and displays the cost evaluation result on the display device 15 (step S17). In this case, the processor 110 evaluates whether the cost of the assumed automation structure (e.g., the initial automation structure) is met based on the requirement specification information and obtains the cost evaluation result. Furthermore, the cost of the assumed automation structure is the cost of the automation system with that structure; in other words, it is synonymous with the cost of the automation system with the assumed structure.
[0075] As an example, if the cost is met for the required specifications, the cost evaluation result may include an "OK" result indicating that the cost of the automated structure meets the required specifications. Conversely, if the cost is not met for the required specifications, the productivity evaluation result may include an "NG" result indicating that the cost of the automated structure does not meet the required specifications.
[0076] In cost evaluation, for example, processor 110 can calculate the required cost (automation cost) of the automation structure based on the initial investment cost, operating cost, and depreciation period of the assumed automation structure. Alternatively, processor 110 can calculate the annual cost under human operation conditions based on the cost per unit time and operational information when humans perform the same task. Processor 110 compares the required automation cost under the automation structure conditions with the required annual cost under the human operation conditions. Alternatively, if the comparison shows that the automation cost under the automation structure conditions is cheaper than the annual cost under the human operation conditions, the automation structure is deemed to meet the cost requirements.
[0077] Processor 110 determines whether the cost evaluation result meets the cost evaluation criteria (i.e., the cost evaluation result is OK) (step S18).
[0078] On the other hand, if the performance evaluation result does not meet the performance requirements (step S14: "No"), if the productivity evaluation result does not meet the productivity requirements (step S16: "No"), or if the cost evaluation result does not meet the cost requirements (step S18: "No"), the processor 110 changes the assumed automation structure (step S19). In this case, the processor 110 can also change the automation structure by receiving input from the user via the input device 140. At this time, the user can, for example, check the evaluation results and countermeasures information displayed on the display device 150 and use them as a reference for changing the automation structure. Therefore, the automation assistance device 100 can provide information that is helpful in determining the automation structure. Therefore, the changes and evaluations of the automation structure can be repeated until the evaluation results for the changed automation structure meet the respective requirements.
[0079] For example, if the performance evaluation result does not meet the performance requirements (step S14: "No"), the processor 110 changes the automation structure to improve performance by changing it to a high-performance robot device, or by making the manipulator lighter (step S19). After processing in step S19, proceed to step S13.
[0080] Alternatively, if no suitable robotic device or automated structure is available to accommodate the aforementioned changes, the processor 110 may request that the specifications be modified to be robot-friendly. Specifically, the processor 110 may also make layout changes such as shortening the distance between the pickup and placement positions, or reducing the pickup area (e.g., the area of a storage container) or the placement area (e.g., the area of a shipping container). This could also lead to cost reductions in the automated structure.
[0081] For example, if the productivity evaluation result does not meet the productivity requirements (step S16: "No"), the processor 110 changes the automation structure to reduce cycle time by increasing the speed of the robot device's movements, increasing the number of robot devices, or handling a large amount of data due to changes in the specifications of the robotic arm (step S19). After processing in step S19, the process proceeds to step S13.
[0082] Alternatively, if no suitable robot device or automation structure is available to accommodate the aforementioned changes, the processor 110 may request that the specifications be modified to be robot-friendly. Specifically, the processor 110 may also increase the robot device's operational time or production days. This could potentially lead to cost reductions in the automation structure.
[0083] Furthermore, if the cost evaluation results do not meet the cost requirements (step S18: "No"), as an example, the processor 110 changes the automation structure to achieve cost reduction of the automation structure by changing to a cheaper robot device, reducing peripheral equipment (such as a camera for image processing), etc. (step S19). After processing in step S19, proceed to step S13.
[0084] Alternatively, if no suitable robotic device or automated structure is available to accommodate the aforementioned changes, the processor 110 may request that the specifications be modified to be robot-friendly. Specifically, the processor 110 may also shorten its depreciation period. This could potentially lead to cost reductions in the automated structure.
[0085] Furthermore, the countermeasures used to improve the performance evaluation results, productivity evaluation results, and cost evaluation results have different correlations with the three requirement specifications (performance requirement specification, productivity requirement specification, and cost requirement specification). Therefore, even if the evaluation result improves for one requirement specification, the evaluation result may worsen for another requirement specification. Therefore, the processor 110 returns to step S13 and performs the above three evaluations (performance evaluation, productivity evaluation, and cost evaluation) again on the modified automation structure.
[0086] If the cost evaluation results meet the cost requirements (step S18: "Yes"), that is, if the three evaluation results meet the requirements, the processor 110 determines the automation structure as the assumed automation structure and outputs information related to the determined automation structure (also called automation structure information) (step S20). The automation structure information may include, for example, information about the hardware and software included in the determined automation system, and may also include identification information of each device, connection relationships of each device, software installation information, etc. Furthermore, the output here may include, for example, sending to an external device via the communication device 130, storing the information in the memory 120, or displaying it via the display device 150, or may include output in other ways.
[0087] For example, by confirming the display of automation structure information, users can identify the structure of the automation system corresponding to the automation structure information, and can set or configure various hardware (such as various devices, apparatuses, sensors, etc.) and software (such as OS, APIs) included in the automation system.
[0088] In this way, the automation assistance device 100 compares the required specifications with the initial automation structure from the perspectives of "performance," "productivity," and "cost." The automation assistance device 100 can then derive a final automation structure and action plan that satisfies all three perspectives.
[0089] An action plan, for example, represents a process (plan) for performing actions of each step through a determined automation structure. For instance, suppose the final decision is to include an automation system that includes a robotic arm capable of simultaneously picking up and placing two items. In this case, the simultaneous picking and placing of two items is not envisioned in the work procedure book, so it is set as "picking up and placing two items." However, the action plan enables the simultaneous picking and placing of two items, so it is set as "simultaneously picking up and placing two items." For example, processor 110 can also generate an action plan based on the determined automation structure and work procedure book.
[0090] Furthermore, examples illustrate outputting information containing each evaluation result at different times in steps S13, S15, and S17, but this is not a limitation. Alternatively, the information containing each evaluation result can be output at the same time at any time after step S17, where each evaluation has ended.
[0091] Figure 5 This is a diagram illustrating an example of an initial automated structure.
[0092] The memory 120, for example, stores information related to a standard structure used for each process (also called standard structure information). This standard structure forms the basis of the automation structure. Based on the standard structure information, the processor 110 determines the automation structure capable of executing each process contained in the work process information, thereby obtaining the automation structure. Alternatively, the standard structure information may not be stored in the memory 120 but in an external device (e.g., an external server). In this case, the processor 110 may also obtain the standard structure information from the external device via the communication device 130.
[0093] For example, the initial automation structure for each step of the loading operation includes a control API (Application Programming Interface), a PC (Personal Computer), a platform, a robot device A, a robotic arm B, a camera C, a belt conveyor, and a container. For example, the robot device can be composed of at least one of a plurality of structures; here, processor 110 specifies robot device A (e.g., a multi-joint robot). For example, the robotic arm B can be composed of at least one of a plurality of hand types; here, processor 110 specifies robotic arm B (e.g., a suction type). For example, regarding other structural components (e.g., the PC), processor 110 can also specify whether they are included in the initial automation structure, or specify at least one from multiple options.
[0094] Furthermore, the initial automation structure can be modified to take into account requirements and specifications that cannot be obtained through the work process information. For example, the initial automation structure can be modified when it is impossible to hold the item when considering its actual weight, size, etc., or when the robotic arm's reach is insufficient during picking and placing.
[0095] After determining the initial automation structure, the automation structure was updated sequentially to ensure that its performance, productivity, and cost met the requirements and specifications of each process.
[0096] <Specific examples of countermeasures when the evaluation result is NG>
[0097] Next, we will explain the countermeasures and their impact when the evaluation result is NG.
[0098] Figure 6 This is a diagram illustrating specific examples of various countermeasures and their impact when the evaluation result is NG (Not Good). Figure 6 In this process, the predictive information of cost evaluation, productivity evaluation, and performance evaluation are maintained in association with each countermeasure method. Figure 6The information can be stored in memory 120 or retrieved from an external device via communication device 130. Furthermore, in Figure 6 In this context, the robotic device is simply referred to as a robot, and the object being worked on is simply referred to as a workpiece. These countermeasures and the predictive information of each evaluation can also be output by the processor 110 (e.g., displayed via the display device 150), which helps with changes to the automation structure and changes to the required specifications.
[0099] Cost assessment forecasts indicate the degree of improvement (impact) in the cost of the modified automation structure compared to the cost of the original automation structure, assuming the implementation of countermeasures and changes to the automation structure. Productivity assessment forecasts indicate the degree of improvement (impact) in the productivity of the modified automation structure compared to the productivity of the original automation structure, assuming the implementation of countermeasures and changes to the automation structure. Performance assessment forecasts indicate the degree of improvement (impact) in the performance of the modified automation structure compared to the performance of the original automation structure, assuming the implementation of countermeasures and changes to the automation structure.
[0100] Countermeasures may include, for example, "extending the depreciation period," "changing the ratio of human to robot operations," "extending the robot's (robot device's) operating time," "increasing the robot's speed," "increasing the number of robots," "increasing the number of objects handled at once (taking multiple objects)," "shortening the distance between the pick-up and placement positions of workpieces (items)," "reducing the size of the pick-up and placement areas," "changing to a high-performance robot," and "changing to a lightweight end effector," and may also include other countermeasures. Forecast information for cost evaluation, productivity evaluation, and performance evaluation can be expressed as "better," "worse," or "no impact," or through other information.
[0101] Furthermore, strategies such as increasing the speed of robotic devices may also lead to higher standards for automation systems and increased costs. In other words, it could also be related to... Figure 6 Different types of relationships.
[0102] Figure 6 Among the countermeasures, "increasing the speed of the robot," "increasing the number of robots," "increasing the number of objects to be handled at one time (taking multiple objects)," "changing to a high-performance robot," and "changing to a lightweight end effector" are examples of countermeasures to change the automation structure. Figure 6Among the countermeasures, "extending the depreciation period," "changing the ratio of human to robot operations," "extending the operating time of robots (robot devices)," and "reducing the size of the pick-up and place-down areas" are examples of changes required to the specification information.
[0103] Furthermore, there are situations where a countermeasure becomes a trade-off relative to the evaluation results. That is, it's possible that implementing a countermeasure improves one evaluation result but worsens others. In this case, the automation assistance device 100 can avoid inappropriateness as a whole by re-evaluating the new automation structure.
[0104] Figure 6 The information shown can be used, for example, as follows.
[0105] When the processor 110 of the automation assistance device 100 follows Figure 4 When processing the flowchart, the automation structure is automatically changed by modifying the parameters related to the automation structure through step S19, thus eliminating the need for manual modification. Figure 6 The information is displayed on the screen of display device 150. On the other hand, if at least one item regarding cost evaluation, productivity evaluation, and performance evaluation fails to achieve an "OK" rating, the process is repeated... Figure 4 The processing steps S13 to S19.
[0106] In contrast, Figure 4 If the processing loop of steps S13 to S19 is repeated a fixed number of times and at least one item fails to achieve an OK evaluation, the processor 110 may also... Figure 6 Information is displayed on the screen, allowing the user to select any countermeasure via input device 140. Alternatively, the processor 110 may display a message whenever any of the cost evaluation, productivity evaluation, or performance evaluation results in an "NG" (Not Acceptable) rating. Figure 6 The information allows the user to select any countermeasure via input device 140.
[0107] Furthermore, in processor 110 according to Figure 4 When processing the flowchart, if only the initial performance evaluation is performed and the result is NG, then productivity and cost evaluations cannot be obtained because they are not performed. Therefore, processor 110 can also output evaluation results such as OK or NG after obtaining all three evaluations (cost evaluation, productivity evaluation, and performance evaluation). That is, in this case, processor 110 can also process the data in the order of steps S13, S15, S17, S14, S16, and S18.
[0108] <use case>
[0109] Next, a use case of automation assistance provided by the automation assistance device 100 will be described.
[0110] Figure 7 This diagram illustrates a container-loading operation of articles performed by a person (operator). The automation auxiliary device 100 automates each step of the process, enabling the container-loading operation of such articles to be performed via an automated system.
[0111] Processor 110 creates an initial automation structure, etc., to assume an automation structure. Based on the assumed automation structure, processor 110 derives various evaluation results (e.g., productivity evaluation results, cost evaluation results, performance evaluation results). Referring to memory 120, processor 110 derives countermeasures for improving the evaluation and the degree of impact (improvement level) of these countermeasures based on each evaluation result. Here, processor 110 can identify which indicator is improved when a particular countermeasure is selected. Therefore, processor 110 can increase the likelihood of improving the evaluation results by selecting countermeasures that improve viewpoints (e.g., performance, productivity, cost) that are considered NG in the evaluation results. Processor 110 presents (e.g., displays) information about each evaluation result, each countermeasure, and the degree of impact of each countermeasure.
[0112] The user, for example, confirms the evaluation results, countermeasures, and the impact of each countermeasure displayed on the display device 150. The user also considers the impact of each countermeasure and implements at least one of the countermeasures, that is, changes at least a portion of the automation structure. The processor 110 receives user input, for example, via the input device 140, to obtain information about the automation structure reflecting the changed structure.
[0113] Figure 8 This is a perspective view showing an example of an automation system 10A with an initial automation structure. Figure 9 This is a diagram illustrating an example of the evaluation corresponding to the initial automation structure. Furthermore, as an example, Figure 8 The initial automation structure shown has Figure 5 The structure shown.
[0114] First, let's assume the initial automation structure includes a robotic arm 20A of the suction type. In this case, as an example, the evaluation results are: productivity NG, cost NG, and performance NG. As examples, countermeasures include Solution 1, changing to a gripper for holding items, and Solution 2, changing to a suction cup capable of holding two items simultaneously. In Solution 1, performance NG changes to performance NG, and performance improves. In Solution 2, productivity NG changes to productivity NG, and productivity improves. Figure 9 In this example, Option 1 is selected by the user via input device 14 and reflected in the change of the automation structure. Figure 9 The dashed box indicates that option 1 has been selected. In option 1, for example, a robotic arm can easily hold a bottle with a cap. Furthermore, Figure 9 The information shown on the display device 150 is information used to assist in changes to the automation structure, and is an example of first change assistance information.
[0115] Figure 10 This is a perspective view showing an example of an automation system 10B with its first modified automation structure. Figure 11 This is a diagram showing an example of the display corresponding to the evaluation of the automation structure after the first modification.
[0116] As described above, the automated structure after the first modification includes a robotic arm 20B with a gripper type that picks up one gripper. In this case, as an example, the evaluation results are NG (Not Good), OK (Good), and OK (Good). As examples, countermeasures include: Option 1, setting the automated system to operate 24 hours a day; Option 2, increasing the number of robot units to two; and Option 3, modifying the robotic arm to be able to hold two grippers simultaneously. Setting it to operate 24 hours a day is an example of extending the operating time of the robot unit. In Option 1, productivity changes from NG to OK, and productivity improves. In Option 2, productivity changes from NG to OK, and productivity improves; on the other hand, cost changes from OK to NG, and cost worsens. In Option 3, productivity changes from NG to OK, and productivity improves. Figure 11 In this case, Option 3 was selected by the user and reflected in the change of the automation structure. Figure 11 The dashed box indicates that option 3 was selected. Furthermore, Figure 11 The information displayed on display device 150 is an example of output information that includes evaluation information. Additionally, the setting to run for 24 hours is information used to assist in changes to requirement specifications, and is an example of second change assistance information.
[0117] Figure 12 This is a perspective view showing an example of an automation system 10C with a second modified automation structure. Figure 13 This is a diagram showing an example of the evaluation corresponding to the second modified automation structure.
[0118] As described above, the second modified automation structure includes a robotic arm 20C with a hand type capable of simultaneously holding two grippers. In this case, as an example, the evaluation results are OK for productivity, OK for cost, and OK for performance. That is, the productivity, cost, and performance evaluation results are all OK. When the productivity, cost, and performance evaluation results are all OK, the processor 110 determines the adopted automation structure (automation structure FIX). Furthermore, in... Figure 13 The countermeasures may not be displayed in the corresponding evaluation after the second change.
[0119] exist Figures 8-13 In the example shown, the automated auxiliary device 100 improves the success rate of item grasping by changing the robotic arm from an adsorption type to a gripper capable of holding and holding. In other words, it improves the performance of the automated system. Furthermore, by changing the gripper from one item to two items simultaneously, the automated auxiliary device 100 reduces cycle time by half while suppressing cost increases. That is, it achieves both increased productivity and reduced costs for the automated system. Thus, the automated auxiliary device 100 meets the requirements from three perspectives.
[0120] Furthermore, as an example, detailed breakdowns of each evaluation result can be displayed. For instance, the cost based on human operation and the cost based on an automated structure can be displayed. Detailed breakdowns of costs for human operation (e.g., labor hours, cost-related ratios, operation time) and costs for robotic devices (e.g., labor hours, cost-related ratios, operation time) can also be displayed. Thus, by confirming the display, users can identify the cost difference between human operation and operation using robotic devices, and intuitively understand the advantages of implementing an automated system.
[0121] Thus, the automation assistance device 100 of this embodiment allows for the evaluation of the automation system not only from a single viewpoint but also from various viewpoints, considering the overall operation of the automation system including the robot. Therefore, the automation assistance device 100 can appropriately automate processes considering the overall work performed by the automation system including the robot. For example, by choosing to shorten the operation time of the robot, the cost required for the robot's operation is reduced, and the reduction in work accuracy can be suppressed. Therefore, regarding the automation assistance device 100, even users unfamiliar with automation systems can easily derive an automation system with high evaluation from various viewpoints, lowering the barrier to implementing automation systems.
[0122] Furthermore, the automation assistance device 100 provides a platform that generates action plans for each process through the finalized automation system, and enables the easy execution of each process according to the action plans. Thus, even users unfamiliar with automation systems can easily determine the automation system from both hardware and software perspectives regarding the automation assistance device 100.
[0123] Furthermore, in this embodiment, the automation assistance device 100 can also determine whether it is better for the automation system to perform automation or for human operation to be performed. If automation is difficult, the automation assistance device 100 can also decide to perform human operation. For example, if the process does not meet the specified requirements, the automation assistance device 100 can also change the automation structure. If the automation structure cannot be changed, or if even if it is changed, the requirements still cannot be met, the automation assistance device 100 can change the requirements. Furthermore, if the requirements cannot be changed, the automation assistance device 100 can determine that automation is difficult and decide that the process to be automated should be performed by a human, and display this decision on the display device 150.
[0124] Furthermore, this embodiment primarily illustrates the automation assistance device 100 assisting in the automation of work processes within a factory, but it is not limited to this and can also be applied to assist in work processes in other scenarios. For example, the automation assistance device 100 can also assist in the automation of work processes related to logistics.
[0125] (Summary of the implementation method)
[0126] Based on the above, at least the following matters are described in this disclosure. Furthermore, the constituent elements corresponding to the above embodiments are illustrated in parentheses, but the scope is not limited thereto.
[0127] (Project 1) An automated auxiliary device (automated auxiliary device 100) includes a processor (processor 110), said automated auxiliary device being used to automate the processes included in an operation, wherein,
[0128] The processor performs the following processing:
[0129] Acquire work process information related to the procedures required for human operation and requirement specification information related to the specifications required by the automated system performing the procedures;
[0130] Based on the work process information, the first structure (initial automation structure) of the automation system is determined;
[0131] Based on the work process information and the required specifications, the performance, productivity, and cost of the automation system of the first structure are evaluated; and
[0132] Based on the evaluation results, first change assistance information is output to assist in changes to the first structure of the automation system.
[0133] Therefore, the automation assistance device can consider not only parameters such as cycle time, but also performance, productivity, cost, and the overall work performed by the robotic device to determine the structure of the automation system for each process, thus automating each process. Furthermore, the user who has confirmed the output of the first change assistance information can modify the first structure of the automation system to determine an appropriate automation system structure. Additionally, the processor can also display the first change assistance information via a display device (an example of an output device) as an example of the output of the first change assistance information.
[0134] (Project 2) The automated auxiliary device according to Project 1, wherein,
[0135] The processor performs the following processing:
[0136] Based on the work process information and the required specifications, the performance, productivity, and cost of the automation system with the modified second structure (the modified automation structure) after the first structure is changed are evaluated; and
[0137] The output includes the results of the evaluation.
[0138] It is also possible that changing the structure of an automation system might improve its evaluation from one perspective, but worsen it from another. In contrast, by re-evaluating the automation system with the modified structure, the automation assistance device can avoid using a structure that already receives a low evaluation to determine the structure of the automation system.
[0139] (Project 3) The automated auxiliary device according to Project 2, wherein,
[0140] If at least one of the performance, productivity, and cost of the automated system in the second structure does not meet the required specifications, the processor outputs second change assistance information to assist in changing the required specifications.
[0141] Therefore, even if the required specifications cannot be met due to changes in the structure of the automation system, the automation auxiliary device can still automate each process by changing the required specification information. Furthermore, the processor can also display the second change assistance information via a display device (an example of an output device), as an example of the output of the second change assistance information.
[0142] (Item 4) The automated auxiliary device according to any one of Items 1 to 3, wherein,
[0143] The first change support information includes the evaluation results of the performance, productivity and cost evaluations, as well as countermeasure information (countermeasure method information) related to countermeasures to improve the performance, productivity and cost evaluations.
[0144] Therefore, by confirming the countermeasure information, users can easily understand what specific changes need to be made to the structure of the automation system.
[0145] (Project 5) The automated auxiliary device according to Project 4, wherein...
[0146] The countermeasure information includes the content of the countermeasures, as well as impact information (influence degree information) related to the impact of the implementation of the countermeasures on the assessment of performance, productivity, and cost.
[0147] Therefore, users can easily understand how changes to the structure of a policy-based automation system affect evaluation by confirming policy information.
[0148] (Item 6) The automated auxiliary device according to any one of Items 2 to 5, wherein,
[0149] When the performance, productivity, and cost of the automation system of the second structure all meet the required specifications, the processor generates an action plan for the automation system of the second structure to execute each process based on the automation system of the second structure and the work process information.
[0150] Thus, automated auxiliary devices can, for example, generate detailed action plans that can be executed by an automated system with a final determined structure.
[0151] (Item 7) An automation assistance method for automating processes included in an operation, the automation assistance method comprising the following processes:
[0152] Acquire work process information related to the procedures required for human operation and requirement specification information related to the specifications required by the automated system performing the procedures;
[0153] The first structure of the automation system is determined based on the work process information.
[0154] Based on the work process information and the required specifications, the performance, productivity, and cost of the automation system of the first structure are evaluated; and
[0155] Based on the evaluation results, first change assistance information is output to assist in changes to the first structure of the automation system.
[0156] Therefore, the same effect as Project 1 can be achieved.
[0157] The above is with reference to the appendix. Figure 1 Various embodiments have been described, but this disclosure is certainly not limited to such examples. Those skilled in the art will appreciate that various modifications or alterations can be conceived within the scope of the claims, and it should be understood that these modifications or alterations also fall within the technical scope of this disclosure. Furthermore, the structural elements in the above embodiments can be combined arbitrarily without departing from the spirit of the invention.
[0158] Industrial availability
[0159] This disclosure is useful for automation aids and automation aids that can appropriately automate processes by taking into account the overall operation performed by robotic devices.
[0160] Explanation of reference numerals in the attached figures
[0161] 10A, 10B, 10B: Automated systems;
[0162] 20A, 20B, 20C: Robotic arms;
[0163] 100: Automated auxiliary devices;
[0164] 110: Processor;
[0165] 120: Memory;
[0166] 121: Hardware Database (Hardware DB);
[0167] 122: Software Database (Software DB);
[0168] 130: Communication equipment;
[0169] 140: Input device;
[0170] 150: Display device.
Claims
1. An automation assistance device having a processor, the automation assistance device being used for assisting automation of a process included in a work, wherein the processor performs the following processing: acquiring work process information related to a process required for a person to perform a work and requirement specification information related to a specification required for an automation system including a robot device to execute the process; deciding a first configuration of the automation system based on the work process information; performing evaluation of performance, productivity, and cost of the automation system of the first configuration based on the work process information and the requirement specification information; and outputting first change assistance information for assisting change of the first configuration of the automation system based on a result of the evaluation.
2. The automation assistance device according to claim 1, wherein the processor performs the following processing: performing evaluation of performance, productivity, and cost of the automation system of a second configuration after the first configuration is changed based on the work process information and the requirement specification information; and outputting output information including a result of the evaluation.
3. The automation assistance device according to claim 2, wherein in a case where at least one of performance, productivity, and cost of the automation system of the second configuration does not satisfy the requirement specification information, the processor outputs second change assistance information for assisting change of the requirement specification information.
4. The automation assistance device according to claim 1 or 2, wherein the first change assistance information includes an evaluation result of the evaluation of performance, productivity, and cost, and countermeasure information related to a countermeasure to improve the evaluation of performance, productivity, and cost.
5. The automation assistance device according to claim 4, wherein the countermeasure information includes content of the countermeasure, and influence information related to an influence of execution of the countermeasure on the evaluation of performance, productivity, and cost.
6. The automation assistance device according to claim 2, wherein in a case where performance, productivity, and cost of the automation system of the second configuration all satisfy the requirement specification information, the processor generates an action plan for executing each process by the automation system of the second configuration based on the automation system of the second configuration and the work process information.
7. An automation assistance method for assisting automation of a process included in a work, the automation assistance method including the following processing: acquiring work process information related to a process required for a person to perform a work and requirement specification information related to a specification required for an automation system to execute the process; deciding a first configuration of the automation system based on the work process information; performing evaluation of performance, productivity, and cost of the automation system of the first configuration based on the work process information and the requirement specification information; and outputting first change assistance information for assisting change of the first configuration of the automation system based on a result of the evaluation.