System

The system addresses maintenance challenges by using a management server and robot with sensor feedback to autonomously adjust and maintain an ideal state, enhancing system availability and adaptability.

JP2024166107APending Publication Date: 2024-11-28THE INSTITUTE OF PHYSICAL & CHEMICAL RESEARCH
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024074900
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-17
Filing Date
2024-05-02
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Automated systems are difficult to maintain and manage.

Method used

A system comprising a management server, a robot, and a sensor that measures the environment, where the management server generates instructions for the robot based on environmental data, and the robot adjusts its state to match the instructed state using a control unit and sensor feedback.

Benefits of technology

The system provides self-maintenance capabilities, allowing the robot to autonomously adapt to environmental changes and maintain an ideal state, thereby increasing system availability and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166107000001_ABST
    Figure 2024166107000001_ABST
Patent Text Reader

Abstract

To provide a system having a self-maintenance capability.SOLUTION: A system comprises: a management server; robots; and sensors for measuring an environment including a space within a robot action range. The management server comprises: a reception part for receiving a mission; and a command part for generating a command on the basis of the mission, and transmitting the command to the robot. Therein, the command includes a first command that indicates a state after execution of the mission. The robot comprises: a state identification part for identifying an environmental state of the robot including a state of an object handled by the robot, on the basis of the measurement data of the sensor; and an instruction part that receives the command and drives the robot on the basis of a difference between the identified state and a state indicated by the command so as to cause a state of the robot to become closer to the state indicated by the command.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a system. [Background technology]

[0002] Research and development is underway to automate tasks such as scientific experiments. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] US Patent Application Publication No. 2015 / 242395 Summary of the Invention [Problem to be solved by the invention]

[0004] Automated systems are difficult to maintain and upkeep. SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to solve the above-mentioned problems and provide a system having self-maintenance capabilities. [Means for solving the problem]

[0005] One aspect of the present invention is a system comprising a management server, a robot, and a sensor that measures an environment including a space within the robot's range of movement, wherein the management server comprises a reception unit that receives missions, and a command unit that generates commands based on the mission and transmits the commands to the robot, the commands including a first command that represents a state after the mission is executed, and the robot comprises a state identification unit that identifies an environmental state of the robot including a state of an item handled by the robot based on measurement data of the sensor, and an instruction unit that receives the command and drives the robot so that the state of the robot approaches the state represented by the command based on the difference between the identified state and the state represented by the command. Effect of the Invention

[0006] According to the present invention, it is possible to provide a system that has self-maintaining capabilities. [Brief description of the drawings]

[0007] [Figure 1] 1 is a diagram showing a configuration of a system 1 according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing a configuration of a robot 21. [Diagram 3] FIG. 2 illustrates an example of the configuration of a control unit 25. [Figure 4] FIG. 2 is a diagram showing a configuration of a management server 11. [Diagram 5] 4 is a flowchart showing the operation of the management server 11. [Figure 6] 13 is a flowchart showing the operation of the management server 11 in step S12 and the operation of the robot 21 at that time. [Figure 7] 13 is a flowchart showing the operation of the management server 11 in step S13 and the operation of the robot 21 at that time. [Figure 8] FIG. 1 is a diagram showing an example of implementation of the system 1. [Figure 9] FIG. 1 is a diagram showing the relationship between a camera, a computer, an actuator, and an installation space. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. First Embodiment 1 is a diagram showing the configuration of a system 1 according to the first embodiment. The system 1 includes a management server 11 and a robot 21. The management server 11 receives a mission from a user U. The mission includes, for example, the contents of an experiment to be performed by the robot 21. The management server 11 acquires data on a predetermined range of movement 2 of the robot 21 from the robot 21. The predetermined range of movement 2 is, for example, a laboratory where the robot 21 performs experimental work. The management server 11 generates commands and issues instructions to the robot 21. The robot 21 drives in the predetermined range of movement 2 according to the commands from the management server 11.

[0009] 2 is a diagram showing the configuration of the robot 21. The robot 21 includes a traveling device 22, a manipulator 23, a sensor 24, a control unit 25, and a communication unit . The running device 22 is provided under the robot 21 and supports the entire robot 21. The running device 22 is, for example, an endless track, and moves the robot 21 within the action range 2 by rotating. The manipulator 23 grasps fixtures within the movement range 2. For example, a servo motor is provided at each joint of the manipulator 23, and the joint angle is controlled. The manipulator 23 feeds back information on the joint angle and whether or not it is grasping to the control unit 25. The manipulator 23 may be provided with a sensor in the grasping portion, and may determine whether or not it is grasping an object and provide feedback.

[0010] The sensor 24 senses the surroundings of the robot 21 and acquires sensing data. The sensor 24 is, for example, a camera, and captures an image of at least the front of the robot 21. The sensing data includes the image captured by the camera. The sensor 24 is, for example, a LiDAR, and measures a three-dimensional space. The sensing data includes data of the three-dimensional space measured by the LiDAR.

[0011] The control unit 25 controls the traveling device 22 and the manipulator 23 based on sensing data from the sensor 24 and commands received from the management server 11. FIG. The control unit 25 includes a state specifying unit 251 , a control amount calculating unit 252 , and an instruction unit 253 . The state identification unit 251 identifies the self state and the environmental state of the robot 21 based on the measurement data by the sensor 24. The self state of the robot 21 indicates the state of the robot 21. The environmental state of the robot 21 indicates the state of the surrounding environment of the robot 21 and the state of equipment used by the robot 21.

[0012] The state identification unit 251 recognizes fixtures such as test tubes by analyzing images. The image analysis is realized, for example, by a machine learning object recognition model. The state identification unit 251 generates a map by SLAM based on the measurement data by the LiDAR. The state identification unit 251 identifies the three-dimensional position and three-dimensional posture of the fixture based on the map by SLAM. The state specifying unit 251 obtains information as to whether or not an object is being grasped by feedback from the manipulator. In recognizing fixtures by image analysis, the number of fixtures may be determined by an object recognition model. Also, the volume of fixtures, such as liquids, is detected using a dedicated trained model. The model for detecting the volume of fixtures is trained to determine the volume from an image using a training dataset consisting of a combination of images of a container containing a liquid and the volume of the liquid.

[0013] The control amount calculation unit 252 calculates the control amounts of the traveling device 22 and the manipulator 23 based on the difference between the self state and the environmental state of the robot 21 identified by the state identification unit 251 and the state represented by the command from the management server 11. The control amount of the traveling device 22 is, for example, a traveling distance, a number of rotations, and a traveling direction. The control amount of the manipulator 23 is, for example, a joint angle. The calculation by the control amount calculation unit 252 is realized by reinforcement learning. More specifically, the action of the robot 21 in the self state and the environmental state specified by the state specification unit 251 is calculated by using the difference between the self state and the environmental state of the robot 21 specified by the state specification unit 251 and the state represented by the command from the management server 11 as a reward. Here, the action is the control amount of the traveling device 22 and the manipulator 23. As described above, the control amount calculation unit controls the traveling device 22 and the manipulator 23 so as to reduce the difference between the self-state and environmental state of the robot 21 at that time and the state indicated by the command, so that adjustments can be made even if disturbances occur.

[0014] The instruction unit 253 instructs the travel device 22 and the manipulator 23 on the amount of control. The travel device 22 and the manipulator 23 receive the instruction and perform movement, rotation, and the like.

[0015] The control amount calculation unit 252 may calculate the control amount of the traveling device 22 and the manipulator 23 even when there is no command from the management server 11. At this time, the control amount calculation unit 252 calculates the control amount of the traveling device 22 and the manipulator 23 based on an ideal state. The ideal state is a state in which the fixtures are in standard positions and have a standard remaining amount. This allows the robot 21 to autonomously maintain its own state and the environmental state in the ideal state.

[0016] The communication unit 26 receives commands from the management server 11. The communication unit 26 notifies the management server 11 of the robot 21's own state and the environmental state.

[0017] 4 is a diagram showing the configuration of the management server 11. The management server 11 includes a reception unit 111, a communication unit 112, and a calculation unit 113. The reception unit 111 receives a mission from a user U. The mission is an experimental instruction to be performed by the robot 21. The experimental instruction is expressed as a change in the state of the system 1. The experimental instruction includes information regarding the substance contained in the test tube (e.g., test tube X contains 1 mg of reagent A), the position of the test tube (e.g., test tube X is placed on rack Y), and the process to be applied to the test tube (e.g., test tube X is heated for 100 seconds, the contents of test tube X are analyzed by method Z). The receiving unit 111 receives a mission via an input device such as a keyboard or via wireless communication by the communication unit 112, which will be described later. The mission also includes a product delivery instruction that causes the robot 21 to deliver the product of the experiment.

[0018] The communication unit 112 transmits and receives data to and from the robot 21. The communication unit 112 receives the robot 21's own state and environmental state from each robot 21. The robot 21's own state includes, for example, the position and working state of the robot 21. The environmental state of the robot 21 includes, for example, the positions and remaining amounts of equipment around the robot 21. Additionally, the communication unit 112 may receive data including mission information from another communication device.

[0019] The calculation unit 113 includes a state recognition unit 114 , an ordering unit 115 , an ideal state estimation unit 116 , and a command unit 117 . The state recognition unit 114 recognizes the state of the system 1 based on the self state and environmental state of the robot 21 acquired from each robot 21. Note that the state recognition unit 114 recognizes the state of the system 1 by receiving the results of image analysis and the like as the self state and environmental state of the robot 21, but the environmental state of the robot 21 may be acquired by acquiring raw data such as an image from the robot 21 and analyzing the image. In this case, the state identification unit 251 of the robot 21 does not need to perform processing such as image analysis.

[0020] The state recognition unit 114 may determine whether or not the command has been completed based on the state of the system 1 after sending the command to the robot 21.

[0021] The ordering unit 115 orders supplies based on the state of the system 1 recognized by the state recognition unit 114. For example, the ordering unit 115 orders supplies when the remaining amount of supplies is low in the recognized state of the system 1. The ordering unit 115 also orders repairs to the robot 21. For example, when the rate at which the robot 21 completes commands is equal to or lower than a predetermined value, the ordering unit 115 determines that the robot 21 needs repairs and orders the repairs. For example, when the difference between the robot 21's own state and environmental state and the state indicated by the command does not decrease and is equal to or higher than a predetermined value, the ordering unit 115 determines that the robot 21 needs repairs and orders the repairs.

[0022] The ideal state estimation unit 116 estimates an ideal state of the robot 21 in the movement range 2 based on the history of past missions. For example, the ideal state estimation unit 116 predicts a mission that will be performed in the future based on the history of past missions, performs a simulation of the predicted future mission being performed in a plurality of different states, and estimates an optimal state from the plurality of different states. The ideal state estimation unit 116 predicts a mission that will be performed in the future by, for example, pattern recognition of past missions.

[0023] The command unit 117 generates commands for controlling the robots 21. The commands include a first command representing a state after a mission is executed and a second command representing an ideal state of the system 1. The command unit 117 transmits the generated commands to each robot 21. The command unit 117 generates a first command based on the mission accepted by the acceptance unit 111 and the state of the system 1 recognized by the state recognition unit 114. The command unit 117 identifies a robot 21 that can realize each experimental instruction included in the mission, and assigns each experimental instruction to the identified robot 21. When a mission is performed by multiple robots 21, the mission may include an instruction for the robot to hand over equipment. The command unit 117 generates a second command based on the ideal state estimated by the ideal state estimation unit 116 and the state of the system 1 recognized by the state recognition unit 114. The second command includes, for example, a command to move the robot 21 from the inventory area where the equipment is placed to a predetermined position.

[0024] 5 is a flowchart showing the operation of the management server 11. If there is a mission accepted by the acceptance unit 111 (step S11: YES), the management server 11 performs an operation to complete the mission (step S12). If there is no mission accepted by the acceptance unit 111 (step S11: NO), the management server 11 performs an operation to maintain the ideal state (step S13).

[0025] FIG. 6 is a flowchart showing the operation of the management server 11 in step S12 and the operation of the robot 21 at that time. The command unit 117 generates a first command representing a state after the mission is executed (step S121). After that, the command unit 117 outputs the command to the robot 21 (step S122). When the robot 21 receives the command, the control amount calculation unit 252 calculates the control amount of the traveling device 22 and the manipulator 23, and the instruction unit 253 instructs the traveling device 22 and the manipulator 23 on the control amount, thereby performing control according to the command (step S221). After the command is completed, the communication unit 26 of the robot 21 notifies the management server 11 of the self state and the environmental state of the robot 21 after the command is completed (step S222). In the management server 11, the state recognition unit 114 recognizes the state of the robot 21 after the command is completed and outputs the result of the experiment (step S123).

[0026] 5 and 6, it is determined in step S11 whether or not there is a mission, but if there is a mission, they may be completed collectively in step S12. In this case, the final experiment results may be output collectively for all the missions.

[0027] 7 is a flow chart showing the operation of the management server 11 in step S13 and the operation of the robot 21 at that time. The ideal state estimation unit 116 estimates the ideal state of the robot 21 (step S131). The command unit 117 generates a second command and outputs it to the robot 21 (step S132). The robot 21 receives the command, the control amount calculation unit 252 calculates the control amount of the traveling device 22 and the manipulator 23 based on the ideal state, and the instruction unit 253 instructs the control amount to the traveling device 22 and the manipulator 23 (step S231). The ordering unit 115 of the management server 11 orders equipment if necessary based on the state of the system 1 (step S133).

[0028] Thus, according to this embodiment, the management server 11 accepts a mission, generates a command based on the mission, and transmits it to the robot 21. The robot 21 identifies the environmental state of the robot 21, receives the command, and drives the robot so that the state of the robot approaches the state represented by the command. This allows the robot 21 to complete the mission even if there is a change in the environment or a disturbance.

[0029] Furthermore, when the robot 21 has not received the first command representing the state after the mission has been executed, the robot 21 is driven so that the difference between the state of the robot 21 and the ideal state of the robot 21 satisfies a predetermined requirement. This makes it possible to keep the robot 21 in the ideal state.

[0030] Moreover, by transmitting a second command representing an ideal state from the management server 11 to the robot 21, the ideal state can be appropriately changed from the management server 11 side. This makes it possible to increase the availability of the system 1.

[0031] Furthermore, the robot 21 can perform optimal driving by determining the amount of driving according to a reinforcement learning algorithm that uses a reward based on the difference between the state of the robot 21 and the state represented by the command.

[0032] In addition, the management server 11 can prevent shortages of items by ordering the replenishment of items that are in short supply in the robot's state according to the state indicated by the command, thereby improving availability. In addition, the robot 21 can automatically replenish items by comparing the data of the items received by the order with the order contents and managing the items, thereby improving availability.

[0033] Furthermore, the management server 11 can automatically bring the ideal state closer to the optimal state by estimating a state in which a future mission can be executed as an ideal state based on missions executed in the past.

[0034] Fig. 8 is a diagram showing an example of an implementation of the system 1. In the example shown in Fig. 8, the system 1 includes a camera, an actuator, and a computer. The camera corresponds to the sensor 24 in the embodiment. The actuator corresponds to the traveling device 22 and the manipulator 23 in the embodiment. The computer corresponds to the control unit 25 and the management server 11 in the embodiment.

[0035] 9 is a diagram showing the relationship between the camera, computer, actuator, and installation space. The camera photographs the installation space of the appliance. The installation space of the appliance corresponds to the movement range 2 in the embodiment. In the installation space of the appliance, the appliance is replenished or discarded as a disturbance. When the installation space is a shared space shared with other systems, disturbances from the other systems are also added.

[0036] The image captured by the camera is transmitted to a computer. The computer detects the appliances placed in the appliance installation space using an object detection model. The object detection model uses the YOLOv5 model. This detection means corresponds to the operation of the state identification unit 251.

[0037] When a question about the location of an appliance is input to the computer, the computer returns the location of the appliance. In the example shown in Figure 8, the computer used a REST API and the YOLOv5 model returned the location of the appliance.

[0038] When actuator instructions are input to the computer, the computer controls the actuator according to the instructions. In the example shown in Figure 8, the computer uses the ChatGPT API to control the actuator based on the input prompt.

[0039] The actuator, when controlled by a computer, moves the instrument placed in the installation space, thereby allowing the instrument placed in the installation space to be moved.

[0040] Other Embodiments Although one embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes, etc. are possible within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0041] 1 system, 11 management server, 111 reception unit, 112 communication unit, 113 calculation unit, 114 state recognition unit, 115 ordering unit, 116 ideal state estimation unit, 117 command unit, 21 robot, 22 running device, 23 manipulator, 24 sensor, 25 control unit, 251 state identification unit, 252 control amount calculation unit, 253 instruction unit, 26 communication unit

Claims

1. A system including a management server, a robot, and a sensor that measures an environment including a space within a range of movement of the robot, The management server includes: A reception section for accepting missions; A command unit that generates a command based on the mission and transmits the command to the robot; Equipped with the instructions include a first instruction representing a state after the mission is executed; The robot comprises: a state identification unit that identifies an environmental state of the robot, including a state of an object handled by the robot, based on measurement data of the sensor; an instruction unit that receives the command and drives the robot so that the state of the robot approaches the state represented by the command based on a difference between the specified state and a state represented by the command; A system comprising:

2. the instruction unit drives the robot so that a difference between a state of the robot and a state represented by the first command satisfies a predetermined requirement; If the first command has not been received, driving the robot so that a difference between a state of the robot and an ideal state of the robot satisfies a predetermined requirement. The system of claim 1 .

3. the robot receives a second command representing an ideal state of the robot from the management server; The system of claim 2.

4. The robot includes a control amount calculation unit that determines a drive amount by a reinforcement learning algorithm using a reward based on a difference between a state of the robot and a state represented by the command; The system of claim 1 .

5. the management server includes an ordering unit that orders the replenishment of items that are in short supply in the state of the robot according to the state indicated by the command; The system of claim 1 .

6. The state specification unit compares data of the ordered item measured by the sensor with the order content by the ordering unit, and manages the item. The system of claim 5.

7. the management server includes an ideal state estimation unit that estimates, as the ideal state, a state in which a mission to be generated in the future can be executed based on the missions executed in the past; The system of claim 2.

Citation Information

Patent Citations

  • Systems and methods for equipment sharing

    US20150242395A1