Information processing device, information processing method, and program
The system addresses the challenge of obtaining a three-dimensional model of an article on an AGV by using a distance sensor and camera to scan and correct distortions, resulting in an accurate representation of the article's shape and texture.
Patent Information
- Application Number
- JP2021033384
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-03
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2041-03-03
AI Technical Summary
Existing systems fail to obtain a three-dimensional model of an article using an automated guided vehicle due to limitations in rotating the article for comprehensive scanning.
An information processing device and method that utilizes a sensor interface connected to a distance sensor, such as a laser rangefinder, to scan an article on an AGV as it rotates, generating a three-dimensional model by integrating data from a camera and correcting distortions based on rotation angles, platform shape, and texture.
Effectively generates a precise three-dimensional model of the article by compensating for non-constant rotational speeds and angles, ensuring accurate representation of the article's shape and texture.
Smart Images

Figure 0007581085000001 
Figure 0007581085000002 
Figure 0007581085000003
Abstract
Description
[Technical field]
[0001] An embodiment of the present invention relates to an information processing device, an information processing method, and a program. [Background technology]
[0002] There are systems that automatically transport objects in a logistics center or the like. Such systems transport objects using automatic guided vehicles. Some of these systems also obtain three-dimensional models of objects using various sensors.
[0003] However, the system has the problem that it cannot rotate the article on the automated guided vehicle to obtain a three-dimensional model of the article. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2019-207230 A Summary of the Invention [Problem to be solved by the invention]
[0005] In order to solve the above problems, an information processing device, an information processing method, and a program are provided that are capable of acquiring a three-dimensional model of an article using an automated guided vehicle. [Means for solving the problem]
[0006] According to an embodiment, an information processing device includes a sensor interface and a processor. The sensor interface is connected to a distance sensor. The processor uses the distance sensor to scan an object loaded on an automated guided vehicle and rotated by the rotation of the automated guided vehicle, and generates a three-dimensional model of the object from scan data obtained by scanning the object. [Brief description of the drawings]
[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a measurement system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of the measurement system according to the first embodiment. [Diagram 3] FIG. 3 is a block diagram illustrating an example of the configuration of a WES according to the first embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of the first WCS according to the first embodiment. [Diagram 5] FIG. 5 is a block diagram showing an example of the configuration of the second WCS according to the first embodiment. [Figure 6] FIG. 6 is a block diagram showing an example of the configuration of the AGV according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an operation example of the measurement system according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an operation example of the measurement system according to the first embodiment. [Figure 9] FIG. 9 is a graph showing an example of a measurement result of the measurement system according to the first embodiment. [Figure 10] FIG. 10 is a graph showing an example of a measurement result of the measurement system according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a three-dimensional model generated by the measurement system according to the first embodiment. [Figure 12] FIG. 12 is a diagram showing an example of a three-dimensional model generated by the measurement system according to the first embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a three-dimensional model generated by the measurement system according to the first embodiment. [Figure 14] FIG. 14 is a diagram showing an example of a three-dimensional model corrected by the measurement system according to the first embodiment. [Figure 15] FIG. 15 is a diagram showing an example of a three-dimensional model corrected by the measurement system according to the first embodiment. [Figure 16]FIG. 16 is a diagram showing an example of a three-dimensional model corrected by the measurement system according to the first embodiment. [Figure 17] FIG. 17 is a diagram showing an operation example of the measurement system according to the first embodiment. [Figure 18] FIG. 18 is a diagram showing an operation example of the measurement system according to the first embodiment. [Figure 19] FIG. 19 is a flowchart showing an operation example of the second WCS according to the first embodiment. [Figure 20] FIG. 20 is a flowchart showing an operation example of the first WCS according to the first embodiment. [Figure 21] FIG. 21 is a diagram illustrating an example of the configuration of a measurement system according to the second embodiment. As shown in FIG. [Figure 22] FIG. 22 is a block diagram showing an example of the configuration of the first WCS according to the second embodiment. [Figure 23] FIG. 23 is a flowchart showing an operation example of the first WCS according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] Hereinafter, an embodiment will be described with reference to the drawings. (First embodiment) First, the first embodiment will be described. A measurement system according to an embodiment transports an object using an automated guided vehicle (AGV). The measurement system scans the object while it is loaded onto the automated guided vehicle. The measurement system generates a three-dimensional model of the object from the scan results.
[0009] Fig. 1 shows a schematic configuration example of a measurement system 1 according to an embodiment. As shown in Fig. 1, the measurement system 1 includes a first WCS 20, an LRF 101, a camera 102, an AGV 103, a loading platform 104, and a column 110. Here, the measurement system scans an article 105.
[0010] The article 105 is a rectangular parallelepiped. A plurality of articles 105 are loaded on the loading platform 104. The plurality of articles 105 are loaded on the loading platform 104 so as to form a rectangular parallelepiped.
[0011] The article 105 has a code 106 on its surface. The code 106 is a code obtained by encoding an ID or the like for identifying the article 105. For example, the code 106 is a barcode or a two-dimensional code.
[0012] A texture 107 is formed on the surface of the article 105. The texture 107 is composed of a pattern or the like on the surface of the article 105. The texture 107 may also include a code 106.
[0013] The AGV 103 transports an article 105. The AGV 103 includes a loading platform 104 on its upper portion. The loading platform 104 has a predetermined shape. Here, the loading platform 104 is formed in a plate shape.
[0014] The AGV 103 loads and transports an item 105 on a loading platform 104. The AGV 103 moves to a designated loading position and loads the item 105. The AGV 103 may be loaded with the item 105 by an operator or a robot. The AGV 103 may also be configured to slip under a shelf on which the item 105 is loaded and lift up the shelf together with the item 105.
[0015] The AGV 103 moves to a specified position while carrying the article 105. In addition, the AGV 103 rotates while carrying the article 105. AGV103 will be described in more detail later.
[0016] An LRF101 (laser rangefinder) (distance sensor) is installed on a pillar 110. The LRF101 is a sensor that measures the distance to an object. The LRF101 includes a light source and a sensor that detects reflected light of light (illuminated light) emitted from the light source. The LRF101 measures the distance to the object based on the reflected light of light (visible light or invisible light) emitted from the light source. For example, the LRF101 employs a ToF (Time-for-Flight) method that measures the distance to the object based on the time it takes for the illuminating light to reflect off the object and reach the sensor.
[0017] The LRF 101 scans the light source in a predetermined direction. The LRF 101 scans the light source in a direction that is not perpendicular to the rotation axis of the AGV 103. Here, the LRF 101 scans the light source in a vertical direction. The LRF 101 measures the distance to the target by irradiating light from the light source at small angles.
[0018] 1, the LRF 101 scans a light source in a scanning area 109. That is, the LRF 101 measures the distance to an object on a line that impinges with the scanning area 109.
[0019] In addition, the LRF 101 acquires a luminance value indicating the luminance of the object, for example, based on the intensity of reflected light.
[0020] The camera 102 is mounted on a pillar 110. Here, the camera 102 is mounted on the lower part of the LRF 101. The camera 102 captures an image of an object 105, etc. That is, the camera 102 captures an image of a code 106, a texture 107, etc.
[0021] The camera 102 may have a zoom function. The camera 102 may also have a light source that illuminates the article 105. For example, the camera 102 is a CCD (Charge Coupled Device) camera.
[0022] A first WCS 20 (Warehouse Control System) (information processing device) scans an item 105 in accordance with a control signal from a WES 10 (described later) to generate a three-dimensional model of the item 105. The first WCS 20 is also connected to an LRF 101 and a camera 102. The first WCS 20 functions as a controller for the LRF 101 and the camera 102. The first WCS 20 will be described in detail later.
[0023] Next, the control system of the measurement system 1 will be described. Fig. 2 shows an example of the configuration of a control system of the measurement system 1. As shown in Fig. 2, the measurement system 1 includes a WMS 5, a WES 10, a first WCS 20, a second WCS 30, an LRF 101, a camera 102, an AGV 103, and the like.
[0024] The WES 10 is communicatively connected to the WMS 5, the first WCS 20, and the second WCS 30. The first WCS 20 is communicatively connected to the LRF 101 and the camera 102. The second WCS 30 is communicatively connected to the AGV 103.
[0025] The WMS 5 (Warehouse Management System) controls the entire measurement system 1. The WMS 5 transmits to the WES 10 a sorting list indicating the items and their sorting destinations.
[0026] For example, WMS5 is composed of a PC, etc.
[0027] A WES 10 (Warehouse Execution System) controls the first WCS 20 and the second WCS 30 under control of the WMS 5. The WES 10 causes the first WCS 20 to generate a three-dimensional model of the article 105. The WES 10 will be described in detail later.
[0028] The second WCS 30 controls the AGV 103 in accordance with a control signal from the WES 10. The second WCS 30 functions as a controller for the AGV 103. The second WCS 30 will be described in detail later.
[0029] Note that the measurement system 1 may include components as necessary in addition to the components shown in FIGS. 1 and 2, and certain components may be excluded from the measurement system 1.
[0030] Next, WES10 will be described. Fig. 3 is a block diagram showing an example of the configuration of the WES 10. As shown in Fig. 3, the WES 10 includes a processor 11, a ROM 12, a RAM 13, an NVM 14, a communication unit 15, an operation unit 16, a display unit 17, and the like.
[0031] The processor 11, the ROM 12, the RAM 13, the NVM 14, the communication unit 15, the operation unit 16, and the display unit 17 are connected to one another via a data bus or the like. It should be noted that the WES 10 may include components as necessary in addition to the components shown in FIG.
[0032] The processor 11 has a function of controlling the overall operation of the WES 10. The processor 11 may include an internal cache and various interfaces, etc. The processor 11 realizes various processes by executing programs stored in advance in the internal memory, the ROM 12, or the NVM 14.
[0033] Some of the various functions realized by the processor 11 executing the programs may be realized by hardware circuits. In this case, the processor 11 controls the functions executed by the hardware circuits.
[0034] The ROM 12 is a non-volatile memory in which control programs, control data, etc. are stored in advance. The control programs and control data stored in the ROM 12 are incorporated in advance in accordance with the specifications of the WES 10.
[0035] The RAM 13 is a volatile memory. The RAM 13 temporarily stores data being processed by the processor 11. The RAM 13 stores various application programs based on instructions from the processor 11. The RAM 13 may also store data necessary for executing the application programs and execution results of the application programs.
[0036] The NVM 14 is a non-volatile memory to which data can be written and rewritten. The NVM 14 is, for example, a hard disk drive (HDD), a solid state drive (SSD), or a flash memory. The NVM 14 stores control programs, applications, and various data according to the operational purpose of the WES 10.
[0037] The communication unit 15 is an interface for communicating with the WMS 5, the first WCS 20, the second WCS 30, etc. For example, the communication unit 15 is an interface for transmitting and receiving data with the WMS 5, the first WCS 20, the second WCS 30, etc. via a network. For example, the communication unit 15 is an interface that supports a wired or wireless LAN (Local Area Network) connection.
[0038] The operation unit 16 accepts various operation inputs from an operator. The operation unit 16 transmits a signal indicating the input operation to the processor 11. The operation unit 16 may be configured from a touch panel.
[0039] The display unit 17 displays image data from the processor 11. For example, the display unit 17 is configured with a liquid crystal monitor. When the operation unit 16 is configured with a touch panel, the display unit 17 may be formed integrally with the operation unit 16.
[0040] Next, the first WCS 20 will be described. Fig. 4 is a block diagram showing an example of the configuration of the first WCS 20. As shown in Fig. 4, the first WCS 20 includes a processor 21, a ROM 22, a RAM 23, an NVM 24, a communication unit 25, a sensor interface 26, an operation unit 27, a display unit 28, and the like.
[0041] The processor 21, the ROM 22, the RAM 23, the NVM 24, the sensor interface 26, the communication unit 25, the operation unit 27, and the display unit 28 are connected to one another via a data bus or the like. The first WCS 20 may include components as necessary in addition to the components shown in FIG. 4, and certain components may be excluded from the first WCS 20.
[0042] The processor 21 has a function of controlling the overall operation of the first WCS 20. The processor 21 may include an internal cache and various interfaces, etc. The processor 21 realizes various processes by executing programs stored in advance in the internal memory, the ROM 22, or the NVM 24.
[0043] Some of the various functions realized by the processor 21 executing the programs may be realized by a hardware circuit. In this case, the processor 21 controls the functions executed by the hardware circuit.
[0044] The ROM 22 is a non-volatile memory that prestores control programs, control data, etc. The control programs and control data stored in the ROM 22 are preinstalled in accordance with the specifications of the first WCS 20.
[0045] The RAM 23 is a volatile memory. The RAM 23 temporarily stores data being processed by the processor 21. The RAM 23 stores various application programs based on instructions from the processor 21. The RAM 23 may also store data necessary for executing the application programs and execution results of the application programs.
[0046] The NVM 24 is a non-volatile memory to which data can be written and rewritten. The NVM 24 is, for example, an HDD, an SSD, or a flash memory. The NVM 24 stores control programs, applications, and various data according to the operational purpose of the first WCS 20.
[0047] The communication unit 25 is an interface for communicating with the WES 10 etc. For example, the communication unit 25 is an interface for transmitting and receiving data to and from the WES 10 etc. via a network. For example, the communication unit 25 is an interface that supports a wired or wireless LAN connection.
[0048] The sensor interface 26 is an interface that connects to the LRF 101 and the camera 102. The sensor interface 26 may also support a Universal Serial Bus (USB) connection.
[0049] In addition, the sensor interface 26 may be composed of an interface that connects to the LRF 101 and an interface that connects to the camera 102.
[0050] The operation unit 27 receives various operation inputs from an operator. The operation unit 27 transmits a signal indicating the input operation to the processor 21. The operation unit 27 may be configured from a touch panel.
[0051] The display unit 28 displays the image data from the processor 21. For example, the display unit 28 is configured with a liquid crystal monitor. When the operation unit 27 is configured with a touch panel, the display unit 28 may be formed integrally with the operation unit 27.
[0052] The communication unit 25 and the sensor interface 26 may be integrally formed.
[0053] Next, the second WCS 30 will be described. Fig. 5 is a block diagram showing an example of the configuration of the second WCS 30. As shown in Fig. 5, the second WCS 30 includes a processor 31, a ROM 32, a RAM 33, an NVM 34, a communication unit 35, an AGV interface 36, an operation unit 37, a display unit 38, and the like.
[0054] The processor 31, the ROM 32, the RAM 33, the NVM 34, the AGV interface 36, the communication unit 35, the operation unit 37, and the display unit 38 are connected to one another via a data bus or the like. The second WCS 30 may include components as necessary in addition to the components shown in FIG. 5, and certain components may be excluded from the second WCS 30.
[0055] The processor 31 has a function of controlling the entire operation of the second WCS 30. The processor 31 may include an internal cache and various interfaces, etc. The processor 31 realizes various processes by executing programs stored in advance in the internal memory, the ROM 32, or the NVM 34.
[0056] Some of the various functions realized by the processor 31 executing the programs may be realized by a hardware circuit. In this case, the processor 31 controls the functions executed by the hardware circuit.
[0057] The ROM 32 is a non-volatile memory that prestores control programs, control data, etc. The control programs and control data stored in the ROM 32 are preinstalled in accordance with the specifications of the second WCS 30.
[0058] The RAM 33 is a volatile memory. The RAM 33 temporarily stores data being processed by the processor 31. The RAM 33 stores various application programs based on instructions from the processor 31. The RAM 33 may also store data necessary for executing the application programs and execution results of the application programs.
[0059] The NVM 34 is a non-volatile memory to which data can be written and rewritten. The NVM 34 is, for example, an HDD, an SSD, or a flash memory. The NVM 34 stores control programs, applications, and various data according to the operational purpose of the second WCS 30.
[0060] The communication unit 35 is an interface for communicating with the WES 10, etc. For example, the communication unit 35 is an interface for transmitting and receiving data to and from the WES 10, etc. via a network. For example, the communication unit 35 is an interface that supports a wired or wireless LAN connection.
[0061] The AGV interface 36 is an interface for communicating with the AGV 103. The AGV interface 36 connects to the AGV 103 wirelessly. For example, the AGV interface 36 may support a wireless LAN connection. The AGV interface 36 may also connect to an access point that wirelessly connects to the AGV 103.
[0062] The operation unit 37 receives various operation inputs from an operator. The operation unit 37 transmits a signal indicating the input operation to the processor 31. The operation unit 37 may be configured with a touch panel.
[0063] The display unit 38 displays the image data from the processor 31. For example, the display unit 38 is configured with a liquid crystal monitor. When the operation unit 37 is configured with a touch panel, the display unit 38 may be formed integrally with the operation unit 37.
[0064] The communication unit 35 and the AGV interface 36 may be integrally formed.
[0065] Next, a description will be given of the AGV 103. Fig. 6 is a block diagram showing a configuration example of the AGV 103. The AGV 103 includes a processor 71, a ROM 72, a RAM 73, an NVM 74, a communication unit 75, a drive mechanism 76, a sensor 77, a battery 78, a charging mechanism 79, tires 70, and the like.
[0066] The AGV 103 may include components other than those shown in FIG. 6 as necessary, or certain components may be excluded from the AGV 103.
[0067] The processor 71 has a function of controlling the overall operation of the AGV 103. The processor 71 may include an internal cache and various interfaces, etc. The processor 71 realizes various processes by executing programs stored in advance in the internal memory, the ROM 72, or the NVM 74.
[0068] For example, the processor 71 is a CPU. The processor 71 may be realized by hardware such as a large scale integration (LSI), an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA).
[0069] The processor 71 performs processes such as calculations and controls required for operations such as acceleration, deceleration, stopping, changing direction, loading and unloading of goods, etc. The processor 71 executes a program stored in the ROM 72 or the like based on a control signal from the second WCS 30 or the like, thereby generating drive signals and outputting them to each unit.
[0070] The ROM 72 is a non-transitory computer-readable storage medium, and stores the above-mentioned programs. The ROM 72 also stores data or various setting values used by the processor 71 when performing various processes. The RAM 73 is a memory used for reading and writing data. The RAM 73 is used as a so-called work area for storing data temporarily used by the processor 71 when performing various processes.
[0071] The NVM 74 is a non-transitory computer-readable storage medium and may store the above-mentioned programs. The NVM 74 also stores data used by the processor 71 in performing various processes, data generated by the processes in the processor 71, various setting values, and the like.
[0072] The communication unit 75 is an interface for transmitting and receiving data to and from the second WCS 30 etc. via a wireless LAN access point etc. For example, the communication unit 75 supports a wireless LAN connection.
[0073] The drive mechanism 76 is a motor or the like, and rotates or stops the motor based on a drive signal output from the processor 71. The power of the motor is transmitted to the tires 70 and then to the steering mechanism. The AGV 103 moves to a target position by the power from the motor.
[0074] The sensor 77 is a plurality of reflection sensors. Each reflection sensor is attached around the AGV 103. Each reflection sensor irradiates a laser light, detects the time from when the laser light is irradiated until the laser light is reflected by an object and returns, detects the distance to the object based on the detected time, and notifies the processor 71 of the detection signal. The processor 71 outputs a control signal for controlling the travel of the AGV 103 based on the detection signal from the sensor 77. For example, the processor 71 outputs a control signal such as deceleration or stop to avoid collision with the object based on the detection signal from the sensor 77. Note that a camera may be provided in addition to the sensor 77, and the camera may capture the surroundings and output the captured image to the processor 71. In this case, the processor 71 analyzes the captured image and outputs a control signal such as deceleration or stop to avoid collision with the object.
[0075] The battery 78 supplies the necessary power to the drive mechanism 76 etc. The charging mechanism 79 is a mechanism that connects a charging station and the battery 78, and the battery 78 is charged with power supplied from the charging station etc. via the charging mechanism 79.
[0076] Here, the processor 71 rotates the AGV 103 by a predetermined angle using the drive mechanism 76 in accordance with control from the second WCS 30. Here, the processor 71 rotates the AGV 103 by 90 degrees at a time. That is, the processor 71 stops the rotation (or accelerates or decelerates the rotation speed) every time the AGV 103 rotates by 90 degrees.
[0077] Next, a description will be given of functions realized by the second WCS 30. The functions realized by the second WCS 30 are realized by the processor 31 executing a program stored in the internal memory, the ROM 32, the NVM 34, or the like.
[0078] The processor 31 has a function of transporting the AGV 103 carrying the article 105 to a predetermined measurement position.
[0079] The processor 31 transports the AGV 103 carrying the item 105 to a predetermined measurement position under the control of the WES 10.
[0080] The processor 31 moves the AGV 103 to a loading position where the item 105 is to be loaded. For example, the processor 31 transmits a control signal to the AGV 103 via the AGV interface 36 to instruct the AGV 103 to move to the loading position.
[0081] When the AGV 103 moves to the loading position, the item 105 is loaded onto the loading platform 104 .
[0082] When the article 105 is loaded onto the loading platform 104, the processor 31 moves the AGV 103 to a position (measurement position) where the LRF 101 can scan the article 105 and the camera 102 can photograph the article 105. For example, the processor 31 transmits a control signal to the AGV 103 via the AGV interface 36 to instruct the AGV 103 to move to the measurement position.
[0083] When the AGV 103 moves to the measurement position, the processor 31 rotates the AGV 103 once. As described above, the AGV 103 can rotate by 90 degrees. Therefore, the processor 31 rotates the AGV 103 by 90 degrees four times. For example, the processor 31 transmits a control signal to the AGV 103 through the AGV interface 36 four times to rotate the AGV 103 by 90 degrees.
[0084] When the AGV 103 has completed one rotation, the processor 31 moves the AGV 103 to a predetermined position. For example, the processor 31 transmits a control signal to the AGV 103 via the AGV interface 36 to instruct the AGV 103 to move to the predetermined position.
[0085] When the AGV 103 arrives at the measurement position, the processor 31 may transmit a signal indicating that the AGV 103 has arrived at the measurement position to the WES 10 via the communication unit 35. Furthermore, when the AGV 103 makes one rotation, the processor 31 may transmit a signal indicating that the AGV 103 has made one rotation to the WES 10 via the communication unit 35.
[0086] Next, a description will be given of functions realized by the first WCS 20. The functions realized by the first WCS 20 are realized by the processor 21 executing a program stored in the internal memory, the ROM 22, the NVM 24, or the like.
[0087] First, the processor 21 has a function of photographing an item 105 using the camera 102 . The processor 21 determines whether the AGV 103 has arrived at the measurement position. For example, the processor 21 determines whether a signal indicating that the AGV 103 has arrived at the measurement position has been received through the communication unit 25.
[0088] When it is determined that the AGV 103 has arrived at the measurement position, the processor 21 starts photographing the item 105 using the camera 102 .
[0089] The processor 21 photographs the item 105 until the AGV 103 completes one rotation. The processor 21 may photograph the article 105 at a timing when the rotation angle of the AGV 103 is a predetermined angle. For example, the processor 21 may photograph the article 105 at a timing when the rotation angle of the AGV 103 is 0, 90, 180, and 270 degrees. In this case, the processor 21 may photograph the article 105 when it receives a signal from the WES 10 indicating that the rotation angle of the AGV 103 is 0, 90, 180, or 270 degrees.
[0090] The processor 21 also has the function of scanning the AGV 103, the loading platform 104, and the item 105 using the LRF 101. Similarly, when it is determined that the AGV 103 has arrived at the measurement position, the processor 21 starts scanning the article 105 using the LRF 101. That is, the processor 21 activates the LRF 101 to measure the distance to the object in the scan area 109.
[0091] 7 is a diagram for explaining an example of an operation in which the processor 21 measures a distance or the like using the LRF 101. As shown in FIG. 7, here, the processor 21 measures a distance to a measurement point 307 or the like using the LRF 101.
[0092] The LRF 101 measures a distance 302 from the LRF 101 to a measurement point 307. Furthermore, the LRF 101 acquires an angle 301 of the light source at the time when the measurement point 307 is measured. Here, the angle 301 is an angle from the horizontal.
[0093] The processor 21 acquires the angle 301 and the distance 302 from the LRF 101. The processor 21 calculates the coordinates of a measurement point 307 in a coordinate system based on the AGV 103, based on the angle 301 and the distance 302.
[0094] Here, the coordinate system based on the AGV 103 is a coordinate system in which the rotation axis of the AGV 103 is the z-axis and an axis perpendicular to the z-axis is the r-axis. That is, the processor 21 calculates the height 303 (z-coordinate) of the measurement point 307 and the distance 304 (r-coordinate) from the z-axis based on the angle 301 and the distance 302.
[0095] Here, vector 305 indicates the direction of AGV 103. Also, angle 306 indicates the rotation angle from the initial angle of AGV 103. Here, it is assumed that the initial angle of AGV 103 is along the r-axis.
[0096] The processor 21 similarly calculates the r coordinate and the z coordinate at each measurement point in the scanning area 109 . Furthermore, the processor 21 calculates the r coordinate and the z coordinate of each measurement point until the AGV 103 makes one rotation. That is, the processor 21 acquires the r coordinate and the z coordinate of each measurement point in time series.
[0097] Next, an example of the operation of the processor 21 measuring the coordinates of each measurement point on the article 105 etc. will be described. FIG. 8 is a diagram for explaining an example of an operation in which the processor 21 measures the coordinates of each measurement point of the article 105 or the like.
[0098] 8, scan angles 401-403 each indicate an angle of the light source of LRF 101. Scan angles 401-403 are angles that LRF 101 passes through while scanning scan region 109.
[0099] The line 404 is a position that is scanned when the rotation angle of the AGV 103 is the initial angle (0 degrees). In other words, the line 404 is a position that collides with the scanning area 109 when the rotation angle of the AGV 103 is the initial angle.
[0100] The line 405 is a position that is scanned when the rotation angle of the AGV 103 is 45 degrees. That is, the line 405 is a position that collides with the scan area 109 when the rotation angle of the AGV 103 is 45 degrees.
[0101] The line 406 is a position that is scanned when the rotation angle of the AGV 103 is 225 degrees. That is, the line 405 is a position that collides with the scanning area 109 when the rotation angle of the AGV 103 is 225 degrees.
[0102] The line 407 is a position that is scanned when the rotation angle of the AGV 103 is 270 degrees. That is, the line 407 is a position that collides with the scanning area 109 when the rotation angle of the AGV 103 is 270 degrees.
[0103] The line 408 is a position that is scanned when the rotation angle of the AGV 103 is 315 degrees. That is, the line 408 is a position that collides with the scanning area 109 when the rotation angle of the AGV 103 is 315 degrees.
[0104] Next, the data (scan data) obtained by the processor 21 through scanning will be described. FIG. 9 shows the r coordinates obtained at scan angles 401-403.
[0105] 9(a) shows the r coordinate obtained at a scan angle 401. Here, the horizontal axis (t axis) indicates time, and the vertical axis indicates the r coordinate.
[0106] Graph 409 shows the r coordinate obtained at scan angle 401. Graph 409 also shows the r coordinate (lines 405 to 408) when the rotation angles of the AGV 103 are 45, 225, 270, and 315 degrees.
[0107] 9(b) shows the r coordinate obtained at the scan angle 402. Here, the horizontal axis indicates time, and the vertical axis indicates the r coordinate.
[0108] Graph 410 shows the r coordinate obtained at scan angle 402. Graph 410 also shows the r coordinates (lines 405 to 408) when the rotation angles of the AGV 103 are 45, 225, 270, and 315 degrees.
[0109] 9(c) shows the r coordinate obtained at the scan angle 403. Here, the horizontal axis indicates time, and the vertical axis indicates the r coordinate.
[0110] Graph 411 shows the r coordinate obtained at scan angle 403. Graph 411 also shows the r coordinate (lines 405 to 408) when the rotation angles of the AGV 103 are 45, 225, 270, and 315 degrees.
[0111] FIG. 10 shows the scan data in the r-axis, z-axis, and t-axis. Scan data 501 indicates r and z coordinates obtained at each angle of the light source of LRF 101.
[0112] Next, a three-dimensional model constructed from scan data will be described. Fig. 11 shows a top view 601 of a three-dimensional model 603. Arrows 604 indicate the plot from one measurement point. Fig. 12 shows a side view 602 of the three-dimensional model 603. Fig. 13 shows a perspective view of the three-dimensional model 603.
[0113] The three-dimensional model 603 is data obtained by converting the scan data from a coordinate system of r-axis, z-axis, and t-axis to a coordinate system of x-axis, y-axis, and z-axis (three-dimensional coordinate system). The x-axis and y-axis are mutually orthogonal and horizontal. The z-axis is vertical. In other words, the three-dimensional model 603 is data obtained by plotting the scan data in three-dimensional coordinates.
[0114] Here, the processor 21 plots the data (r coordinates and z coordinates) acquired in a time series at equal angular intervals to generate a three-dimensional model 603. That is, the processor 21 generates the three-dimensional model 603 from the scan data, assuming that the AGV 103 rotates at a constant speed.
[0115] On the other hand, the rotation speed of the AGV 103 is not constant, but stops (or accelerates or decelerates) every 90 degrees. Therefore, in the three-dimensional model 603, the data of the LRF 101 is stretched when the rotation angle of the AGV 103 is near 0, 90, 180, and 270 degrees, and the data of the LRF 101 is compressed when the rotation angle is near 45, 135, 225, and 315 degrees. As a result, as shown in Fig. 11, the three-dimensional model 603, which should be a rectangular parallelepiped, is distorted.
[0116] The processor 21 also has a function of correcting distortion of the three-dimensional model 603 caused by the stopping of the rotation speed. As described above, since the rotation speed of the AGV 103 is not constant, the three-dimensional model 603 does not represent the shape of the actual item 105, etc. Therefore, the processor 21 modifies the three-dimensional model 603 so as to represent the shape of the actual item 105.
[0117] Here, several methods by which the processor 21 corrects distortions in the three-dimensional model 603 are described. First, a method in which the processor 21 corrects the distortion of the three-dimensional model 603 based on the rotation angle of the AGV 103 will be described.
[0118] The processor 21 acquires the rotation angle of the AGV 103 in time series from the WES 10, the second WCS, or the AGV 103 via the communication unit 25 or the like. When acquiring the rotation angle of the AGV 103 in time series, the processor 21 associates the rotation angle in time series with the r coordinate and the z coordinate in time series. The processor 21 corrects the three-dimensional model 603 based on the association between the rotation angle and the r coordinate and the z coordinate. That is, the processor 21 adjusts the angle interval at which the r coordinate and the z coordinate are plotted based on the rotation angle (or the rotation speed) of the AGV 103 to correct the three-dimensional model 603.
[0119] Fig. 14 shows a top view 701 of the modified 3D model 703. Arrow 704 indicates the plot from one measurement point. Fig. 15 shows a side view 702 of the modified 3D model 703. Fig. 16 shows a perspective view of the modified 3D model 703.
[0120] 14 to 16, each side of the three-dimensional model 703 is a straight line. Therefore, the three-dimensional model 703 represents the shape (rectangular parallelepiped) of the loaded item 105.
[0121] Next, a method for correcting distortion of the three-dimensional model 603 based on the shape of the loading platform 104 by the processor 21 will be described.
[0122] Here, the NVM 24 pre-stores data (reference shape model) indicating the loading platform 104 (reference shape).
[0123] The processor 21 extracts data (reference data) obtained by scanning the reference shape from the scan data. For example, the processor 21 extracts the reference data based on the height at which the loading platform 104 is placed.
[0124] When the reference data is extracted, the processor 21 plots the reference data in a three-dimensional coordinate system to generate a three-dimensional model of the loading platform 104. When the three-dimensional model of the loading platform 104 is generated, the processor 21 sets an angle interval of the plot so that the generated three-dimensional model of the loading platform 104 matches the reference shape model. The processor 21 modifies the three-dimensional model 603 to a three-dimensional model 703 based on the set angle interval.
[0125] For example, the processor 21 adjusts the plot angle of the scan data at each time within a range in which the magnitude relationship with the plot angle of the scan data at adjacent times does not change, and adopts a state close to the reference shape model.
[0126] The processor 21 may use as the reference shape the shape of a specific pallet or the AGV 103. The processor 21 may also recognize a marker or the like attached to a specific pallet or the AGV 103 to acquire reference data.
[0127] Furthermore, when the article 105 is box-shaped, the processor 21 may set a rectangular parallelepiped as the reference shape. For example, the processor 21 may correct the three-dimensional model 603 so that each side of the three-dimensional model 603 becomes a straight line.
[0128] Next, a method for processor 21 to correct distortion of three-dimensional model 603 based on texture will be described.
[0129] FIG. 17 is a diagram for explaining a method in which the processor 21 corrects distortion of the three-dimensional model 603 based on the texture 107 of the article 105.
[0130] Here, 3D model 801 is the 3D model to be rectified.
[0131] Here, the processor 21 obtains the texture 107 of the item 105 . For example, the processor 21 acquires an image (captured image) captured by the camera 102 when the rotation angle of the AGV 103 is 0, 90, 180, or 270 degrees. That is, the processor 21 acquires an image captured at a timing when the surface of the article 105 faces the camera 102.
[0132] The processor 21 obtains the texture 107 from the obtained image according to a predetermined image processing algorithm or the like.
[0133] The processor 21 may also read the code 106 from the acquired image. The processor 21 may also obtain, from a database, a texture 107 associated with information (such as an identifier for the item 105) obtained by decoding the code 106.
[0134] When the texture 107 is acquired, the processor 21 acquires texture information indicating the luminance value of the texture 107 from the texture 107 .
[0135] In addition, the processor 21 acquires the luminance value of each measurement point from the LRF 101.
[0136] 17, the processor 21 acquires the brightness value of the measurement point 804 on a predetermined surface of the article 105. Here, the predetermined surface of the article 105 is a surface facing the LRF 101 and the camera 102 when the rotation angle of the AGV 103 is 0, 90, 180, or 270 degrees. Moreover, an arrow 803 indicates the plot of a measurement point 804 .
[0137] The processor 21 also acquires texture information 805 for a specific surface of the article 105 .
[0138] The processor 21 corrects the plot angle of the measurement point 804 so that the brightness value of the measurement point 804 and the brightness value indicated by the texture information 805 become closer to each other.
[0139] The processor 21 similarly corrects the plot angle for each measurement point 804. The processor 21 also similarly corrects the plotting angles for each side of the article 105.
[0140] The processor 21 corrects the plotting angle for each face to generate a distortion-corrected three-dimensional model 802.
[0141] Similarly to the above, the processor 21 may correct distortion of the three-dimensional model 603 based on the texture of the AGV 103 or the loading platform 104. For example, the processor 21 acquires the texture of the AGV 103 or the loading platform 104 from a captured image. The processor 21 may also acquire the texture of the AGV 103 or the loading platform 104 from the captured image from the NVM 24.
[0142] The processor 21 corrects the distortion of the three-dimensional model by any one of the methods described above. Note that the processor 21 may correct the distortion of the three-dimensional model by combining several methods.
[0143] The method by which the processor 21 corrects the distortion of the three-dimensional model is not limited to a particular method.
[0144] In addition, the processor 21 may transmit the three-dimensional model with the distortion corrected to an external device such as the WES 10.
[0145] The processor 21 also has a function of extracting the area (foreground area) in which the article 105 appears from the captured image based on the distortion-corrected three-dimensional model.
[0146] Fig. 18 shows an example of an operation in which the processor 21 extracts a foreground region from a captured image. In Fig. 18, it is assumed that the processor 21 has generated a three-dimensional model 901 in which distortion has been corrected. It is also assumed that the processor 21 has acquired a captured image 903.
[0147] The processor 21 calibrates the three-dimensional model 901 and the captured image 903 based on the position of the LRF 101 and the position and angle of view of the camera 102. That is, the processor 21 projects the three-dimensional model 901 onto the captured image 903.
[0148] The processor 21 acquires the region onto which the three-dimensional model 901 is projected in the captured image 903 as a foreground region 905. The processor 21 also acquires the other regions as a background region 904.
[0149] The processor 21 may also extract foreground regions from the captured images of each side of the article 105 in a similar manner.
[0150] In addition, the processor 21 may transmit the foreground region 905 to an external device such as the WES 10.
[0151] Next, a description will be given of functions realized by the WES 10. The functions realized by the WES 10 are realized by the processor 11 executing a program stored in the internal memory, the ROM 12, the NVM 14, or the like.
[0152] The processor 11 is operable to cause the first WCS 20 to generate a three-dimensional model of a given item 105 and a foreground region. First, the processor 11 sets the item 105. After setting the item 105, the processor 11 causes the AGV 103 to move the set item 105 loaded thereon to a measurement position via the second WCS 30.
[0153] When the AGV 103 transports the article 105 to the measurement position, the processor 11 transmits a signal indicating that the AGV 103 has arrived at the measurement position to the first WCS 20 via the communication unit 15.
[0154] The processor 11 also rotates the AGV 103 once through the second WCS 30. Here, the processor 11 may transmit a signal indicating that the rotation angle of the AGV 103 is 0, 90, 180, or 270 degrees to the second WCS 30 through the communication unit 15.
[0155] The processor 11 may also transmit, via the communication unit 15, a signal to the first WCS 20 indicating that the AGV 103 has completed one rotation.
[0156] When the AGV 103 has completed one rotation, the processor 11 moves the AGV 103 to a predetermined position via the second WCS 30.
[0157] The processor 11 may also receive a three-dimensional model of the item 105 and the foreground region from the first WCS 20 via the communication unit 15.
[0158] Next, an example of the operation of the measurement system 1 will be described. First, an example of the operation of the second WCS 30 will be described. FIG. 19 is a flowchart for explaining an example of the operation of the second WCS 30. As shown in FIG.
[0159] Here, it is assumed that the AGV 103 has an item 105 loaded onto a loading platform 104 .
[0160] The processor 31 of the second WCS 30 moves the AGV 103 to the measurement position (S11). After the AGV 103 is moved to the measurement position, the processor 31 rotates the AGV 103 by a predetermined angle (here, 90 degrees) (S12).
[0161] When the AGV 103 is rotated by a predetermined angle, the processor 31 determines whether the AGV 103 has rotated once (S13). If it is determined that the AGV 103 has not rotated once (S13, NO), the processor 31 returns to S12.
[0162] When it is determined that the AGV 103 has made one rotation (S13, YES), the processor 31 moves the AGV 103 from the measurement position to a predetermined position (S14).
[0163] When the AGV 103 has been moved from the measurement position to a predetermined position, the processor 31 ends the operation.
[0164] Next, an example of the operation of the first WCS 20 will be described. FIG. 20 is a flowchart for explaining an example of the operation of the first WCS 20. As shown in FIG.
[0165] First, the processor 21 of the first WCS 20 determines whether the AGV 103 carrying the item 105 has arrived at the measurement position (S21). If it is determined that the AGV 103 carrying the item 105 has not arrived at the measurement position (S21, NO), the processor 21 returns to S21.
[0166] When it is determined that the AGV 103 carrying the article 105 has arrived at the measurement position (S21, YES), the processor 21 starts scanning the LRF 101 (S22). When scanning the LRF 101 starts, the processor 21 starts capturing images with the camera 102 (S23).
[0167] Here, it is assumed that the AGV 103 starts to rotate. When the camera 102 starts capturing images, the processor 21 determines whether the AGV 103 has completed one rotation (S24). If the processor 21 determines that the AGV 103 has not completed one rotation (S24, NO), the processor 21 returns to S24.
[0168] When it is determined that the AGV 103 has completed one rotation (S24, YES), the processor 21 ends the scanning of the LRF 101 (S25). When the scanning of the LRF 101 ends, the processor 21 ends the shooting of the camera 102 (S26).
[0169] When the camera 102 finishes capturing images, the processor 21 corrects distortion of the three-dimensional model based on the scan data of the LRF 101 (S27). After correcting the distortion of the three-dimensional model, the processor 21 extracts a foreground region from the captured image based on the distortion-corrected three-dimensional model (S28). Once the foreground region is extracted, processor 21 ends its operation.
[0170] The first WCS 20 and the second WCS 30 may be integrally formed. Also, the first WCS 20, the second WCS 30, and the WES 10 may be integrally formed.
[0171] The first WCS 20 may also realize the functions of the WES 10. The second WCS 30 may also realize the functions of the WES 10.
[0172] Furthermore, the measurement system 1 may use a three-dimensional camera instead of the LRF 101 to obtain the distance to the measurement point.
[0173] The measurement system configured as described above rotates an object using an AGV. The measurement system uses an LRF to scan the object being rotated by the AGV. The measurement system also corrects distortions caused by the non-constant rotation speed of the AGV in the 3D model obtained by the scan. As a result, the measurement system can effectively obtain a 3D model of the object using the AGV. Second Embodiment Next, a second embodiment will be described. The measurement system according to the second embodiment differs from that according to the first embodiment in that it can scan and photograph an article 105 that is located at different measurement positions. Therefore, the other points are given the same reference numerals and detailed description is omitted.
[0174] 21 shows a schematic configuration example of a measurement system 1' according to the second embodiment. The measurement system 1' further includes a driving mechanism 111 and the like.
[0175] The driving mechanism 111 moves the LRF 101 and the camera 102 under control of the first WCS 20. Here, the driving mechanism 111 rotates the column 110 around the central axis of the column 110 as the axis of rotation under control of the first WCS 20. The driving mechanism 111 is composed of a motor for rotating the pillar 110 and the like.
[0176] The driving mechanism 111 rotates the pillar 110 so that the LRF 101 and the camera 102 can respectively scan and photograph an article 1001 located at a first measurement position. The driving mechanism 111 also rotates the pillar 110 so that the LRF 101 and the camera 102 can respectively scan and photograph an article 1002 located at a second measurement position different from the first measurement position.
[0177] Moreover, the measurement system 1 ′ includes a first WCS 20 ′ in place of the first WCS 20 . Fig. 22 is a block diagram showing a configuration example of the first WCS 20'. As shown in Fig. 22, the first WCS 20 includes a processor 21, a ROM 22, a RAM 23, an NVM 24, a communication unit 25, a sensor interface 26, an operation unit 27, a display unit 28, a drive mechanism interface 29, and the like.
[0178] The processor 21, the ROM 22, the RAM 23, the NVM 24, the sensor interface 26, the communication unit 25, the operation unit 27, the display unit 28 and the drive mechanism interface 29 are connected to one another via a data bus or the like.
[0179] The drive mechanism interface 29 is an interface for communicating with the drive mechanism 111 .
[0180] Next, a description will be given of functions realized by the first WCS 20'. The functions realized by the first WCS 20' are realized by the processor 21 executing a program stored in the internal memory, the ROM 22, the NVM 24, or the like.
[0181] The first WCS 20' realizes the following functions in addition to the functions realized by the first WCS 20 according to the first embodiment.
[0182] The processor 21 has a function of controlling the position and orientation of the LRF 101 and the camera 102 according to the measurement position where the AGV 103 is located. Here, the processor 31 of the second WCS 30 moves the AGV 103 carrying an article to the first measurement position or the second measurement position under control of the WES 10.
[0183] The processor 21 determines which measurement position (for example, the first measurement position or the second measurement position) the AGV 103 carrying the article 105 has arrived at. For example, the processor 21 may receive a signal indicating which measurement position the AGV 103 has arrived at through the communication unit 25. The processor 21 may also determine which measurement position the AGV 103 has arrived at by using various sensors.
[0184] The processor 21 controls the positions and orientations of the LRF 101 and the camera 102 according to the measurement position where the AGV 103 arrives. That is, the processor 21 uses the drive mechanism 111 to rotate the pillar 110 so that the LRF 101 and the camera 102 can respectively scan and photograph the article present at the arrival position.
[0185] Next, an example of the operation of the first WCS 20' will be described. FIG. 23 is a flowchart for explaining an example of the operation of the first WCS 20'.
[0186] First, the processor 21 of the first WCS 20' determines whether the AGV 103 carrying the article 105 has arrived at any measurement position (S31). If it is determined that the AGV 103 carrying the article 105 has not arrived at any measurement position (S31, NO), the processor 21 returns to S31.
[0187] When it is determined that the AGV 103 carrying the item 105 has arrived at any of the measurement positions (S31, YES), the processor 21 uses the drive mechanism 111 to rotate the pillar 110 according to the measurement position at which the AGV 103 has arrived (S32).
[0188] After rotating the pillar 110, the processor 21 starts scanning the LRF 101 (S22). Since the process from S22 onwards is similar to that in the first embodiment, the description will be omitted.
[0189] The driving mechanism 111 may be configured to move the pillar 110 in the horizontal direction. Furthermore, the driving mechanism 111 may be configured to move the LRF 101 and the camera 102 in the vertical direction.
[0190] Furthermore, the driving mechanism 111 may move the LRF 101 and the camera 102 according to any one of three or more measurement positions.
[0191] Furthermore, if the processor 21 recognizes in advance the measurement position where the AGV 103 will arrive, the processor 21 may execute S32 before S31.
[0192] The measurement system configured as described above can generate a three-dimensional model of an article using one LRF 101 and one camera 102 for an article that has arrived at any one of a plurality of measurement positions.
[0193] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. The invention as described in the claims of the original application is set forth below. [C1] A sensor interface for connecting to a distance sensor; Using the distance sensor, scanning an item loaded on an automated guided vehicle and rotated by rotation of the automated guided vehicle; scanning the article to generate a three-dimensional model of the article from the resulting scan data; A processor; An information processing device comprising: [C2] The automated guided vehicle rotates about a vertical axis, The distance sensor scans vertically. An information processing device according to [C1]. [C3] The automated guided vehicle stops or accelerates or decelerates its rotation at every predetermined angle, the processor corrects distortions in the three-dimensional model caused by stopping or accelerating or decelerating the rotation; The information processing device according to [C1] or [C2]. [C4] The processor corrects the distortion based on a rotation angle of the automated guided vehicle. The information processing device according to [C3]. [C5] The processor corrects the distortion based on a rotation angle of the automated guided vehicle over a time series. An information processing device according to [C4]. [C6] The processor, Obtaining reference data by scanning a reference shape from the scan data; correcting the distortion based on the reference data; The information processing device according to [C3]. [C7] The processor corrects the distortion so that a three-dimensional model generated from the reference data corresponds to the reference shape. The information processing device according to [C6]. [C8] The processor uses the distance sensor to scan a loading platform on which the item is loaded in the automated guided vehicle; The reference shape is the loading platform. The information processing device according to [C6] or [C7]. [C9] The processor scans the automated guided vehicle using the distance sensor; The reference shape is the automated guided vehicle. The information processing device according to [C6] or [C7]. [C10] the processor corrects the distortion based on a texture of the article. The information processing device according to [C3]. [C11] The distance sensor acquires a brightness value; the processor corrects the distortion based on the obtained luminance values and the luminance values of the texture. The information processing device according to [C10]. [C12] The sensor interface is connected to a camera that photographs the item; The processor extracts an area in which the object appears from the image captured by the camera based on the three-dimensional model of the object. An information processing device according to any one of [C1] to [C11]. [C13] a drive mechanism interface that is connected to a drive mechanism that moves the distance sensor, and the processor uses the drive mechanism to move the distance sensor according to a position of the automated guided vehicle; An information processing device according to any one of [C1] to [C12]. [C14] 1. An information processing method executed by a processor, comprising: Using a distance sensor, scanning an item loaded on an automated guided vehicle and rotated by rotation of the automated guided vehicle; scanning the article to generate a three-dimensional model of the article from the resulting scan data; Information processing methods. [C15] A program executed by a processor, The processor, a function of scanning an item loaded on an automated guided vehicle and rotated by the rotation of the automated guided vehicle using a distance sensor; a function of generating a three-dimensional model of the article from scan data obtained by scanning the article; A program to achieve this. [Explanation of symbols]
[0194] 1...measurement system, 1'...measurement system, 5...WMS, 10...WES, 11...processor, 12...ROM, 13...RAM, 14...NVM, 15...communication unit, 16...operation unit, 17...display unit, 20...first WCS, 20'...first WCS, 21...processor, 22...ROM, 23...RAM, 24...NVM, 25...communication unit, 26...sensor interface, 27...operation unit, 28...display unit, 29...drive mechanism interface, 3 0...second WCS, 31...processor, 32...ROM, 33...RAM, 34...NVM, 35...communication unit, 36...AGV interface, 37...operation unit, 38...display unit, 70...tire, 71...processor, 72...ROM, 73...RAM, 74...NVM, 75...communication unit, 76...drive mechanism, 77...sensor, 78...battery, 79...charging mechanism, 101...LRF, 102...camera, 103...AGV, 104...loading platform, 105...object product, 106...code, 107...texture, 109...scanning area, 110...pillar, 111...driving mechanism, 301...angle, 302...distance, 303...height, 304...distance, 305...vector, 306...angle, 307...measurement point, 401...scanning angle, 402...scanning angle, 403...scanning angle, 404...line, 405...line, 406...line, 407...line, 408...line, 409...graph, 410...graph, 411 ...graph, 501...scan data, 601...top view, 602...side view, 603...three-dimensional model, 604...arrow, 701...top view, 702...side view, 703...three-dimensional model, 704...arrow, 801...three-dimensional model, 802...three-dimensional model, 803...arrow, 804...measurement point, 805...texture information, 901...three-dimensional model, 903...captured image, 904...background region, 905...foreground region, 1001...object, 1002...object.
Claims
1. A sensor interface for connecting to a distance sensor; Using the distance sensor, an article is scanned which is loaded on an automated guided vehicle that stops or accelerates / decelerates its rotation at predetermined angles and rotates due to the rotation of the automated guided vehicle; scanning the article and generating a three-dimensional model of the article from the resulting scan data; A processor; Equipped with the processor corrects distortions in the three-dimensional model caused by stopping or accelerating or decelerating the rotation; Information processing device.
2. The automated guided vehicle rotates about a vertical axis, The distance sensor scans vertically. The information processing device according to claim 1 .
3. The processor corrects the distortion based on a rotation angle of the automated guided vehicle. The information processing device according to claim 1 .
4. The processor corrects the distortion based on a rotation angle of the automated guided vehicle over a time series. The information processing device according to claim 3 .
5. The processor, Obtaining reference data by scanning a reference shape from the scan data; correcting the distortion based on the reference data; The information processing device according to claim 1 .
6. The processor corrects the distortion so that a three-dimensional model generated from the reference data corresponds to the reference shape. The information processing device according to claim 5 .
7. The processor uses the distance sensor to scan a loading platform on which the item is loaded in the automated guided vehicle; The reference shape is the loading platform.
7. The information processing device according to claim 5 or 6.
8. The processor scans the automated guided vehicle using the distance sensor; The reference shape is the automated guided vehicle.
7. The information processing device according to claim 5 or 6.
9. the processor corrects the distortion based on a texture of the article. The information processing device according to claim 1 .
10. The distance sensor acquires a brightness value; the processor corrects the distortion based on the obtained luminance values and the luminance values of the texture. The information processing device according to claim 9.
11. The sensor interface is connected to a camera that photographs the item; The processor extracts an area in which the object appears from the image captured by the camera based on the three-dimensional model of the object. The information processing device according to claim 1 .
12. a drive mechanism interface that is connected to a drive mechanism that moves the distance sensor, and the processor uses the drive mechanism to move the distance sensor according to a position of the automated guided vehicle; The information processing device according to claim 1 .
13. 1. An information processing method executed by a processor, comprising: Using a distance sensor, an article is scanned which is loaded on an automated guided vehicle that stops or accelerates / decelerates its rotation at predetermined angles and rotates with the rotation of the automated guided vehicle; generating a three-dimensional model of the article from scan data obtained by scanning the article; Correcting distortions in the three-dimensional model caused by stopping or accelerating / decelerating the rotation; Information processing methods.
14. A program executed by a processor, The processor, A function of scanning an article loaded on an automated guided vehicle that stops or accelerates / decelerates its rotation at predetermined angles using a distance sensor and rotates with the rotation of the automated guided vehicle; a function of generating a three-dimensional model of the article from scan data obtained by scanning the article; A function of correcting distortions caused by stopping or accelerating / decelerating rotation in the three-dimensional model; A program to achieve this.
Citation Information
Patent Citations
Three-dimensional shape measuring apparatus
JP2004045261A
Dynamic pallet dimensioning-forklift taring
JP2019207230A
Unmanned carrier, control device, and program
JP2020200154A
Cargo handling device, cargo handling system and program
JP2021013969A
Drive unit and horizontal conveyance carriage
WO2018221409A1
