Cargo handling machine, on-board device, method, and program

The cargo handling machine uses electromagnetic scanning to align and insert forks into container openings, addressing fork collisions and unmarked cargo issues, ensuring safe and precise transportation.

JP7586267B2Active Publication Date: 2024-11-19NEC CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2023183844
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-10-26
Publication Date
2024-11-19
Estimated Expiration
2037-03-22

AI Technical Summary

Technical Problem

Existing cargo handling technologies face issues such as fork collision with containers and the need for marked cargo handling objects, leading to inadequate transportation capabilities.

Method used

A cargo handling machine equipped with a spatial recognition device that uses electromagnetic waves for horizontal scanning to detect the distance and position of insertion claws, allowing precise alignment with container openings, and performs operations to adjust the height and timing of insertion to prevent collisions.

Benefits of technology

Enables accurate and safe transportation of cargo without damage to containers, even when they are not marked, by ensuring proper alignment and insertion of forks into container pockets.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007586267000001
    Figure 0007586267000001
  • Figure 0007586267000002
    Figure 0007586267000002
  • Figure 0007586267000003
    Figure 0007586267000003
Patent Text Reader

Abstract

To appropriately convey an object to be conveyed.SOLUTION: A cargo handling machine performs first operation for moving up and down the height of an insertion claw for holding an object to be conveyed. The cargo handling machine causes a spatial recognition device, which senses a distance to an object by horizontal scanning of an electromagnetic wave, to perform second operation for moving up / down the height of the horizontal scanning with respect to the object at a timing different from that of the first operation. The cargo handling machine detects a position of an insertion unit of the object to be conveyed to which the insertion claw is inserted based on the distance from the object acquired by the spatial recognition device.SELECTED DRAWING: Figure 11
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a cargo handling machine, an on-vehicle device, a method, and a program. [Background technology]

[0002] In recent years, with the development of autonomous driving technology and robotics technology, the accuracy of spatial recognition technology using lasers and radar has improved, and the cost of spatial recognition sensors has been reduced. On the other hand, devices that manage loading and unloading work are used in loading and unloading machines such as forklifts. For example, Patent Document 1 describes detecting when the distance to a container reaches a predetermined value, and notifying an operator that the detected distance has reached the predetermined value. For example, Patent Document 2 describes a method in which the amount of left-right and up-down deviation between the forks 2 and the object to be loaded is calculated from the position on the screen of a mark photographed by a camera, and automatic fork positioning control is performed to automatically align the forks 2 with the object to be loaded so as to eliminate the amount of deviation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2000-335896 A [Patent Document 2] JP 2003-128395 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 has a problem in that the forks themselves collide with the container, making it impossible to insert the forks into the container and transporting it. Also, the technology described in Patent Document 2 has a problem in that the cargo object must be marked, and unmarked cargo objects cannot be transported. As illustrated above, the techniques described in Patent Documents 1 and 2 may not be able to properly transport the object to be transported.

[0005] Therefore, one aspect of the present invention aims to be able to properly transport objects to be transported. [Means for solving the problem]

[0006] One aspect of the present invention is a loading machine comprising: means for performing a first action of raising and lowering the height of a plug for grasping an object to be transported; means for causing a spatial recognition device that senses the distance to an object by horizontal scanning of electromagnetic waves to perform a second action of raising and lowering the height of the horizontal scanning on the object at a timing different from that of the first action; and means for detecting a position of an insertion portion of the object to be inserted with the plug, based on the distance to the object obtained by the spatial recognition device.

[0007] Another aspect of the present invention is an on-board device mounted on a loading machine that performs a first action of raising and lowering the height of a plug-in claw for grasping an object to be transported, and the on-board device is equipped with: a means for performing a second action of raising and lowering the height of horizontal scanning of an object at a timing different from that of the first action, for a spatial recognition device that senses the distance to an object by horizontal scanning of electromagnetic waves; and a means for detecting the position of an insertion portion of the object to be inserted with the plug-in claw, based on the distance to the object obtained by the spatial recognition device.

[0008] Another aspect of the present invention is a method that includes performing a first action of raising and lowering the height of a plug for grasping an object to be transported, and having a spatial recognition device that senses the distance to the object by horizontal scanning of electromagnetic waves perform a second action of raising and lowering the height of the horizontal scanning on the object at a timing different from that of the first action, and detecting a position of an insertion portion of the object to be inserted with the plug based on the distance to the object obtained by the spatial recognition device.

[0009] Another aspect of the present invention is a program that causes a computer to execute a first operation of raising and lowering the height of a plug-in claw for grasping an object to be transported, a second operation of raising and lowering the height of horizontal scanning of electromagnetic waves on the object at a timing different from that of the first operation, using a spatial recognition device that senses the distance to the object by horizontal scanning of electromagnetic waves, and a process of detecting the position of the insertion portion of the object to be inserted with the plug-in claw, based on the distance to the object obtained by the spatial recognition device. Effect of the Invention

[0010] According to one aspect of the present invention, an effect is obtained in that the object to be transported can be transported appropriately. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is an explanatory diagram illustrating a carrying operation according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram illustrating an example of a fixed position of the work management device according to the present embodiment. [Diagram 3] FIG. 2 is a schematic diagram illustrating an example of sensing according to the present embodiment. [Figure 4] FIG. 11 is another schematic diagram illustrating an example of sensing according to the present embodiment. [Diagram 5] FIG. 4 is a schematic diagram illustrating an example of a sensing result according to the embodiment. [Figure 6] FIG. 11 is a diagram illustrating an example of deviation determination according to the embodiment. [Figure 7] 11 is a schematic diagram showing another example of deviation determination according to the present embodiment. FIG. [Figure 8] 11 is a schematic diagram showing another example of deviation determination according to the present embodiment. FIG. [Figure 9] 11 is a schematic diagram showing another example of deviation determination according to the present embodiment. FIG. [Figure 10] 11 is a schematic diagram showing another example of deviation determination according to the present embodiment. FIG. [Figure 11] FIG. 4 is a flowchart showing an example of an operation of the forklift according to the embodiment. [Figure 12] 1 is a schematic diagram illustrating a hardware configuration of a work management device according to an embodiment of the present invention; [Figure 13] 1 is a schematic block diagram showing a logical configuration of a work management device according to an embodiment of the present invention. [Figure 14] 4 is another schematic block diagram showing the logical configuration of the work management device according to the present embodiment. FIG. [Figure 15] FIG. 11 is a schematic diagram showing an example of facing determination according to a modified example of the present embodiment. [Figure 16] FIG. 11 is a schematic diagram showing an example of an insertion timing prediction according to a modified example of the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0013] <About transportation work> FIG. 1 is an explanatory diagram for explaining a carrying operation according to an embodiment of the present invention. The forklift F1 is an example of a cargo handling machine. The forklift F1 is provided with forks F101 and F102. The forks F101 and F102 are an example of a plug-in claw. The forklift F1 grips and transports an object to be transported, such as a baggage or a pallet, by inserting the forks F101, F102 into the object to be transported. That is, the loading / unloading machine is provided with insertion claws that grip the object to be transported by inserting them into the object.

[0014] The container 20 is an example of a transport object or an insertion object. The container 20 is a receptacle for storing luggage and the like inside. The container 20 is provided with openings (insertion portions; they may be recesses) for fork pockets 201 and 202. The fork pockets 201 and 202 are holes or recesses into which the forks F101 and F102 are inserted, respectively. The fork pockets 201 and 202 are an example of an insertion object. The surface (also referred to as the "insertion surface 211") that faces the forklift F1 during insertion or transportation has fork pockets 201, 202. The fork pockets 201, 202 are holes or recesses into which the forks F101, F102, respectively, are inserted from the front (insertion surface 211) of the object to be transported to the back (positive direction of the Y axis in FIG. 1) and allow the tips of the forks to protrude from the back. In FIG. 1, the fork pockets 201 and 202 are holes extending straight in the normal direction of the insertion surface 211 at the lower part of the insertion surface 211.

[0015] When the forks F101, F102 are inserted straight into the fork pockets 201, 202, respectively, the forklift F1 can properly (well-balanced and stably) grip and transport the container 20. The dimensions of the container 20 and the fork pockets 201, 202 are determined by standard specifications (for example, JIS). The object to be transported is not limited to the container 20, but may be a pallet, or may be both a pallet and cargo placed on the pallet. Here, a pallet refers to a loading platform on which cargo is placed. The pallet is provided with fork pockets. There may be three or more fork pockets (for example, four).

[0016] The work management device 1 is attached and fixed to a cargo handling machine. The work management device 1 includes a space recognition sensor such as a laser sensor. In this embodiment, a case where the space recognition sensor is a laser sensor will be described. That is, the work management device 1 (space recognition sensor) irradiates laser light and receives reflected light, and senses the distance R from the device to each object. The work management device 1 repeats this for the range of the sensing target. The work management device 1 recognizes the space, for example, based on the irradiation direction of the laser light and the distance R to each object (see Figs. 3 to 6).

[0017] The work management device 1 detects the container 20 (or the insertion surface 211) based on sensing information obtained from the spatial recognition sensor. Based on the sensing information, the work management device 1 performs a deviation judgment to judge whether or not there is a deviation in the positional relationship between the fork pockets 201, 202 of the container 20 (or the insertion surface 211) and the forks F101, F102. Here, the positional relationship is, for example, a positional relationship (positional relationship projected onto a plane) on a plane (XZ plane) perpendicular to the direction in which the forklift F1 and the container 20 face each other, but the present invention is not limited to this, and may be a positional relationship on an XY plane or a YZ plane. Note that the direction in which the forklift F1 and the container 20 face each other is also the direction in which the forks F101, F102 are inserted, or the traveling direction of the forklift F1 (when moving straight). The work management device 1 outputs the determination result. For example, when the work management device 1 determines that there is a deviation, it outputs a warning (for example, a warning sound, a warning light, a warning image, a guide, etc.).

[0018] Thereby, the work management device 1 can inform, for example, a worker or the like whether the fork pockets 201, 202 and the forks F101, F102 are misaligned (also simply referred to as "the forks are misaligned"). In other words, the worker or the like can change the position of the forklift F1 and the positions (e.g., heights) of the forks F101, F102 in response to the warning. As a result, the worker or the like can accurately insert the forks F101, F102 into the fork pockets 201, 202.

[0019] The loading platform L1 is an example of a destination. The loading platform L1 is a loading platform of a truck or a trailer, a freight car of a freight train, etc. The loading platform L1 is provided with fastening devices L11 to L14. The fastening devices are devices used to connect and secure the container 20. The container 20 is grasped and transported by a forklift F1, placed on a loading platform L1, and secured to the loading platform L1 by fastening devices L11 to L14. Incidentally, the coordinate axes X, Y, and Z shown in FIG. 1 are common to the figures of this embodiment and its modified examples.

[0020] <About forklifts> FIG. 2 is a schematic diagram showing an example of a fixed position of the work management device 1 according to this embodiment. FIG. 2 is a front view of the forklift F1.

[0021] The fork rails F11, F12 (finger bars) are rails on which the forks F101, F102 are attached. The fork F101 or F102 can be slid along the fork rails F11, F12 to adjust the distance between the forks F101 and F102. The backrest F13 is attached to the fork rails F11 and F12. The backrest F13 is a mechanism that prevents the grasped container 20 from collapsing or falling toward the forklift F1. The mast F14 is a rail for raising and lowering the forks F101 and F102. The fork rails F11 and F12 are raised and lowered along the mast F14, whereby the forks F101 and F102 are raised and lowered.

[0022] The work management device 1 is fixed to the underside (lower side) of the fork rail F11 at the center (in the X-axis direction) of the fork rail F11. However, the work management device 1 may also be attached to the upper side (upper side) of the fork rail F11, etc. Furthermore, the work management device 1 may also be attached to the fork rail F12, the backrest F13, the mast F14, or the body of the forklift F1. Furthermore, multiple work management devices 1 or spatial recognition sensors may be attached. When the work management device 1 is fixed to the fork rail F11, the fork rail F12, and the backrest F13, the laser light emitted by the spatial recognition device can be irradiated to the container 20 without being blocked. In this case, the fork rail F11, the fork rail F12, and the backrest F13 move up and down together with the forks F101, F102 and the container 20, so that the relative positional relationship between these and the work management device 1 can be fixed.

[0023] <About Sensing> Sensing by the work management device 1 (space recognition sensor) will be described below. In this embodiment, the laser light irradiation method will be described as a case where the work management device 1 performs raster scanning. However, the present invention is not limited to this, and other irradiation methods (for example, Lissajous scanning) may also be used.

[0024] FIG. 3 is a schematic diagram showing an example of sensing according to this embodiment. This figure shows the sequentially irradiated laser beams as viewed from the top side of the forklift F1. In Fig. 3, the angle (polar coordinate deviation angle) of the projection direction of the laser beam when projected onto the XY plane is set to θ. The axis parallel to the Y axis and passing through the work management device 1 (irradiation port) (initial optical axis described later) is set to θ=0.

[0025] The work management device 1 sequentially irradiates the laser light in the horizontal direction (while keeping the other deflection angles φ constant), thereby performing scanning in the horizontal direction. More specifically, the work management device 1 sequentially irradiates the laser light (for example, at equal angles Δθ) in the positive direction of the deflection angle θ. After irradiating (also referred to as "horizontal scanning") a specific range in the horizontal direction (where the deflection angle projected onto the XY plane is in the range of -θmax≦θ≦θmax) with the laser light, the work management device 1 shifts the irradiation direction of the laser light in the vertical direction and irradiates the laser light in the negative direction of the deflection angle θ. When this horizontal scan in the negative direction of the deflection angle θ is completed, the work management device 1 further shifts the irradiation direction of the laser light in the vertical direction, and again performs horizontal scanning in the positive direction of the X-axis.

[0026] FIG. 4 is another schematic diagram showing an example of sensing according to this embodiment. This figure shows the irradiation of the laser light as seen from the side of the forklift F1. Note that the horizontal scanning in FIG. 3 corresponds to one of the arrows in FIG. 4, the angle (polar coordinate deviation angle) of the projection direction of the laser light when projected onto the YZ plane is defined as φ. The axis (initial optical axis) that is parallel to the Y axis and passes through the work management device 1 (irradiation port) is defined as φ=0.

[0027] The work management device 1 shifts the laser light by an equal angle Δφ in the direction of the deflection angle φ for each horizontal scan. More specifically, the work management device 1 performs a horizontal scan in the positive direction of the deflection angle θ, and then shifts the irradiation direction of the laser light by an equal angle Δφ in the positive direction of the deflection angle φ. After that, the work management device 1 performs a horizontal scan in the negative direction of the deflection angle θ, and then further shifts the irradiation direction of the laser light by an equal angle Δφ in the positive direction of the deflection angle φ. The work management device 1 repeats this operation, irradiating a specific range (-φmax (e.g., φmax=90°)≦φ≦0) in the positive direction of the deflection angle φ. Note that the work management device 1 may shift the irradiation by only the specific range (φ=0) and then reverse it to the negative direction of the deflection angle φ. Note that the work management device 1 may irradiate the laser light in a different order or in a different coordinate system.

[0028] FIG. 5 is a schematic diagram illustrating an example of a sensing result according to the present embodiment. Fig. 5 shows sensing information indicating the sensing result for the example of sensing in Fig. 3 and Fig. 4. The sensing information is, for example, spatial coordinates. The work management device 1 calculates the spatial coordinates based on the irradiation direction of the laser light (deflection angles θ and φ) and the distance R of the reflector (object). The spatial coordinates are coordinates that indicate the position of the reflector within the sensing range. Fig. 5 is a diagram that shows a schematic representation of the spatial coordinates.

[0029] 5, the work management device 1 detects the container 20, its fork pockets 201 and 202, and the forks F101 and F102. The surface marked with the symbol G is the road surface G. The work management device 1 detects the container 20 (at least a part of the insertion surface 211) and its fork pockets 201, 202 through a first detection process. In one example of the first detection process, for example, the work management device 1 detects a plane that is a flat or approximately flat surface (including surfaces with irregularities) and that stands perpendicular (vertical) or approximately perpendicular to the ground or floor surface. When the work management device 1 detects the fork pockets 201, 202 on this plane, it determines that this plane is the insertion surface 211 of the container 20. Here, the work management device 1 detects, for example, portions on the detected plane or below the plane where reflected laser light is not detected or portions where the reception level of reflected laser light is low as fork pockets 201, 202.

[0030] The work management device 1 may detect as the fork pockets 201, 202 a portion on the detected plane or below the plane where the distance to the plane is changed by a predetermined value or more (is farther away). Furthermore, the work management device 1 may detect the fork pockets 201, 202 from the detected plane using the sensing information and the pocket position information. Here, the pocket position information is information indicating a combination of the dimensions of the container 20 and the positions or dimensions (shapes) of the fork pockets 201, 202 in the container 20, or information indicating the pattern of this combination. In other words, the work management device 1 may determine that the fork pockets 201, 202 exist based on the pocket position information when, for example, a portion where the reception level of reflected laser light is low exists at a predetermined rate or more at the position where the fork pockets 201, 202 exist based on the pocket position information.

[0031] The work management device 1 detects the forks F101, F102 by a second detection process. In one example of the second detection process, the work management device 1 detects, as the forks F101, F102, a plane that is parallel or approximately parallel to the XY plane, extends a certain length or more in the Y axis direction, and has a width smaller than a certain width in the X axis direction. The work management device 1 may store the positions and shapes of the forks F101, F102 in advance.

[0032] <Determining deviation> FIG. 6 is a schematic diagram showing an example of deviation determination according to the present embodiment. Fig. 6 is a diagram showing a case where it is determined that the fork is not misaligned in the misalignment determination. Fig. 6 is a diagram showing the sensing information of Fig. 5 projected onto the XZ plane. In Fig. 6, the object (reflection source) detected by the work management device 1 is shown by a solid line.

[0033] 2, the work management device 1 detects the upper surfaces F1011, F1021 of the forks F101, F102, but may not be able to detect the lower surfaces or side surfaces of the forks F101, F102. In this case, for example, the work management device 1 stores predetermined thickness information and sets the thickness indicated by the thickness information as the thickness of the forks F101, F102 (length of the side surface; length in the Z-axis direction). The work management device 1 estimates that the forks F101, F102 exist in the thickness direction (Z-axis direction) by the thickness indicated by the thickness information from the detected upper surfaces F1011, F1021 of the forks F101, F102. Specifically, the work management device 1 estimates the shapes of the forks F101 and F102 as shown by the dashed lines in Fig. 6. However, the present invention is not limited to this, and the work management device 1 may detect the bottom and side surfaces of the forks F101 and F102 using another space recognition device.

[0034] 6, the forks F101 and F102 are located within the ranges of the fork pockets 201 and 202, respectively. At this time, when the forklift F1 moves forward straight in the Y-axis direction, the forks F101 and F102 can be inserted into the fork pockets 201 and 202, respectively, without hitting the container 20. As shown in FIG. 6, when the forks F101 and F102 are located within the ranges of the fork pockets 201 and 202, respectively, in the projection onto the XZ plane, the work management device 1 determines that the fork pockets 201 and 202 are not misaligned with the forks F101 and F102 (the forks are not misaligned).

[0035] The work management device 1 may determine that the forks are not misaligned if the gap (length of the gap in the X-axis direction or Z-axis direction) between the forks F101, F102 (surface; outer surface) and the fork pockets 201, 202 (surface; inner surface) in the projection onto the XZ plane is greater than a predetermined distance. In other words, the work management device 1 may determine that the forks are misaligned if the gap between the forks F101, F102 and the fork pockets 201, 202 in the projection onto the XZ plane is smaller than a predetermined distance. Furthermore, the work management device 1 may determine that the forks are not misaligned if the centers (intersections of diagonals) of the forks F101 and F102 are within a predetermined range from the centers (intersections of diagonals) of the fork pockets 201 and 202, respectively, in the projection onto the XZ plane, and may determine that the forks are misaligned if they are not within the predetermined range. The predetermined range may be the distance between two points, or the distance of the X component or the Z component.

[0036] FIG. 7 is a schematic diagram showing another example of deviation determination according to the present embodiment. Fig. 7 is a diagram showing a case where the fork is determined to be misaligned in the misalignment determination. Fig. 7 is a diagram showing the sensing information projected onto the XZ plane. In Fig. 7, the object (reflection source) detected by the work management device 1 is shown by a solid line.

[0037] 7, the forks F101 and F102 are located outside the ranges of the fork pockets 201 and 202, respectively. Specifically, the forks F101 and F102 are located above the fork pockets 201 and 202, respectively (positive direction of the Z axis). At this time, if the forklift F1 moves forward straight in the Y axis direction, the forks F101 and F102 will hit the container 20 (insertion surface 211) and will not be able to be inserted into the fork pockets 201 and 202.

[0038] As shown in FIG. 7, when the fork F101 is located outside the range of the fork pocket 201, or when the fork F102 is located outside the range of the fork pocket 202, in the projection onto the XZ plane, the work management device 1 determines that the forks are misaligned. Here, when the fork F101 or F102 is misaligned in the up-down direction (Z-axis direction) of the fork pocket 201 or 202, respectively, the work management device 1 may determine that the fork is misaligned in the "height direction" as the type of misalignment. Furthermore, the work management device 1 may determine that the fork is misaligned in the height direction by "d1" as the amount of misalignment. Furthermore, the work management device 1 may output information based on the type of misalignment or the amount of misalignment.

[0039] FIG. 8 is a schematic diagram showing another example of deviation determination according to the present embodiment. Fig. 8 is a diagram showing a case where the fork is determined to be misaligned in the misalignment determination. Fig. 8 is a diagram showing the sensing information projected onto the XZ plane. In Fig. 8, the object (reflection source) detected by the work management device 1 is shown by a solid line.

[0040] 8, the forks F101 and F102 are located outside the ranges of the fork pockets 201 and 202, respectively. Specifically, the forks F101 and F102 are located to the right of the fork pockets 201 and 202, respectively (the positive direction of the X-axis). At this time, if the forklift F1 moves forward straight in the Y-axis direction, the forks F101 and F102 will collide with the container 20 (insertion surface 211) and will not be able to be inserted into the fork pockets 201 and 202.

[0041] As shown in FIG. 8, when the fork F101 is positioned outside the range of the fork pocket 201 and when the fork F102 is positioned outside the range of the fork pocket 202 in the projection onto the XZ plane, the work management device 1 determines that the forks are misaligned. Here, when the fork F101 or F102 is misaligned in the left-right direction (X-axis direction) of the fork pocket 201 or 202, respectively, the work management device 1 may determine that the fork is misaligned in the "lateral direction" as the type of misalignment. Furthermore, the work management device 1 may determine that the fork is misaligned in the lateral direction by "d2" as the amount of misalignment. Furthermore, the work management device 1 may output information based on the type of misalignment or the amount of misalignment.

[0042] FIG. 9 is a schematic diagram showing another example of deviation determination according to the present embodiment. Fig. 9 is a diagram showing a case where the fork is determined to be misaligned in the misalignment determination. Fig. 9 is a diagram showing the sensing information projected onto the XZ plane. In Fig. 9, the object (reflection source) detected by the work management device 1 is shown by a solid line.

[0043] 9, one of the forks F101 and F102 is located outside the range of the fork pockets 201 and 202, respectively. Specifically, the fork F101 is located to the right of the fork pocket 201 (positive direction of the X-axis). At this time, if the forklift F1 moves forward straight in the Y-axis direction, the fork F101 will hit the container 20 (insertion surface 211) and will not be able to be inserted into the fork pocket 201. FIG. 9 shows that the spacing between the forks F101 and F102 does not match the spacing between the fork pockets 201, 202, and in the example of FIG. 9, the spacing between the forks F101 and F102 needs to be increased.

[0044] As shown in Figure 9, the work management device 1 determines that the forks are misaligned when either the fork F101 is located outside the range of the fork pocket 201 or the fork F102 is located outside the range of the fork pocket 202 in the projection onto the XZ plane. In this case, the work management device 1 may determine that the "width" of the fork is misaligned as the type of misalignment. Also, the work management device 1 may determine that the misalignment is by "d3" in the horizontal direction as the amount of misalignment. Also, the work management device 1 may output information based on the type of misalignment or the amount of misalignment.

[0045] FIG. 10 is a schematic diagram showing another example of deviation determination according to the present embodiment. Fig. 10 is a diagram showing a case where the fork is determined to be misaligned in the misalignment determination. Fig. 10 is a diagram showing the sensing information projected onto the XZ plane. In Fig. 10, the object (reflection source) detected by the work management device 1 is shown by a solid line. 10, the container 20 is provided with four fork pockets 201, 202, 203, and 204. In this case, the forklift F1 needs to insert and grasp the forks F101 and F102 into either the combination of fork pockets 201 and 202 that are line-symmetrical with respect to the center line (axis of symmetry Lc) of the container 20 in the left-right direction (X-axis direction; width direction of the container 20) or the combination of fork pockets 203 and 204.

[0046] In Fig. 10, the forks F101 and F102 are located within the ranges of fork pockets 201, 202, 203, and 204, respectively, which are not symmetrical with respect to the center line of the container 20 (also referred to as an "inappropriate pocket combination"). Specifically, the forks F101 and F102 are located within the ranges of fork pockets 202 and 204, respectively. At this time, when the forklift F1 moves forward straight in the Y-axis direction, the forks F101 and F102 can be inserted into the fork pockets 202 and 204. However, since the center of the container 20 is not located between the forks F101 and F102, the forklift F1 cannot hold the container 20 in a balanced manner.

[0047] As shown in FIG. 10, when the forks F101, F102 are located within the range of an inappropriate pocket combination in the projection onto the XZ plane, the work management device 1 determines that the forks are misaligned, that is, that they are misaligned from the appropriate pocket combination. In this case, the work management device 1 may determine, as the type of deviation, that the forks are deviated from the "appropriate pocket combination" or that the forks are in an "inappropriate pocket combination." The work management device 1 may select an appropriate pocket combination based on the number and order of the detected fork pockets. As an example, if the work management device 1 detects four fork pockets when the forklift has two prongs, it selects the combination of the second and third fork pockets or the combination of the first and fourth fork pockets in the X-axis direction as an appropriate pocket combination.

[0048] <Forklift operation> FIG. 11 is a flow chart showing an example of the operation of the forklift F1 according to this embodiment.

[0049] (Step S101) The forklift F1 starts the engine (ACC ON) by the operation of an operator, etc. Then, the process proceeds to step S102. (Step S102) The in-vehicle device such as the work management device 1 is started by receiving power or acquiring information indicating that the engine has been started. After that, the process proceeds to steps S103, S104, and S05.

[0050] (Step S103) The work management device 1 acquires sensing information representing the space using a space recognition sensor. Specifically, the work management device 1 irradiates a laser light and senses the distance to the object (sensor scanning). Then, the process proceeds to step S106. (Step S104) The work management device 1 acquires position information indicating the position of the forklift F1 (work management device 1). The position information is, for example, a positioning result of a GNSS (Global Navigation Satellite System). However, the position information may be a positioning result using other wireless communication (for example, a wireless LAN or an RFID tag). Then, proceed to step S106.

[0051] (Step S105) The work management device 1 acquires vehicle information indicating the state of the forklift F1 or the operation by the worker, etc. Then, the process proceeds to step S106. Here, the vehicle information is data that the forklift F1 can output, such as the speed of the forklift F1, steering angle, accelerator operation, brake operation, gear (forward, reverse, high speed, low speed, etc.), manufacturer, model, vehicle identification information, etc. The vehicle information may also include fork information indicating the positions (heights) of the forks F101 and F102, the presence or absence of a transport object being grasped and its weight, or the load condition of the lift chain, the type of the forks F101 and F102, etc., or work information indicating the identification information of the worker (driver), the identification information of the work site (warehouse or factory) or company, the identification information of the transport object grasped (transported) (for example, obtained by an RFID or the like attached to the transport object), etc.

[0052] (Step S106) The work management device 1 associates the sensing information acquired in step S103, the position information acquired in step S104, and the vehicle information acquired in step S105 (the associated data is also referred to as "associated data"). For example, the work management device 1 associates the sensing information, position information, and vehicle information with the device identification information of the work management device 1 and the acquisition date and time. Then, the process proceeds to step S107. (Step S107) The work management device 1 determines the presence or absence of a danger or event based on the association data associated in step S106. For example, the work management device 1 performs the above-mentioned deviation determination based on the association data. If it is determined that there is a danger or event (yes), the process proceeds to step S108. On the other hand, if it is determined that there is no danger or event (no), the process proceeds to step S109.

[0053] (Step S108) The work management device 1 outputs a warning (including guidance) based on the type of danger or event determined in step S107, or on the type and the association data, and then proceeds to step S109. (Step S109) The work management device 1 associates the association data, the determination information indicating the determination result of step S107, or the output information indicating the output result of the warning of step S108, and records the associated data in a recording device, etc. Then, the process proceeds to step S110. (Step S110) The work management device 1 transmits the data associated in step S109 to a server, etc. Then, the process proceeds to step S111. The server is an information processing device that comprehensively collects and manages data from multiple forklifts F1 in, for example, a workshop or a company. The data sent to the server is analyzed using a statistical processing function or a machine learning function. The data sent to the server or the analysis result data is used for driving training, etc. For example, driving data of a worker who is good at or efficient at loading transported objects is used as a model. On the other hand, if the transported object is damaged or dropped, the data from that time is used to identify the cause and make improvements.

[0054] (Step S111) If the engine of the forklift F1 is stopped by an operation by a worker or the like (yes), the process proceeds to step S112. On the other hand, if the engine of the forklift F1 is not stopped (no), the process proceeds to steps S103, S104, and S05. In other words, the work management device 1 acquires information by sensing or the like, associates, records, and transmits data until the engine is stopped. (Step S112) When the in-vehicle device such as the work management device 1 acquires information indicating that the power supply has been stopped or the engine has been stopped, the in-vehicle device stops or goes into a sleep state. After that, this operation ends.

[0055] <Configuration of the work management device> 12 is a schematic diagram showing the hardware configuration of the work management device 1 according to this embodiment. In this diagram, the work management device 1 includes a CPU (Central Processing Unit) 111, an IF (Interface) 112, a communication module 113, a sensor 114 (e.g., a spatial recognition sensor), a ROM (Read Only Memory) 121, a RAM (Random Access Memory) 122, and an HDD (Hard Disk Drive) 123. The IF 112 is, for example, an output device (lamp, speaker, touch panel display, etc.) provided in a part of the forklift F1 (driver's seat, vehicle body, mast F14, etc.) or the work management device 1. The communication module 113 transmits and receives signals via a communication antenna. The communication module 113 is, for example, a communication chip such as a GNSS receiver or wireless LAN. The sensor 114, for example, irradiates laser light and performs sensing based on the received reflected light.

[0056] 13 is a schematic diagram showing the hardware configuration of the work management device 1 according to this embodiment. In this diagram, the work management device 1 includes a sensor unit 101, a vehicle information acquisition unit 102, a GNSS receiving unit 103, an analysis unit 104, a control unit 105, an output unit 106, a recording unit 107, and a communication unit 108.

[0057] The sensor unit 101 is a space recognition sensor. The sensor unit 101 senses the distance R from the device itself to each object, for example, by laser light. The sensor unit 101 recognizes the space based on the irradiation direction (deflection angles θ, φ) of the laser light and the sensed distance R. Note that recognizing the space means generating three-dimensional coordinates for the space including surrounding objects, but the present invention is not limited to this, and may also mean generating two-dimensional coordinates. The sensor unit 101 generates sensing information (for example, coordinate information) and outputs it to the control unit 105.

[0058] The vehicle information acquisition unit 102 acquires vehicle information from the forklift F1, and outputs the acquired vehicle information to the control unit 105. The GNSS receiving unit 103 acquires location information and outputs the acquired location information to the control unit 105.

[0059] The analysis unit 104 acquires the sensing information output by the sensor unit 101, the vehicle information output by the vehicle information acquisition unit 102, and the location information output by the GNSS receiving unit from the control unit 105. The analysis unit 104 generates association data by associating the acquired sensing information, vehicle information, and location information. The analysis unit 104 analyzes the generated association data. For example, the analysis unit 104 detects the insertion surface 211 (container 20) by detecting the plane and the fork pockets 201 and 202 through a first detection process based on the sensing information. Also, the analysis unit 104 detects the forks F101 and F102 through a second detection process based on the sensing information.

[0060] The control unit 105 acquires the sensing information output by the sensor unit 101, the vehicle information output by the vehicle information acquisition unit 102, and the location information output by the GNSS receiving unit, analyzes them using, for example, the analysis unit 104, and makes a judgment based on the analysis results. For example, the control unit 105 determines whether or not there is a danger or an event. As one of the determinations, the control unit 105 performs the above-mentioned deviation determination. Specifically, the control unit 105 determines whether the forks are misaligned based on the positional relationship in the sensing information, that is, the positional relationship between the forks F101, F102 and the fork pockets 201, 202. For example, the control unit 105 determines whether the forks are misaligned by determining whether the forks F101, F102 are located within the ranges of the fork pockets 201, 202, respectively, when projected onto the XZ plane.

[0061] The control unit 105 causes the output unit 106 to output a warning (including guidance) based on the determination result or the determination result and the association data. The output unit 106 may output information based on the type of deviation or the amount of deviation. The control unit 105 records the determination information indicating the determination result and the association data in the recording unit 107, and transmits them to a server or the like via the communication unit .

[0062] 12. Similarly, the vehicle information acquisition unit 102 and the GNSS receiving unit 103 are realized by, for example, a communication module 113. The analysis unit 104 and the control unit 105 are realized by, for example, a CPU 111, a ROM 121, a RAM 122, or a HDD 123.

[0063] (Summary of this embodiment) As described above, in this embodiment, the work management device 1 is an on-board device mounted on a forklift F1 (cargo handling machine). In the work management device 1 (forklift F1), as shown in Fig. 14, the analysis unit 104 detects the container 20 (insertion target) into which the forks F101, F102 (insertion claws) are inserted based on sensing information acquired from a spatial recognition sensor (spatial recognition device). The control unit 105 performs a deviation judgment based on the sensing information to judge whether or not there is a deviation in the positional relationship between the openings (insertion parts) of the fork pockets 201, 202 and the forks F101, F102. This allows the work management device 1 to reliably insert the forks F101, F102 into the fork pockets 201, 202 and properly transport the transport object. For example, the forklift F1 can prevent the fork pockets 201, 202 from being damaged or destroyed. In addition, the forklift F1 can properly (well-balanced and stably) hold and transport the container 20 and prevent the container 20 from dropping. Furthermore, for example, the work management device 1 can reliably insert the forks F101, F102 into the fork pockets 201, 202 even for a container 20 that does not have a mark, and can appropriately transport the transport object. However, the work management device 1 may be used in combination with a mark, or may grip a container 20 that has a mark.

[0064] <Modification A1> In the above embodiment, the control unit 105 (the forklift F1 or the work management device 1) may perform a misalignment determination or a warning based on the misalignment determination (also referred to as a "misalignment determination, etc.") after determining that the forklift F1 is facing the insertion surface 211 having the openings of the fork pockets 201, 202 based on the sensing information (also referred to as a "facing determination"). For example, the control unit 105 may perform a misalignment determination, etc. after at least one facing determination, and may not perform a misalignment determination, etc. before at least one facing determination. This allows the work management device 1 to determine whether the forks are misaligned after the forklift F1 and the container 20 (insertion surface 211) are faced to each other in the correct orientation. In other words, the forklift F1 can insert the forks F101, F102 straight into the fork pockets 201, 202 without any misalignment.

[0065] Hereinafter, an example of a case where the work management device 1 performs a facing determination using sensing information will be described. However, the present invention is not limited to this, and the work management device 1 may perform other facing determinations (for example, facing determination using RFID or facing determination based on a captured image).

[0066] <Face detection> FIG. 15 is a schematic diagram showing an example of facing determination according to the present embodiment. Fig. 15(a) is a diagram showing a case where the forklift F1 faces the container 20. Fig. 15(a) is a diagram showing the sensing information in Fig. 5 projected onto the XY plane. Fig. 15(b) is a diagram showing a case where the forklift F1 is not facing the container 20. Fig. 15(b) is a diagram showing the sensing information in Fig. 6 projected onto the XY plane. 15(a) and (b), solid lines represent laser light, and for the sake of convenience, projections of the container 20, the forks F101 and F102, and the work management device 1 are depicted by dashed lines in FIG.

[0067] In FIG. 15(a), the work management device 1 is P1 ≦θ≦θ P1+m In FIG. 15(b), the work management apparatus 1 detects the plane 211 within the range where the deflection angle θ is −θ P2 ≦θ≦θ P2+n The plane 211 is detected within the range of θ i The i in θ represents the order in which the laser light is irradiated in one horizontal scan, that is, the number of irradiations. For example, i =-θ max +i×Δθ.

[0068] When the work management device 1 detects the fork pockets 201, 202 on the detected plane 211, it determines that the plane 211 is the insertion surface of the container 20 (insertion surface 211). The work management device 1 performs a facing determination to determine whether the forklift F1 is facing the insertion surface 211 (container 20) directly, based on the sensing information. For example, the work management device 1 performs the facing determination by determining whether the insertion surface 211 is parallel to the reference plane B1 (whether it is not inclined). Here, the reference plane B1 is a plane parallel to the XZ plane, and is a plane perpendicular to the traveling direction when the forklift F1 moves straight ahead. For example, the reference plane B1 is one of such planes that includes the work management device 1 (projection port).

[0069] As a specific example of the facing determination, the work management device 1 determines the distance R from the work management device 1 to the object (reflection source). i Based on this, the distance L from the reference plane B1 of the forklift F1 to the insertion surface 211 i (“Reference distance L i Here, the distance R i is the distance R detected in the i-th irradiation, and represents the distance R from the work management apparatus 1 to the object (reflection source). For example, the work management device 1 has an illumination direction of θ i , φ, the distance to the object R i When detected, the reference distance L i =R i cos|φ|×cos|θ i Here, φ represents the deflection angle φ when the i-th irradiation is performed.

[0070] The work management device 1 is a reference distance L i and the reference distance L j (i≠j) difference ΔL i,j =|L i -L j As an example, the operation management device 1 performs a facing determination based on the adjacent reference distance L i and the reference distance L i+1 Difference ΔL i+1,i =|L i+1-L i Based on |, a matching determination is made. In this case, the work management device 1 detects the difference ΔL on the insertion surface 211. i+1,i If all of these are within the threshold value T1, it is determined that the forklift F1 is facing the insertion surface 211 (container 20). On the other hand, the work management device 1 detects the difference ΔL on the insertion surface 211. i+1,i When at least one of these has a value greater than the threshold value T1, it is determined that the forklift F1 is not facing the insertion surface 211 (container 20).

[0071] In FIG. 15(a) (when completely facing each other), in the range of P1≦i≦P1+m, L i In this case, for example, in the range of P1≦i≦P1+m-1, the difference ΔL i+1,i =|L i+1 -L i |=0≦T1. In this case, the work management device 1 determines that the forklift F1 is facing the insertion surface 211 (container 20).

[0072] In FIG. 15(b), in the range of P2≦i≦P2+n, L i are different values, e.g., L i is a monotonically increasing function of i. In this case, for example, in the range of P1≦i≦P1+m-1, the difference ΔL i+1,i =|L i+1 -L i |>T1. In this case, the work management device 1 determines that the forklift F1 is not facing the insertion surface 211 (container 20).

[0073] <Modification A2> In the above embodiment, the control unit 105 (the forklift F1 or the work management device 1) may perform deviation determination, etc., based on the timing t (also referred to as "insertion timing t") when the forks F101, F102 are located at or near the openings of the fork pockets 201, 202. For example, the control unit 105 performs deviation determination, etc., a predetermined time t1 before the insertion timing t. This allows the work management device 1 to prevent outputting a warning even when the need for a warning is low. The insertion timing t is also the timing at which the forks F101, F102 start to be inserted into the container 20. The insertion timing t represents the time from the calculation point until the forks F101, F102 are positioned at the openings of the fork pockets 201, 202.

[0074] Specifically, the control unit 105 determines the distance d between the tip of the fork F101, F102 and the opening (or the insertion surface 211) of the fork pockets 201, 202. c Based on the vehicle speed of the vehicle information, the insertion timing t is predicted (also referred to as "insertion timing prediction"). The control unit 105 performs deviation determination, etc., a predetermined time t1 before the insertion timing t. From the viewpoint, the control unit 105 does not perform deviation determination, etc., until the predetermined time t1 before the insertion timing t.

[0075] 16A and 16B are schematic diagrams showing an example of insertion timing prediction according to a modified example of this embodiment. 16A and 16B are diagrams in which sensing information is projected onto the XY plane. In 16A and 16B, the distance d C1 , d C2 is the distance d c and the length f1 is the length of the forks F101 and F102 (length in the Y-axis direction). Fig. 16(b) is a diagram showing a case where the forklift F1 is closer to the container 20 than in Fig. 16(a). When the vehicle speed is the same, the insertion timing t (the time required to start insertion) is shorter in the case of Fig. 16(b) than in the case of Fig. 16(a).

[0076] For example, the control unit 105 subtracts the length f1 from the distance between the insertion surface 211 and the reference surface B1 to obtain the distance d c The control unit 105 calculates the reference distance L measured when the irradiation direction is the normal direction of the reference plane B1, that is, when θ=0, φ=0, as the distance between the insertion surface 211 and the reference plane B1. i , the distance d cThe control unit 105 may detect the length f1 or may store it in advance. The control unit 105 calculates the distance d c The control unit 105 calculates the insertion timing t by dividing by the vehicle speed. If the calculated insertion timing t is within a time t1 stored in advance, the control unit 105 performs deviation judgment, etc., and if it is greater than the time t1, the control unit 105 does not perform deviation judgment, etc.

[0077] <Modification A3> In the above embodiment, the control unit 105 (the forklift F1 or the work management device 1) may perform deviation determination and the like based on the relative positional relationship between the forks F101, F102 and the openings of the fork pockets 201, 202. This allows the work management device 1 to prevent a warning from being output even when the need for a warning is low.

[0078] Specifically, the control unit 105 performs a deviation determination or the like based on the positions of the tips of the forks F101 and F102 and the positions of the openings (or the insertion surfaces 211) of the fork pockets 201 and 202. For example, the control unit 105 determines the distance d c When the distance d becomes equal to or smaller than a predetermined distance d11 (for example, 1 m), the control unit 105 performs a shift determination. c is greater than a predetermined distance d11 (farther), no deviation determination or the like is performed.

[0079] The control unit 105 calculates, for example, a distance d from the midpoint between the tip of the fork F101 and the tip of the fork F102 to the insertion surface 211. c (see FIG. 16), but the present invention is not limited to this. cThe distance from either the tip of the fork F101 or the tip of the fork F102 to the insertion surface 211 may be used as the distance, or a value obtained by adding or subtracting a predetermined distance f11 to the tip of the fork F101 may be used. The distance to the insertion surface 211 is not limited to the normal direction of the insertion surface 211, but may be the normal direction of the reference plane B1, that is, the traveling direction of the forklift or the extending direction (axial direction) of the forks F101 and F102. The distance to the insertion surface 211 may also be the distance to the center line of the insertion surface 211 (the symmetry axis Lc in FIG. 10). In this case, the insertion surface 211 is located at the reference distance L i Alternatively, the sides of the insertion surface 211 may be detected by edge detection or the like to calculate the center line.

[0080] <Modification A4> In the above embodiment, the control unit 105 (the forklift F1 or the work management device 1) may change the warning based on the deviation determination based on the insertion timing t. For example, when the control unit 105 determines that the fork is out of place and the insertion timing t is greater than t2, the control unit 105 issues a warning with a less noticeable warning (small output, for example, a small sound or dim light, a sound or light that flashes for a short time or frequency, a sound or light that flashes at short intervals, etc.) compared to when the insertion timing t is equal to or less than t2. On the other hand, when the control unit 105 determines that the fork is out of place and the insertion timing t is equal to or less than t2, the control unit 105 issues a warning with a more noticeable warning (large output, for example, a large sound or bright light, a sound or light that flashes for a long time or frequency, a sound or light that flashes at short intervals, etc.) compared to when the insertion timing t is greater than t2.

[0081] <Modification A5> In the above embodiment, the control unit 105 (the forklift F1 or the work management device 1) may change the warning based on the deviation determination, based on the relative positional relationship between the forks F101, F102 and the openings of the fork pockets 201, 202. For example, when the control unit 105 determines that the fork is out of alignment, the control unit 105 cIf is greater than (farther from) the given distance d12, then the distance d c In comparison with the case where the distance is smaller (closer) than d12, a less noticeable warning (smaller output, for example, a small sound or dim light, a sound or light flashing for a short period of time or frequency, a sound or light flashing with wider intervals, etc.) is given. On the other hand, when the control unit 105 determines that the fork is out of alignment, the distance d c If is less than or equal to the predetermined distance d12 (close), then the distance d c When the distance is greater than (farther from) the predetermined distance d12, a more noticeable warning (larger output, for example, a loud sound or bright light, sound or light flashing for longer or more times, sound or light flashing with closer intervals, etc.) is issued.

[0082] <Modification B1: Conditions for output or deviation judgment> In the above embodiment, the control unit 105 (the forklift F1 or the work management device 1) may set a condition for whether or not to perform deviation determination. The control unit 105 issues a warning based on the deviation determination when the following first condition is satisfied, and may not issue a warning based on the deviation determination when the first condition is not satisfied. Moreover, the control unit 105 may perform deviation determination or sensing when the first condition is satisfied, and may not perform deviation determination or sensing when the first condition is not satisfied. Furthermore, the control unit 105 may change the warning based on the deviation determination or the interval between deviation determinations or sensing (hereinafter referred to as warnings, etc.) based on the first condition.

[0083] The first condition is, for example, as described above, a condition that the distance between the container 20 and the forklift F1 is smaller than a threshold value (they are close to each other). The first condition may be, for example, a condition based on position information or vehicle information. For example, the control unit 105 may issue a warning or the like when the forklift F1 enters a predetermined position (range) in a warehouse or the like, and may not issue a warning or the like in other positions. For example, the control unit 105 may give a warning or the like when the gear is in forward position, but not give a warning or the like in other positions.

[0084] For example, the control unit 105 may issue a warning or the like when the vehicle speed is slower than a threshold value, and may not issue a warning or the like otherwise. Conversely, the control unit 105 may issue a warning or the like when the vehicle speed is faster than a threshold value, and may not issue a warning or the like otherwise. For example, the control unit 105 may issue a warning or the like when the steering angle is smaller than a threshold value, but may not issue a warning or the like in other cases.

[0085] The first condition may be, for example, a condition based on fork information or work information. For example, the control unit 105 may issue a warning or the like when there is no object being held, and may not issue a warning or the like when there is an object being held. The control unit 105 may issue a warning or the like when the position (height) of the forks F101, F102 is lower than a threshold, and may not issue a warning or the like when the position (height) of the forks F101, F102 is higher than the threshold. For example, the control unit 105 may issue a warning or the like when a specific operator is operating the machine, but may not issue a warning or the like in other cases.

[0086] The first condition may be, for example, a condition that occurs when the forks F101 and F102 are inserted. For example, the control unit 105 may issue a warning or the like when the forks F101, F102 are inserted, and may not issue a warning or the like when the forks F101, F102 are removed. Also, the control unit 105 may issue a warning or the like when the gear is forward, and may not issue a warning or the like when the gear is reverse.

[0087] As shown in Fig. 2, when the work management device 1 is fixed to the center of the forklift F1 in the X-axis direction, the work management device 1 can be positioned at the center of the forks F101 and F102, or at the center of the fork pockets 201 and 202 when the forklift F1 attempts to properly grip the container 20. When the work management device 1 is fixed to the fork rail F11 or the backrest F13, the work management device 1 can more easily recognize the forks F101 and F102 compared to when the work management device 1 is fixed to the fork rail F12. In other words, since the work management device 1 and the forks F101 and F102 are separated in the height direction (X-axis direction), the work management device 1 can recognize more of the shapes of the forks F101 and F102 in the length direction (Y-axis direction) (see Figs. 3 and 5). Furthermore, when the work management device 1 is fixed to the fork rail F11 or F12, it becomes easier for the work management device 1 to recognize the fork pockets 201, 202 compared to when the work management device 1 is fixed to the backrest F13. In other words, because the work management device 1 and the fork pockets 201, 202 are closer in height, the work management device 1 can make the irradiation angle (angle in the height direction) of the laser light or the like on the fork pockets 201, 202 closer to horizontal (perpendicular to the insertion surface).

[0088] The determination of whether the forks F101 and F102 are facing each other may be a determination of whether the forks F101 and F102 are perpendicular to the container 20 or the insertion surface 211. The spatial recognition sensor may perform spatial recognition using something other than laser light. For example, the work management device 1 may perform spatial recognition using radio waves other than laser light, or may perform spatial recognition using captured images. For example, the spatial recognition sensor may be a monocular camera, a stereo camera, an infrared camera, a millimeter wave radar, an optical laser, LiDAR (Light Detection And Ranging, Laser Imaging Detection And Ranging), an (ultrasonic) sensor, or the like. Furthermore, the work management device 1 may output a warning or the like when the fork pockets 201, 202 are not positioned horizontally, that is, when they are misaligned vertically.

[0089] Furthermore, the work management device 1 may be connected to an automatic driving device or may be a part of the automatic driving device. In other words, the work management device 1 may perform deviation judgment and automatically drive the forklift F1 so that the forks do not deviate. For example, if the deviation judgment result indicates deviation in the "height direction", the work management device 1 raises and lowers the forks F101 and F102 to increase or decrease the height. For example, if the deviation judgment result indicates deviation in the "lateral direction", the work management device 1 adjusts the steering angle, gears, accelerator, and brakes to adjust the position of the forklift F1 so that it deviates in the lateral direction. Furthermore, the work management device 1 may exclude the road surface G, walls, and objects located at a position farther than a predetermined distance from the detection target (sensing information). When projecting onto each surface, the work management device 1 excludes these from the projection target.

[0090] The work management device 1 may use edge detection when detecting the container 20, the platform L1, and the forks F101 and F102. Here, the edge detected by edge detection is, for example, a point where the distance R or the rate of change thereof is large. As a specific example of edge detection, the work management device 1 may determine as an edge a portion of a detected object where partial differentials on each coordinate axis are equal to or greater than a threshold. Also, for example, the work management device 1 may determine as an edge a portion where detected planes intersect, a portion where the difference in distance R between adjacent or close points in opposite directions is equal to or greater than a threshold, a portion adjacent to a portion where reflected laser light is not detected, or a portion adjacent to a portion where the reception level of reflected laser light is low. The work management device 1 may perform edge detection using other methods.

[0091] [Note] (1) An in-vehicle device comprising: an analysis unit that detects the spatial coordinates of a plug and the spatial coordinates of an insertion portion into which the plug is inserted based on sensing information acquired from a spatial recognition device that senses the distance to an object; and a control unit that performs a deviation determination that determines whether or not there is a deviation in the positional relationship between the insertion portion and the plug based on the detected position and shape of the plug and the detected position and shape of the insertion portion. (2) The analysis unit detects the spatial coordinates of an insertion surface having an insertion portion based on the sensing information, and the control unit performs the misalignment determination or a warning based on the misalignment determination after determining that the detected insertion surface is facing in the correct orientation. (3) The in-vehicle device according to (1) or (2), wherein the control unit performs the misalignment determination or the warning based on the misalignment determination based on a timing at which the insertion claw is inserted into the insertion portion. (4) The in-vehicle device according to any one of (1) to (3), wherein the control unit performs the misalignment determination or the warning based on the misalignment determination based on a positional relationship between the insertion claw and the insertion portion. (5) The in-vehicle device according to any one of (1) to (4), wherein the control unit changes the warning based on the deviation determination based on a timing at which the insertion claw is inserted into the insertion portion. (6) The in-vehicle device according to any one of (1) to (5), wherein the control unit changes the warning based on the deviation determination based on a positional relationship between the insertion claw and the insertion portion. (7) A loading machine equipped with an on-board device according to any one of (1) to (6). (8) A control circuit that determines whether or not the positional relationship between the insertion part and the plug is misaligned based on the spatial coordinates of the plug detected based on sensing information acquired from a spatial recognition device that senses the distance to an object and the spatial coordinates of the insertion part into which the plug is inserted. (9) A control method comprising: an analysis process in which an analysis unit detects the spatial coordinates of the plug and the spatial coordinates of an insertion part into which the plug is inserted based on sensing information acquired from a spatial recognition device that senses the distance to an object; and a control process in which a control unit performs a deviation judgment to determine whether or not there is a deviation in the positional relationship between the insertion part and the plug based on the detected position and shape of the plug and the detected position and shape of the insertion part. (10) A program for causing a computer to execute an analysis means for detecting the spatial coordinates of the plug and the spatial coordinates of the plug portion into which the plug is inserted based on sensing information acquired from a spatial recognition device that senses the distance to an object, and a control means for performing a deviation judgment for determining whether or not there is any deviation in the positional relationship between the plug portion and the plug based on the detected position and shape of the plug and the detected position and shape of the plug.

[0092] The above-mentioned work management device 1 may perform the above-mentioned processes by recording a program for realizing each function in a computer-readable recording medium, and reading and executing the program recorded in the recording medium into a computer system. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. The term "computer system" also includes a WWW system equipped with a homepage providing environment (or display environment). The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" also refers to storage devices that hold a program for a certain period of time, such as volatile memory (RAM) inside a computer system that becomes a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line.

[0093] The above program may also be transmitted from a computer system in which the program is stored in a storage device or the like to another computer system via a transmission medium, or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The above program may also be for realizing part of the above-mentioned functions. Furthermore, it may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system. [Explanation of symbols]

[0094] F1...Forklift, F101, F102...Fork, F11, F12...Fork rail, F13...Backrest, F14...Mast, 20...Container, 201, 202...Fork pocket, 211...Insertion surface, 1...Work management device, 111...CPU, 112...IF, 113...Communication module, 114...Sensor, 121...ROM, 122...RAM, 123...HDD, 101...Sensor unit, 102...Vehicle information acquisition unit, 103...GNSS receiving unit, 104...Analysis unit, 105...Control unit, 106...Output unit, 107...Recording unit, 108...Communication unit

Claims

1. The robot is equipped with a spatial recognition sensor that senses the distance to an object by horizontally scanning electromagnetic waves, and a plug-in claw for grasping the object to be transported. A means for causing the spatial recognition sensor to perform a first operation of increasing or decreasing the height of the horizontal scan on the object; A means for detecting spatial coordinates representing a position and a shape of an insertion portion of the transport object into which the insertion claw is inserted, based on a distance to the object acquired by the first operation of the spatial recognition sensor; a second operation for increasing or decreasing the height of the insertion claws based on the detected spatial coordinates of the insertion portion, the second operation being performed at a timing different from that of the first operation; a means for gripping the object to be transported by inserting the insertion claw, the height of which has been increased or decreased by the second operation, into an insertion portion of the object to be transported; A loading machine equipped with

2. The spatial recognition sensor is at least one of a millimeter wave radar, an optical laser, and a LiDAR. A cargo handling machine according to claim 1.

3. The spatial recognition sensor is attached to the cargo handling machine at a position where the height of the horizontal scanning on the object can be increased or decreased independently of the operation of the insertion claw. A cargo handling machine according to claim 1 or 2.

4. determining a positional deviation between the insertion portion and the insertion claw based on the detected spatial coordinates of the insertion portion, and moving a position of the machine body when it is determined that the insertion claw is laterally deviated; A cargo handling machine according to any one of claims 1 to 3.

5. determining a positional deviation between the insertion portion and the insertion claw based on the detected spatial coordinates of the insertion portion, and increasing or decreasing a height of the insertion claw when it is determined that the insertion claw is vertically deviated; A loading machine according to claim 4.

6. The device is mounted on a cargo handling machine equipped with a spatial recognition sensor that senses the distance to an object by horizontally scanning electromagnetic waves and a plug-in claw for grasping the object to be transported, A means for causing the spatial recognition sensor to perform a first operation of increasing or decreasing the height of the horizontal scan on the object; A means for detecting spatial coordinates representing a position and a shape of an insertion portion of the transport object into which the insertion claw is inserted, based on a distance to the object acquired by the first operation of the spatial recognition sensor; a second operation for increasing or decreasing the height of the insertion claws based on the detected spatial coordinates of the insertion portion, the second operation being performed at a timing different from that of the first operation; a means for gripping the object to be transported by inserting the insertion claw, the height of which has been increased or decreased by the second operation, into an insertion portion of the object to be transported; An in-vehicle device comprising:

7. A cargo handling machine equipped with a spatial recognition sensor that senses the distance to an object by horizontally scanning electromagnetic waves and a plug-in claw for grasping an object to be transported, causing the spatial recognition sensor to perform a first operation of raising or lowering the height of the horizontal scan on the object; Detecting spatial coordinates representing a position and a shape of an insertion portion of the transport object into which the insertion claw is inserted based on a distance to the object acquired by the first operation of the spatial recognition sensor; a second operation for increasing or decreasing the height of the insertion claw based on the detected spatial coordinates of the insertion portion is performed at a timing different from that of the first operation; A method for grasping the object to be transported by inserting the insertion claw, the height of which has been increased or decreased by the second action, into the insertion portion of the object to be transported.

8. A computer controls a cargo handling machine equipped with a spatial recognition sensor that senses the distance to an object by horizontally scanning electromagnetic waves and a plug-in claw for gripping an object to be transported. A process of causing the spatial recognition sensor to perform a first operation of increasing or decreasing the height of the horizontal scan on the object; A process of detecting spatial coordinates representing a position and a shape of an insertion portion of the transport object into which the insertion claw is inserted, based on a distance to the object acquired by the first operation of the spatial recognition sensor; A process of performing a second operation of increasing or decreasing the height of the insertion claws based on the detected spatial coordinates of the insertion portion at a timing different from that of the first operation; A process of gripping the object to be transported by inserting the insertion claw, the height of which has been increased or decreased by the second operation, into the insertion portion of the object to be transported; A program that executes the following.

Citation Information

Patent Citations

  • Fork-lift truck

    EP3000771A1

  • Designated material carry-out method by unmanned forklift, truck and unmanned forklift truck used therefor

    JP1996301596A

  • Container loading device

    JP2000335896A

  • Cargo handling work support device in industrial vehicle and industrial vehicle

    JP2003128395A

  • Movable sensor device on load-bearing means of forklift

    JP2006528122A