Load management method and load management device

Abstract

To provide a load amount management method and a load amount management device capable of reliably grasping a load amount of each truck.SOLUTION: A load amount management method includes the steps of: acquiring a loading image Im0 obtained by imaging a loading section 94 of the truck 92 by using cameras 2 installed respectively at the side and rear of a loading / unloading area 93 of a truck 92 at a loading / unloading base 91 for a cargo 90; and calculating a current load amount 97 which includes the amount of cargoes 90 actually loaded in the loading section 94, the amount of pallets 95 actually loaded in the loading section 94, and the amount of load gaps 96 that includes a gap between the cargoes 90, a gap between the pallets 95 and a gap between the cargo 90 and the pallet 95 on the basis of the loading image Im0.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technique for grasping the amount of cargo actually loaded on the loading part of a truck.

Background Art

[0002] Trucks for collecting and delivering various goods are provided with a loading part for loading the goods. When collecting or delivering goods, if an appropriate amount of goods is not loaded on the loading part of the truck and the empty space of the loading part is larger than necessary, there will be a problem that the number of truck trips required for collecting or delivering the goods will be more than actually necessary.

[0003] In this case, the number of trucks required and the fuel cost of the trucks increase, and the number of drivers required also increases. As a result, not only problems occur from the viewpoints of cost and personnel procurement, but also problems occur in that the CO 2 emission increases.

[0004] As a method for solving the above problems, conventionally, a load management method has been adopted in which the empty space in the loading part of each truck loaded with goods is calculated and the result is fed back to manage the route, trips, and load amount of each trip for collecting and delivering the goods.

[0005] As the above-described conventional load management method, specifically, a method is known in which an operator visually confirms the amount of goods, i.e., the load amount, in the loading part of a truck, and calculates the empty space of the loading part based on the visually confirmed load amount. Based on the empty space of the loading part calculated here, the amount of goods that can be further loaded on the truck can be calculated. In this specification, if necessary, the above value, i.e., the amount of goods that can be further loaded on a truck loaded with goods, is referred to as the additional loadable amount.

[0006] According to the above-described method for calculating the additional load capacity, due to the variation in the proficiency level of each operator, there is a significant variation in the additional load capacity for each operator. Further, according to the method for calculating the additional load capacity, there may be a large difference between the calculated additional load capacity (apparent additional load capacity) and the actual additional load capacity (true additional load capacity). Therefore, conventionally, it has been difficult to sufficiently increase the loading rate of the truck and efficiently carry the goods.

[0007] Here, in order to sufficiently increase the loading rate of the truck and efficiently carry the goods, it is necessary to reduce the difference between the apparent additional load capacity and the true additional load capacity. The difference between the apparent additional load capacity and the true additional load capacity is greatly related to the variation in the proficiency level of each operator who visually checks the load. Therefore, if the involvement of the operator in load management is reduced, there is a possibility of reducing the above difference.

[0008] As one method for reducing the involvement of the operator in load management, there can be mentioned a method of imaging the loading part of the truck and calculating the load and free space of the loading part based on the obtained loading image. Patent Document 1 and Patent Document 2 introduce a technique for imaging the loading part of a truck.

Prior Art Documents

Patent Documents

[0009]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0010] Patent Document 1 introduces a technique of imaging the loading part with a camera installed on the wing of a truck and calculating the load loaded on the loading part based on the obtained loading image. In the technology of Patent Document 1, the obtained load amount is communicated from the truck to an external device in an office or the like. Patent Document 1 explains that, by this means, since the load amount actually loaded on the truck can be grasped, especially when the number of packages is large and the number of trips is also large, the transportation of packages can be efficiently carried out.

[0011] In addition, Patent Document 2 introduces a technology for imaging a truck and a container, that is, the loading part of the truck, with a camera. In the technology of Patent Document 2, based on schedule data showing the combination of the truck and the container and the image captured by the above camera, the correctness of the combination of the truck and the container is determined. Patent Document 2 explains that, by this means, accurate transportation of packages can be achieved.

[0012] If the loading part is imaged using a camera as in the technologies introduced in Patent Document 1 and Patent Document 2 described above, unlike the case where an operator visually checks the load amount, it is possible to reduce the problems caused by the variation in the proficiency level of each operator, and ultimately, it is possible to reduce the difference between the apparent additional loadable amount and the true additional loadable amount.

[0013] However, in reality, simply imaging the loading part using a camera alone was not able to sufficiently reduce the difference between the apparent additional loadable amount and the true additional loadable amount. That is, with only the conventional technologies introduced in Patent Document 1 and Patent Document 2 described above, it was still difficult to improve the loading rate of the truck and efficiently carry out the transportation of packages.

[0014] Therefore, in order to improve the loading rate of the truck and efficiently carry out the transportation of packages, a technology that can reliably grasp the load amount of each truck is desired.

[0015] The present invention has been made in view of the above circumstances, and an object to be solved is to provide a load amount management method and a load amount management device that can reliably grasp the load amount of each truck.

Means for Solving the Problems

[0016] The load quantity management method of the present invention for solving the above problems is using cameras respectively installed on the side and rear of the loading and unloading area of the truck at the loading and unloading base of the goods to obtain a loading image of the loading part of the truck, Based on the loading image, calculating the current load quantity including the quantity of goods actually loaded on the loading part, the quantity of pallets actually loaded on the loading part, the gaps between the goods, the gaps between the pallets, and the quantity of load gaps including the gaps between the goods and the pallets. This is a load quantity management method.

[0017] The load quantity management device of the present invention for solving the above problems is a camera respectively installed on the side and rear of the loading and unloading area of the truck at the loading and unloading base of the goods to obtain a loading image of the loading part of the truck, and a load quantity management element that calculates the current load quantity including the quantity of goods actually loaded on the loading part, the quantity of pallets actually loaded on the loading part, the gaps between the goods, the gaps between the pallets, and the quantity of load gaps including the gaps between the goods and the pallets based on the loading image. This is a load quantity management device.

Effect of the Invention

[0018] According to the load quantity management method of the present invention and the load quantity management device of the present invention, it is possible to accurately grasp the load quantity of each truck.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Mode for Carrying Out the Invention

[0020] Hereinafter, the load management method and load management device of the present invention will be described with specific examples.

[0021] Hereinafter, unless otherwise specified, the numerical range "x to y" described in this specification includes the lower limit x and the upper limit y in the range. And by arbitrarily combining these upper limit values, lower limit values, and the numerical values listed in the embodiments, a numerical range can be constituted. Furthermore, a numerical value arbitrarily selected from within the numerical range can be used as the numerical value of the upper limit and the lower limit.

[0022] As described above, simply using a camera to image the loading section, like the technology introduced in Patent Document 1 and the conventional technology introduced in Patent Document 2, could not sufficiently reduce the difference between the apparent additional load capacity and the true additional load capacity.

[0023] The inventor of the present invention considered that the above problem is closely related to the positional relationship between the loading section and the camera.

[0024] At the time of delivery, in order for the operator to load the goods for the customer who is the delivery destination onto the loading section of the truck, the amount of goods in the loading section rapidly increases over time after the wings of the truck are opened. On the other hand, at the time of cargo collection, in order for the operator to unload the goods collected from the production base, suppliers, etc. from the loading section, the amount of goods in the loading section rapidly decreases over time after the wings of the truck are opened. In other words, the amount of goods in the loading section changes at a relatively high speed both at the time of cargo collection and at the time of delivery.

[0025] Therefore, in order to accurately calculate the load amount and the additional load capacity based on the loading image captured by the camera, it is necessary not only to obtain a loading image that captures the entire loading section without any gaps, but also to obtain the maximum value of the changing load amount at the time of cargo collection and at the time of delivery. In order to obtain the maximum value of the load amount, it is necessary to quickly obtain a loading image immediately after the wings of the truck are opened at the time of cargo collection and immediately before the wings of the truck are closed at the time of delivery.

[0026] For example, when imaging the loading section with a camera installed on the wing of a truck as in Patent Document 1, there are often blind spots in the loading section, and it is difficult to say that a loading image that captures the entire loading section without any gaps can be obtained. If the loading image is not accurate, the load amount and the additional load capacity cannot be accurately calculated.

[0027] Also, as in Patent Document 2, when installing a camera outside a vehicle or outside a container, simply installing the camera at a high position, on a building, or on a flying object such as a drone alone cannot quickly obtain a loading image that captures the entire loading area without omission. Therefore, even in this case, it cannot be said that the load amount and the additional loadable amount can be accurately calculated.

[0028] In contrast, in the load management method of the present invention, first, (1) Using cameras respectively installed on the side and rear of the loading and unloading area of the truck at the loading and unloading base of the goods, a loading image of the loading part of the truck is acquired.

[0029] Here, the loading and unloading base means a base for loading or unloading goods on a truck. Specifically, examples of the loading and unloading base include, but are not limited to, a production base, a logistics center, a customer warehouse, etc.

[0030] Also, the loading and unloading area of the truck means an area for parking the truck in order to load goods on the truck or unload the goods loaded on the truck at the loading and unloading base of the goods. The loading and unloading area may also be referred to as a truck station.

[0031] The loading part displayed in the loading image obtained in the above step (1) can be said to be imaged from the side and rear of the truck.

[0032] In order to image the loading part without omission and obtain the image information of the goods loaded on the loading part without missing any, it is considered preferable to install a camera on the side of the loading and unloading area and image the loading part from the side. In order to image the entire loading part from the side of the loading part, it is necessary to install a camera at a position away from the loading part or to use a high-performance camera equipped with an ultra-wide-angle lens.

[0033] General loading and unloading bases are provided with a number of loading and unloading areas, and adjacent loading and unloading areas are close to each other. Therefore, it is difficult to say that it is suitable to install a camera on the side of the loading part and at a position far from the loading part. Or, even if a camera can be installed at that position, it is highly likely that not only the target truck but also the trucks adjacent to it will be captured in the image of the camera. Therefore, it is difficult to say that it is suitable to install a camera on the side of the loading part and at a position far from the loading part. On the other hand, since high-function cameras equipped with ultra-wide-angle lenses are expensive, there is a problem that it is difficult to say that they are suitable in terms of cost.

[0034] In contrast, in the load management method of the present invention, in order to image the loading part from the side and the rear, a camera with an overly large angle of view like the above-mentioned ultra-wide-angle lens is not required, and even if the camera is installed relatively close to the loading part, the loading part can be imaged without any gaps. For this reason, there is an advantage that the problem of other trucks being captured in the image captured by the camera can be suppressed, and a high-function camera is not required.

[0035] Also, when imaging the loading part from an oblique position, the image information about the area of the loading part that is far from the camera tends to be less than the image information about the area of the loading part that is close to the camera. However, by imaging the loading part from the rear instead of the front, the influence of the cab part in the truck can be excluded and the loading part can be imaged from as close a position as possible, and it becomes possible to obtain sufficient image information about the area of the loading part that is far from the camera.

[0036] Furthermore, by setting the installation position of the camera to the side and the rear of the loading part and setting the imaging direction of the camera to the direction from the installation position towards the loading part, as long as the imaging target is a truck that fits within the camera's angle of view and the loading and unloading area, it is possible to image the entire loading part without any gaps while keeping the position of the camera with respect to the loading and unloading area fixed at a predetermined position. Thus, according to the load management method of the present invention, it becomes possible to quickly acquire a loading image that images the entire loading part without any gaps.

[0037] Also, in the load quantity management method of the present invention, after obtaining the loading image in the above (1), (2) Based on the loading image, a step of calculating the current load quantity including the quantity of the goods actually loaded on the loading part, the quantity of the pallets actually loaded on the loading part, the gaps between the goods, the gaps between the pallets, and the quantity of the load gaps including the gaps between the goods and the pallets is performed. The current load quantity includes not only the quantity of the goods but also the quantity of the pallets actually loaded on the loading part and the quantity of the above load gaps. Therefore, it is possible that the current load quantity coincides with or is very close to the space actually used at the imaging time in the loading part.

[0038] Here, the quantity of the goods actually loaded on the loading part means the quantity of the goods themselves when the goods are unpacked, and means the quantity of the goods including the packaging material when the goods are packed with the packaging material. That is, in this specification, both the packed goods and the unpacked goods are treated as goods in the same way.

[0039] Also, as described above, the load gap means a gap including the gaps between the goods, the gaps between the pallets, and the gaps between the goods and the pallets, but may also include other gaps in the loading part. Examples of the other gaps include the gaps between the outer edge of the loading part and the goods, and the gaps between the outer edge and the pallets.

[0040] Here, the outer edge of the loading part means a boundary that actually or virtually separates the inside and the outside of the loading part. The outer edge of the loading part may be, for example, a frame actually provided on the truck or the like, or a virtual frame or the like connecting the ends of the loading part in the truck. The loading part can be said to include the outer edge and be a space surrounded by the outer edge.

[0041] As described above, the current load obtained in (2) substantially coincides with the space actually used at the time of imaging in the loading section. Therefore, the load management method of the present invention can obtain the current load as accurately as possible. And the additional load capacity calculated based on the current load obtained by the load management method of the present invention is an amount that substantially coincides with the load capacity that can actually be added to the loading section, that is, the true additional load capacity. Therefore, according to the load management method of the present invention, it can be said that the difference between the apparent additional load capacity and the true additional load capacity described above can be reduced.

[0042] The load management method of the present invention, after obtaining the current load in the above (2), further (3) may include a step of calculating an additional load capacity that can be added to the loading section based on the current load.

[0043] The additional load capacity calculated based on the current load obtained in (2) as described above substantially coincides with the true additional load capacity. Therefore, it can also be said that the difference between the apparent additional load capacity and the true additional load capacity described above can be reduced by the load management method of the present invention including the above step (3). Note that the step (3) may be performed continuously with the steps (1) and (2), or may be performed separately from these. That is, in the load management method of the present invention, the step (3) may be performed each time the steps (1) and (2) are performed to calculate the additional load capacity. Or, usually, only the steps (1) and (2) are performed, and the step (3) may be performed as necessary.

[0044] The load management device of the present invention is a device for performing load management using the above-described load management method of the present invention. The load management device of the present invention includes a camera and a load management element. Among these, the camera is an element for performing the step (1) in the load management method of the present invention, and includes the following constituent elements (1-1). (1-1) Cameras that are respectively installed on the side and rear of the loading and unloading area of the truck at the loading and unloading base of the goods, and acquire a loading image of the loading section of the truck.

[0045] One load quantity management element is an element for performing step (2) in the load quantity management method of the present invention, and includes the following components (1-4). (1-4) A load quantity management element that calculates the current load quantity including the quantity of goods actually loaded on the loading part, the quantity of pallets actually loaded on the loading part, the gaps between the goods, the gaps between the pallets, and the quantity of load gaps including the gaps between the goods and the pallets, based on the loading image.

[0046] Since the load quantity management device of the present invention is a device for performing load quantity management using the above-described load quantity management method of the present invention, similar to the load quantity management method of the present invention, it has the advantage of being able to reduce the difference between the apparent additional loadable quantity and the true additional loadable quantity.

[0047] Note that the management element in the load quantity management device of the present invention can further perform the step of calculating the additional loadable quantity based on the current load quantity obtained in the above step (3), that is, the above step (1).

[0048] Hereinafter, the load quantity management method and the load quantity management device of the present invention will be described for each component.

[0049] The load quantity management method of the present invention includes the above steps (1) to (3).

[0050] Among these, in step (1), a loading image of the loading part of the truck is acquired using cameras respectively installed on the side and rear of the loading and unloading area of the truck at the loading and unloading base.

[0051] In addition, the loading part of the truck refers to the part of the truck where goods are loaded, and can also be referred to as the cargo compartment of the truck.

[0052] The camera used in step (1) in the load quantity management method of the present invention, that is, the camera in the load quantity management device of the present invention, is installed at least one for one loading and unloading area. In other words, at least one camera is installed for one truck that performs loading and unloading of goods in the one loading and unloading area.

[0053] The camera is installed on the side and rear of the loading and unloading area and images the loading part of the truck. In other words, the camera faces in a direction capable of imaging the loading part of the truck.

[0054] There is no particular limitation on the number of cameras, and in some cases, two or more cameras may be installed for one loading and unloading area. In this case, at least one camera is installed on the side and rear of the loading and unloading area, and it is sufficient to image the loading part of the truck from this position. There are no particular restrictions on the installation positions of the other cameras or the imaging targets.

[0055] However, when cameras are installed on both sides of the truck, that is, when one camera is installed on one side and the rear of the loading and unloading area, and the other camera is installed on the other side and the rear of the loading and unloading area, the loading part of the truck can be imaged from both sides, and the current load amount closer to the actual load amount can be obtained.

[0056] That is, the loading part of the truck has depth in the direction facing both sides, that is, in the vehicle width direction. Therefore, there may be a large difference between the amount of goods loaded on one side of the loading part and the amount of goods loaded on the other side. In such a case, instead of only based on the loading image from one side, by calculating the current load amount considering the loading image from one side and the loading image from the other side, a current load amount closer to the actual load amount can be obtained. As a result, there is an advantage that the difference between the apparent additional loadable amount and the true additional loadable amount can be further reduced.

[0057] The position of the camera is on the side and rear of the loading and unloading area, and further, it is sufficient if it is a position capable of imaging the entire loading part. It may be set at an appropriate position according to the angle of view of the camera used and the installation height of the camera, etc. Considering quickly obtaining a loading image that images the entire loading part, it is preferable that the camera is fixed in position with respect to the loading and unloading area, and it is particularly preferable that it is fixed to the facilities at the loading and unloading base.

[0058] Here, in this specification, the rear of the loading and unloading area means the rear in the traveling direction of the truck parked in the loading and unloading area. Also, the side of the loading and unloading area means the direction orthogonal to the traveling direction of the truck, in other words, the vehicle width direction. It is assumed that the direction of the truck parked in the loading and unloading area is determined in a predetermined one direction in advance.

[0059] The performance required for the camera is determined according to the position of the camera with respect to the loading and unloading area. As the camera, one that satisfies the required performance may be selected.

[0060] For example, the minimum value of the angle of view required for the camera can be calculated according to the positional relationship between the camera and the loading part of the truck.

[0061] Specifically, the minimum value (θH) of the angle of view in the horizontal direction may be calculated based on the following formulas [1] to [3]. θH1 = tan -1 ×h3 / h1 ……… [1] θH2 = tan -1 ×h1 / h2 ……… [2] θH = 90 - θH1 - θH2 ……… [3]

[0062] Note that h1 means the horizontal distance between the front end and side end BE of the loading part shown in FIG. 10 or the front end and side end FE of the loading part, and the camera 2. The camera 2 shown in FIG. 10 and FIG. 11 described later specifically means the center point of the lens of the camera. h2 means the horizontal distance between the above FE and the above camera 2. h3 means the horizontal distance between the above BE and the above camera 2.

[0063] Also, the minimum value (θV) of the angle of view in the vertical direction may be calculated based on the following formulas [4] to [6]. θV1 = tan -1 ×v3 / v1 ……… [4] θV2 = tan -1×v1 / v2………〔5〕 θV = 90 - θV1 - θV2………〔6〕

[0064] Note that v1 means the horizontal distance between the lower end and side end LE of the loading part shown in FIG. 11 or the upper end and side end UE of the loading part, and the camera 2. v2 means the vertical distance between the LE and the camera 2. v3 means the vertical distance between the UE and the camera 2.

[0065] In the load management method and load management device of the present invention, as the camera, it is preferable to select one that satisfies both the minimum value (θH) of the viewing angle in the horizontal direction and the minimum value (θV) of the viewing angle in the vertical direction. In other words, as the camera, it is preferable to select one whose viewing angle is equal to or greater than the minimum value (θH) in the horizontal direction and equal to or greater than the minimum value (θV) in the vertical direction.

[0066] Furthermore, in other words, the load management method of the present invention may include a step (0) of selecting a camera as a pre-step of the process and a step (01). (0) A step of calculating the minimum value (θH) of the viewing angle in the horizontal direction based on the above formulas 〔1〕~〔3〕, and calculating the minimum value (θV) of the viewing angle in the vertical direction based on the above formulas 〔4〕~〔6〕, (01) A step of selecting, as the camera, one whose viewing angle is equal to or greater than the minimum value (θH) in the horizontal direction and equal to or greater than the minimum value (θV) in the vertical direction. Note that the steps (0) and (01) only need to be performed only when the camera is installed or replaced.

[0067] By the way, since the camera is installed on the side and rear of the loading and unloading area, it is also on the side and rear with respect to the loading part. When the camera and the loading part are in such a relationship, the image captured by the camera is more likely to be distorted in the front-rear direction than in the up-down direction. Therefore, as the camera, it is more preferable to select one whose viewing angle in the horizontal direction exceeds the minimum value (θH).

[0068] Specifically, as for the camera in the load quantity management method and the load quantity management device of the present invention, it is preferable to select one having a horizontal angle of view larger than the above minimum value θH by 10% or more. Also in this case, the vertical angle of view may be equal to or greater than the above minimum value θV.

[0069] Considering the above preferred embodiment, it can be said that it is more preferable that the load quantity management method of the present invention includes a step (0) of selecting a camera as a pre-step of step (1) and a step (02). (0) A step of calculating the minimum value (θH) of the horizontal angle of view based on the above formulas [1] to [3], and calculating the minimum value (θV) of the vertical angle of view based on the above formulas [4] to [6], (02) A step of selecting, as a camera, one having an angle of view larger than the minimum value (θH) by 10% or more in the horizontal direction and equal to or greater than the minimum value (θV) in the vertical direction. Also in this case, it suffices to perform the steps (0) and (02) only when the camera is installed or replaced.

[0070] In step (1) of the load quantity management method of the present invention, a loaded image obtained by imaging the loading part of the truck is acquired using the above-described camera. The loaded image may be a still image or a still image obtained from a moving image. In other words, the camera may be one capable of imaging only still images or one capable of imaging moving images.

[0071] The camera may acquire at least one loaded image for the loading part of each truck in the loading and unloading area, but it is preferable to image a plurality of loaded images over time. As described above, the amount of goods in the loading part changes at a relatively high speed both during collection and delivery. However, by acquiring a plurality of loaded images imaged over time, there is an advantage that the change in the load quantity during collection and delivery can be accurately followed, and the maximum value of the load quantity can be obtained with high reliability.

[0072] The amount of cargo in the loading section is the largest immediately after the start of unloading in the consolidation shipment, specifically, immediately after the truck's wing is opened, and the largest immediately before the completion of loading in the delivery shipment, specifically, immediately before the truck's wing is closed. Therefore, it is preferable that the plurality of loading images described above include a loading image immediately after the completion of the opening operation of the truck's wing in the consolidation shipment. Specifically, it is particularly preferable to include a loading image within 180 seconds, 120 seconds, 60 seconds, or 30 seconds after the completion of the opening operation of the truck's wing. Also, in the delivery shipment, it is preferable that the loading image includes an image immediately before the start of the closing operation of the truck's wing. Specifically, it is particularly preferable to include an image within 180 seconds, 120 seconds, 60 seconds, or 30 seconds before the start of the closing operation of the truck's wing.

[0073] In the cargo quantity management method of the present invention, the loading image obtained in the above step (1) is used to calculate the current cargo quantity in step (2). The loading image may further be used to calculate the additional loadable quantity in step (3). The cargo quantity management device of the present invention includes a cargo quantity management element for performing the above step (2) and, if necessary, step (3). Specifically, the cargo quantity management element is connected to the camera by wire or wirelessly and acquires the loading image acquired and transmitted by the camera. Then, the loading image is analyzed to calculate the current cargo quantity and, if necessary, the additional loadable quantity.

[0074] The cargo quantity management element may have such a function, and its structure and configuration are not particularly limited. Examples of the cargo quantity management element include a computer equipped with an arithmetic and control device such as a CPU and a storage device such as a memory or a hard disk.

[0075] In the load management method and load management device of the present invention, a loading image corresponding to each truck in each loading and unloading area is transmitted to the same load management element to calculate each current load, and an additional load capacity may be calculated as needed. Alternatively, a loading image corresponding to each truck in each loading and unloading area may be transmitted to different load management elements to calculate each current load, and an additional load capacity may be calculated as needed.

[0076] Note that each current load and additional load capacity calculated based on each loading image are information useful for load management. Therefore, in any case, each current load and additional load capacity are finally aggregated and processed. For this reason, it can be said that each camera and load management element are connected by wire or wirelessly to form a network.

[0077] In other words, it can be said that the load management device of the present invention includes a network in which each camera and load management element are connected by wire or wirelessly. And even when calculating the current load by processing the loading image corresponding to each truck with different load management elements and calculating the additional load capacity as needed, each load management element forms a network and functions as one load management element.

[0078] In step (2) of the load management method of the present invention, the current load is calculated based on the loading image acquired in step (1). The current load includes the amount of goods actually loaded on the loading part, the amount of pallets actually loaded on the loading part, the gaps between the goods, the gaps between the pallets, and the amount of load gaps including the gaps between the goods and the pallets. The pallet mentioned here means a loading platform for simultaneously transporting a plurality of goods using a mobile lifting device typified by a forklift. In the load management method of the present invention, not only the amount of goods actually loaded on the loading part, but also the amount of the pallet and the amount of load gaps, that is, the amount of gaps between the goods, the amount of gaps between the pallets, and the amount of gaps between the goods and the pallets are included in the calculation of the current load.

[0079] As a method for calculating the current load based on the loaded image, a method of image processing the loaded image may be used. As the program, application, or software used for the image processing, those having the functions necessary for the target image processing may be appropriately used.

[0080] First, in the load amount management method and the load amount management device of the present invention, the loading part of the truck is imaged from the side and the rear. While the loading part of a general truck is rectangular, in the loaded image, the loading part forms a distorted quadrilateral shape in which the front side is smaller than the rear side. Therefore, when image-processing the loaded image, it is preferable to first perform a process of returning the distorted loading part to a rectangle, and calculate the current load based on the obtained image, that is, the processed loaded image.

[0081] For example, assuming that the truck is a large vehicle such as a 10-ton truck, in order to include the entire loading part within the angle of view from a short distance where the luggage can be discriminated, it is necessary to use a wide-angle camera. However, by performing the above image processing, there is an advantage that it is not necessary to select a camera with an excessively large angle of view as the camera for acquiring the loaded image, and the cost required for the camera can be reduced. For reference, the horizontal angle of view of the camera used in Example 1 described later is 100 to 120°.

[0082] The processed loaded image is an image obtained by processing the loading part in the loaded image so as to be rectangular. Specifically, the loading part to be processed is preferably an area inside the outer edge including the outer edge of the loading part described above.

[0083] In the load amount management method and the load amount management device of the present invention, the current load is calculated based on the loaded image using the load amount management element. At this time, when the loaded image is image-processed as described above to obtain a processed loaded image, the current load may be calculated based on the processed loaded image. Hereinafter, unless otherwise specified, the loaded image and the processed loaded image are collectively referred to as a loaded-related image.

[0084] The load quantity management element discriminates the goods, pallets, and load gaps in the loading-related image. This discrimination may be performed based on data pre-stored in the load quantity management element, or may be performed based on data stored in an external database or the like accessible to the load quantity management element. The discrimination mechanism, discrimination criteria, etc. are not particularly limited.

[0085] Then, based on the goods, pallets, and load gaps in the loading-related image discriminated as described above, the quantity of goods, the quantity of pallets, and the quantity of load gaps in the loading-related image are calculated.

[0086] The calculation method for each quantity is not particularly limited. For example, it may be calculated based on the area of goods or the like displayed in the loading-related image, or other methods may be used.

[0087] As a calculation method for each quantity, it is preferable to obtain the integrated pixel count obtained by integrating the number of pixels of the goods, pallets, and load gaps in the loading-related image, and calculate the current load quantity based on the integrated pixel count. If the relationship between the number of pixels in the loading-related image and the area of goods or the like loaded in the loading area is obtained in advance, it is possible to easily calculate the current load quantity based on the integrated pixel count.

[0088] When multiple loading images are acquired, it is advisable to calculate a provisional current load quantity for each loading-related image, and adopt the largest one among them as the current load quantity.

[0089] Alternatively, when multiple loading images are acquired, in the case of a collection shipment, the one captured at the time closest to the completion of the wing opening operation among the multiple loading images may be adopted, and the current load quantity may be calculated based on the loading-related image. Similarly, when multiple loading images are acquired, in the case of a delivery shipment, the one captured at the time closest to the start of the wing closing operation among the multiple loading images may be adopted, and the current load quantity may be calculated based on the loading-related image.

[0090] Furthermore, when acquiring a plurality of loaded images, in the case of a collection shipment, for each loaded-related image, a provisional current load is calculated respectively, and the provisional current load calculated based on the loaded-related image captured at the time closest to the completion of the opening operation of the wing among these may be adopted as the current load. Similarly, when acquiring a plurality of loaded images, in the case of a delivery shipment, for each loaded-related image, a provisional current load is calculated respectively, and the provisional current load calculated based on the loaded-related image captured at the time closest to the start of the closing operation of the wing among these may be adopted as the current load.

[0091] Also, when cameras are installed on both sides sandwiching the loading and unloading area and the loading part is imaged from both sides respectively, for each side, a provisional current load is calculated, and the current load may be calculated based on these two provisional current loads.

[0092] In step (3) of the load management method of the present invention, an additional loadable amount is calculated based on the current load obtained in step (2). As described above, the additional loadable amount means the amount of goods that can be further loaded on a truck on which goods are already loaded.

[0093] In the load management method of the present invention, the additional loadable amount may be simply expressed as a volume corresponding to the empty space of the loading part, or may be converted into the amount of goods that can be accommodated in the empty space, the number of pallets, and the amount of gaps between goods.

[0094] In any case, according to the load management method of the present invention, since the current load obtained in step (2) substantially coincides with the space actually used at the imaging time in the loading part, the additional loadable amount obtained in step (3) also substantially coincides with the amount that can actually be added to the loading part, that is, the true additional loadable amount.

[0095] In other words, according to the load management method of the present invention, the difference between the apparent additional loadable amount and the true additional loadable amount described above can be reduced. And by performing load management by feeding back the additional loadable amount obtained in step (3), it is possible to sufficiently increase the loading rate of the truck and efficiently carry goods.

[0096] The load management device of the present invention includes a camera having the component of (1-1) above and a load management element having the component of (1-4) above.

[0097] Among these, the camera is an element for performing step (1) in the load management method of the present invention and is the same as the camera used in the load management method of the present invention described above. Also, the load management element is an element for performing steps (2) and (3) in the load management method of the present invention and is the same as the load management element used in the load management method of the present invention described above.

[0098] By the way, in order to improve the loading rate of the truck and efficiently carry the goods, it is essential to accurately associate the route and schedule of the truck with the loading information of the truck such as the above-described loading-related image, the current load, and the additional loadable amount.

[0099] In the conventional load management method, for example, the route and schedule of the truck and the truck number are registered in advance, and by associating the above-described loading information of the truck with the truck number, the route and schedule of the truck associated with the truck number and the loading information of the truck are associated. This is common.

[0100] According to such a method, when using a truck different from the pre-registered truck, for example, when using another truck as a substitute truck during the maintenance of the truck, the number of the truck to be used is not associated with the route and schedule of the truck, and the loading information of each truck cannot be grasped. As a result, the load in each schedule cannot be managed either.

[0101] In the load management method of the present invention, when associating the driving route and schedule name of the truck with the loading information of the truck using the mobile lift device captured in the loading-related image, the above problems can be addressed.

[0102] In this specification, the mobile lift device refers to a device for transporting goods between a warehouse or the like and the loading section of a truck, or for loading and unloading the goods onto / from the loading section of the truck. As an example of the mobile lift device, a forklift can be cited.

[0103] In this case, it is advisable to associate the driving route and the flight number of the truck with the individual information of the mobile lift device before imaging the loading section of the truck when collecting or delivering goods.

[0104] Normally, when collecting or delivering goods, the truck used for collecting or delivering the goods and its driving route and flight number have already been determined. On the other hand, the mobile lift device moves back and forth on the side of the loading section of the truck when loading and unloading goods. Therefore, the mobile lift device often appears in the loading-related images obtained by imaging the loading section.

[0105] Therefore, if the driving route and the flight number of the truck are associated with the individual information of the mobile lift device before imaging the loading section of the truck when collecting or delivering goods, it is possible to easily and reliably associate the loading information of the truck with the corresponding driving route and flight number of the truck based on the individual information of the mobile lift device that appears in the loading-related images.

[0106] Therefore, in this case, while fully coping with changes in the trucks used, etc., it is possible to accurately grasp the loading information of each truck for each route and flight number, and thus it is possible to perform load management to optimize the load quantity for each flight. Note that, for example, when the flight number includes information on the driving route, etc., it may be sufficient to simply associate the flight number of the truck with the individual information of the mobile lift device before imaging the loading section of the truck when collecting or delivering goods.

[0107] Normally, when collecting or delivering goods, an operator borrows a mobile lift device at the loading and unloading base for use in loading the truck or unloading the truck. At this time, it is reasonable to perform the operation of associating the truck's driving route and flight number with the individual information of the mobile lift device. Hereinafter, as necessary, the operation of associating the truck's driving route and flight number with the individual information of the mobile lift device may be referred to as the association operation of the mobile lift device.

[0108] The above-mentioned association operation of the mobile lift device may be performed by a driver, an operator of the reception service, etc. Alternatively, a truck recognition element for recognizing the individual information of the truck and a lift device recognition element for recognizing the individual information of the mobile lift device may be provided in the load management device, and the load management device may automatically perform the operation.

[0109] In any case, the information in which the truck's driving route and flight number are associated with the individual information of the mobile lift device is preferably shared by the load management element. Therefore, even when the driver or the like performs the association operation of the mobile lift device, it is advisable to register the information in the load management element.

[0110] Note that the above-mentioned individual information of the truck refers to information for identifying individual trucks. Specifically, the truck's driving route and flight number are essential, and in addition, the truck's license plate number, the vehicle body number of the truck, the engine number of the engine mounted on the truck, etc. may also be included.

[0111] For the above-mentioned association operation of the mobile lift device, it is preferable to use an ID card (so-called truck card) that stores at least one of the above-mentioned individual information of the truck as an IC tag, FID tag, QR code (registered trademark), barcode, etc., or various identification tickets.

[0112] The above-mentioned individual information of the mobile lift device refers to information for identifying individual mobile lift devices. Specifically, examples include, but are not limited to, the vehicle body number, manufacturing number, vehicle number, etc. of the mobile lift device.

[0113] For the linking operation of the above-described mobile lift device, it is preferable to use a key of the mobile lift device linked to at least one kind of the individual information of the above-described mobile lift device. Alternatively, it is also preferable to use an ID card or various identification tickets that store at least one kind of the individual information of the above-described mobile lift device as an IC tag, FID tag, QR code (registered trademark), barcode, or the like.

[0114] For example, a driver who has arrived at the loading and unloading base by riding on a truck submits an ID card corresponding to the truck being used to the reception desk and receives a key of the mobile lift device in exchange for it. At this time, the individual information of the truck stored in the ID card of the truck and the individual information of the mobile lift device linked to the key of the mobile lift device are linked. Since the unloading from or loading onto the truck parked or stopped in the loading area is performed by the mobile lift device, it is naturally performed after the above-described linking operation of the mobile lift device is completed.

[0115] Thereby, before imaging the loading part of the truck at the time of cargo collection or delivery, the above-described linking operation of the mobile lift device can be performed with high reliability. And then, based on the loading-related image acquired during loading or unloading and the individual information of the mobile lift device captured in the loading-related image, it is possible to easily and reliably link the driving route and flight number of the truck and the loading information of the truck.

[0116] In the cargo quantity management method and cargo quantity management device of the present invention, as a method of linking the driving route and flight number of the truck and the loading information of the truck, it is preferable to adopt a method using the individual information of the mobile lift device captured in the loading-related image, but other methods may also be adopted.

[0117] As the above-described other method, for example, a method of linking the staying period of the truck in the loading and unloading area and the loading-related image captured during that period can be adopted.

[0118] Specifically, by imaging and monitoring the loading and unloading area or its vicinity with a camera, the inbound time of the truck to the loading and unloading area and the outbound time from the loading and unloading area are obtained, and the first stay period [a] is obtained.

[0119] On the other hand, the reception time of the truck at the time of inbound to the loading and unloading area and the reception time of the truck at the time of outbound from the loading and unloading area are obtained, and the second stay period [b] is obtained. At this time, the individual information of the truck is obtained by the reception work using a truck card or the like.

[0120] By associating the individual information of the truck obtained at the time of reception with the loading information of the truck obtained during the first stay period [a] or the loading information of the truck obtained during the second stay period [b], it is possible to associate the driving route and flight name of the truck with the loading information of the truck.

[0121] By the way, usually, after the driver of the truck stores the truck in the loading and unloading area, the reception work at the time of inbound is performed using a truck card or the like, and after the reception work at the time of outbound is performed using a truck card or the like, the truck is taken out of the loading and unloading area. Therefore, the above-mentioned stay period [b] of the truck is shorter than the stay period [a] of the truck.

[0122] Therefore, although the actual period during which the truck stays in the loading and unloading area is the stay period [a] of the truck, the individual information of the truck used for association is obtained during the stay period [b] of the truck, and there is a time lag between the two. For this reason, when the reception of trucks is crowded, etc., there is a risk that the loading information of the truck will be associated with the individual information of other trucks that were received at a nearby time, rather than the individual information of the truck to be associated.

[0123] General loading and unloading bases are equipped with many loading and unloading areas, and in many cases, many trucks enter the corresponding loading and unloading areas respectively and perform loading and unloading operations simultaneously. Therefore, when simply associating the individual information of a truck with the loading information of the truck using only the stay period [a] or the stay period [b] of the truck as described above, it may be difficult to accurately associate the individual information with the loading information of the truck to be associated for a plurality of trucks that have been received simultaneously or without a sufficient interval.

[0124] When adopting a method that uses the linking operation of a mobile lift device as a method for linking the driving route and the flight number of a truck with the loading information of the truck as described above, even when a large number of trucks are received simultaneously or without a sufficient interval, it is possible to accurately associate the individual information of each truck with the loading information of the truck.

[0125] When linking the driving route and the flight number of a truck with the loading information of the truck using the linking operation of a mobile lift device, in order to easily identify the mobile lift device captured in the loading-related image, it is preferable that the mobile lift device directly displays the individual information of the mobile lift device or displays an identifier associated with the individual information of the mobile lift device. Any identifier may be used as the identifier, but considering identification within the loading-related image, it is particularly preferable to select an AR (augmented reality) marker.

[0126] For example, an identifier such as an AR marker may be displayed at a position that can be imaged by a camera among the mobile lift devices, and during the loading or unloading operation by the mobile lift device, the mobile lift device may be made to appear in the loading-related image together with the identifier. As the position that can be imaged by a camera among the mobile lift devices, it is preferable to select the side surface or the upper surface of the mobile lift device.

[0127] Here, when cameras are installed on both sides of one loading and unloading area, for example, in the camera installed on the right side of the vehicle traveling direction in the loading and unloading area, a mobile lift device for loading or unloading goods from the right side of the truck to the loading section is captured in the camera. On the other hand, in the camera installed on the left side of the vehicle traveling direction in the loading and unloading area, a mobile lift device for loading or unloading goods from the left side of the truck to the loading section is captured in the camera.

[0128] There are many loading and unloading areas provided in the loading and unloading base, and there are often other loading and unloading areas on the side of one loading and unloading area. The work target of the mobile lift device captured in the loading-related image may be one of the two loading and unloading areas or the other. However, when the mobile lift device is, for example, a forklift, it can be determined that the area where the forks are directed is the loading and unloading area that is the work target.

[0129] That is, in this case, by associating the loading and unloading area where the mobile lift device is directed in the loading-related image with the identifier of the mobile lift device, the loading information of the truck in the loading and unloading area, the driving route of the truck, and the flight number can be easily and reliably associated.

[0130] Considering the positional relationship between the loading and unloading area and the mobile lift device for the loading section as described above, it is preferable that the above identifier is displayed on both side surfaces of the mobile lift device.

[0131] When displaying identifiers on both sides of a mobile lift device, each identifier preferably has at least two types of information, namely the individual information of the above-described mobile lift device and direction information. Among these, regarding the direction information, it is preferable to display different identifiers on the identifier displayed on one side of the mobile lift device and the identifier displayed on the other side. For example, it is preferable to incorporate information that can distinguish that the surface is the left side surface into the identifier displayed on the left side surface of the mobile lift device. And it is preferable to incorporate information that can distinguish that the surface is the right side surface into the identifier displayed on the right side surface of the mobile lift device.

[0132] Note that the mobile lift device does not necessarily have to be shown in all loading-related images. For example, if the loading-related images captured by the same camera are associated with each other, even for a loading-related image in which the mobile lift device is not shown, the loading information of the truck based on the loading-related image, the driving route and the flight number of the truck, can be easily associated.

[0133] As a method for determining the direction of the fork in the above-described mobile lift device, a method using an identifier such as an AR marker can be adopted.

[0134] Specifically, by incorporating direction information into the identifier and comparing the reference direction in the loading-related image with the direction information in the identifier shown in the loading-related image, it is possible to determine the direction of the fork in the mobile lift device. Alternatively, the mobile lift device and its fork in the loading-related image may be actually recognized by image analysis to determine the direction of the fork. As a method for determining the direction of the fork, various methods other than this can be adopted.

[0135] Hereinafter, the load management method and load management device of the present invention will be described with specific examples.

[0136] (Example 1) FIG. 1 is an explanatory diagram schematically explaining the positional relationship among the loading and unloading base, the loading and unloading area, the truck, the loading section, the goods, and the camera in the load management method and the load management device of Example 1. FIG. 2 is an explanatory diagram schematically explaining a state in which a loading image is acquired by the camera in the load management method and the load management device of Example 1. FIG. 3 is an explanatory diagram schematically explaining the loading image acquired by the load management method and the load management device of Example 1. FIG. 4 is an explanatory diagram schematically explaining a state in which a processed loading image is acquired from the loading image acquired by the load management method and the load management device of Example 1. FIG. 5 is an explanatory diagram schematically explaining the goods in the processed loading image acquired by the load management method and the load management device of Example 1. FIG. 6 is an explanatory diagram schematically explaining the current load calculated based on the processed loading image acquired by the load management method and the load management device of Example 1. FIG. 7 is an explanatory diagram schematically explaining the additional loadable amount calculated based on the processed loading image acquired by the load management method and the load management device of Example 1. FIG. 8 is an explanatory diagram schematically explaining the mobile lift device and the identifier used in the load management method and the load management device of Example 1. FIG. 9 is a flowchart schematically explaining the load management method of Example 1.

[0137] The load management device 1 of Example 1 includes a camera 2 and a load management element 3 connected to the camera 2.

[0138] Among these, the camera 2 includes the following components (1-1). (1-1) Cameras 2 respectively installed on the side and rear of the loading and unloading area 93 of the truck 92 at the loading and unloading base 91 of the goods 90, and acquiring a loading image Im0 obtained by imaging the loading section 94 of the truck 92.

[0139] The load management element 3 includes the following components (1-5). (1-5) Based on the loading image Im0, calculate the current load quantity 97 including the quantity of the goods 90 actually loaded on the loading part 94, the quantity of the pallets 95 actually loaded on the loading part 94, the gaps between the goods 90, the gaps between the pallets 95, and the quantity of the load gaps 96 including the gaps between the goods 90 and the pallets 95. Further, calculate the additional load quantity 98 that can be added to the loading part 94 based on the current load quantity 97, which is the load quantity management element 3.

[0140] The loading and unloading base 91 is provided with a number of loading and unloading areas 93. As shown in FIG. 1, each loading and unloading area 93 is a section where the truck 92 can park and is surrounded by a line drawn on the floor of the building. The truck 92 is inside the loading and unloading area 93 at the time of warehousing and exits the loading and unloading area 93 at the time of shipping.

[0141] Two cameras 2 are arranged for each loading and unloading area 93. One camera 2 is arranged on the left and rear of the loading and unloading area 93, and the other camera 2 is arranged on the right and rear of the loading and unloading area 93.

[0142] The camera 2 is selected such that its viewing angle is equal to or greater than the minimum value (θH) in the horizontal direction shown in FIG. 10 above and equal to or greater than the minimum value (θV) in the vertical direction shown in FIG. 11.

[0143] As shown in FIG. 2, one camera 2 acquires a loading image Im0 obtained by imaging the loading part 94 of the truck 92 from the right side (driver's seat side), and the other camera 2 acquires a loading image Im0 obtained by imaging the loading part 94 of the truck 92 from the left side (passenger seat side).

[0144] The load quantity management element 3 is a computer equipped with AI, and each camera 2 is controlled by the load quantity management element 3 to image the loading image Im0 as a video. The loading image Im0 acquired by the camera 2 is transmitted to and stored in the load quantity management element 3.

[0145] The load management element 3 processes the loading image Im0 to detect the opening and closing operations of the wing 99 of the truck 92. When the truck 92 is a collection shipment, four still images of the loading image Im0 are acquired from the loading image Im0 of the above video at 30 - second intervals for a total of four times over a two - minute period after the wing 99 of the truck 92 has completed the opening operation. When the truck 92 is a delivery shipment, four still images of the loading image Im0 are acquired from the loading image Im0 of the above video at 30 - second intervals for a total of four times over a two - minute period before the wing 99 of the truck 92 starts the closing operation. Then, by performing image processing on these multiple still images of the loading image Im0, a processed loading image Im1 is acquired.

[0146] Note that the interval for acquiring the above - mentioned still images of the loading image Im0 may be appropriately set according to the operating speed and moving speed of the mobile lift device 4 so that the mobile lift device 4 is not captured in the loading image Im0 that is the object of image processing. In Example 1, corresponding to the mobile lift device 4 operated by the work vehicle, still images of the loading image Im0 were acquired at 30 - second intervals. However, if the mobile lift device 4 is automatically operated, compared with a skilled operator, its operating speed and moving speed are set slower based on safety, so it is preferable to increase the interval for acquiring the loading image Im0.

[0147] Here, as shown in FIG. 3, the loading part 94 of the truck 92 forms a substantially trapezoidal shape in the loading image Im0, where the rear side in the vehicle traveling direction is large and the front side in the vehicle traveling direction is small. The load management element 3 processes the loading image Im0 by image processing so that at least the loading part 94 becomes rectangular, and acquires a processed loading image Im1 (see FIG. 4).

[0148] As shown in FIG. 5, the processed loading image Im1 shows the loading part 94, and the goods 90 and the pallet 95 loaded on the loading part 94 are also shown in the processed loading image Im1.

[0149] The load quantity management element 3 calculates the current load quantity 97 based on the processed loading image Im1 (see FIG. 6). The current load quantity 97 includes the quantity of the goods 90 actually loaded on the loading part 94, the quantity of the pallets 95 actually loaded on the loading part 94, and the quantity of the load gaps 96. The load gaps 96 are the portions of the remaining gaps in the loading part 94 where new goods 90 or pallets 95 cannot be loaded, and include the gaps between the goods 90, the gaps between the pallets 95, and the gaps between the goods 90 and the pallets 95.

[0150] Note that the load quantity management element 3 calculates a provisional current load quantity 97 for each of the above-mentioned plurality of processed loading images Im1. At this time, the load quantity management element 3 obtains the integrated pixel number obtained by integrating the pixel number of the goods 90, the pixel number of the pallets 95, and the pixel number of the load gaps 96 in the processed loading image Im1, and calculates the provisional current load quantity 97 based on the integrated pixel number. Then, the load quantity management element 3 compares each provisional current load quantity 97, and sets the one with the largest value among them as the current load quantity 97. Further, the load quantity management element 3 associates and stores the loading image Im0 used for calculating the current load quantity 97 with the current load quantity 97.

[0151] The load quantity management element 3 calculates an additional load quantity 98 that can be added to the loading part 94 based on the current load quantity 97 (see FIG. 7). Then, the additional load quantity 98 is collected for each driving route and flight of the truck 92, and when the next truck 92 is dispatched, load quantity management is performed by feeding back the additional load quantity 98. Thereby, the loading rate of the truck 92 can be sufficiently increased.

[0152] By the way, in the load quantity management device 1 of the first embodiment, as a method of associating the driving route and flight name of the truck 92 with the loading information of the truck 92, the above-mentioned "method using the individual information of the mobile lift device 4 written in the loading-related image" is adopted.

[0153] Therefore, as shown in FIG. 8, the mobile lift device 4 is provided with an identifier 40 associated with the individual information of the mobile lift device 4. Specifically, the identifier 40 is an AR marker. The identifier 40 is arranged at three positions on both side surfaces and the upper surface of the mobile lift device 4.

[0154] Based on the identifier 40 of the mobile lift device 4 captured in the processing loading image Im1, the load management element 3 associates the loading information of the truck 92 such as the current load 97 and the additional loadable amount 98, and the individual information of the truck 92. Thereby, the loading information of each truck 92 is accurately associated with the driving route and the flight name of the truck 92.

[0155] Hereinafter, based on the flowchart shown in FIG. 9, the load management method of the first embodiment will be described.

[0156] When the truck 92 enters the loading / unloading area 93 of the loading / unloading base 91, first, the driver of the truck 92 performs a reception operation (S1). At this time, by reading the truck card with a scanner, the individual information of the truck 92 registered on the truck card is input to the load management element 3 (S2). At this time, the driver also borrows the key of the mobile lift device 4. By reading the borrowing card of the key with a scanner at this time, the individual information of the mobile lift device 4 corresponding to the key is input to the load management element 3 (S3).

[0157] In the loading / unloading base 91, the cameras 2 installed on both sides sandwiching the loading / unloading area 93 face the loading / unloading area 93 and are always capturing videos (S4). The videos are separated into a video captured from the driver's seat side of the loading / unloading area 93 and the space above it, and a video captured from the passenger seat side, and are stored in the load management element 3 (S2, S3).

[0158] The load management element 3 monitors the above video and determines the presence or absence of the truck 92 in the loading and unloading area 93 of the truck 92. Then, when the load management element 3 determines that the truck 92 has entered the loading and unloading area 93 (S5), it stores the entry time (S6) and determines the presence or absence of the opening and closing operation of the wing 99 of the truck 92 (S7). When it is determined that the wing 99 of the truck 92 has performed an opening operation, for each of the cameras 2 on the driver's seat side and the passenger seat side, four still images of the loaded image Im0 are acquired every 30 seconds for 2 minutes after the opening operation of the wing 99 of the truck 92 is completed. Thereafter, video accumulation is continued until it is determined that the wing 99 has performed a closing operation. When it is determined that the wing 99 has performed a closing operation, four still images of the loaded image Im0 are acquired every 30 seconds for 2 minutes before the closing operation of the wing 99 of the truck 92 starts. Then, a provisional current load 97 is calculated based on each still image of the loaded image Im0, the current load 97 is determined by comparing each provisional current load 97, and further, an additional loadable amount 98 is calculated from the current load 97 (S8, S9).

[0159] Furthermore, the load management element 3 monitors the above video and determines whether the mobile lift device 4 is captured (S10). When it is determined that the mobile lift device 4 is present in the video, the orientation of the mobile lift device 4 with respect to the loading and unloading area 93 and the loading section 94 is determined. Then, when it is determined that the mobile lift device 4 is performing a loading and unloading operation on the load 90 with respect to the loading section 94 that is the imaging target, based on the identifier 40 of the mobile lift device 4 captured in the image, the individual information of the mobile lift device 4 and the individual information of the truck 92 associated therewith are called. Then, depending on whether the corresponding truck 92 is a delivery shipment or a collection shipment, among the plurality of current loads 97 and additional loadable amounts 98 calculated in S8 and S9, the current load 97 and additional loadable amount 98 corresponding to the situation are extracted. Then, the loading information of these trucks 92 is associated with the individual information of the trucks 92 and stored in the load management element 3. The load management element 3 performs load management to increase the loading rate of the truck 92 by collecting such information for as many operating routes and trips as possible and feeding back the information during the next vehicle allocation of the truck 92.

[0160] According to the load management method and the load management device 1 of the embodiment, it is possible to reliably grasp the current load 97 and the additional loadable amount 98 of each truck 92, and as a result, it is possible to improve the loading rate of the truck 92 and efficiently carry the goods 90.

[0161] Although the present invention has been described above, the present invention is not limited to the above-described embodiments and the like, and it is possible to appropriately extract and combine the elements described in the embodiments and the like, and to make various changes without departing from the spirit of the present invention. In addition, the specification of the present invention discloses a technical idea in which the matters described in each claim are appropriately combined, not limited to the citation relationship of each claim at the time of filing.

Explanation of Signs

[0162] 2: Camera 3: Load management element 4: Mobile lift device 40: Identifier (AR marker) 90: Goods 91: Loading and unloading base 92: Truck 93: Loading and unloading area 94: Loading section 95: Pallet 96: Load gap 97: Current load 98: Additional loadable amount 99: Wing Im0: Loading image Im1: Processed loading image

Claims

1. An image of the loading part of the truck is acquired by a camera of a load management device installed on the side and rear of the loading and unloading area of the truck at a freight loading and unloading base, by a load management element of the load management device, based on the loading image, the amount of goods actually loaded on the loading part, the amount of pallets actually loaded on the loading part, the gaps between the goods, the gaps between the pallets, and the amount of load gaps including the gaps between the goods and the pallets are calculated to obtain the current load, before imaging the loading part of the truck, the driving route and flight number of the truck are associated with the individual information of a mobile lift device for loading and unloading the goods on the loading part and / or transporting the goods, Based on the image of the mobile lift device captured in the loading image, the individual information of the mobile lift device is obtained, and the driving route and flight number are associated with the current load, a load management method.

2. by the load management element, Based on a processed loading image obtained by processing the loading part in the loading image into a rectangle, the current load is calculated, the load management method according to claim 1.

3. The camera is installed on both sides sandwiching the loading and unloading area, the load management method according to claim 1 or claim 2.

4. The camera captures a plurality of the loading images over time, the load management method according to claim 1 or claim 2.

5. The plurality of loading images, in the collection flight, include the loading image within 120 seconds after the completion of the opening operation of the wing of the truck, in the delivery flight, include the loading image within 120 seconds before the start of the closing operation of the wing of the truck, the load management method according to claim 4.

6. by the load management element, The integrated pixel number obtained by integrating the pixel numbers of the goods, the pallets, and the load gaps in the processed loading image is obtained, and the current load is calculated based on the integrated pixel number, the load management method according to claim 2.

7. An AR marker is installed on the mobile lift device, by the load management element, Using the AR marker, the individual information of the mobile lift device captured in the loading image is obtained, the load management method according to claim 1 or claim 2.

8. A camera that is installed on the side and rear of the loading and unloading area of a truck at a cargo loading and unloading base, and that acquires a loading image obtained by imaging the loading section of the truck; a load quantity management element that calculates a current load quantity including the quantity of cargo actually loaded on the loading section, the quantity of pallets actually loaded on the loading section, the gaps between the cargos, the gaps between the pallets, and the quantity of load gaps including the gaps between the cargo and the pallets, based on the loading image; by the load quantity management element; before imaging the loading section of the truck, associating the driving route and flight number of the truck with the individual information of a mobile lift device for loading and unloading the cargo onto / from the loading section and / or transporting the cargo; a load quantity management device that acquires the individual information of the mobile lift device based on the image of the mobile lift device captured in the loading image, and associates the driving route and flight number with the current load quantity.

Images