Load amount management method and load amount management device

Abstract

To provide a load amount management method and a load amount management device capable of reliably grasping a load amount of each truck.SOLUTION: A load amount management method includes the steps of: acquiring a loading image Im0 obtained by imaging a loading section 94 of the truck 92 by using cameras 2 installed respectively at the side and rear of a loading / unloading area 93 of a truck 92 at a loading / unloading base 91 for a cargo 90; and calculating a current load amount 97 which includes the amount of cargoes 90 actually loaded in the loading section 94, the amount of pallets 95 actually loaded in the loading section 94, and the amount of load gaps 96 that includes a gap between the cargoes 90, a gap between the pallets 95 and a gap between the cargo 90 and the pallet 95 on the basis of the loading image Im0.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a technique for determining the amount of cargo actually loaded in the loading section of a truck. [Background technology]

[0002] Trucks for collecting and delivering various cargoes are provided with loading sections for loading the cargoes. When cargo is collected or delivered, if an appropriate amount of cargo is not loaded onto the loading section of a truck and the free space in the loading section is larger than necessary, a problem occurs in which more trucks than actually needed are required to collect or deliver the cargo.

[0003] In this case, the number of trucks required, the fuel costs for those trucks, and the number of drivers required will also increase, resulting in problems not only in terms of costs and personnel procurement, but also in increased CO2 emissions.

[0004] To solve the above-mentioned problems, a cargo volume management method has been conventionally adopted in which the amount of free space in the loading section of each truck carrying cargo is calculated and the result is fed back to manage the routes and services for collecting and delivering the cargo, as well as the cargo volume on each service.

[0005] Specifically, as the conventional load management method described above, a method is known in which an operator visually checks the amount of cargo in the loading section of a truck, i.e., the cargo volume, and calculates the available space in the loading section based on the visually checked cargo volume. Based on the available space in the loading section calculated here, the amount of cargo that can be further loaded on the truck can be calculated. In this specification, the above value, i.e., the amount of cargo that can be further loaded on a truck already loaded with cargo, is referred to as the additional load volume, as necessary.

[0006] According to the above-mentioned calculation method of the addable load amount, the addable load amount varies greatly from worker to worker due to the difference in the proficiency level of each worker. Also, according to the calculation method of the addable load amount, there may be a large difference between the calculated addable load amount (apparent addable load amount) and the actual addable load amount (true addable load amount). For this reason, it has been difficult to increase the loading rate of trucks sufficiently and transport cargo efficiently.

[0007] Here, in order to sufficiently increase the loading rate of trucks and efficiently transport cargo, it is necessary to reduce the difference between the apparent and true loads. The difference between the apparent and true loads is largely influenced by the proficiency level of each worker who visually checks the load. Therefore, if the involvement of the worker in load management is reduced, it may be possible to reduce the difference.

[0008] One method for reducing the involvement of workers in cargo volume management is to capture an image of the loading section of a truck and calculate the cargo volume and free space in the loading section based on the captured image of the cargo. Patent Documents 1 and 2 introduce techniques for imaging the loading section of a truck. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] Patent No. 3711839 [Patent Document 2] JP 2022-170260 A Summary of the Invention [Problem to be solved by the invention]

[0010] Patent Document 1 introduces a technology in which a loading section is imaged by a camera installed on the wing of a truck, and the amount of cargo loaded on the loading section is calculated based on the obtained loading image. In the technology of Patent Document 1, the obtained load amount is transmitted from the truck to an external device in an office, etc. Patent Document 1 explains that this makes it possible to grasp the load amount actually loaded on the truck, thereby enabling efficient transport of loads, particularly when there are many loads and many trips.

[0011] Furthermore, Patent Document 2 introduces a technology for capturing images of trucks and containers, i.e., the loading area of ​​trucks, with a camera. In the technology of Patent Document 2, the correctness of a combination of trucks and containers is determined based on schedule data showing the combination of trucks and containers and an image captured by the camera. Patent Document 2 explains that this makes it possible to transport cargo accurately.

[0012] As with the technology introduced in the above-mentioned Patent Document 1 and the technology introduced in Patent Document 2, by using a camera to capture an image of the loading area, unlike when an operator visually checks the load amount, it is possible to reduce problems caused by variations in the proficiency level of each operator, and ultimately to reduce the difference between the apparent and true load amount that can be added.

[0013] However, in reality, it has not been possible to sufficiently reduce the difference between the apparent load capacity and the true load capacity simply by capturing an image of the loading area using a camera. In other words, it remains difficult to improve the loading rate of trucks and efficiently transport cargo using only the conventional techniques introduced in the above-mentioned Patent Documents 1 and 2.

[0014] For this reason, there is a demand for technology that can reliably grasp the amount of cargo on each truck in order to improve the loading rate of trucks and transport cargo more efficiently.

[0015] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a load management method and device that can grasp the load of each truck with high reliability. [Means for solving the problem]

[0016] The load management method of the present invention which solves the above problems includes: Obtaining a loading image of a loading section of the truck using cameras installed on the sides and rear of a loading / unloading area of ​​the truck at a loading / unloading base of the luggage, This is a cargo volume management method that calculates, based on the loading image, a current cargo volume including the amount of cargo actually loaded on the loading section, the amount of pallets actually loaded on the loading section, and the amount of cargo gaps including the gaps between the cargo, the gaps between the pallets, and the gaps between the cargo and the pallets.

[0017] The load management device of the present invention, which solves the above problems, is cameras installed at the sides and rear of a loading / unloading area of ​​a truck at a loading / unloading base for loading and unloading luggage, for capturing images of a loading section of the truck; This is a cargo volume management device comprising: a cargo volume management element that calculates a current cargo volume based on the loading image, the current cargo volume including the amount of cargo actually loaded on the loading section, the amount of pallets actually loaded on the loading section, and the amount of cargo gaps including gaps between the cargo, gaps between the pallets, and gaps between the cargo and the pallets. Effect of the Invention

[0018] According to the load management method and the load management device of the present invention, it is possible to grasp the load of each truck with high reliability. [Brief description of the drawings]

[0019] [Figure 1] 1 is an explanatory diagram for explaining a schematic positional relationship between a loading / unloading base, a loading / unloading area, a truck, a loading section, luggage, and a camera in a luggage amount management method and a luggage amount management device of a first embodiment. FIG. [Diagram 2] 1 is an explanatory diagram for explaining a schematic view of a state in which a load image is acquired by a camera in the load management method and load management device of the first embodiment. FIG. [Diagram 3]1 is an explanatory diagram for explaining a loading image obtained by the load management method and the load management device according to the first embodiment; [Figure 4] 3A to 3C are explanatory diagrams for explaining a schematic diagram of a state in which a processed load image is acquired from a load image acquired by the load management method and the load management device according to the first embodiment. [Diagram 5] 1 is an explanatory diagram for explaining a model of cargo in a processed load image acquired by the cargo weight management method and the cargo weight management device of the first embodiment; [Figure 6] 1 is an explanatory diagram for explaining a schematic diagram of a current load amount calculated based on a processed load image acquired by the load amount management method and the load amount management device of the first embodiment. FIG. [Figure 7] 1 is an explanatory diagram for explaining a schematic diagram of an addable load amount calculated based on a processed load image acquired by the load amount management method and the load amount management device of the first embodiment. FIG. [Figure 8] FIG. 2 is an explanatory diagram for explaining a mobile lift device and an identifier used in the load management method and load management device of the first embodiment. [Figure 9] 4 is a flowchart illustrating a load management method according to the first embodiment. [Figure 10] 1 is an explanatory diagram for explaining a camera selection method in a load management method and a load management device according to the present invention; [Figure 11] 1 is an explanatory diagram for explaining a camera selection method in a load management method and a load management device according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] The load management method and load management device of the present invention will be described below with reference to specific examples.

[0021] Hereinafter, unless otherwise specified, the numerical range "x to y" described in this specification includes the lower limit x and the upper limit y in the range. The numerical range can be formed by arbitrarily combining these upper and lower limit values, as well as the numerical values ​​listed in the embodiment. Furthermore, the numerical values ​​arbitrarily selected from within the numerical range can be the upper and lower limit numerical values.

[0022] As mentioned above, simply taking an image of the loading section using a camera, as in the technology introduced in Patent Document 1 and the conventional technology introduced in Patent Document 2, was not able to sufficiently reduce the difference between the apparent amount of load that can be added and the true amount of load that can be added.

[0023] The inventors of the present invention have considered that the above-mentioned problem is closely related to the positional relationship between the loading section and the camera.

[0024] During delivery, the amount of cargo in the loading section increases rapidly as time passes after the wings of the truck open, as workers load cargo for the delivery destination customer onto the loading section of the truck. On the other hand, during collection, the amount of cargo in the loading section decreases rapidly as time passes after the wings of the truck open, as workers unload cargo collected from production sites, suppliers, etc., from the loading section. In other words, the amount of cargo in the payload changes at a relatively fast rate both during collection and delivery.

[0025] Therefore, in order to accurately calculate the load amount and the possible additional load amount based on the loading image taken by the camera, it is necessary not only to acquire a loading image that captures the entire loading section thoroughly, but also to acquire the maximum value of the changing load amount at the time of collection and delivery. In order to acquire the maximum value of the load amount, it is necessary to quickly acquire the loading image immediately after the wings of the truck open at the time of collection, and immediately before the wings of the truck close at the time of delivery.

[0026] For example, when the loading section is imaged by a camera installed on the wing of a truck as described in Patent Document 1, there are often blind spots in the loading section, and it is difficult to obtain a loading image that captures the entire loading section. If the loading image is not accurate, the load amount and the possible additional load amount cannot be calculated with high accuracy.

[0027] Also, as described in Patent Document 2, even when a camera is installed outside a vehicle or a container, it is not possible to quickly obtain a loading image that captures the entire loading section thoroughly by simply installing the camera in a high position, on a building, or on an aircraft such as a drone. Therefore, in this case, it cannot be said that the load amount and the additional load amount can be calculated with high accuracy.

[0028] In contrast, in the load management method of the present invention, first, (1) Using cameras installed on the sides and rear of a truck loading / unloading area at a cargo loading / unloading base, a loading image of the loading section of the truck is obtained.

[0029] Here, the loading and unloading base refers to a base for loading and unloading goods onto and from trucks. Specific examples of the loading and unloading base include, but are not limited to, a production base, a logistics center, a customer warehouse, and the like.

[0030] In addition, a truck loading and unloading area means an area at a loading and unloading base where trucks are stopped to load or unload cargo. The loading and unloading area is sometimes called a truck station.

[0031] The loading section displayed in the loading image acquired in the above step (1) can be said to be imaged from the side of the truck and from behind the truck.

[0032] In order to capture an image of the entire loading section and obtain image information of the luggage loaded on the loading section without missing any, it is considered preferable to install a camera on the side of the loading / unloading area and capture an image of the loading section from the side. In order to capture an image of the entire loading section from the side, a camera must be installed at a position away from the loading section, or a high-performance camera with an ultra-wide-angle lens must be used.

[0033] A typical loading and unloading base has many loading and unloading areas, and adjacent loading and unloading areas are close to each other. Therefore, it is not possible to install a camera at a position to the side of the loading part and away from the loading part, or even if it is possible to install a camera at such a position, there is a high possibility that trucks adjacent to the target truck will also be captured in the camera's image. Therefore, it is difficult to say that it is preferable to install a camera at a position to the side of the loading part and away from the loading part. On the other hand, high-performance cameras equipped with super-wide-angle lenses are expensive, and therefore are not ideal from a cost perspective.

[0034] In contrast, the cargo amount management method of the present invention does not require a camera with an excessively wide angle of view, such as the ultra-wide-angle lens, to capture images of the loading section from the side and rear, and can capture images of the loading section thoroughly even if the camera is installed relatively close to the loading section. This has the advantage of preventing other trucks from appearing in the images captured by the camera, and does not require a high-performance camera.

[0035] In addition, when the loading section is imaged from an oblique position, the amount of image information for the area of ​​the loading section that is far from the camera tends to be less than the amount of image information for the area of ​​the loading section that is close to the camera. However, by imaging the loading section from the rear instead of the front, it is possible to eliminate the influence of the interior of the truck and image the loading section from as close a position as possible, and it is possible to obtain sufficient image information for the area of ​​the loading section that is far from the camera.

[0036] Furthermore, by setting the installation position of the camera to the side and rear of the loading section and setting the imaging direction of the camera to the direction from the installation position toward the loading section, as long as the imaging target is a truck that fits within the camera's angle of view and the loading / unloading area, it is possible to thoroughly image the entire loading section while keeping the camera position relative to the loading / unloading area fixed at a predetermined position. As a result, the cargo amount management method of the present invention makes it possible to quickly obtain a loading image that thoroughly images the entire loading section.

[0037] In addition, in the load management method of the present invention, after obtaining the loading image in (1) above, (2) A process is performed to calculate a current load amount based on the loading image, the current load amount including the amount of cargo actually loaded on the loading section, the amount of pallets actually loaded on the loading section, and the amount of cargo gaps including gaps between the cargo, gaps between the pallets, and gaps between the cargo and the pallets. The current load amount includes not only the amount of cargo, but also the amount of pallets actually loaded on the loading section and the amount of the cargo gaps. Therefore, it is possible to say that the current load amount is equal to or very close to the amount of space in the loading section that is actually used at the time of image capture.

[0038] In addition, the amount of cargo actually loaded on the loading section means the amount of the cargo itself if the cargo is bare, and means the amount of the cargo including the packaging material if the cargo is packed in packaging material. In other words, in this specification, packaged and unpackaged cargo are treated as cargo in the same way.

[0039] As described above, the cargo gap refers to gaps including gaps between cargo objects, gaps between pallets, and gaps between cargo objects and pallets, but may also include other gaps in the loading section. Examples of such other gaps include a gap between the outer edge of the loading section and cargo objects, and a gap between the outer edge of the loading section and a pallet.

[0040] Here, the outer edge of the loading section means a boundary that actually or virtually separates the inside and outside of the loading section. The outer edge of the loading section may be, for example, a frame that is actually provided on the truck, or a virtual frame that connects the ends of the loading section on the truck. The loading section includes the outer edge and can be said to be a space surrounded by the outer edge.

[0041] As described above, the current load amount obtained in (2) approximately coincides with the space in the loading section that is actually being used at the time of imaging. Therefore, the load amount management method of the present invention can obtain the current load amount as accurately as possible. The addable load amount calculated based on the current load amount obtained by the load amount management method of the present invention is an amount that approximately coincides with the load amount that can actually be added to the loading section, i.e., the true addable load amount. Therefore, it can be said that the load amount management method of the present invention can reduce the difference between the apparent addable load amount and the true addable load amount.

[0042] In the load management method of the present invention, after obtaining the current load in the above (2), (3) The method may include a step of calculating an additional load amount that can be added to the loading section based on the current load amount.

[0043] As described above, the load amount that can be added calculated based on the current load amount obtained in (2) is approximately equal to the true load amount that can be added. Therefore, it can be said that the load amount management method of the present invention including the above-mentioned (3) step can also reduce the difference between the apparent load amount that can be added and the true load amount that can be added. The step (3) may be performed consecutively with the steps (1) and (2), or may be performed separately from these. In other words, in the load management method of the present invention, the step (3) may be performed each time the steps (1) and (2) are performed to calculate the additional load amount. Alternatively, only the steps (1) and (2) may be performed normally, and the step (3) may be performed as necessary.

[0044] The load management device of the present invention is a device for performing load management using the load management method of the present invention described above. The load management device of the present invention includes a camera and a load management element. Of these, the camera is an element for carrying out step (1) in the load management method of the present invention, and includes the following components (1-1). (1-1) Cameras that are installed on the sides and rear of the truck loading / unloading area at a cargo loading / unloading base and capture loading images of the loading section of the truck.

[0045] On the other hand, the load management element is an element for performing step (2) in the load management method of the present invention, and includes the following components (1-4). (1-4) A cargo volume management element that calculates the current cargo volume based on the loading image, including the amount of cargo actually loaded on the loading section, the amount of pallets actually loaded on the loading section, and the amount of cargo gaps, which include the gaps between the cargo, the gaps between the pallets, and the gaps between the cargo and the pallets.

[0046] The cargo volume management device of the present invention is a device for performing cargo volume management using the cargo volume management method of the present invention described above, and therefore has the advantage, like the cargo volume management method of the present invention, of being able to reduce the difference between the apparent cargo volume that can be added and the true cargo volume that can be added.

[0047] The management element in the load amount management device of the present invention can further perform the above step (3), that is, a step of calculating an addable load amount based on the current load amount obtained in the above step (1).

[0048] The load management method and the load management device of the present invention will be described below for each component.

[0049] The load management method of the present invention includes the above-mentioned steps (1) to (3).

[0050] In step (1), cameras installed on the sides and rear of the loading / unloading area of ​​the truck at the loading / unloading base are used to capture images of the loading section of the truck to obtain a loading image.

[0051] The loading section of a truck refers to the part of the truck where cargo is loaded, and can also be called the luggage compartment of the truck.

[0052] At least one camera used in step (1) of the cargo amount management method of the present invention, i.e., the camera in the cargo amount management device of the present invention, is installed for each loading / unloading area. In other words, at least one camera is installed for each truck that loads and unloads cargo in the loading / unloading area.

[0053] The camera is installed to the side and rear of the loading / unloading area and captures an image of the loading section of the truck. In other words, the camera faces in a direction capable of capturing an image of the loading section of the truck.

[0054] There is no particular limit to the number of cameras, and in some cases, two or more cameras may be installed in one loading / unloading area. In this case, at least one camera is installed to the side and rear of the loading / unloading area and images the loading section of the truck from that position, and there is no particular restriction on the installation positions or imaging targets of the other cameras.

[0055] However, if a camera is installed on each side of the truck, i.e., one camera is installed on one side and rear of the loading / unloading area and the other camera is installed on the other side and rear of the loading / unloading area, it is possible to capture images of the loading area of ​​the truck from both sides, and a current cargo weight that is closer to the actual cargo weight can be obtained.

[0056] In other words, the loading section of the truck has depth in both directions, i.e., in the vehicle width direction, so the amount of luggage loaded on one side of the loading section may be significantly different from the amount of luggage loaded on the other side. In such a case, by calculating the current load amount by taking into account the loading image from one side and the loading image from the other side, rather than based only on the loading image from one side, it is possible to obtain a current load amount that is closer to the actual load amount, which has the advantage of further reducing the difference between the apparent load amount that can be added and the true load amount that can be added.

[0057] The camera should be positioned to the side and rear of the loading / unloading area, and further, in a position that can capture an image of the entire loading section. It should be set to an appropriate position depending on the angle of view of the camera used and the installation height of the camera, etc. Considering the need to quickly obtain a loading image capturing an image of the entire loading section, it is preferable for the camera to be fixed in position relative to the loading / unloading area, and it is particularly preferable for the camera to be fixed to a facility at the loading / unloading base.

[0058] In this specification, the rear of a loading / unloading area means the rear in the traveling direction of a truck parked in the loading / unloading area, and the side of the loading / unloading area means the direction perpendicular to the traveling direction of the truck, in other words, the vehicle width direction. The direction of trucks parked in the loading / unloading area is determined in advance to be one predetermined direction.

[0059] The performance required for the camera is determined according to the position of the camera relative to the loading and unloading area. A camera that satisfies the required performance can be selected.

[0060] For example, the minimum angle of view required for the camera can be calculated based on the positional relationship between the camera and the loading section of the truck.

[0061] Specifically, the minimum value of the angle of view in the horizontal direction (θH) may be calculated based on the following formulas (1) to (3). θH1=tan -1 ×h3 / h1………〔1〕 θH2=tan -1 ×h1 / h2………〔2〕 θH=90-θH1-θH2……[3]

[0062] Note that h1 means the horizontal distance between the front end and side end BE of the loading part or the front end and side end FE of the loading part shown in Fig. 10 and the camera 2. Specifically, the camera 2 shown in Fig. 10 and Fig. 11 described later means the center point of the camera lens. h2 means the horizontal distance between the FE and the camera 2. h3 means the horizontal distance between the BE and the camera 2.

[0063] Moreover, the minimum value of the angle of view in the vertical direction (θV) may be calculated based on the following expressions (4) to (6). θV1=tan -1 ×v3 / v1………〔4〕 θV2=tan -1×v1 / v2………〔5〕 θV=90-θV1-θV2……[6]

[0064] Note that v1 means the horizontal distance between the camera 2 and the lower end and side end LE of the loading section or the upper end and side end UE of the loading section shown in FIG. v2 denotes the vertical distance between the LE and the camera 2. v3 denotes the vertical distance between the UE and the camera 2.

[0065] In the load management method and load management device of the present invention, it is preferable to select a camera that satisfies both the minimum value of the horizontal angle of view (θH) and the minimum value of the vertical angle of view (θV). In other words, it is preferable to select a camera whose angle of view is equal to or greater than the minimum value (θH) in the horizontal direction and equal to or greater than the minimum value (θV) in the vertical direction.

[0066] In other words, the load management method of the present invention may include a step (0) and a step (01) of selecting a camera as a step preceding the step (1). (0) calculating a minimum value of the angle of view in the horizontal direction (θH) based on the above formulas [1] to [3], and calculating a minimum value of the angle of view in the vertical direction (θV) based on the above formulas [4] to [6]; (01) A step of selecting a camera whose angle of view is equal to or greater than a minimum value (θH) in the horizontal direction and equal to or greater than a minimum value (θV) in the vertical direction. It should be noted that steps (0) and (01) need only be performed when installing or replacing the camera.

[0067] However, since the camera is installed to the side and rear of the loading / unloading area, it is also to the side and rear of the loading section. When the camera and the loading section are in such a relationship, the image captured by the camera is more likely to be distorted in the front-to-back direction than in the up-to-down direction. Therefore, it is more preferable to select a camera whose angle of view in the horizontal direction exceeds the minimum value (θH).

[0068] Specifically, it is preferable to select a camera for use in the load management method and device of the present invention that has a horizontal angle of view that is 10% or more greater than the minimum value θH. In this case, the vertical angle of view may be greater than or equal to the minimum value θV.

[0069] In consideration of the above-mentioned preferred embodiment, it can be said that the load management method of the present invention more preferably includes the steps (0) and (02) of selecting a camera as a preceding step to the step (1). (0) calculating a minimum value of the angle of view in the horizontal direction (θH) based on the above formulas [1] to [3], and calculating a minimum value of the angle of view in the vertical direction (θV) based on the above formulas [4] to [6]; (02) A step of selecting a camera whose angle of view is 10% or more greater than the minimum value (θH) in the horizontal direction and is equal to or greater than the minimum value (θV) in the vertical direction. In this case, steps (0) and (02) need to be performed only when installing or replacing the camera.

[0070] In the step (1) of the load management method of the present invention, a loading image of the loading section of the truck is acquired using the camera. The loading image may be a still image or a still image acquired from a video. In other words, the camera may be capable of capturing only still images or may be capable of capturing video.

[0071] The camera needs to capture at least one loading image for each loading section of each truck in the loading / unloading area, but it is preferable to capture multiple loading images over time. As described above, the amount of cargo in the loading section changes relatively quickly both at the time of collection and at the time of delivery. However, by capturing multiple loading images captured over time, it is possible to follow the change in the amount of cargo at the time of collection and delivery with high accuracy, and it is advantageous to be able to reliably capture the maximum amount of cargo.

[0072] The amount of cargo in the loading section is greatest immediately after unloading begins, specifically, immediately after the wings of the truck open, on collection flights, and is greatest immediately before loading of the cargo is completed, specifically, immediately before the wings of the truck close, on delivery flights. For this reason, it is preferable that the above-mentioned multiple loading images, in the case of a collection service, include loading images immediately after the truck's wings have completed opening, and more specifically, it is particularly preferable to include loading images within 180 seconds, 120 seconds, 60 seconds, or 30 seconds after the truck's wings have completed opening. In addition, in the case of delivery trucks, it is preferable that the loading images include an image taken immediately before the wings of the truck begin to close, and more specifically, it is particularly preferable that the loading images include an image taken within 180 seconds, 120 seconds, 60 seconds, or 30 seconds before the wings of the truck begin to close.

[0073] In the load amount management method of the present invention, the loading image acquired in the above step (1) is used to calculate the current load amount in step (2). The loading image may be further used to calculate the additional load amount in step (3). The load management device of the present invention includes a load management element for carrying out the step (2) and, if necessary, the step (3). Specifically, the load management element is connected to a camera by wire or wirelessly, and acquires a load image acquired and transmitted by the camera. Then, the load image is subjected to image analysis to calculate the current load and, if necessary, the load that can be added.

[0074] The load management element may have any of these functions, and its structure and configuration are not particularly limited. For example, the load management element may be a computer having a calculation and control device such as a CPU, and a storage device such as a memory or a hard disk.

[0075] In the load management method and load management device of the present invention, the loading image corresponding to each truck in each loading / unloading area may be transmitted to the same load management element to calculate the current load of each truck, and if necessary, the load management element may further calculate the additional load. Alternatively, the loading image corresponding to each truck in each loading / unloading area may be transmitted to different load management elements to calculate the current load of each truck, and if necessary, the load management element may further calculate the additional load.

[0076] The current load amount and the additional load amount calculated based on each loading image are information useful for load amount management. Therefore, in either case, the current load amount and the additional load amount are finally collected and processed. Therefore, each camera and the load amount management element are connected by wire or wirelessly to form a network.

[0077] In other words, the load management device of the present invention can be said to have a network in which each camera and load management element are connected by wire or wirelessly. And, even when the loading image corresponding to each truck is processed by different load management elements to calculate the current load and calculate the additional load as necessary, each load management element can be said to form a network and function as one load management element.

[0078] In step (2) of the load management method of the present invention, a current load amount is calculated based on the loaded image acquired in step (1). The current load amount includes the amount of luggage actually loaded on the loading section, the amount of pallets actually loaded on the loading section, and the amount of luggage gap including the gaps between the luggage, the gaps between the pallets, and the gaps between the luggage and the pallets. The term "pallet" as used herein means a platform for simultaneously transporting multiple loads using a mobile lift device such as a forklift. In the load management method of the present invention, the current load amount is calculated based not only on the amount of loads actually loaded on the loading section, but also on the amount of the pallet, and the load gap amount, i.e., the gap amount between loads, the gap amount between pallets, and the gap amount between loads and pallets.

[0079] A method for calculating the current load amount based on the loaded image may be a method for processing the loaded image. As a program, application, or software used for the image processing, any program, application, or software having the functions required for the desired image processing may be used.

[0080] First, in the load management method and device of the present invention, the loading section of a truck is imaged from the side and rear. The loading section of a typical truck is rectangular, but in the loading image, the loading section has a distorted quadrangle shape in which the front side is smaller than the rear side. For this reason, when processing the load image, it is preferable to first perform processing to return the distorted load portion to a rectangular shape, and then calculate the current load amount based on the obtained image, that is, the processed load image.

[0081] For example, assuming that the truck is a large vehicle such as a 10-ton truck, a wide-angle camera is required to capture the entire load within the viewing angle from a close enough distance to identify the load. However, by performing the above image processing, it is no longer necessary to select a camera with an excessively large viewing angle for acquiring the load image, and there is an advantage in that the cost required for the camera can be reduced. For reference, the horizontal viewing angle of the camera used in Example 1 described later is 100 to 120°.

[0082] The processed loading image is an image in which the loading portion in the loading image has been processed to form a rectangle, and the loading portion to be processed is preferably, specifically, the area inside the outer edge of the loading portion described above, including the outer edge of the loading portion.

[0083] In the load amount management method and load amount management device of the present invention, the load amount management element is used to calculate the current load amount based on the load image. In this case, if the load image is processed to obtain a processed load image as described above, the current load amount can be calculated based on the processed load image. Hereinafter, unless otherwise specified, the load image and the processed load image are collectively referred to as the load-related image.

[0084] The load management element distinguishes between luggage, pallets, and load gaps in the load-related image. The determination may be made based on data stored in advance in the load management element, or based on data stored in an external database that the load management element can access, and the determination mechanism, determination criteria, etc. are not particularly limited.

[0085] Then, based on the cargo, pallets and cargo gaps in the load-related image determined as described above, the amount of cargo, the amount of pallets and the amount of cargo gaps in the load-related image are calculated.

[0086] The method of calculating each amount is not particularly limited, and for example, the amount may be calculated based on the area of ​​the luggage or the like displayed in the loading-related image, or other methods may be used.

[0087] A suitable method for calculating each amount is to obtain an integrated pixel number by accumulating the pixel numbers of the luggage, pallets, and luggage gaps in the loading-related image, and to calculate the current luggage amount based on the integrated pixel number. If the relationship between the pixel number in the loading-related image and the area of ​​the luggage, etc. loaded in the loading section is obtained in advance, it is possible to easily calculate the current luggage amount based on the integrated pixel number.

[0088] When a plurality of loading images are acquired, it is advisable to calculate a provisional current load amount for each loading-related image and adopt the largest of these as the current load amount.

[0089] Alternatively, when multiple loading images are acquired, the loading image captured closest to the completion of the wing opening operation may be used for the collection flight, and the current load amount may be calculated based on that loading-related image. Similarly, when multiple loading images are acquired, in the case of a delivery flight, the loading image captured closest to the start of the wing closing operation may be used, and the current cargo volume may be calculated based on that loading-related image.

[0090] Furthermore, when multiple loading images are acquired, in the case of a collection service, a tentative current loading volume may be calculated for each loading-related image, and the tentative current loading volume calculated based on the loading-related image captured at the point closest to the completion of the wing opening operation may be adopted as the current loading volume. Similarly, when multiple loading images are acquired, in the case of a delivery flight, a provisional current load volume can be calculated for each loading-related image, and the provisional current load volume calculated based on the loading-related image captured at the time closest to the start of the wing closing operation can be used as the current load volume.

[0091] In addition, when cameras are installed on both sides of the loading / unloading area and images of the loading section are taken from both sides, a provisional current cargo volume can be calculated for each side, and the current cargo volume can be calculated based on these two provisional current cargo volumes.

[0092] In the step (3) of the cargo amount management method of the present invention, an additional cargo amount is calculated based on the current cargo amount acquired in the step (2). As described above, the additional cargo amount means the amount of cargo that can be further loaded onto a truck that is already loaded with cargo.

[0093] In the cargo volume management method of the present invention, the additional cargo volume may be expressed simply as the volume equivalent to the free space in the loading section, or it may be converted into the amount of luggage, amount of pallets, and amount of cargo gaps that can be accommodated in the free space.

[0094] In either case, according to the cargo volume management method of the present invention, the current cargo volume obtained in step (2) approximately coincides with the space in the loading section that is actually being used at the time of imaging, and therefore the addable cargo volume obtained in step (3) also approximately coincides with the cargo volume that can actually be added to the loading section, i.e., the true addable cargo volume.

[0095] In other words, the load management method of the present invention can reduce the difference between the apparent load that can be added and the true load that can be added. And, by feeding back the load that can be added obtained in the (3) step and performing load management, it is possible to sufficiently increase the loading rate of trucks and efficiently transport cargo.

[0096] The load management device of the present invention includes a camera having the components described above in (1-1) and a load management element having the components described above in (1-4).

[0097] Of these, the camera is an element for carrying out step (1) in the load management method of the present invention, and is the same as the camera used in the load management method of the present invention described above. The load management elements are elements for carrying out steps (2) and (3) in the load management method of the present invention, and are the same as the load management elements used in the load management method of the present invention described above.

[0098] Incidentally, in order to improve the loading rate of trucks and transport cargo efficiently, it is essential to link the truck's route and service with the truck's loading information, such as the loading-related images, current loading volume, and possible additional loading volume, with a high degree of accuracy.

[0099] In conventional cargo volume management methods, for example, a truck route or service and a truck number are registered in advance, and the above-mentioned truck loading information is linked to the truck number, thereby linking the truck route and service linked to the truck number with the truck loading information.

[0100] With this method, if a truck other than one that has been registered in advance is used, for example if another truck is used as a loaner while the current truck is being maintained, the number of the truck used will not be linked to the truck's route or trip, making it impossible to grasp the loading information of each truck, and ultimately making it impossible to manage the amount of cargo on each trip.

[0101] In the cargo volume management method of the present invention, the above-mentioned problems can be addressed by using a mobile lift device captured in a load-related image to link a truck's route and flight name with the loading information of the truck.

[0102] In this specification, the mobile lift device means a device for transporting cargo between a warehouse or the like and a loading section of a truck, and for loading and unloading the cargo onto and from the loading section of a truck. An example of the mobile lift device is a forklift.

[0103] In this case, it is advisable to link the truck's route and flight name with individual information about the mobile lift device when the luggage is collected or delivered and before an image of the loading section of the truck is captured.

[0104] Usually, when a package is collected or delivered, the truck to be used for the collection or delivery of the package, as well as its operating route and flight number, have already been determined. On the other hand, the mobile lift device travels along the side of the load section of a truck when loading and unloading cargo, and therefore the mobile lift device is frequently captured in images of the load section.

[0105] Therefore, if the truck's operating route and flight name are linked to the individual information of the mobile lift device when the cargo is collected or delivered and before the loading section of the truck is imaged, it is possible to easily and reliably link the truck's loading information to the corresponding truck's operating route and flight name based on the individual information of the mobile lift device captured in the loading-related image.

[0106] Therefore, in this case, it is possible to fully respond to changes in the trucks used, and the loading information of each truck can be grasped with high accuracy for each route and trip, and ultimately it is possible to perform load management that optimizes the load on each trip. In addition, for example, when the flight name includes information about the route, it may be sufficient to link the truck flight name with the individual information of the mobile lift device at the time of collection or delivery of the luggage and before imaging the loading section of the truck.

[0107] Typically, when a package is collected or delivered, a worker rents a mobile lifting device at a loading / unloading depot for use in loading or unloading a truck. It is reasonable to link the truck route and flight number with the individual information of the mobile lifting device at this time. Hereinafter, as necessary, the task of linking the truck's route and flight name with the individual information of the mobile lift device may be referred to as the task of linking the mobile lift device.

[0108] The above-mentioned mobile lift device linking work may be performed by a driver, a receptionist, etc. Alternatively, the load management device may be provided with a truck recognition element that recognizes individual information of the truck and a lift device recognition element that recognizes individual information of the mobile lift device, and the work may be performed automatically by the load management device.

[0109] In either case, it is preferable that the information linking the truck route and name with the individual information of the mobile lift device is shared with the load management element. Therefore, even if the driver or the like performs the linking work of the mobile lift device, it is preferable that the information is registered in the load management element.

[0110] The individual information of the truck mentioned above refers to information for identifying each individual truck, and specifically, the truck's operating route and flight name are essential, and may also include the truck's license plate number, the truck's vehicle number, the engine number of the engine installed in the truck, etc.

[0111] For the binding work of the above-mentioned mobile lift device, it is preferable to use an ID card (so-called truck card) or various identification tags that store at least one of the individual information of the above-mentioned truck as an IC tag, FID tag, QR code (registered trademark), barcode, etc.

[0112] The individual information of the mobile lift device mentioned above refers to information for identifying each individual mobile lift device, and specific examples thereof include the vehicle identification number, serial number, and vehicle number of the mobile lift device, but are not limited to these.

[0113] For the binding work of the mobile lift device, it is preferable to use a key of the mobile lift device that is bound to at least one of the individual information of the mobile lift device. Alternatively, it is also preferable to use an ID card or various identification tags that store at least one of the individual information of the mobile lift device as an IC tag, FID tag, QR code (registered trademark), barcode, etc.

[0114] For example, when a truck driver arrives at a loading / unloading point, he or she presents the ID card corresponding to the truck being used at the reception desk and receives a key to the mobile lift device in exchange. At this time, the individual information of the truck stored in the truck's ID card is linked to the individual information of the mobile lift device linked to the key of the mobile lift device. Since unloading from or loading onto a truck parked or stopped in the loading area is performed by a mobile lift device, this is naturally done after the above-mentioned work of linking the mobile lift device is completed.

[0115] This allows the above-mentioned mobile lift device linking operation to be performed reliably when the load of the truck is collected or delivered and before the image of the load of the truck is captured. After that, the truck's route and flight name can be linked to the load information of the truck easily and reliably based on the load-related images acquired during loading or unloading and the individual information of the mobile lift device captured in the load-related images.

[0116] In addition, in the cargo volume management method and cargo volume management device of the present invention, it is preferable to use individual information of the mobile lift device reflected in the loading-related image as a method of linking a truck's operating route and flight name with the loading information of the truck, but other methods may also be adopted.

[0117] As another method other than the above, for example, a method of linking the stay period of a truck in a loading / unloading area with the load-related images captured during that period can be adopted.

[0118] Specifically, by capturing and monitoring images of the loading / unloading area or its vicinity with a camera, the time when the truck enters the loading / unloading area and the time when it leaves the loading / unloading area are obtained, and the first stay period [a] is obtained.

[0119] On the other hand, the reception time of the truck when it enters the loading / unloading area and the reception time of the truck when it leaves the loading / unloading area are obtained to obtain a second stay period [b]. At this time, individual information of the truck is obtained by reception work using a truck card or the like.

[0120] By linking the individual information of the truck obtained at the time of reception with the loading information of the truck obtained during the first stay period [a] or the loading information of the truck obtained during the second stay period [b], it is possible to link the truck's operating route and flight name with the loading information of the truck.

[0121] Generally, after the truck driver enters the loading / unloading area, he / she performs reception work at the time of entry using a truck card or the like, and after performing reception work at the time of exit using a truck card or the like, he / she leaves the loading / unloading area. Therefore, the above-mentioned truck stay period [b] is shorter than the truck stay period [a].

[0122] Therefore, the period during which the truck actually stays in the loading / unloading area is the truck's stay period [a], while the individual truck information used for linking was obtained during the truck's stay period [b], resulting in a time lag between the two. For this reason, when truck reception is congested, there is a risk that the truck's loading information will be linked to the individual information of other trucks that were received in the same period, rather than to the individual information of the truck to which it should be linked.

[0123] A typical loading and unloading base has many loading and unloading areas, and many trucks enter the corresponding loading and unloading areas and perform loading and unloading work at the same time. Therefore, when linking individual truck information and truck loading information using only the truck's stay period [a] or stay period [b] as described above, it may be difficult to accurately link the individual information of multiple trucks that are accepted at the same time or with a sufficient interval between them with the truck loading information that should be linked.

[0124] As described above, when the method of using the linking work of a mobile lift device is adopted as a method of linking a truck's route and flight name with the loading information of the truck, it is possible to accurately link the individual information of each truck with the loading information of the truck, even if a large number of trucks are accepted at the same time or with sufficient intervals between them.

[0125] When using the linking work of a mobile lift device to link a truck's operating route and flight name with the loading information of the truck, in order to easily identify a mobile lift device that appears in a loading-related image, it is preferable for the mobile lift device to directly display its own individual information or to display an identifier linked to the individual information of the mobile lift device. Any identifier may be used as the identifier, but considering that the identifier is to be identified within the load-related image, it is particularly suitable to select an AR (Augmented Reality) marker.

[0126] For example, an identifier such as an AR marker can be displayed at a position on the mobile lift device that can be imaged by a camera, and when the mobile lift device is performing loading or unloading operations, the mobile lift device is captured in a loading-related image together with the identifier. As a position of the mobile lift device that can be imaged by the camera, it is preferable to select a side surface or an upper surface of the mobile lift device.

[0127] Here, if cameras are installed on both sides of a loading / unloading area, for example, a camera installed on the right side of the loading / unloading area in the direction of vehicle travel will capture a mobile lift device loading or unloading cargo from the right side of the truck onto the loading section. On the other hand, a camera installed on the left side of the loading / unloading area in the direction of vehicle travel captures a mobile lift device that loads or unloads cargo from the left side of the truck onto the loading section.

[0128] A loading and unloading hub has many loading and unloading areas, and often one loading and unloading area has other loading and unloading areas next to it. The work target of the mobile lift device captured in the loading-related image may be one of the two loading / unloading areas or the other. However, if the mobile lift device is, for example, a forklift, it can be determined that the direction in which the forks are pointed is the loading / unloading area that is the work target.

[0129] In other words, in this case, by linking the loading / unloading area in which the forks of the mobile lift device are pointed in the loading-related image with the identifier of the mobile lift device, the loading information of the truck in that loading / unloading area can be easily and reliably linked to the truck's operating route and flight number.

[0130] Considering the positional relationship of the mobile lift device to the loading / unloading area and the loading section as described above, it is preferable that the identifiers be displayed on both sides of the mobile lift device.

[0131] When identifiers are displayed on both sides of a mobile lift device, each identifier preferably has at least two kinds of information: the individual information of the mobile lift device described above, and directional information. Of these, it is preferable that the directional information displayed on one side of the mobile lift device is different from the directional information displayed on the other side. For example, it is preferable that the identifier displayed on the left side of the mobile lift device includes information that identifies that side as the left side. It is preferable that the identifier displayed on the right side of the mobile lift device includes information that identifies that side as the right side.

[0132] It is not necessary for the mobile lift device to appear in all loading-related images, because, for example, if loading-related images captured by the same camera are linked, even if the loading-related image does not include the mobile lift device, the loading information of the truck based on the loading-related image can be easily linked to the truck's operating route and flight name.

[0133] As a method for determining the orientation of the forks in the above-described mobile lift device, a method using an identifier such as an AR marker can be adopted.

[0134] Specifically, by incorporating directional information in the identifier and comparing the reference direction in the loading-related image with the directional information in the identifier reflected in the loading-related image, it is possible to determine the direction of the forks in the mobile lift device. Alternatively, the direction of the fork may be determined by actually recognizing the mobile lift device and its fork in the load-related image through image analysis. The method of determining the direction of the fork is not limited to this, and various other methods can be adopted.

[0135] The load management method and load management device of the present invention will be described below with reference to specific examples.

[0136] Example 1 FIG. 1 is an explanatory diagram for explaining the positional relationship of a loading / unloading base, a loading / unloading area, a truck, a loading section, luggage, and a camera in the load management method and load management device of the first embodiment. FIG. 2 is an explanatory diagram for explaining the state in which a load image is acquired by a camera in the load management method and load management device of the first embodiment. FIG. 3 is an explanatory diagram for explaining the load image acquired by the load management method and load management device of the first embodiment. FIG. 4 is an explanatory diagram for explaining the state in which a processed load image is acquired from a load image acquired by the load management method and load management device of the first embodiment. FIG. 5 is an explanatory diagram for explaining luggage in the processed load image acquired by the load management method and load management device of the first embodiment. FIG. 6 is an explanatory diagram for explaining the current load calculated based on the processed load image acquired by the load management method and load management device of the first embodiment. FIG. 7 is an explanatory diagram for explaining the additional load calculated based on the processed load image acquired by the load management method and load management device of the first embodiment. Fig. 8 is an explanatory diagram for typically explaining the mobile lift device and identifier used in the load management method and load management device of the embodiment 1. Fig. 9 is a flow chart for typically explaining the load management method of the embodiment 1.

[0137] The load management device 1 of the first embodiment includes a camera 2 and a load management element 3 connected to the camera 2 .

[0138] Of these, camera 2 includes the following components (1-1). (1-1) Cameras 2 are installed on the sides and rear of a loading / unloading area 93 of a truck 92 at a loading / unloading base 91 for luggage 90, and capture loading images Im0 of the loading section 94 of the truck 92.

[0139] The load management element 3 also has the following components (1-5). (1-5) A load management element 3 that calculates a current load amount 97 based on the loading image Im0, the current load amount 97 including the amount of luggage 90 actually loaded in the loading section 94, the amount of pallets 95 actually loaded in the loading section 94, and the amount of load gaps 96 including the gaps between the luggage 90, the gaps between the pallets 95, and the gaps between the luggage 90 and the pallets 95, and further calculates an additional load amount 98 that can be added to the loading section 94 based on the current load amount 97.

[0140] The loading / unloading base 91 is provided with a number of loading / unloading areas 93. As shown in Fig. 1, each loading / unloading area 93 is an area in which trucks 92 can be parked, and is surrounded by lines drawn on the floor of a building. When a truck 92 enters the warehouse, it is inside the loading / unloading area 93, and when it leaves the warehouse, it leaves the loading / unloading area 93.

[0141] Two cameras 2 are disposed for each loading / unloading area 93. One camera 2 is disposed to the left and rear of the loading / unloading area 93, and the other camera 2 is disposed to the right and rear of the loading / unloading area 93.

[0142] The camera 2 is selected so that its angle of view is equal to or greater than the minimum value (θH) in the horizontal direction shown in FIG. 10 and equal to or greater than the minimum value (θV) in the vertical direction shown in FIG.

[0143] As shown in Figure 2, one camera 2 acquires a loading image Im0 captured from the right side (driver's side) of the loading section 94 of the truck 92, and the other camera 2 acquires a loading image Im0 captured from the left side (passenger's side) of the loading section 94 of the truck 92.

[0144] The load management element 3 is a computer equipped with AI, and each camera 2 is controlled by the load management element 3 to capture a loading image Im0 as a video. The loading image Im0 captured by the camera 2 is transmitted to the load management element 3 and stored.

[0145] The load management element 3 performs image processing on the loading image Im0 to detect the opening and closing operations of the wings 99 of the truck 92. When the truck 92 is a cargo collection truck, still images of the loading image Im0 are acquired from the above moving image of the loading image Im0 every 30 seconds for a total of four times over a period of two minutes after the wings 99 of the truck 92 have completed the opening operation. If the truck 92 is a delivery truck, still loaded images Im0 are acquired from the moving loaded image Im0 a total of four times every 30 seconds for two minutes before the wings 99 of the truck 92 start closing. Then, image processing is performed on the stacked images Im0 of the plurality of still images to obtain a processed stacked image Im1.

[0146] The interval for acquiring the still loaded image Im0 may be appropriately set based on the operating speed and moving speed of the mobile lift device 4 so that the mobile lift device 4 is not captured in the loaded image Im0 to be subjected to image processing. In the first embodiment, the still loaded image Im0 was acquired at 30-second intervals corresponding to the mobile lift device 4 operated by the work vehicle. However, if the mobile lift device 4 is automatically operated, its operating speed and moving speed are set slower based on the safety factor compared to an experienced worker, so it is preferable to make the interval for acquiring the loaded image Im0 longer.

[0147] Here, as shown in FIG. 3, the loading section 94 of the truck 92 has a substantially trapezoidal shape in the loading image Im0, with the rear side in the vehicle travel direction being larger and the front side in the vehicle travel direction being smaller. The load amount management element 3 processes the loading image Im0 by image processing so that at least the loading portion 94 becomes rectangular, and obtains a processed loading image Im1 (see FIG. 4).

[0148] As shown in FIG. 5, a loading section 94 appears in the processed loading image Im1, and the luggage 90 and pallets 95 loaded on the loading section 94 also appear in the processed loading image Im1.

[0149] The load amount management element 3 calculates a current load amount 97 based on the processed loading image Im1 (see FIG. 6). The current load amount 97 includes the amount of luggage 90 actually loaded on the loading section 94, the amount of pallets 95 actually loaded on the loading section 94, and the amount of load gaps 96. The load gaps 96 are the remaining gaps in the loading section 94 where new luggage 90 or pallets 95 cannot be loaded, and include the gaps between luggage 90, the gaps between pallets 95, and the gaps between luggage 90 and pallets 95.

[0150] The load amount management element 3 calculates a tentative current load amount 97 for each of the plurality of processed load images Im1. At this time, the load amount management element 3 obtains an integrated pixel number obtained by integrating the number of pixels of the luggage 90, the number of pixels of the pallet 95, and the number of pixels of the load gap 96 in the processed load image Im1, and calculates the tentative current load amount 97 based on the integrated pixel number. Then, the load amount management element 3 compares each of the tentative current load amounts 97, and sets the largest value among them as the current load amount 97. Furthermore, the load amount management element 3 associates the current load amount 97 with the loading image Im0 used to calculate the current load amount 97 and stores the current load amount 97.

[0151] The load management element 3 calculates an additional load amount 98 that can be added to the loading section 94 based on the current load amount 97 (see FIG. 7). Then, the additional load amount 98 is collected for each route and trip of the truck 92, and when the truck 92 is next dispatched, the additional load amount 98 is fed back to perform load management. This allows the loading rate of the truck 92 to be sufficiently increased.

[0152] Incidentally, in the cargo volume management device 1 of Example 1, the above-mentioned “method of using individual information of the mobile lift device 4 captured in the loading-related image” is adopted as a method for linking the operating route and flight name of the truck 92 with the loading information of the truck 92.

[0153] For this reason, as shown in Fig. 8, the mobile lift device 4 displays an identifier 40 linked to individual information of the mobile lift device 4. Specifically, the identifier 40 is an AR marker. The identifiers 40 are arranged at three locations on both side surfaces and the top surface of the mobile lift device 4.

[0154] The load management element 3 links the loading information of the truck 92, such as the current load 97 and the additional load 98, to the individual information of the truck 92, based on the identifier 40 of the mobile lift device 4 reflected in the processed loading image Im1. This allows the loading information of each truck 92 to be accurately linked to the operating route and flight name of the truck 92.

[0155] The load management method of the first embodiment will be described below with reference to the flow chart shown in FIG.

[0156] When a truck 92 enters the loading / unloading area 93 of the loading / unloading base 91, the driver of the truck 92 first performs reception work (S1). At this time, the truck card is read by a scanner, and the individual information of the truck 92 registered on the truck card is entered into the load management element 3 (S2). Also at this time, the driver borrows a key for the mobile lift device 4. At this time, the key borrowing card is read by a scanner, and the individual information of the mobile lift device 4 corresponding to the key is entered into the load management element 3 (S3).

[0157] At the loading / unloading base 91, the cameras 2 installed on both sides of the loading / unloading area 93 face the loading / unloading area 93 and constantly capture video (S4). The video is separated into a video captured from the driver's seat side of the loading / unloading area 93 and the space above it, and a video captured from the passenger's seat side, and these are stored in the cargo amount management element 3 (S2, S3).

[0158] The load management element 3 monitors the video and judges whether the truck 92 is in the loading / unloading area 93 of the truck 92. When the load management element 3 judges that the truck 92 has entered the loading / unloading area 93 (S5), it stores the entry time (S6) and judges whether the wing 99 of the truck 92 has been opened (S7). When it judges that the wing 99 of the truck 92 has been opened, the camera 2 on the driver's seat side and the passenger seat side acquires a still image of the load Im0 every 30 seconds for a total of four times for two minutes after the wing 99 of the truck 92 has completed the opening operation. Thereafter, it continues to accumulate the video until it judges that the wing 99 has been closed, and when it judges that the wing 99 has been closed, it acquires a still image of the load Im0 every 30 seconds for a total of four times for two minutes before the wing 99 of the truck 92 starts the closing operation. Then, a tentative current load amount 97 is calculated based on the still image of each loading image Im0, and the tentative current load amounts 97 are compared to determine the current load amount 97, and further, an addable load amount 98 is calculated from the current load amount 97 (S8, S9).

[0159] Furthermore, the load management element 3 monitors the video and judges whether the mobile lift device 4 is captured (S10). If it is judged that the mobile lift device 4 is present in the video, it judges the orientation of the mobile lift device 4 relative to the loading / unloading area 93 and the loading section 94. If it is judged that the mobile lift device 4 is loading / unloading the baggage 90 from the loading section 94 that is the subject of the image, it calls up the individual information of the mobile lift device 4 and the individual information of the truck 92 linked thereto based on the identifier 40 of the mobile lift device 4 captured in the image. Then, depending on whether the corresponding truck 92 is a delivery or collection flight, it extracts the current load amount 97 and the additional load amount 98 corresponding to the situation from the multiple current load amounts 97 and additional load amounts 98 calculated in S8 and S9. Then, the loading information of the truck 92 and the individual information of the truck 92 are linked and stored in the load management element 3. The load management element 3 collects the information for as many routes and trips as possible, and performs load management to increase the loading rate of the truck 92 by feeding back the information when the truck 92 is next dispatched.

[0160] According to the cargo volume management method and cargo volume management device 1 of the embodiment, it is possible to reliably grasp the current cargo volume 97 and additional cargo volume 98 of each truck 92, thereby improving the loading rate of the truck 92 and efficiently transporting the cargo 90.

[0161] Although the present invention has been described above, the present invention is not limited to the above-described embodiments, and it is possible to implement the present invention by appropriately extracting and combining elements described in the embodiments, and to make various modifications without departing from the spirit of the present invention. Furthermore, the specification of the present invention discloses not only the citation relationships of each claim at the time of the initial application, but also a technical idea that appropriately combines the matters described in each claim. [Explanation of symbols]

[0162] 2: Camera 3: Load management elements 4: Mobile lift device 40: Identifier (AR marker) 90: Luggage 91: Loading and unloading point 92: Truck 93: Loading / unloading area 94: Loading section 95: Pallet 96: Load gap 97: Current load 98: Additional load capacity 99: Wing Im0: Loaded image Im1: Processed loaded image

Claims

1. Obtaining a loading image of a loading section of the truck using cameras installed on the sides and rear of a loading / unloading area of ​​the truck at a loading / unloading base of the luggage, A cargo volume management method for calculating a current cargo volume based on the loading image, the current cargo volume including the amount of cargo actually loaded on the loading section, the amount of pallets actually loaded on the loading section, and the amount of cargo gaps including gaps between the cargo, gaps between the pallets, and gaps between the cargo and the pallets.

2. The load amount management method according to claim 1 , further comprising the step of: calculating the current load amount based on a processed load image in which the load portion in the load image is processed so as to have a rectangular shape.

3. 3. The cargo amount management method according to claim 1, wherein the cameras are installed on both sides of the loading / unloading area.

4. The method for managing cargo amount according to claim 1 or 2, wherein the camera captures a plurality of the loaded images over time.

5. The plurality of loading images are In the case of a collection service, the loading image includes the loading image within 120 seconds after the completion of the opening operation of the wings of the truck, The method for managing cargo volume according to claim 4, wherein in the case of a delivery truck, the loaded image includes a load image taken within 120 seconds before the start of a closing operation of the wings of the truck.

6. The cargo amount management method according to claim 2 , further comprising the steps of: acquiring an integrated pixel number by accumulating the pixel numbers of the cargo, the pallet, and the cargo gap in the processed loaded image; and calculating the current cargo amount based on the integrated pixel number.

7. Before imaging the loading section of the truck, the truck's operating route and flight name are linked to individual information of a mobile lift device for loading and unloading the luggage on the loading section and / or transporting the luggage, A cargo volume management method as described in claim 1 or claim 2, further comprising obtaining individual information of the mobile lift device based on an image of the mobile lift device captured in the loading image, and linking the route and flight name to the current cargo volume.

8. An AR marker is installed on the mobile lift device, The load management method according to claim 7 , further comprising the step of acquiring individual information of the mobile lift device captured in the loaded image by using the AR marker.

9. cameras installed at the sides and rear of a loading / unloading area of ​​a truck at a loading / unloading base for loading and unloading luggage, for capturing images of a loading section of the truck; A cargo amount management device comprising: a cargo amount management element that calculates a current cargo amount based on the loading image, the amount of cargo actually loaded on the loading section, the amount of pallets actually loaded on the loading section, and the amount of cargo gaps including gaps between the cargo items, gaps between the pallets, and gaps between the cargo items and the pallets.

Images