Loading assistance device, loading assistance method, and program

Abstract

This loading assistance device (109) comprises: a first acquiring unit (115) that acquires cargo information (114) about respective pieces of cargo (101_a) included in an unloaded cargo group; a second acquiring unit (116) that acquires loading information that indicates a current loading status of a loading space; a determining unit (117) that uses the cargo information and the loading information to determine the cargo to be loaded next in the loading space; and an output control unit (118) that causes a monitor (110) that serves as a first output means to output cargo designation information for designating the cargo (101_a) to be loaded next.

Description

[Technical Field]

[0001] The present invention relates to a loading assistance device, a loading assistance method, allusion to law and programs. [Background technology]

[0002] In order to increase the transport efficiency in transporting cargo, it is important to load as much cargo as possible onto a container, truck bed, etc. For example, Patent Document 1 discloses a loading operation support system that specifies the position at which an object to be loaded into a specified space should be loaded. Patent Document 1 describes that this makes it possible to increase the filling rate of the specified space (loading space) into which cargo is loaded. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2020 / 009024 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, at a base for trunk truck transportation, a large amount of cargo collected from a specific area is generally sorted by destination and transported to a transport location near the truck's stop by a conveyor or other means. The cargo then arrives at the transport location and is carried by a driver or other worker from the transport location and loaded onto the truck bed or elsewhere.

[0005] In such a loading operation, the cargo may be delivered to the transport location one after another, so it is desirable to load the cargo from the transport location onto the truck one after another as quickly as possible while taking into consideration the loading rate of the cargo on the truck bed, etc.

[0006] However, even if the technology described in Patent Document 1 could provide a technology for increasing the filling rate of the loading space, it would be difficult to improve the efficiency of loading operations, including quickly loading cargo from the transport location onto the bed of a truck, etc.

[0007] The present invention has been made in view of the above circumstances, and one of its objects is to improve the efficiency of cargo loading operations. [Means for solving the problem]

[0008] In order to achieve the above object, a loading assistance device according to a first aspect of the present invention comprises: a first acquisition means for acquiring baggage information of each baggage included in the group of unloaded baggage; A second acquisition means for acquiring loading information indicating a current loading status of the loading space; a determining means for determining the next cargo to be loaded into the loading space using the cargo information and the loading information; and an output control means for causing the first output means to output cargo designation information for designating the cargo to be loaded next.

[0009] In order to achieve the above object, a loading assistance system according to a second aspect of the present invention comprises: a first acquisition means for acquiring baggage information of each baggage included in the group of unloaded baggage; A second acquisition means for acquiring loading information indicating a current loading status of the loading space; a determining means for determining the next cargo to be loaded into the loading space using the cargo information and the loading information; and a first output means for outputting cargo designation information for designating the cargo to be loaded next.

[0010] In order to achieve the above object, a loading assistance method according to a third aspect of the present invention comprises: Acquire information about each of the unloaded luggage items included in the group of unloaded luggage items; Obtaining loading information indicating the current loading status of the loading space; Using the luggage information and the loading information, determine the luggage to be loaded next into the loading space; The first output means is caused to output cargo designation information for designating the cargo to be loaded next.

[0011] In order to achieve the above object, a program according to a fourth aspect of the present invention comprises: On the computer, Acquiring baggage information for each of the bags included in the group of unloaded bags; obtaining loading information indicating a current loading status of the loading space; determining a next cargo to be loaded into the loading space using the cargo information and the loading information; and causing the first output means to output cargo designation information for designating the cargo to be loaded next. [Effects of the Invention]

[0012] According to the present invention, it is possible to improve the efficiency of cargo loading operations. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram showing a configuration of a loading assistance system according to a first embodiment of the present invention. [Figure 2] 1 is a diagram illustrating a functional configuration of a luggage management device according to a first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of the configuration of package information according to the first embodiment. [Figure 4] 1 is a diagram showing a functional configuration of a loading support device according to a first embodiment. [Figure 5] 1 is a diagram showing a physical configuration of a loading support device according to a first embodiment. [Figure 6] 5 is a flowchart showing an example of a loading support process according to the first embodiment of the present invention. [Figure 7] 5 is a flowchart showing an example of a loading support process according to the first embodiment of the present invention. [Figure 8] FIG. 10 is a diagram showing the configuration of a loading support system according to a second modification. [Figure 9]FIG. 10 is a diagram showing the physical configuration of a display device according to Modification 2. [Figure 10] 10 is a flowchart showing an example of a loading support process according to a second modification. [Figure 11] FIG. 10 is a diagram showing the configuration of a loading assistance system according to a second embodiment of the present invention. [Figure 12] FIG. 10 is a diagram illustrating a functional configuration of a luggage management device according to a second embodiment. [Figure 13] FIG. 10 is a diagram showing an example of the configuration of package information according to the second embodiment. [Figure 14] FIG. 10 is a diagram showing a functional configuration of a loading support device according to a second embodiment. [Figure 15] 10 is a flowchart showing an example of a loading support process according to the second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, like components are designated by like reference numerals, and the description thereof will be omitted as appropriate.

[0015] <<Embodiment 1>> <Configuration of Loading Assist System 100> As shown in FIG. 1, a loading assistance system 100 according to the first embodiment of the present invention is a system for assisting a loading operation in which cargo 101 is loaded into a loading space.

[0016] The cargo 101 is an object to be loaded into a loading space. The loading space is a predetermined space, such as a loading platform 103 of a truck 102, a container, a warehouse, or the like, the perimeter of which is partitioned.

[0017] In this embodiment, an example will be described in which the loading space is provided in a loading platform 103 of a truck 102 for highway transportation. In general highway transportation, cargo 101 in a predetermined area is collected at a base, and a large amount of cargo is transported collectively from the base to another base.

[0018] At the base, the packages 101 collected in the corresponding area are sorted according to their destinations (hereinafter also referred to as "transportation destinations") and transported to a transport location 104 by a conveyor 105 or the like. The truck 102 has the rear of its loading platform 103 open and is parked at a predetermined parking position in front of the transport location 104. Note that a door that opens and closes the rear of the loading platform 103 is not shown in FIG. 1.

[0019] The luggage 101 transported to the transport location 104 is loaded into the loading space from the rear of the loading platform 103 by a worker such as a driver of the truck 102. In such a loading operation, the luggage 101 is transported to the transport location 104 one after another, and as shown in FIG. 1, it is often the case that a plurality of luggage 101 remains on the loading platform 103 and has not yet been loaded.

[0020] In the following, when distinguishing whether or not the luggage 101 is loaded on the loading platform 103 (loading space), the luggage 101 that is not loaded on the loading platform 103 (loading space) will also be referred to as "luggage 101_a" as shown in Fig. 1. Also, the luggage 101 that has been loaded on the loading platform 103 (loading space) will also be referred to as "luggage 101_b".

[0021] Furthermore, among the unloaded luggage 101, luggage 101 that has been newly transported to the transport location 104 by the conveyor 105 or the like is also referred to as "luggage 101_n." The term "unloaded luggage group" is also used as a general term for the unloaded luggage 101. That is, the unloaded luggage group is made up of unloaded luggage 101 (luggage 101_a), and the unloaded luggage 101 (luggage 101_a) includes luggage 101 (luggage 101_n) that is added to the unloaded luggage 101. Note that the number of luggage 101 that constitutes the unloaded luggage group may be one.

[0022] As shown in FIG. 1, the loading assistance system 100 includes a first photographing unit 106, a second photographing unit 107, a luggage management device 108, a loading assistance device 109, and a monitor 110 connected to the loading assistance device 109 by wiring.

[0023] The first photographing unit 106, the second photographing unit 107, and the luggage management device 108 are each connected to the loading support device 109 so as to be able to transmit and receive information to and from the loading support device 109 via a network N. The network N may be constructed using wired or wireless lines, or an appropriate combination of these. The network N in this embodiment is, for example, a LAN (Local Area Network) provided at a base for trunk line transportation.

[0024] The monitor 110 may be connected to the loading support device 109 via the network N by being connected to another device (not shown) or by being integrally included in a device such as a tablet terminal.

[0025] The first photographing unit 106 photographs the transport location 104 and generates first image data including the photographed image.

[0026] As shown in Fig. 1, the first photographing unit 106 according to this embodiment is installed on the ceiling directly above the approximate center of the transport location 104, and photographs the area surrounded by the dotted circle A shown in Fig. 1. In this way, the first photographing unit 106 photographs the entire transport location 104 and generates first image data including an image of the luggage 101_a included in the unloaded luggage group.

[0027] The second photographing unit 107 is a photographing device that photographs the loading space in the loading platform 103 and generates second image data including the photographed image.

[0028] The second photographing unit 107 according to this embodiment is installed, for example, at the center of the rear end of the ceiling of the loading platform 103. The second photographing unit 107 is installed so as to photograph an area in front and below the installed position (an area sandwiched between two dotted lines B shown in FIG. 1 when viewed from above). In this way, the second photographing unit 107 photographs almost the entire loading space and generates second image data including an image of the loaded baggage 101_b.

[0029] (Functional configuration of the baggage management device 108) The luggage management device 108 is a device for managing luggage 101 transported by trunk line transportation. Functionally, the luggage management device 108 includes a memory unit 112 and a memory control unit 113, as shown in FIG.

[0030] The storage unit 112 stores various information such as package information 114 .

[0031] The luggage information 114 is information relating to the luggage 101. For example, as shown in FIG. 2, the luggage information 114 is information in which "luggage ID (Identification)", "destination", "transportation direction", "size", "weight", "shape", "loading conditions", "current state", and the like are associated.

[0032] The "baggage ID" is information for identifying each baggage 101.

[0033] "Destination" is information indicating the destination of the package 101 identified by the associated package ID. For example, an address is set in "destination".

[0034] "Transportation direction" is information indicating the transportation direction of the package 101 identified by the associated package ID. For example, information specifying a base station that is the destination of transportation in a trunk route transportation is set in "Transportation direction".

[0035] The shipping direction may be specified from the destination, and in this case, the package information 114 does not need to include "Shipping direction."

[0036] "Size" is information indicating the size of the package 101 identified by the associated package ID, and includes, for example, the length in each direction (i.e., dimensions) of the length, width, and height.

[0037] "Weight" is information indicating the weight of the package 101 identified by the associated package ID.

[0038] "Shape" is information indicating the shape of the package 101 identified by the associated package ID. For example, "shape" may be set to "rectangular parallelepiped," "cylindrical," or "other." Here, "rectangular parallelepiped" and "cylindrical" are examples of information indicating a predetermined specific shape. "Other" is information indicating a shape other than the predetermined specific shape.

[0039] Furthermore, for example, among the luggage 101, there is a type of luggage such as a "golf bag" whose general shape can be identified based on the contents of the luggage 101. In such a case, "golf bag" may be set as the "shape" of the luggage information 114 as "information indicating a predetermined specific shape."

[0040] The "loading conditions" are information indicating conditions related to loading of the luggage 101 identified by the associated luggage ID. For example, the "loading conditions" may include handling conditions related to handling of the luggage 101, such as whether it is upside down or upside down. Furthermore, for example, the "loading conditions" may include attributes of the luggage 101, such as fragile items and precision machinery. Here, "fragile items" refers to items that are easily broken, such as luggage 101 made of ceramic or glass.

[0041] "Current Status" is information indicating the current status of the package 101 identified by the associated package ID. For example, "Current Status" may be set to "Sorting," "Not Loaded," "Loaded," or "Sent."

[0042] "Distribution in progress" is information indicating the status from when the package 101 arrives at the base until when it reaches the delivery location 104 in the transportation direction corresponding to its destination.

[0043] "Not loaded" is information indicating a state in which the transport location 104 has been reached and the cargo has not yet been loaded onto the loading platform 103 (loading space).

[0044] "Loaded" is information indicating a state in which the cargo 101 has been loaded onto the loading platform 103 (loading space) of the truck 102 and the truck 102 has not yet departed (i.e., the truck 102 is currently loading the cargo 101).

[0045] “Dispatch” is information indicating the situation in which the truck 102 loaded with the package 101 departs from a parking position near the delivery location 104 .

[0046] Referring again to FIG. The memory control unit 113 controls the memory unit 112. The memory control unit 113 also communicates with the loading support device 109 via a network N.

[0047] In this embodiment, the memory control unit 113 transmits the baggage information 114 in accordance with information from the loading assistance device 109 acquired via the network N. The memory control unit 113 also updates the "current status" of the baggage information 114 in accordance with information from the loading assistance device 109 acquired via the network N.

[0048] (Functional configuration of loading assistance device 109) The loading support device 109 is a device for supporting the loading work of loading the cargo 101 into the loading space. The loading support device 109 is provided, for example, in correspondence with each transportation direction. The loading support device 109 has the following functionalities: Figure 4 As shown in FIG. 1, the system includes a first acquisition unit 115, a second acquisition unit 116, a determination unit 117, and an output control unit 118.

[0049] The first acquisition unit 115 acquires the baggage information 114 of each of the plurality of bags 101_a included in the group of unloaded bags.

[0050] The first acquisition unit 115 according to this embodiment acquires first image data in real time from the first photographing unit 106. The first acquisition unit 115 identifies an image of each of the unloaded luggage 101_a based on the first image data. The first acquisition unit 115 communicates with the luggage management device 108 to acquire luggage information 114 of each of the identified luggage 101_a from the first image data, and stores the acquired luggage information 114.

[0051] The package information 114 acquired by the first acquisition unit 115 may include at least one of the size, weight, shape, and loading conditions of the package 101_a.

[0052] The second acquisition unit 116 acquires loading information indicating the current loading status of the loading space.

[0053] The second acquisition unit 116 according to the present embodiment acquires second image data in real time from the second photographing unit 107. The second acquisition unit 116 identifies images of each of the loaded luggage 101_b based on the second image data. In this way, the second acquisition unit 116 acquires loading information.

[0054] The determination unit 117 determines the cargo 101_a to be loaded next in the loading space and the loading position of the cargo 101_a, using the cargo information and the loading information. The loading position of the cargo 101_a is the position in the loading space where the cargo 101_a is loaded.

[0055] The output control unit 118 causes the monitor 110 to output luggage designation information for designating the luggage 101_a to be loaded next and position designation information for designating the loading position of the luggage 101_a to be loaded next.

[0056] Referring again to FIG. The monitor 110 is a device that displays images under the control of the output control unit 118. The monitor 110 is preferably provided so that the worker can view it during loading work.

[0057] The monitor 110 according to this embodiment displays baggage designation information and location designation information. That is, in this embodiment, a first output means for outputting baggage designation information and a second output means for outputting location designation information are realized by a single monitor 110. The baggage designation information and the location designation information may be displayed in different areas, for example, by dividing the display area of ​​the monitor 110. Note that the baggage designation information and the location designation information may be displayed alternately on the monitor 110 at predetermined time intervals.

[0058] Up to now, the functional configuration of the loading support system 100 according to the embodiment 1 has been mainly explained. From now on, the physical configuration of the loading support system 100 will be explained.

[0059] (Physical configuration of the first imaging unit 106 and the second imaging unit 107) Each of the first imaging unit 106 and the second imaging unit 107 is realized by, for example, a camera including an image sensor. information A 3D camera that can also obtain the above-mentioned 3D images is desirable. Conventional techniques may be applied to the 3D camera's imaging method.

[0060] (Physical configuration of the baggage management device 108) The luggage management device 108 may be configured physically in a similar manner to the loading assistance device 109. Therefore, the physical configuration of the loading assistance device 109 will be described first with reference to the drawings, and then differences between the physical configuration of the luggage management device 108 and the physical configuration of the loading assistance device 109 will be described.

[0061] (Physical configuration of the loading assist device 109) The loading assistance device 109 is physically, for example, a general-purpose computer.

[0062] In detail, for example, the loading assistance device 109 physically comprises a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a network interface 1050, an input interface 1060, and an output interface 1070, as shown in FIG.

[0063] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, network interface 1050, input interface 1060, and output interface 1070. However, the method of connecting the processor 1020 and other components to each other is not limited to bus connection.

[0064] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0065] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0066] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules for realizing each functional unit of the loading support device 109. The processor 1020 reads each of these program modules into the memory 1030 and executes them, thereby realizing each functional unit corresponding to the program module.

[0067] The network interface 1050 is an interface for connecting the loading support device 109 to the network N.

[0068] The input interface 1060 is connected to an input device 1080 such as a keyboard or a mouse for an operator as a user to input information.

[0069] A monitor 110 for outputting information to an operator as a user is connected to the output interface 1070. The monitor 110 is, for example, a liquid crystal display panel, an organic EL (Electro-Luminescence) monitor, or the like.

[0070] The luggage management device 108 differs from the loading assistance device 109 in that a storage device 1040 stores program modules for realizing each functional unit of the luggage management device 108. The luggage management device 108 also differs from the loading assistance device 109 in that a network interface 1050 connects the luggage management device 108 to the network N. Except for these points, the physical configuration of the luggage management device 108 is generally similar to the physical configuration of the loading assistance device 109 described above.

[0071] So far, the configuration of the loading support system 100 according to the first embodiment of the present invention has been described. Now, the operation of the loading support system 100 according to this embodiment will be described.

[0072] <Operation of Loading Assist System 100> 6 and 7 are flowcharts showing an example of the loading support process according to this embodiment. The loading support process is a process for supporting the loading work of loading cargo 101 into the loading space.

[0073] The loading support process is started, for example, when the first photographing unit 106, the second photographing unit 107, the baggage management device 108, the loading support device 109, and the monitor 110 are operated. Then, the loading support process is repeatedly executed while these are operating.

[0074] The first image capturing unit 106 continuously outputs first image data during its operation. Similarly, the second image capturing unit 107 continuously generates second image data during its operation. This allows the loading assistance device 109 to acquire the first image data showing the current status of the transport location 104 and the second image data showing the current status of the loading space in real time.

[0075] Please refer to Figure 6. The first acquisition unit 115 acquires the first image data from the first imaging unit 106 in real time (step S101).

[0076] The first acquisition unit 115 holds the first image data acquired in step S101, and determines whether or not there is any package 101_n that has been added to the unloaded package 101_a based on the first image data (step S102).

[0077] Specifically, the first acquisition unit 115 compares the first image data acquired in the current step S101 with the first image data acquired in the previous step S101. Then, the first acquisition unit 115 performs image processing on each of the first image data to identify the packages 101_a included in each of the first image data.

[0078] If the first image data acquired in this step S101 includes a package 101_a that was not included in the first image data acquired in the previous step S101, the first acquisition unit 115 determines that an added package 101_n exists. Otherwise, the first acquisition unit 115 determines that an added package 101_n does not exist.

[0079] Note that the method of determining whether or not there is an added piece of luggage 101_n in step S102 is not limited to this. For example, if a weight sensor (not shown) is provided at the transfer location 104 and there is a change in the weight of the piece of luggage 101_a at the transfer location 104, specifically, for example, if the weight of the piece of luggage 101_a at the transfer location 104 increases, the first acquisition unit 115 may determine that there is an added piece of luggage 101_n. Also, for example, if a piece of luggage sensor (e.g., an infrared sensor or other sensor not shown) is provided to detect the passage of the piece of luggage 101_n at a predetermined location (e.g., the exit of the conveyor 105, the entrance of the transfer location 104, etc.), and the first acquisition unit 115 detects the passage of the piece of luggage 101_n at the location, the first acquisition unit 115 may determine that there is an added piece of luggage 101_n. Furthermore, for example, the first acquisition unit 115 may determine that there is an added piece of luggage 101_n when it detects the passage of the piece of luggage 101_n at the location by performing image processing using the first image data.

[0080] If it is determined that there is an added package 101_n (step S102; Yes), the first acquisition unit 115 acquires the package information 114 of the added package 101_n (step S103).

[0081] Any suitable method may be adopted as the method for acquiring the package information 114 in step S103. As examples, methods 1 to 3 for acquiring the package information 114 will be described below.

[0082] (How to obtain baggage information 114 1) The first acquisition unit 115 acquires, from the luggage management device 108, luggage information 114 corresponding to the luggage 101_n that has been determined to have been added to the group of unloaded luggage in step S102, based on the first image data.

[0083] In detail, for example, the first acquisition unit 115 identifies the shape and size of the package 101_n from the first image data. Conventional technology may be applied to identify the shape and size of the package 101_n from the first image data. The first acquisition unit 115 transmits an inquiry including the identified shape and size to the package management device 108.

[0084] The memory control unit 113 first performs an extraction process of the luggage information 114 by the "current state" and the "transportation direction." In detail, for example, the memory control unit 113 extracts the luggage information 114 including the "transportation direction" corresponding to the loading support device 109 equipped with the first acquisition unit 115 that sent the inquiry from the luggage information 114 whose "current state" is "being sorted."

[0085] Next, the memory control unit 113 performs processing to identify the package information 114 based on the shape and size included in the inquiry. In detail, for example, the memory control unit 113 identifies, from the extracted package information 114, package information 114 associated with "shape" and "size" that match the shape and size included in the inquiry.

[0086] Here, in the process of identifying the package information 114, it is desirable to identify package information 114 associated with the same "shape" and "size" as the shape and size included in the inquiry.

[0087] However, due to measurement errors in image processing, etc., there may be a difference between the size included in the inquiry and the "size" in the package information 114, even for the same package 101_n.

[0088] Therefore, for example, the "size" closest to the size included in the inquiry may be determined to match the size included in the inquiry. Also, for example, the "size" of the package information 114 that is closest to the size included in the inquiry and that differs from the size included in the inquiry by a predetermined range may be determined to match the size included in the inquiry.

[0089] Furthermore, due to errors in the shape recognized by image processing, there may be differences between the shape included in the inquiry and the "shape" of the package information 114, even for the same package 101_n.

[0090] Therefore, for example, taking into consideration errors in shapes recognized by image processing, a combination of shapes that match the shape included in the inquiry and the "shape" of the package information 114 may be determined in advance and stored in the storage control unit 113. Then, when the shape included in the inquiry and the "shape" of the package information 114 are a predetermined combination, it may be determined that the "shape" of the package information 114 matches the shape included in the inquiry.

[0091] Then, the storage control unit 113 transmits the identified package information 114 to the loading assistance device 109. As a result, the first acquisition unit 115 acquires the package information 114 of the added package 101_n.

[0092] If it is not possible to identify luggage information 114 associated with "shape" and "size" that match the shape and size included in the inquiry, the storage control unit 113 may transmit error information to the loading assistance device 109. The error information is information indicating that there is no luggage information 114 that matches the shape and size identified from the first image data. The error information may be displayed on the monitor 110, which will be described later.

[0093] (How to obtain baggage information 114 2) In the method 1 for acquiring package information 114, an example has been described in which the memory control unit 113 performs the extraction process and the identification process of the package information 114. However, the first acquisition unit 115 may acquire the package information 114 from the package management device 108 and perform the extraction process and the identification process of the package information 114. Alternatively, the first acquisition unit 115 may acquire the package information 114 extracted by the extraction process of the package information 114 from the package management device 108 and perform the identification process of the package information 114.

[0094] (How to obtain baggage information 114 3) The first acquisition unit 115 may acquire the luggage information 114 of the unloaded luggage 101_n by generating luggage information 114 of the added luggage 101_n based on the first image data. In this case, since there is no need to refer to the luggage information 114, the luggage management device 108 may not be provided in the loading assistance system 100.

[0095] The "baggage ID" is acquired by the first acquisition unit 115. Attached It would be good to be given this.

[0096] Generally, a destination label is affixed to the exterior of the package 101. The "destination" may be set based on an image of the destination label. For example, the image of the destination label may be set as the "destination." Alternatively, for example, information such as characters indicating the destination may be obtained by performing image processing on the image of the destination label, and the obtained information may be set as the "destination."

[0097] The "size" may be determined and set from the first image data. As described above, conventional techniques may be applied to determine the size of the package 101_n from the first image data.

[0098] The "weight" may be acquired from a weight sensor (not shown) provided at the transport location 104 by connecting the weight sensor and set in the package information 114.

[0099] The "shape" may be specified and set from the first image data. As described above, conventional techniques may be applied to specify the shape of the package 101_n from the first image data.

[0100] Generally, a loading condition label bearing words such as "Turn head down," "Fragile," and "Precision machinery" and pictures representing each word may be attached to the outer surface of the cargo 101. The "loading conditions" may be set based on an image of the loading condition label. For example, the "loading conditions" may be set by performing image processing on the image of the loading condition label to obtain information indicating the loading conditions, and the obtained information may be set as the "loading conditions."

[0101] "Current status" is set to "Unloaded."

[0102] In this way, when the first acquisition unit 115 acquires information to be set for each element constituting the package information 114 based on the first image data, the first acquisition unit 115 associates each piece of acquired information, thereby enabling the first acquisition unit 115 to generate the package information 114 for the package 101_n.

[0103] So far, examples of methods for acquiring package information 114 have been described. Referring again to FIG. The first acquisition unit 115 holds the baggage information 114 acquired in step S103, and transmits an instruction to change the "current state" of the baggage information 114 to the baggage management device 108. As a result, the first acquisition unit 115 updates the baggage information 114 related to the unloaded baggage 101_a (step S104).

[0104] In detail, for example, the first acquisition unit 115 can retain the luggage information 114 of the unloaded luggage 101_a by retaining the luggage information 114 acquired in step S103. Furthermore, the first acquisition unit 115 transmits an instruction to set the "current state" of the luggage information 114 acquired in step S103 to "unloaded." As a result, the "current state" of the luggage information 114 of the luggage 101_n retained in the storage unit 112 is changed from "being sorted" to "unloaded."

[0105] The second acquisition unit 116 acquires the second image data from the second imaging unit 107 in real time (step S105).

[0106] The second acquisition unit 116 acquires loading information indicating the current loading status of the loading space based on the second image data acquired in step S105 (step S106). Then, the second acquisition unit 116 holds the acquired loading information.

[0107] The second acquisition unit 116 holds the loading information acquired in step S106, and determines whether there is a change in the loading situation based on the loading information (step S107).

[0108] In detail, for example, the second acquisition unit 116 compares the loading information acquired in the current step S106 with the loading information acquired in the previous step S106. As a result, the second acquisition unit 116 determines whether or not there is a change in the cargo 101_b identified in each piece of loading information.

[0109] The loaded cargo 101_b may be changed, for example, when a new cargo 101 is loaded onto the loading platform 103 (loading space) or when the loading position of the loaded cargo 101_b is changed by an operator.

[0110] If it is determined that there is no added baggage 101_n (step S102; No ), the second obtaining unit 116 performs the same processes as steps S105 to S106 described above.

[0111] The second acquisition unit 116 holds the loading information acquired in step S106, and determines whether there has been a change in the loading situation based on the loading information (step S108).

[0112] In step S108, it is determined whether or not there has been a change in the loading situation based on the loading information in the same manner as in step S107.

[0113] If it is determined that there is no change in the loading situation (step S108; No), the processing from step S101 onwards is repeated again.

[0114] When it is determined that there is a change in the loading status (step S107; Yes or step S108; Yes), the second acquisition unit 116 determines whether or not a new load 101_b has been loaded (step S111), as shown in Fig. 7. In other words, it determines whether or not a load 101 has been added to the already loaded load 101_b.

[0115] In detail, for example, the second acquisition unit 116 determines that a new cargo 101_b has been loaded when the current loading information acquired in step S106 includes a cargo 101_b that has not been included in the loading information acquired so far in step S106 related to the loading work on the current loading platform 103. In other cases, the second acquisition unit 116 determines that a new cargo 101_b has not been loaded.

[0116] When it is determined that a new piece of luggage 101 has been loaded (step S111; Yes), the second acquisition unit 116 deletes the luggage information 114 of the newly loaded piece of luggage 101_b from the luggage information 114 held in the first acquisition unit 115. In addition, the second acquisition unit 116 transmits an instruction to change the "current state" of the luggage information 114 of the newly loaded piece of luggage 101_b to the luggage management device 108. As a result, the second acquisition unit 116 updates the luggage information 114 related to the newly loaded piece of luggage 101_b (step S112).

[0117] In detail, the second acquisition unit 116 identifies the size and shape of the newly loaded cargo 101_b based on the second image data.

[0118] Then, the second acquisition unit 116 deletes the luggage information 114 associated with the "shape" and "size" that match the identified dimensions and shape from the luggage information 114 held in the first acquisition unit 115. This allows the first acquisition unit 115 to hold the luggage information 114 of the unloaded luggage 101_a.

[0119] The second acquisition unit 116 also transmits an instruction to set "current status" of the cargo information 114 associated with the "shape" and "size" that match the identified dimensions and shape to "loaded."

[0120] More specifically, the memory control unit 113 extracts, from among the luggage information 114 whose "current status" is "unloaded," luggage information 114 that includes a "transportation destination" corresponding to the loading assistance device 109 equipped with the second acquisition unit 116 that sent the instruction. Then, from among the extracted luggage information 114, the memory control unit 113 identifies luggage information 114 that is associated with a "shape" and a "size" that match the shape and size included in the instruction, respectively. The memory control unit 113 sets the "current status" of the identified luggage information 114 to "loaded." As a result, the "current status" of the luggage information 114 of the newly loaded luggage 101_b is changed from "unloaded" to "loaded."

[0121] Here, the method for identifying "luggage information 114 associated with a 'shape' and 'size' that match the identified dimensions and shape" may be, for example, a method similar to the above-mentioned process for identifying luggage information 114.

[0122] The determination unit 117 determines the next cargo 101_a to be loaded onto the loading platform 103 (loading space) based on the cargo information 114 of the unloaded cargo 101_a and the loading information acquired in step S106 (step S113).

[0123] Since the package information 114 of the currently unloaded package 101_a is held in the first acquisition unit 115, the determination unit 117 may acquire the package information 114 of the currently unloaded package 101_a from the first acquisition unit 115.

[0124] Then, the determination unit 117 determines the loading position of the cargo 101_a determined in step S113 (step S114).

[0125] The next load 101_a and its loading position in steps S113 to S114 are determined using a learning model trained by machine learning, for example. That is, the determination unit 117 inputs the load information 114 of each of the loads 101_a in the unloaded load group to a trained learning model that has undergone machine learning to determine the next load 101_a and its loading position, thereby determining the next load 101_a and its loading position.

[0126] Input data to the learning model during learning is the luggage information 114 of each of the multiple luggage 101. In machine learning, it is preferable to perform supervised learning in which the next luggage 101_a to be loaded and its loading position determined by a worker skilled in loading work according to the luggage information 114 of each of the multiple luggage 101 are used as correct answers.

[0127] Generally, loading efficiency varies depending on the skill level of the worker, and more skilled workers are often able to load cargo into the loading space at a higher loading rate. Therefore, by using supervised learning in which the decisions of workers skilled in loading work are used as the correct answer, even workers with little experience in loading work can load cargo 101 at a loading rate as high as that of skilled workers. Therefore, it is possible to improve the loading rate of cargo 101.

[0128] Here, the loading ratio is at least one of the ratio of the volume occupied by the cargo 101 to the volume of the loading space, and the ratio of the total weight of the cargo 101 loaded in the loading space to the predetermined upper limit of the loading weight of the truck 102.

[0129] Furthermore, in this type of machine learning, for example, a questionnaire survey or the like may be conducted in advance to determine the items according to the constraints and the viewpoints (item information such as size and weight) that skilled workers prioritize for efficient loading, and the operation data of a skilled worker who is skilled in loading work to be reproduced may be used as input to determine which items the worker prioritizes, and the weighting of each item may be determined. By determining the loading position of the item 101_a using a learning model obtained by such machine learning, the item 101 can be loaded with a loading rate as high as that of a skilled worker. Therefore, it is possible to improve the loading rate of the item 101.

[0130] The output control unit 118 causes the monitor 110 to output the cargo designation information for designating the cargo 101_a to be loaded next, which has been determined in step S113 (step S115).

[0131] In detail, for example, the output control unit 118 displays a current image of the delivery location 104 captured by the first photographing unit 106 based on the first image data. This image includes an image of the currently unloaded luggage 101_a. Then, the output control unit 118 outputs information for pointing to the luggage 101_a determined in step S113 using a pointer of a predetermined shape such as an arrow to the monitor 110. As a result, the monitor 110 displays, as luggage designation information, an image in which the image of the currently unloaded luggage 101_a at the delivery location 104 is superimposed on an image in which the pointer points to the luggage 101_a to be loaded next.

[0132] The method of pointing out the next load 101_a in the image is not limited to a pointer, and various methods may be used, such as blinking the area of ​​the load 101_a.

[0133] The output control unit 118 causes the monitor 110 to output position designation information for designating the loading position determined in step S114 (step S116).

[0134] In detail, for example, the output control unit 118 displays a current image of the loading space captured by the second image capturing unit 107 based on the second image data. This image shows the current situation of the loading space and includes an image of the currently loaded luggage 101_b. Then, the output control unit 118 outputs information for indicating the loading position determined in step S114 using a pointer of a predetermined shape such as an arrow to the monitor 110. As a result, the monitor 110 displays, as position designation information, an image in which the image of the currently loaded luggage 101_b in the loading space is superimposed on an image indicating the loading position of the luggage 101_a to be loaded next.

[0135] The method of indicating the loading position in the image is not limited to a pointer, and various methods may be used, such as blinking an area according to the size and shape of the cargo 101_a to be loaded next.

[0136] As a result, the output control unit 118 ends the loading support process.

[0137] In this embodiment, when a piece of luggage 101_n is added to the group of unloaded luggage, the first acquisition unit 115 acquires the luggage information 114 of the piece of luggage 101_n. As a result, the first acquisition unit 115 acquires the luggage information 114 of each piece of luggage 101_a included in the group of unloaded luggage. In addition, the second acquisition unit 116 acquires loading information indicating the current loading status of the loading space.

[0138] Then, the cargo 101_a to be loaded next in the loading space is determined using the cargo information and the loading information, and cargo designation information for designating the cargo 101_a to be loaded next is displayed on the monitor 110.

[0139] This allows the worker to easily and quickly determine the next cargo 101_a to be loaded into the loading space by looking at the cargo designation information, thereby improving the efficiency of the loading work of the cargo 101.

[0140] Furthermore, the next cargo 101_a to be loaded in the loading space is determined based on the currently unloaded cargo 101_a and the current loading status of the loading space. Therefore, even a worker with relatively little experience in loading work can load the cargo 101 with a high loading rate. Therefore, it is possible to improve the loading rate of the cargo 101.

[0141] In this embodiment, the loading position of the next cargo 101_a in the loading space is determined using the cargo information and loading information, and position designation information for designating the loading position of the cargo 101_a is displayed on the monitor 110.

[0142] This allows the worker to easily and quickly determine the loading position of the next load 101_a by looking at the position designation information, thereby improving the efficiency of the load work of the load 101.

[0143] Furthermore, since the loading position in the loading space of the next cargo 101_a to be loaded is determined according to the currently unloaded cargo 101_a and the current loading status of the loading space, even an operator with relatively little experience in loading work can load the cargo 101 with a high loading rate. Therefore, it is possible to improve the loading rate of the cargo 101.

[0144] In this embodiment, the luggage information 114 includes at least one of the size, weight, shape, and loading conditions of each luggage 101_a. This makes it possible to determine the luggage 101_a to be loaded next in the loading space so that the luggage 101 can be loaded with a high loading rate. Furthermore, it is possible to determine the loading position of the luggage 101_a so that the luggage 101 can be loaded with a high loading rate. Therefore, it is possible to improve the loading rate of the luggage 101.

[0145] In this embodiment, step S113 is performed after the determination processes of steps S102, S107, and S108. Therefore, when it is detected that at least one of the following has occurred: an item 101_n has been added to the group of unloaded items; and a change has occurred in the current loading status of the loading space, the item 101_a to be loaded next in the loading space is determined. Furthermore, these changes are detected based on the first image data or the second image data acquired in real time.

[0146] As a result, when a change occurs in either the luggage 101_n constituting the unloaded luggage group or the current loading status, the luggage 101_a to be loaded next can be determined immediately after the change occurs. Therefore, it is possible to improve the efficiency of the loading work of the luggage 101.

[0147] Up to this point, the first embodiment of the present invention has been described. The first embodiment may be modified in various ways, for example, as in the following modified examples.

[0148] (Modification 1: Modification of the configuration of the loading assistance system) In the first embodiment, an example has been described in which one loading support device 109 is connected to the luggage management device 108. However, when the loading support device 109 is provided in association with the transfer location 104 of each transportation direction as in the first embodiment, the luggage management device 108 may be connected via the network N to a plurality of loading support devices 109 associated with each of a plurality of transportation directions.

[0149] The loading assistance device 109 may also have the function of the luggage management device 108. Furthermore, one loading assistance device 109 may be provided corresponding to a plurality of transport directions to assist the loading operation at each of the transport locations 104 for the plurality of transport directions.

[0150] (Modification 2: Modification of the first output means and the second output means) In the first embodiment, an example has been described in which the first output means and the second output means are realized by one monitor 110. However, the first output means and the second output means may be realized by different devices.

[0151] 8 is a diagram showing the configuration of a loading support system 200 according to Modification 2. The loading support system 200 includes a display device 221 in addition to the first photographing unit 106, the second photographing unit 107, the luggage management device 108, the loading support device 109, and the monitor 110 similar to those in Embodiment 1.

[0152] The display device 221 is connected to the loading assistance device 109 so as to be able to send and receive information to and from each other via the network N. Like the monitor 110, the display device 221 is a device that displays images under the control of the output control unit 118, and is preferably provided so that the worker can view the images during loading work. FIG. 8 shows an example in which the display device 221 is installed inside the loading platform 103, and is attached to the left inner wall of the loading platform 103.

[0153] Monitor 110 according to this embodiment displays baggage designation information. That is, monitor 110 corresponds to first output means for outputting baggage designation information in this embodiment. Display device 221 displays position designation information. That is, display device 221 corresponds to second output means for outputting position designation information.

[0154] Such a display device 221 is physically, for example, a tablet terminal, a smartphone, or the like.

[0155] In detail, for example, the display device 221 physically comprises a bus 2010, a processor 2020, a memory 2030, a storage device 2040, a network interface 2050, and a user interface 2060, as shown in FIG.

[0156] bus 2 010 is the processor 2 020, Memory 2 030, storage device 2 040, Network Interface 2The data transmission path is used for transmitting and receiving data between the processor 2020 and the user interface 2060. However, the method for connecting the processor 2020 and the like to each other is not limited to a bus connection.

[0157] The processor 2020 is a processor realized by a CPU, a GPU, etc. The memory 2030 is a main storage device realized by a RAM, etc. The storage device 2040 is an auxiliary storage device realized by a HDD, an SSD, a memory card, a ROM, etc.

[0158] The storage device 2040 stores program modules for realizing the functions of the display device 221. The processor 2020 stores these program modules in the memory. 2 By loading the program module into the 030 and executing it, the function corresponding to the program module is realized.

[0159] The network interface 2050 is an interface for connecting the display device 221 to the network N.

[0160] The user interface 2060 includes a touch panel, a keyboard, a mouse, and the like as interfaces for the user to input information, and a liquid crystal panel and the like as an interface for presenting information to the user.

[0161] The display device 221 may be physically the same as the monitor 110. The monitor 110 may also be physically the same as the display device 221, such as a tablet terminal or a smartphone.

[0162] This modification also provides the same effects as the first embodiment.

[0163] Furthermore, according to this modification, the baggage designation information and the position designation information are output to different devices. This allows the worker to view the monitor 110 that outputs the baggage designation information while working at the transport location 104. Also, the worker can view the display device 221 that outputs the position designation information while working on the loading platform 103 (loading space).

[0164] In this way, the worker can perform the work while looking at a screen close to the work location, and can more easily and quickly determine the next load 101_a and its loading position, which can further improve the efficiency of the load work of the load 101.

[0165] Generally, loading work may be performed by a plurality of workers. For example, the loading work may be performed by dividing the work between a first worker who carries the luggage 101_a from the transport location 104 to the loading platform 103 and a second worker who places the luggage 101_a at a loading position on the loading platform 103 (loading space). In such a case, the first worker can perform the loading work while looking at the monitor 110. The second worker can perform the loading work while looking at the display device 221.

[0166] In this way, when multiple workers share the work, each worker can perform the work by looking at a screen close to his or her work location, and therefore can more easily and quickly determine the next load 101_a to be loaded and its loading position, which can further improve the efficiency of the load work of the load 101.

[0167] (Modification 3: Another modification of the first output means and the second output means) In the first embodiment and the second modification, an example has been described in which the first output means and the second output means are devices that display images. The method of outputting the baggage specification information and the location specification information is not limited to displaying images. For example, the first output means and the second output means may be devices that emit light, such as a laser pointer or a projector.

[0168] The loading support system according to this modification includes a first laser pointer as a first output means in place of the monitor 110 of the modification 2. The loading support system according to this modification also includes a second laser pointer as a second output means in place of the display device 221 of the modification 2.

[0169] The first laser pointer is provided, for example, on the ceiling near the first photographing unit 106. The first laser pointer irradiates light onto the next load 101_a in accordance with the control of the output control unit 118. This outputs load designation information for designating the next load 101_a.

[0170] The second laser pointer is provided, for example, near the second photographing unit 107 on the ceiling of the loading platform 103. The second laser pointer irradiates light onto the loading position of the next load 101_a in accordance with the control of the output control unit 118. This outputs position designation information for designating the loading position of the next load 101_a.

[0171] This modification also provides the same effects as the first embodiment.

[0172] Furthermore, according to this modification, the next load 101_a is designated by the light irradiated onto the load 101_a. Therefore, the worker can see the load 101_a at the transport location 104 and immediately determine the next load 101_a without looking at the monitor 110 or the like. That is, the worker can more easily and quickly determine the next load 101_a to be loaded. Therefore, it is possible to further improve the efficiency of the load 101 loading operation.

[0173] Furthermore, according to this modification, the loading position of the next load 101_a is specified by light irradiated onto the loading position. Therefore, the worker can look inside the loading platform 103 (loading space) and immediately determine the loading position of the next load 101_a without looking at the monitor 110 or the like. That is, the worker can determine the loading position more easily and quickly. Therefore, it is possible to further improve the efficiency of the load operation of the load 101.

[0174] (Modification 4: Modification in which the loaded cargo 101_b is the next cargo to be loaded) In the first embodiment, an example has been described in which the next cargo 101 to be loaded, determined by the determining unit 117, is determined from among the unloaded cargoes 101_a.

[0175] However, the loading rate may be improved by moving the loading position of the loaded luggage 101_b. In this modified example, an example will be described in which the luggage 101 to be loaded next, determined by the determination unit 117, is determined not only from the unloaded luggage 101_a but also from the loaded luggage 101_b.

[0176] Here, when moving the loading position of the loaded luggage 101_b, for example, moving the loading position of the luggage 101_b loaded at the back may actually reduce work efficiency. Therefore, it is desirable to move the luggage 101_b whose loading position is to be moved to a luggage 101_b that is relatively easy to move.

[0177] Examples of luggage 101_b that are relatively easy to move include luggage 101_b that is exposed to the outside in the loading space (i.e., luggage 101_b loaded at the front), luggage 101_b loaded at the top (or on the top shelf), etc. In this way, luggage 101_b loaded within a predetermined range in the current loading situation of the loading space may be targeted as the luggage 101 to be loaded next.

[0178] Of the luggage 101_b loaded in the loading space, the luggage 101_b loaded in a range that is predetermined as a range that is relatively easy to move is collectively referred to as a "temporarily loaded luggage group."

[0179] The first acquisition unit 115 according to this modification acquires the luggage information 114 of each of the luggage 101_a included in the unloaded luggage group. In addition, the first acquisition unit 115 according to this modification acquires the luggage information 114 of each of the luggage 101_b included in the provisionally loaded luggage group.

[0180] The first acquisition unit 115 according to this modification acquires the package information 114 of the package 101_a in the same manner as the first acquisition unit 115 according to the first embodiment. Therefore, detailed description of the acquisition of the package information 114 of the package 101_a will be omitted.

[0181] The first acquisition unit 115 according to this modification acquires second image data in real time from the second photographing unit 107. Based on the second image data, the first acquisition unit 115 identifies images of each of the loaded luggage 101_b included in the temporary loaded luggage group among the loaded luggage 101_b. The first acquisition unit 115 communicates with the luggage management device 108 to acquire luggage information 114 of each of the luggage 101_b included in the temporary loaded luggage group identified from the second image data, and stores the acquired luggage information 114.

[0182] In this modification, the processes of steps S101 to S112 are performed in the same manner as in embodiment 1. Then, in this modification, the process of step S317 is performed before step S113, as shown in Fig. 10. In step S317, the first acquisition unit 115 acquires the baggage information 114 of each of the baggage 101_b included in the tentative loaded baggage group.

[0183] Any suitable method may be adopted as the method for acquiring the package information 114 in step S317. As examples, methods 4 to 6 for acquiring the package information 114 will be described below.

[0184] (How to obtain baggage information 114 4) The first acquisition unit 115 acquires, from the luggage management device 108, luggage information 114 corresponding to the luggage 101_b included in the group of provisionally loaded luggage, based on the second image data.

[0185] In detail, for example, the first acquisition unit 115 identifies the shape and size of the luggage 101_b included in the tentatively loaded luggage group from the second image data. Conventional technology may be applied to identify the shape and size of the luggage 101_b from the second image data. The first acquisition unit 115 transmits an inquiry including the identified shape and size to the luggage management device 108.

[0186] The storage control unit 113 performs extraction processing and identification processing of the package information 114 in the same manner as in the acquisition method 1 of the package information 114 .

[0187] However, the luggage 101_n in the method 1 for acquiring luggage information 114 is the luggage 101_b included in the provisional loaded luggage group in the method 4 for acquiring luggage information 114. Furthermore, the "current state" condition applied to extract the luggage information 114 of the luggage 101_b included in the provisional loaded luggage group is "loaded."

[0188] Then, the storage control unit 113 transmits the identified luggage information 114 to the loading assistance device 109. As a result, the first acquisition unit 115 acquires the luggage information 114 of the luggage 101_b included in the group of provisionally loaded luggage.

[0189] (How to obtain baggage information 114 5) Similar to the method 2 for acquiring the luggage information 114, the first acquisition unit 115 may acquire the luggage information 114 from the luggage management device 108 and perform extraction processing and identification processing of the luggage information 114 of the luggage 101_b included in the provisional loaded luggage group. Alternatively, the first acquisition unit 115 may acquire the luggage information 114 extracted by the extraction processing of the luggage information 114 of the luggage 101_b included in the provisional loaded luggage group from the luggage management device 108 and perform identification processing of the luggage information 114 of the luggage 101_b.

[0190] (How to obtain baggage information 114 6) The first acquisition unit 115 may acquire the luggage information 114 of the luggage 101_b included in the provisional loaded luggage group by generating the luggage information 114 of the luggage 101_b included in the provisional loaded luggage group based on the second image data, as in the method 3 of acquiring the luggage information 114.

[0191] The method by which the first acquisition unit 115 acquires the information to be set in each element constituting the package information 114 is the same as the acquisition method 3 for the package information 114.

[0192] However, the first image data in acquisition method 3 of the luggage information 114 is the second image data in acquisition method 6 of the luggage information 114. Also, the luggage 101_n in acquisition method 3 of the luggage information 114 is the luggage 101_b included in the provisional loaded luggage group in acquisition method 6 of the luggage information 114.

[0193] When the first acquisition unit 115 acquires information to be set for each element constituting the luggage information 114 based on the second image data, the first acquisition unit 115 associates each piece of acquired information. In this way, the first acquisition unit 115 can generate luggage information 114 for luggage 101_b included in the tentative loaded luggage group.

[0194] In step S113 of this modified example, the determination unit 117 determines the next luggage 101 to be loaded onto the loading platform 103 (loading space) based on the luggage information 114 of the unloaded luggage 101_a and the luggage 101_b included in the temporary loaded luggage group and the loading information acquired in step S106.

[0195] In step S114 according to this modification, the determination unit 117 determines the loading position of the cargo 101 determined in step S113, as in the first embodiment.

[0196] In step S115 according to this modification, the output control unit 118 causes the monitor 110 to output baggage designation information for designating the baggage 101 to be loaded next, which has been determined in step S113.

[0197] In detail, for example, when the next cargo 101 to be loaded is an unloaded cargo 101_a, the output control unit 118 may perform the same processing as in the first embodiment.

[0198] If the next luggage 101 to be loaded is one of the luggage 101_b included in the group of tentatively loaded luggage, the output control unit 118 according to this modification displays a current image of the loading space captured by the second photographing unit 107 based on the second image data. Then, the output control unit 118 outputs information for pointing to the luggage 101 determined in step S113 with a pointer of a predetermined shape such as an arrow to the monitor 110. As a result, the monitor 110 displays, as luggage designation information, an image in which an image of the currently loaded luggage 101_b in the loading space is superimposed on an image in which the pointer points to the luggage 101_b determined as the next luggage 101 to be loaded.

[0199] In step S116 according to this modification, the output control unit 118 causes the monitor 110 to output position designation information for designating the loading position determined in step S114, as in the first embodiment.

[0200] This modification also provides the same effects as the first embodiment.

[0201] Furthermore, according to this modification, the loaded cargo 101_b is included in the provisional loaded cargo group as the next cargo 101 to be loaded. This makes it possible to improve the loading rate of the cargo 101.

[0202] Furthermore, the luggage 101_b included in the provisionally loaded luggage group is the luggage 101_b that has been loaded within a predetermined range that is relatively easy to move, among the loaded luggage 101_b. This makes it possible to suppress a decrease in efficiency of the loading work due to the movement of the loaded luggage 101_b.

[0203] Therefore, it is possible to further improve the loading rate of the cargo 101 while suppressing a decrease in the efficiency of the loading work.

[0204] <<Embodiment 2>> In the first embodiment, an example has been described in which the next cargo 101 to be loaded, determined by the determining unit 117, is determined from among all of the unloaded cargoes 101_a.

[0205] However, some of the luggage 101_a are preferably loaded onto the loading platform 103 at a predetermined timing, such as loading onto the loading platform 103 last. Examples of this type of luggage 101_a include items with distinctive shapes such as golf bags, fragile items, and precision machinery that require careful handling.

[0206] In the second embodiment, an example will be described in which a piece of luggage 101_a that satisfies predetermined storage conditions is treated as a piece of storage luggage and is loaded onto the loading platform 103 (loading space) at a predetermined timing. In this embodiment, differences from the first embodiment will be mainly described, and similarities to the first embodiment will be omitted as appropriate for the sake of simplicity.

[0207] 11, a loading support system 400 according to the second embodiment of the present invention includes a first photographing unit 106 and a second photographing unit 107 similar to those of the first embodiment. The loading support system 400 also includes a luggage management device 408, a loading support device 409, and a monitor 410, which replace the luggage management device 108, the loading support device 109, and the monitor 110 according to the first embodiment, respectively. The loading support system 400 also includes a third photographing unit 422.

[0208] Each of the first photographing unit 106, the second photographing unit 107, the third photographing unit 422 and the luggage management device 408 is connected to the loading support device 409 so that information can be sent and received between them via the network N.

[0209] The third photographing unit 422 photographs the storage location 423 and generates third image data including the photographed image.

[0210] The storage location 423 is an area where the storage baggage 401_c is moved from the transport location 104 and stored until the loading timing. The storage location 423 is provided near the transport location 104 (to the left of the transport location 104 in FIG. 11).

[0211] The reserved baggage 401_c is an unloaded baggage 101_a that satisfies a predetermined reservation condition.

[0212] The holding conditions may include, for example, specific types of luggage such as golf bags, specific loading conditions such as fragile items and precision machinery, and the like, which are determined in advance as appropriate.

[0213] The loading timing is determined in advance as the timing for loading the placed baggage 401_c. An example of the loading timing is "after the loading status of the loading platform 103 (for example, spatial loading rate) meets a standard." The loading timing may be determined for each placement condition. Condition information relating to placement that associates the placement conditions with the loading timing may be stored in advance in, for example, the determination unit 417 described later.

[0214] The third photographing unit 422 according to this embodiment is installed on the ceiling directly above the approximate center of the storage location 423, as shown in Fig. 11, and photographs the area surrounded by the dotted circle C shown in Fig. 11. In this way, the third photographing unit 422 photographs the entire storage location 423, and generates third image data including an image of the storage baggage 401_c that has been placed at the storage location 423.

[0215] In addition, when the photographing area of ​​the first photographing unit 106 includes the placement location 423, the loading assistance system 400 does not need to be provided with the third photographing unit 422.

[0216] (Functional configuration of the baggage management device 408) 12, the luggage management device 408 is functionally equipped with a storage unit 112 and a storage control unit 113 similar to those in the first embodiment. In this embodiment, the configuration of luggage information 414 stored in the storage unit 112 is different from that in the first embodiment.

[0217] The package information 414 is information relating to the package 101, and as shown in FIG. 13, for example, in addition to the information constituting the package information 114 according to the first embodiment, a "hold flag" is further associated therewith.

[0218] The "reservation flag" is information indicating whether the luggage 101 identified by the associated luggage ID is a reserved luggage 401_c. For example, the "reservation flag" of the reserved luggage 401_c is set to "1," and the "reservation flag" of the unloaded luggage 101a other than the reserved luggage 401_c is set to "0."

[0219] The information set in the "reservation flag" is not limited to "0" or "1", but may be any number, letter, or the like that is appropriately determined depending on whether the baggage is reserved baggage 401_c or not.

[0220] (Functional configuration of loading support device 409) The loading support device 409 is functionally 1 4, the present embodiment includes a first acquisition unit 115 and a second acquisition unit 116 similar to those in the first embodiment, and a determination unit 417 and an output control unit 418 replacing the determination unit 117 and the output control unit 118 in the first embodiment, respectively.

[0221] The determination unit 417, similarly to the first embodiment, uses the luggage information and loading information to determine the luggage 101_a to be loaded next in the loading space and the loading position of the luggage 101_a.

[0222] When an unloaded baggage 101_n is added to the group of unloaded baggage, the determination unit 417 according to the present embodiment further determines whether the added baggage 101_n is a reserved baggage that satisfies a predetermined reservation condition. This determination is made using the baggage information of the added baggage 101_n.

[0223] The determination unit 417 according to this embodiment further determines whether the placed baggage 401_c satisfies a predetermined loading timing when the placed baggage 401_c is present at the storage location 423. This determination is made using the baggage information 414 and loading information of the placed baggage 401_c.

[0224] The output control unit 418 causes the monitor 410 to output the package specification information and the position specification information, as in the first embodiment.

[0225] Furthermore, when it is determined that the luggage 101_n added to the group of unloaded luggage is the set-aside luggage 401_c, the output control unit 418 according to this embodiment displays set-aside designation information on the monitor 410. The set-aside designation information is information for designating the luggage 101_c added to the group of unloaded luggage as the set-aside luggage.

[0226] Furthermore, when it is determined that the loading timing for the reserved baggage 401_c is met, the output control unit 418 according to this embodiment displays baggage designation information on the monitor 410. The baggage designation information output here is information for designating the reserved baggage 401_c as the next baggage to be loaded.

[0227] Referring again to FIG. Similar to the first embodiment, the monitor 410 displays the baggage specification information and the location specification information under the control of the output control unit 418. That is, the monitor 410 according to this embodiment corresponds to the first output means and the second output means, similar to the first embodiment.

[0228] The monitor 410 according to this embodiment further displays placement designation information for designating the luggage 101_c added to the group of unloaded luggage as placement luggage in accordance with the control of the output control unit 418. That is, the monitor 410 according to this embodiment corresponds to a third output means for outputting placement designation information for designating the luggage 101_c added to the group of unloaded luggage as placement luggage.

[0229] The monitor 410 according to this embodiment further displays baggage designation information for designating the put-away baggage 401_c as the next baggage to be loaded in accordance with the control of the output control unit 418. That is, the monitor 410 according to this embodiment corresponds to a fourth output means for outputting baggage designation information for designating the put-away baggage 401_c as the next baggage to be loaded.

[0230] In this manner, in this embodiment, the first output means, the second output means, the third output means, and the fourth output means are realized by one monitor 410. The luggage designation information, the location designation information of luggage 101_a at the transport location 104, the placement designation information, and the location designation information of placed luggage 401_c may be displayed in different areas by dividing the display area of ​​monitor 410, or may be displayed sequentially on monitor 410 at predetermined time intervals.

[0231] As explained in Modification 2, some or all of the first output means, second output means, third output means, and fourth output means may be different devices. Also, as explained in Modification 3, a device for realizing some or all of the first output means, second output means, third output means, and fourth output means may be a device that emits light, such as a laser pointer or a projector.

[0232] Up to now, the functional configuration of the loading support system 400 according to the second embodiment has been mainly explained. Now, the physical configuration of the loading support system 400 will be explained.

[0233] Each of the first imaging unit 106 and the second imaging unit 107 may be physically configured in the same manner as in the first embodiment. The third imaging unit 422 is realized by, for example, a camera including an image sensor, similar to each of the first imaging unit 106 and the second imaging unit 107. The third imaging unit 422 is preferably a 3D camera that can also obtain information about depth (upward depth). Conventional technology may be applied to the imaging method of the 3D camera.

[0234] The luggage management device 408, the loading assistance device 409, and the monitor 410 may be physically configured in the same manner as the luggage management device 108, the loading assistance device 109, and the monitor 110 according to the first embodiment, respectively.

[0235] So far, the configuration of the loading support system 400 according to the second embodiment of the present invention has been described. Now, the operation of the loading support system 400 according to this embodiment will be described.

[0236] <Operation of Loading Assist System 400> In this embodiment, the same processing of steps S101 to S108 as in embodiment 1 is performed (see FIG. 6). In the loading support processing according to this embodiment, after the processing of steps S101 to S108, the processing shown in FIG. 15 is performed.

[0237] The loading assistance process starts, for example, when the first photographing unit 106, the second photographing unit 107, the third photographing unit 422, the luggage management device 408, the loading assistance device 409, and the monitor 410 are operated, and is repeatedly executed while these are operating, as in embodiment 1.

[0238] In this embodiment, the third photographing unit 422 continuously outputs the third image data during operation, similar to each of the first photographing unit 106 and the second photographing unit 107. This allows the loading assistance device 409 to acquire the third image data indicating the current status of the storage location 423 in real time, in addition to the first image data and the second image data.

[0239] Please refer to Figure 6. In the loading support process according to the present embodiment, after step S101 similar to that of embodiment 1, if it is determined that there is no added cargo 101_n (step S102; No), the processes of steps S105, S106, and S108 similar to those of embodiment 1 are performed. Thereafter, as shown in Fig. 16, the processes of steps S111 to S116 similar to those of embodiment 1 are performed.

[0240] Furthermore, if it is determined that there is an added piece of luggage 101_n (step S102; Yes), the same processes as in the first embodiment, steps S103 to S107 and S111 to S112, are performed as shown in Figures 6 and 16. Thereafter, in the loading support process according to this embodiment, the determination unit 417 determines whether or not the piece of luggage 101_n is a piece of luggage that satisfies a predetermined placement condition, based on the piece of luggage information 414 of the added piece of luggage 101_n acquired in step S103 (step S420).

[0241] If it is determined that the baggage is a reserved baggage (step S420; Yes), the determination unit 417 holds the baggage information 414 acquired in step S103 and transmits an instruction to the baggage management device 108 to set the "reservation flag" of the baggage information 414 to "1." As a result, the determination unit 417 updates the reserved baggage information regarding the reserved baggage 401_c (step S421).

[0242] In detail, for example, the determination unit 417 can store the baggage information 414 of the put-away baggage 401_c as put-away baggage information by storing the baggage information 414 acquired in step S103. In addition, the determination unit 417 sends an instruction to set the above-mentioned instruction to the baggage management device 108, thereby setting the "put-away flag" of the baggage information 414 of the put-away baggage 401_c stored in the storage unit 112 to "1", which is predetermined as information indicating that the baggage is put-away baggage.

[0243] The output control unit 418 causes the monitor 410 to output the placement designation information for designating the baggage 101_c added to the group of unloaded baggage as a placed baggage (step S422).

[0244] In detail, for example, the output control unit 418 displays a current image of the delivery location 104 captured by the first photographing unit 106 based on the first image data. This image includes an image of the currently unloaded baggage 101_a. Then, the output control unit 418 outputs to the monitor 410 information for pointing out the baggage 101_c determined to be the set-aside baggage in step S420 using a pointer of a predetermined shape, such as an arrow. As a result, the monitor 410 displays, as the set-aside designation information, an image in which the image of the currently unloaded baggage 101_a at the delivery location 104 is superimposed on an image in which the pointer points out the baggage 101_c determined to be the set-aside baggage.

[0245] The worker, viewing the placement designation information on the monitor 410, moves the placement baggage 401_c designated by the placement designation information to the placement location 423. As a result, the placement baggage 401_c is placed at the placement location 423.

[0246] With reserved luggage do not have If it is determined that (step S420; No ), or after the processing of step S422, the determination unit 417 determines whether or not there is a placed baggage 401_c that satisfies the loading timing at the placement location 423 (step S423).

[0247] In detail, for example, the determination unit 417 acquires third image data from the third photographing unit 422. Based on the third image data, the determination unit 417 determines whether the put-away baggage 401_c is at the storage location 423. If the put-away baggage 401_c is not at the storage location 423, the determination unit 417 determines that the put-away baggage 401_c that satisfies the loading timing is not at the storage location 423.

[0248] When the reserved baggage 401_c is in the storage location 423, the determination unit 417 Tori Luggage storage 4The determination unit 417 refers to the luggage information 414 of the put-away luggage 401_c. Based on the luggage information 414 of the put-away luggage 401_c and the condition information related to the put-away luggage, the determination unit 417 identifies the putting-away conditions of the put-away luggage 401_c and acquires the loading timing corresponding to the identified putting-away conditions. Based on the acquired loading timing and loading information, the determination unit 417 determines whether the put-away luggage 401_c satisfies the loading timing.

[0249] For example, if the loading timing is "after the spatial loading rate of the loading platform 103 meets the standard," the determination unit 417 calculates the ratio of the volume occupied by the luggage 101 to the volume of the loading space (spatial loading rate) based on the second image data.

[0250] Then, when the spatial loading rate satisfies the criterion, the determination unit 417 determines that the placed baggage 401_c satisfies the loading timing. That is, the determination unit 417 determines that the placed baggage 401_c that satisfies the loading timing is present in the placement location 423.

[0251] Furthermore, if the spatial loading ratio does not satisfy the criteria, the determination unit 417 determines that the placed baggage 401_c does not satisfy the loading timing. In other words, the determination unit 417 determines that the placed baggage 401_c that satisfies the loading timing is not present in the placement location 423.

[0252] If it is determined that there is no placed baggage 401_c that satisfies the loading timing in the placement location 423 (step S423; No), the same processes as in the first embodiment, steps S113 to S116, are performed.

[0253] If it is determined that the reserved baggage 401_c that satisfies the loading timing is present in the storage location 423 (step S423; Yes), the determination unit 417 determines the reserved baggage 401_c that satisfies the loading timing as the baggage 101_a to be loaded next (step S413).

[0254] The determination unit 417 determines the loading position of the placed baggage 401_c determined in step S413, as in the first embodiment (step S114).

[0255] The output control unit 418 causes the monitor 410 to output baggage designation information for designating the next placed baggage 401_c to be loaded, which was determined in step S413 (step S415).

[0256] In detail, for example, the output control unit 418 displays a current image of the storage location 423 captured by the third image capture unit 422 based on the third image data. This image includes an image of the placed baggage 401_c. Then, the output control unit 418 outputs information for pointing to the placed baggage 401_c determined in step S413 using a pointer of a predetermined shape such as an arrow to the monitor 410. As a result, the monitor 410 displays, as baggage designation information, an image in which the image of the currently placed baggage 401_c at the storage location 423 is superimposed on an image in which the pointer points to the placed baggage 401_c to be loaded next is indicated.

[0257] As in the first embodiment, the output control unit 118 causes the monitor 410 to output position designation information for designating the loading position determined in step S114 (step S116).

[0258] The determination unit 417 deletes the baggage information 414 of the placed baggage 401_c that is determined to meet the loading timing in step S423 from the baggage information 414 that it holds as placed baggage information. The determination unit 417 also sends an instruction to the baggage management device 108 to set the "placement flag" of the baggage information 414 of the placed baggage 401_c to "0." As a result, the determination unit 417 updates the placed baggage information regarding the placed baggage 401_c (step S424).

[0259] In detail, for example, the determination unit 417 deletes the luggage information 414 that it holds as the holding luggage information, thereby holding the luggage information 414 of the currently held luggage 401_c as the holding luggage information. Also, the determination unit 417 sends an instruction to set the above-mentioned instruction to the luggage management device 108, thereby setting the "holding flag" of the luggage information 414 of the held luggage 401_c held in the memory unit 112 to "0", which is predetermined as information indicating that the luggage is not the holding luggage.

[0260] As a result, the determining unit 417 ends the loading support process.

[0261] In this embodiment, when the luggage 101_c is added to the group of unloaded luggage, luggage information of the added luggage 101_c is acquired. Then, using the luggage information 414 of the added luggage 101_c, it is determined whether the added luggage 101_c is a reserved luggage that satisfies the reservation conditions.

[0262] As a result, when the luggage 101_c is added to the group of unloaded luggage, it can be determined whether the luggage 101_c is a reserved luggage. Therefore, the luggage 101_c can be treated as a reserved luggage different from the other unloaded luggage 101_a in that it will not be loaded until the loading timing, and the efficiency of the loading work can be improved. Therefore, the efficiency of the loading work of the luggage 101 can be improved.

[0263] In this embodiment, when it is determined that the added luggage 101_c is a reserved luggage, the storage designation information for designating the added luggage 101_c as a reserved luggage is output. This makes it possible to easily and quickly identify the reserved luggage 401_c that will not be loaded until the loading timing and move it from the transport location 104.

[0264] When a large number of packages 101_a are delivered to the transfer location 104, the packages 101_a at the transfer location 104 may become overcrowded, which may reduce the efficiency of the loading operation of the packages 101. According to this embodiment, as described above, the reserved packages 401_c can be moved from the transfer location 104, which reduces the number of packages 101_a at the transfer location 104 and prevents a reduction in the efficiency of the loading operation of the packages 101. Therefore, it is possible to improve the efficiency of the loading operation of the packages 101.

[0265] According to this embodiment, when it is determined that the loading timing for the placed baggage 401_c is met, baggage designation information for designating the placed baggage 401_c as the next baggage to be loaded is output. This allows the worker to reliably load the placed baggage 401_c onto the loading platform 103 (loading space) at the loading timing for the placed baggage 401_c. By appropriately handling the placed baggage 401_c in this way, it is possible to prevent damage to the placed baggage 401_c and improve the loading rate of the baggage 101.

[0266] Although the embodiments and modifications of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0267] In addition, although the flowcharts used in the above description show multiple steps (processes) in a sequential order, the order of steps performed in each embodiment is not limited to the order shown. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of content. Furthermore, the above-described embodiments and variations can be combined as long as the content is not contradictory.

[0268] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0269] 1. A first acquisition means for acquiring baggage information of each baggage included in a group of unloaded baggage; A second acquisition means for acquiring loading information indicating a current loading status of the loading space; a determining means for determining the next cargo to be loaded into the loading space using the cargo information and the loading information; an output control means for causing the first output means to output cargo designation information for designating the next cargo to be loaded; Loading assistance device. 2. The determining means further determines a loading position in the loading space of the next cargo to be loaded using the cargo information and the loading information; The output control means further controls the second output means to output position designation information for designating the loading position of the next cargo to be loaded. The loading assistance device described in 1 above. 3. The package information includes at least one of the size, weight, shape, and loading conditions of each package. The loading assistance device according to 1 or 2 above. 4. When a piece of luggage is added to the group of unloaded luggage, the first acquisition means acquires luggage information of the added piece of luggage; The determining means further determines whether the added parcel is a reserved parcel that satisfies a predetermined reservation condition using the parcel information of the added parcel. A loading assistance device according to any one of 1. to 3. above. 5. When it is determined that the added parcel is the reserved parcel, the output control means further outputs, to a third output means, reservation designation information for designating the added parcel as the reserved parcel. The loading assistance device described in 4. above. 6. The determination means further determines whether the reserved luggage satisfies a predetermined loading timing using the luggage information and the loading information; When it is determined that the loading timing for the reserved baggage is met, the output control means outputs the baggage designation information for designating the reserved baggage as the baggage to be loaded next to the fourth output means. The loading assistance device described in 5. above. 7. When at least one of the following is detected: an item has been added to the group of unloaded items; or a change has occurred in the current loading status of the loading space; the determining means determines the next item to be loaded in the loading space using the item information and the loading information. A loading assistance device according to any one of 1. to 6. above. 8. The first acquisition means acquires luggage information of one or more luggage included in a group of provisionally loaded luggage loaded within a predetermined range among luggage loaded in the loading space. A loading assistance device according to any one of items 1 to 7 above. 9. A first acquisition means for acquiring baggage information of each baggage included in the group of unloaded baggage; A second acquisition means for acquiring loading information indicating a current loading status of the loading space; a determining means for determining the next cargo to be loaded into the loading space using the cargo information and the loading information; a first output means for outputting luggage designation information for designating the luggage to be loaded next; Loading assistance system. 10. Acquire information about each of the unloaded luggage items; Obtaining loading information indicating the current loading status of the loading space; Using the luggage information and the loading information, determine the luggage to be loaded next into the loading space; outputting, to the first output means, cargo designation information for designating the cargo to be loaded next; Loading assistance methods. 11. On the computer, Acquiring baggage information for each of the bags included in the group of unloaded bags; obtaining loading information indicating a current loading status of the loading space; determining a next cargo to be loaded into the loading space using the cargo information and the loading information; and causing the first output means to output cargo designation information for designating the next cargo to be loaded. [Explanation of symbols]

[0270] 100,200,400 Loading Assistance System 101, 101_a, 101_b, 101_n Luggage 102 tracks 103 Cargo bed 104 Delivery location 105 Conveyor 106 First Filming Section 107 2nd Filming Department 108,408 Luggage management device 109,409 Loading assistance device 110,410 monitor 112 Storage section 113 Memory control unit 114,414 Baggage Information 115 First acquisition part 116 Second Acquisition Department 117,417 Decision Section 118,418 Output control section 221 Display device 401_c Reserved luggage 422 Third Filming Division 423 Reservation Location

Claims

1. a first acquisition means for acquiring baggage information of each baggage included in the group of unloaded baggage; a second acquiring means for acquiring loading information indicating a current loading status of the loading space; a determining means for determining the next cargo to be loaded into the loading space using the cargo information and the loading information; output control means for causing the first output means to output cargo designation information for designating the next cargo to be loaded; The determination means is a loading assistance device that determines the next cargo to be loaded into the loading space using the cargo information and the loading information when a change in the current loading status of the loading space is detected.

2. The determining means further determines a loading position in the loading space of the next cargo to be loaded using the cargo information and the loading information, The output control means further causes the second output means to output position designation information for designating the loading position of the next cargo to be loaded. The loading assist device according to claim 1 .

3. The luggage information includes at least one of the size, weight, shape, and loading conditions of each of the luggage.

3. A loading assistance device according to claim 1 or 2.

4. When a piece of luggage is added to the group of unloaded luggage, the first acquisition means acquires luggage information of the added piece of luggage, The determining means further determines whether the added parcel is a reserved parcel that satisfies a predetermined reservation condition using the parcel information of the added parcel. The loading assistance device according to any one of claims 1 to 3.

5. The output control means, when it is determined that the added parcel is the reserved parcel, further outputs, to a third output means, retention designation information for designating the added parcel as the reserved parcel.

5. The loading assist device according to claim 4.

6. The determination means further determines whether the reserved luggage satisfies a predetermined loading timing using the luggage information and the loading information; When it is determined that the loading timing for the reserved baggage is met, the output control means outputs the baggage designation information for designating the reserved baggage as the baggage to be loaded next to the fourth output means.

6. The loading assistance device according to claim 5.

7. The first acquisition means acquires luggage information of one or more luggage included in a group of provisionally loaded luggage loaded within a predetermined range among luggage loaded in the loading space. A loading assistance device according to any one of claims 1 to 6.

8. Acquire information about each of the unloaded luggage items; Obtaining loading information indicating the current loading status of the loading space; Using the luggage information and the loading information, determine the luggage to be loaded next into the loading space; outputting, to the first output means, cargo designation information for designating the cargo to be loaded next; When a change in the current loading status of the loading space is detected, the next cargo to be loaded in the loading space is determined using the cargo information and the loading information. Loading assistance methods.

9. On the computer, Acquiring baggage information for each of the bags included in the group of unloaded bags; obtaining loading information indicating a current loading status of the loading space; determining a next cargo to be loaded into the loading space using the cargo information and the loading information; and outputting, to the first output means, cargo designation information for designating the cargo to be loaded next; a program for determining the next cargo to be loaded into the loading space using the cargo information and the loading information when a change in the current loading status of the loading space is detected;

Images