Package management apparatus, package management system, package management method, and program

Abstract

To efficiently determine whether a package form based on the appearance of a package loaded onto a vehicle matches information indicating a package form of the package.SOLUTION: Package information acquisition means acquires package form information indicating a package form of a specific package, out of packages to be loaded onto or unloaded from a vehicle. Video data acquisition means acquires video data generated by imaging the specific package. Package form analysis means identifies a package form based on the appearance of the specific package, from the video data. Determination means determines whether the package form of the specific package identified by the package form analysis means matches the package form of the specific package indicated by the package form information, and outputs a result of the determination.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a luggage management device, a luggage management system, a luggage management method, and a program. [Background technology]

[0002] In recent years, the logistics industry has been facing difficulties in securing drivers for vehicles that transport cargo. Therefore, in order to reduce the burden on drivers, measures are being considered to reduce the workload and improve efficiency of the work associated with cargo transportation. For drivers to perform their work efficiently, it is desirable to reduce the time required for loading and unloading cargo by smoothly loading and unloading cargo onto vehicles. Therefore, it is necessary to understand the packaging of the cargo to be loaded and unloaded.

[0003] For example, Patent Document 1 proposes a method for simulating the loading of luggage using 3D models of luggage. In this method, a 3D model is generated for each luggage based on arrangement information including an identification code, type information, dimensional information, and attribute information associated with each luggage. Then, a simulation is performed in which the 3D models of multiple luggage are loaded, and the luggage loading state is evaluated. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-76965 Summary of the Invention [Problem to be solved by the invention]

[0005] However, there are cases where the data entered into a delivery system, for example, shows a discrepancy between the actual package shape and the package shape of the parcel. For example, even if the data shows that 10 cardboard boxes are loaded onto a cart and made into one package, in reality, the 10 cardboard boxes may not be loaded onto the cart and may remain as 10 packages. In this case, because the data shows a discrepancy between the package shape and the actual package shape, even if the data is used to predict whether or not a parcel can be loaded onto a vehicle, it may not be possible to load multiple parcels onto the vehicle as expected. [Means for solving the problem]

[0006] A luggage management device according to one embodiment comprises a luggage information acquisition means for acquiring packaging style information indicating the packaging style of specific luggage among the luggage to be loaded onto and unloaded from a vehicle, a video data acquisition means for acquiring video data generated by imaging the specific luggage, a packaging style analysis means for identifying the packaging style based on the appearance of the specific luggage from the video data, and a determination means for determining whether the packaging style of the specific luggage identified by the packaging style analysis means matches the packaging style of the specific luggage indicated by the packaging style information, and outputting the determination result.

[0007] A luggage management system according to one embodiment comprises an imaging means for capturing images of luggage being loaded onto and unloaded from a vehicle, a luggage information acquisition means for acquiring packaging style information indicating the packaging style of a specific luggage among the luggage being loaded onto and unloaded from the vehicle, a video data acquisition means for acquiring video data generated by the imaging means capturing an image of the specific luggage, a packaging style analysis means for identifying the packaging style based on the appearance of the specific luggage from the video data, and a determination means for determining whether the packaging style of the specific luggage identified by the packaging style analysis means matches the packaging style of the specific luggage indicated by the packaging style information, and outputting a determination result.

[0008] A cargo management method according to one embodiment acquires packaging style information indicating the packaging style of specific cargo among the cargo being loaded onto and unloaded from a vehicle, acquires video data generated by capturing an image of the specific cargo, identifies the packaging style based on the appearance of the specific cargo from the video data capturing the specific cargo, determines whether the identified packaging style of the specific cargo matches the packaging style of the specific cargo indicated by the packaging style information, and outputs the determination result.

[0009] A program according to one embodiment causes a computer to perform the following processes: acquiring packaging style information indicating the packaging style of specific cargo among the cargo to be loaded onto and unloaded from a vehicle; acquiring video data generated by capturing an image of the specific cargo; identifying the packaging style based on the appearance of the specific cargo from the video data capturing the specific cargo; and determining whether the identified packaging style of the specific cargo matches the packaging style of the specific cargo indicated by the packaging style information, and outputting the determination result. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to efficiently determine whether the packaging style based on the appearance of the luggage loaded onto a vehicle matches the information indicating the packaging style of the luggage. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram illustrating a configuration of a package management system according to an embodiment of the present invention; [Figure 2] FIG. 10 is a diagram showing a modified example of the luggage management system according to the embodiment. [Figure 3] FIG. 10 is a diagram showing a modified example of the luggage management system according to the embodiment. [Figure 4] 1 is a block diagram illustrating a configuration of a luggage management device according to an embodiment. [Figure 5] 1 is a block diagram illustrating a configuration of a luggage management device according to an embodiment. [Figure 6] FIG. 10 is a diagram illustrating an example of a packaging information database. [Figure 7] 10 is a flowchart of the operation of the luggage management device according to one embodiment. [Figure 8] 1 is a block diagram illustrating a configuration of a luggage management device according to an embodiment. [Figure 9] 10 is a flowchart of the operation of the luggage management device according to one embodiment. [Figure 10] 1 is a block diagram illustrating a configuration of a package management system according to an embodiment of the present invention; [Figure 11] FIG. 10 is a diagram illustrating an example of the configuration of a computer for realizing the luggage management device. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same elements are designated by the same reference numerals, and redundant explanations will be omitted as necessary.

[0013] When referring to one embodiment below, it means that the present invention can be applied to any one of the embodiments described below or a combination of two or more embodiments, and is not limited to a specific embodiment.

[0014] Embodiment 1 A luggage management system that manages luggage loaded onto a vehicle based on its appearance will be described. FIG. 1 is a block diagram that schematically shows the configuration of a luggage management system according to one embodiment. The luggage management system 1000 has an imaging device 1 and a luggage management device 100. The imaging device 1 captures images of the packaging of luggage 3 at, for example, the departure and arrival points of a vehicle 2 that transports the luggage. The luggage captured by the imaging device 1 may be in a state where it is not loaded onto the vehicle 2, or may be in a state where it is loaded into the luggage compartment of the vehicle 2.

[0015] 1, the imaging device 1 is an imaging device fixedly installed at a specific location, such as a surveillance camera at the departure or arrival point of the vehicle 2. The imaging device 1 transmits captured video data DAT to the baggage management device 100. In FIG. 1, for example, the baggage management device 100 and the imaging device 1 are connected by a cable 4 to enable bidirectional communication.

[0016] The imaging device 1 may be any of various imaging devices installed in the vehicle 2 that can capture images of the packaged luggage being transported, such as a camera installed in the vehicle 2 for use in autonomous driving (AD) or advanced driver-assistance systems (ADAS). FIG. 2 is a diagram showing a modified example of a luggage management system according to an embodiment. In the example of FIG. 2, the imaging device 1 is configured as a camera for ADAS and is installed so as to be able to capture images of, for example, the rear of a luggage compartment 2A of the vehicle 2. An openable door 2B is installed at the rear of the luggage compartment 2A of the vehicle 2. The luggage to be transported is loaded into the luggage compartment 2A with the door 2B open, and then unloaded from the luggage compartment 2A. In the example of FIG. 2, the imaging device 1 may transmit video data DAT to the luggage management device 100, for example, via various commonly used wired or communication lines or networks.

[0017] The luggage management device 100 is installed, for example, in a facility such as a delivery management center of an organization to which the driver of the vehicle 2 belongs, such as a transportation company. However, the location where the luggage management device 100 is installed is not limited to this, and the luggage management device 100 may be installed in any location.

[0018] The imaging device 1 may also store the video data DAT in a storage device via various communication means. FIG. 3 is a diagram illustrating a modified example of a luggage management system according to an embodiment. In the example of FIG. 3, compared to the example of FIG. 2, a storage device 5 is further provided in the vehicle 2. The imaging device 1 stores the video data DAT in the storage device 5. This allows the storage device 5 to store video data DAT captured on multiple different occasions. The luggage management device 100 may acquire the video data DAT stored in the storage device 5 via any communication means as needed. The storage device 5 may be a storage device installed in the vehicle 2 or a storage device detachable from the vehicle 2. If the storage device 5 is detachable from the vehicle 2, for example, as shown in FIG. 2, when the vehicle 2 moves to a facility where the luggage management device 100 is installed, the storage device 5 may be detached from the vehicle 2 and connected to the luggage management device 100 via a cable 6. This allows the luggage management device 100 to acquire the video data DAT from the storage device 5 as needed.

[0019] The luggage management device 100 analyzes whether the data representation of the luggage included in the video data DAT matches the actual packaging style identified from the video, based on the video data DAT received from the imaging device 1. Then, the luggage management device 100 outputs a determination result DET.

[0020] 4 is a block diagram showing a schematic configuration of a luggage management device according to an embodiment. The luggage management device 100 includes a video data acquisition unit 11, a packaging style information acquisition unit 12, a packaging style analysis unit 13, and a determination unit 14.

[0021] The video data acquisition unit 11 acquires the video data DAT to be analyzed from either or both of the imaging device 1 and the storage device 5 as appropriate.

[0022] The packaging style information acquisition unit 12 refers to the information database 10 based on the package identification information ID that identifies the package included in the video data DAT acquired by the video data acquisition unit 11, and acquires the package style information S of the package included in the video data DAT.

[0023] The baggage identification information ID may be acquired, for example, by a driver or the like reading a slip attached to the baggage and inputting the information into a terminal, or by reading a barcode attached to the slip. The acquired baggage identification information ID may be linked to the video data DAT by the video data acquisition unit 11 or the packaging information acquisition unit 12.

[0024] The packaging style information acquisition unit 12 acquires the packaging style information corresponding to the package identification information ID by, for example, referring to a packaging style information database stored in an external storage device or a storage device provided in the package management device 100. Then, the packaging style information acquisition unit 12 outputs the acquired packaging style information S to the determination unit 14.

[0025] Fig. 5 is a block diagram showing a schematic configuration of a luggage management device according to an embodiment. In Fig. 5, luggage management device 100 is further provided with an information database 10. Information database 10 stores a packaging style information database 10A.

[0026] FIG. 6 is a diagram showing an example of a packaging style information database. In the packaging style information database 10A, a package identification information ID that identifies a package is linked to the corresponding packaging style information, as in each row of the table in FIG. 6. The package identification information ID is information for individually identifying a package, such as a slip number. The information indicating the packaging style may be a symbol or number that indicates the type of packaging style. The information indicating the packaging style may also be text information that indicates the name of the packaging style, such as bulk or wagon.

[0027] The packaging style information may be extracted from text such as a contract for service concluded between a transporter and a shipper, or a delivery instruction. In this case, the packaging style information may be extracted by manually reading the contract for service or the delivery instruction. Alternatively, the packaging style information may be extracted by applying a general natural language processing model to the contract for service or the delivery instruction.

[0028] The packaging style analysis unit 13 inputs the video data DAT into a packaging style identification model, and outputs an analysis result RES, which is information indicating the packaging style of the package included in the video data DAT, from the packaging style identification model to the determination unit 14. The packaging style analysis unit 13 can use various methods that function as a classifier that can identify the type of packaging style of the package included in the video data DAT. For example, the packaging style analysis unit 13 may be a trained model constructed by machine learning using training data consisting of video data capturing the actual packaging style of the package being driven and a label indicating the packaging style. The video data included in the training data may be, for example, video data capturing images of packages in various packaging styles in advance.

[0029] The determination unit 14 compares the analysis result RES with the packaging style information S, and determines whether or not the actual packaging style identified from the video matches the packaging style indicated by the packaging style information S. Then, the determination unit 14 outputs the determination result DET.

[0030] The determination unit 14 can output the determination result DET in various ways. For example, the determination unit 14 may display text information or a diagram indicating the determination result DET on a display device such as a display. The determination unit 14 may also print and output the text information or a diagram indicating the determination result DET using a printer, for example. Furthermore, the determination unit 14 may output a sound notifying the user of the determination result DET using an audio output device such as a speaker, for example.

[0031] The following describes the operation of the luggage management device 100. Fig. 7 is a flowchart of the operation of the luggage management device according to one embodiment.

[0032] Step S11 The video data acquisition unit 11 acquires the video data DAT to be analyzed.

[0033] Step S12 The package style information acquisition unit 12 refers to the information database 10 based on the package identification information ID, and acquires package style information S of the package contained in the video data DAT.

[0034] Step S13 The packaging style analysis unit 13 inputs the video data DAT into a packaging style identification model, and outputs an analysis result RES indicating the type of packaging style of the package included in the video data DAT.

[0035] Step S14 The determining unit 14 compares the analysis result RES with the packaging style information S, and determines whether the actual packaging style identified from the video and the packaging style indicated by the packaging style information S match.

[0036] Step S15 The determination unit 14 outputs the determination result DET in step S14.

[0037] As described above, the luggage management device 100 can detect when the luggage style indicated by the luggage style information does not match the actual luggage style. This makes it possible to prevent a situation in which luggage cannot be loaded as planned into a luggage compartment created based on the luggage style information due to a difference in the actual luggage style.

[0038] On the other hand, for luggage for which no discrepancies in packaging style are detected, it is believed that the luggage can be loaded according to the prior luggage loading plan. Therefore, manual confirmation work can be omitted for luggage for which no discrepancies in packaging style are detected. This allows manual confirmation work and correction of the loading plan to be performed only for luggage for which discrepancies in packaging style are detected. As a result, it is possible to reduce the manual confirmation work and the number of personnel required for the confirmation work compared to manually checking the packaging style of all luggage.

[0039] Furthermore, the loading operation can be carried out smoothly, shortening the time required for the operation. This also makes it possible to shorten the waiting time of the vehicle driver when loading the cargo. As a result, the time that the driver is not working can be reduced, and the driver's work efficiency can be improved.

[0040] Embodiment 2 In the first embodiment, the luggage management device is described as determining whether the packaging style matches, but the luggage management device may also provide additional information that is useful for loading luggage. In this embodiment, a luggage management device that can provide additional information in addition to the determination result of the packaging style will be described.

[0041] 8 is a block diagram showing a schematic configuration of a luggage management device according to one embodiment. The luggage management device 200 has a configuration in which the information database 10 and the information database 20 of the luggage management device 100 according to the first embodiment are replaced with each other. The luggage management device 200 further has an additional information acquisition unit 21.

[0042] In comparison with the information database 10, the information database 20 further stores additional information AD.

[0043] The additional information acquisition unit 21 refers to the information database 20 and acquires the additional information AD corresponding to the package identification information ID. Then, the additional information acquisition unit 21 may output the acquired additional information AD. In this case, the additional information acquisition unit 21 may appropriately output the additional information AD in the same manner as the determination result DET.

[0044] The additional information AD may be physical characteristics other than appearance, such as the weight and volume of the luggage determined or estimated in accordance with the packaging information. If the additional information AD is the weight of the luggage, the user of the luggage management device 200 can refer to the provided luggage weight to consider the weight balance when loading multiple luggage. If the additional information AD is the luggage volume, the user of the luggage management device 200 can refer to the provided luggage volume to consider whether multiple luggage can be loaded and the loading order.

[0045] The additional information AD may also be luggage loading conditions. The loading conditions referred to here may be, for example, information indicating the luggage loading posture, such as "Upside down only," information specifying the luggage loading position, such as "No overloading," or information indicating luggage handling instructions, such as "Fragile." When the additional information AD is luggage loading conditions, the user of the luggage management device 200 can refer to the provided luggage loading conditions to consider the appropriateness of the posture and position of the luggage when loading multiple luggage.

[0046] The additional information AD may be obtained from an indication attached to a shipping slip attached to the package or from package data entered into the delivery system. For example, the additional information AD may be extracted based on image data of a shipping slip and stored in the information database 20. Furthermore, physical quantity data such as weight and volume may be estimated values ​​using machine learning. For example, the type and packaging information of the package indicated by the package identification information ID may be input into a trained model constructed by machine learning learning data linked to package type, packaging style, and quantity data to estimate quantity data such as weight and volume.

[0047] The other configurations of the luggage management device 200 are the same as those of the luggage management device 100, so duplicated explanations will be omitted.

[0048] Next, a description will be given of the operation of the luggage management device 200. Fig. 9 is a flowchart of the operation of the luggage management device according to one embodiment.

[0049] Steps S21 to S25 Steps S21 to S25 are similar to steps S11 to S15 in FIG. 7, respectively, and therefore will not be described again.

[0050] Step S26 The additional information acquisition unit 21 refers to the information database 20 and acquires the additional information AD corresponding to the package identification information ID.

[0051] Step S27 The additional information acquisition unit 21 outputs the acquired additional information AD.

[0052] As described above, the luggage management device 200 can provide not only the result of determining the style of packaging, but also additional information that is useful for loading luggage.

[0053] Embodiment 3 The cargo management device described in the above embodiment may provide the determination results and additional information to a matching device that matches cargo in order to load cargo from multiple shippers or multiple cargoes with different packaging styles onto a vehicle.

[0054] 10 is a block diagram showing a schematic configuration of a luggage management system according to one embodiment. The luggage management system 3000 includes a luggage management device 200 according to the second embodiment and a matching device 7.

[0055] The luggage management device 200 outputs the determination result DET and additional information AD to the matching device 7.

[0056] The matching device 7 is a device that matches luggage to be loaded onto a vehicle based on information indicating the packaging style, weight, volume, etc. obtained from multiple luggage slips, etc. The matching device 7 may verify whether the luggage packaging style included in the luggage matching information generated in advance is appropriate in light of the determination result DET. If the luggage packaging style included in the luggage matching information differs from the packaging style identified by the luggage management device 200 from the video, it may not be possible to load the luggage onto the vehicle according to the matching information. Therefore, the matching device 7 may regenerate the matching information based on the determination result DET. Furthermore, when regenerating the matching information, the additional information AD may be referenced to confirm whether the matching is being performed within the range of the specified vehicle's load weight and loading requirements.

[0057] As described above, the baggage management system 3000 can verify the validity of the matching information generated in advance, in accordance with the determination result DET from the baggage management device 200.

[0058] Other embodiments Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0059] The baggage management system according to the third embodiment has been described as including the baggage management device 200 according to the second embodiment. However, the baggage management system may be configured such that the baggage management device 100 according to the first embodiment provides the determination result DET to the matching device 7. In this case, the matching device 7 may verify the validity of the matching result based on the determination result DET received from the baggage management device 100.

[0060] In the above embodiment, the packaging style analysis unit 13 and the determination unit 14 are described separately, but this is merely for the sake of convenience. For example, the packaging style analysis unit 13 and the determination unit 14 may be constructed as a model that performs similar determination processing based on video data and packaging style information.

[0061] In the above-described embodiment, the model used by the packaging style analysis unit 13 may be re-learned in accordance with information indicating the appropriateness of the determination result DET given to the package management device by a user who uses the determination result DET. Also, the determination criteria in the determination unit 14 may be changed in accordance with the information indicating the appropriateness of the determination result DET.

[0062] In the above embodiment, video data is used, but the video data is not limited to video data. The video data may be a single still image, a frame-by-frame video consisting of a set of multiple still images, or the like.

[0063] In the above-described embodiment, the luggage management device according to the present disclosure has been described primarily as a hardware configuration, but this is not limited thereto. The luggage management device according to the present disclosure can also be realized by having a computer execute a computer program to perform any desired processing. These processes may be realized by having a computer including at least one processor (e.g., a microprocessor, CPU, GPU, MPU, or DSP (Digital Signal Processor)) execute the program. Specifically, one or more programs including instructions for causing a computer to perform these algorithms for transmitting or receiving signals may be created, and the programs may be supplied to the computer.

[0064] A computer program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to a computer via a wired communication path such as an electric wire or optical fiber, or via a wireless communication path.

[0065] An example of the configuration of a computer for realizing a luggage management device is shown below. FIG. 11 is a diagram showing an example of the configuration of a computer for realizing a luggage management device. The luggage management device can be realized by a computer 9000 such as a dedicated computer or a personal computer (PC). However, the computer does not need to be physically single, and may be multiple when performing distributed processing. As shown in FIG. 11, the computer 9000 has, for example, a processor 9001, a ROM (Read Only Memory) 9002, a RAM (Random Access Memory) 9003, a storage unit 9004, a communication interface 9005, and a user interface 9006.

[0066] The processor 9001, ROM 9002, RAM 9003, storage unit 9004, communication interface 9005, and user interface 9006 are connected to each other so as to be able to communicate with each other via a bus 9007. Note that although explanation of OS software for operating the computer is omitted, it is also installed in the computer 9000 as appropriate.

[0067] The ROM is configured by, for example, a nonvolatile semiconductor memory device, etc. The ROM 9002 stores information such as various programs used by the computer 9000.

[0068] The storage unit 9004 is configured by various storage devices such as a hard disk, a solid state disk, etc. Furthermore, the storage unit 9004 is not limited to a storage device installed in the computer 9000, but may be a storage device external to the computer 9000. The external storage device may be a cloud storage connected to the computer 9000 via various communication means, for example, a network. The storage unit 9004 stores information such as various programs and data used by the computer 9000.

[0069] The RAM 9003 is configured by a volatile semiconductor memory device, etc. Programs, data, and other information used by the processor 9001 are loaded into the RAM 9003 from one or both of the ROM 9002 and the storage unit 9004 as appropriate.

[0070] The processor 9001 may be configured with, for example, a CPU (Central Processing Unit). The processor 9001 may also include not only a CPU but also a GPU (Graphics Processing Unit). A GPU is suitable for performing routine processing in parallel, and when applied to processing in a neural network, for example, it can improve processing speed compared to a CPU. The processor 9001 executes various processes based on various programs stored in the ROM 9002 or various programs and data held in the RAM 9003, as appropriate. The processor 9001 may also store data generated by processing in the RAM 9003 or the storage unit 9004, as appropriate.

[0071] The communication interface 9005 is an interface that connects the computer 9000 to a communication network such as the Internet or an intranet via various wired communication means or wireless communication means, etc. This allows the computer 9000 to communicate with other devices, systems, sensors, etc. that are connected to the communication network.

[0072] The user interface 9006 includes, for example, a display unit that provides information so that the user can recognize it using a display device or the like, and an audio output unit that outputs audio. The user interface 9006 also includes an input unit that allows the user to input information to the computer 9000 by operating a keyboard, mouse, touch panel, or the like. The user interface 9006 may also include devices such as sensors that obtain information useful to the user.

[0073] Although the computer 9000 has been described as a single device here, this is merely an example. The computer 9000 may be composed of multiple physically separated devices. Some of the multiple devices may be portable devices, and other devices may be stationary devices.

[0074] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0075] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0076] (Supplementary Note 1) A luggage management device comprising: a luggage information acquisition means for acquiring packaging style information indicating the packaging style of specific luggage among the luggage to be loaded and unloaded onto a vehicle; a video data acquisition means for acquiring video data generated by imaging the specific luggage; a packaging style analysis means for identifying the packaging style based on the appearance of the specific luggage from the video data; and a determination means for determining whether the packaging style of the specific luggage identified by the packaging style analysis means matches the packaging style of the specific luggage indicated by the packaging style information, and outputting the determination result.

[0077] (Appendix 2) The luggage management device described in Appendix 1, wherein the packaging style analysis means inputs the video data to be estimated into a model constructed in advance by machine learning learning data consisting of learning video data of luggage and label information that indicates the packaging style of the luggage and is included in the learning video data and is linked to the learning video data, and outputs an identification result of the packaging style of the luggage included in the video data to be estimated from the model, and the determination means outputs the determination result based on the identification result and the packaging style information.

[0078] (Appendix 3) A luggage management device as described in Appendix 1 or 2, wherein, based on information indicating the appropriateness of the judgment result, the packaging style analysis means re-learns the model, or the judgment means changes the criteria for determining whether the packaging style of the specific luggage identified by the packaging style analysis means matches the packaging style of the specific luggage indicated by the packaging style information.

[0079] (Supplementary Note 4) The luggage management device according to any one of Supplementary Notes 1 to 3, wherein the packaging style information of the specific luggage is extracted from information indicating the packaging style of the specific luggage.

[0080] (Appendix 5) A luggage management device described in any one of Appendices 1 to 4, wherein the luggage information acquisition means further acquires additional information about the specific luggage that is different from the packaging information, and outputs the acquired additional information.

[0081] (Supplementary Note 6) The luggage management device according to Supplementary Note 5, wherein the additional information is part or all of the weight, volume, or loading conditions of the specific luggage.

[0082] (Appendix 7) A luggage management device described in any one of Appendices 1 to 4, wherein the determination means outputs the determination result to a matching device that performs matching for loading the specific luggage and luggage other than the specific luggage into a specific vehicle, and the matching device verifies the validity of the matching result based on the determination result.

[0083] (Appendix 8) The luggage management device described in Appendix 5, wherein the determination means outputs the determination result to a matching device that performs matching for loading the specific luggage with luggage other than the specific luggage into a specific vehicle, the luggage information acquisition means outputs the additional information to the matching device, and the matching device verifies the validity of the matching result based on the determination result and the additional information.

[0084] (Appendix 9) A luggage management system comprising: an imaging means for imaging luggage to be loaded onto and unloaded from a vehicle; a luggage information acquisition means for acquiring packaging style information indicating the packaging style of specific luggage among the luggage to be loaded onto and unloaded from the vehicle; a video data acquisition means for acquiring video data generated by the imaging means capturing the specific luggage; a packaging style analysis means for identifying the packaging style based on the appearance of the specific luggage from the video data; and a determination means for determining whether the packaging style of the specific luggage identified by the packaging style analysis means matches the packaging style of the specific luggage indicated by the packaging style information, and outputting the determination result.

[0085] (Appendix 10) A cargo management method comprising: acquiring packaging style information indicating the packaging style of specific cargo among the cargo to be loaded onto and unloaded from a vehicle; acquiring video data generated by imaging the specific cargo; identifying the packaging style based on the appearance of the specific cargo from the video data of the specific cargo; determining whether the identified packaging style of the specific cargo matches the packaging style of the specific cargo indicated by the packaging style information; and outputting the determination result.

[0086] (Appendix 11) A program that causes a computer to execute the following processes: a process of acquiring packaging style information indicating the packaging style of specific luggage among luggage to be loaded onto or unloaded from a vehicle; a process of acquiring video data generated by capturing an image of the specific luggage; a process of identifying the packaging style based on the appearance of the specific luggage from the video data capturing the specific luggage; and a process of determining whether the identified packaging style of the specific luggage matches the packaging style of the specific luggage indicated by the packaging style information, and outputting the determination result. [Explanation of symbols]

[0087] 1. Imaging device 2 vehicles 2A Luggage compartment 2B Door 3. Luggage 4, 6 cables 5 Storage device 7 Matching Device 10, 20 Information Database 11 Video data acquisition unit 12 Packaging Information Acquisition Department 13 Packaging Analysis Department 14 Judgment section 21 Additional information acquisition unit 100, 200 Luggage management device 1000, 3000 luggage management system 9000 computers 9001 processor 9002 ROM 9003 RAM 9004 Storage section 9005 Communication Interface 9006 User Interface 9007 Bus AD Additional Information DAT video data DET judgment result ID Baggage identification information RES analysis results S Packaging Information

Claims

1. a cargo information acquisition means for acquiring package shape information indicating the package shape of a specific cargo among the cargo to be loaded onto or unloaded from a vehicle; a video data acquisition means for acquiring video data generated by capturing an image of the specific package; a package style analysis means for identifying a package style based on the appearance of the specific package from the image data; a determining means for determining whether the packaging style of the specific parcel identified by the packaging style analyzing means matches the packaging style of the specific parcel indicated by the packaging style information, and outputting a determination result. Luggage management device.

2. the packaging style analysis means inputs the video data to be estimated into a model constructed by pre-machine learning of learning data consisting of learning video data of an image of a package and label information associated with the learning video data and indicating the packaging style of the package, the learning video data being included in the learning video data, and outputs an identification result of the packaging style of the package included in the video data to be estimated from the model; The determination means outputs the determination result based on the identification result and the packaging style information. The luggage management device according to claim 1 .

3. Based on information indicating the suitability of the judgment result, The packaging style analysis means re-learns the model, or the determining means changes a criterion for determining whether the packaging style of the specific package identified by the packaging style analyzing means matches the packaging style of the specific package indicated by the packaging style information; The luggage management device according to claim 1 or 2.

4. The packaging style information of the specific package is extracted from information indicating the packaging style of the specific package. The luggage management device according to any one of claims 1 to 3.

5. the package information acquisition means further acquires additional information of the specific package that is different from the packaging style information, and outputs the acquired additional information. The luggage management device according to claim 1 or 2.

6. The additional information is a part or all of the weight, volume, or loading conditions of the specific cargo. The luggage management device according to claim 5.

7. The determination means outputs the determination result to a matching device that performs matching for loading the specific cargo and cargo other than the specific cargo onto a specific vehicle, the matching device verifies the validity of the matching result based on the determination result; The luggage management device according to claim 1 or 2.

8. an imaging means for imaging luggage being loaded onto and unloaded from a vehicle; a cargo information acquisition means for acquiring package shape information indicating the package shape of a specific cargo among the cargo to be loaded onto and unloaded from the vehicle; a video data acquisition means for acquiring video data generated by the imaging means capturing an image of the specific package; a package style analysis means for identifying a package style based on the appearance of the specific package from the image data; a determining means for determining whether the packaging style of the specific parcel identified by the packaging style analyzing means matches the packaging style of the specific parcel indicated by the packaging style information, and outputting a determination result. Baggage management system.

9. Acquire packaging information indicating the packaging of specific cargo among the cargo to be loaded onto and unloaded from the vehicle; Acquire video data generated by capturing an image of the specific baggage; Identifying a package shape based on the appearance of the specific package from image data of the specific package; determining whether the identified packaging style of the specific package coincides with the packaging style of the specific package indicated by the packaging style information, and outputting the determination result; How to manage luggage.

10. A process of acquiring packaging information indicating the packaging style of specific cargo among the cargo to be loaded onto and unloaded from the vehicle; A process of acquiring video data generated by capturing an image of the specific package; A process of identifying a packaging style based on the appearance of the specific package from image data of the specific package; determining whether the identified packaging style of the specific package matches the packaging style of the specific package indicated by the packaging style information, and outputting the determination result; program.

Images