Information management device and inspection system

Abstract

To provide an information management device and an inspection system capable of easily performing inspection.SOLUTION: An information management device according to an embodiment has a communication interface, a first storage unit, a second storage unit, and a processor. The communication interface communicates with an information acquisition device which acquires information from a to-be-inspected baggage as an inspection object. The first storage unit has a brand database which stores brand information regarding brands as detection objects. The second storage unit has a baggage information database which stores baggage information including information acquired from the to-be-inspected baggage by the information acquisition device. When an inspection result indicates that the to-be-inspected baggage includes an article of a brand on which brand information is stored in the brand database, the processor registers baggage information on the to-be-inspected baggage including an image of a brand display portion on the to-be-inspected baggage and the inspection result on the to-be-inspected baggage.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information management device and an inspection system. [Background technology]

[0002] Conventionally, there is an inspection system in which an operator inspects an external image (exterior image) and an image taken by X-ray (X-ray image) of a package, and classifies the package based on the operator's inspection results. The inspection system may perform various processes including multiple stages of inspection at different locations. For example, the inspection system may perform processes such as acquiring information from the package, visually inspecting the package, and opening the exterior and inspecting the contents of the package in detail at different locations. One of the inspections in the inspection system is a process to detect target products such as brands that have been subject to a petition for import / export suspension as intellectual property infringement products, and similar products.

[0003] Conventionally, there are many brands registered in a database as targets to be detected in an inspection system, and each brand may have multiple letters, marks, etc. registered. Furthermore, brand information such as brand images that are targets of suspension, etc. may change, and brand information registered in the database may be updated from time to time. For this reason, there is a problem that it is not easy for individual operators (inspectors) to memorize the brand information registered in the database and perform the task of finding luggage that is a target of suspension, etc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-201599 A Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide an information management device and an inspection system that can easily perform inspections. [Means for solving the problem]

[0006] According to an embodiment, the information management device has a communication interface, a first storage unit, a second storage unit, and a processor. The communication interface communicates with an information acquisition device that acquires information from inspection baggage to be inspected. The first storage unit has a brand database that stores brand information related to a brand to be detected. The second storage unit has a baggage information database that stores baggage information including information acquired from the inspection baggage by the information acquisition device. When the inspection result indicates that the inspection baggage contains an item of a brand whose brand information is stored in the brand database, the processor registers baggage information of the inspection baggage, including an image of the brand display portion of the inspection baggage and the inspection result for the inspection baggage, in the baggage information database. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram illustrating an overall configuration of an inspection system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of a higher-level device in the inspection system according to the embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of the configuration of a zero-order processing system in the inspection system according to the embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of a control system of the zero-order processing system in the inspection system according to the embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of the configuration of a first inspection system and a second inspection system in the inspection system according to the embodiment. [Figure 6] FIG. 6 is a block diagram showing an example of the configuration of a control system of the first inspection system and the second inspection system in the inspection system according to the embodiment. [Figure 7]FIG. 7 is a flowchart for roughly explaining the flow of the entire operation of the inspection system according to the embodiment. [Figure 8] FIG. 8 is a flowchart for explaining an example of the operation of the information acquisition (zeroth-order processing) system in the inspection system according to the embodiment. [Figure 9] FIG. 9 is a flowchart for explaining an example of a primary inspection process by the primary inspection system in the inspection system according to the embodiment. [Figure 10] FIG. 10 is a flowchart for explaining an example of the operation of the secondary inspection system in the inspection system according to the embodiment. [Figure 11] FIG. 11 is a flowchart for explaining the process of registering brand information in the brand database in the inspection system according to the embodiment. [Figure 12] FIG. 12 is a diagram showing an example of brand information registered in a brand database in the inspection system according to the embodiment. [Figure 13] FIG. 13 is a diagram illustrating a process of registering brand information in a brand database in the inspection system according to the embodiment. [Figure 14] FIG. 14 is a flowchart for explaining the process of registering package information in the package information database in the inspection system according to the embodiment. [Figure 15] FIG. 15 is a diagram showing an example of baggage information registered in the baggage information database in the inspection system according to the embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of package information registered in the package information database in the zero-order processing in the inspection system according to the embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of baggage information registered in the baggage information database in the primary or secondary inspection in the inspection system according to the embodiment. [Figure 18] FIG. 18 is a diagram showing an example of past baggage information searched for using a part of the document information of an inspection baggage as a search key in the inspection system according to the embodiment. [Figure 19] FIG. 19 is a flowchart for explaining a first search process in which the inspection system according to the embodiment searches for past baggage information using a portion of the baggage information of an inspection baggage. [Figure 20] FIG. 20 is a schematic diagram showing a process in which the inspection system according to the embodiment searches for past baggage information using a brand image of the baggage to be inspected. [Figure 21] FIG. 21 is a flowchart for explaining a second search process in which the inspection system according to the embodiment searches for past baggage information using a brand image of the inspection baggage. [Figure 22] FIG. 22 is a schematic diagram showing an example in which the inspection system according to the embodiment outputs a registered brand image similar to a captured image and a brand image of past baggage information. [Figure 23] FIG. 23 is a schematic diagram showing an example of a search result in which past luggage information searched for by the inspection system according to the embodiment using a brand name as a search key is narrowed down in order of relevance. [Figure 24] FIG. 24 is a flowchart for explaining an example of the third search process by the inspection system according to the embodiment. [Diagram 25] FIG. 25 is a flowchart for explaining an example of a process for calculating the degree of association between an inspection baggage and past baggage information by the inspection system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments will be described with reference to the drawings. FIG. 1 is an explanatory diagram for explaining a schematic configuration example of an inspection system 1 according to an embodiment. The inspection system 1 is a system for inspecting items such as luggage that are subject to inspection. The inspection system 1 performs inspections to find, for example, branded items or similar items that are banned from being imported or exported, items including regulated items or taxable items, and items (luggage) from a specific sender or specific recipient. For example, branded items and similar items are identified by logos or letters affixed to the items or boxes that contain the items. Restricted items are expected to include items that are restricted from being imported into the country and items that are restricted from being exported overseas.

[0009] In the inspection system 1 according to the present embodiment, the object to be inspected is not limited to luggage, but in the following description, the object is assumed to be luggage contained in a box or the like. A slip and a tag are affixed to the luggage as the object to be inspected. The slip includes, for example, an address label indicating the sender and recipient of the luggage, and an item content declaration indicating the contents. The tag is information indicating identification information assigned to the luggage, and may be a barcode printed with the identification information encoded, or may be an RFID (Radio Frequency Identifier) ​​tag storing the identification information assigned to the luggage and the results of inspection by another inspection agency. However, it is assumed that the tag may not be affixed to some luggage to be inspected.

[0010] 1, the inspection system 1 includes a host device 2, a 0th processing system 3, a 1st inspection system 4, and a 2nd inspection system 5. In addition, the host device 2 is communicatively connected to a search terminal 6 for confirming the location of a package or package information. The higher-level device 2 is an information management device for managing information in the inspection system 1. The higher-level device 2 manages information related to the luggage to be inspected. For example, the higher-level device 2 stores advance data as information related to the luggage to be inspected in a database, and updates the database that stores information including inspection results related to the luggage based on information acquired from each of the systems 3, 4, and 5.

[0011] The zero-level processing system 3 is an information acquisition system that acquires information for inspecting luggage. The zero-level processing system 3 acquires various information from each luggage transported by the conveyor, and registers the acquired information in a database provided in the higher-level device 2. For example, the zero-level processing system 3 acquires tag information, form information, exterior images, and X-ray images from each luggage. The zero-level processing system 3 registers the tag information, form information, exterior images, and X-ray images acquired from each luggage in the database in association with identification information (identification ID) assigned to each luggage or acquired from each luggage.

[0012] The primary inspection system 4 is a system that inspects each piece of luggage based on the information registered in the primary processing system. The primary inspection system 4 presents the information obtained in the primary processing for each piece of luggage to an operator, and accepts input of the inspection results for the luggage by the operator. For example, the primary inspection system 4 displays information such as tag information, form information, exterior images, and X-ray images obtained from the luggage to be inspected on a display device. The primary inspection system 4 may also display information identified by image processing such as OCR (optical character recognition) on the display device. The operator visually checks the displayed information and separates the luggage into those that require secondary inspection and those that do not.

[0013] For example, the operator may determine that a secondary inspection is necessary for luggage suspected of containing branded goods whose import and export are prohibited or regulated goods, and input that a secondary inspection is necessary through the operation terminal. The operator may also determine that a secondary inspection is necessary when information written on the slip, such as sender information, recipient (destination) information, and item contents, contains information that requires a secondary inspection, and input that a secondary inspection is necessary through the operation terminal. The operator may also determine that a secondary inspection is necessary when a luggage is judged to be a normal item (has passed the inspection), and input that the inspection result for the luggage is normal through the operation terminal.

[0014] Baggage that is determined by the primary inspection system 4 to require secondary inspection is sent to a secondary inspection site where the secondary inspection system 5 is installed. Baggage that is determined to be normal by the primary inspection system 4 is sent to a location where baggage determined to be normal is processed. In this embodiment, baggage that is determined to be normal by the primary inspection system 4 or the secondary inspection system 5 is sent to a destination sorting device (hereinafter also simply referred to as a sorter) that sorts the baggage according to the destination written on the slip.

[0015] The secondary inspection system 5 performs a detailed inspection of luggage that is determined by the primary processing system to require secondary inspection. For example, in the secondary inspection system 5, an operator unpacks luggage and inspects the contents of the luggage in detail. The secondary inspection system 5 displays the results of the primary inspection in the primary inspection system 4 and information obtained in the zero-level processing, and accepts input of information indicating the results of the operator unpacking the luggage and inspecting it in detail. The secondary inspection system 5 may also display information identified by image processing or the like on a display device.

[0016] For example, when the secondary inspection system 5 confirms that a package contains a regulated item, the operator inputs through the operation terminal that the item is a package to be rejected. Also, when the operator unpacks and inspects the package and confirms that the package is normal and does not contain any regulated items, the operator inputs through the operation terminal that the inspection result for the package is normal.

[0017] The search terminal 6 is used as a terminal device for searching information managed by the higher-level device 2. The search terminal 6 is realized by a computer capable of communicating with the higher-level device 2 that manages the baggage information database 16 (see FIG. 2) that stores baggage information. The search terminal 6 may be any electronic device equipped with a user interface such as a touch panel and a communication interface capable of communicating with the higher-level device 2, and may be, for example, a mobile terminal carried by an operator of the inspection system 1. The search terminal 6 may also be realized by the operation terminal 27 (see FIGS. 3 and 4) in the 0th processing system 3 or the operation terminal 55 (see FIGS. 3 and 4) in the 1st inspection system 4 or the 2nd inspection system 5.

[0018] Next, a configuration of the higher-level device 2 as an information management device according to the embodiment will be described. FIG. 2 is a block diagram showing an example of the configuration of the higher-level device 2 serving as an information management device. The host device 2 manages information on the entire inspection system 1. The host device 2 is a computer that is communicatively connected to each of the systems 3, 4, and 5. The host device 2 is configured by, for example, a server device.

[0019] In the exemplary configuration shown in FIG. 2, the higher-level device 2 includes a processor (first processor) 11, a memory 12, a communication interface 13, and a storage . The processor 11 executes arithmetic processing. The processor 11 is configured as, for example, a CPU. The processor 11 executes programs stored in the memory 12 or the storage 14 to realize various processes.

[0020] The memory 12 is a system memory provided in a computer as a higher-level device, and stores programs and data. The memory 12 includes, for example, a ROM which is a read-only nonvolatile memory, a RAM which temporarily stores data, and a rewritable nonvolatile memory.

[0021] The communication interface 13 is an interface for communicating with the zero-order processing system 3, the primary inspection system 4, and the secondary inspection system 5. As the communication interface 13, a communication interface may be provided for each of the systems 3, 4, and 5. The communication interface 13 also functions as an interface for communicating with the search terminal 6 operated by an operator to check the location of a specific baggage or the inspection status of the baggage. In this case, the communication interface 13 may be an interface for communicating with the search terminal 6 via a network. Note that the interface for communicating with the search terminal 6 may be provided separately from the communication interface 13. For example, a wireless communication interface for wirelessly communicating with the search terminal 6 carried by an inspector may be provided.

[0022] The storage 14 is a storage device including a rewritable non-volatile memory. The storage 14 is configured, for example, by a hard disk drive (HDD) or a solid state drive (SSD). The storage 14 includes a first storage unit having a brand database (DB) 15 and a second storage unit having a package information database (DB) 16. The brand database 15 is a database that stores information (brand information) related to brands that are targets of detection. For example, the brand database 15 stores brand information such as brands that have received a petition for import / export suspension. The brand information stored in the brand database 15 includes brand names and brand images. The brand database 15 may also store information such as registration numbers, expiration dates, corporate numbers, and contact information as brand information. The brand database 15 is updated every time brand information that requires inspection is added or modified. For example, the brand database 15 may be updated by acquiring information registered in a database of brand information managed by an external server.

[0023] The baggage information database 16 stores information acquired from the baggage to be inspected and information indicating the inspection results, etc. For example, the baggage information database 16 registers information acquired by the primary processing system 3 (tag information, appearance image, X-ray image, form information, etc.), content information, and information such as inspection results based on data registered in the brand database 15 in association with identification information. For example, the baggage information database 16 registers brand names and images (brand images) of brand parts attached to the baggage to be inspected as inspection results related to brands.

[0024] The amount of data stored in the baggage information database 16 increases each time a baggage inspection is performed. For this reason, data registered in the baggage information database 16 may be deleted according to specific pre-set rules in order to reduce the amount of stored data and improve the accuracy of the search function. For example, data stored in the baggage information database 16 may be deleted periodically, starting with the oldest data. Also, information (dataset) related to baggage that failed the secondary inspection (baggage that was ultimately rejected) may not be deleted from the baggage information database 16.

[0025] It should be noted that the brand database 15 and the package information database 16 are not limited to being stored in a storage device that is a storage device within the higher-level device 2. For example, the brand database 15 and the package information database 16 may be provided in a storage device provided in an external device accessible by the higher-level device 2. In this case, the higher-level device 2 accesses the brand database 15 and the package information database 16 via a memory interface, respectively.

[0026] Next, the configuration of the zero-order processing system (information acquisition system) 3 according to the embodiment will be described. FIG. 3 is a diagram illustrating an outline of a configuration example of a zero-order processing system 3 according to the embodiment. The 0th processing system 3 includes an information acquisition device (0th processing device) 20, a conveyor 22, a tag reader 23, a camera 24, an X-ray imaging device 25, a form reader 26, and an operation terminal 27. The information acquisition device 20 is configured to be able to communicate with the conveyor 22, the tag reader 23, the camera 24, the X-ray imaging device 25, the form reader 26, and the operation terminal 27.

[0027] As shown in Fig. 3, a document M1 and a tag M2 are affixed to a package M, which is an example of an item to be inspected by the inspection system 1. The document M1 includes, for example, an address label indicating the sender and destination of the package, and an item contents declaration form indicating the contents. The address label contains destination information indicating the address of the destination, recipient information indicating the recipient, sender address information indicating the address of the sender, sender information indicating the sender, and the like. The item contents declaration form contains information indicating the items contained in the package M declared by the sender.

[0028] Furthermore, the tag M2 indicates tag information including identification information (item identification information) as an identification ID assigned to the package M. For example, the tag M2 may be a barcode printed thereon indicating tag information including identification information, or may be an RFID tag storing identification information assigned to the package and inspection results from other inspection agencies, etc., and is affixed to the surface of the package M. In this embodiment, the tag M2 is assumed to be a barcode printed thereon indicating tag information including identification information.

[0029] The tag M2 is, for example, an Electronic Advance Data (EAD) tag. The EAD tag is printed with an identification code (EAD identification code) included in EAD information, which is the inspection result at the customs of another country. In this case, the tag M2 may be printed with tag information including identification information such as the EAD identification code printed as a barcode. The EAD information is information including the EAD identification code, address and name information, information indicating the name and weight of the contents, etc. (content information), etc. The address and name information is, for example, information indicating the recipient (destination) of the package M (recipient information) and / or information indicating the sender (sender information).

[0030] The conveyor 22 is a device that conveys the luggage M to be inspected. In the processing (0th processing) in the 0th processing system 3, various information is acquired from the luggage M conveyed in a predetermined direction. For this reason, the conveyor 22 conveys the luggage M so that it passes through positions where various devices acquire various information. That is, the conveyor 22 conveys the luggage M in a predetermined direction so that it passes through positions (imaging positions) where the tag reader 23, the camera 24, the X-ray imaging device 25, and the form reader 26 acquire information. In addition, the conveyor 22 moves the luggage M at a conveying speed that allows the tag reader 23, the camera 24, the X-ray imaging device 25, and the form reader 26 to reliably acquire information. In addition, the luggage M that has passed the imaging positions of the tag reader 23, the camera 24, the X-ray imaging device 25, and the form reader 26 by the conveyor 22 is sent to the 1st inspection system 4.

[0031] The upstream end of the conveyor 22 may be configured to receive the luggage M by a robot arm or the like. Also, an automated guided vehicle (AGV) or the like may be disposed at the downstream end of the conveyor 22 for sending the luggage M that has completed the zero-stage processing to the primary inspection system 4.

[0032] The tag reader 23 reads the tag M2 from the luggage M being transported by the conveyor 22. The tag M2 is assumed to record information including the identification information (e.g., an identification ID) of the luggage M. The tag reader 23 reads information including the identification information from the tag M2, and supplies the information read from the tag M2 to the information acquisition device 20. For example, if a barcode indicating the identification information is printed on the tag M2, the tag reader 23 is configured by a barcode reader. For example, the tag M2 is an EAD tag. In this case, the tag reader 23 reads an EAD identification code from the EAD tag serving as the tag M2.

[0033] The camera 24 acquires (takes) an image (exterior image, exterior image) of the exterior (exterior) of the luggage M transported by the conveyor 22. The camera 24 supplies the acquired exterior image of the luggage M to the information acquisition device 20. For example, the camera 24 is configured by combining a lens and an imaging element that converts light focused by the lens into an image. The camera 24 may be configured to capture an exterior image of the luggage M not only from above, but also from a direction other than above.

[0034] The X-ray imaging device 25 acquires an X-ray image of the luggage M transported by the conveyor 22. The X-ray imaging device 25 supplies the acquired X-ray image of the luggage M to the information acquisition device 20. For example, the X-ray imaging device 25 is configured by combining an X-ray tube that irradiates the luggage M with X-rays and an X-ray detector that detects the X-rays that have passed through the luggage M. The X-ray imaging device 25 may be configured to irradiate X-rays not only from one direction but also from multiple directions to capture multiple X-ray images.

[0035] The document reader 26 reads various information from the document M1 affixed to the package M transported by the conveyor 22. For example, the document reader 26 obtains information such as recipient information and sender information from the destination label of the document M1, and obtains information indicating the contents of the package (e.g., product name, etc.) from the goods contents declaration of the document M1. The information that the document reader 26 reads from the document M1 is referred to as document information. The document reader 26 supplies the document information read from the document M1 attached to the package M to the information acquisition device 20.

[0036] For example, the form reader 26 includes a line image sensor having an imaging element in which pixels that convert light into an image are arranged in a line, and a lens that focuses light on the pixels, and acquires an image (form image) of the form M1. The form reader 26 also includes a processor that performs optical character recognition (OCR) to recognize form information such as recipient information, sender information, and content information from the form image read by the line image sensor. Dictionary data used for OCR by the form reader 26 is stored in the memory of the information acquisition device 20.

[0037] The operation terminal 27 generates a signal (operation signal) according to an operation input by an operator, and supplies the operation signal to the information acquisition device 20. The operation terminal 27 also has a touch panel 28 that functions as a user interface. The touch panel 28 is equipped with a display that provides various information to the operator, and a touch sensor that accepts operation instructions input by the operator touching the screen. Furthermore, a memory interface (I / F) 29 that connects an external memory is connected to the operation terminal 27. The memory I / F 29 is a device that inputs and outputs data to and from an external memory device. The operation terminal 27 may also function as a search terminal 6 that inputs a search key (described later) and displays information as a search result.

[0038] Next, the configuration of a control system in the zero-order processing system (information acquisition system) 3 according to the embodiment will be described. FIG. 4 is a block diagram showing an example of the configuration of a control system in the zero-order processing system 3 according to the embodiment. As shown in FIG. 4, the 0th processing system 3 has a configuration in which an information acquisition device (0th processing device) 20 is connected to each device (a conveyor 22, a tag reader 23, a camera 24, an X-ray device 25, a form reader 26, and an operation terminal 27).

[0039] The information acquiring device 20 acquires various information from the luggage M to be inspected. The information acquiring device 20 acquires external images, X-ray images, form information, tag information, etc. The information acquiring device 20 registers the acquired information in a database managed by the higher-level device 2. The information acquiring device 20 is configured by a device capable of communicating, processing, and storing data, such as a personal computer (PC).

[0040] As shown in FIG. 4, the information acquisition device 20 includes a processor 31, a memory 32, a higher level communication interface 33, and a communication interface . The processor 31 executes arithmetic processing. The processor 31 is, for example, a CPU. The processor 31 executes programs to realize various processes. The memory 32 is a storage device that stores programs and data, and includes, for example, a ROM that is a read-only nonvolatile memory, a RAM that temporarily stores data, and a rewritable nonvolatile memory. The processor 31 functions as a processing unit that executes various processes by executing programs stored in the ROM or non-volatile memory of the memory 32 using the RAM.

[0041] The memory 32 also has a dictionary DB 32a that stores dictionary data used for OCR by the document reader 26. The dictionary data stored in the dictionary DB 32a can be updated depending on the operation mode. For example, the dictionary data may be updated by information stored in data acquired from the outside via a storage medium or a network, or may be updated based on information registered in the package information database 16.

[0042] That is, the dictionary data stored in the dictionary DB 32a may be updated based on the difference with the information stored in the external memory connected to the memory I / F 29. In this case, the external memory connected to the memory I / F 29 may contain not only data used as a dictionary for normal character recognition, but also information such as specific sender information or destination information for which the package should be NG (problematic) or require inspection (blacklist information). Note that the information such as the blacklist is stored in the storage 14 of the higher-level device 2 as blacklist data for use in inspection, as well as for updating the dictionary data used for OCR. The dictionary data may be updated based on the difference from information acquired via a network that can communicate through the communication interface.

[0043] The dictionary data may also be updated based on information stored in the package information database 16 of the higher-level device 2. For example, the dictionary data may be updated based on sender information and destination information contained in tag information registered in the package information database 16. Furthermore, the dictionary data may be updated based on information about packages that have been determined to be NG by an inspection (secondary inspection) described below. This enables the dictionary data to accurately recognize slips that have similar information to packages that have been previously determined to be NG. Furthermore, updating the dictionary data based on information about packages that have been determined to be NG not only improves recognition accuracy by adding new data, but also has the effect of accurately recognizing packages similar to packages that have been determined to be NG, thereby ensuring that packages similar to packages that have been determined to be NG can be detected.

[0044] The upper communication interface 33 is an interface for communicating with a higher-level device (information management device) 2. The processor 31 accesses the baggage information database 16 provided in the higher-level device 2 via the upper communication interface 33. The upper communication interface 33 is also an interface for accessing the database. The upper communication interface 33 may also have a function for communicating with the primary inspection device 50 of the primary inspection system 4 and the secondary inspection device 50 of the secondary inspection system 5.

[0045] The communication interface 34 is an interface for communicating with each device in the 0th-order processing system 3. The communication interface 34 includes terminals and circuits compatible with communication standards for communicating with each device in the 0th-order processing system 3. For example, the communication interface 34 includes interfaces for the processor 31 to communicate with the tag reader 23, the camera 24, the X-ray imaging device 25, the form reader 26, the operation terminal 27, and the like.

[0046] Next, the configuration of the operation terminal 27 will be described. As shown in FIG. 4, the operation terminal 27 includes a processor 41, a memory 42, a communication interface 43, a touch panel 28, and a memory I / F 29. The processor 41 executes arithmetic processing. The processor 41 is, for example, a CPU. The processor 41 executes programs to realize various processes. The memory 42 is a storage device that stores programs and data, and includes, for example, a ROM that is a read-only nonvolatile memory, a RAM that temporarily stores data, and a rewritable nonvolatile memory. The processor 41 functions as a processing unit that executes various processes by executing programs stored in the ROM or non-volatile memory of the memory 42 using the RAM.

[0047] The communication interface 43 is an interface for communicating with the information acquisition device (zeroth-order processing device) 20. The communication interface 43 may be configured to communicate with other devices in the zeroth-order processing system 3.

[0048] The touch panel 28 is an example of a user interface that displays a screen and generates an operation signal in response to an operation by an operator. The touch panel 28 includes an integral display 45 and a touch sensor 46. However, the operation terminal 27 may include, as a user interface, an operation device that generates an operation signal in response to an operation in addition to the touch panel 28. The operation device may be any device, such as a mouse, a trackball, a keyboard, or a trackpad.

[0049] The display 45 displays on the screen the display data (screen data) supplied from the processor 41 or a graphic controller (not shown). The touch sensor 46 generates an operation signal indicating a position touched by an operator operating the operation terminal 27 on the screen displayed on the display 45. In this way, the touch panel 28 functions as a user interface that detects input to icons serving as operation keys displayed on the display 45 by the touch sensor 46.

[0050] The memory I / F 29 connects an external memory device including a storage medium for storing data. The memory I / F 29 is a device for inputting and outputting data to and from an external memory device (storage medium). For example, the memory I / F 29 reads data from an external memory device set by an operator. The memory I / F 29 supplies the information read from the external memory device to the processor 41 of the operation terminal 27. The processor 41 supplies the information read from the external memory device via the memory I / F 29 to the information acquiring device 20. The information acquiring device 20 may further supply the information read from the external memory device via the memory I / F 29 to the higher-level device 2.

[0051] Next, the configurations of the primary inspection system 4 and the secondary inspection system 5 according to the embodiment will be described. FIG. 5 is a diagram illustrating an example of the configuration of a primary inspection system 4 and a secondary inspection system 5 according to the embodiment. In this embodiment, the primary inspection system 4 and the secondary inspection system 5 are described as having similar configurations as shown in FIG. 5. However, in reality, the primary inspection system 4 and the secondary inspection system 5 are separate systems, with the primary inspection system 4 installed at a primary inspection site and the secondary inspection system 5 installed at a secondary inspection site different from the primary inspection site. For this reason, the primary inspection system 4 and the secondary inspection system 5 may have different configurations. For example, in the secondary inspection system 5, as described below, an operator unpacks and inspects the luggage M, so a space for performing the unpacking and inspection work may be secured.

[0052] The primary inspection system 4 (secondary inspection system 5) includes an inspection device (primary inspection device, secondary inspection device) 50, a first conveyor 51, a second conveyor 52, a sorting mechanism 53, a form reader 54, and an operation terminal 55. The inspection device 50 is configured to be able to communicate with the first conveyor 51, the second conveyor 52, the sorting mechanism 53, the form reader 54, and the operation terminal 55.

[0053] The first conveyor 51 conveys the luggage M to be inspected in a first direction. The luggage M to be inspected by the inspection system 1 is one whose information has been read by the zero-order processing system 3 as shown in FIG. 3. The first conveyor 51 repeatedly conveys and stops the luggage M according to the control of the inspection device 50. The operation of the first conveyor 51 is controlled so that an operator can easily perform work such as inspection on the luggage M on the first conveyor 51. For example, in a state where the transportation of the luggage M by the first conveyor 51 is stopped, the first conveyor 51 is operated so that an operator can perform work such as inspection on the luggage M on the first conveyor 51. In addition, the luggage M whose inspection result is judged to be OK (for example, a normal luggage that can be delivered) is sent to the rear end of the first conveyor 51. A mechanism for guiding the luggage M judged to be normal to a sorting device (sorter) that sorts the luggage M according to destination may be provided at the rear end of the first conveyor 51.

[0054] Furthermore, a gate 53a driven by a sorting mechanism 53 is provided on the transport path of the luggage M by the first conveyor 51. The sorting mechanism 53 rotates the gate 53a to sort (sort) the luggage M transported by the first conveyor 51 to be transported directly by the first conveyor 51 or to be transported directly by the second conveyor 52. When sorting the luggage M to the second conveyor 52, the gate 35a is set to a position so as to guide the luggage M transported by the first conveyor 51 to the second conveyor 52. When transporting the luggage M directly by the first conveyor 51, the gate 35a is set to a position so as not to interfere with the luggage M transported by the first conveyor 51.

[0055] The second conveyor 52 transports the luggage M sorted by the gate 53a from the first conveyor 51 in the second direction. The luggage M whose inspection result is determined to be NG (requiring secondary inspection or rejected) is sent to the rear end of the second conveyor 52. The rear end of the second conveyor 52 may be provided with a mechanism for sending the luggage M to the secondary inspection system 5 or a reject stacking section. For example, the rear end of the second conveyor 52 of the primary inspection system 4 may be provided with a mechanism for sending the luggage M to the secondary inspection system 5. In addition, the rear end of the second conveyor 52 of the secondary inspection system 5 may be provided with a mechanism for sending the luggage M to a reject stacking section that stacks rejected luggage.

[0056] The sorting mechanism 53 drives the gate 53a to sort the luggage M transported by the first conveyor 51. The gate 53a is installed on the first conveyor 51 downstream of the position where the inspection work on the luggage M is performed. For example, when the inspection result of the luggage M transported by the first conveyor 51 is OK, the sorting mechanism 53 drives the gate 53a to transport the luggage M as is on the first conveyor 51. In addition, when the inspection result of the luggage M transported by the first conveyor 51 is NG (secondary inspection required or rejected), the sorting mechanism 53 drives the gate 53a to guide the luggage M to the second conveyor 52.

[0057] Furthermore, the sorting mechanism 53 may be a retention mechanism that retains the luggage M transported by the first conveyor 51 with the gate 53a. For example, the sorting mechanism 53 retains the luggage M on the first conveyor 51 by moving the gate 53a to a position where the luggage M transported by the first conveyor 51 is blocked. In this way, when processing a set of multiple luggage (multiple pieces of luggage), the sorting mechanism 53 can retain the luggage that has been previously inspected on the first conveyor 51 with the gate 53a. In other words, by retaining each piece of luggage with the sorting mechanism 53, the inspection device 50 can control the sorting of multiple pieces of luggage in the same direction based on a comprehensive judgment result (result of multiple judgments) for the multiple pieces of luggage.

[0058] The mechanism for retaining the luggage transported by the first conveyor 51 is not limited to that realized by driving the gate 53a. The mechanism for retaining the luggage may be of any configuration as long as it is a mechanism for retaining each luggage so that multiple luggage from multiple ports can be transported together to the same sorting destination.

[0059] The document reader 54 reads identification information from the document M1 or tag M2 affixed to the luggage M on the first conveyor 51. The document reader 54 may be a handheld scanner that an operator holds in his / her hand to scan, or may be installed at a fixed position and read the identification information from the document M1 or tag M2 affixed to the luggage M transported by the first conveyor 51.

[0060] The operation terminal 55 generates a signal (operation signal) according to an operation input by an operator, and supplies the operation signal to the inspection device 50. The operation terminal 55 has a touch panel 56 having a display 75 and a touch sensor (touch panel) 76. The operation terminal 55 may be configured so that the operator inputs identification information of the luggage M to be inspected by using the touch sensor 76 of the touch panel 56. The operation terminal 55 may also function as a search terminal 6 that inputs a search key (described later) and displays information as a search result.

[0061] The operation terminal 55 displays on the display 75 of the touch panel 56 information related to the luggage M, which is the identification information read by the document reader 54 or the identification information input by key input. The operation terminal 55 displays on the display 75 information (exterior image, X-ray image, document information, tag information, etc.) acquired from the luggage (inspection luggage) M to be inspected in the primary processing system 3. The operation terminal 55 also displays on the display 75 information such as search results acquired by the inspection device 50 from the higher-level device 2.

[0062] For example, in the primary inspection system 4, an operator performs an inspection to determine whether or not the inspection baggage M is normal (secondary inspection is required) while referring to information displayed on the display 75 of the touch panel 56. If the inspection result shows that the inspection baggage M is normal (OK), the operator indicates through the touch sensor 76 that there is no abnormality in the baggage M. If the inspection result shows that there is an abnormality in the inspection baggage M (NG), the operator indicates through the touch sensor 76 that the inspection baggage M requires secondary inspection or rejection.

[0063] Furthermore, in the primary inspection system 4, the operator performs an inspection to determine whether the inspection baggage M is normal (requires detention) or not while referring to information displayed on the display 75 of the touch panel 56. For example, if the inspection result shows that the inspection baggage M is normal (no problem), the operator uses the touch sensor 76 to indicate that the inspection baggage M is normal. If the inspection result shows that the inspection baggage M has an abnormality (problem), the operator uses the touch sensor 76 to indicate that the inspection baggage M has a problem (or requires detention). As a specific example, if the inspection result shows that the brand of an item contained in the inspection baggage M is a brand registered in the brand database 15 or a similar item, the operator uses the touch sensor 76 to indicate that the inspection baggage M has a problem (requires detention).

[0064] The camera 57 photographs the part to be inspected in the secondary inspection or the primary inspection. For example, the camera 57 photographs the part displaying the brand on the inspection baggage or the article in the inspection baggage in the brand inspection described later. The camera 57 has a configuration for capturing images such as a lens and an image sensor, and a configuration for supplying the captured image to the inspection device 50. The camera 57 may have a fixed shooting position, or may be held by an operator and capture images by the operator's operation. The camera 57 may also be a wearable device such as smart glasses that has a configuration for capturing images.

[0065] Next, the configuration of a control system in the primary inspection system 4 or the secondary inspection system 5 according to the embodiment will be described. FIG. 6 is a block diagram showing an example of the configuration of a control system in the primary inspection system 4 or the secondary inspection system 5 according to the embodiment. As shown in Figure 6, the primary inspection system 4 (secondary inspection system 5) has a configuration in which each device (first conveyor 51, second conveyor 52, sorting mechanism 53, document reader 54, operation terminal 55) is connected to an inspection device (primary inspection device, secondary inspection device) 50.

[0066] The inspection device 50 is configured by a device such as a personal computer (PC) that is capable of communicating, processing, and storing data. The inspection device 50 displays information about the luggage M to be inspected (exterior image, X-ray image, form information, and tag information) on the operation terminal 55, and acquires the inspection results input by the operator via the operation terminal 55. The inspection device 50 controls the driving of the first conveyor 51, the second conveyor 52, and the sorting mechanism 53 according to the inspection work and the inspection results. The inspection device 50 acquires information about the luggage M from the higher-level device 2 that corresponds to the identification information (identification ID) read by the form reader 54 or the identification information keyed in by the operator on the operation terminal 55, and supplies the information about the luggage M acquired from the higher-level device 2 to the operation terminal 55.

[0067] As shown in FIG. 6, the inspection device 50 includes a processor (first processor) 61, a memory 62, a higher level communication interface 63, and a communication interface (terminal interface) 64. The processor 61 executes arithmetic processing. The processor 61 is, for example, a CPU. The processor 61 executes programs stored in the memory 62 to realize various processes. The memory 62 is a system memory of a computer serving as the inspection device 50, and stores programs, data, etc. The memory 62 includes, for example, a ROM which is a read-only nonvolatile memory, a RAM which temporarily stores data, and a rewritable nonvolatile memory.

[0068] The upper communication interface 63 is an interface for communicating with a higher-level device (information management device) 2. The processor 61 accesses the baggage information database 16 provided in the higher-level device 2 via the upper communication interface 63. The upper communication interface 63 is an interface for the inspection device 50 to access the database. The upper communication interface 63 may have a function for communicating with the information acquisition device 20 of the primary processing system 3, etc.

[0069] The communication interface 64 is a terminal interface for communicating with each device (such as the conveyor 51, the conveyor 52, the sorting mechanism 53, the form reader 54, the operation terminal 55, and the camera 57) in the primary inspection system 4 (secondary inspection system 5). The communication interface 64 includes terminals and circuits compatible with communication standards for communicating with each device.

[0070] Next, the configuration of the operation terminal 55 will be described. As shown in FIG. 6, the operation terminal 55 includes a processor 71, a memory 72, a communication interface 73, and a touch panel 56. The processor 71 executes arithmetic processing. The processor 71 is, for example, a CPU. The processor 71 executes programs stored in the memory 72 to realize various processes. The memory 72 is a storage device that stores programs and data, and includes, for example, a ROM that is a read-only nonvolatile memory, a RAM that temporarily stores data, and a rewritable nonvolatile memory.

[0071] The communication interface 73 is an interface for communicating with the inspection device 50. The communication interface 73 may be configured to communicate with other devices in the primary inspection system 4 (secondary inspection system 5).

[0072] The touch panel 56 is an example of a user interface that displays a screen and generates an operation signal in response to an operation by an operator. The touch panel 56 includes an integrally configured display (display unit) 75 and a touch sensor (operation unit) 76. However, the operation terminal 55 may also include, as a user interface, a display that displays a screen, and an operation device that generates an operation signal in response to an operation. The operation device may be a mouse, a trackball, a keyboard, a trackpad, or the like.

[0073] The display 75 displays on the screen the display data (screen data) supplied from the processor 71 or a graphic controller (not shown). The touch sensor 76 generates an operation signal indicating a position touched by an operator operating the operation terminal 55 on the screen displayed on the display 75. In this way, the touch panel 56 functions as a user interface that detects input to icons serving as operation keys displayed on the display 75 by the touch sensor 76.

[0074] Next, the operation of the inspection system 1 according to the embodiment will be described. FIG. 7 is a flowchart for explaining the overall operation of the inspection system 1 according to the embodiment. The inspection system 1 sequentially performs 0th processing (information acquisition processing) by a 0th processing system, 1st inspection processing by a 1st inspection system, and 2nd inspection processing by a 2nd inspection system.

[0075] The zero-order processing system 3 executes information acquisition processing (zero-order processing) for acquiring external images, X-ray images, document information, and tag information from the luggage M to be inspected (ST11). The zero-order processing system 3 acquires an identification ID (identification information for each luggage) assigned to the luggage to be inspected placed on the conveyor 22, and registers information such as the external image, X-ray image, document information, and tag information as part of the luggage information in association with the identification ID in the luggage information database 16 of the upper device 2. Note that if acquisition of the identification ID fails, the zero-order processing system 3 may register various information acquired from the luggage M, such as the external image, X-ray image, document information, and tag information, in association with temporary identification information (temporary ID) in the luggage information database 16 of the upper device 2.

[0076] The baggage M that has undergone the primary processing is sent to a primary inspection system 4 installed at a primary inspection site. The primary inspection system 4 provides information for an operator to carry out an inspection (primary inspection) of the baggage with the input identification ID, and carries out a primary inspection to obtain the inspection result (primary inspection result) by the operator (ST12). In the primary inspection process, an external image, an X-ray image, and form information of the baggage corresponding to the input identification ID are displayed on the touch panel 56. The operator visually checks the displayed information and determines (inspects) whether or not a secondary inspection is necessary, and inputs the inspection result into the touch panel 56. For example, if the baggage is suspected to contain an item that requires inspection, the operator determines that the baggage requires a secondary inspection.

[0077] If the primary inspection system 4 determines that secondary inspection is unnecessary (normal, OK) (ST13, NO), it ends the inspection of the baggage and determines that the baggage is to be sorted to the destination sorting device (sorter) (ST14). Also, if the primary inspection system 4 determines that secondary inspection is necessary (NG) (ST13, YES), it determines that the baggage is to be sorted to the secondary inspection system installed at the secondary inspection site.

[0078] Baggage that is determined to require secondary inspection by the primary inspection is sent to the secondary inspection system 5 installed at the secondary inspection site. The secondary inspection system 5 performs secondary inspection processing in which an operator unpacks the baggage to be inspected and performs a detailed inspection (secondary inspection) (ST15). In the secondary inspection processing, the operator unpacks the baggage and inspects the contents of the baggage. For example, if it is confirmed that the baggage contains a regulated item, the operator determines that the baggage is abnormal (NG). The operator inputs the result of the inspection (secondary inspection) on the touch panel 56. Here, if the operator determines that the baggage is abnormal, the operator may input the reason for determining that the baggage is abnormal (brand requiring inspection, regulated item, dangerous item, abnormal sender, abnormal recipient, taxable item, etc.) on the touch panel 56.

[0079] The secondary inspection system judges whether the baggage being inspected is abnormal or normal according to an input by an operator to the touch panel 56 (ST16). If an input is made to the touch panel 56 indicating that the baggage is abnormal (NG) (ST16, YES), the secondary inspection system 5 determines that the baggage is to be rejected (ST17). Also, if an input is made to the touch panel 56 indicating that the baggage is normal (ST16, NO), the secondary inspection system 5 determines that the baggage is to be sorted by a destination sorting device (sorter) that sorts the baggage by destination (ST14).

[0080] Next, the information acquisition process (zeroth-order processing) by the above-mentioned zeroth-order processing system 3 will be described in detail. FIG. 8 is a flowchart for explaining an example of information acquisition processing by the zero-order processing system 3. In the zero-level processing system 3, luggage to be inspected (inspection luggage) M is placed on the conveyor 22 in an orientation that allows the tag reader 23, the camera 24, and the document reader 26 to read the document M1 and the tag M2. The processor 31 causes the conveyor 22 to transport each luggage M in sequence, and acquires information from the tag reader 23, the camera 24, the X-ray device 25, and the document reader 26 in sequence.

[0081] The tag reader 23 of the primary processing system 3 reads tag information from the tag M2 attached to the luggage M being transported by the conveyor 22. The tag reader 23 supplies the read tag information or information that the tag could not be read to the information acquiring device 20. In this way, the information acquiring device 20 acquires the tag information of the luggage M supplied from the tag reader 23 via the communication interface 34 (ST21).

[0082] The camera 24 of the primary processing system 3 captures an image of the luggage M being transported by the conveyor 22. The camera 24 supplies the captured image of the luggage M on the conveyor 22 to the information acquisition device 20 as an external image. As a result, the information acquisition device 20 acquires the external image of the luggage M supplied from the camera 24 via the communication interface 34 (ST22).

[0083] The X-ray imaging device 35 of the primary processing system 3 captures an X-ray image of the luggage M being transported by the conveyor 22. The X-ray imaging device 35 irradiates X-rays onto the luggage M on the conveyor 22 and captures the image, and supplies the image as an X-ray image to the information acquisition device 20. As a result, the information acquisition device 20 acquires the X-ray image supplied from the X-ray imaging device 25 via the communication interface 34 (ST23).

[0084] The document reader 26 of the zero-order processing system 3 reads document information from the document M1 attached to the package M being transported by the conveyor 22. The document reader 26 recognizes the document information written on the document M1 by OCR processing using a dictionary in the dictionary DB 31a, and supplies the document information obtained as a recognition result to the information acquisition device 20. As a result, the information acquisition device 20 acquires the document information written on the document M1 attached to the package supplied from the document reader 26 via the communication interface 34 (ST24).

[0085] Furthermore, the processor 31 of the information acquisition device 20 acquires the identification ID of the package from which various information has been acquired (ST25). For example, the processor 31 acquires the identification ID by reading tag information including identification information serving as the identification ID from the package M using the tag reader 23. Upon acquiring the identification ID, the processor 31 transmits a data set in which the identification ID is linked to various information acquired from the package M (appearance image, X-ray image, form information, etc.) to the higher-level device 2 as package information to be registered in the package information database 16 (ST26).

[0086] In response to this, when the processor 11 of the higher-level device 2 receives a data set including the identification ID from the primary inspection system 4, it registers various pieces of information acquired in association with the identification ID as package information in the package information database 16. In the primary processing, data (part of the package information) registered in the package information database 16 includes, for example, the reception number, the identification ID, sender information, destination (recipient) information, product name, package image (exterior image), and X-ray image.

[0087] The reception number is information issued according to the processing date and time, etc. For example, the reception number is information that combines the date, time, work site number, etc. The reception number may also be used as a temporary ID. Information such as the identification ID, sender information, destination information, and product name is information acquired from the tag M2 or the form M1, for example. Information such as the sender information, destination information, and product name is information that is registered in advance as information corresponding to the identification ID, and may also be information identified from the identification ID.

[0088] The X-ray image is an image captured by the X-ray imaging device 25 using X-rays. The X-ray image may be an image from one direction or multiple X-ray images captured along multiple axes. The baggage image is an image captured by the camera 24. Multiple image data in different data formats may be registered for the baggage image, and the baggage image may be registered in the baggage information database 16 with not only a file name but also a storage path.

[0089] If the processor 31 of the information acquisition device 20 fails to acquire an identification ID, it may issue temporary identification information (temporary ID) for the parcel about which various information has been acquired, and transmit a data set in which the temporary ID is set to the various information acquired from the parcel M (appearance image, X-ray image, form information, etc.) to the higher-level device 2 as information of the parcel to be registered in the parcel information database 16. In this case, the higher-level device 2 may simply register the various information (appearance image, X-ray image, form information, etc.) associated with the temporary ID in the parcel information database 16.

[0090] The processor 31 of the information acquisition device 20 registers various information about each of the multiple packages in the package information database 16, and also transports each of the multiple packages by the conveyor 22 to a primary inspection site where the primary inspection system 4 is installed (ST27). For example, the packages processed by the primary processing system 3 may be sent to the primary inspection system 4 by the conveyor 22, or may be transported from the downstream rear end of the conveyor 22 to the primary inspection system 4 by another transport means (e.g., an AGV).

[0091] Next, the primary inspection process by the primary inspection system 4 will be described in detail. FIG. 10 is a flowchart for explaining an example of a primary inspection process for multiple pieces of baggage by the primary inspection system 4. The primary inspection system 4 performs an inspection (primary inspection) on the luggage M whose information has been registered in the luggage information database 16 by the primary processing system. In the primary inspection, an operator visually checks the information acquired from the luggage M by the primary processing to determine whether or not a secondary inspection is necessary.

[0092] First, in the primary inspection system 4, a package M to be subjected to a primary inspection is placed on a first conveyor 51, and an identification ID of the package M is input. A form reader 54 inputs the identification ID of the package M by reading a tag M2 or a form M1 attached to the package M. The identification ID may also be input by an operator using a touch panel 56 of an operation terminal 55 or the like.

[0093] The processor 61 of the inspection device 50 acquires the identification ID inputted by the document reader 54 or the operation terminal 55 via the communication interface 64 (ST31). When the processor 61 of the inspection device 50 acquires the identification ID, it accesses the higher-level device 2 via the higher-level communication interface 63 and requests information corresponding to the acquired identification ID registered in the baggage information database 16. In response, the higher-level device 2 extracts baggage information corresponding to the requested identification ID from the baggage information database 16 and supplies it to the inspection device 50. As a result, the processor 61 of the inspection device 50 acquires baggage information corresponding to the identification ID registered in the baggage information database 16 from the higher-level device 2 (ST32).

[0094] When the processor 61 of the inspection device 50 acquires the baggage information corresponding to the identification ID, it displays the baggage information corresponding to the acquired identification ID on the display 75 of the touch panel 56 as reference information to be presented to the operator on a confirmation screen for the primary inspection (confirmation screen for primary inspection) (ST33). With the confirmation screen for primary inspection displayed, the processor 61 accepts input of the inspection results by the operator (ST34).

[0095] For example, the processor 61 displays information such as an X-ray image, an external image, and document information included in the baggage information for the identification ID on a confirmation screen for primary inspection as information (reference information) to be presented to an operator. The processor 61 also displays buttons for inputting inspection results that can be instructed on the touch panel 56 on the confirmation screen for primary inspection. For example, the processor 61 displays a button to be instructed when it is determined that a secondary inspection is not required for the baggage (a button to instruct no abnormality (secondary inspection not required)) on the confirmation screen for primary inspection, and a button to be instructed when it is determined that a secondary inspection is required for the baggage (a button to specify that an abnormality is present (secondary inspection required)). Furthermore, when it is specified that a secondary inspection is required, the processor 61 may input the reason or item for determining that there is an abnormality.

[0096] When the operator inputs the inspection results, the processor 61 of the inspection device 50 performs a process of registering the input inspection results in the baggage information database 16 (ST35). The processor 61 specifies the identification ID of the baggage in question and requests the higher-level device 2 to add the inspection results to the baggage information database 16. For example, when the operator specifies that there are no abnormalities (no secondary inspection required), the processor 61 requests the higher-level device 2 to register, as the inspection result, that the baggage specified by the identification ID is normal baggage that does not require secondary inspection.

[0097] Furthermore, when the operator designates that there is an abnormality (secondary inspection required), the processor 61 requests the higher-level device 2 to register, as an inspection result, that the baggage designated by the identification ID is a baggage that requires a secondary inspection. In response to this, the processor 11 of the higher-level device 2 adds the inspection result to the baggage information corresponding to the designated identification ID in the baggage information database 16 in response to a request from the inspection device 50. As a result, information such as the results of the primary inspection for the baggage is added to the baggage information database 16 by the zero-order inspection.

[0098] Furthermore, when the operator inputs the inspection results, the processor 61 determines the sorting destination of the baggage in question based on the inspection results. If it is determined that the baggage is normal and does not require secondary inspection (ST36, YES), the processor 61 determines that the sorting destination of the baggage is a sorter that sorts bags by destination, and transports the baggage to the sorter (ST37). If it is determined that the baggage requires secondary inspection (ST36, NO), the processor 61 determines that the sorting destination of the baggage is the secondary inspection system 5, and transports the baggage to the secondary inspection site where the secondary inspection system 5 is located (ST38).

[0099] As described above, the inspection device of the primary inspection processing system performs the primary setting process based on the information acquired from the baggage by the zero-order process, and registers the primary inspection results in the baggage information database. In addition, according to the above-mentioned operation, the inspection device of the primary inspection processing system can register in the database, even for bags whose identification IDs could not be determined in the zero-order process, the identification IDs are associated with the data set specified by the operator.

[0100] Next, the secondary inspection process by the secondary inspection system 5 will be described in detail. FIG. 10 is a flowchart for explaining an example of the secondary inspection process by the secondary inspection system 5. The secondary inspection system 5 performs an inspection (secondary inspection) on baggage that is determined to require secondary inspection by the primary inspection system 4. In the secondary inspection system 5, for example, an operator inspects the contents of the baggage in detail by opening the baggage as the secondary inspection.

[0101] First, in the secondary inspection system 5, luggage (inspection luggage) M to be subjected to secondary inspection is placed on a first conveyor 51, and an identification ID of the luggage M is input. For example, the identification ID of the luggage M is input by reading the tag M2 or the document M1 with a document reader 54. The identification ID may also be input by an operator using a touch panel 56 or the like on an operation terminal 55.

[0102] The processor 61 of the inspection device 50 of the secondary inspection system 5 acquires the identification ID input by the document reader 54 via the communication interface 64 (ST51). Upon acquiring the identification ID, the processor 61 accesses the upper device 2 via the upper communication interface 63, and acquires various pieces of information about the package corresponding to the identification ID from the package information database 16 (ST52). In the secondary inspection, the processor 61 also acquires the inspection results from the primary inspection from the package information database 16.

[0103] When acquiring information on the baggage corresponding to the identification ID, the processor 61 displays the information acquired from the baggage information database 16 (information to be presented to the operator for the secondary inspection) on the display 75 of the touch panel 56 serving as the display unit of the operation terminal 55 (ST53). For example, the processor 61 displays the inspection results of the primary inspection as information to be presented to the operator. The processor 61 may also display information such as X-ray images, external images, and form information acquired in the primary processing on the display 75 of the touch panel 56 together with the inspection results of the primary inspection.

[0104] The processor 61 of the inspection device 50, while displaying the baggage information of the baggage to be inspected, performs a secondary inspection of the baggage (ST54). In the secondary inspection, an operator unpacks the baggage and checks the contents. For example, the operator inputs the inspection results of the secondary inspection as the inspection results of the unpacked baggage via the touch panel 56. The processor 61 accepts the inspection results input by the operator using the touch panel 56 or the like (ST55).

[0105] In this embodiment, the secondary inspection is performed as a brand inspection to inspect the brand of the baggage to be inspected or the item contained in the baggage. As the brand inspection, the operator inspects (determines) whether there is a problem with the brand of the inspected baggage by referring to the brand information registered in the brand database 15 and past baggage information. The operator also uses the camera 57 to photograph the brand display part of the baggage to be inspected or the item contained in the baggage. The inspection device 50 acquires an image (photographed brand image) of the brand display part photographed by the camera 57 during the brand inspection (secondary inspection). The processor 61 of the inspection device 50 regards information in which the result of the brand inspection input by the operator and the brand image photographed by the camera 57 are associated with an identification ID as the inspection result of the secondary inspection (brand inspection).

[0106] When the inspection results are input using touch panel 56, processor 61 registers the input inspection results in baggage information database 16 as baggage information corresponding to the identification ID (ST56). Processor 61 of inspection device 50 supplies information regarding the secondary inspection, including the inspection results, to host device 2 as information to be registered in baggage information database 16, in association with the identification ID. As a result, host device 2 registers information including the inspection results from the secondary inspection from inspection device 50 in baggage information database 16. The registration of baggage information including inspection results in baggage information database 16 will be described in detail later.

[0107] Furthermore, when the inspection results of the secondary inspection are input, processor 61 determines the sorting destination of the parcel in question based on the inspection results. If the secondary inspection determines that the parcel is normal (no problem) (ST57, YES), processor 61 designates the sorting destination of the parcel as a sorter that sorts parcels by destination, and transports the parcel to the sorter (ST58). If the secondary inspection determines that the parcel is abnormal (has a problem) (ST57, NO), processor 61 designates the sorting destination of the parcel as reject, and transports the parcel to a reject stacking section that stacks parcels that are determined to be NG (ST59).

[0108] As described above, the inspection device of the secondary inspection processing system of the embodiment performs a detailed secondary inspection, including unpacking, on luggage that is determined to require secondary inspection by the primary inspection, and the inspection results, including the brand inspection results, are registered in the luggage information database.

[0109] Next, the brand database 15 managed by the higher-level device 2 serving as an information management device according to the embodiment will be described. FIG. 12 is a flowchart for explaining a process in which the higher-level device 2 registers or updates information in the brand database 15. The processor 11 of the higher-level device 2 acquires information (brand information) about a brand that needs to be inspected in the inspection system 1 (ST111). For example, the processor 11 of the higher-level device 2 acquires brand information to be registered in the brand database 15 from an external device via the communication interface 13. The processor 11 of the higher-level device 2 may also acquire brand information to be newly registered or updated from a device operated by an administrator with which communication is possible via the communication interface 13.

[0110] For example, the processor 11 of the higher-level device 2 may acquire brand information to be registered in the brand database 15 from an external server that accumulates information on brands that have been subject to a petition for import / export suspension due to intellectual property infringement goods, etc. In this case, the processor 11 may acquire the newly registered or updated brand information from the external server by accessing the external server at a predetermined timing and searching for the newly registered or updated brand information.

[0111] FIG. 12 is a diagram showing an example of brand information registered in the brand database 15. As shown in FIG. As shown in Fig. 12, the brand information includes a symbol mark, a logo mark, characters, etc. as a brand image (registered brand image) indicating a specific brand. In addition, a plurality of symbol marks, a plurality of logo marks, a plurality of character strings, etc. may be registered as a brand image for one brand. In addition, the brand information may include not only the brand image, but also information (additional information) such as the brand name, registration date, validity period (registration expiration date), registration number, corporate number, and contact information.

[0112] When the processor 11 of the higher-level device 2 acquires the brand information, it registers or updates the acquired brand information in the brand database 15 (ST112). For example, when the processor 11 acquires brand information about an unregistered (new) brand, it registers (adds) the acquired brand information in the brand database 15. In addition, when the processor 11 acquires brand information about an already registered brand, it updates the brand information already registered in the brand database 15 with the acquired brand information.

[0113] FIG. 13 is a schematic diagram showing an example of brand information and a brand database 15 in which the brand information is registered. In the example shown in Fig. 13, the brand information includes information such as the brand name, brand image (registered brand image), registration deadline, etc. The registered brand image includes a plurality of marks such as symbols and logos, as exemplified in Fig. 12. Furthermore, the brand information may include information such as the registration date, registration number, corporate number, and contact information in addition to the brand name, brand image, and registration deadline.

[0114] 13, brand information is registered for each brand (brand name) in the brand database 15. In this case, when the processor 11 of the higher-level device 2 acquires brand information with an unregistered brand name, the processor 11 newly registers (adds) the acquired brand information in the brand database 15. In addition, when the processor 11 of the higher-level device 2 acquires brand information with a registered brand name, the processor 11 updates the brand information already registered in the brand database 15 with the acquired brand information.

[0115] Furthermore, the brand information registered in the brand database 15 may be deleted when the registration deadline has passed. For example, the processor 11 of the higher-level device 2 may check the registration deadline of each piece of brand information registered in the brand database 15 at a predetermined timing or at any timing, and delete the brand information whose registration deadline has passed.

[0116] Next, the package information database (DB) 16 managed by the higher-level device 2 as the information management device according to the embodiment will be described. FIG. 14 is a flowchart for explaining the process in which the higher-level device 2 registers or updates information in the package information database 16. The higher-level device 2 acquires baggage information as information relating to baggage (inspection baggage) to be inspected in the inspection system 1 (ST121). For example, the processor 11 of the higher-level device 2 acquires various pieces of information obtained from the inspection baggage by the 0th processing system 3 in the 0th processing described above as baggage information. The processor 11 of the higher-level device 2 also acquires information including the inspection results of the inspection baggage obtained in the 1st inspection processing by the 1st inspection system 4 as baggage information. The processor 11 of the higher-level device 2 also acquires information including the inspection results of the inspection baggage obtained in the 2nd inspection processing by the 2nd inspection system 5 as baggage information.

[0117] When the processor 11 of the higher-level device 2 acquires baggage information from any device in the inspection system 1, the processor 11 registers or updates the acquired baggage information in the baggage information database 16 (ST122). For example, when the processor 11 of the higher-level device 2 acquires various information corresponding to the identification ID of the inspection baggage from the 0th processing system 3, the processor 11 registers (adds) the acquired information in the baggage information database 16 as baggage information associated with the identification ID.

[0118] Furthermore, when processor 11 obtains information including the inspection results of the primary results for the inspected baggage from primary inspection system 4, it updates baggage information database 16 by adding the obtained information to the baggage information associated with the identification ID of the baggage. Furthermore, when processor 11 obtains information including the inspection results of the secondary inspection for the inspected baggage from secondary inspection system 5, it updates brand database 15 by adding the obtained information to the baggage information associated with the identification ID of the baggage.

[0119] FIG. 15 is a diagram showing an example of package information registered in the package information database 16. As shown in FIG. In the example shown in FIG. 15, the baggage information includes an identification ID (identification information), form information, an exterior image, an X-ray image, content information, and inspection results. The identification ID is identification information that the tag reader 23 reads from a tag attached to the inspection baggage in the zero-order processing. The form information is information that the form reader 26 reads from a form affixed to the inspection baggage by OCR processing or the like in the zero-order processing, and is information including, for example, sender information and recipient information. The exterior image is an image of the exterior of the inspection baggage captured by the camera 24 in the zero-order processing. The X-ray image is an image of the inspection baggage captured by the X-ray imaging device 25 using X-rays in the zero-order processing.

[0120] The content information includes information read by the document reader 26 from the document of the inspection baggage in the zero-order processing and a photographed image of the brand display portion of the baggage or the items in the baggage (brand image of the inspection baggage) photographed by the camera 57 in the secondary inspection or primary inspection. The information read from the document in the content information is, for example, information such as the product name (contents) and brand name. The brand image of the inspection baggage is, for example, a photographed image of the brand display portion of an item in the unpacked inspection baggage. The brand image of the inspection baggage may also be a photographed image of the brand display portion displayed on the exterior of the inspection baggage. The inspection result is information indicating the inspection result of the inspection baggage in the secondary inspection or primary inspection.

[0121] FIG. 16 is a schematic diagram showing an example of package information obtained by the zero-order processing and an image of the package information registered in the package information database 16. In FIG. 16 is composed of information obtained by 0th order processing. In 0th order processing, the higher-level device 2 obtains, for each inspection baggage, an identification ID, document information, an exterior image, an X-ray image, and content information from the 0th order processing system 3. The higher-level device 2 registers each piece of information obtained from the 0th order processing system 3 in the baggage information database 16 as baggage information associated with the identification ID.

[0122] FIG. 17 is a schematic diagram showing an example of baggage information including the inspection results obtained by the secondary processing, and an image of the baggage information registered in the baggage information database 16. In FIG. The baggage information shown in Fig. 17 is information in which information including the inspection results obtained in the secondary inspection or primary inspection is added to the baggage information obtained in the zero-order processing shown in Fig. 16. For example, the secondary inspection system 5 inspects the brand of the baggage (items contained in the baggage) and supplies the inspection results to the higher-level device 2 in association with the identification ID of the baggage. In the secondary inspection by the secondary inspection system 5, when inspecting the brand, the brand-displaying part of the baggage (items contained in the baggage) is photographed by the camera 57. The secondary inspection system 5 supplies the photographed image of the brand-displaying part of the inspected baggage together with the inspection results associated with the identification ID to the higher-level device 2 as a brand image of the inspected baggage.

[0123] The higher-level device 2 registers (adds) the inspection results associated with the identification ID acquired from the secondary inspection system 5 and the brand image of the inspected luggage in the luggage information database 16. As a result, as shown in Fig. 17, the luggage information database 16 registers, as information associated with the identification ID, luggage information including document information, exterior image, X-ray image, and photographed brand image, and inspection results (brand inspection results).

[0124] Next, a search process (first search process) for searching past baggage information using part of the baggage information of an inspection baggage as a search key in the inspection system 1 according to the embodiment will be described. The inspection system 1 according to the embodiment has a function of searching the baggage information database 16 for baggage information that has been found to be problematic in the past, using specific information included in the baggage information of the baggage to be inspected as a search key, and outputting the searched information.

[0125] The inspection system 1 according to the embodiment performs brand inspection in the primary or secondary inspection to check whether there is a problem with the brand of the inspected baggage or the brand of the items contained in the inspected baggage. When performing brand inspection on the inspected baggage, the inspection system 1 searches the baggage information database 16 for baggage information that was previously found to be problematic, using part or all of the baggage information of the inspected baggage as a search key, and outputs the searched baggage information. For example, since the primary inspection can obtain baggage information obtained in the zero-order processing of the inspected baggage, past baggage information that was found to be problematic is searched for using part of the baggage information obtained in the zero-order processing as a search key. Such search results are displayed, for example, on the display 75 of the operation terminal 55 in the primary inspection system 4 that performs the primary inspection.

[0126] FIG. 18 is a schematic diagram showing a process of searching the package information database 16 for past package information with problematic inspection results using form information as a search key. As the search key, information contained in the baggage information of the searched baggage is set. When the sender information of the inspection baggage is specified as the search key, the sender information "A1" in the document information of the inspection baggage is set as the search key. When the search key is set to "A1", baggage information with sender information "A1" is selected from the baggage information database 16, as shown in FIG. 18. Furthermore, in order to detect past baggage information with problematic inspection results, baggage information with sender information "A1" and inspection results of "problematic" is extracted as the search result from the baggage information database 16.

[0127] FIG. 19 is a flowchart for explaining an example of a first search process for searching past baggage information using part of the baggage information of an inspection baggage as a search key in the inspection system 1 according to the embodiment. Here, we will explain as an example of the first search process the process in which the higher-level device 2 uses part of the baggage information specified on the operation terminal 55 during the primary inspection as a search key to search the baggage information database 16 for past baggage information for which the inspection results were problematic, and outputs the search results to the operation terminal 55.

[0128] First, in the primary inspection system 4, the processor 61 of the inspection device 50 acquires the identification ID of the baggage to be inspected (inspection baggage) and acquires baggage information corresponding to the identification ID (ST131). When the processor 61 of the inspection device 50 acquires the baggage information of the inspection baggage, it sets a part of the acquired baggage information as a search key. For example, the processor 61 sets information of a part of the items (or items set in advance) in the baggage information designated by the operator on the operation terminal 55 among the acquired baggage information as the search key (ST132).

[0129] As a specific example, when sender information in the form information is specified (set) to be the search key, the processor 61 of the inspection device 50 sets the sender information included in the acquired baggage information of the inspection baggage as the search key. The processor 61 of the inspection device 50 may also set information included in a specific item of the baggage information (such as a country name, a person's name, or a corporate name) as the search key. For example, when the sender information in the baggage information of the inspection baggage includes a specific country name set in advance, the processor 61 may set the specific country name in the sender information as the search key.

[0130] The processor 61 of the inspection device 50 sets part of the baggage information of the inspected baggage as a search key, and requests the host device 2 to search for past baggage information for which the inspection results were problematic using the set search key. When the processor 11 of the host device 2 receives the search request from the inspection device 50, it searches the baggage information database 16 using the search key specified in the search request from the inspection device 50 (ST133).

[0131] When the processor 11 of the higher-level device 2 executes the search key specified in the search request, it determines whether past baggage information including the specified search key exists in the baggage information database 16 (ST134). If there is no baggage information including the specified search key in the baggage information database 16 (ST134, NO), the processor 11 of the higher-level device 2 outputs a search result indicating that there is no past baggage information including the search key to the inspection device 50, and ends the search process.

[0132] If past package information including the specified search key exists in the package information database 16 (ST134, YES), the processor 11 of the higher-level device 2 selects package information including the search key from the package information database 16. When the processor 11 of the higher-level device 2 selects past package information including the search key, it determines whether or not there is any package information including the selected search key that has a problematic inspection result (ST135). If there is no package information including the specified search key and that has a problematic inspection result in the package information database 16 (ST135, NO), the processor 11 of the higher-level device 2 outputs a search result indicating that there is no problematic past package information including the search key to the inspection device 50, and ends the search process.

[0133] If there is luggage information in the luggage information database 16 that includes the specified search key and has problematic inspection results (ST135, YES), the processor 11 of the higher-level device 2 outputs past luggage information that includes the search key and has problematic inspection results to the inspection device 50 as the search result (ST136). When the processor 61 of the inspection device 50 acquires the search results in response to the search request from the host device 2, it displays the past baggage information obtained as the search results on the display 75 of the operation terminal 55.

[0134] For example, processor 61 of inspection device 50 displays past baggage information as a search result on display 75 as reference information to be presented to the operator together with the confirmation screen for the first inspection described above. Processor 61 of inspection device 50 also accepts input of inspection results by the operator while the confirmation screen for the first inspection and the past baggage information are displayed.

[0135] This allows the operator to carry out an inspection of the luggage while referring to the brand image and other information of past luggage that was found to be problematic in the inspection results. Also, the inspection system can assist in focusing the inspection of luggage that has the same information (e.g., sender information, recipient information, etc.) specified as the search key as luggage that was found to be problematic in the past, making it easier to identify luggage that includes similar information to luggage that was found to be problematic in the past.

[0136] In the above-described processing example, the upper device 2 performs a search in the luggage information database in response to an inspection request from the inspection device 50 of the primary inspection system 4, but the search may also be performed in response to an inspection request from the inspection device 50 of the secondary inspection system 5, or in response to a search request from the search terminal 6.

[0137] According to the first search process described above, the inspection system of the embodiment searches the baggage information database for baggage information that has previously resulted in problematic inspection results using part of the baggage information of the inspected baggage as a search key, and outputs the past baggage information searched from the baggage information database as the search result.

[0138] Thus, according to the inspection system of the embodiment, it is possible to present to the operator past baggage information that includes the baggage information of the inspection baggage specified in the search key and that has resulted in problematic inspection results. As a result, the operator can inspect the inspection baggage while referring to past baggage information that includes the baggage information of the inspection baggage and that has resulted in problematic inspection results, making it easier to identify baggage that displays a brand that needs to be suspended, etc.

[0139] Next, a search process (second search process) for searching past baggage information using a captured image of a brand display portion of an inspection baggage as a search key in the inspection system 1 according to the embodiment will be described. The inspection system 1 according to the embodiment has a function of searching and outputting information on luggage that was problematic in the past from the luggage information database 16 using a captured image (brand image of the inspection luggage) of the brand display portion of the inspection luggage or an item in the inspection luggage during the primary or secondary inspection. For example, the inspection system 1 according to the embodiment performs a brand inspection in the secondary inspection to check whether there is a problem with the brand of the item in the inspection luggage. During such secondary inspection, it is possible to search for information on luggage that was problematic in the past by using brand information (e.g., brand name) of a brand image similar to the captured image of the brand display portion of the item in the inspection luggage as a search key.

[0140] FIG. 20 is a schematic diagram showing a process of searching the baggage information database 16 for past baggage information that has resulted in problematic inspection results, using a brand image of the inspected baggage. In the example shown in Fig. 20, a captured image of a brand-displaying portion of an item contained in an inspection baggage is set as a search key. For example, in a secondary inspection, the baggage to be inspected is unpacked and the brands of the items contained in the baggage are inspected. In this case, the operator photographs the brand-displaying portion of the inspection baggage (items contained in the baggage) with camera 57, and issues an instruction on operation terminal 55 to search for past baggage information using the photographed image of the brand-displaying portion (brand image of the inspection baggage) as a search key.

[0141] When an instruction is given to perform a search using the brand image of the baggage to be inspected, the inspection system 1 acquires a photographed image as a brand image of the baggage to be inspected taken by the camera 57. When the inspection system 1 acquires a photographed image that is a brand image of the baggage to be inspected, it selects brand information including a brand image similar to the photographed image (the similarity exceeds a predetermined threshold value) in the brand database 15, as exemplified in FIG. 20. When there is brand information of a brand image similar to the photographed image, the inspection system 1 identifies the brand name of the brand information including the brand image similar to the photographed image. The inspection system 1 detects baggage information including the brand name of the brand information including the brand image similar to the photographed image from the baggage information database 16 and having a problematic inspection result, and outputs the search result.

[0142] Next, a flow of a second search process for searching for past baggage information using a brand image of an inspection baggage in the inspection system 1 according to the embodiment will be described. FIG. 21 is a flowchart for explaining an example of the operation of the second search process in which the inspection system 1 searches for past baggage information using a brand image of the inspection baggage. Here, as an example of operation shown in Figure 21, a process will be described in which a brand whose brand image is similar to the image of the brand-displaying part of the inspection baggage (items in the baggage) captured by camera 57 during the secondary inspection is selected from brand database 15, and past baggage information for which the inspection results were problematic is searched for in baggage information database 16 using the brand name of the selected brand as a search key.

[0143] The processor 61 of the inspection device 50 of the secondary inspection system 5 acquires the identification ID of the baggage to be inspected, and acquires baggage information (including the inspection results of the primary inspection) corresponding to the identification ID. The processor 61 of the inspection device 50 also accepts an instruction to search for past baggage information using the brand image of the inspected baggage during the secondary inspection. When searching for past baggage information using the brand image of the inspected baggage, the operator inputs a search instruction using the brand image of the inspected baggage on the touch panel 56 of the operation terminal 55 or the like.

[0144] When a search by brand image is instructed by the operation terminal 55, the processor 61 of the inspection device 50 acquires an image of the brand display part of the inspection baggage photographed by the camera 57 (brand image of the inspection baggage) (ST141), and sets the image photographed by the camera 57 as the brand image of the inspection baggage as a search key. For example, an operator instructs a search by brand image, and uses the camera 57 to capture an image of the brand display part of the inspection baggage or an item in the unpacked inspection baggage. Here, the camera 57 may be a fixed camera, or may be smart glasses worn by the operator. The processor 61 of the inspection device 50 acquires the brand image of the inspection baggage photographed by the operator using the camera 57.

[0145] When the processor 61 of the inspection device 50 acquires a brand image of the inspection baggage, it requests the higher-level device 2 to search for brand information using the acquired brand image of the inspection baggage and past baggage information. Here, the inspection device 50 specifies the brand image of the inspection baggage in the search request, and requests the higher-level device 2 to search for brand information including a brand image similar to the specified brand image of the inspection baggage, and to search for past baggage information including that brand information and for which the inspection result was problematic.

[0146] When the processor 11 of the higher-level device 2 receives a search request from the inspection device 50 using the brand image of the inspected baggage, it detects brand information from the brand database 15 including brand images whose similarity to the brand image of the inspected baggage exceeds a predetermined threshold, and searches the baggage information database 16 for past baggage information that includes brand information (as an example, a brand name) of a brand image whose similarity exceeds the predetermined threshold and for which the inspection results were problematic (ST142-147).

[0147] The processor 11 of the higher-level device 2 selects one piece of brand information from the brand database 15 (ST142). The processor 11 calculates the similarity between the photographed image as the brand image of the inspection baggage specified in the search request and the brand image (registered brand image) of the brand information selected from the brand database 15 (ST143). The calculation of the similarity can be realized, for example, by image processing or image recognition processing using a CNN (Convolutional Neural Network). After calculating the similarity between the brand image (photographed image) of the inspection baggage and the registered brand image, the processor 11 determines whether the calculated similarity exceeds a predetermined threshold value (ST144).

[0148] If the similarity between the captured image and the registered brand image is equal to or less than the predetermined threshold (ST144, NO), the processor 11 of the higher-level device 2 returns to ST142, selects the next brand information in the brand database 15, and executes the above-mentioned process. However, if the processor 11 has finished selecting all the brand information in the brand database 15 (ST147), the series of processes ends.

[0149] If the similarity between the photographed image and the registered brand image exceeds a predetermined threshold (ST144, YES), the processor 11 of the higher-level device 2 identifies brand information (brand information of a similar brand) including a registered brand image whose similarity to the photographed image exceeds the predetermined threshold. Here, the processor 11 of the higher-level device 2 identifies a brand name as the brand information of a brand similar to the photographed image. When the processor 11 of the higher-level device 2 identifies the brand name of a brand similar to the photographed image, it searches the luggage information database 16 for past luggage information that includes the identified brand name and has a problematic inspection result (ST145).

[0150] For example, the processor 11 of the higher-level device 2 selects luggage information including a brand name of a similar brand from the luggage information database 16, and determines the luggage information with a search result of problematic luggage from among the selected luggage information as the search result. However, if there is no luggage information including the specified brand name and with a problematic inspection result in the luggage information database 16, the processor 11 of the higher-level device 2 determines the search result of luggage information as the absence of problematic past luggage information including a similar brand name.

[0151] When the processor 11 of the higher-level device 2 has completed the search for past luggage information by brand name, it outputs the brand information including the brand image similar to the captured image and the past luggage information selected by the brand name of the brand information as search results to the inspection device 50 that requested the search (ST146).

[0152] When the processor 61 of the inspection device 50 obtains the search results for the search request from the higher-level device 2, it displays the brand information of similar brands obtained as the search results and the search results of past baggage information using that brand information on the display 75 of the operation terminal 55. The processor 61 of the inspection device 50 accepts the input of the inspection results by the operator while displaying the brand information detected in the brand image of the inspected baggage and the past search results.

[0153] For example, the processor 11 of the higher-level device 2 outputs, as a search result, information that combines a brand image of brand information that includes a brand image similar to a photographed image of the brand-displaying part of the inspected luggage, and a brand image of luggage information that includes that brand information (brand name) and has problematic inspection results.

[0154] FIG. 22 is a schematic diagram showing an example of outputting a search result that combines a brand image of a brand that includes a brand image similar to a photographed image that is a brand image of an inspection baggage with a brand image of past baggage information. In the example shown in Figure 22, information that lists the brand image of brand information that includes a brand image similar to the captured image, and the brand image of luggage information that includes the brand name of the brand information and has an inspection result that is problematic, is output as the search result.

[0155] 22, the processor 61 of the inspection device 50 displays the registered brand image detected from the brand image of the inspection baggage as the search result and the brand image of the past baggage information on the display 75 of the operation terminal 55. This allows the operator to easily check the brand image of the brand that includes a brand image similar to the brand image of the inspection baggage registered in the brand database 15, and the brand image of the past baggage information that includes the brand information (brand name) and has a problematic inspection result.

[0156] When the processor 11 of the higher-level device 2 outputs the search results of the brand database 15 and the baggage information database 16 based on the photographed image that is the brand image of the inspection baggage to the inspection device 50, the process returns to ST142, where the processor 11 selects the next brand information from the brand database 15 and executes the above-mentioned process. When the processor 11 has finished selecting all the brand information in the brand database 15 (ST147), the processor 11 ends the series of processes.

[0157] According to the second search process described above, the inspection system of the embodiment outputs brand information of registered brand images that are similar to the brand image of the inspection baggage, as well as baggage information that has previously been found to be problematic and includes the brand information, as search results based on the brand image of the inspection baggage.

[0158] Thus, according to the inspection system of the embodiment, it is possible to present to the operator, as a search result, brand information including a registered brand image similar to the brand image of the inspection baggage, and information on baggage that has been determined to be problematic in the past including brand information similar to the brand image of the inspection baggage. As a result, the operator can inspect the inspection baggage by referring to the brand information of the brand image similar to the brand image of the inspection baggage and information on baggage that has been determined to be problematic in the past including that brand information, making it easier to identify baggage that displays a brand that needs to be suspended, etc.

[0159] In the above-described operation example, it is determined whether the similarity with the brand image of each brand in the brand database 15, whose similarity exceeds a predetermined threshold, exceeds a predetermined threshold, but it is also possible to detect brand information of a brand image that has the highest similarity with the brand image (photographed image) of the inspection baggage from the brand database 15. In this case, the brand information that is most similar to the inspection baggage can be selected from the brand database 15 based on the similarity with the brand image (photographed image) of the inspection baggage, and the most similar brand information can be presented to the operator.

[0160] In addition, in the above-mentioned operation example, the upper device 2 executes the search process in response to a search request from the inspection device 50 of the secondary inspection system 5, which includes a photographed image of the brand-marked portion of the inspection baggage; however, the search process may also be executed in response to a search request from the inspection device 50 of the primary inspection system 4, which includes a photographed image of the brand-marked portion, or the search may be executed in response to a search request from the search terminal 6, which includes a photographed image of the brand-marked portion.

[0161] Next, a third search process which is a modification of the second search process using a captured image of a brand display portion of an inspection baggage in the inspection system 1 according to the embodiment will be described. 21, a large amount of past baggage information including brand information of a brand image similar to the photographed image that is the brand image of the baggage to be inspected may be searched for. If too much past baggage information is presented (displayed) as a search result, the operator who performs the inspection may have too much information to check and may not be able to inspect efficiently.

[0162] In the third search process, when a large amount of information is searched using the brand image of the inspection baggage, the inspection system 1 outputs (displays) a predetermined number of pieces of information narrowed down in order of priority as search results. When a large amount of information is searched, the priority for displaying the narrowed down information is determined, for example, by the relevance to the inspection baggage. Here, the process of outputting (displaying) search results in which past baggage information searched using the brand image of the inspection baggage is limited to a predetermined number according to the relevance to the inspection baggage will be described as the third search process.

[0163] FIG. 23 is a schematic diagram showing an example of outputting past package information narrowed down in order of relevance as a search result when multiple pieces of past package information with problematic inspection results are searched for using a brand name as a search key. FIG. 23 illustrates an example in which four pieces of past luggage information are selected from the luggage information database 16 using the brand name as a search key. In this case, for each of the four pieces of luggage information selected by brand name, a relevance indicating the relevance to the luggage to be inspected is calculated. FIG. 22 illustrates an example in which three pieces of luggage information are output in order of the relevance of the four pieces of luggage information selected using the brand name as a search key. As shown in FIG. 22, when the past luggage information narrowed down to a predetermined number (three) in order of relevance is output as the search result, the past luggage information narrowed down in order of relevance can be displayed on the display 75 of the operation terminal 55, etc.

[0164] Furthermore, when the multiple selected past baggage information are of the same brand (when multiple baggage information are selected based on brand information such as brand name), the relevance calculated for each past baggage information may be calculated based on the similarity between the brand image included in the selected past baggage information and the brand image of the inspection baggage. In this case, past baggage information narrowed down in order of similarity of the brand image included in the baggage information to the brand image of the inspection baggage can be output as a search result. For example, when only one past baggage information is output as a search result, past baggage information including the brand image most similar to the brand image of the inspection baggage can also be output as a search result.

[0165] The relevance may be calculated by focusing on an item designated by an operator or an item designated in advance. For example, when an operator designates form information including sender information and recipient information as an item for calculating the relevance, the degree of agreement (similarity) between the form information of the inspection baggage and the form information of the selected past baggage information may be calculated as the relevance. Furthermore, a risk level may be set for specific information such as a specific country name, corporate name, or person name that may be included in the form information of the baggage information, and when the specific information is included in the inspection baggage and the past baggage information, the relevance level according to the risk level of the specific information may be calculated.

[0166] Next, a flow of a third search process in which the inspection system 1 according to the embodiment narrows down and outputs past baggage information selected using the brand image of the baggage to be inspected based on the relevance will be described. FIG. 24 is a flowchart for explaining an example of the third search process by the inspection system 1 according to the embodiment. Here, similar to the second search process shown in Figure 21 described above, the process will be described as searching the baggage information database 16 for past baggage information that resulted in problematic inspection results, using as a search key the brand name of a brand image similar to the brand image of the inspection baggage captured by camera 57 during the secondary inspection.

[0167] That is, the processor 61 of the inspection device 50 of the secondary inspection system 5 acquires an image of the brand display portion of the inspection baggage captured by the camera 57 (brand image of the inspection baggage) (ST151), and requests the higher-level device 2 to search for the brand image of the inspection baggage. When the processor 11 of the higher-level device 2 receives a search request from the inspection device 50 using the brand image of the inspection baggage, it selects one piece of brand information from the brand database 15 to calculate the similarity between the brand image of the inspection baggage and the brand image of each piece of brand information registered in the brand database 15 (ST152).

[0168] Processor 11 calculates the similarity between the photographed image as the brand image of the inspection baggage specified in the search request and the brand image of the brand information selected from brand database 15 (ST153). Processor 11 determines whether the similarity between the brand image of the inspection baggage and the brand image of the brand information selected from brand database 15 exceeds a predetermined threshold value (ST154).

[0169] If the similarity between the brand image of the inspection baggage and the registered brand image is equal to or less than the predetermined threshold (ST154, NO), the processor 11 of the higher-level device 2 returns to ST152, selects the next brand information in the brand database 15, and executes the above-mentioned process again. However, if the processor 11 has finished selecting all the brand information in the brand database 15 (ST157), the processor 11 proceeds to ST158.

[0170] If the similarity between the brand image of the inspection baggage and the registered brand image exceeds a predetermined threshold (ST154, YES), the processor 11 of the higher-level device 2 identifies brand information including a brand image whose similarity to the brand image of the inspection baggage exceeds the predetermined threshold. The processor 11 of the higher-level device 2 searches the baggage information database 16 for past baggage information that includes the brand name of the brand information including a brand image whose similarity to the brand image of the inspection baggage exceeds the predetermined threshold and has a problematic inspection result (ST155).

[0171] When the processor 11 of the higher-level device 2 selects past luggage information using the brand name as a search key, it executes a process of calculating a degree of association indicating a relationship between each selected past luggage information and the inspection luggage (a process of submitting the degree of association) (ST156). In the process of calculating the degree of association, the processor 11 calculates the degree of association for each piece of past luggage information in which the brand name was selected as a search key. The processor 11 stores in the memory 12 the degree of association calculated for each piece of past luggage information selected by the brand name in the process of calculating the degree of association.

[0172] The relevance calculated in the relevance calculation process may be a value indicating the magnitude of relevance between the inspection baggage and past baggage information selected from the baggage information database 16. For example, the relevance may be calculated based on the similarity between the baggage information of the inspection baggage and the selected past baggage information, or based on the similarity for each piece of baggage information, or based on the sum of the similarities taking into account the weights set for each item of baggage information. A specific example of the relevance calculation process will be described in detail later.

[0173] After the processor 11 of the higher-level device 2 calculates the relevance for each selected past package information, the processor 11 returns to ST152, selects the next brand information from the brand database 15, and executes the above-mentioned process again. Furthermore, when the processor 11 of the higher-level device 2 finishes the process for all brand information in the brand database 15 (ST157), the processor 11 of the higher-level device 2 ends the process in ST152-157 and proceeds to ST158.

[0174] When the processes in ST152-157 are completed, the processor 11 of the higher-level device 2 outputs the past luggage information narrowed down in order of relevance stored in the memory 12 as a search result (ST158). For example, when the number of past luggage information items to be output as a search result is set, the processor 11 of the higher-level device 2 narrows down the set number of past luggage information items in order of relevance, and outputs the past luggage information narrowed down in order of relevance to the inspection device 50 as a search result. In addition, the processor 11 of the higher-level device 2 may output information combining the past luggage information narrowed down in order of relevance and the brand information of the brand name of the search key used to search for the luggage information to the inspection device 50 as a search result, as shown in FIG. 22.

[0175] That is, the processor 11 of the higher-level device 2 transmits the past baggage information narrowed down to a set number in order of relevance as a search result to the inspection device 50 that originated the search request. This enables the processor 61 of the inspection device 50 to display the search result obtained from the higher-level device 2 on the display 75 of the operation terminal 55, and to accept input of the inspection results for the inspection baggage by the operator.

[0176] Next, an example of the above-mentioned process of calculating the relevance will be described in detail. Here, as an example of the process for calculating the relevance, we will explain a process in which the similarity between the luggage information of the inspection luggage and past luggage information is calculated for each item of luggage information, and the relevance is calculated by the sum of the products of the weights set for each item and the similarities.

[0177] FIG. 25 is a flowchart for explaining an example of a process for calculating the degree of association between an inspection baggage and past baggage information by the upper device 2 in the inspection system 1. When calculating the degree of association between an inspection baggage and past baggage information, the processor 11 of the higher-level device 2 acquires a weight value set for each item of the baggage information (ST161). For example, information indicating the weight Wi (i=1 to I) for each of I items of baggage information is stored in advance in the storage 14 or memory 12. In this case, the processor 11 reads the weight Wi for each item of the baggage information from the storage 14 or memory 12.

[0178] Note that the weighting may be set to 0 for items that are not included in the calculation of the relevance. For items with a weighting of 0, the processing of ST163-164 described later may be omitted. Furthermore, for specific items, the weighting may be changed according to specific information contained in the item. For example, for items that may contain information of particular interest (such as a specific country name, person's name, or corporate name), the information of interest may be set in advance, and the weighting may be changed so that the relevance is high when the information of interest is included. As a specific example, it is possible to set the weighting to be high when the sender information contains a specific country name or a specific corporate name.

[0179] The processor 11 of the higher-level device 2 selects one item (score calculation item) from each item of the baggage information to calculate a point (score) indicating the relevance of each item (ST162). When the processor 11 selects one item as the score calculation item, it calculates the similarity between the information of the item in the baggage information of the inspection baggage and the information of the item in the past baggage information (ST163).

[0180] The processor 11 of the higher-level device 2 calculates the similarity between the baggage information of the inspection baggage and past baggage information for the selected item (calculation item) using a similarity calculation method according to the type of information for the selected item (calculation item).

[0181] For example, when the information of the calculation item is image information, the processor 11 calculates the similarity between image information using an image recognition method such as template matching, Wien classification, machine learning (CNN, SVM, etc.). When the information of the calculation item is character information, the processor 11 calculates the similarity between character information using an index of similarity between character strings or words such as Levenshtein distance, Gestalt pattern matching, or machine learning (Word2Vec, etc.). For items including country names and names, the processor 11 may be configured to output the similarity as the degree of match when there is a complete or partial match.

[0182] The processor 11 of the higher-level device 2 calculates the similarity between the baggage information of the inspection baggage and the past baggage information for the selected calculation item, and then calculates the product of the weight set for the calculation item and the calculated similarity (ST164). For example, the processor 11 calculates the product of the similarity for the i-th (i=1 to N) calculation item i and the weight Wi set for the calculation item i as the score (i) of the calculation item. After calculating the score (i), the processor 11 stores the score (Score) obtained by accumulating the scores (1) to (i) of each item that has already been calculated in the memory 12.

[0183] After processor 11 of higher-level device 2 calculates the score of the selected calculation item, it returns to ST152, selects the next score calculation item, and executes the above-mentioned process again. For example, after processor 11 calculates score (i), it selects item (i=i+1) as the next score calculation item, and executes the calculation of score (i) as described above.

[0184] When processor 11 finishes calculating the scores for all items (i=I) in the package information (ST165), it ends the calculation of the scores for all items in the package information. After calculating the scores for all items in the package information, processor 11 outputs the score (Score), which is the sum of the scores for all items, as the relevance (ST166).

[0185] According to the above-described third search process, the inspection system of the embodiment selects past baggage information that includes brand information of a brand image similar to the brand image of the inspection baggage and has problematic inspection results, and outputs search results that narrow down the selected past baggage information based on its relevance to the inspection baggage.

[0186] As a result, the inspection system according to the embodiment can present the operator with search results that include brand information of brand images similar to the brand image of the inspected baggage and that narrow down past baggage information with problematic inspection results based on relevance to the inspected baggage. As a result, the operator can inspect the inspected baggage while referring to information on baggage that was previously determined to be problematic and includes brand information of similar brand images, making it easier to identify baggage with a brand display that requires suspension, etc.

[0187] According to the relevance calculation process in the third search process described above, the inspection system according to the embodiment calculates the relevance between the inspection baggage and past baggage information based on the similarity between the baggage information of the inspection baggage and the past baggage information. This allows the inspection system according to the embodiment to preferentially present past baggage information similar to the baggage information of the inspection baggage as a search result.

[0188] In addition, in the above-mentioned relevance calculation process, the inspection system according to the embodiment calculates the similarity between the baggage information of the inspected baggage and the past baggage information for each item of the baggage information, and calculates the relevance between the inspected baggage and the past baggage information by the sum of the similarities for each item. This allows the inspection system according to the embodiment to present, as a search result, past baggage information narrowed down by the relevance based on the similarity selected for each item of the baggage information.

[0189] Furthermore, in the above-mentioned relevance calculation process, the inspection system according to the embodiment sets a weight for each item of the baggage information, calculates the product of the similarity between the baggage information of the inspection baggage and past baggage information for each item and the weight, and calculates the relevance between the inspection baggage and past baggage information by the sum of the products of the similarity and the weight for each item. This allows the inspection system according to the embodiment to present as a search result past baggage information narrowed down by the relevance with the inspection baggage determined by the score weighted for each item.

[0190] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0191] 1...inspection system, 2...host device (information management device), 3...information acquisition (0th processing) system, 4...first inspection system, 5...second inspection system, 11...processor (first processor), 12...memory, 13...communication interface, 14...storage (first memory unit, second memory unit), 15...brand database, 16...baggage information database, 20...information acquisition device, 22...conveyor, 23...tag reader, 24...camera, 25...X-ray device, 26...document reader, 27...operation terminal, 28...touch panel, 29...memory interface, 31...processor, 32...memory, 32a ...Dictionary data, 33...upper communication interface, 34...communication interface, 41...processor, 42...memory, 43...communication interface, 50...inspection equipment, 51...first conveyor, 52...second conveyor, 53...sorting mechanism, 53a...sorting gate, 54...document reader, 55...operation terminal, 56...touch panel, 57...camera, 61...processor (second processor), 62...memory, 63...upper communication interface, 64...communication interface (terminal interface), 71...processor, 72...memory, 73...communication interface, 75...display, 76...touch sensor.

Claims

1. a communication interface for communicating with an information acquisition device for acquiring information from the inspection baggage to be inspected; a first storage unit having a brand database that stores brand information related to a brand to be detected; a second storage unit having a baggage information database that stores baggage information including information acquired by the information acquisition device from the inspection baggage; a processor that, when the inspection result indicates that the inspection baggage contains an item of a brand whose brand information is stored in the brand database, registers in the baggage information database baggage information of the inspection baggage, the baggage information including an image of a part showing the brand in the inspection baggage and the inspection result for the inspection baggage; An information management device having the above configuration.

2. When the processor receives a search request in which information to be used as a search key is specified via the communication interface, the processor outputs a search result obtained by searching the baggage information database for past baggage information that includes the search key and for which inspection results indicate a problem to a source of the search request. The information management device according to claim 1 .

3. the brand database stores brand information including a brand image related to a brand to be detected; When the processor receives a search request using a photographed image of a brand display portion of the inspection baggage, the processor calculates a similarity between the photographed image and a brand image included in the brand information registered in the brand database, and outputs brand information including a brand image whose similarity exceeds a predetermined threshold to a source of the search request. The information management device according to claim 1 .

4. the brand database stores brand information including a brand image related to a brand to be detected; When the processor receives a search request using a photographed image of a brand display portion of the inspection baggage, the processor calculates a similarity between the photographed image and a brand image included in the brand information registered in the brand database, searches the baggage information database for brand information including a brand image whose similarity exceeds a predetermined threshold and for past baggage information with problematic inspection results, and outputs a search result to a source of the search request. The information management device according to claim 1 .

5. The processor outputs, as a search result to a source of the search request, brand information including a brand image whose similarity exceeds a predetermined threshold, and past baggage information including brand information of a brand image whose similarity exceeds a predetermined threshold, searched from the baggage information database, and having an inspection result that indicates a problem. The information management device according to claim 4.

6. the processor outputs, as a search result to a source of the search request, brand images registered in the brand database as brand information including brand images whose similarity exceeds a predetermined threshold value, and photographed images of brand display parts in past luggage information searched from the luggage information database. The information management device according to claim 5 .

7. The processor calculates a degree of relevance with the inspection baggage for each piece of past baggage information retrieved from the baggage information database, and outputs the past baggage information narrowed down by the degree of relevance as a search result to a requester of the search request. The information management device according to claim 4.

8. The processor calculates the degree of association based on a degree of similarity between the baggage information of the inspection baggage and past baggage information. The information management device according to claim 7.

9. The processor calculates a similarity between the baggage information of the inspection baggage and past baggage information for each item of the baggage information, and calculates the degree of association by summing up the similarities for each item. The information management device according to claim 7.

10. The processor further obtains a weight set for each item of the package information, and calculates the relevance by summing up the products of the similarity calculated for each item and the weight. The information management device according to claim 7.

11. An inspection system having an information management device and an inspection device, The information management device includes: an information acquisition device for acquiring information from an inspection baggage to be inspected and a communication interface for communicating with the inspection device; a first storage unit having a brand database that stores brand information related to a brand to be detected; a second storage unit having a baggage information database that stores baggage information including information acquired by the information acquisition device from the inspection baggage; a first processor that, when the inspection result indicates that the inspection baggage contains an item of a brand whose brand information is stored in the brand database, registers in the baggage information database baggage information of the inspection baggage, the baggage information including an image of a brand display portion of the inspection baggage and the inspection result for the inspection baggage; The inspection device includes: A host communication interface that communicates with the information management device; a terminal interface for communicating with an operation terminal and a camera; and a second processor that transmits to the information management device the inspection results for the inspection baggage input to the operation terminal and an image of the brand display portion of the inspection baggage taken by the camera. Inspection system.

12. when the first processor receives a search request from the inspection device via the communication interface, the search request specifying information to be used as a search key, the first processor searches the baggage information database for past baggage information that includes the search key and for which the inspection result is problematic, and outputs a search result to the inspection device; the second processor transmits a search request specifying information used as the search key to the information management device, and displays the search results obtained from the information management device on a display of the operation terminal; The inspection system of claim 11.

13. the brand database stores brand information including a brand image related to a brand to be detected; when receiving a search request using a photographed image of a brand display portion of the inspection baggage, the first processor calculates a similarity between the photographed image and a brand image included in the brand information registered in the brand database, and outputs, as a search result, to the inspection device, brand information including a brand image whose similarity exceeds a predetermined threshold, or brand information searched for in the baggage information database and including a brand image whose similarity exceeds a predetermined threshold and for which an inspection result is problematic; the second processor transmits a search request using an image of the brand display portion of the inspection baggage photographed by the camera to the information management device, and displays the search result obtained from the information management device on a display of the operation terminal. The inspection system of claim 11.

14. the second processor calculates a degree of relevance with the inspection baggage for each piece of past baggage information retrieved from the baggage information database, and outputs the past baggage information narrowed down by the degree of relevance to the inspection device. The inspection system of claim 13.

Images