Baggage inspection device, baggage inspection method, and program

Abstract

To provide a luggage inspection device capable of improving the accuracy of reading a code attached to the outer surface of luggage and improving the accuracy of inspecting luggage. [Solution] A luggage inspection device inspects luggage and includes a processor that causes a camera to capture an overall image of the luggage to be inspected so that the entire luggage is visible, stores imaging conditions in memory for each of multiple preset areas that make up the image range of the overall image, identifies the position of a code that can identify the luggage attached to the exterior surface of the luggage from the overall image, obtains an image based on the imaging conditions for the preset area that corresponds to the identified code position, and reads the code based on the image.

Description

[Technical field]

[0001] The present disclosure relates to a luggage inspection device, a luggage inspection method, a program, and a luggage inspection system for inspecting luggage. [Background technology]

[0002] Conventionally, a camera is used to capture an image of a barcode and read the barcode through image recognition. When a barcode is attached to a package, the barcode is generally small, and zooming or focusing is required to capture the barcode, which requires processing time and is troublesome.

[0003] Conventionally, there is known an image processing device that photographs and reads barcodes at the same magnification or focus (see Patent Document 1). This image processing device specifies the barcode range (reading range) from the entire image, performs zoom setting for the first barcode, and applies the same zoom setting to the second and subsequent barcodes, moving the photographing range to photograph and read each barcode. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-220829 A Summary of the Invention [Problem to be solved by the invention]

[0005] When barcodes printed on labels attached to multiple packages are captured by a camera installed at a fixed position, the distance between the camera and each barcode of each package is different for each package. Also, the imaging direction for capturing an image of the barcode of each package by the camera is different for each package. Therefore, when capturing an image of each barcode with the same zoom setting as in the image processing device of Patent Document 1, the barcode reading accuracy is likely to be insufficient depending on the placement of the packages.

[0006] The present disclosure provides a luggage inspection device, a luggage inspection system, a luggage inspection method, a program, and a luggage inspection system that can improve the reading accuracy of codes attached to the outer surface of luggage and improve the inspection accuracy of luggage. [Means for solving the problem]

[0007] One aspect of the present disclosure is a baggage inspection device for inspecting baggage, the baggage inspection device including a processor, the processor configured to cause a camera to detect a baggage to be inspected. Specific imaging range The image is captured, Specific imaging range Configure One or more programs The imaging conditions for each reset area are stored in a memory. Specific imaging range This is a luggage inspection device that identifies the position of a code that can identify the luggage and is attached to the outer surface of the luggage, obtains an image based on the imaging conditions of the preset area that corresponds to the identified position of the code, and reads the code based on the image.

[0008] One aspect of the present disclosure is a baggage inspection method for inspecting baggage, comprising: Specific imaging range and imaging the Specific imaging range Configure One or more programs A step of storing imaging conditions for each reset area in a memory; Specific imaging range The baggage inspection method includes the steps of: identifying the position of a code attached to the outer surface of the baggage from a camera; acquiring an image based on imaging conditions of the preset area corresponding to the identified position of the code; and reading the code based on the image.

[0009] One aspect of the present disclosure is a program for causing a computer to execute each step of the baggage inspection method described above.

[0010] One aspect of the present disclosure is a baggage inspection system including a camera for capturing images of luggage and a baggage inspection device for inspecting the luggage, the baggage inspection device causes the camera to capture an overall image of the luggage to be inspected so that the entirety of the luggage is captured, stores in a memory imaging conditions for each of a plurality of preset areas constituting an image range of the overall image, identifies a position of a code attached to an outer surface of the luggage that can identify the luggage from the overall image, obtains an image based on the imaging conditions of the preset area that corresponds to the identified position of the code, and based on the image, A baggage inspection system that reads the code. Effect of the Invention

[0011] According to the present disclosure, the accuracy of reading codes attached to the outer surface of luggage can be improved, and the accuracy of inspecting luggage can be improved. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram showing a configuration example of a baggage inspection system according to a first embodiment. [Diagram 2] FIG. 1 is a schematic diagram showing an example of how a camera captures an image of a package to be inspected. [Figure 3A] FIG. 1 is a diagram showing a first example of preset areas constituting the entire imaging range. [Figure 3B] FIG. 13 is a diagram showing a second example of a preset area constituting the entire imaging range. [Figure 4] A flowchart showing an example of an operation of a management device during preset information determination processing. [Figure 5A] FIG. 13 is a diagram showing an example of an overall image for determining preset information; [Figure 5B] FIG. 13 is a diagram showing an example of a preset area determined based on an entire image for determining preset information; [Figure 6] A flowchart showing an example of an operation of a management device during baggage inspection processing. [Figure 7] A flowchart showing an example of an operation of a management device when reading a baggage code. [Figure 8A]FIG. 13 is a diagram showing an example of a baggage code presence area in an overall image including multiple bags to be inspected. [Figure 8B] Flowchart showing a first example of a process for acquiring a read image [Figure 8C] 11 is a flowchart showing a second example of a process for acquiring a read image. [Figure 9] 1 is a flowchart showing an example of an operation performed by a management device when acquiring a pallet ID. [Figure 10] A diagram showing a first example of the inspection result display screen [Figure 11] A diagram showing a second example of the inspection result display screen DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0014] (First embodiment) Fig. 1 is a block diagram showing an example of the configuration of a baggage inspection system 5 according to the first embodiment. The baggage inspection system 5 includes a camera 10, a concentrator 20, a lighting device 30, a management device 100, and a server 200. The baggage inspection system 5 inspects one or more bags 50 (see Fig. 2) that are to be inspected.

[0015] The camera 10 captures an image of the luggage 50 to be inspected. There may be one or more cameras 10, and in this embodiment, a case where four cameras 10 are provided is mainly illustrated as an example. The luggage 50 has, for example, a rectangular parallelepiped shape (for example, a cardboard shape). In this case, the luggage 50 has four sides. The four cameras 10 are positioned so as to be able to capture images of each of the four sides of the luggage 50.

[0016] The camera 10 has a zoom function or an AF (AutoFocus) function, etc., and can be flexibly set according to the positional relationship between the camera 10 and the luggage 50. The camera 10 may be, for example, a PTZ camera having pan, tilt, and zoom functions. In this case, the camera 10 can expand and reduce the imaging range by changing the zoom magnification, move the imaging range in various directions by panning or tilting, etc. Therefore, the imaging range of the camera 10 can be set to an entire imaging range in which one or more luggage 50 to be inspected are entirely captured, or a specific imaging range in which the vicinity of a specific luggage 50 is limitedly captured. The camera 10 does not need to have pan and tilt functions.

[0017] The camera 10 may be installed at a fixed position, for example, at a location in a warehouse where loading, unloading, or inventory of the luggage 50 is performed. This fixed position includes a wall surface, a ceiling surface, a floor surface, a table, etc. The camera 10 includes, for example, a processor, an imaging device, a communication device, and a memory.

[0018] The concentrator 20 electrically connects the camera 10 and the management device 100 so as to be able to communicate with each other. The concentrator 20 may be a hub, a switching hub (layer 2 switch), a layer 3 switch, or the like.

[0019] The lighting device 30 illuminates the luggage 50 to be inspected. By illuminating the luggage 50, the lighting device 30 makes it easier to ensure the brightness around the luggage 50 required for the camera 10 to capture an image of the luggage 50. There may be one or more lighting devices 30. The lighting device 30 may be provided separately from the camera 10 or may be included in the camera 10. The lighting device 30 may operate in synchronization with the camera 10. The lighting device 30 is configured to include, for example, a lighting device, a processor, a communication device, and a memory.

[0020] The management device 100 inspects the baggage 50 that is the target of inspection. The management device 100 manages each device (e.g., the camera 10, the lighting device 30, and the server 200) included in the baggage inspection system 5, The management device 100 may inspect the luggage 50 in cooperation with each of these devices. The management device 100 is configured by, for example, a PC (Personal Computer). The management device 100 may be connected to the camera 10 so as to be able to communicate via wired or wireless communication. The management device 100 may be connected to the lighting device 30 so as to be able to communicate via wired or wireless communication. The management device 100 may be connected to the server 200 so as to be able to communicate via wired or wireless communication.

[0021] As shown in FIG. 1, the management device 100 includes a processor 110, a communication device 120, a memory 130, an operation device 140, and a display device 150.

[0022] The processor 110 includes a micro processing unit (MPU), a central processing unit (CPU), a digital signal processor (DSP), a graphical processing unit (GPU), or the like. The processor may be configured with various integrated circuits (e.g., a large scale integration (LSI), a field programmable gate array (FPGA)). The processor 110 realizes various functions by executing programs stored in the memory 130. The processor 110 comprehensively controls each part of the management device 100 and performs various processes.

[0023] For example, the processor 110 determines the imaging conditions for the camera 10. The information on the imaging conditions may include zoom information on zoom (e.g., zoom magnification), focus information on focus (e.g., focal position), or other imaging-related information (e.g., imaging timing, imaging range, shutter speed, ISO sensitivity, or aperture value information). The processor 110 may acquire operation information via the operation device 140 and determine the imaging conditions based on the operation information. This allows a user of the management device 100 (e.g., an administrator, an inspector) to generate desired imaging conditions. The processor 110 may determine the imaging conditions by calculation based on the positional relationship (e.g., distance, angle) between each baggage 50 and the camera 10, the environment of the inspection position (e.g., brightness), etc.

[0024] The processor 110 determines the lighting conditions by the lighting device 30. The information on the lighting conditions may include the timing of lighting, the lighting range, the lighting pattern, the color of the lighting light, the amount of the lighting light, or other information on lighting. The processor 110 may acquire operation information via the operation device 140 and determine the lighting conditions based on the operation information. This allows the user of the management device 100 to generate desired lighting conditions. The processor 110 may determine the lighting conditions by calculation based on the positional relationship (e.g., distance, angle) between each baggage 50 and the camera 10 or the environment (e.g., brightness) of the inspection position. In addition, the lighting by the lighting device 30 may be linked to the image capture by the camera 10. Therefore, the lighting conditions may be the lighting conditions at the time of image capture by the camera 10. The lighting conditions by the lighting device 30 may be included in the image capture conditions by the camera 10.

[0025] The communication device 120 communicates various data or information. The communication method by the communication device 120 may be a wired communication or a wireless communication method, and may include a communication method such as a local area network (LAN), a wide area network (WAN), a power line communication, or a cellular communication for mobile phones (e.g., 5G, LTE (Long Term Evolution)). For example, the communication device 120 may transmit the determined imaging conditions to the camera 10. The communication device 120 may transmit the determined lighting conditions to the lighting device 30.

[0026] The memory 130 includes a primary storage device (e.g., a random access memory (RAM) or a read only memory (ROM)). The memory 130 may include a secondary storage device (e.g., a hard disk drive (HDD) or a solid state drive (SSD)) or a tertiary storage device (e.g., an optical disk or an SD card). The memory 130 may include other storage devices. The memory 130 holds various data or information, etc.

[0027] The operation device 140 may include various buttons, keys, switches, a touch panel, a touch pad, a microphone, or other operation devices (input devices). The operation device 140 accepts input of various data or information.

[0028] The display device 150 may include a liquid crystal display device, an organic EL device, or another display device. The display device 150 displays various data or information.

[0029] The server 200 holds luggage information on the luggage 50, pallet information on the pallet 60 (an example of a loading platform), and the like. The pallet 60 is an example of a loading platform on which the luggage 50 is placed and transported during inspection of the luggage 50, and can be moved by a forklift. The luggage information may include, for example, identification information (luggage ID) of the luggage 50, size information of the luggage 50, weight information of the luggage 50, and storage position information of the luggage 50 in the warehouse. The pallet information may include, for example, identification information (pallet ID) of the pallet 60, size information of the pallet 60, weight information of the pallet 60, or information on the maximum number and maximum weight of the luggage 50 that can be loaded on the pallet 60. The server 200 also holds luggage information and pallet information in association with each other, and holds information on the luggage 50 that should be on the pallet 60. That is, if the server 200 can identify the pallet 60, it can identify the luggage 50 that should be on the pallet 60, and if the server 200 can identify the luggage 50 on the pallet 60, it can identify the pallet 60. In this case, the baggage ID and the pallet ID may be associated with each other. The server 200 includes a processor, a communication device, a memory, and the like.

[0030] Fig. 2 is a schematic diagram showing an example of how an image of a baggage 50 to be inspected is captured by the camera 10. For the sake of explanation, in Fig. 2, an example of front, back, left, right, top and bottom directions is indicated by arrows.

[0031] When inspecting the luggage 50, a pallet 60 on which one or more luggage 50 to be inspected are placed is placed at a predetermined inspection position. When the pallet 60 is placed at the inspection position, the pallet 60 and the one or more luggage 50 placed on the pallet 60 can be imaged in their entirety by the camera 10. When inspection of a group of luggage 50 to be inspected placed on one pallet 60 is completed, the pallet 60 and the luggage 50 leave the inspection position, and the next pallet 60 and luggage 50 to be inspected enter the inspection position. This entry and exit of the pallet 60 and luggage 50 to be inspected is repeated in sequence, making it possible to inspect a large number of luggage 50 in an assembly line process.

[0032] In FIG. 2, four cameras 10 are installed on all four sides of the luggage 50 placed on the pallet 60. For example, in FIG. 2, four cameras 10 are arranged to face the front, rear, left, and right sides of the luggage 50 arranged at the inspection position. When there are multiple luggage 50, the multiple luggage 50 may be the same size. The camera 10 facing the front is also referred to as a front camera. The camera 10 facing the rear is also referred to as a rear camera. The camera facing the left side is also referred to as a left camera. The camera 10 facing the right side is also referred to as a right camera. Although not shown in the figure, a rotating platform may be provided at the location where the pallet 60 is arranged to facilitate the arrangement of the luggage 50.

[0033] Each piece of luggage 50 has a luggage code 55 for identifying the piece of luggage 50 attached to any one of the outer surfaces of the piece of luggage 50 that can be imaged by the camera 10 (the front surface in FIG. 2). The luggage code 55 may be composed of, for example, a one-dimensional code (e.g., a barcode), a two-dimensional code (e.g., a QR code (registered trademark)), or a three-dimensional code (e.g., a PM code (registered trademark)).

[0034] As shown in FIG. 2 , the baggage code 55 may be written on the label 52, and the label 52 may be affixed to the baggage 50. In this case, the baggage code 55 may be written on the label 52, for example, by directly printing the baggage code 55 or by attaching a separate sticker or the like indicating the baggage code 55. The label 52 is placed at a predetermined position with respect to the baggage 50. Information on the relative position of the label 52 with respect to the baggage 50 may be held in the memory 130 of the management device 100. The baggage code 55 is placed at a predetermined position with respect to the label 52. Information on the relative position of the baggage code 55 with respect to the label 52 may be held in the memory 130 of the management device 100.

[0035] Furthermore, the baggage code 55 may be written directly on the baggage 50. In this case, the baggage code 55 may be written on the baggage 50, for example, by directly printing the baggage code 55 or by attaching a separate sticker or the like indicating the baggage code 55. The baggage code 55 is placed at a predetermined position with respect to the baggage 50. Information on the relative position of the baggage code 55 with respect to the baggage 50 may be stored in the memory 130 of the management device 100.

[0036] A pallet code 65 for identifying the pallet 60 is affixed to any one of the outer surfaces of the pallet 60 that can be imaged by the camera 10 (the front in FIG. 2). The pallet code 65 may be configured, for example, as a one-dimensional code (e.g., a barcode), a two-dimensional code (e.g., a QR code (registered trademark)), or a three-dimensional code (PM code (registered trademark)). The pallet code 65 may be written on the pallet 60, for example, by directly printing the pallet code 65 or by attaching a separate sticker or the like showing the pallet code 65.

[0037] Each piece of luggage 50 may be placed on the pallet 60 such that the luggage code 55 is located on one of the multiple sides of each piece of luggage 50 in the same direction (e.g., the front). Furthermore, the side on which the pallet code 65 marked on the pallet 60 is located may be the same side (e.g., the front) as the side on which the luggage code 55 marked on the piece of luggage 50 is located. In this case, the pallet 60 and the piece of luggage 50 can be imaged by the front camera, so only one camera 10 may be required. In this case, the number of cameras 10 installed in the luggage inspection system 5 can be reduced.

[0038] Furthermore, the luggage codes may be located on different side surfaces of each piece of luggage 50. Even in this case, the luggage codes 55 located on each side surface of the luggage 50 can be imaged by capturing images from different directions using multiple cameras 10. Therefore, when a worker places luggage 50 on a pallet 60, the worker can place luggage 50 on the pallet 60 without worrying about the orientation of luggage 50 relative to the pallet 60, and the time required to place luggage 50 can be shortened.

[0039] The baggage code 55 is captured by at least one camera 10, read based on the captured image or a processed image obtained by processing the captured image, and the baggage ID corresponding to the baggage code 55 is identified.

[0040] (Preset information) The preset information is now explained. The preset information is composed of preset area information, image capture condition information, and lighting condition information. Note that the lighting condition information may or may not be included. First, the preset area information will be described. FIG. 3A is a diagram showing a first example of a preset region PR that constitutes the entire imaging range CA1. FIG. 3B is a diagram showing a second example of the preset region PR that constitutes the entire imaging range CA1.

[0041] The processor 110 of the management device 100 determines a plurality of preset regions PR constituting the entire imaging range CA1. The processor 110 may acquire operation information via the operation device 140 and determine the preset region PR based on the operation information. This allows the user of the management device 100 to generate a desired preset region PR. The processor 110 may also determine the preset region PR by calculation. For example, the processor 110 may determine the size of the preset region PR based on the size of the area occupied by the baggage code 55 relative to the entire imaging range CA. The processor 110 may reduce the size of the preset region PR as the size of the area occupied by the baggage code 55 relative to the entire imaging range CA becomes smaller. The processor 110 may increase the size of the preset region PR as the size of the area occupied by the baggage code 55 relative to the entire imaging range CA becomes larger. The processor 110 holds preset region information (e.g., the position of each preset region, the size of each preset region, the shape of each preset region, or the presence or absence of overlap between adjacent preset regions) related to the determined preset region PR in the memory 130.

[0042] Next, information on the imaging conditions will be described. The processor 110 sets focus, pan, tilt, zoom, exposure, and the like as imaging conditions of the camera 10. The processor 110 determines the imaging conditions for each preset region PR, and stores the determined imaging conditions in the memory 130. The lighting conditions will now be described. The processor 110 sets the lighting timing, lighting range, lighting pattern, lighting color, lighting amount, etc. as the lighting conditions. The processor 110 determines the lighting conditions for each preset region PR, and stores the determined lighting conditions in the memory 130. The preset information is configured including the preset area information, the imaging condition information, and the lighting condition information determined in this manner. The preset area information, the imaging condition information, and the lighting condition information may be associated with each other. The processor 110 may store the information determined by the processor 110 in the memory 130 as the preset information. The processor 110 may not determine the preset information itself, but may obtain predetermined preset information from an external device via the communication device 120 and store it in the memory 130. The imaging condition information may include the preset area information.

[0043] Since the entirety of one or more pieces of luggage 50 to be inspected is captured in the entire imaging range CA, when the entire imaging range CA is captured, the luggage code 55 written on the luggage 50 is captured in at least one preset area PR. The preset area PR in which the luggage code 55 is captured is also an area for reading the luggage code 55 written on the luggage 50, and is therefore also referred to as a reading area PRα (see FIG. 8A).

[0044] In Fig. 3A, the entire imaging range CA1 is equally divided to define four preset regions PR1, PR2, PR3, and PR4 of the same size and shape. The range of each preset region PR may be defined by coordinates. For example, the preset region PR1 may be indicated by coordinate information such as (x, y) coordinates, and is indicated by a coordinate range of (0, 0) to (300, 200), for example. Note that the multiple preset regions PR may be formed in different shapes or sizes.

[0045] In addition, in FIG. 3A, the four preset regions PR are arranged without gaps such that the ends of adjacent preset regions PR (e.g., preset regions PR1 and PR2, preset regions PR2 and PR4, preset regions PR4 and PR3, preset regions PR3 and PR1) do not overlap with each other.

[0046] In Fig. 3B, the entire imaging range CA1 is equally divided to define four preset regions PR1A, PR2A, PR3A, and PR4A of the same size and shape. In Fig. 3B, the coordinate range of each preset region PR may be shown in the same manner as in Fig. 3A.

[0047] In FIG. 3B, the four preset regions PR are arranged such that ends of adjacent preset regions PR (for example, preset regions PR1A and PR2A, preset regions PR2A and PR4A, preset regions PR4A and PR3A, preset regions PR3A and PR1A) overlap each other.

[0048] For example, assume that the baggage code 55 is located at a position P1 near the boundary between adjacent preset areas PR. In this case, the processor 110 may set at least one of the adjacent preset areas PR as a reading area PRα. Even in this case, the management device 100 can increase the probability of successfully reading the baggage code 55 (reading accuracy) by using a read image based on imaging conditions corresponding to at least one of the adjacent preset areas PR, since adjacent ends of the adjacent preset areas PR overlap each other.

[0049] Also, assume that the position of the baggage code 55 is at P1 near the boundary between adjacent preset areas PR. In this case, the processor 110 may set the preset area PR in which the distance between the center position PRO of the adjacent preset area PR and the position P1 of the baggage code 55 is the shortest as the reading area PRα. In FIG. 3B, the processor 110 may set the preset area PR3A of the adjacent preset areas PR1A and PR3A as the reading area PRα. This allows the management device 100 to select a preset area PR that is likely to successfully read the baggage code 55 at the position P1 and specify it as the reading area PRα, thereby improving the reading accuracy and shortening the reading time.

[0050] (Preset information determination process) Next, the preset information determination process will be described. Fig. 4 is a flowchart showing an example of operation during preset information determination processing by the management device 100. Fig. 5A is a diagram showing an example of an entire image GA1 for determining preset information. Fig. 5B is a diagram showing an example of a preset area determined based on the entire image GA1.

[0051] First, the camera 10 captures an entire image GA1 for determining preset information (for determining a preset region PR) with the entire image capture range CA1 as the capture range. The entire image GA1 includes the baggage 50 to be inspected. The camera 10 transmits the entire image GA1 to the management device 100.

[0052] In the management device 100, the processor 110 acquires the entire image GA1 from the camera 10 via the communication device 120 (S1). The processor 110 divides the image range of the entire image GA1 (i.e., the entire imaging range CA1) into a grid to determine a plurality of preset regions PR (S2) (see FIG. 5B). The processor 110 determines the imaging conditions for each preset region PR (S3). In addition to the imaging conditions, lighting conditions may also be determined. Note that detailed imaging condition settings may be calculated and determined by the camera 10. The processor 110 stores preset information including information on the determined plurality of preset regions PR and information on the imaging conditions for each preset region PR in the memory 130 (S4). Note that the preset information may be stored in each camera 10.

[0053] According to such an operation during the preset information determination process, the management device 100 that inspects the luggage 50 can determine the preset areas PR and the imaging conditions for each preset area PR used to read the luggage code 55 required for inspecting the luggage 50. Therefore, the management device 100 can determine the preset areas PR using the entire image GA in a state close to when the luggage 50 is imaged during actual inspection, and can capture the read image under suitable imaging conditions, thereby improving the reading accuracy.

[0054] The preset information determination process may be performed before the baggage inspection process described later or during the initial baggage inspection process. Therefore, the management device 100 can repeatedly obtain read images under the same imaging conditions by using the determined preset information for each baggage inspection process.

[0055] (Baggage inspection processing) Next, the baggage inspection process will be described. FIG. 6 is a flowchart showing the inspection process of the luggage 50 by the management device 100.

[0056] First, the processor 110 of the management device 100 cooperates with the camera 10 to perform a process of reading the package code 55 (S11). The process of reading the package code 55 will be described in detail later. The processor 110 cooperates with the server 200 to perform a process of acquiring a pallet ID (S12). The process of acquiring a pallet ID will be described in detail later.

[0057] The processor 110 transmits the pallet ID acquired by the pallet ID acquisition process to the server 200 via the communication device 120. The processor 110 receives package information corresponding to the pallet ID from the server 200 via the communication device 120 (S13).

[0058] The processor 110 inspects each of the inspection target luggage 50 by performing a comparison process that compares one or more luggage IDs (also referred to as registered luggage IDs) included in the luggage information with one or more luggage IDs (also referred to as inspection target luggage IDs) read by the reading process of S11 (S14). The registered luggage IDs are luggage IDs registered in the server 200 as luggage information. For example, the processor 110 determines that the inspection result is OK (normal) for luggage IDs whose registered luggage IDs and the inspection target luggage IDs match, because the luggage IDs are registered in the server 200 in advance and are actually placed on the pallet 60. In addition, when the inspection target luggage ID is obtained by the reading process of the luggage 50, but the registered luggage ID matching the inspection target luggage ID is not included in the luggage information, the processor 110 determines that the inspection result is NG (abnormal) because there is a luggage 50 that is not registered in the server 200. In addition, if the processor 110 obtains a registered luggage ID contained in the luggage information corresponding to the pallet 60, but cannot obtain a luggage ID of the inspection target matching the registered luggage ID by reading the luggage 50, the processor 110 determines that the inspection result is NG (abnormal), since there is a luggage 50 that is registered in the server 200 but does not exist on the pallet 60.

[0059] The processor 110 displays inspection result information indicating the inspection result of the package 50 via the display device 150 (S15). The inspection result information is displayed on the display device 150 in the form of an inspection result display screen, for example (see FIGS. 10 and 11, which will be described later).

[0060] The processor 110 transmits the inspection result information to the server 200 via the communication device 120 (S16). The server 200 acquires the inspection result information from the management device 100, and updates the parcel information held by the server 200 based on the inspection result information. This allows the server 200 to hold parcel information that reflects the latest status of the parcels 50 under management.

[0061] The processor 110 issues a completion notification or a completion display indicating that the inspection of the package has been completed (S17). The processor 110 may transmit the completion notification to an external device (e.g., the server 200, or a mobile terminal held by an inspector or other worker) via, for example, the communication device 120. The processor 110 may output the completion notification by voice via, for example, a voice output device. The processor 110 may display the completion display via the display device 150.

[0062] According to such a process for reading the baggage code 55, the baggage inspection system 5, which cooperates with the management device 100, the camera 10, and the server 200, can inspect each baggage 50 by comparing the baggage information registered in the server 200 with the baggage information of the baggage 50 present on the pallet 60 as an inspection target, based on an image including the pallet code 65 and the baggage code 55 captured during inspection. Also, a user of the management device 100 can check the inspection result information on the display, which can be used for the inspection work.

[0063] 7 is a flowchart showing an example of an operation during a process of reading a package code by the management device 100. The process of reading the package code 55 corresponds to the process of S11 in FIG.

[0064] First, the camera 10 captures an overall image GA1 within the overall imaging range CA1. The overall image GA1 includes the baggage 50 to be inspected. The camera 10 transmits the overall image GA1 to the management device 100.

[0065] In the management device 100, the processor 110 acquires the entire image GA1 from the camera 10 via the communication device 120 (S21). The processor 110 recognizes the label 52 included in the entire image GA1 by performing image recognition on the entire image GA1. The processor 110 may recognize the label 52 by artificial intelligence (AI). In this case, the processor 110 may generate a trained model for recognizing the label 52 by deep learning using a neural network, for example, and store the trained model in the memory 130 or the like, and recognize the label 52 based on the entire image GA1 and the trained model.

[0066] The processor 110 recognizes the position of the label 52 by image recognition of the entire image GA1 (S22). The recognized position of the label 52 may be the region of the label 52, an arbitrary end point of the region of the label (e.g., the upper left corner), or the center position of the region of the label 52.

[0067] The processor 110 recognizes the position of the package code 55 relative to the overall image GA1 (S23). For example, the processor 110 acquires information on the position of the package code 55 relative to the label 52 stored in the memory 130. Then, the processor 110 recognizes the position of the package code 55 relative to the overall image GA1 based on the recognized position of the label 52 and the position of the package code 55 relative to the label 52.

[0068] The processor 110 identifies one or more reading areas PRα based on the position of the recognized baggage code 55 (S24). In this case, the processor 110 acquires preset area information from the memory 130. The processor 110 divides the entire image GA1 corresponding to the multiple preset areas PR. The processor 110 identifies the reading area PRα, which is one or more preset areas PR in which one or more baggage codes 55 are located, from among the multiple preset areas PR into which the entire image GA1 is divided.

[0069] For example, assume that the position of the baggage code 55 is obtained as coordinate information (e.g., (x, y) = 200, 50). In this case, the processor 110 can specify that the baggage code 55 is included in the coordinate range of (0, 0) to (300, 200), and therefore is included in, for example, the preset region PR1 in FIG. 3A or the preset region PR1A in FIG. 3B.

[0070] The processor 110 performs an acquisition process of one or more read images Gα based on the imaging conditions (also referred to as imaging conditions for reading) corresponding to the reading area PRα (S26). The imaging conditions for reading may also include preset area information related to the reading area PRα. The read image Gα (not shown) is an image that includes the reading area PRα in its image range, for example, the same range as the reading area PRα. The acquisition process of the read image Gα will be described in detail later.

[0071] The processor 110 performs a parcel code 55 reading process to read the parcel code 55 present in the read image Gα by image recognition, and obtains the parcel ID (S27). The processor 110 stores the read information (i.e., the parcel ID) obtained as a result of reading the parcel code 55 in the memory 130 (S28). Note that multiple parcel IDs may be obtained from one read image Gα. In other words, if multiple parcels 50 are located in the reading area PRα, multiple parcel IDs may be obtained. Note that the parcel code 55 reading process may fail to read the parcel code 55.

[0072] The processor 110 determines whether or not reading of the baggage code 55 has been completed for all scanned images Gα corresponding to the entire reading area PRα (S29). If there is a scanned image Gα for which reading of the baggage code has not been completed (No in S29), the processor 110 moves the image for which the baggage code 55 is to be read to the next scanned image Gα, and proceeds to the process of S27. That is, the processor 110 performs the processes of S27 and S28 while changing the image for which the baggage code 55 is to be read as necessary. On the other hand, if reading of the baggage code 55 has been completed for all scanned images Gα (Yes in S29), the process of FIG. 7 is terminated.

[0073] According to such a reading process of the baggage code 55, even if the size of the baggage code 55 is small (for example, about 10 mm), the management device 100 can read the baggage code 55 with a high probability by reading the baggage code 55 based on the read image Gα according to the imaging condition with a high zoom magnification. In addition, since the management device 100 can read the baggage code 55 only in the reading area PRα where the baggage code 55 exists, the reading time of the baggage code 55 can be shortened. In addition, when the reading process of the baggage code 55 is performed, the preset information is stored in the memory 130. Therefore, if the management device 100 obtains the imaging conditions corresponding to each reading area PRα from the memory 130, it is not necessary to adjust the imaging conditions anew, and therefore the reading time of the baggage code 55 can be shortened by eliminating the adjustment process of the imaging conditions. In addition, since the management device 100 can obtain the read image Gα derived based on the imaging conditions different for each reading area PRα, an image suitable for reading the baggage code 55 can be obtained as each read image Gα.

[0074] FIG. 8A is a diagram showing an example of a reading area PRα in the entire image GA1. One or more pieces of luggage 50 to be inspected are reflected in the overall image GA1. The image range (overall imaging range CA1) of the overall image GA1 is divided into a plurality of preset areas PR (16 in FIG. 8A). In FIG. 8A, at least a portion of the luggage 50 is reflected in all of the preset areas PR, but the reading area PRα in which the luggage code 55 is estimated to exist based on the position of the label 52, etc., is a part of the plurality of preset areas PR. In FIG. 8A, eight preset areas PR in two central rows in the X direction are specified as the reading areas PRα (PRα1 to PRα8). The management device 100 can obtain a read image Gα based on imaging conditions corresponding to this reading area PRα, and can read the luggage code 55.

[0075] FIG. 8B is a flowchart showing a first example of the process of acquiring the read-out image Gα. In the process of acquiring the read image Gα, the processor 110 of the management device 100 transmits the imaging conditions corresponding to the reading area PRα to the camera 10 via the communication device 120 (S26A). The camera 10 receives the imaging conditions corresponding to the reading area PRα from the management device 100.

[0076] When preset information is stored on the camera 10 side, the management device 100 may transmit information indicating necessary preset information, and the camera 10 may acquire the imaging conditions based on this information.

[0077] For example, when the camera 10 holds all information of the preset information (e.g., preset area information, image capture condition information, and lighting condition information) in the memory of the camera 10, the management device 100 may transmit information for identifying the reading area PRα (e.g., an identification number of the reading area PRα, or simply information indicating the position of the baggage code 55 relative to the entire image GA1) to the camera 10. In this case, the camera 10 may receive information for identifying the reading area PRα from the management device 100, refer to the preset information, and acquire position information of the reading area PRα and image capture condition information or lighting condition information, etc. based on the received information.

[0078] Furthermore, for example, when the camera 10 holds a portion of the preset information (for example, information on the imaging conditions or the lighting conditions for each preset area) in the memory of the camera 10, the management device 100 may refer to the preset information held in the memory 130 and transmit the identification information of the reading area PRα and the position information of the reading area PRα to the camera 10. In this case, the camera 10 may receive the identification information of the reading area PRα and the position information of the reading area PRα from the management device 100, and may refer to a portion of the preset information to acquire information on the imaging conditions or the lighting conditions corresponding to the identification information of the reading area PRα.

[0079] The camera 10 acquires a readout image Gα according to imaging conditions corresponding to the reading area PRα. The camera 10 transmits the acquired readout image Gα to the management device 100. The processor of the management device 100 receives the readout image Gα from the camera 10 via the communication device 120 (S26B).

[0080] The following two types of images are assumed as the read image Gα acquired by the camera 10. For example, the read image Gα may be a reference image obtained by changing the imaging conditions when the camera 10 captures the entire image GA1 to imaging conditions corresponding to the reading area PRα. In this case, the camera 10 does not capture new images after capturing the entire image GA1, and obtains, for example, a live view image. The read image Gα may also be an image newly captured by the camera 10 under imaging conditions corresponding to the reading area PRα, separate from the imaging of the entire image GA1.

[0081] According to this first example of the process for acquiring the read image Gα, the management device 100 can suppress deterioration of image quality due to enlargement of the overall image GA1, etc., without relying on the image quality of the overall image GA1, and can acquire an image captured by the camera 10 applying imaging conditions corresponding to the reading area PRα, thereby obtaining an image that makes it easy to read the baggage code 55.

[0082] FIG. 8C is a flowchart showing a second example of the process of acquiring the read-out image Gα. In the acquisition process of the read image Gα, the processor 110 generates the read image Gα based on the imaging conditions corresponding to the reading area PRα and the entire image GA1 (S26C). In this case, the processor 110 may generate the read image Gα by processing a partial image corresponding to the reading area PRα in the entire image GA1 according to image processing conditions corresponding to the imaging conditions corresponding to the reading area PRα. For example, the processor 110 may determine the size of the read image Gα in response to the zoom information, may sharpen or blur the read image Gα in response to the focus information, or may adjust the brightness of the read image Gα in response to the lighting conditions.

[0083] According to this second example of the process for acquiring the read image Gα, the management device 100 can generate a read image Gα for each reading area PRα through image processing, thereby eliminating the need to repeatedly change the imaging conditions such as zoom or focus each time the camera 10 captures the read image Gα, thereby shortening the time required to acquire the read image Gα.

[0084] FIG. 9 is a flowchart showing an example of the operation of management device 100 during the process of acquiring a pallet ID.

[0085] The processor 110 recognizes the position of the palette code 65 relative to the entire image GA1 (S31). For example, the processor 110 performs image recognition on the entire image GA1 to recognize the palette 60 included in the entire image GA1, and recognizes the position of the palette 60 relative to the entire image GA1. The processor 110 acquires information on the position of the palette code 65 relative to the palette 60 stored in the memory 130. Then, the processor 110 recognizes the position of the palette code 65 relative to the entire image GA1 based on the recognized position of the palette 60 and the position of the palette code 65 relative to the palette 60.

[0086] The processor 110 performs image recognition on the palette code 65 whose position has been recognized, attempts to read the palette code (S32), and determines whether or not reading the palette code 65 has been successful (S33). If reading the palette code 65 by image recognition is successful, the processor 110 stores the read information (i.e., the palette ID) obtained as a result of reading the palette code 65 in the memory 130, and ends the processing of FIG.

[0087] On the other hand, if the reading of the pallet code 65 by the image recognition fails, the processor 110 acquires from the memory 130 one or more parcel IDs obtained by the reading process of the parcel code 55. The processor 110 acquires a pallet ID based on the acquired one or more parcel IDs (S34). In this case, for example, the processor 110 transmits one or more parcel IDs to the server 200 via the communication device 120. The server 200 receives one or more parcel IDs from the management device 100. The server 200 refers to one or more pieces of pallet information associated with the parcel information including one or more parcel IDs, which is held in the memory of the server 200. Then, the server 200 acquires a pallet ID included in each of the one or more pieces of pallet information that have been referenced, and transmits the acquired one or more pallet IDs to the management device 100. The processor 110 of the management device 100 acquires the one or more pallet IDs from the server 200 via the communication device 120.

[0088] The processor 110 determines whether the pallet ID has been uniquely identified based on the one or more acquired pallet IDs (S35). For example, when the number of acquired pallet IDs is one, or when the one or more acquired pallet IDs are the same (common) pallet ID, the processor 110 identifies the pallet ID corresponding to the pallet code 65 as this pallet ID, and determines that the pallet ID has been uniquely identified. On the other hand, when the acquired multiple pallet IDs are different pallet IDs, the processor 110 determines that the pallet code 65 has not been uniquely identified.

[0089] The processor 110 may use the package ID to inquire of the server 200, obtain from the server 200 the result of the server 200's guess of the pallet ID, and use this as a uniquely specified pallet ID. The processor 110 may also store the pallet information and package information stored by the server 200 in the memory 130, and complete the processes of S34 and S35 within the management device 100 without cooperating with the server 200.

[0090] If it is determined that the palette ID has been uniquely identified (Yes in S35), the processor 110 stores the uniquely identified palette ID in the memory 130, and ends the processing of FIG.

[0091] On the other hand, if it is determined that the palette ID has not been uniquely identified (No in S35), the processor 110 manually inputs a palette ID via the operation device 140 (S36). In this case, the operation device 140 directly inputs a palette ID, or accepts an operation to select a specific palette ID from one or more palette IDs. Then, the processor 110 stores the manually input palette ID in the memory 130, and ends the processing in FIG. 9.

[0092] According to such a pallet ID acquisition process, the management device 100 can acquire the pallet ID with a high probability by various methods (e.g., image recognition, guessing based on the baggage ID, manual input). Therefore, the management device 100 can increase the probability that the baggage inspection process can proceed smoothly.

[0093] (Example of inspection results) 10 is a diagram showing a first example of an inspection result display screen. The inspection result display screen G11 is a screen that displays information obtained as a result of the inspection process of the package 50 to which the label 52 is affixed. The inspection result display screen G11 is displayed by the display device 150.

[0094] The inspection result display screen G11 includes information on the pallet ID of the pallet 60 on which the luggage 50 to be inspected is placed, the overall images of each side of the luggage 50 captured by each camera 10 (here, the overall front image, the overall rear image, the overall left image, and the overall right image), the overall inspection result, and the detailed inspection result. The overall front image is an overall image captured by the front camera. The overall rear image is an overall image captured by the rear camera. The overall left image is an overall image captured by the left camera. The overall right image is an overall image captured by the right camera. The overall inspection result is information indicating the number of luggage with an inspection result of OK (e.g., "90") relative to the number of luggage to be inspected (the number of registered luggage IDs, e.g., "92"), and may be calculated by the processor 110. The detailed inspection result includes an inspection ID for identifying the inspection, a check box used by the user, and a registered luggage ID. The registered luggage ID is a luggage ID registered (held) as part of luggage information in the server 200. Furthermore, the inspection result display screen G11 also displays a save result button B11, a cancel button B12, and a scroll bar B13.

[0095] In the table of detailed inspection results in FIG. 10, a first pattern is applied to the background of the individual inspection results of the parcels corresponding to the inspection ID "1". The first pattern indicates that the label 52 was recognized and the parcel code 55 was not read in the parcel 50 inspected with the inspection ID "1". A second pattern is applied to the background of the individual inspection results of the parcels corresponding to the inspection ID "2". The second pattern indicates that the label 52 was recognized and the parcel code 55 was successfully read in the parcel 50 inspected with the inspection ID "2", but the parcel should not be placed on the pallet 60. The individual inspection results of the parcels corresponding to the inspection IDs "3" and later are shown as plain without a pattern. The plain pattern indicates that the label 52 was recognized and the parcel code 55 was successfully read in the parcels 50 inspected with the inspection IDs "3" and later, and the parcel should be placed on the pallet 60.

[0096] In the overall image of each side of the package 50 displayed on the inspection result display screen G11, if a label 52 is recognized, it is displayed by a label frame 53 (53A, 53B, 53C, ...). The label frame 53 is attached to the position (area) of the recognized label 52, and is shown by a rectangular frame on the inspection result display screen G11. Note that even if a label 52 exists, if the label 52 is not recognized, the label frame 53 is not displayed for this label 52.

[0097] The processor 110 may determine the display mode of the label frame 53 based on the result of comparing the registered baggage ID with the baggage ID of the baggage to be inspected or the result of reading the baggage code 55. In other words, the display mode of the label frame 53 may indicate various results related to the inspection of the baggage 50.

[0098] For example, when the label 52 is recognized and the registered baggage ID matches the baggage ID of the inspection target, the processor 110 may display the label frame 53A via the display device 150 in a display manner indicating that the inspection result is OK (for example, a thick solid frame in FIG. 10). This allows the user to easily confirm the position of the label 52 corresponding to the baggage 50 whose inspection result was OK by checking the display of the label frame 53A.

[0099] For example, when the label 52 is recognized and the registered baggage ID and the baggage ID of the inspection target do not match, the processor 110 may display the label frame 53B via the display device 150 in a display manner indicating that the inspection result is NG (for example, a thick dashed line frame in FIG. 10). The display of the label frame 53B is one of the error displays (display of warning information). This allows the user to easily confirm the position of the label 52 attached to the baggage 50 corresponding to the baggage code 55 whose inspection result was NG by checking the display of the label frame 53B. Therefore, the user can take action such as, for example, going to the inspection location and individually checking in detail the baggage 50 corresponding to the baggage ID whose inspection result was NG.

[0100] For example, when the label 52 is recognized but the reading of the baggage code 55 fails, the processor 110 may display the label frame 53C via the display device 150 in a display manner (for example, a thick dashed frame in FIG. 10) indicating that the reading of the baggage code 55 has failed. The display of the label frame 53C is one of the error displays. This allows the user to easily confirm the position of the label 52 attached to the baggage 50 corresponding to the baggage code 55 that has failed to be read, by checking the display of the label frame 53C. Therefore, the user can take measures such as, for example, going to the inspection position and individually reading the baggage code 55 that has failed to be read using a portable handheld terminal.

[0101] The processor 110 also displays, as a detailed inspection result, via the display device 150, information on the presence or absence of a parcel ID to be inspected that corresponds to the registered parcel ID. In this case, the processor 110 may display, via the display device 150, a registered parcel ID for which the inspection result is OK and a registered parcel ID for which the inspection result is NG in different display modes, similar to the display of the entire image of each side of the parcel 50. In this case, the user can easily check at a glance the registered parcel ID for which the inspection result is NG from the registered parcel ID in the list included in the detailed inspection result. Note that the processor 110 may display, as a detailed inspection result, a parcel ID to be inspected that does not correspond to the registered parcel ID. In this case, the parcel ID to be inspected may be displayed in a different display mode from the registered parcel ID for which the inspection result is OK and the registered parcel ID for which the inspection result is NG. In this case, the user can easily check that there is a parcel 50 for which parcel information is not registered in the server 200.

[0102] Fig. 11 is a diagram showing a first example of an inspection result display screen. The inspection result display screen G12 is a screen that displays information obtained as a result of the inspection process of the luggage 50 that does not have a label 52 attached. The inspection result display screen G12 is displayed by the display device 150. Note that in the inspection result display screen G12 of Fig. 11, explanations of matters similar to those in the inspection result display screen G11 of Fig. 10 will be omitted or simplified.

[0103] The inspection result display screen G12, like the inspection result display screen G11 shown in FIG. 10, includes information such as the pallet ID, overall images of each side of the luggage 50 captured by each camera 10, overall inspection results, and detailed inspection results.

[0104] In the table of detailed inspection results in FIG. 11, a third pattern is applied to the background of the individual inspection results of the parcels corresponding to the inspection ID "1". The third pattern indicates that the parcels 50 inspected with the inspection ID "1" were recognized, but the parcel code 55 failed to be read. Furthermore, a fourth pattern is applied to the background of the individual inspection results of the parcels corresponding to the inspection ID "2". The fourth pattern indicates that the parcels 50 inspected with the inspection ID "2" were recognized, and the parcel code 55 was successfully read, but the parcels should not be placed on the pallet 60. Furthermore, the individual inspection results of the parcels corresponding to the inspection IDs "3" and subsequent numbers are shown as plain without any pattern applied to the background. The plain pattern indicates that the parcels 50 inspected with the inspection IDs "3" and subsequent numbers were recognized, and the parcel code 55 was successfully read, and the parcels should be placed on the pallet 60.

[0105] In the overall image of each side of the luggage 50 displayed on the inspection result display screen G12, if the luggage 50 is recognized, it is displayed by a luggage frame 51 (51A, 51B, 51C, ...). The luggage frame 51 is attached to the position (area) of the recognized luggage 50, and is shown by a rectangular frame on the inspection result display screen G12. Note that even if the luggage 50 exists, if the luggage 50 is not recognized, the luggage frame 51 is not displayed for this luggage 50.

[0106] The processor 110 may determine the display mode of the luggage frame 51 based on the result of comparing the registered luggage ID with the luggage ID of the inspection target, the result of reading the luggage code 55, or the like. In other words, the display mode of the luggage frame 51 may indicate various results related to the inspection of the luggage 50.

[0107] For example, when the luggage 50 is recognized and the registered luggage ID matches the luggage ID of the inspection target, the processor 110 may display the luggage frame 51A via the display device 150 in a display manner indicating that the inspection result is OK (for example, a thick solid frame in FIG. 11). This allows the user to easily confirm the location of the luggage 50 for which the inspection result was OK by checking the display of the luggage frame 51A.

[0108] For example, when the processor 110 recognizes the luggage 50 and the registered luggage ID and the luggage ID of the inspection target do not match, the processor 110 may display the luggage frame 51B via the display device 150 in a display manner indicating that the inspection result is NG (for example, a thick dashed line frame in FIG. 11). The display of the luggage frame 51B is one of the error displays. This allows the user to easily confirm the location of the luggage 50 corresponding to the luggage code 55 for which the inspection result was NG by checking the display of the luggage frame 51B. Therefore, the user can take action such as, for example, going to the inspection location and individually checking in detail the luggage 50 corresponding to the luggage ID for which the inspection result was NG.

[0109] For example, when the luggage 50 is recognized but the luggage code 55 fails to be read, the processor 110 may display the luggage frame 51C via the display device 150 in a display manner (for example, a thick dashed frame in FIG. 11) indicating that the luggage code 55 has failed to be read. The display of the luggage frame 51C is one of the error displays. This allows the user to easily confirm the position of the luggage 50 corresponding to the luggage code 55 that has failed to be read by checking the display of the luggage frame 51C. Therefore, the user can take measures such as going to the inspection position and individually reading the luggage code 55 that has failed to be read using a portable handheld terminal.

[0110] By checking the inspection result information displayed on the inspection result display screens G11, G12, etc., the user of the management device 100 can recognize the shortage of luggage 50, the presence of luggage 50 with unknown contents, and the location of these luggage 50, etc., thereby reducing the burden associated with inspection. Furthermore, the user does not need to go to each of the luggage 50 for which the inspection result is OK based on the image captured by the camera 10, and inspect them using a handheld terminal, etc. Furthermore, the user only needs to go to each of the luggage 50 for which the inspection result is NG or the luggage cannot be read, and inspect them using a handheld terminal, etc. Therefore, the luggage inspection system 5 can reduce the effort and time required for the user's inspection work.

[0111] The management device 100 may transmit the inspection result information on the inspection result display screens G11, G12, etc. via the server 200 or another terminal, etc., and display the inspection result information on the server 200 or another terminal, etc. Also, the management device 100 displays a rectangular frame for the label 52 on the inspection result display screen G11, and a rectangular frame for the luggage 50 on the inspection result display screen G12, but may also display a rectangular frame for other codes such as a luggage code or a pallet code. In this way, the management device 100 can assist in easily finding the position of the label.

[0112] As described above, the management device 100 (an example of a baggage inspection device) of this embodiment is a device for inspecting baggage 50, and includes a processor 110. The processor 110 causes the camera 10 to capture an entire image GA1 so that the entire baggage 50 to be inspected is captured. The processor 110 causes the memory 130 to store imaging conditions for each of a plurality of preset areas PR constituting the image range of the entire image GA1. The processor 110 identifies the position of a baggage code 55 (an example of a code) that can identify the baggage 50 and is attached to the outer surface of the baggage 50 from the entire image GA1. The processor 110 obtains a read image Gα (an example of an image) based on the imaging conditions of the preset area PR that corresponds to the position of the identified baggage code 55. The processor 110 reads the baggage code 55 based on the read image.

[0113] As a result, the management device 100 can determine imaging conditions suitable for reading the baggage code 55 for each preset area PR before capturing the entire image GA1, and can capture the baggage 50 according to the imaging conditions. Therefore, even if the distance between the camera 10 and the baggage code 55 of each baggage 50 differs for each baggage 50, and the imaging direction for capturing the baggage code 55 of each baggage 50 by the camera 10 differs for each baggage 50, the management device 100 can improve the reading accuracy of the baggage code 55 regardless of the position of the baggage code 55 relative to the entire image GA1. Furthermore, compared to a case in which the imaging conditions of the camera 10 are set each time according to the position of each baggage code 55 relative to the entire image GA1 in order to read each baggage code 55 attached to each baggage 50, the management device 100 has imaging conditions for each preset area PR determined in advance. Therefore, the management device 100 can reduce the time required to read each baggage code 55, and therefore the time required to inspect the baggage 50. Furthermore, the management device 100 can acquire a scanned image Gα that is compatible with the imaging conditions of the preset region PR in which the baggage code 55 is certainly present. Therefore, the management device 100 can read the baggage code 55 more efficiently than when acquiring images that are compatible with the imaging conditions for all the preset regions PR, and can shorten the time required to complete reading of all the baggage codes 55.

[0114] In addition, the processor 110 may notify the camera 10 of the imaging conditions for reading (an example of the imaging conditions) via, for example, the communication device 120, and acquire, for example, via the communication device 120, the read image Gα obtained by the camera 10 in accordance with the imaging conditions for reading.

[0115] As a result, the management device 100 acquires the scanned image Gα under imaging conditions different from those used when capturing the entire image GA1, and therefore an image in which the baggage code 55 is easy to read can be obtained.

[0116] Furthermore, the processor 110 may generate the read image Gα by processing a partial image corresponding to the read area PRα of the entire image GA1 based on the imaging conditions for reading corresponding to the read area PRα.

[0117] This allows the management device 100 to obtain a read image Gα (a read image Gα as if it were captured under the imaging conditions) according to the imaging conditions corresponding to the reading area PRα by electronically processing the entire image GA1. Therefore, since no data communication occurs between the management device 100 and the camera 10, the time required to obtain the read image Gα can be shortened.

[0118] Furthermore, adjacent preset regions PR1A, PR3A among the multiple preset regions PR may partially overlap.

[0119] As a result, even if the baggage code 55 is located near the edge of the preset area PR of the overall image GA1, the management device 100 performs the reading process of the baggage code 55 based on the read image Gα obtained under the imaging conditions of any of the adjacent preset areas PR, thereby improving the reading accuracy.

[0120] Furthermore, when the position of the baggage code 55 is included in at least two of the adjacent preset regions PR, the processor 110 may select, as the reading region PRα, the preset region PR in which the distance between the position P1 (e.g., the center position) of the baggage code 55 and the center position PRO of the preset region PR is the shortest. Then, the processor 110 may read the baggage code 55 based on the read image Gα based on the imaging conditions of the reading region PRα.

[0121] The closer the position of the baggage code 55 is to the center position of the preset area PR, the higher the reading accuracy becomes. Therefore, the management device 100 performs the reading process based on the read image Gα obtained under the imaging conditions of the preset area PR in which the distance between the center position of the baggage code 55 and the center position PRO of the preset area PR is the shortest, thereby improving the reading accuracy.

[0122] Furthermore, the information on the imaging conditions may include zoom information related to the zoom when imaging by the camera 10, focus information related to the focus when imaging by the camera 10, or information on the lighting conditions when imaging by the camera 10.

[0123] This allows the administration device 100 to determine parameters relating to imaging that are expected to affect reading before capturing the entire image GA1.

[0124] Moreover, the overall image GA1 may include a pallet code 65 capable of identifying a pallet 60 (an example of a loading platform) on which the luggage 50 is placed. The processor 110 may read the pallet code 65 and identify the pallet 60. The processor 110 may obtain information about the luggage 50 that should be on the identified pallet 60. The processor 110 may inspect the luggage 50 by comparing a luggage ID (an example of first luggage information) of the inspection target, which is information about the luggage 50 corresponding to the read luggage code 55, with a registered luggage ID (an example of second luggage information), which is information about the luggage 50 that should be on the pallet 60. Note that, although the first luggage information and the second luggage information are illustrated here as luggage IDs, the information about the luggage may be information about the luggage other than the luggage ID.

[0125] This allows the management device 100 to, for example, determine whether the cargo 50 that is to be placed on the pallet 60 is actually placed thereon, and to inspect the cargo 50.

[0126] In addition, the processor 110 may perform image recognition on the overall image GA1 to determine whether or not the pallet code 65 has been successfully read, and if the pallet code 65 has not been successfully read, may obtain the pallet ID corresponding to the pallet code 65 based on the parcel ID of the parcel to be inspected which corresponds to the parcel code 55 attached to each of the multiple parcels 50 to be inspected.

[0127] As a result, even if the management device 100 fails to read the pallet code 65 using image recognition, it can estimate the pallet ID corresponding to the pallet code 65 based on the parcel ID of the inspection target that corresponds to the parcel code 55 that was successfully read, and can obtain the registered parcel ID that is associated with the pallet ID.

[0128] Furthermore, the memory 130 may hold information on the position of the baggage code 55 for each of the pieces of luggage 50. The processor 110 may recognize the position of the baggage 50 relative to the overall image GA1 based on the overall image GA1, and calculate the position of the baggage code 55 relative to the overall image GA1 based on the position of the baggage 50.

[0129] This allows the management device 100 to derive the position of the package code 55 based on the position of the package 50.

[0130] Furthermore, the memory 130 may hold information on the position of the baggage code 55 relative to the label 52 to which the baggage code 55 is attached. The processor 110 may recognize the position of the label 52 relative to the overall image GA1 based on the overall image GA1, and calculate the position of the baggage code 55 relative to the overall image GA1 based on the position of the label 52.

[0131] This allows the management device 100 to derive the position of the baggage code 55 based on the position of the label 52.

[0132] In addition, when the position of the luggage 50 is recognized but reading of the luggage code 55 fails, the processor 110 may cause the display device 150 to display a luggage frame 51C (an example of first warning information) indicating that reading of the luggage code 55 based on the luggage 50 has failed.

[0133] This allows the user of the management device 100 to recognize that the reason for the NG inspection result is that the reading of the package code 55 based on the package failed.

[0134] In addition, when the position of the label 52 is recognized but reading of the luggage code 55 fails, the processor 110 may cause the display device 150 to display a label frame 53C (an example of second warning information) indicating that reading of the luggage code 55 based on the label 52 has failed.

[0135] This allows the user to recognize that the reason for the NG inspection result is a failure to read the baggage code 55 based on the label 52.

[0136] In addition, when the position of the luggage 50 is recognized and the luggage code 55 is successfully read, and the registered luggage ID and the luggage ID of the luggage subject to inspection are different, the processor 110 may cause the display device 150 to display luggage frame 51B (an example of third warning information) indicating that the registered luggage ID and the luggage ID of the luggage subject to inspection are different in a display mode different from that of luggage frame 51C.

[0137] This allows the user to easily determine whether the reason for the inspection result being NG is a failure to read the baggage code 55 based on the baggage 50, or a mismatch between the baggage ID of the inspection target and the registered baggage ID.

[0138] In addition, when the position of the label 52 is recognized and the parcel code 55 is successfully read, and the registered parcel ID and the parcel ID of the parcel to be inspected are different, the processor 110 may cause the display device 150 to display a label frame 53B (an example of fourth warning information) indicating that the registered parcel ID and the parcel ID of the parcel to be inspected are different in a display manner different from that of the label frame 53C.

[0139] This allows the user to easily determine whether the reason for the inspection result being NG is due to failure to read the baggage code 55 based on the label 52, or due to a mismatch between the baggage ID of the item to be inspected and the registered baggage ID.

[0140] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or amended examples within the scope of the claims, and it is understood that these also naturally belong to the technical scope of the present invention. In addition, the components in the above-mentioned embodiments may be arbitrarily combined within the scope of the invention.

[0141] In the above embodiment, the whole image GA1 for determining the preset information and the whole image GA1 for inspecting the baggage 50 are the same as each other, but this is not limited to the above. In other words, the whole image GA1 for determining the preset information and the whole image GA1 for inspecting the baggage 50 may be different images.

[0142] In the above embodiment, the processor may be physically configured in any way. If a programmable processor is used, the processing contents can be changed by changing the program, so that the degree of freedom in processor design can be increased. The processor may be configured as one semiconductor chip, or may be physically configured as multiple semiconductor chips. When configured as multiple semiconductor chips, each control in the above embodiment may be realized by a different semiconductor chip. In this case, it can be considered that the multiple semiconductor chips constitute one processor. The processor may be configured as a semiconductor chip and a member (such as a capacitor) having a different function. A single semiconductor chip may be configured to realize the functions of the processor and other functions. A single processor may also be configured as multiple processors. [Industrial Applicability]

[0143] The present disclosure is useful for a luggage inspection device, a luggage inspection system, a luggage inspection method, a program, etc., which can improve the reading accuracy of codes attached to the outer surface of luggage and can improve the inspection accuracy of luggage. [Explanation of symbols]

[0144] 5. Baggage Inspection System 10. Camera 20 Concentrator 30 Lighting Equipment 50 Baggage 51, 51A, 51B, 51C Luggage compartment 52 Label 53, 53A, 53B, 53C Label frame 55 Baggage Code 60 palettes 65 Pallet Code 100 Management device 110 Processor 120 Communication Devices 130 Memory 140 Operation Device 150 Display Devices 200 Servers G11, G12 inspection result display screen GA1 Overall Image PR Preset Area PRα1~PRα8 reading region

Claims

1. A baggage inspection device for inspecting baggage, A processor is provided. The processor, The camera captures a specific area of ​​the baggage to be inspected, storing imaging conditions for each of the one or more preset regions constituting the specific imaging range in a memory; Identifying a position of a code attached to an outer surface of the package from the specific imaging range, the code being capable of identifying the package; Acquire an image based on the imaging conditions of the preset area corresponding to the identified position of the code; reading the code based on the image; Baggage inspection equipment.

2. The processor, notifying the camera of the imaging conditions; acquiring the image based on the imaging conditions of the preset area obtained by the camera according to the imaging conditions; The baggage inspection device according to claim 1.

3. The processor, generating the image by processing a partial image corresponding to the preset region of the specific imaging range based on the imaging condition corresponding to the preset region; The baggage inspection device according to claim 1.

4. When the position of the code is included in at least two of the adjacent preset regions, the processor reads the code based on the image based on an imaging condition of a preset region among the adjacent preset regions in which a distance between a center position of the code and a center position of the preset region is shortest. The baggage inspection device according to claim 1.

5. The information on the imaging conditions includes zoom information regarding zoom when imaging by the camera, focus information regarding focus when imaging by the camera, or information on lighting conditions when imaging by the camera. The baggage inspection device according to any one of claims 1 to 4.

6. the specific imaging range includes a pallet code capable of identifying a loading platform on which the baggage is placed, The processor, Reading the pallet code and identifying the loading platform; Obtaining information about the baggage that should be present on the identified loading platform; inspecting the luggage by comparing first luggage information, which is information about the luggage corresponding to the read code, with second luggage information, which is information about the luggage that should be present on the loading platform; A baggage inspection device according to any one of claims 1 to 5.

7. The first baggage information and the second baggage information include the number of bags and a baggage ID.

7. The baggage inspection device according to claim 6.

8. The processor, performing image recognition on the specific imaging range to determine whether or not the pallet code has been successfully read; If the reading of the pallet code fails, information on the loading platform corresponding to the pallet code is obtained based on the first package information corresponding to the code attached to each of the plurality of packages to be inspected.

8. A baggage inspection device according to claim 7.

9. the memory holds information about the location of the code for each of the packages; The processor, Based on the specific imaging range, a position of the package relative to the specific imaging range is recognized; calculating a position of the code relative to the particular imaging range based on the position of the package; 9. A baggage inspection device according to claim 7 or 8.

10. the memory holds information about the position of the code relative to a label to which the code is attached; The processor recognizes a position of the label relative to the particular imaging range based on the particular imaging range; calculating a position of the code relative to the particular imaging range based on the position of the label; 9. A baggage inspection device according to claim 7 or 8.

11. When the location of the package is recognized and the code reading fails, the processor causes a display device to display first warning information indicating that the code reading based on the package has failed. The baggage inspection device according to claim 9.

12. and when the position of the label is recognized and the reading of the code is unsuccessful, the processor causes a display device to display second warning information indicating a failure to read the code based on the label. The baggage inspection device according to claim 10.

13. when the location of the package is recognized and the code is successfully read, and the first package information and the second package information are different, the processor causes the display device to display third warning information indicating that the first package information and the second package information are different in a display manner different from that of the first warning information. The baggage inspection device according to claim 11.

14. when the position of the label is recognized and the code is successfully read, and when the first package information and the second package information are different, the processor causes the display device to display fourth warning information indicating that the first package information and the second package information are different in a display manner different from that of the second warning information. The baggage inspection device according to claim 12.

15. A baggage inspection method for inspecting baggage, comprising: A step of causing a camera to capture an image of a specific imaging range of a package to be inspected; storing in a memory imaging conditions for each of one or more preset areas constituting an image range of the specific imaging range; determining a position of a code attached to an outer surface of the package from the specific imaging range, the code being capable of identifying the package; acquiring an image based on an imaging condition of the preset area corresponding to the identified position of the code; reading the code based on the image; A baggage inspection method comprising the steps of:

16. A program for causing a computer to execute the baggage inspection method described in claim 15.

Images