Baggage inspection device

Abstract

To associate a transmission image photographed at an appropriate timing regardless of the state of a baggage with an image of a baggage.SOLUTION: An appearance image acquisition unit 402 repeatedly photographs and acquires with a camera an appearance image of a baggage passing through a visible-light photographing area. A transmission image acquisition unit 403 repeatedly photographs and acquires with an inspection device a transmission image of the baggage passing through a transmission photographing area. An arrival time specifying unit 404 specifies a time at which the baggage reaches the transmission photographing area as a first arrival time and specifies a time at which the baggage reaches the baggage visible-light photographing area as a second arrival time. An image associating unit 405 associates the appearance image of the baggage 2 photographed with the camera at the specified second arrival time with the transmission image of the baggage photographed with the inspection device at the specified first arrival time. An image display unit 406 displays both the appearance image and the transmission image associated with each other.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a technique for inspecting luggage. [Background technology]

[0002] As a technology for inspecting luggage, Patent Document 1 discloses a technology for performing efficient luggage inspection by moving a luggage floor board moving along a luggage lane and a people floor board moving along a people lane at approximately the same speed.

[0003] [Patent Document 1] JP 2019-11981 A Summary of the Invention [Problem to be solved by the invention]

[0004] For example, when inspecting luggage by taking an X-ray transmission image, even if a luggage is judged to need manual reinspection from the transmission image, it may be difficult to determine which luggage is actually indicated by the transmission image if similar luggage are transported one after another. Therefore, it is conceivable that a sensor could be used to detect the timing of the luggage being transported, photograph the luggage, and display it together with the transmission image to make it easier to identify the luggage that needs reinspection, but luggage comes in various shapes, and some luggage has an irregular shape, so the sensor may detect the luggage too early or too late and not be able to take the transmission image at the appropriate time. In view of the above background, an object of the present invention is to associate a transmission image captured at an appropriate timing with an image of the luggage, regardless of the state of the luggage. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the present invention provides, in a first aspect, a baggage inspection device that determines the time at which the baggage reaches an imaging area downstream of a specified area on the baggage conveying path based on the time at which the baggage reaches the specified area on the baggage conveying path, and matches a transmitted image of the baggage captured during a period corresponding to the determined time with an image of the baggage captured by a visible light camera at the time the baggage reaches the specified area.

[0006] According to the baggage inspection device of the first aspect, it is possible to associate a transmission image captured at an appropriate timing with an image of the baggage regardless of the state of the baggage.

[0007] In the baggage inspection device of the first aspect described above, a second aspect may be adopted in which the specified area is repeatedly photographed by the visible light camera, and if the baggage is recognized from the central area of ​​the image captured by the visible light camera, the time the image was captured is identified as the time the baggage arrived at the specified area.

[0008] According to the baggage inspection device of the second aspect, it is possible to improve the accuracy of identifying the time when the baggage reaches a specified area, compared to when identification is performed based on the time when the edge of the baggage reaches the specified area.

[0009] In the baggage inspection device of the first aspect described above, a configuration may be adopted as a third aspect in which the time when the baggage reaches the specified area is determined based on the period during which a sensor that detects the presence of an object in the specified area detects the object.

[0010] According to the baggage inspection device of the third aspect, even if the baggage is difficult to recognize from the captured image, it is possible to identify the time when the baggage arrived at the predetermined area.

[0011] In the baggage inspection device of the first aspect described above, a configuration may be adopted as a fourth aspect in which the device is provided with a mechanism for bringing the portion of the baggage extending outward from the main body upstream of the specified area closer to the main body.

[0012] According to the baggage inspection device of the fourth aspect, compared to a case in which the mechanism of the present invention is not provided, it is possible to ensure that the entire baggage is captured in a transmitted image, while making it easier for key parts of the baggage to be captured in an image captured in a specified area. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram illustrating an external appearance of an entrance inspection system according to an embodiment. [Diagram 2] FIG. 1 is a diagram showing a functional configuration realized in this embodiment. [Diagram 3] FIG. 1 is a diagram illustrating an example of a reference position and a central region. [Figure 4] A diagram showing an enlarged view of the transmitted light shooting area and the visible light shooting area. [Diagram 5] FIG. 13 is a diagram illustrating an example of a displayed appearance image and a transmitted image. [Figure 6] FIG. 13 is a diagram illustrating an example of an operation of a control device in association processing. [Figure 7] FIG. 1 is a diagram illustrating an example of a captured exterior image. [Figure 8] FIG. 13 is a diagram illustrating an example of a central region of a modified example of luggage. [Figure 9] FIG. 1 is a diagram illustrating an example of an image in a transmission photography area. [Figure 10] FIG. 1 shows a modified entrance inspection system. [Figure 11] FIG. 1 shows a modified example of an entrance inspection system. [Figure 12] FIG. 1 is a diagram illustrating an example of an object detection situation. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] [1] First Example Fig. 1 shows the appearance of an entrance inspection system 1 according to an embodiment. Fig. 1(a) shows the entrance inspection system 1 as viewed vertically from above, and Fig. 1(b) shows the entrance inspection system 1 as viewed horizontally.

[0015] The entrance inspection system 1 is a system for inspecting whether or not visitors have brought in prohibited items (prohibited items), such as knives, at the entrance to an event venue, for example. The entrance inspection system 1 is an example of the "inspection system" of the present invention. The entrance inspection system 1 inspects, for example, baggage 2 shown in FIG. 1. The entrance inspection system 1 is used by an inspector 3 who performs work related to the inspection.

[0016] The entrance inspection system 1 includes a conveying device 10, an inspection device 20, a camera 30, and a control device 40. The conveying device 10 is a belt conveyor that conveys baggage 2 in a conveying direction A1, and forms a conveying path B1. In the entrance inspection system 1, an inspector 3 is positioned on either the left or right side of the conveying path B1, and an inspection lane through which holders of baggage 2 pass is provided on the opposite side to the inspector 3.

[0017] The inspection device 20 is a device that captures a transmitted image of a baggage being transported. The transmitted image is an image used for inspecting baggage. The inspection device 20 irradiates electromagnetic waves onto the baggage 2 passing through a transmitted image capture area B2 within the device, for example, and generates a transmitted image of the baggage 2 that is depicted with shading according to the intensity of the electromagnetic waves that have transmitted through the baggage 2. The electromagnetic waves that the inspection device 20 irradiates onto the baggage 2 are electromagnetic waves in a frequency band that penetrate the baggage 2 but have different transmittance depending on the material of the contents of the baggage 2, such as X-rays.

[0018] A camera 30 is provided vertically above the entrance side of the inspection device 20. The camera 30 has an image sensor that detects visible light, and captures an object represented by visible light. The camera 30 is provided so that a visible light photography area B3, which is defined upstream of a transmission photography area B2 defined on the conveying path B1, is included in the angle of view. The camera 30 repeatedly captures, in visible light, an appearance image showing the appearance of the baggage 2 conveyed by the conveying device 10 and passing through the visible light photography area B3. The camera 30 is an example of a "visible light camera" of the present invention, and the visible light photography area B3 is an example of a "predetermined area" of the present invention.

[0019] The control device 40 is a device that controls the operation of each device included in the entrance inspection system 1. The control device 40 is a computer equipped with a processor such as a CPU (Central Processing Unit), memory, storage, a communication unit, etc. The control device 40 is electrically connected to the transport device 10, the inspection device 20, and the camera 30 via wiring (not shown). The control device 40 controls the operation of each device while exchanging data with each device that is electrically connected to it.

[0020] The control device 40 is also connected to a display and displays an image on the display. The control device 40 loads a predetermined software (program) onto hardware such as a memory, and the processor performs calculations to control communication by each communication device and / or control reading and writing of data in the memory and storage, thereby realizing the functions shown in FIG.

[0021] 2 shows the functional configuration realized by the control device 40. The control device 40 includes a transport control unit 401, an external image acquisition unit 402, a transmission image acquisition unit 403, an arrival time identification unit 404, an image matching unit 405, and an image display unit 406. The transport control unit 401 controls the transport of the baggage 2 by the transport device 10. The transport control unit 401 starts and ends the transport of the baggage 2 based on, for example, the operation of the inspector 3.

[0022] After conveyance starts, the conveyor control unit 401 rotates the belt conveyor so that the conveyance speed becomes a predetermined conveyance speed or a conveyance speed set by the inspector 3. The conveyor control unit 401 notifies the arrival time identifying unit 404 of the conveyance speed being controlled. The appearance image acquiring unit 402 controls the camera 30 to repeatedly capture the visible light photography area B3 and acquires an appearance image of the baggage 2 passing through the visible light photography area B3. The appearance image acquiring unit 402 supplies the acquired appearance image to the arrival time identifying unit 404.

[0023] The transmitted image acquiring unit 403 controls the inspection device 20 to repeatedly capture images of the transmitted photography area B2 and acquires transmitted images of the luggage 2 passing through the transmitted photography area B2. The transmitted image acquiring unit 403 supplies the acquired transmitted images to the arrival time identifying unit 404. The arrival time identifying unit 404 identifies the time at which the luggage 2 arrives at the visible light photography area B3 (hereinafter referred to as the "second arrival time") based on the time at which the luggage 2 arrives at the transmitted photography area B2 (hereinafter referred to as the "first arrival time").

[0024] The arrival time identification unit 404 identifies the time when the central area of ​​the luggage 2 reaches a reference position within the transmission photography area B2 as the first arrival time, and identifies the second arrival time of the luggage 2 based on the identified first arrival time. Fig. 3 shows an example of the reference position and the central region. In Fig. 3, the reference position C2 and the central region D1 of the transmission photography region B2 are respectively shown by two-dot chain lines. In Fig. 3, the inspection device 20 and the camera 30 are not shown in order to make the drawing easier to see.

[0025] In the example of Fig. 3, a position where the distance from the front end and the rear end of the transmission photography area B2 in the conveying direction A1 are the same L1 is defined as the reference position C2. In other words, a position that is the center of the transmission photography area B2 in the conveying direction A1 is defined as the reference position C2. Also, in the example of Fig. 3, a rectangular area including the center of the package 2 is defined as the central area D1. Specifically, an area where the distance from the front end and the rear end of the package 2 in the conveying direction A1 are the same L3 is defined as the central area D1.

[0026] The distance L3 is determined to be, for example, a predetermined percentage of the length L2 in the conveying direction A1 of the package 2. For example, if the predetermined percentage is 40%, then the distance L3 = distance L2 x 0.4, and the length L4 of the central area D1 in the conveying direction A1 is distance L2 x 0.2. In addition, the central area D1 is determined to be an area whose distances from the left and right ends of the conveying device 10 in the width direction A2 (direction perpendicular to the conveying direction A1) are the same, that is, L6.

[0027] The distance L6 is determined to be, for example, a predetermined percentage of the length L5 of the baggage 2 in the width direction A2. For example, if the predetermined percentage is 40%, the distance L6=L5×0.4, and the length L7 of the central region D1 in the width direction A2 is L5×0.2. The arrival time identification unit 404 detects the transported object (baggage 2 in the example of FIG. 3) from the transmission images repeatedly supplied from the transmission image acquisition unit 403 using an image recognition technique.

[0028] In Fig. 3(a), the luggage 2 is located in front of the transmission photography area B2, so detection of the luggage 2 has not yet been performed. In Fig. 3(b), the entire luggage 2 is included in the transmission photography area B2, so the arrival time identifying unit 404 detects the luggage 2 from the transmission image. The arrival time identifying unit 404 calculates the coordinates of the front and rear ends of the detected luggage 2 in the conveyance direction A1 and the coordinates of the left and right ends of the luggage 2 in the width direction A2, based on a coordinate system set for the transmission image (for example, a two-dimensional coordinate system with the upper left corner of the transmission image as the origin).

[0029] The arrival time specifying unit 404 calculates, from the calculated coordinates, the coordinates of the central region D1 determined as above, for example, the coordinates of the four corners of the central region D1. The arrival time specifying unit 404 calculates the coordinates of the central region D1 every time a transmission image is supplied, and specifies the time when any one of the calculated coordinates reaches the reference position C2 of the transmission shooting region B2 as the time when the central region D1 reaches the reference position C2, i.e., the first arrival time, as shown in FIG.

[0030] That is, the arrival time specifying unit 404 specifies the time when the front end of the central region D1 in the transport direction A1 reaches the reference position C2 as the first arrival time. The arrival time specifying unit 404 stores in advance the distances related to the transmitted light photography region B2 and the visible light photography region B3. 4 shows an enlarged view of the transmitted light photography area B2 and the visible light photography area B3. The arrival time specifying unit 404 stores a distance L11 in the transport direction A1 between the reference position C2 of the transmitted light photography area B2 and the reference position C3 of the visible light photography area B3.

[0031] 4, the reference position C3 is a position where the distance from the front end of the visible light shooting region B3 is equal to the distance from the rear end of the visible light shooting region B3 (both distances are L12). The arrival time identifying unit 404 calculates a value obtained by dividing the distance L11 by the conveying speed V1 notified by the conveying control unit 401 as a value indicating the time required for the package 2 to be conveyed from the reference position C3 to the reference position C2 (hereinafter referred to as the "conveying time").

[0032] The arrival time identifying unit 404 identifies a time that is the calculated transport time back from the identified first arrival time as the second arrival time. The arrival time identifying unit 404 notifies the identified first arrival time and second arrival time to the image matching unit 405. The image matching unit 405 matches the appearance image captured by the camera 30 with the transmission image captured by the inspection device 20 based on the notified first arrival time and second arrival time, i.e., the first arrival time and second arrival time identified by the arrival time identifying unit 404.

[0033] Specifically, the image matching unit 405 matches the exterior image of the luggage 2 captured by the camera 30 at the second arrival time identified by the arrival time identifying unit 404 with the transmission image of the luggage 2 captured by the inspection device 20 at the first arrival time identified by the arrival time identifying unit 404. The image matching unit 405 supplies the matched exterior image and transmission image to the image display unit 406. The image display unit 406 displays both the supplied exterior image and transmission image.

[0034] Fig. 5 shows an example of the displayed external image and the transparent image. In the example of Fig. 5, the image display unit 406 displays the transparent image G1 and the external image G2 side by side on the inspector screen E1. The inspector 3 looks at the displayed transparent image and judges whether the visitor has brought in a prohibited item. In the example of Fig. 5, a knife, which is a prohibited item, has been brought in, so the inspector 3 looks at the external image displayed together and distinguishes the baggage 2 that has come out of the inspection device 20 from the other bags, picks up the baggage 2 from the conveyance path B1, and takes it to a place for reinspection to check the contents.

[0035] Based on the above configuration, the control device 40 performs a matching process for matching the acquired transmission image and appearance image. 6 shows an example of the operation of the control device 40 in the association process. First, the control device 40 (transport control unit 401) transports the luggage 2 by the transport device 10 (step S11). Next, the control device 40 (appearance image acquisition unit 402) repeatedly captures and acquires appearance images of the luggage 2 passing through the visible light shooting area B3 by the camera 30 (step S12).

[0036] Next, the control device 40 (transmission image acquisition unit 403) repeatedly captures and acquires transmission images of the luggage 2 passing through the transmission photography area B2 using the inspection device 20 (step S13). Next, the control device 40 (arrival time identification unit 404) identifies the time when the luggage 2 arrives at the transmission photography area B2 as the first arrival time (step S14). Next, the control device 40 (arrival time identification unit 404) identifies the time when the luggage 2 arrives at the visible light photography area B3 as the second arrival time (step S15).

[0037] Next, the control device 40 (image matching unit 405) matches the external image of the baggage 2 taken by the camera 30 at the second arrival time specified in step S15 with the transmission image of the baggage 2 taken by the inspection device 20 at the first arrival time specified in step S14 (step S16). Then, the control device 40 (image display unit 406) displays the mutually associated external image and transmission image together (step S17).

[0038] One method for matching an external image with a transmitted image is to use a sensor to detect the timing at which the luggage is being transported, photograph the luggage, and match it with the transmitted image. However, luggage comes in a variety of shapes, and the shapes are not necessarily uniform, so there are cases where the sensor detects the luggage too early or too late, and the transmitted image taken at the appropriate time cannot be matched with the external image.

[0039] In this embodiment, the second arrival time at which the package 2 arrives at the visible light photography area B3 is identified based on the first arrival time at which the package 2 arrives at the reference position C2 in the transmission photography area B2. If the first arrival time and the conveying speed of the package 2 are known, it is possible to accurately identify the second arrival time at which the package 2 arrives at the visible light photography area B3, the distance from which is a fixed position C2. In other words, according to this embodiment, the transmission image and the package image captured at the appropriate timing can be associated with each other regardless of the state of the package 2.

[0040] In this embodiment, the time when the central region D1 of the baggage 2 reaches the reference position C2 is specified as the first arrival time. In contrast, if the time when the front end of the baggage reaches the reference position C2 is specified as the first arrival time, for example, if the baggage is a handbag or the like with a shoulder strap that extends long forward, some or all of the contents of the baggage may not be reflected in the transmission image. By specifying the first arrival time based on the central region D1 of the baggage 2 as in this embodiment, it is possible to make it less likely that the contents of the baggage will not be reflected in the transmission image compared to when the third arrival time is specified based on the front end of the baggage.

[0041] [2] Second Example In the first embodiment, the time (second arrival time) at which the luggage 2 reaches the visible light shooting area B3 is determined based on the time (first arrival time) at which the luggage 2 reaches the transparent shooting area B2, whereas in the second embodiment, conversely, the time at which the luggage 2 reaches the transparent shooting area B2 is determined based on the time at which the luggage 2 reaches the visible light shooting area B3.

[0042] In this embodiment as well, the appearance image and the transmitted image of the luggage 2 are supplied to the arrival time identifying unit 404. However, in this embodiment, the arrival time identifying unit 404 identifies the time (hereinafter referred to as the "fourth arrival time") at which the luggage 2 arrives at the transmitted photography area B2 downstream of the transport path B1 from the visible light photography area B3 based on the time (hereinafter referred to as the "third arrival time") at which the luggage 2 arrives at the visible light photography area B3 of the transport path B1.

[0043] More specifically, when the package 2 is recognized from the central area of ​​the exterior image captured by the camera 30, the arrival time identifying unit 404 identifies the capture time of the exterior image as the third arrival time. Fig. 7 shows an example of the captured external image. The external image acquisition unit 402 repeatedly acquires external images of the luggage 2, and therefore, as shown in Figs. 7(a), (b), and (c), images of the luggage 2 moving little by little in the conveying direction A1 are acquired as external images G11, G12, and G13 (when no distinction is made, they are referred to as "external image G10").

[0044] 7, a central region D11 is shown as a region located at the center of the external image G10 in the conveying direction A1. The central region D11 is a region that is a distance L13 or more away from the front end and rear end of the external image G10 in the conveying direction A1, and the length of the width direction A2 of the conveying path B1 is the same as the length of the width direction A2 of the external image G10. In FIG. 7(a), the package 2 has not yet reached the central region D11.

[0045] In Fig. 7(b), the front end of the luggage 2 has reached the central region D11, but only one-third of the entire luggage 2 has reached the central region D11. In Fig. 7(c), two-thirds of the entire luggage 2 has reached the central region D11. The arrival time identification unit 404 determines that the luggage 2 has been recognized from the central region D11, for example, when a certain proportion (e.g., two-thirds) of the luggage 2 is included in the central region D11 of the exterior image G10.

[0046] When the certain ratio is two-thirds, the arrival time identifying unit 404 identifies the time when the external image G13 was acquired as the third arrival time. The arrival time identifying unit 404 calculates the transport time (the time required for the package 2 to be transported from the reference position C3 in the visible light shooting area B3 to the reference position C2 in the transmitted light shooting area B2) in the same manner as in the first embodiment, and identifies the time that is the calculated transport time back from the identified third arrival time as the fourth arrival time.

[0047] The arrival time identifying unit 404 notifies the identified third arrival time and fourth arrival time to the image matching unit 405. The image matching unit 405 matches the transmission image of the luggage 2 captured during a period corresponding to the notified third arrival time with an exterior image of the luggage 2 captured by the camera 30 at the time when the luggage 2 arrives at the visible light photography area B3. The image matching unit 405 determines, for example, the third arrival time itself as the period corresponding to the third arrival time.

[0048] In this case, the image matching unit 405 matches the transmitted image of the luggage 2 taken by the inspection device 20 at the third arrival time (the period corresponding to the third arrival time) identified by the arrival time identification unit 404 with the external image of the luggage 2 taken by the camera 30 at the fourth arrival time (the time when the luggage 2 arrives at the visible light shooting area B3) identified by the arrival time identification unit 404.

[0049] If the third arrival time, which is the time when the package 2 reaches the visible light photography area B3, and the transport speed of the package 2 are known, it is possible to accurately identify the fourth arrival time when the package 2 reaches the transmission photography area B2, which has a fixed distance from the visible light photography area B3. In other words, according to this embodiment, like the first embodiment, the transmission image and the package image captured at appropriate timing can be associated with each other regardless of the state of the package 2.

[0050] In this embodiment, when the baggage 2 is recognized from the central region D11 of the external image, the photographing time of the external image is specified as the third arrival time. This makes it less likely that the contents of the baggage are not reflected in the transmitted image, compared to the case where the third arrival time is specified based on the front end of the baggage, as in the first embodiment.

[0051] [3] Variations Each of the above-described embodiments is merely an example of the implementation of the present invention, and may be modified as follows. Furthermore, each of the embodiments and modifications may be combined with each other as necessary.

[0052] [3-1] Central area In the first embodiment, the method of determining the central area of ​​the package (the area in which the distance from the front end and the distance from the rear end in the conveying direction A1 of the package 2 are the same L3) is not limited to the above. For example, the distance from the front end and the distance from the rear end may be slightly different rather than being exactly the same. These are methods of determining the central area based on the distance from the edge of the package.

[0053] On the other hand, there is also a method for determining the central region based on the arrangement of the pixel group representing the luggage. For example, the region including the center of gravity of the pixel group representing the luggage in the transparent image is determined as the central region. The center of gravity of the pixel group is a point expressed as the average value of the x coordinate and the average value of the y coordinate of each pixel. Fig. 8 shows an example of the central region of the luggage of this modified example. Fig. 8(a) shows the center of gravity F11 of the luggage 2 and a central region D11 centered on the center of gravity F11.

[0054] The luggage 2 has a shape in which a short handle 22 is attached to a main body 21 that contains the contents. In the case of the luggage 2, since the handle 22 is short, the distance between the center of gravity F11 and a central point F12 that is equidistant from both ends in the conveyance direction A1 and the width direction A2 is short. Fig. 8(b) shows the center of gravity F11a of the luggage 2a and a central region D12a centered on the center of gravity F11a. The luggage 2a has a shape in which a long handle 22a is attached to a main body 21a that contains the contents.

[0055] In the case of the luggage 2a, since the luggage 2a has a rectangular body 21a with a long and thin handle 22a, the distance between the center of gravity F11a and the center point F12a that is equidistant from both ends in the conveying direction A1 and the width direction A2 is longer than that of the luggage 2. In addition, the longitudinal direction of the handle 22a is aligned with the conveying direction A1. In this way, when the center point and the center of gravity of the luggage are shifted in the conveying direction A1, the image of the transmission photography area B2 used to identify the first arrival time also differs.

[0056] Fig. 9 shows an example of an image of the transmission photography area B2. Fig. 9(a) shows a transmission image G31 captured when the center point F12a of the luggage 2a reaches the reference position C2 of the transmission photography area B2. In this case, the image of the main body 21a including the contents is close to the edge of the transmission image G31, but the entire luggage 2a is included in the transmission image G31.

[0057] 9(b) shows a transmission image G32 captured when the center of gravity F11a of the baggage 2a reaches the reference position C2 of the transmission photography area B2. In this case, the image of the main body 21a including the contents is close to the center of the transmission image G32, but part of the handle 22a protrudes from the transmission image G32. Normally, the handle is not dangerous, but if it is known that part of the handle is not captured in the transmission image, there is a risk that a dangerous object may be placed there.

[0058] Therefore, from the viewpoint of not overlooking prohibited items, it is better to use the center point F12a of the baggage 2a as in the transmitted image G31. However, if this is done, the exterior image captured by the camera 30 at the specified second arrival time will also show the main body 21a of the baggage 2a away from the center of the exterior image as in the transmitted image G31. This is fine if the exterior image captures the same range as the transmitted image, but if the capture range of the exterior image is narrower than the capture range of the transmitted image, there is a possibility that the main body 21a of the baggage 2a will protrude from the exterior image.

[0059] Therefore, the center point is used in the transmission image, but the center of gravity may be used in the appearance image. In this case, the arrival time specifying unit 404 adjusts the time from when the package 2a arrives at the visible light photography area B3 to when the package 2a arrives at the transmission photography area B2 according to the amount of deviation of the central area D12 of the package 2a in the transmission image G31 from the reference position C2 of the transmission image G31, and specifies the second arrival time using the adjusted time.

[0060] In the example of Fig. 9(a), the deviation is the distance L21 in the conveying direction A1 between the center point F12a of the package 2a and the central area D12. The arrival time identifying unit 404 calculates, for example, the time required to convey the distance L21, which is the deviation, at the current conveying speed (hereinafter referred to as "deviation time"). The arrival time identifying unit 404 also calculates the conveying time (the time required for the package 2 to be conveyed from the reference position C3 to the reference position C2) in the same manner as in the first embodiment.

[0061] The arrival time specifying unit 404 performs an adjustment to subtract the calculated shift time from the calculated transport time, and specifies the time obtained by subtraction from the first arrival time as the second arrival time. By performing the above adjustment, it is possible to make the main part of the package appear easily in the external image while making the entire package appear in the transmission image. The main part of the package is the part that shows the main shape of the package, and in the case of package 2a, it is the main body 21a.

[0062] [3-2] Stretched part In the above-described modified example, the arrival time is determined taking into consideration the amount of deviation caused by the handle 22a of the baggage 2a, but a mechanism for reducing this amount of deviation may be provided. Fig. 10 shows an entrance inspection system 1b of this modified example. In the example of Fig. 10, a piece of luggage 2b is shown having a main body 21b containing contents and a soft, elongated handle 22b connected to the main body 21b.

[0063] The entrance inspection system 1b is provided with an approach mechanism 50 that brings the handle 22b, which is a portion extending outward from the body 21b of the baggage 2b upstream of the visible light shooting area B3, closer to the body 21b. The approach mechanism 50 is an example of the "mechanism" of the present invention. The approach mechanism 50 is a plate-like mechanism made of a highly elastic material such as rubber, and has a contact part 51 at one end where elongated rod-like parts are arranged closely together.

[0064] The approach mechanism 50 is located upstream of the visible light shooting area B3 as shown in FIG. 10(a), and is fixed at a height where the lower end of the contact part 51 contacts the conveying device 10 as shown in FIG. 10(b). When the luggage 2b is conveyed, the contact part 51 drags the handle 22b in the opposite direction to the conveying direction A1, bringing it closer to the main body 21b, as shown in FIG. 10(c) and (d), but because it is elastic, bends in the conveying direction A1 to allow the main body 21b to pass through.

[0065] By bringing the handle 22b closer to the main body 21c with the approaching mechanism 50, the entire luggage can be captured in the transmitted image while the essential parts of the luggage can be more easily captured in the external image, compared to a case where the approaching mechanism 50 is not provided.

[0066] [3-3] Object detection sensor In the second embodiment, the inspection device 20 and the camera 30 that take pictures of luggage are used, but in addition to these, a sensor that detects an object may also be used. Fig. 11 shows an entrance inspection system 1c according to this modified example. The entrance inspection system 1c includes an object detection sensor 60 located upstream of a visible light shooting area B3 in the conveying direction A1 as shown in Fig. 11(a).

[0067] The object detection sensor 60 has a light-emitting unit 61 and a light-receiving unit 62. The light-emitting unit 61 and the light-receiving unit 62 are provided facing one end and the other end of the transport device 10 in the width direction A2. For example, an object is not detected while the light-receiving unit 62 is receiving the light emitted by the light-emitting unit 61, and an object is detected when the amount of light received by the light-receiving unit 62 drops to or above a certain level. The object detection sensor 60 is provided at a position to detect an object in the visible light shooting area B3.

[0068] In a modified example, the arrival time determination unit 404 determines the first arrival time at which the luggage arrives in the visible light shooting area B3 based on the period during which the object detection sensor 60, which detects the presence of an object in the visible light shooting area B3, detects the object (hereinafter referred to as the "detection period"). Fig. 12 shows an example of an object detection situation. In the example of Fig. 12, the object detection sensor 60 detects an object during a detection period T1 from time t1 to time t2.

[0069] The arrival time identifying unit 404 identifies, for example, the middle time of the detection period T1 (the time when half the period of the detection period T1 has elapsed from time t1) as the first arrival time. For example, if the luggage is transparent or reflective like a mirror, it may be difficult to recognize the luggage from the captured exterior image. According to this modification, even if the luggage is difficult to recognize from the exterior image, as long as the object detection sensor 60 can detect the object, it is possible to identify the time when the luggage arrived at the visible light shooting area B3.

[0070] [3-4] Types of Inspection The types of inspections performed by the entrance inspection system 1 are not limited to those described in the embodiment. For example, an inspection may be performed in which a transmission image is taken using millimeter waves or terahertz waves instead of X-rays. Also, an inspection may be performed to detect liquids (suspected to be explosives) contained in baggage, or to detect traces of explosives, called traces. In any case, the entrance inspection system is equipped with an inspection device for each inspection and performs those inspections. In short, any kind of inspection may be performed as long as it is an inspection for detecting prohibited items or preventing danger at the venue.

[0071] [3-5] Baggage inspection area In the embodiment, the baggage inspection is performed at an event venue, but the baggage inspection may be performed at other locations, such as entrances to vehicles at airports, train stations, ports, and bus terminals, or entrances to facilities such as concert venues, sports stadiums, stadiums, and art museums. In short, if it is necessary to check the contents of visitors' baggage at the entrance for safety, the baggage inspection may be performed at any location (entrance). [Explanation of symbols]

[0072] 1...entry inspection system, 10...transport device, 20...inspection device, 30...camera, 40...control device, 50...approach mechanism, 60...object detection sensor.

Claims

1. A time at which the luggage arrives at an image capturing area downstream of the luggage transport path from the predetermined area is identified based on a time at which the luggage arrives at the predetermined area of ​​the luggage transport path, and a transmission image of the luggage captured during a period corresponding to the time is associated with an image of the luggage captured by a visible light camera at the time when the luggage arrives at the predetermined area. Baggage inspection equipment.

2. The predetermined area is repeatedly photographed by the visible light camera, and when the package is recognized from a central area of ​​the image photographed by the visible light camera, the photographing time of the image is identified as the time when the package arrived at the predetermined area.

2. The baggage inspection device according to claim 1.

3. The time when the package arrived at the predetermined area is identified based on a period during which a sensor that detects the presence of an object in the predetermined area detects the object.

2. The baggage inspection device according to claim 1.

4. a mechanism for bringing a portion of the luggage extending outward from the luggage body upstream of the predetermined area closer to the luggage body; 2. The baggage inspection device according to claim 1.

Images