Inspection system
By using a camera and transparent anti-reflective components on a belt conveyor, the problem of identifying dangerous goods in personal cargo inspection devices in venues such as event halls has been solved, achieving efficient and safe cargo inspection.
Patent Information
- Application Number
- CN202080075619.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-10-26
- Filing Date
- 2020-10-28
- Publication Date
- 2026-02-06
- Estimated Expiration
- 2040-10-28
AI Technical Summary
In the case of personal cargo inspection devices in venues such as event venues, a small number of inspectors are needed to achieve high throughput and high security. Existing technologies are difficult to effectively identify dangerous goods, and the operation is inconvenient for inspectors and can easily waste time.
The inspection system uses a continuously operating belt conveyor to transport goods, and a camera to capture images of the goods at the entrance. Combined with transparent anti-reflective components and a display control unit, it enables rapid identification and monitoring of dangerous goods, reducing psychological anxiety for the holder.
It enables the rapid and accurate identification of dangerous goods with a smaller number of inspectors, reduces the psychological anxiety of holders, and improves inspection efficiency and safety.
Smart Images

Figure CN114829915B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to a technology of inspecting an inspection object. BACKGROUND
[0002] As a technology of inspecting an inspection object, Patent Literature 1 discloses a technology of moving a cargo floor that moves in a cargo passage and a person floor that moves in a person passage at substantially the same speed, thereby efficiently performing cargo inspection.
[0003] PRIOR ART DOCUMENTS
[0004] PATENT LITERATURE
[0005] Patent Literature 1: Japanese Patent Application Publication No. 2019-11981 SUMMARY
[0006] PROBLEMS TO BE SOLVED BY THE INVENTION
[0007] Conventionally, a carry-on cargo inspection device used at an airport or the like is configured with a plurality of workers, and a cargo is transported at a low speed, thereby performing inspection that takes time. On the other hand, targets of terrorist attacks are becoming diversified, and there are event venues, vehicles, office buildings, hotels, and the like, and even if it is not an airport level of security, there is a demand for maintaining a throughput similar to the current situation and improving security, and a higher convenience of security.
[0008] In a carry-on cargo inspection device for an event venue, a space is often limited so that it is difficult to configure a plurality of workers as in an airport. Therefore, in order to perform carry-on cargo inspection at a high throughput, an inspection device that can be corresponded to by a smaller number of inspection personnel is required. However, the conventional carry-on cargo inspection device is configured to require a person who operates the device, a person who observes a screen, a person who takes a carry-on cargo of a user and puts it into the inspection device, a person who takes a carry-on cargo of which inspection is completed and gives it to the user, and the like, and thus there is a problem that it cannot be corresponded to by a smaller number of inspection personnel.
[0009] In order to be corresponded to by a smaller number of inspection personnel, efficiency of inspection is required. For example, in a case where the inspection device detects a dangerous article in a cargo, the inspection personnel is required to perform secondary inspection, but at this time, if an effort is spent in order to find a cargo in which a dangerous article is detected, a corresponding time is wasted.
[0010] The present application is made in view of the above background, and an object thereof is to be able to easily determine a cargo in which a dangerous article is detected.
[0011] MEANS FOR SOLVING THE PROBLEMS
[0012] To solve the above problems, the present application provides an inspection system as a first aspect, which inspects a cargo conveyed by a continuously operating belt conveyor by an inspection device, wherein the inspection system includes a camera that captures an appearance image of the cargo on an entrance side of the inspection device.
[0013] According to the inspection system of the first aspect, it is possible to easily determine a cargo in which a dangerous article is detected from an image captured by the camera.
[0014] As a second aspect, the following configuration can be employed: in the inspection system of the first aspect, the camera is disposed at a position visually shielded from a passage through which a holder of the cargo passes.
[0015] According to the inspection system of the second aspect, it is possible to prevent the holder of the cargo from feeling mentally uncomfortable due to the camera.
[0016] As a third aspect, the following configuration can be employed: in the inspection system of the first aspect, the inspection system includes a transparent anti-reflection member disposed on the entrance side of the inspection device, the transparent anti-reflection member transmits visible light and reduces reflection of light, and the camera captures the appearance image of the cargo through the transparent anti-reflection member.
[0017] According to the inspection system of the third aspect, it is possible to reduce the possibility that the camera reflects light from a member such as a protective cover and causes the holder of the cargo to feel mentally uncomfortable.
[0018] As a fourth aspect, the following configuration can be employed: in the inspection system of the third aspect, the transparent anti-reflection member is provided to at least one of two surfaces of a transparent protective cover disposed on the entrance side of the inspection device.
[0019] According to the inspection system of the fourth aspect, it is possible to suppress reflection of the camera disposed above the transparent protective cover.
[0020] As a fifth aspect, the following configuration can be employed: in the inspection system of the third aspect, the transparent anti-reflection member is provided to at least one of two surfaces of a transparent protective cover disposed in a direction of capturing by the camera.
[0021] According to the inspection system of the fifth aspect, it is possible to suppress reflection of the camera by the transparent protective cover regardless of the position of the camera.
[0022] As a sixth aspect, the following configuration can be employed: in the inspection system of the first aspect, the inspection system includes a display control unit that displays the image captured by the camera and a result of inspection by the inspection device simultaneously or alternately on a display device.
[0023] According to the inspection system of the sixth aspect, the inspector of the inspection system can see both the inspection result of the baggage and the appearance of the baggage put into the inspection apparatus, and therefore, it is not necessary to additionally provide a monitor who monitors the baggage put into the inspection apparatus by visual observation at the entrance side of the inspection apparatus.
[0024] As the seventh aspect, the following configuration can be employed: in the inspection system of the sixth aspect described above, the display control unit causes the display apparatus to switch the display of the image captured by the camera and the inspection result of the inspection apparatus, depending on the inspection result of the inspection apparatus or the placement state of the baggage placed on the belt conveyor.
[0025] According to the inspection system of the seventh aspect, the inspector of the inspection system can confirm the placement state of the baggage as necessary depending on the placement state of the baggage.
[0026] As the eighth aspect, the following configuration can be employed: in the inspection system of the sixth or seventh aspect described above, the inspection system is provided with a cover which is arranged at the entrance of the inspection apparatus, and the camera captures the inside of the cover.
[0027] According to the inspection system of the eighth aspect, it is possible to suppress the possibility that a user's hand or the like is caught at the entrance of the inspection apparatus.
[0028] As the ninth aspect, the following configuration can be employed: in the inspection system of the eighth aspect described above, at least a part of the inside of the cover is visible from the outside.
[0029] According to the inspection system of the ninth aspect, the inspector can monitor the inside of the cover through the image captured by the camera through the cover.
[0030] As the tenth aspect, the following configuration can be employed: in the inspection system of the eighth or ninth aspect described above, a region of the cover which comes into contact with the baggage is covered with a member having a frictional coefficient smaller than the cover.
[0031] According to the inspection system of the tenth aspect, it is possible to suppress the possibility that the baggage is jammed and its conveyance is stopped by coming into contact with the cover.
[0032] As the eleventh aspect, the following configuration can be employed: in the inspection system of the first aspect described above, the inspection system is provided with a correlation unit which determines the timing at which the baggage arrives at a prescribed region within the capturing region of the camera, from the timing at which the baggage arrives at the inspection region of the inspection apparatus, and correlates the image captured by the camera at the timing with the inspection result of the inspection apparatus.
[0033] According to the inspection system of the 11th aspect, the result of the inspection by the inspection device can be associated with the image of the cargo at an appropriate timing regardless of the state of the cargo.
[0034] As the 12th aspect, the following structure can be employed: in the inspection system of the 11th aspect described above, the association unit determines the timing at which the cargo reaches the prescribed region based on the timing at which the central region of the cargo reaches the reference position within the inspection region.
[0035] According to the inspection system of the 12th aspect, the result of the inspection can be made difficult to reflect the contents of the cargo compared to the timing at which the end of the cargo reaches the reference position.
[0036] As the 13th aspect, the following structure can be employed: in the inspection system of the 12th aspect described above, the inspection device captures a perspective image of the cargo, the association unit adjusts the time from the timing at which the cargo reaches the prescribed region to the timing at which the cargo reaches the inspection region based on the amount of shift of the central region of the cargo in the perspective image captured by the inspection device with respect to the reference position of the perspective image, and determines the timing at which the cargo reaches the prescribed region using the adjusted time.
[0037] According to the inspection system of the 13th aspect, the perspective image can reflect the entire cargo, and the main part of the cargo can be easily reflected in the image captured in the prescribed region.
[0038] As the 14th aspect, the following structure can be employed: in the inspection system of the 11th aspect described above, the inspection system includes an association unit that determines the timing at which the cargo reaches the inspection region based on the timing at which the cargo reaches a prescribed region within the capturing region of the camera, and associates the result of the inspection by the inspection device corresponding to the timing with the image captured by the camera at the timing at which the cargo reaches the prescribed region.
[0039] According to the inspection system of the 14th aspect, the result of the inspection by the inspection device can be associated with the image of the cargo at an appropriate timing regardless of the state of the cargo.
[0040] As the 15th aspect, the following structure can be employed: in the inspection system of the 14th aspect described above, the camera repeatedly captures the prescribed region, the association unit performs recognition processing on the image captured by the camera, and in a case where the cargo is recognized from the central region of the image, the timing at which the image is captured is determined as the timing at which the cargo reaches the prescribed region.
[0041] According to the inspection system of the 15th aspect, compared to the case where the time when the cargo arrives at the prescribed area is determined based on the time when the end of the cargo arrives, the determination accuracy of the time when the cargo arrives at the prescribed area can be improved.
[0042] As the 16th aspect, the following configuration can be employed: in the inspection system of the above-mentioned 14th aspect, the association unit determines the time when the cargo arrives at the prescribed area based on the period during which the sensor detects the object existing in the prescribed area.
[0043] According to the inspection system of the 16th aspect, the time when the cargo arrives at the prescribed area can be determined even in a case where it is difficult to identify the cargo based on the captured image.
[0044] As the 17th aspect, the following configuration can be employed: in the inspection system of the above-mentioned 14th aspect, the inspection system is provided with a mechanism that brings the portion extending outward from the main body of the cargo closer to the main body at a position on the upstream side of the prescribed area in the conveyance direction of the cargo.
[0045] According to the inspection system of the 17th aspect, compared to the case where the mechanism of the present aspect is not provided, the perspective image can be made to show the entire cargo, and the image captured at the prescribed area can be made to show the main portion of the cargo. BRIEF DESCRIPTION OF DRAWINGS
[0046] Figure 1A FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0047] Figure 1B FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0048] Figure 2 FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0049] Figure 3 FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0050] Figure 4 FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0051] Figure 5 FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0052] Figure 6 FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0053] Figure 7 FIG. 1 is a diagram showing the appearance of the inspection system of the first embodiment.
[0054] Figure 8 FIG. 12 is an example of a display timing of an inspection image showing an inspection result of the modification of the second embodiment.
[0055] Figure 9 FIG. 13 is an example of a simultaneous display of an entrance image and an inspection image of the modification of the second embodiment.
[0056] Figure 10 FIG. 14 is a diagram for explaining a placement state of a cargo of the modification of the second embodiment.
[0057] Figure 11 FIG. 15 is an example of an entrance image when there is an abnormality in the placement state of a cargo of the modification of the second embodiment.
[0058] Figure 12 FIG. 16 is an example of a cover from which a part of the inside can be seen from the outside of the modification of the second embodiment.
[0059] Figure 13 FIG. 17 is an example of a region in contact with a cargo in the cover of the modification of the second embodiment being covered with a film.
[0060] Figure 14A FIG. 18 is a diagram showing an appearance of the entrance inspection system of the third embodiment.
[0061] Figure 14B FIG. 19 is a diagram showing an appearance of the entrance inspection system of the third embodiment.
[0062] Figure 15 FIG. 20 is a diagram showing a functional structure of the inspection system of the third embodiment.
[0063] Figure 16A FIG. 21 is a diagram showing an example of a reference position and a central region in the inspection system of the third embodiment.
[0064] Figure 16B FIG. 22 is a diagram showing an example of a reference position and a central region in the inspection system of the third embodiment.
[0065] Figure 16C FIG. 23 is a diagram showing an example of a reference position and a central region in the inspection system of the third embodiment.
[0066] Figure 17 FIG. 24 is a diagram showing a perspective photographing region and a visible light photographing region of the inspection system of the third embodiment enlarged and shown.
[0067] Figure 18 FIG. 25 is a diagram showing an example of an appearance image and a perspective image displayed by the inspection system of the third embodiment.
[0068] Figure 19Fig. 1 is a diagram showing an example of the action in the association processing of the control device of the inspection system of the 3rd embodiment.
[0069] Figure 20A Fig. 2 is a diagram showing an example of the appearance image photographed by the inspection system of the 3rd embodiment.
[0070] Figure 20B Fig. 3 is a diagram showing an example of the appearance image photographed by the inspection system of the 3rd embodiment.
[0071] Figure 20C Fig. 4 is a diagram showing an example of the appearance image photographed by the inspection system of the 3rd embodiment.
[0072] Figure 21A Fig. 5 is a diagram showing an example of the central region of the cargo of the modification of the 3rd embodiment.
[0073] Figure 21B Fig. 6 is a diagram showing an example of the central region of the cargo of the modification of the 3rd embodiment.
[0074] Figure 22A Fig. 7 is a diagram showing an example of the image of the perspective photographing region of the inspection system of the modification of the 3rd embodiment.
[0075] Figure 22B Fig. 8 is a diagram showing an example of the image of the perspective photographing region of the inspection system of the modification of the 3rd embodiment.
[0076] Figure 23A Fig. 9 is a diagram showing the inspection system of the modification of the 3rd embodiment.
[0077] Figure 23B Fig. 10 is a diagram showing the inspection system of the modification of the 3rd embodiment.
[0078] Figure 23C Fig. 11 is a diagram showing the inspection system of the modification of the 3rd embodiment.
[0079] Figure 23D Fig. 12 is a diagram showing the inspection system of the modification of the 3rd embodiment.
[0080] Figure 24 Fig. 13 is a diagram showing the inspection system of the modification of the 4th embodiment.
[0081] Figure 25 Fig. 14 is a diagram showing an example of the detection state of the object by the inspection system of the modification of the 4th embodiment. DETAILED DESCRIPTION
[0082] [1st Embodiment]
[0083] Figure 1A and Figure 1B(Hereinafter, these drawings are collectively referred to as FIG. 1) shows the appearance of an inspection system 1 of a first embodiment of the present application. The inspection system 1 is, for example, a system that checks whether or not the goods J of an entrant contain a prohibited article such as a knife (prohibited article) by an inspection device at an active site. In FIG. 1, an example in which the goods J are the object of inspection is shown.
[0084] The inspection system 1 is used by the holder P of the goods J and the inspector Q who performs a work related to the inspection. The inspection system 1 is sometimes provided with a plurality according to the size of the entrance, but in the present embodiment, a so-called one operation in which each inspection system 1 is configured with only one inspector Q is implemented. In Figure 1A , the inspection system 1 is shown as viewed from the vertical direction above, and in Figure 1B , the inspection system 1 is shown as viewed in the horizontal direction.
[0085] The inspection system 1 is provided with a first conveyance device 10, a second conveyance device 20, an inspection device 30, a shield 40, a camera 50, a control device 60, and a display 70. The first conveyance device 10 and the second conveyance device 20 are both belt conveyors that convey the goods J in a conveyance direction Al. That is, the goods J are conveyed by a belt conveyor that is continuously operated. The first conveyance device 10 and the second conveyance device 20 are arranged in the conveyance direction Al, thereby forming a conveyance path Bl.
[0086] In the inspection system 1, either one of the left and right of the conveyance path Bl is configured with the inspector Q, and the opposite side of the inspector Q is provided with an inspection passage B2 through which the holder P of the goods J passes. The first conveyance device 10 is arranged on the upstream side of the second conveyance device 20, and a placement site B3 in which the holder P places the goods J is provided. The front of the conveyance path Bl in which the goods placed in the placement site B3 is provided with the shield 40, and the inspection device 30 is provided on the downstream side of the shield 40.
[0087] The inspection device 30 is a device that photographs a perspective image obtained by seeing through the inspection object that is conveyed. The perspective image is an image for the inspection of the goods, and shows the result of the inspection by the inspection device 30. The inspection device 30, for example, irradiates the goods J that pass through a photographing region B4 of the perspective image with electromagnetic waves within the device, and generates an image that is drawn according to the depth corresponding to the intensity of the electromagnetic waves that pass through the goods J as the perspective image of the goods J. The electromagnetic waves irradiated by the inspection device 30 to the goods J are electromagnetic waves of a frequency band that are transmitted through the goods J but have different transmission rates according to the substance of the contents of the goods J, and are, for example, X-rays.
[0088] When it is determined in the primary inspection based on the captured perspective image of the inspection device 30 that an article that can be a prohibited article has been captured, the inspector Q performs a secondary inspection of opening the cargo J to confirm what is actually put in. The determination of whether or not the secondary inspection is needed is made by the control device 60 based on the captured perspective image. The detailed determination method will be described later.
[0089] The shield 40 is disposed at a position on the upstream side of the capturing region B4 of the inspection device 30 in the conveyance direction Al. The shield 40 is a transparent member that covers the conveyance path of the cargo J and is provided to avoid the hand of the holder P from entering the capturing region B4 in which electromagnetic waves are interlaced. The shield 40 is an example of the "transparent shield" of the present application.
[0090] The shield 40 has an upper surface portion 41, a side surface portion 42, and a side surface portion 43. The upper surface portion 41, the side surface portion 42, and the side surface portion 43 are each a quadrangular plate-like shape. The internal space B5 of the shield 40, which is formed in a letter-shaped cross section perpendicular to the conveyance direction Al by the upper surface portion 41, the side surface portion 42, and the side surface portion 43, is sized to allow the cargo J to pass therethrough. On the upstream side of the conveyance direction Al of the inspection device 30, the vertical upper side of the upper surface portion 41 is provided with the camera 50.
[0091] Figure 2 The camera 50 is enlarged and shown. The camera 50 captures an appearance image showing the appearance of the cargo J conveyed by the first conveyance device 10. The camera 50 is disposed in the internal space 32 of the housing 31 of the inspection device 30 and captures the outside space through an opening portion 33 that opens to the vertical lower side of the housing 31. The camera 50 captures an appearance image of the cargo J on the inspection device 30 entry side through the outside space.
[0092] According to Figure 2 the configuration shown, the housing 31, which is a part of the inspection device 30, functions as a shield that shields (makes invisible) the camera 50 from a person looking at the inspection device 30 from the inspection passage B2 side. Strictly speaking, even from the inspection passage B2 side, if the opening portion 33 is peeped from the vertical lower side, a part of the camera 50 is sometimes visible, but the entire camera 50 is not visible, and a part is necessarily shielded. Further, in the case of looking from a position higher than the housing 31, the entire camera 50 is shielded.
[0093] Thus, the camera 50 is disposed at a position visually shielded from the inspection passage B2 side through which the holder P of the article J passes. If the holder P sees the camera 50, he or she sometimes becomes uneasy in that he or she is conscious of being photographed. In the present embodiment, the camera 50 is shielded by the case 31 serving as a shield, as shown in FIG. 3, so that the holder P can not feel mentally uneasy due to seeing the camera 50. Figure 2
[0094] The camera 50 photographs the appearance of the article J passing through the internal space B5 surrounded by the shield 40 through the upper surface portion 41 of the shield 40. Thus, the upper surface portion 41 is formed of a member that transmits visible light. Further, the upper surface 411 of the upper surface portion 41 on the side of the camera 50 is subjected to processing for suppressing reflection of light, by which processing, as compared with the case where it is simply processed to be flat, reflection of light can be suppressed.
[0095] The upper surface 411 is subjected to processing for sticking an antireflection film, for example. The antireflection film is a film of, for example, two layers, by which reflected light becomes out of phase and is thus canceled by interference, thereby suppressing reflection. Further, the antireflection film can be a film that suppresses reflection by providing minute irregularities on the surface to scatter light, or a film that has both the two layers and the irregularities.
[0096] The antireflection film is a member that is transparent and has a function of preventing reflection of light, and is an example of the "transparent antireflection member" of the present application. Thus, the camera 50 photographs the appearance image of the article J through the transparent antireflection member provided to the shield 40 disposed on the entrance side of the inspection device 30.
[0097] Further, the transparent antireflection member is not limited to being provided only to the upper surface 411 of the shield 40, but can be provided to the back surface upper surface 412, or can be provided only to the back surface upper surface 412. By providing the transparent antireflection member at these positions, the camera 50 disposed above the shield 40 can be suppressed from being reflected in the shield 40. Further, by providing the transparent antireflection member, the clarity of the reflection image of the article photographed through the shield 40 can be improved.
[0098] If the camera 50 is reflected in the shield 40, the holder P can notice the presence of the camera 50, and as described above, he or she sometimes feels uneasy. In the present embodiment, this reflection is suppressed, so that the holder P of the article J can hardly notice the presence of the camera 50, and thus the possibility of the holder P feeling mentally uneasy can be reduced.
[0099] In the shield 40, the transparent antireflection member can be provided not only in the upper surface portion 41 but also in the side surface portions 42 and 43. Further, the transparent antireflection member can be provided not only on the surfaces of the side surface portions 42 and 43 but also on the back surface (the surface on the inner space B5 side). Alternatively, the transparent antireflection member can be provided not by pasting the antireflection film to each surface but by processing the surfaces themselves to have the same structure as the antireflection film.
[0100] As described above, the side surfaces of the shield 40 are also provided with the transparent antireflection member. Thereby, it is possible to suppress the situation in which the holder of the goods himself is reflected in the transparent shield and it is difficult to see the goods. The goods J conveyed by the first conveying device 10 reach the end of the conveying direction Al of the first conveying device 10 and are then conveyed by the second conveying device 20.
[0101] The holder P advances to the position of the second conveying device 20 through the inspection passage B2 provided along the conveying path Bl and takes the goods J. The conveying speed of the second conveying device 20 is slower than the conveying speed of the first conveying device 10, so that the holder P easily takes the goods J. However, in the case where the above-described two inspections are performed, the inspector Q takes the goods J before the holder P.
[0102] The determination method of the two inspections using the above-described control device 60 will be described. The control device 60 is a device that controls the operation of each device provided in the inspection system 1. The control device 60 is a computer provided with a processor such as a CPU (Central Processing Unit), a memory, a storage, a communication section, and the like. The control device 60 is electrically connected to the first conveying device 10, the second conveying device 20, the inspection device 30, and the display 70 through a wiring not shown.
[0103] The control device 60 controls the operation of each device while exchanging data with each device electrically connected thereto. The control device 60 performs an inspection process for inspecting whether the goods J contain the prohibited article. Specifically, the control device 60 performs a photographing process of causing the inspection device 30 to photograph the goods passing through the photographing region B4 and a determination process of determining whether the goods contain the article that can be the prohibited article, that is, whether the two inspections by the inspector Q are necessary, on the basis of the perspective image photographed in the photographing process.
[0104] The control device 60 analyzes the shape of the contents contained in the goods on the basis of the perspective image photographed by a known image analysis method, and determines whether the contents are the prohibited article by a pattern matching method or the like on the basis of the analyzed shape. The control device 60 displays the determination result of the determination process and the perspective image and the appearance image photographed with respect to the goods J as described above on the display 70.
[0105] Figure 3 An example of a perspective image and an exterior image is shown. Figure 3 In this example, the control device 60 displays a perspective image G1 of the cargo J, an external image G2 of the cargo J, and a determination result C1 on the display surface 71 of the display 70. The determination result C1 is an image displaying the string "Prohibited item detected." Figure 3 In the example, the knife-shaped inclusion in cargo J will be determined as a prohibited item.
[0106] The control device 60 analyzes the images captured by the camera 50 to identify objects passing through the conveyor path B1. Then, the control device 60 identifies the objects on the conveyor path B1 captured by the camera 50 before the moment when the perspective image G1 was captured (hereinafter referred to as the "perspective capture moment") and closest to that moment (hereinafter referred to as the "appearance capture moment") as the goods captured in the perspective image G1, and associates the appearance image G2 of the goods with the perspective image G1 and displays them simultaneously.
[0107] As described above, the inspection system 1 transports goods J under the control of the control device 60, and captures a perspective image G1 and an appearance image G2 of the transported goods J. The captured perspective image G1 and appearance image G2 are associated and simultaneously displayed on the display 70, which serves as a display unit. As shown in FIG1, the display 70 is positioned so that the inspector can see the captured goods J from the pick-up location.
[0108] As described above, when inspectors are at a location where goods requiring a second inspection are being retrieved, they can determine the appearance of the item requiring a second inspection simply by viewing the display 70, even if the perspective image G1 captures a prohibited item. Thus, according to this embodiment, compared to the case where the perspective image and the appearance image are displayed simultaneously on the same display unit without being linked, it is easier to identify items requiring a second inspection.
[0109] The conveyor belt B1 is positioned at approximately waist height to facilitate placement or retrieval of goods by the holder. This also allows inspectors to view the goods from above. In this embodiment, the camera 50 captures an image of the goods from a vertically upward perspective, making it easier for inspectors to identify the actual goods as shown in the image compared to, for example, an image captured from a horizontal perspective.
[0110] [Modifications of the First Embodiment]
[0111] The above-described first embodiment is merely one example of the implementation of the present application, and can be modified as follows. Moreover, two or more of the following modified examples can be combined as needed.
[0112] [Modified Example 1]
[0113] The configuration of the camera that captures the appearance image can be different from that of the embodiment.
[0114] Figure 4 The periphery of the camera 50a of the present modified example is enlarged and shown. In Figure 4 , the camera 50a and the like are shown as viewed from directly above. The camera 50a captures the appearance image of the goods J conveyed by the first conveying device 10a.
[0115] The camera 50a is disposed in the internal space 32a of the housing 31a of the inspection device 30a. The internal space 32a is provided on the side of the inspection passage B2 through which the holder P passes in the housing 31a. The internal space 32a has an opening portion 33a that is open on the side of the shield 40a. The camera 50a captures the outside space via the opening portion 33a. In this way, the camera 50a is disposed at a position that cannot be seen from the side of the inspection passage B2 through which the holder P passes, at a position further from the camera 50a itself.
[0116] Therefore, the camera 50a is not seen by the holder P who is passing through the inspection passage B2. Thus, as in the embodiment, the holder P can not feel mentally uneasy due to seeing the camera. The camera 50a captures the appearance of the goods J as viewed from the horizontal direction through the side surface portion 43a of the shield 40a.
[0117] In the present modified example, a transparent anti-reflection member such as an anti-reflection film is provided on either one or both of the front surface or the back surface of the shield 40a disposed in the direction of the capturing of the camera 50a. The surface disposed in the direction of the capturing is a surface along the direction of the capturing by the camera 50a. If it is the case of Figure 4 , the transparent anti-reflection member is provided on either one or both of the front surface 431a or the back surface 432a of the side surface portion 43a of the shield 40a.
[0118] Thus, as in the embodiment, it is difficult for the holder P of the goods J to notice the presence of the camera 50a, and it is possible to reduce the possibility of the holder P feeling mentally uneasy. Moreover, by providing the transparent anti-reflection member on the shield 40a disposed in the direction of the capturing of the camera 50a, it is possible to suppress the reflection of the camera into the shield 40a regardless of the position of the camera 50a.
[0119] [Modified Example 2]
[0120] In the embodiment, the case 31 of the inspection device 30 is used as a shield that shields the camera 50, but is not limited thereto. For example, the camera 50 can be installed outside the case 31 of the inspection device 30, and a cover that shields the camera 50 can be provided. Also, the camera 50 can be installed to the guard 40, and the same cover can be provided.
[0121] In either case, at least a part of the camera 50 is shielded by the shield with respect to a person who observes the camera 50 from the direction of the inspection passage B2 side. By providing such a shield, as in the embodiment, the holder P can not feel mentally uneasy due to seeing the camera. In addition, by using a part of the device that captures a see-through image, that is, the inspection device 30 as the shield as in the embodiment, the holder P can be made to see the camera more naturally than when a separate shield is provided.
[0122] [Modified Example 3]
[0123] In the embodiment, the case in which the inspection of the cargo is performed at the event site is described, but in addition thereto, for example, the inspection can be performed at the entrance of a transportation facility such as an airport, a station, a port, and a bus terminal, and the inspection can be performed at the entrance of a facility such as a concert site, a sports competition site, an open-air stadium, and an art museum. In general, as long as the contents of the cargo of the person entering are confirmed for security at the entrance, the inspection of the cargo can be performed at any place (entrance).
[0124] [Modified Example 4]
[0125] In the embodiment, the conveyance device is two, but can be one. In this case, the conveyance speed can be always constant, or can be made faster when the cargo passes through the photographing region B4 in a case where the cargo to be inspected is small (for example, in a case where only one cargo is inspected at one time point), and can be made slower after the cargo passes through the photographing region B4.
[0126] [Second Embodiment]
[0127] [Structure of Inspection System]
[0128] Figure 5 is a diagram showing an example of the structure of an inspection system 2 of one embodiment of the present application. The inspection system 2 is a system that inspects the cargo of a person entering a place where a transportation facility or a music hall, a public hall, or the like provides a service to the person entering, at the time of the entrance of the person.
[0129] Figure 5 is a diagram showing an outline of a situation seen from above when the inspection system 2 is viewed from above. The inspection system 2 inspects the cargo of a person entering a place where a transportation facility or a music hall, a public hall, or the like provides a service to the person entering, at the time of the entrance of the person. Figure 5The arrow shown conveys and inspects the goods J of the customer P who enters from the outside L to the inside H. The inspection system 2 is provided with a controller 21, an inspection device 22, a conveyor 23, a camera 24, and a display device 25.
[0130] The controller 21 is a unit that controls the operation of each part of the inspection system 2. The controller 21 is provided with an arithmetic processing device such as a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a storage device such as a solid state drive, a hard disk drive, and the like, and the arithmetic processing device executes a program stored in these storage devices.
[0131] The inspection device 22 is a device that continuously inspects the goods J conveyed by the conveyor 23 under the control of the controller 21, for example, by irradiating X-rays. In Figure 5 , the entrance of the inspection device 22 where the goods J are carried in is shown in the lower direction, and the exit of the inspection device 22 where the goods J are carried out is shown in the upper direction.
[0132] The conveyor 23 is a device that conveys the goods J placed by the customer P so that the inspection device 22 inspects the goods J. The conveyor 23 carries the goods J placed by the customer P into the entrance of the inspection device 22. Then, the conveyor 23 further conveys the goods J carried into the entrance so that the goods J pass through a position where the inspection device 22 receives inspection, and are carried out from the exit of the inspection device 22. The conveyor 23 is, for example, a belt conveyor. In Figure 5 , the conveyor 23 conveys the goods J from the outside L on the lower side toward the inside H on the upper side.
[0133] In addition, the conveyor 23 can be configured, for example, by a single belt conveyor. Also, the conveyor 23 can be configured by a linkage of belt conveyors and the like divided into the upstream side of the conveying direction from the entrance of the inspection device 22, the inside of the inspection device 22, and the downstream side of the conveying direction from the exit of the inspection device 22, respectively.
[0134] In the example shown in Figure 5 , a cover 26 is provided in a manner of covering a region from the entrance of the inspection device 22 toward the upstream of the conveying direction of the conveyor 23. Also, in the example shown in Figure 5 , a cover 27 is provided in a manner of covering a region from the exit of the inspection device 22 toward the downstream of the conveying direction of the conveyor 23. The cover 26 and the cover 27 are each configured by a transparent member, and the inside can be seen from the outside.
[0135] The camera 24 is an imaging device that images an object, and is, for example, a digital camera that has an optical system including a lens, a mirror, a prism, or the like, and an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device).
[0136] The camera 24 images an entrance of the inspection device 22 through which the cargo J is carried in, and provides the controller 21 with image data representing an image (hereinafter, referred to as an entrance image S1 (see FIG. 8)) imaged. Figure 6
[0137] In addition, the inspection device 22 performs inspection by radiographing the inside of the cargo J, and provides the controller 21 with image data representing an image (hereinafter, referred to as an inspection image S2 (see FIG. 9)) representing a result of the inspection of the cargo J. Figure 7
[0138] The display device 25 has a display screen such as a liquid crystal display screen, and displays an image in accordance with a control of the controller 21. A transparent touch panel that receives an operation by sensing contact / proximity of a pointing body such as a finger can also be arranged on the display screen of the display device 25 in a superimposed manner.
[0139] When the controller 21 receives a provision of the image data representing the entrance image S1 from the camera 24, the controller 21 transmits a control signal for displaying the entrance image S1 to the display device 25 in accordance with the image data. The display device 25 displays the entrance image S1 on the display screen in accordance with the control signal when the display device 25 receives the control signal from the controller 21.
[0140] In addition, when the controller 21 receives a provision of the image data representing the inspection image S2 from the inspection device 22, the controller 21 transmits a control signal for displaying the inspection image S2 to the display device 25 in accordance with the image data. The display device 25 displays the inspection image S2 on the display screen in accordance with the control signal when the display device 25 receives the control signal from the controller 21.
[0141] The display screen of the display device 25 faces the inspector Q on the exit side of the inspection device 22, and the inspector Q visually confirms the entrance image S1 and the inspection image S2 displayed on the display screen.
[0142] [Operation of the inspection system]
[0143] Hereinafter, an example of the operation of the inspection system will be described. Figure 5 The inspector Q shown needs to respond to the result of the inspection of the cargo J corresponding to, for example, a warning detention or re-inspection, of the holder P who has entered the inside H from the outside L, and thus stands on the exit side of the inspection device 22. Therefore, the inspector Q can see the exit of the inspection device 22 via the transparent cover 27, but the entrance becomes a shadow (dead angle) of the inspection device 22 and cannot be seen.
[0144] The camera 24 photographs the entrance of the inspection device 22 via the transparent cover 26, and provides the controller 21 with image data representing the photographed entrance image S1. The controller 21 displays the entrance image S1 represented by the provided image data on the display device 25. The display device 25 displays the entrance image S1 on a display screen, which the inspector Q confirms. Thereby, the inspector Q confirms the result of the inspection of the cargo J by the inspection device 22, while monitoring the entrance of the inspection device 22 through the entrance image S1 photographed by the camera 24.
[0145] Figure 6 is a diagram showing an example of the entrance image S1 displayed on the display device 25 when the inspection device 22 does not detect an abnormality. During a period (i.e., a normal period) in which the inspection device 22 inspects the inside of the cargo J and does not detect an abnormality, the controller 21 displays the entrance image S1 provided by the camera 24 on the display device 25, as shown. Figure 6
[0146] The entrance image S1 is obtained by the camera 24 photographing the situation in which the cargo J is conveyed on the inside of the cover 26. In the example shown, the display device 25 displays the entrance image S1 on the entire area U0 of the display screen. The inspector Q, for example, monitors this entrance image S1, thereby confirming whether or not an abnormality such as a jam of the cargo J, a user's mistake of sticking a hand or the like into the inside, and the like occurs. Figure 6
[0147] On the other hand, when the inspection device 22 detects an abnormality, the controller 21 receives image data representing the above-described inspection image S2 as the result of the inspection. Then, the controller 21 causes the inspection image S2 displayed by the image data to be displayed on the display device 25. That is, the controller 21 switches the entrance image S1 being displayed to the inspection image S2 and displays it on the display device 25.
[0148] Figure 7 is a diagram showing an example of the inspection image S2 displayed on the display device 25 when the inspection device 22 detects an abnormality. The inspection device 22 analyzes a perspective image obtained by irradiating X-rays to the cargo J, thereby recognizing the shape / category of the contents of the cargo J. When a dangerous article is recognized in the contents of the cargo J (in the example shown, a gun), the controller 21 causes the inspection image S2 representing the dangerous article to be displayed on the display device 25. Figure 7 the example of a knife), the inspection device 22 determines that "an abnormality is detected" and generates, for example, a display in which a warning is written in the perspective image of the cargo J (in the example of "Warning!!") and obtains an inspection image S2 and provides it to the controller 21. Figure 7
[0149] The controller 21, upon receiving the inspection image S2 from the inspection device 22, causes the inspection image S2 to be displayed on the display device 25. That is, when the inspection device 22 inspects the inside of the cargo J and detects an abnormality (i.e., at the time of abnormality detection), the controller 21 switches the image displayed on the display device 25 from the entrance image S1 to the inspection image S2 as shown in FIG. 6. Figure 7
[0150] As described above, the inspection system 2 causes the entrance image S1 captured by the camera 24 which photographs the inside of the cover 26 to be displayed on the display device 25 in real time. Thereby, the monitor personnel can confirm whether the cargo J conveyed by the conveyer 23 is blocked at the entrance or the hand of the holder P is caught in the entrance. Also, when the inspection device 22 detects a dangerous article, the display of the display device 25 is switched, so the inspection personnel Q can pay attention to only the display screen of the display device 25.
[0151] Then, according to this inspection system 2, it is sufficient that the inspection personnel Q is arranged on the exit side of the inspection device 22, and it is not necessary to provide other monitor personnel who visually monitor the entrance side of the inspection device 22.
[0152] [Variation of the 2nd Embodiment]
[0153] The above-described 2nd embodiment is only one example of the implementation of the present application, and can be modified as follows. Also, two or more of the following variations can be combined as necessary.
[0154] [Variation 1]
[0155] In the above-described 2nd embodiment, the inspection device 22 provides the inspection image S2 to the controller 21 at the time of abnormality detection, but can provide the inspection image S2 to the controller 21 also at the time other than the time of abnormality detection. The inspection device 22 can provide the inspection image S2 to the controller 21 every time the inspection result is obtained, for example, regardless of whether the inspection result is abnormal or normal.
[0156] In this case, at the timing at which the inspection device 22 provides the inspection image S2, the controller 21 causes the inspection image S2 to be displayed on the display device 25 for a certain time, and causes the entrance image S1 to be displayed on the display device 25 for the rest of the time. That is, at the timing at which the inspection result is obtained, the controller 21 switches the entrance image S1 to the inspection image S2 and displays it on the display device 25.
[0157] Figure 8 is a view showing an example of the inspection image S2 displayed at the timing when the inspection result is obtained. In the case where the entrance image S1 shown in Figure 6 is displayed on the display device 25, if the inspection device 22 obtains the inspection result of the cargo J and provides the inspection image S2, the controller 21 causes the inspection image S2 shown in Figure 8 to be displayed on the display device 25 for a certain time, for example, for several seconds. Then, after the certain time elapses, the controller 21 causes the original entrance image S1 to be displayed on the display device 25. Thereby, for example, at the timing when the inspection result is obtained, the inspection personnel Q watches the inspection image S2 for a certain time regardless of the contents of the inspection. As a result, for example, in the case where the inspection of the inspection device 22 is omitted, the inspection image S2 is displayed at the timing when the inspection result is obtained, and thus the inspection personnel Q is likely to find the abnormality.
[0158] [Modified Example 2]
[0159] In the above-described second embodiment, the controller 21 switches the entrance image S1 and the inspection image S2 to be displayed on the display device 25, but they can be displayed simultaneously. Figure 9 is a view showing an example of the entrance image S1 and the inspection image S2 displayed simultaneously by the display device 25. The display screen of the display device 25 is divided into two halves left and right, and the entrance image S1 is displayed in the left region U1 and the inspection image S2 is displayed in the right region U2, respectively. Thereby, the inspection personnel Q confirms the entrance image S1 and the inspection image S2 simultaneously. Figure 9
[0160] [Modified Example 3]
[0161] In addition, in the case where the display device 25 displays the entrance image S1 and the inspection image S2 on the display screen simultaneously, the attributes of the regions in which the entrance image S1 and the inspection image S2 are displayed, such as the areas, positions, shapes, thicknesses or colors of the boundary lines, presence or absence of flicker, and the like can be different.
[0162] For example, the display device 25 divides the display screen into a region of a rectangle having a width and a height each of which is less than half of the entire display screen and a region other than the region. Then, the display device 25 can simultaneously display the entrance image S1 and the inspection image S2 in the two regions having different areas, respectively. In this way, in the case where the areas of the regions obtained by dividing the display screen are different, the amount of information of the image that the inspection personnel Q can watch in detail differs depending on the regions, and thus it is preferable to display the image that needs to be more carefully monitored in the region having a larger area.
[0163] For example, the display device 25 simultaneously displays the inspection image S2 in the region having a smaller area and the entrance image S1 in the region having a larger area, respectively.
[0164] Thus, the inspector Q confirms the entrance image S1 and the inspection image S2 at the same time. The inspector Q monitors the entrance image S1 displayed in a region having a larger area compared to the region in which the inspection image S2 is displayed more carefully than the inspection image S2.
[0165] [Modified example 4]
[0166] In the case where the display device 25 displays the entrance image S1 and the inspection image S2 in the display screen at the same time, the images displayed in the divided two regions can be switched depending on whether the inspection device 22 detects an abnormality or not.
[0167] For example, when the inspection device 22 detects an abnormality and notifies the controller 21 of the content, the controller 21 instructs the display device 25 to exchange the display of the divided two regions. As a result, the display device 25 displays the entrance image S1 in the region having a smaller area and the inspection image S2 in the region having a larger area at the same time, respectively.
[0168] Thus, the inspector Q confirms the entrance image S1 and the inspection image S2 at the same time. The inspector Q monitors the entrance image S1 displayed in a region having a larger area compared to the region in which the inspection image S2 is displayed more carefully than the inspection image S2.
[0169] [Modified example 5]
[0170] In the above-described embodiment, the controller 21 switches the image displayed in the display device 25 at the time of abnormality detection from the entrance image S1 to the inspection image S2. That is, in the above-described embodiment, the controller 21 switches the display of the display device 25 depending on the inspection result of the cargo J inspected by the inspection device 22, but can switch the display of the display device 25 depending on the placement state of the cargo J placed by the holder P on the conveyor 23.
[0171] Figure 10 is a diagram for explaining the placement state of the cargo J. Figure 10 The cargo J illustrated is a large handbag or the like. Figure 10 The cargo J illustrated has a height larger than the height and the width of the cover 26. Figure 10 The cover 26 illustrated covers the upper side of the conveyance path of the conveyor 23 on the entrance side of the inspection device 22. The conveyor 23 conveys the cargo J placed on the conveyance path in the arrow direction illustrated and moves it into the entrance of the inspection device 22 through the conveyance space S surrounded by the cover 26 and the conveyor 23. Figure 10 The cargo J placed on the conveyance path is conveyed in the arrow direction illustrated and moved into the entrance of the inspection device 22 through the conveyance space S surrounded by the cover 26 and the conveyor 23.
[0172] Thus, Figure 10The cargo J shown is more likely to contact and jam in the height direction or the width direction of the cover 26 if not placed in the length direction along the conveying direction.
[0173] Figure 11 is a view showing an example of the entrance image S1 when the placement state of the cargo J is abnormal. The cargo J is tipped over in the width direction of the conveyor 23 before entering the conveying space S, and thus as shown in Figure 11 the upstream end of the cover 26 remains in contact and cannot be conveyed.
[0174] The controller 21 analyzes the entrance image S1 provided by the camera 24. The controller 21 acquires the entrance image S1 for a short period, for example, every 1 second, and detects the outline of the object imaged for each entrance image S1, and analyzes the state of the cargo J by determining the change in the outline over time.
[0175] When analyzing the entrance image S1 shown in Figure 11 the controller 21 detects that the cargo J has not moved for a prescribed period at the upstream end of the cover 26. As a result, the controller 21 determines that the placement state of the cargo J is abnormal, and instructs the display device 25 to display the entrance image S1. That is, the inspection system 2 switches the display of the display device 25 according to the placement state of the cargo J placed on the conveyor 23 by the holder P. Thereby, the inspector Q recognizes the case where the placement state of the cargo J is abnormal.
[0176] [Modification 6]
[0177] Each region of the display screen can be a region in which the properties of the area, position, shape, thickness or color of the boundary line, presence or absence of flicker, and the like are changed. Also, these properties can be changed according to the inspection result of the cargo J or the degree of abnormality of the placement state of the cargo J.
[0178] For example, the controller 21 or the inspection device 22 classifies the above-described inspection result or placement state into three stages of "dangerous", "caution", "monitoring required", and the like according to the degree of abnormality. Here, "dangerous" is a stage in which the degree of abnormality is higher than "caution", and "caution" is a stage in which the degree of abnormality is higher than "monitoring required". The controller 21 adjusts the properties of each region according to these stages so that the area of the region displaying important content can be made larger.
[0179] For example, if the degree of abnormality of the above-described inspection result and placement state is classified as "monitoring required", the controller 21 causes the display device 25 to display the entrance image S1 and the inspection image S2 respectively in the regions allocated as shown in Figure 9 In this case, the inspector Q watches the entrance image S1 and the inspection image S2 displayed respectively in the regions of the same area, and thus pays attention to both of them equally.
[0180] On the other hand, when the degree of abnormality of the inspection result and the degree of abnormality of the placement state are classified as "dangerous" and "monitoring required", respectively, the controller 21 causes the display device 25 to divide the display screen into regions corresponding to the respective degrees of abnormality. Then, the controller 21 changes the allocation and displays the entrance image S1 and the inspection image S2 in the divided regions.
[0181] That is, the inspection image S2 of the inspection result judged to be more dangerous (higher degree of abnormality) is displayed in a region having a larger area. On the other hand, the entrance image S1 of the placement state judged to be not dangerous (lower degree of abnormality) compared to the inspection result is displayed in another region having a smaller area than the above region. In this case, the inspection personnel Q pays more attention to the inspection image S2 than to the entrance image S1.
[0182] [Modified Example 7]
[0183] In the above embodiment, the cover 26 is provided so as to cover the region upstream of the conveyance direction of the conveyor 23 from the entrance of the inspection device 22, and the cover 27 is provided so as to cover the region downstream of the conveyance direction of the conveyor 23 from the exit of the inspection device 22. The inspection system 2 can be provided with only either of these covers. That is, the inspection system 2 can be provided with the cover at least one of the entrance of the inspection device 22 and the exit of the inspection device 22 from which the goods J are carried out. In this case, it is also possible that the camera 24 captures the inside of the cover, and the controller 21 causes the display device 25 to display the image captured by the camera 24.
[0184] [Modified Example 8]
[0185] In the above embodiment, both the cover 26 and the cover 27 are composed of transparent members, and the inside is visible from the outside. However, it is also possible that at least a part of the inside is visible from the outside.
[0186] Figure 12 is a view showing an example of the cover 26 in which a part of the inside is visible from the outside. Figure 12 The cover 26 shown is composed of a plurality of lines 28 arranged in a lattice shape. The lines 28 have gaps A from each other, and thus the inside of the cover 26 is visible. That is, in the cover 26 shown, the inside is visible from the outside through the gaps A. Figure 12 In the cover 26 shown, a part of the inside is visible from the outside through the gaps A.
[0187] [Modified Example 9]
[0188] In addition, it is also possible that a region of the inner wall surface of the cover 26 or the cover 27 which comes into contact with the goods J is covered with a member having a smaller friction than the cover 26 or the cover 27. Figure 13is a view of an example in which the region of the inner wall surface of the cover 26 that comes into contact with the cargo J is covered with the film 29. Figure 13 The film 29 shown is a member formed of a transparent material having a smaller coefficient of friction than the material of the cover 26, which covers the region of the inner wall surface of the cover 26 that comes into contact with the cargo J.
[0189] For example, in the case where the cover 26 is formed of a material such as glass or an acrylic resin, a polycarbonate resin, or the like, if the cargo J is formed of a material such as leather or a vinyl-based material, it is difficult to slide in the case of direct contact, and clogging is likely to occur.
[0190] The film 29 is formed of a transparent material having a smaller coefficient of friction than the material of the cover 26, and therefore the cargo J does not come into direct contact with the cover 26, and even if the cargo J comes into contact with the film 29, it slides, and therefore, as shown, Figure 13 compared to the case where the cover 26 is not covered with the film 29, clogging is less likely to occur.
[0191] [Modified Example 10]
[0192] The program executed by the controller 21 of the inspection system 2 can be provided in the state of a recording medium that can be read by a computer device such as a magnetic recording medium such as a magnetic tape or a magnetic disk, an optical recording medium such as an optical disk, an optical magnetic recording medium, a semiconductor memory, or the like. Also, the program can be downloaded by transmission through a communication line such as the Internet. In addition, as the control unit exemplified by the above-described controller 21, various devices are sometimes applied in addition to a CPU, such as the use of a dedicated processor or the like.
[0193] [3rd Embodiment]
[0194] Figure 14A and Figure 14B (Figures 14, hereinafter, are collectively referred to as Fig. 14) show the appearance of the inspection system 3 of the embodiment. In Figure 14A , the inspection system 3 is shown as viewed from directly above, and in Figure 14B , the inspection system 3 is shown as viewed in the horizontal direction.
[0195] The inspection system 3 is a system for inspecting whether or not an entrant has brought in a prohibited article such as a knife or the like (prohibited article) at a place where an event venue or the like is entered, for example. The inspection system 3 inspects a cargo J1 shown in Fig. 14, for example. The inspection system 3 is used by an inspector Q who performs the work of the inspection.
[0196] The inspection system 3 is provided with a conveyance device 310, an inspection device 320, a camera 330, and a control device 340. The conveyance device 310 is a belt conveyor that conveys the cargo J1 in the conveyance direction Al l, and forms a conveyance path Dl. In the inspection system 3, an inspection personnel Q is arranged on either side of the conveyance path Dl, and an inspection passage through which a holder of the cargo J1 passes is provided on the side opposite the inspection personnel Q.
[0197] The inspection device 320 is a device that photographs a perspective image obtained by perspective-conveying the cargo. The perspective image is an image used for inspection of the cargo. The inspection device 320, for example, irradiates the cargo J1 passing through a perspective photographing region D2 in the device with electromagnetic waves, and generates an image drawn in accordance with the depth corresponding to the intensity of the electromagnetic waves that have been perspective-conveyed by the cargo J1, as a perspective image of the cargo J1. The electromagnetic waves irradiated by the inspection device 320 are electromagnetic waves of a frequency band that are transmitted through the cargo J1 but have different transmission rates in accordance with the material of the contents of the cargo J1, and are, for example, X-rays.
[0198] The camera 330 is provided above the entrance side of the inspection device 320 in the vertical direction. The camera 330 has an image sensor that detects visible light, and photographs a photographing object represented by the visible light. The camera 330 is provided in such a manner that a visible light photographing region D3 determined at a position more upstream than the perspective photographing region D2 determined in the conveyance path Dl falls within the angle of view. The camera 330 repeatedly photographs an appearance image of the appearance of the cargo J1 conveyed by the conveyance device 310 and passing through the visible light photographing region D3, which is shown by the visible light. The visible light photographing region D3 is an example of the "predetermined region" of the present application.
[0199] The control device 340 is a device that controls the operation of each device provided in the inspection system 3. The control device 340 is a computer provided with a processor such as a CPU (Central Processing Unit), a memory, a storage, and a communication unit. The control device 340 is electrically connected to the conveyance device 310, the inspection device 320, and the camera 330 via a wire not shown. The control device 340 controls the operation of each device while exchanging data with each device electrically connected.
[0200] In addition, the control device 340 is also connected to a display, and displays an image on the display. The control device 340 realizes the functions shown by reading a predetermined software (program) on a hardware such as a memory, performing an operation by a processor, and controlling at least one of the communication of each communication device or the reading and writing of data of the memory and the storage. Figure 15
[0201] Figure 15 The functional configuration implemented by the control device 340 is shown. The control device 340 is provided with a conveyance control section 341, an appearance image acquisition section 342, a perspective image acquisition section 343, a time of arrival determination section 344, an image correlation section 345, and an image display section 346. The conveyance control section 341 controls the conveyance of the goods Jl by the conveyance device 310. The conveyance control section 341 causes the conveyance of the goods Jl to start and end, for example, in accordance with the operation of the inspector Q.
[0202] The conveyance control section 341 causes the belt conveyer to rotate at a predetermined conveyance speed or a conveyance speed set by the inspector Q after the conveyance is started. The conveyance control section 341 notifies the time of arrival determination section 344 of the conveyance speed in control. The appearance image acquisition section 342 controls the camera 330 to repeatedly take a photograph of the visible light photographing region D3, thereby acquiring an appearance image of the goods Jl passing through the visible light photographing region D3. The appearance image acquisition section 342 supplies the acquired appearance image to the time of arrival determination section 344.
[0203] The perspective image acquisition section 343 controls the inspection device 320 to repeatedly take a photograph of the perspective photographing region D2, thereby acquiring a perspective image of the goods Jl passing through the perspective photographing region D2. The perspective image acquisition section 343 supplies the acquired perspective image to the time of arrival determination section 344. The time of arrival determination section 344 determines the time at which the goods Jl arrives at the visible light photographing region D3 (hereinafter referred to as "second time of arrival") from the time at which the goods Jl arrives at the perspective photographing region D2 (hereinafter referred to as "first time of arrival").
[0204] The time of arrival determination section 344 determines the time at which the central region of the goods Jl arrives at the reference position within the perspective photographing region D2 as the first time of arrival, and determines the second time of arrival of the goods Jl from the determined first time of arrival.
[0205] Figure 16A to Figure 16C An example of the reference position and the central region is shown in the following drawings. In Fig. 16, the reference position E2 and the central region Fl of the perspective photographing region D2 are respectively indicated by double-dot chain lines. In Fig. 16, the inspection device 320 and the camera 330 are omitted for easy observation of the drawing.
[0206] In the example of Fig. 16, as the reference position E2, a position at which the distance from the leading end and the distance from the trailing end of the conveyance direction Al l of the perspective photographing region D2 are both Ll is determined. In other words, as the reference position E2, a position that is the center of the perspective photographing region D2 in the conveyance direction Al l is determined. Also, in the example of Fig. 16, as the central region Fl, a region of a rectangle that contains the center of the article Jl is determined. Specifically, as the central region Fl, a region in which the distance from the leading end and the distance from the trailing end of the conveyance direction Al l of the article Jl are both L3 is determined.
[0207] As the distance L3, for example, a distance that is a prescribed proportion of the length L2 of the conveyance direction Al l of the article Jl is determined. For example, in a case where the prescribed proportion is set to 40%, distance L3 = distance L2 x 0.4, and the length L4 of the conveyance direction Al l of the central region Fl is distance L2 x 0.2. Also, as the central region Fl, a region in which the distance from the left end and the distance from the right end of the width direction A12 (a direction perpendicular to the conveyance direction Al l) of the conveyance device 310 are both L6 is determined.
[0208] As the distance L6, for example, a distance that is a prescribed proportion of the length L5 of the width direction A12 of the article Jl is determined. For example, in a case where the prescribed proportion is set to 40%, distance L6 = distance L5 x 0.4, and the length L7 of the width direction A12 of the central region Fl is distance L5 x 0.2. The arrival time determination section 344 detects the article (in the example of Fig. 16, the article Jl) that is being conveyed using image recognition technology based on the perspective images repeatedly supplied from the perspective image acquisition section 343.
[0209] In Figure 16A , the article Jl is also positioned further forward than the perspective photographing region D2, so detection of the article Jl has not yet been performed. In Figure 16B , the entire article Jl is contained in the perspective photographing region D2, so the arrival time determination section 344 detects the article Jl based on the perspective image. The arrival time determination section 344 calculates the coordinates of the leading end and the trailing end of the conveyance direction Al l of the detected article Jl and the coordinates of the left end and the right end of the width direction A12 of the article Jl based on a coordinate system (for example, a two-dimensional coordinate system with the upper left corner of the perspective image as the origin) set with respect to the perspective image.
[0210] The arrival time determination section 344 calculates, for example, the coordinates of the four corners of the central region Fl based on the calculated coordinates as the coordinates of the central region Fl determined as described above. The arrival time determination section 344 calculates the coordinates of the central region Fl each time a perspective image is supplied, and as Figure 16CAs shown, the time when the calculated coordinates reach the reference position E2 of the perspective shooting area D2 is determined as the time when the central area F1 reaches the reference position E2, that is, the first arrival time.
[0211] That is, the arrival time determination unit 344 determines the time when the front end of the conveying direction A11 of the central region F1 reaches the reference position E2 as the first arrival time. The arrival time determination unit 344 stores in advance the distance between the perspective imaging area D2 and the visible light imaging area D3.
[0212] Figure 17 The perspective imaging area D2 and the visible light imaging area D3 are magnified and shown. The arrival time determination unit 344 pre-stores the distance L11 between the reference position E2 of the perspective imaging area D2 and the transport direction A11 of the reference position E3 of the visible light imaging area D3.
[0213] exist Figure 17 In the example, the reference position E3 is the position where the distance from the front end and the distance from the rear end of the visible light imaging area D3 are equal (both are distances L12). The arrival time determination unit 344 calculates the value obtained by dividing the distance L11 by the conveying speed V1 notified by the conveying control unit 341 as a value representing the time required to convey the goods J1 from the reference position E3 to the reference position E2 (hereinafter referred to as "conveying time").
[0214] The arrival time determination unit 344 determines the second arrival time as the time obtained by tracing back the calculated transport time from the determined first arrival time. The arrival time determination unit 344 notifies the determined first arrival time and second arrival time to the image association unit 345. The image association unit 345 associates the appearance image captured by the camera 330 with the perspective image captured by the inspection device 320 based on the notified first arrival time and second arrival time, that is, the first arrival time and second arrival time determined by the arrival time determination unit 344.
[0215] Specifically, the image association unit 345 associates the appearance image of the cargo J1 captured by the camera 330 at the second arrival time determined by the arrival time determination unit 344 with the perspective image of the cargo J1 captured by the inspection device 320 at the first arrival time determined by the arrival time determination unit 344. The image association unit 345 provides the associated appearance image and perspective image to the image display unit 346. The image display unit 346 displays the provided appearance image and perspective image together.
[0216] Figure 18 An example of a displayed exterior image and perspective image is shown. Figure 18In the example of FIG. 1, the image display section 346 displays the see-through image K1 and the appearance image K2 side by side on the inspector screen H1. The inspector Q observes the displayed see-through image and determines whether the entrant has brought in a prohibited article. Figure 18 In the example of FIG. 1, a knife as a prohibited article is brought in, and therefore the inspector Q observes the appearance image displayed together, distinguishes the article J1 carried out from the inspection device 320 from other articles, and picks up the article J1 from the conveyance path D1 to confirm the contents at a place for re-inspection.
[0217] The control device 340 performs the association process of associating the acquired see-through image and appearance image according to the above-described configuration.
[0218] Figure 19 An example of the operation of the control device 340 in the association process is shown. First, the control device 340 (conveyance control section 341) conveys the article J1 by the conveyance device 310 (step S11). Next, the control device 340 (appearance image acquisition section 342) repeatedly performs imaging by the camera 330 and acquires the appearance image of the article J1 passing through the visible light imaging region D3 (step S12).
[0219] Next, the control device 340 (see-through image acquisition section 343) repeatedly performs imaging by the inspection device 320 and acquires the see-through image of the article J1 passing through the see-through imaging region D2 (step S13). Next, the control device 340 (arrival time determination section 344) determines the time at which the article J1 arrives at the see-through imaging region D2 as a first arrival time (step S14). Next, the control device 340 (arrival time determination section 344) determines the time at which the article J1 arrives at the visible light imaging region D3 as a second arrival time (step S15).
[0220] Next, the control device 340 (image association section 345) associates the appearance image of the article J1 imaged by the camera 330 at the second arrival time determined in step S15 with the see-through image of the article J1 imaged by the inspection device 320 at the first arrival time determined in step S14 (step S16). Then, the control device 340 (image display section 346) displays the appearance image and the see-through image associated with each other together (step S17).
[0221] As a method of associating the appearance image and the see-through image, a method of detecting the timing of conveying the article by a sensor and imaging the article and associating the see-through image is considered, but the article has various shapes, and in addition, the shape is not limited to a certain shape, and therefore the detection by the sensor is sometimes too fast or too slow, and thus the see-through image imaged and the appearance image cannot be associated at an appropriate timing.
[0222] In the present embodiment, the time when the central region Fl of the article Jl reaches the reference position E2 is determined as the first arrival time. In contrast, for example, in a case where the time when the leading end of the article reaches the reference position E2 is determined as the first arrival time, if the article is a handbag or the like and a strap for hanging on the shoulder extends long to the front, a part or all of the contents of the article can not be reflected in the perspective image. In the present embodiment, the first arrival time is determined based on the central region Fl of the article Jl, and thus, as compared with a case where the third arrival time is determined based on the leading end of the article, it is difficult for the contents of the article to not be reflected in the perspective image.
[0223] In addition, in the present embodiment, the time when the central region Fl of the article Jl reaches the reference position E2 is determined as the first arrival time. In contrast, for example, in a case where the time when the leading end of the article reaches the reference position E2 is determined as the first arrival time, if the article is a handbag or the like and a strap for hanging on the shoulder extends long to the front, a part or all of the contents of the article can not be reflected in the perspective image. In the present embodiment, the first arrival time is determined based on the central region Fl of the article Jl, and thus, as compared with a case where the third arrival time is determined based on the leading end of the article, it is difficult for the contents of the article to not be reflected in the perspective image.
[0224] [4th Embodiment]
[0225] In the third embodiment, the time when the article Jl reaches the visible light imaging region D3 is determined based on the time when the article Jl reaches the perspective imaging region D2 (the first arrival time), but in the fourth embodiment, in contrast, the time when the article Jl reaches the perspective imaging region D2 is determined based on the time when the article Jl reaches the visible light imaging region D3.
[0226] In the present embodiment, the appearance image and the perspective image of the article Jl are supplied to the arrival time determination section 344. However, in the present embodiment, the arrival time determination section 344 determines the time when the article Jl reaches the perspective imaging region D2 on the downstream side of the visible light imaging region D3 in the conveyance road Dl (hereinafter referred to as "fourth arrival time") based on the time when the article Jl reaches the visible light imaging region D3 (hereinafter referred to as "third arrival time").
[0227] In detail, the arrival time determination section 344 determines the imaging time of the appearance image as the third arrival time when the article Jl is recognized from the central region of the appearance image imaged by the camera 330.
[0228] Figure 20A to Figure 20C An example of the imaged appearance image is shown in FIG. 20. The appearance image acquisition section 342 repeatedly acquires the appearance image of the article Jl, and thus, as shown in FIG. 20, the appearance image of the article Jl is imaged at the third arrival time, the fourth arrival time, and the fifth arrival time. Figure 20A 、 20BAs shown in FIG. 20, the image pickup device 320 acquires images of the article Jl moving little by little in the conveyance direction Al l as appearance images Kl l, Kl2, Kl3 (referred to as "appearance image K10" without distinction).
[0229] In FIG. 20, the central region Fl l is shown as a region in the center of the conveyance direction Al l of the appearance image K10. The central region Fl l is a region of the appearance image K10 that is apart from the front end and the rear end of the conveyance direction Al l by a distance L13 or more, and the length in the width direction A12 of the conveyance path Dl is the same as the length in the width direction A12 of the appearance image K10. In the central region Fl l, the image pickup device 320 acquires the appearance image K10 of the article Jl. Figure 20A In the case of FIG. 20A, the article Jl has not yet reached the central region Fl l.
[0230] In the case of FIG. 20B, the front end of the article Jl has reached the central region Fl l, but only one-third of the entire article Jl has reached the central region Fl l. In the case of FIG. 20C, two-thirds of the entire article Jl has reached the central region Fl l. Figure 20B In the case of FIG. 20B, the front end of the article Jl has reached the central region Fl l, but only one-third of the entire article Jl has reached the central region Fl l. In the case of FIG. 20C, two-thirds of the entire article Jl has reached the central region Fl l. Figure 20C In the case of FIG. 20B, the front end of the article Jl has reached the central region Fl l, but only one-third of the entire article Jl has reached the central region Fl l. In the case of FIG. 20C, two-thirds of the entire article Jl has reached the central region Fl l.
[0231] In the case of two-thirds, the arrival time determination section 344 determines the time at which the appearance image Kl3 was acquired as the third arrival time. The arrival time determination section 344, like the third embodiment, calculates the conveyance time (the time required to convey the article Jl from the reference position E3 of the visible light photographing region D3 to the reference position E2 of the see-through photographing region D2), and determines the time obtained by tracing back the calculated conveyance time from the determined third arrival time as the fourth arrival time.
[0232] The arrival time determination section 344 notifies the image correlation section 345 of the determined third arrival time and the fourth arrival time. The image correlation section 345 correlates the see-through image of the article Jl photographed during the period corresponding to the notified third arrival time with the appearance image of the article Jl obtained by the camera 330 photographing the article Jl at the time at which the article Jl arrived at the visible light photographing region D3. The image correlation section 345, for example, uses the third arrival time itself as the period corresponding to the third arrival time.
[0233] In this case, the image correlation section 345 correlates the see-through image of the article Jl photographed by the inspection device 320 at the third arrival time determined by the arrival time determination section 344 (the period corresponding to the third arrival time) with the appearance image of the article Jl photographed by the camera 330 at the fourth arrival time determined by the arrival time determination section 344 (the time at which the article Jl arrived at the visible light photographing region D3).
[0234] As long as the timing at which the article J1 reaches the visible light imaging region D3, the 3rd arrival timing, and the conveyance speed of the article J1 are known, the 4th arrival timing at which the article J1 reaches the perspective imaging region D2 determined in association with the visible light imaging region D3 can be accurately determined. That is, according to the present embodiment, as with the 3rd embodiment, the perspective image and the image of the article can be associated with each other at an appropriate timing regardless of the state of the article J1.
[0235] In addition, in the present embodiment, in a case where the article J1 is recognized from the central region F11 of the appearance image, the timing at which the appearance image is imaged is determined as the 3rd arrival timing. Thereby, as with the 3rd embodiment, as compared with a case where the 3rd arrival timing is determined in association with the leading end of the article, it is possible to make it difficult for the contents of the article to be reflected in the perspective image.
[0236] [Modified example of the 3rd or 4th embodiment]
[0237] The above-described 3rd and 4th embodiments are only one example of the implementation of the present application, and can be modified as follows. Moreover, two or more of the following modified examples can be combined as needed.
[0238] [Modified example 1]
[0239] In the 3rd embodiment, the method of determining the central region of the article (a region whose distance from the leading end and distance from the trailing end in the conveyance direction Al l are both L3 (see Fig. 16)) is not limited to the above-described method. For example, the distance from the leading end and the distance from the trailing end can be set to be slightly different from each other. These are methods of determining the central region in association with the distance from the end of the article.
[0240] On the other hand, there is also a method of determining the central region in association with the arrangement of the pixel group representing the article. For example, a region including the center of gravity of the pixel group representing the article in the perspective image is determined as the central region. The center of gravity of the pixel group refers to a point represented by the average value of the x coordinates and the average value of the y coordinates of the pixels.
[0241] Figure 21A and Figure 21B An example of the central region of the article representing the present modified example is shown. In Figure 21A , the center of gravity Ml l of the article Jl and the central region F11 centered on the center of gravity Ml l are shown.
[0242] The article Jl is in a shape in which a main body Jl l housing the contents is provided with a relatively short handle Jl 2. In the case of the article Jl, the handle Jl 2 is relatively short, and therefore the distance of the center of gravity Ml l from the center point Ml 2 whose distances from both ends in the conveyance direction Al l and the width direction A 12 are equal is relatively short. In the case of the article Jl, the center of gravity Ml 1 is located in the central region F11.Figure 21B The image shows the center of gravity M11a of cargo J2 and the central region F12a centered on the center of gravity M11a. Cargo J2 is shaped by a main body J21 that houses the contents, with a long handle J22.
[0243] In the case of cargo J2, the body J21 is rectangular with a slender handle J22. Therefore, compared to cargo J1, the center of gravity M11a is farther from the center point M12a, which is equidistant from both ends in the conveying direction A11 and the width direction A12. Furthermore, the length direction of the handle J22 is along the conveying direction A11. Because the center point and center of gravity of the cargo are offset in the conveying direction A11, the image of the perspective imaging area D2 used to determine the first arrival time is also different.
[0244] Figure 22A and Figure 22B An example image of the perspective-captured area D2 is shown. Figure 22A The image shows a perspective image K31 taken when the center point M12a of the cargo J2 reaches the reference position E2 of the perspective shooting area D2. In this case, the image of the main body J21 containing the contents is close to the end of the perspective image K31, but the entire cargo J2 is contained within the perspective image K31.
[0245] exist Figure 22B The image shows a perspective image K32 taken when the center of gravity M11a of cargo J2 reaches the reference position E2 of the perspective imaging area D2. In this case, the image of the main body J21 containing the contents is close to the center of the perspective image K32, but a part of the handle J22 protrudes from the perspective image K32. The handle is normally not dangerous, but if it is known that part of the handle will not be reflected in the perspective image, it is possible to place a dangerous item there.
[0246] Therefore, from the perspective of not overlooking prohibited items, it is preferable to use the center point M12a of the cargo J2, as in perspective image K31. However, in this case, the appearance image captured by camera 330 at the determined second arrival time will also show the main body J21 of the cargo J2 at a position away from the center of the appearance image, just like perspective image K31. The appearance image can be taken within the same range as the perspective image, but if the shooting range of the appearance image is smaller than that of the perspective image, the main body J21 of the cargo J2 may protrude from the appearance image.
[0247] Therefore, the center point is used in the perspective image, but the center of gravity can also be used in the appearance image. In this case, the arrival time determination unit 344 adjusts the time from the time when the cargo J2 arrives at the visible light shooting area D2 to the time when the cargo J2 arrives at the perspective shooting area D2 based on the offset of the central region F12 of the cargo J2 in the perspective image K31 relative to the reference position E2 of the perspective image K31, and uses the adjusted time to determine the second arrival time.
[0248] exist Figure 22A In the example, the distance L21 between the center point M12a of cargo J2 and the conveying direction A11 of the central region F12 is called the offset. The arrival time determination unit 344 calculates, for example, the time required for the conveying offset, i.e., the distance L21 (hereinafter referred to as "offset time"), based on the current conveying speed. Moreover, the arrival time determination unit 344 calculates the conveying time (the time required to convey cargo J2 from the reference position E3 to the reference position E2) in the same way as in the third embodiment.
[0249] The arrival time determination unit 344 adjusts the calculated delivery time by subtracting the calculated offset time, and determines the second arrival time as the time obtained by subtraction from the first arrival time. By performing this adjustment, the entire cargo is reflected in the perspective image, and the main parts of the cargo can be easily reflected in the appearance image. The main parts of the cargo refer to the parts representing the main shape of the cargo; in the case of cargo J2, this is the main body J21.
[0250] [Variation Example 2]
[0251] In the above variation, the arrival time is determined by taking into account the offset caused by the handle J22 of cargo J2, but a mechanism to reduce this offset can also be provided.
[0252] Figure 23A to Figure 23D (Hereinafter referred to collectively as FIG23) shows the inspection system 3b of this modified example. In the example of FIG23, a cargo J3 is shown having a main body J31 for storing contents and a flexible, slender handle J32 connected to the main body J31.
[0253] The inspection system 3b is provided with an approach mechanism 350 located upstream of the visible light imaging area D3, which allows the handle J32, extending outward from the main body J31 of the cargo J3, to approach the main body J31. The approach mechanism 350 is an example of the "mechanism" of this invention. The approach mechanism 350 is a plate-shaped mechanism formed of a highly elastic material such as rubber, with a contact portion 351 formed by the seamless arrangement of elongated rod-shaped portions at one end.
[0254] Regarding the approach mechanism 350, contact part 351, as follows: Figure 23AAs shown, it is fixed at a position upstream of the visible light imaging area D3. Figure 23B As shown, the lower end of the contact portion 351 contacts the conveying device 310 at the height that, when the cargo J3 is conveyed, such as Figure 23C and Figure 23D As shown, the contact part 351 pulls the handle J32 in the opposite direction to the conveying direction A11, thereby bringing it closer to the main body J31. Due to its elasticity, it bends along the conveying direction A11, thereby allowing the main body J31 to pass through.
[0255] The approach mechanism 350 brings the handle J32 close to the main body J31, thereby enabling the entire cargo to be reflected in the perspective image compared to the case without the approach mechanism 350, and making it easy to reflect the main part of the cargo in the appearance image.
[0256] [Variation Example 3]
[0257] In the fourth embodiment, an inspection device 320 for photographing goods and a camera 330 are used, but in addition, a sensor for detecting objects can also be used.
[0258] Figure 24 The inspection system 3c of this modified example is shown. (As shown) Figure 24 As shown, the inspection system 3c has an object detection sensor 360 located upstream of the visible light imaging area D3 in the transport direction A11.
[0259] The object detection sensor 360 includes a light-emitting unit 361 and a light-receiving unit 362. The light-emitting unit 361 and the light-receiving unit 362 are arranged facing each other at one end and the other end of the width direction A12 of the conveying device 310. For example, an object is not detected while the light-receiving unit 362 receives light emitted by the light-emitting unit 361, and an object is detected when the amount of light received by the light-receiving unit 362 decreases to a certain level. The object detection sensor 360 is positioned at the object detection location within the visible light imaging area D3.
[0260] In this modified example, the arrival time determination unit 344 determines the first arrival time of the goods arriving at the visible light imaging area D3 based on the period during which the object detection sensor 360 detects the object (hereinafter referred to as the "detection period") when it detects the presence of an object in the visible light imaging area D3.
[0261] Figure 25 This illustrates an example of object detection status. In Figure 25 In the example, the object detection sensor 360 detects an object during the detection period T1 from time t1 to t2.
[0262] The arrival time determination unit 344 determines the first arrival time, for example, the exact midpoint of the detection period T1 (the moment when half of the detection period T1 has elapsed from time t1). For example, when the goods are transparent or reflective like a mirror, it can sometimes be difficult to identify the goods based on the captured appearance image. According to this modified example, even in cases where it is difficult to identify the goods based on the appearance image, as long as the object can be detected by the object detection sensor 360, the time when the goods arrive at the visible light imaging area D3 can be determined.
[0263] [Variation Example 4]
[0264] The types of inspections performed by inspection system 3 are not limited to those described in embodiments 3 and 4. For example, inspections can be conducted by taking X-ray images using millimeter waves or terahertz waves instead of X-rays. Furthermore, inspections can be performed to detect liquids (suspected explosives) contained in personal belongings, or to detect traces of explosives. In any case, the entry inspection system is equipped with inspection devices to perform these inspections. In short, any inspection can be performed as long as it is used to detect prohibited items or prevent dangers in the venue.
[0265] [Variation Example 5]
[0266] In the third or fourth embodiment, the inspection of goods was described at the event venue. However, it can also be carried out at the entrances of transportation vehicles such as airports, train stations, ports, and bus terminals, as well as at the entrances of facilities such as concert venues, sports stadiums, open-air stadiums, and art galleries. In short, as long as it is necessary to check the contents of the goods of attendees at the entrance for security reasons, the inspection of goods can be carried out at any location (entrance).
[0267] Label Explanation
[0268] 1: Inspection system; 2: Inspection system; 3: Inspection system; 10: First conveyor; 20: Second conveyor; 21: Controller; 22: Inspection device; 23: Conveyor; 24: Camera; 25: Display device; 26: Cover; 27: Cover; 28: Wire; 29: Membrane; 30: Inspection device; 31: Housing; 32: Internal space; 33: Opening; 40: Protective cover; 41: Upper surface; 42: Side surface; 43: Side surface; 50: Camera; 60: Control device; 70: Display; 71: Display surface; 310: Conveying device; 320: Inspection device; 330: Camera; 340: Control device; 341: Conveying control unit; 342: Appearance image acquisition unit; 343: Perspective image acquisition unit; 344: Arrival time determination unit; 345: Image association unit; 346: Image display unit; 350: Proximity mechanism; 351: Contact part; 360: Object detection sensor; 361: Light-emitting part; 362: Light-receiving part; 411: Upper surface; 412: Back upper surface.
Claims
1. An inspection system that inspects a baggage conveyed by a continuously operating belt conveyor by an inspection device, wherein the inspection system comprises: a camera that is disposed in an inner space of a housing of the inspection device, and that captures an appearance image of the baggage passing through an outer space of the housing via an opening portion provided at an entrance side of the baggage of the housing; and a shield that is disposed at the entrance side of the inspection device, and that covers a conveyance path of the baggage passing through the outer space of the housing, the camera is visually shielded by the housing from a passage side of a holder of the baggage, the shield has a transparent anti-reflection member that transmits visible light and reduces reflection of light at a position where the camera is reflected, and the camera captures the appearance image of the baggage via the transparent anti-reflection member.
2. An inspection system that inspects a baggage conveyed by a continuously operating belt conveyor by an inspection device, wherein the inspection system comprises: a camera that captures an appearance image of an entrance side of the baggage of the inspection device; and a correlation unit that determines a time at which the baggage reaches a prescribed region within a capturing region of the camera from a time at which the baggage reaches an inspection region of the inspection device, and correlates an image captured by the camera at the time with an inspection result of the inspection device, the correlation unit determines a central region of the baggage in a conveyance direction in a perspective image captured by the inspection device from a center of gravity of a pixel group representing the baggage in the perspective image, and determines the time at which the baggage reaches the prescribed region from a time at which the central region reaches a reference position within the inspection region.
3. The inspection system according to claim 2, wherein the inspection device captures a perspective image of the baggage, the correlation unit adjusts a time from the time at which the baggage reaches the prescribed region until the time at which the baggage reaches the inspection region, from an amount of shift of the central region of the baggage in the perspective image captured by the inspection device with respect to a reference position of the perspective image, and determines the time at which the baggage reaches the prescribed region using the adjusted time.
4. An inspection system that inspects a baggage conveyed by a continuously operating belt conveyor by an inspection device, wherein the inspection system comprises: a camera that captures an appearance image of an entrance side of the baggage of the inspection device; and a correlation unit that determines a time at which the baggage reaches an inspection region of the inspection device from a time at which the baggage reaches a prescribed region within a capturing region of the camera, and correlates an inspection result of the inspection device corresponding to the time with an image captured by the camera at the time at which the baggage reaches the prescribed region, the camera repeatedly captures the prescribed region, the correlation unit performs recognition processing on the image captured by the camera, determines a central region in a conveyance direction of the image from a center of gravity of a pixel group representing the baggage in the image, and determines a capturing time of the image as the time at which the baggage reaches the prescribed region in a case where the baggage is recognized from the central region. 5. The inspection system according to claim 2 or 4, wherein The inspection system is provided with a mechanism that brings a portion extending outward from a main body of the cargo closer to the main body at a position upstream of the prescribed region in the conveyance direction of the cargo.
Citation Information
Patent Citations
Baggage inspection apparatus and baggage inspection system
JP2019011981A
Inspection System
JP6568634B1
Method and Apparatus for Improving Identification and Control of Articles Passing Through a Scanning System
US20080260096A1