Mobile

Abstract

A moving body includes an imaging system that acquires an image formed by a terahertz wave, wherein the image is an image obtained by capturing an inspection object inside the moving body.

Description

Technical Field

[0001] The invention relates to a mobile body comprising an imaging system. Background Art

[0002] Inspection techniques using terahertz waves are known. Terahertz waves can be defined as electromagnetic waves having a frequency of 30 GHz (inclusive) to 30 THz (inclusive). Japanese Patent Publication No. 2004-286716 discloses a method for inspecting illicit drugs such as narcotics contained in a sealed letter. In this method, the characteristic absorption spectrum of illicit drugs such as narcotics in the terahertz band is used to identify the substance in the sealed letter without destroying the seal.

[0003] Recently, dangerous articles (such as knives) brought into a moving body are a serious problem from the perspective of crime prevention. There is a strong demand for technology to detect such dangerous articles in a moving body, but such technology has not yet been achieved.

[0004] The present invention provides a technique that facilitates crime prevention in mobile objects. Summary of the invention

[0005] A moving body according to one aspect of the present invention includes an imaging system configured to acquire an image formed by a terahertz wave. The imaging system can be arranged to capture an inspection object inside the moving body.

[0006] One of the aspects of the present invention provides a mobile body including an imaging system configured to acquire an image formed by a terahertz wave, wherein the image is an image obtained by capturing an inspection object inside the mobile body. Other features of the present invention will become clear from the following description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figures 1A to 1C are diagrams each showing a carriage according to an embodiment;

[0008] Figure 2 is a diagram schematically showing a state in which the carriage of the first arrangement example has stopped at a platform in a station;

[0009] Figure 3 is a diagram schematically showing a state in which a carriage of the second arrangement example has stopped at a platform in a station;

[0010] Figure 4 is a diagram showing a more detailed example of the second arrangement example;

[0011] Figure 5A and 5B is a diagram schematically showing an example of arrangement of a plurality of illumination sources and a plurality of cameras;

[0012] Figure 6 is a diagram schematically showing a carriage of a third layout example;

[0013] Figure 7 is a diagram schematically showing a carriage of a fourth layout example;

[0014] Figure 8 is a diagram schematically showing a carriage of a fifth arrangement example;

[0015] Fig. 9 is a diagram schematically showing a carriage of a sixth arrangement example;

[0016] Fig.10 is a diagram schematically showing a carriage of a seventh arrangement example;

[0017] Fig.11 is a diagram schematically showing a carriage of an eighth arrangement example;

[0018] Fig.12 is a diagram schematically showing a carriage of an eighth arrangement example;

[0019] Fig.13 is a block diagram showing the arrangement of carriages and the arrangement of a station monitoring system;

[0020] Fig.14A and 14B is a diagram showing an arrangement example of a ticket inspection machine in which an imaging system included in a camera system according to an embodiment is arranged;

[0021] Fig.15A and 15B It is shown Fig.14A and 14B A diagram showing a modification of the ticket checking machine shown;

[0022] Fig.16A and 16B is a diagram showing an arrangement example of a partition in which an imaging system included in a camera system according to an embodiment is arranged;

[0023] Figures 17A to 17C It is shown Fig.16A and 16B A diagram showing a modification of the partition shown;

[0024] Fig.18A and 18B is a diagram showing an arrangement example of an escalator in which an imaging system included in a camera system according to an embodiment is arranged;

[0025] Fig.19A and 19B is a diagram showing an arrangement example of a ladder in which an imaging system included in a camera system according to an embodiment is arranged;

[0026] Fig. 20A and20B is a diagram showing an arrangement example of channels in which an imaging system included in a camera system according to an embodiment is arranged;

[0027] Fig.21 is a diagram showing an arrangement example of a station where an imaging system included in a camera system according to an embodiment is arranged;

[0028] Fig. 22 is a diagram showing an example of arrangement when the camera system and the railway carriage according to the embodiment monitor an inspection object;

[0029] Fig.23 is a conceptual diagram of a processing system according to a first embodiment;

[0030] Fig.24 is a flowchart of the process according to the first embodiment;

[0031] Fig.25 is a conceptual diagram of a processing system according to a second embodiment;

[0032] Fig.26 is a flowchart of a process according to the second embodiment;

[0033] Fig. 27 is a conceptual diagram of a processing system according to a third embodiment;

[0034] Fig.28 is a flowchart of a process according to a third embodiment;

[0035] Fig.29 is a conceptual diagram of a processing system according to a fourth embodiment;

[0036] Fig.30 is a conceptual diagram of a processing system according to a fifth embodiment;

[0037] Fig.31 is a diagram showing an example of the arrangement of a processing system;

[0038] Fig.32 is a diagram showing an example of the arrangement of a processing system;

[0039] Fig.33 is a flowchart showing an operation example of the camera system according to the embodiment;

[0040] Fig.34 is a flowchart showing an operation example of the camera system according to the embodiment;

[0041] Fig.35 is a flowchart showing an operation example of the camera system according to the embodiment; and

[0042] Fig.36 is a flowchart showing an operation example of the camera system according to the embodiment. DETAILED DESCRIPTION

[0043] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention. A plurality of features are described in the embodiments, but the invention is not limited to requiring all such features, and a plurality of such features may be combined as appropriate. In addition, in the accompanying drawings, the same reference numerals are given to the same or similar configurations, and redundant descriptions thereof are omitted.

[0044] In the specification, an “embodiment” may be an embodiment of the invention described in the appended claims, or may be an embodiment of the invention not described in the appended claims.

[0045] Figures 1A to 1C The coaches 100a, 100b and 100c according to the embodiment are shown exemplarily respectively. The coaches 100a, 100b and 100c can be railway coaches, but can also be buses. In one example, a train can be formed by connecting one coach 100a, one or more coaches 100b and one coach 100c. If the coaches 100a, 100b and 100c are not distinguished from each other and are described, they will be referred to as coaches 100.

[0046] The carriage 100 can include, for example, a side door (side sliding door) 110, a through door 111, a seat 112, facilities 113, a partition door 114, a cabin aisle 115, and a deck 116. The side door 110, the through door 111, and the partition door 114 are doors. In this specification, in order to identify the doors from each other, unique names are given according to convention. The side door 110 is a door arranged between the inside and outside of the carriage 100. The through door 111 is a door arranged at one or both of the two ends of the carriage 100. The seat 112 can be used as, for example, a non-reserved seat or a reserved seat. The facilities 113 can include, for example, a washstand, a toilet, a smoking room, etc. The partition door 114 is a door arranged between the corridor 116 and the cabin (in other words, the cabin aisle 115) where a plurality of seats 112 are arranged. The cabin aisle 115 is an aisle provided in the cabin so as to pass through one side of the space where the plurality of seats 112 are arranged. The cabin aisle 115 can be arranged, for example, between a first seat row formed by a plurality of first seats and a second seat row formed by a plurality of second seats. The corridor 116 is an aisle partitioned by, for example, a partition door 114, a through door 111, and a side door 110. Note that a carriage will be described here as an example. However, the technology can be applied to moving bodies (cars (standard-sized vehicles, buses, and trucks), airplanes, helicopters, and ships) that carry people or cargo.

[0047] Figure 2The state in which the carriage 100 of the first arrangement example has stopped at the platform PF in the station is schematically shown. The platform PF can include a platform screen door FD. The carriage 100 can include an imaging system ICS configured to acquire an image formed by a terahertz wave TW. The imaging system ICS can be arranged to capture an inspection object M using a common part of the carriage 100 as the interior of a moving body. The common part is a place or space available to many non-designated people. The inspection object M is usually a person, but may also be an animal or a robot other than a person.

[0048] An imaging system ICS' can also be arranged on the platform PF. The imaging system ICS can include one or more imaging units 3a, 3b, 3c, 3d, and 3e. The imaging system ICS' can include one or more imaging units 3f. If the imaging units 3a, 3b, 3c, 3d, 3e, and 3f are described without being distinguished from each other, they will be referred to as imaging unit 3. Terahertz waves pass through fabrics, leather, chemical fibers, resins, and the like. For this reason, a processor (not shown) connected to the imaging system ICS can detect dangerous items such as firearms, cutting tools, or explosives based on images provided from the imaging system ICS.

[0049] The imaging unit 3 may be a passive imaging unit or an active imaging unit. In the passive imaging unit 3, the image formed on the imaging surface of the imaging unit by the terahertz wave TW radiated from the peripheral environment or the inspection object M is acquired (that is, captured) by the imaging unit as an electrical image without irradiating the inspection object M with the terahertz wave TW. The active imaging unit 3 can include an irradiation source 1 and a camera 2. Figure 2 In the example shown, the imaging system ICS includes a plurality of imaging units 3a, 3b, 3c, 3d, and 3e formed by a plurality of illumination sources 1a, 1b, 1c, 1d, and 1e and a plurality of cameras 2a, 2b, 2c, 2d, and 2e. In addition, the imaging system ICS' includes an imaging unit 3f formed by an illumination source 1f and a camera 2f. If the plurality of illumination sources 1a, 1b, ... are described without being distinguished from each other, they will be referred to as illumination sources 1, and if the plurality of cameras 2a, 2b, ... are described without being distinguished from each other, they will be referred to as cameras 2.

[0050] A plurality of cameras 2 can be arranged so that their optical axes face different directions from each other. The irradiation source 1 radiates a terahertz wave TW, and the inspection object M can be irradiated with the terahertz wave TW. The camera 2 acquires (that is, captures) an image formed on an imaging surface by the terahertz wave TW mainly specularly reflected by the inspection object M irradiated with the terahertz wave TW as an electrical image. The imaging system ICS may include a visible light camera that captures an image formed by visible light. Similarly, the imaging system ICS' may include a visible light camera that captures an image formed by visible light.

[0051] The carriage 100 can include a common portion. The common portion can include, for example, an aisle. The aisle can include, for example, a corridor 116 and / or a cabin aisle 115. The corridor 116 can include a first direction ( Figure 2 A first channel 116-1 extending in a horizontal direction in the first direction) and a second channel 116-1 extending in a second direction ( Figure 2 The second passage 116-2 extends in the vertical direction (in the vertical direction) and is connected to the first passage 116-1. Figure 2 As shown, the first aisle 116-1 and the second aisle 116-2 may intersect. The first aisle 116-1 and the cabin aisle 115 may be parallel to each other. The second aisle 116-2 and the cabin aisle 115 may be orthogonal to each other.

[0052] The inspection object M on the platform PF can enter the carriage 100 via the opening portion formed as the side door 110 opens, move through the second aisle 116-2, and change the forward direction to the direction facing the partition door 114 at the connecting portion CP between the first aisle 116-1 and the second aisle 116-2. Thereafter, the inspection object M can enter the cabin aisle 115 via the opening portion formed as the partition door 114 opens. Alternatively, the inspection object M on the platform PF can enter the carriage 100 via the opening portion formed as the side door 110 opens, move through the second aisle 116-2, and change the route to the direction of the first aisle 116-1 (the side of the facility 113) at the connecting portion CP. That is, the inspection object M can change the forward direction at the connecting portion CP between the first aisle 116-1 and the second aisle 116-2. The connecting portion CP can be considered as a branch point or corner where the inspection object M changes its forward direction. That is, the connection part CP can be a position where the inspection object moving in the carriage (moving body) changes direction, where the inspection object slows down or stops, or where the inspection object rotates. Alternatively, the connection part CP can be a position where the inspection object moving in the carriage (moving body) is rectified. Rectification here means that the spread queue of multiple inspection objects lined up on the platform is reduced when they enter the carriage 100. Usually, the inspection objects are rectified into one or two teams in the carriage 100.

[0053] When the imaging system ICS is arranged to capture the inspection object M at the connection portion CP, it is possible to capture the inspection object M from various directions according to the change in the direction of the inspection object M. In addition, when the plurality of cameras 2 of the imaging system ICS are arranged to capture the inspection object M at the connection portion CP, it is possible to further capture the inspection object M from various directions / angles. This can improve the detection probability of the position / shape / material of the dangerous item by the processor connected to the imaging system ICS.

[0054] The first aisle 116-1 and the second aisle 116-2 may intersect at a connection portion CP, the end of the first aisle 116-1 may end at the connection portion CP, and the end of the second aisle 116-2 may end at the connection portion CP. Alternatively, the end of the first aisle 116-1 and the second aisle 116-2 may end at the connection portion CP. In addition, the cabin aisle 115 may be understood as a second aisle, and the second aisle and the first aisle 116-1 may be connected at the connection portion CP. Another example of the connection portion CP can include a connecting portion between a plane aisle used as a first aisle and a ladder used as a second aisle.

[0055] exist Figure 2 In the example shown, the imaging system ICS includes imaging units 3a, 3b and 3c that capture the inspection object M present at the connection part CP. The imaging unit 3c can be arranged in the cabin to capture the inspection object M via the opening portion formed as the partition door 114 is opened. Because the inspection object M generally stops instinctively before the partition door 114, the imaging unit 3c is advantageous in capturing a large number of images. The imaging unit 3d can be arranged to capture the inspection object M passing through the cabin aisle 115. The imaging units 3c and 3d can be arranged on all or some of the seats 112, shelves, floors and ceilings. In particular, because the terahertz wave passes through resins, etc., the imaging units 3c and 3d can be easily arranged in various places. Here, the imaging units 3c and 3d have a higher degree of freedom in arranging on the floor and ceiling than on the fixed position seat 112. Therefore, the imaging units 3c and 3d can be embedded in the floor and / or ceiling and arranged.

[0056] In some airports, body scanners using millimeter waves are used. Because such body scanners are extremely large and inspections with them are time-consuming, it is not practical to apply them to ground transportation systems that transport huge numbers of people. Figure 2 In the example shown, a compact imaging system or monitoring system can be provided.

[0057] The imaging unit 3e can be arranged in the passenger compartment to capture the inspection object M via the opening portion formed as the side door 110 is opened. Since the inspection object M generally stops instinctively before the side door 110, the imaging unit 3e is advantageous in capturing a large number of images. One or more irradiation sources 1g and 1h configured to assist the image capture performed by the imaging unit 3e can be arranged on the platform PF. In addition, a reflective surface MR configured to assist the image capture performed by the imaging unit 3e can be arranged on the platform PF. The reflective surface MR can include a curved surface. The reflective surface MR can be provided on the carriage 100. The reflective surface MR can be formed by a metal surface. A film of a coating or a poster made of paper or the like can be provided on the metal surface. Alternatively, for example, the reflective surface MR can be formed by a surface of a member made of a resin or the like having a surface roughness equal to or less than the wavelength of the irradiated electromagnetic wave, preferably 1 / 10 of the wavelength or less and generally about 10 to 100 mm.

[0058] Figure 3 The state in which the carriage 100 of the second arrangement example has stopped at the platform PF in the station is schematically shown. Contents not mentioned as the second arrangement example can follow the first arrangement example. The imaging system ICS can include a plurality of illumination sources 1a, 1b and 1c and a plurality of cameras 2a, 2b, 2c and 2d. The number of the plurality of illumination sources 1a, 1b and 1c and the number of the plurality of cameras 2a, 2b, 2c and 2d can be equal to each other, or can be different from each other. All or some of the plurality of cameras 2a, 2b, 2c and 2d can be arranged at the corner portion of the wall in the carriage 100. Although in Figure 3 Although not shown in the figure, all or some of the plurality of illumination sources 1a, 1b, and 1c may be arranged at a corner portion of a wall in the compartment 100. All or some of the plurality of cameras 2a, 2b, 2c, and 2d may be arranged to be overlapped in a vertical direction. All or some of the plurality of illumination sources 1a, 1b, and 1c may be arranged to be overlapped in a vertical direction. The imaging system ICS may include a plurality of cameras 1a, 1b, and 1c and a plurality of illumination sources 2a, 2b, 2c, and 2d.

[0059] Figure 4 A more detailed example of the second arrangement example is shown. Figure 4As shown, one or more irradiation sources 1 can be overlapped in the vertical direction and arranged at the corner portion of the wall in the carriage 100. The corner portion can be a corner portion of the wall facing the connection portion CP. In addition, one or more cameras 2 can be arranged. One or more cameras 2 can be arranged at the corner portion, or can be arranged on the ceiling or the floor. The irradiation source 1 and the camera 2 can be embedded in a structure such as a wall, a ceiling, and a floor so that the inspection object M cannot visually identify them.

[0060] Figure 5A Schematically shows an example of arrangement of a plurality of illumination sources 1a and 1b and a plurality of cameras 2a and 2b. Figure 5A As schematically shown in FIG. 1 , a plurality of illumination sources 1 a and 1 b and a plurality of cameras 2 a and 2 b can be arranged on the ceiling C. Here, the plurality of illumination sources 1 a and 1 b and the plurality of cameras 2 a and 2 b can be embedded in the ceiling C and arranged.

[0061] Figure 5B Another arrangement example of a plurality of illumination sources 1 and a plurality of cameras 2 is schematically shown. Figure 5B As schematically shown in , a plurality of illumination sources 1 can be arranged on the ceiling C, and a plurality of cameras 2 can be arranged on the floor F. Here, a plurality of illumination sources 1 can be arranged by being embedded in the ceiling C, and a plurality of cameras 2 can be arranged by being embedded in the floor F. On the contrary, a plurality of illumination sources 1 can be arranged on the floor F, and a plurality of cameras 2 can be arranged on the ceiling C. Here, a plurality of illumination sources 1 can be arranged by being embedded in the floor F, and a plurality of cameras 2 can be arranged by being embedded in the ceiling C.

[0062] Figure 6 The carriage 100 of the third arrangement example is schematically shown. The contents not mentioned as the third arrangement example can comply with the first arrangement example or the second arrangement example. The third arrangement example can be implemented in combination with at least one of the first arrangement example and the second arrangement example. In the third arrangement example, the imaging system can include multiple irradiation sources 1a to 1d arranged on multiple seats 112 to irradiate the inspection object M using the cabin aisle 115 as a common part with terahertz waves TW. In addition, the imaging system can include multiple cameras 2a and 2b arranged at the periphery of the doorway (partition door 114) of the cabin to capture the inspection object M irradiated with terahertz waves. The cabin aisle 115 can be arranged between, for example, a first seat row S1 formed by a plurality of first seats 112 and a second seat row S2 formed by a plurality of second seats 112. Multiple irradiation sources 1a to 1d can be arranged on seats 112 facing the cabin aisle 115.

[0063] The carriage 100 can include a sensor 30 configured to detect the inspection object M. The plurality of radiation sources 1a to 1d can be controlled based on the output of the sensor 30. For example, the plurality of radiation sources 1a to 1d can be controlled to radiate the terahertz wave TW in response to detection of the inspection object M by the sensor 30. The sensor 30 can also be used as a sensor configured to detect the approach of the inspection object M and open the partition door 114.

[0064] Figure 7 The carriage 100 of the fourth arrangement example is schematically shown. The contents not mentioned as the fourth arrangement example can comply with the first to third arrangement examples. The fourth arrangement example can be implemented in combination with at least one of the first to third arrangement examples. In the fourth arrangement example, the imaging system can include a plurality of irradiation sources 1a, 1b, ... configured to irradiate the inspection object M using the cabin aisle 115 as a common part with terahertz waves TW, and a plurality of cameras 2a, 2b, ... configured to capture the inspection object M irradiated by the terahertz waves. In the first seat row S1, the irradiation source 1a as some of the plurality of irradiation sources 1a, 1b, ... and the camera 2a as some of the plurality of cameras 2a, 2b, ... can be arranged alternately. In the second seat row S2, the irradiation source 1b as some of the plurality of irradiation sources 1a, 1b, ... and the camera 2b as some of the plurality of cameras 2a, 2b, ... can be arranged alternately. This arrangement is advantageous for alternately capturing the left and right sides of the inspection subject M passing through the cabin aisle 115 and for early detection of the inspection subject M holding dangerous articles.

[0065] Figure 8 A carriage 100 of a fifth arrangement example is schematically shown. Contents not mentioned as the fifth arrangement example can comply with the first to fourth arrangement examples. The fifth arrangement example can be implemented in combination with at least one of the first to fourth arrangement examples. In the fifth arrangement example, the imaging system can include a plurality of irradiation sources 1 configured to irradiate an inspection object using a cabin aisle as a common portion with terahertz waves and a plurality of cameras (not shown) configured to capture the inspection object irradiated by the terahertz waves. Figure 8 As shown, the plurality of illumination sources 1 can include at least two illumination sources 1 arranged on the backrest of the seat 112. This arrangement is advantageous for irradiating the inspection object with terahertz waves from various angles or positions.

[0066] Fig. 9The carriage 100 of the sixth arrangement example is schematically shown. Contents not mentioned as the sixth arrangement example can be followed in accordance with the first to fourth arrangement examples. The sixth arrangement example can be implemented in combination with at least one of the first to fourth arrangement examples. In the sixth arrangement example, the imaging system can include a plurality of irradiation sources 1 configured to irradiate an inspection object using the cabin aisle with terahertz waves and a plurality of cameras 2 configured to capture the inspection object irradiated by the terahertz waves. Fig. 9 As shown, the plurality of irradiation sources 1 can include at least two irradiation sources 1 arranged on the backrest of the seat 112. This arrangement is advantageous for irradiating the inspection object with terahertz waves from various angles or positions. Fig. 9 As shown, the plurality of cameras 2 can include, for example, at least one camera 2 arranged on a backrest of the seat 112 .

[0067] Fig.10 A carriage 100 of a seventh arrangement example is schematically shown. Contents not mentioned as the seventh arrangement example can comply with the first to sixth arrangement examples. The seventh arrangement example can be implemented in combination with at least one of the first to sixth arrangement examples. In the seventh arrangement example, the imaging system can include a plurality of irradiation sources 1 configured to irradiate an inspection object M using the cabin aisle with a terahertz wave TW and a plurality of cameras 2 configured to capture the inspection object M irradiated by the terahertz wave TW. The plurality of irradiation sources 1 can include, for example, at least one irradiation source 1 arranged on a backrest of a seat 112. The plurality of cameras 2 can include at least one camera 2 arranged on a ceiling. The camera 2 arranged on the ceiling is Fig.10 The inspection object M can be visually discernible in the middle, but can also be embedded in the ceiling.

[0068] Fig.11 and Fig.12The carriage 100 of the eighth arrangement example is schematically shown. Contents not mentioned as the eighth arrangement example can comply with the first to seventh arrangement examples. The eighth arrangement example can be implemented in combination with at least one of the first to seventh arrangement examples. In the eighth arrangement example, the imaging system ICS includes a reflective surface MR1 configured to reflect the terahertz wave TW, and the reflective surface MR1 can include a curved surface. The reflective surface MR1 can be formed, for example, by a metal surface. A film of a coating or a poster made of paper or the like can be provided on the metal surface. Alternatively, for example, the reflective surface MR1 can be formed by the surface of a member made of a resin or the like having a surface roughness equal to or less than the wavelength of the irradiated electromagnetic wave, preferably 1 / 10 or less of the wavelength and generally about 10 to 100 mm. This arrangement makes it possible to reflect the light scattered by the inspection object M or the light not irradiated in the terahertz wave TW used by the multiple irradiation sources 1 to irradiate the inspection object M through the reflective surface MR1, irradiate the inspection object M again, and make the light enter the camera 2. Therefore, this arrangement can improve the detection performance of the imaging system ICS.

[0069] Fig.13 The arrangement of the carriage 100 and the arrangement of the station monitoring system 120 are shown. Note that although an example in which the monitoring system is set in a station will be described here, the scope of application of the technology is not limited to this example. For example, other examples of places where the moving body leaves / arrives are airports and ports (ships). In addition to the above-mentioned imaging system ICS, the carriage 100 can also include a processor 10 and a communication unit 15. The processor 10 performs processing of signals output from the imaging system ICS. The processing can include determining the risk of the inspection object M. The processing can include specifying the position of the inspection object M with a predetermined risk. Alternatively, the processing can include specifying the seat of the inspection object M with a predetermined risk. The processor 10 can be formed, for example, by a PLD (abbreviation of programmable logic device) such as FPGA (abbreviation of field programmable gate array), ASIC (abbreviation of application-specific integrated circuit), a general or special-purpose computer with a program installed, or a combination of some or all of them.

[0070] The processor 10 can specify the seat of the inspection object M based on the corresponding information associating the feature information of the inspection object M with the seat information assigned to the passenger having the feature corresponding to the feature information. The feature information can be information extracted by the processor 10 from the image captured by the imaging system ICS. The feature information can be, for example, a feature quantity specified based on the shape, size, etc. of a partial image extracted from the image captured by the imaging system ICS, can be information specifying the type of dangerous goods, or can be information representing another feature. Alternatively, the feature information can be information representing the above-mentioned risk. Extracting a partial image from the image captured by the imaging system ICS can include, for example, extracting a portion having a brightness higher than a predetermined brightness. AI (artificial intelligence) can be used to extract feature information. More specifically, an AI that has undergone deep learning is installed in the processor 10, and feature information can be extracted by the AI. For example, information representing the risk in the image captured by the camera 2 appears in different ways depending on the position and orientation of the camera 2. Therefore, deep learning can be performed based on images captured by multiple cameras 2.

[0071] The processor 10 can send the result of the above processing to a pre-set terminal 20 via the communication unit 15. The terminal 20 can be carried by, for example, a crew member in the carriage 10. The terminal 20 may include a terminal carried by a person other than the crew member in the carriage 100, a terminal set in a security office arranged in a station or the like, and a terminal set in an administrative agency such as a police station.

[0072] The station monitoring system 120 can include an imaging system 21, a control system 22, and a ticket gate 23. The imaging system 21 can include a camera configured to acquire an image formed by a terahertz wave TW. The imaging system 21 can include a camera configured to acquire an image formed by an electromagnetic wave (e.g., visible light) having a wavelength different from that of the terahertz wave. The imaging system 21 can include a camera installed to capture at least an inspection object passing through the ticket gate 23 and configured to acquire an image formed by the terahertz wave TW. The ticket gate 23 can not only have a ticket gate function, but also have a function of reading the seat information (information for specifying a reserved seat) of a ticket held by an inspection object undergoing ticket inspection (including an electronic ticket held by a portable medium such as a portable terminal) and notifying the control system 22 of the seat information.

[0073] The imaging system 21 can capture the inspection object passing through the ticket gate 23 using the terahertz wave TW, and send the captured image to the control system. The control system 22 can decide the risk of the inspection object based on the image received from the imaging system 21. In addition, the control system 22 can extract feature information of the inspection object from the image received from the imaging system 21. The feature information can be extracted by an extraction method that is the same as or similar to the extraction method of the feature information performed by the above-mentioned processor 10. The control system 22 can be formed, for example, by a general-purpose or dedicated computer installed with a program.

[0074] The control system 22 generates corresponding information that associates feature information of the inspection object extracted from the image received from the imaging system 21 with the seat information read by the ticket gate 23. For example, the feature information can be information that strongly suggests the possession of a firearm, and the seat information can be seat information read by the ticket gate 23 from a ticket held by the inspection object holding the firearm. The corresponding information can be sent from the control system 22 to the carriage 100. The feature information may include information that identifies the ID of the inspection object (that is, information that specifies an individual). If the imaging system 21 includes a visible light camera, the ID of the inspection object can be identified from a visible light image of the inspection object or from a visible light image by AI or the like. The visible light image of the inspection object having a predetermined risk can be sent to the carriage 100 together with the above-mentioned corresponding information, and can also be sent to the terminal 20.

[0075] Hereinafter, a technology advantageous in improving crime prevention through a camera system installed in a facility will be described.

[0076] Will refer to FIG. 14A to FIG. 22 The camera system 200 according to some embodiments of the present invention is described. The camera system 200 according to the present embodiment is installed in a facility. Examples of facilities are terminals such as railway stations and airports, commercial facilities, and entertainment facilities. The camera system 200 according to the present embodiment is installed in the structure of a railway station or the like. The structure of the station includes a station building in which ticket gates, ticket offices, waiting rooms, etc. are arranged, a platform where a railway carriage arrives, a passage connecting the station building and the platform, and the like. Here, the passage can be not only a flat passage, but also a place where passengers pass, such as stairs, escalators, or elevators. In addition, a railway carriage is an example of a moving body. If the facility is an airport, the moving body is, for example, an airplane. The camera system 200 according to the present embodiment can be a camera system arranged to form part of a surveillance system of a station.

[0077] The camera system 200 includes an imaging system 201 configured to acquire an image formed by a terahertz wave reflected by an inspected object 250. The imaging system 201 can include at least one irradiation unit 202 configured to irradiate a terahertz wave and at least one camera 203 configured to acquire an image formed by the terahertz wave. The irradiation unit 202 is also referred to as an irradiation unit. In order to distinguish between a plurality of irradiation units 202 and a plurality of cameras 203 in the following description, a suffix is ​​added to each reference numeral, such as an irradiation unit 202 "a" and a camera 203 "a". If the irradiation unit and the camera do not need to be distinguished, they are simply expressed as "irradiation unit 202" and "camera 203". This also applies to other constituent elements.

[0078] In this embodiment, the camera 203 that detects the terahertz wave is a type called an active camera, and can be used in combination with the irradiation unit 202. However, the camera is not limited thereto, and may be a passive type camera. In this case, the inspection object 250 is not irradiated with the terahertz wave irradiated from the irradiation unit 202, but an image can be acquired by the terahertz wave radiated from the inspection object 250.

[0079] The imaging system 201 can be arranged to capture an inspection object 250 using the station. The inspection object 250 is typically a person, but may also be an animal or a robot other than a person. Terahertz waves pass through fabrics, leather, etc. For this reason, a processor (e.g., control system 22) (not shown) connected to the camera system 200 can detect dangerous items such as firearms, cutting tools, or explosives based on the images provided by the imaging system 201 of the camera system 200.

[0080] Fig.14A and 14B The drawings are a plan view and a front view respectively showing an example of the arrangement of a ticket gate 211 in which the imaging system 201 included in the camera system 200 according to the present invention is arranged. The ticket gate 211 is installed in a ticket gate of a station, and separates the inside of the ticket gate and the outside of the ticket gate. Here, the inside of the ticket gate can be an area that requires a ticket such as a platform ticket or a boarding ticket to enter. The ticket gate 211 can be an automatic ticket gate. The imaging system 201 is arranged to acquire an image of an inspection object 250 passing through a passage 240 of the ticket gate 211. For example, the imaging system 201 can acquire an image of an inspection object 250 entering the inside of the ticket gate from the outside of the ticket gate. The following will be described assuming that the inspection object 250 is in a Fig.14A The direction of the arrow shown is described as passing from the outside of the ticket gate to the inside of the ticket gate.

[0081] exist Fig.14A and 14BIn the arrangement shown, the ticket inspector 211 includes a ticket inspector 211a and a ticket inspector 211b arranged to face each other across a passage. That is, the width and length of the passage 240 of the ticket inspector 211 can be determined by the ticket inspector 211a and the ticket inspector 211b. The imaging system 201 includes an irradiation unit 202 arranged on the ticket inspector 211a and a camera 203 arranged on the ticket inspector 211b. The terahertz wave irradiated from the irradiation light source 202 can be specularly reflected by an inspection object 250 such as a person. For this reason, when the irradiation unit 202 and the camera 203 are respectively arranged on the ticket inspector 211a and the ticket inspector 211b facing each other across a passage 240, the terahertz wave irradiated from the irradiation unit 202 is easily reflected by the inspection object 250 and detected by the camera 203.

[0082] like Fig. 14B As shown, the irradiation unit 202 is able to use a range 204 of almost the entire passage 240 as an irradiation range. The spread of the terahertz wave irradiated from the irradiation unit 202 can be adjusted by using a lens or the like. In addition, the terahertz wave is reflected by metal or the like. Therefore, the inspection object 250 is irradiated even near the lower portion of the ticket gate 211a because the terahertz wave is reflected by the side surface of the ticket gate 211b. In addition, in order to effectively use the reflection of the terahertz wave by each side surface on one side of the passage 240 of the ticket gate 211, the irradiation unit 202 and the camera 203 can be arranged near the end of the ticket gate 211 on the opposite side of the direction of the optical axis of the irradiation unit 202 and the camera 203, as shown in FIG. Fig.14A That is, the irradiation unit 202 and the camera 203 configured to capture the outside of the ticket gate from the ticket gate 211 may be arranged near the end of the ticket gate 211 on the inside of the ticket gate.

[0083] The arrangement of the irradiation unit 202 and the camera 203 is not limited to the above arrangement. For example, the irradiation unit 202 and the camera 203 may be arranged on the ticket gate 211a. Alternatively, for example, the irradiation unit 202 and the camera 203 may be arranged near the center of the ticket gate 211, or may be arranged at Fig.14A Near the end of the outer side of the ticket gate in. For one camera 203, the irradiation unit 202 may be formed by a plurality of irradiation devices. For example, the irradiation unit 202 may be formed by a plurality of irradiation devices having different terahertz wave irradiation directions. In addition, the irradiation unit 202 and the camera 203 may be fixed to the ticket gate 211 in an immovable state, or may be rotatably arranged, for example, according to the movement of the inspection object 250.

[0084] If the imaging system 201 of the camera system 200 is used as a surveillance camera, in some cases, by capturing the person as the inspection object 250 one by one, post-processing such as image processing performed by a processor (not shown) at the later stage of the imaging system 201 of the camera system 200 is facilitated. The ticket gate 211 allows the person as the inspection object 250 to pass one by one with a high probability. Therefore, when the imaging system 201 is arranged in the ticket gate 211, the burden of post-processing such as image processing can be suppressed. That is, the imaging system 201 can be arranged where the inspection objects 250 are lined up. In addition, the time required for the person as the inspection object 250 to pass through the ticket gate 211 is about 1 second. However, the imaging system 201 can acquire an image formed by a terahertz wave at a frame rate of 50fps or faster. For this reason, capturing one inspection object 250 can be performed multiple times. In multiple image captures, the inspection object 250 can be captured as a whole, or the inspection object 250 can be captured only partially.

[0085] The imaging system 201 of the camera system 200 may include a sensor 260 configured to detect the approach of the inspection object 250. For example, Fig. 14B As shown, the ticket inspection machine 211 may be provided with a sensor 260. Alternatively, for example, the sensor 260 may be added to the irradiation unit 202 or the camera 203. The irradiation unit 202 is controlled based on the output of the sensor 260. For example, the irradiation unit 202 may start irradiating the terahertz wave according to the sensor 260 detecting the inspection object 250. This can suppress the power consumed by the imaging system 201.

[0086] Fig.15A As an example of the imaging system 201, two sets of irradiation units 202 and cameras 203 are shown arranged on a ticket inspection machine 211. Fig.15A As shown, the irradiation units 202a and 202b are arranged on the ticket checking machine 211a, and the cameras 203a and 203b are arranged on the ticket checking machine 211b. Fig.15AAs shown, the irradiation unit 202a and the camera 203a are arranged to irradiate and capture the inner side of the ticket gate from the ticket gate 211, and the irradiation unit 202b and the camera 203b are arranged to irradiate and capture the outer side of the ticket gate from the ticket gate 211. Through this arrangement, not only the front side of the inspection object 250 can be captured, but also the rear side of the inspection object 250 can be captured. At this time, as described above, in order to effectively use the terahertz waves irradiated from the irradiation units 202a and 202b, the irradiation unit 202a and the camera 203a can be arranged on the inner side of the ticket gate relative to the irradiation unit 202b and the camera 203b. However, the arrangement of the irradiation units 202a and 202b and the cameras 203a and 203b is not limited thereto, and as described above, they can be freely arranged. In addition, as described above, each side surface of the channel 240 side of the ticket gate 211 can form a reflection surface that reflects the terahertz wave. That is, each surface on one side of the passage 240 of the ticket inspector 211 may be made of metal, or may include a rough surface having an unevenness of about 1 / 10 of the wavelength of the terahertz wave. Fig. 15B As shown, the ticket inspector 211 may have a gate-shaped structure including an upper structure 212 for more reflection of the terahertz wave. At this time, each surface on one side of the channel 240 of the upper structure 212 may be made of metal, or may include a rough surface having an unevenness of about 1 / 10 of the wavelength of the terahertz wave. When the terahertz wave is reflected or scattered by the surface of the ticket inspector 211, the inspection object 250 is illuminated from various angles, and the quality of the image obtained by the camera 203 can be improved.

[0087] In addition, Figures 14A to 15B In the figure, the irradiation unit 202 and the camera 203 are illustrated as separate entities on the ticket gate 211 to simplify the description. However, the present invention is not limited to this. The terahertz wave can pass through materials such as resin. For this reason, a window made of resin can be provided in a part of the ticket gate 211, and the irradiation unit 202 or the camera 203 can be arranged in the ticket gate 211. As the resin, for example, a suitable material such as high-density polyethylene or cycloolefin copolymer can be used. In the following description, the irradiation unit 202 and the camera 203 are also illustrated as being large in the drawings.

[0088] Next, refer to Fig.16A and 16B An example in which the imaging system 201 is applied to a partition wall 213 on a platform 216 of a station will be described. Fig.16A and 16B1 and 2 are a plan view and a front view showing an arrangement example of a partition wall 213 in which an imaging system 201 included in a camera system 200 according to the present invention is arranged. The imaging system 201 is arranged adjacent to the partition wall 213, which is configured to partition a platform 216 and a track side area 217 and includes a door portion 214 that can be opened and closed. The partition wall 213 is a so-called platform screen door installed on the platform 216. In this embodiment, the imaging system 201 acquires an image of an inspection object 250 passing through a passage 241 when the door portion 214 of the partition wall 213 is opened.

[0089] The imaging system 201 includes an irradiation unit 202a and a camera 203a arranged in a track side area 217. When the door portion 214 is open, the irradiation unit 202a and the camera 203a perform irradiation and image capture of the passage 241 from the track side area 217. In addition, the imaging system 201 includes an irradiation unit 202b and a camera 203b arranged in a platform 216. When the door portion 214 is open, the irradiation unit 202b and the camera 203b perform irradiation and image capture of the passage 241 from the platform 216. When the irradiation unit 202a and the camera 203a and the irradiation unit 202b and the camera 203b are arranged, it is possible to acquire a front side image and a rear side image of both the inspection object 250 entering the railway car 218 via the door 219 and the inspection object 250 leaving the railway car 218 via the door 219. However, the present invention is not limited thereto, and only the irradiation unit 202a and the camera 203a may be arranged, or only the irradiation unit 202b and the camera 203b may be arranged.

[0090] like Fig.16A and 16B As shown, each of the irradiation units 202a and 202b may include a plurality of irradiation devices. Fig.16A and 16B As shown, the irradiation units 202a and 202b may be arranged at the end of the door pocket portion 215 in the partition wall 213 in the direction of opening and closing the door portion 214, and the door pocket portion 215 stores the door portion 214 when the door portion 214 is opened. Fig.16AAs shown, when the door portion 214 is opened, in some cases part of the door portion 214 is not stored in the door cover portion 215. In this case, the side surface of the unstored part of the door portion 214 can form a reflection surface that reflects the terahertz wave, such as the side surface on one side of the passage 240 of the above-mentioned ticket gate 211. This makes it possible to use the terahertz waves irradiated from the irradiation units 202a and 202b more efficiently. In addition, the body of the railway carriage 218 can be used as a reflection surface that reflects the terahertz wave. When the door portion 214 of the partition wall 213 is opened to form the passage 241, the railway carriage 218 may have arrived. The body of the railway carriage 218 can be made of metal. For this reason, the body of the railway carriage 218 can be used as a reflection surface that reflects the terahertz wave.

[0091] In addition, if Fig. 16B As shown, cameras 203a and 203b may be attached to a structure such as pole 220. As cameras 203a or 203b, such as Fig. 16B As shown, multiple image capture devices may be used. Fig. 16B As shown, the cameras 203a and 203b may be arranged at, for example, the height of the waist of the inspection object 250 or at a position higher than the inspection object 250. When the cameras 203a and 203b are arranged at a high position, even if the interval of the inspection object 250 in the front-rear direction is small, the possibility of being able to acquire images one by one becomes higher than the case where the cameras 203a and 203b are arranged at a low position. In addition, when the cameras 203a and 203b are arranged at an angle relative to the passage 241, the possibility of acquiring an image in front of and an image in the back of the inspection object 250 becomes high.

[0092] The arrangement of the irradiation units 202a and 202b and the cameras 203a and 203b is not limited to Fig.16A and 16B For example, Figures 17A to 17C As shown, the irradiation units 202a and 202b may be attached to a structure such as a rod 220. In this case, Fig.17A and 17B As shown, the illumination unit 202 and the camera 203 may be attached to separate poles 220a and 220b. Fig. 17C As shown, the illumination unit 202 and the camera 203 may be attached to the same pole 220 .

[0093] As described above, if the imaging system 201 is used as a surveillance camera, it is possible to reduce the burden of post-processing such as image processing by capturing people as the inspection object 250 one by one. Therefore, the imaging system 201 included in the camera system 200 can be applied to a partition wall 213 installed in a station where a bullet train or an express train stops, where people line up and enter one by one. In this case, the width of the door 219 of the railway carriage 218 for the bullet train or the express train is about 700 mm to 1,000 mm. Therefore, in Fig.16A Or in the arrangement shown in 17A, the maximum distance between the irradiation unit 202 and the camera 203 can be reduced to, for example, about 1,100 mm (inclusive) to 2,000 mm (inclusive). This makes it possible to efficiently use the terahertz wave irradiated from the irradiation unit 202. Bullet trains or express trains generally have a fixed train formation. Therefore, the size of the door portion 214 can be changed according to the size of the door 219 of the railway carriage 218. Therefore, for example, the distance between the irradiation unit 202 and the camera 203 adjacent to the door portion 214 corresponding to the door 219 having a small width (e.g., 700 mm) can be, for example, 700 mm (inclusive) to 1,000 mm (inclusive). In this case, the maximum distance between the irradiation unit 202 and the camera 203 can be, for example, 850 mm or more.

[0094] For example, the imaging system 201 may be applied to a partition wall 213 in a railway station such as a commuter train. In this case, images of people can be acquired one by one except during rush hour. Even in the case where a plurality of inspection objects 250 enter or leave at the same time, the inspection objects 250 are usually lined up in two or three teams and enter. Each inspection object 250 can be distinguished by image processing or the like using a processor included in the camera system 200. In a commuter train or the like, the width of a door is approximately 1,300 mm to 2,000 mm. For this reason, in Fig.16A In the arrangement shown in FIG. 17A or FIG. 17A , the maximum distance between the irradiation unit 202 and the camera 203 may be, for example, 1,500 mm (inclusive) to 3,000 mm (inclusive). The output of the terahertz wave irradiated from the irradiation unit 202 may be changed according to the distance between the irradiation unit 202 and the camera 203. In this case, the irradiation unit 202 having a longer distance to the camera 203 may irradiate the terahertz wave at a higher output than the irradiation unit having a shorter distance to the camera 203.

[0095] In some cases, the platform 216 is arranged outdoors. Therefore, the imaging system 201 arranged on the platform 216 or the track side area 217 is easily affected by the external environment. Terahertz waves are easily absorbed by water, and images with sufficient image quality may not be obtained in a high humidity environment (such as rain). Fig. 16BAs shown, the imaging system 201 may include a sensor 261 configured to detect an external environment. The irradiation unit 202 is controlled based on the output of the sensor 261. For example, if the sensor 261 detects information about humidity and the humidity is high, the output of the irradiation unit 202 irradiating the terahertz wave may be increased. This can improve the quality of the image acquired by the camera 203.

[0096] In addition, for example, the irradiation unit 202 or the camera 203 may be attached to the body of the railway car 218. That is, the camera system 200 may include the irradiation unit or the camera installed on the railway car 218. In this case, the camera system 200 can include a communication unit between the imaging system 201 arranged in the station and the imaging system including the irradiation unit or the camera included in the railway car 218.

[0097] In addition, for example, when the door portion 214 of the partition wall 213 is opened, the irradiation unit 202 and the camera 203 may start operating. For example, the imaging system 201 may be synchronized with the operation of the door portion 214, or may include a sensor configured to detect that the door portion 214 has been opened. This can suppress the power consumption of the imaging system 201.

[0098] Next, refer to Fig.18A and 18B An example in which the imaging system 201 is applied to an escalator 221 will be described. Fig.18A and 18B They are a side view and a plan view respectively showing an arrangement example of an escalator 221 in which the imaging system 201 included in the camera system 200 according to the present invention is arranged.

[0099] The imaging system 201 is arranged adjacent to the escalator 221 to acquire an image of the inspection object 250 passing through the escalator 221. Fig.18A In the illustrated arrangement, the imaging system 201 includes an illumination unit 202 and a camera 203. The illumination unit 202 may include a plurality of illumination devices, and the camera 203 may include a plurality of image capture devices. Fig.18A As shown, they may be arranged on separate structures such as multiple rods 220, or they may be arranged on the same structure such as one rod 220. For example, Fig.18A As shown, the irradiation unit 202 and the camera 203 may be arranged to face the direction opposite to the advancing direction of the escalator 221 and perform irradiation and image capture. This makes it possible to acquire an image of the inspection object 250 at the front side.

[0100] For example, Fig.18BAs shown, the irradiation unit 202 and the camera 203 may be arranged in a direction intersecting the advancing direction of the escalator 221 and sandwiching the escalator 221. The same effect as the irradiation unit 202 arranged on the ticket gate 211a and the camera 203 arranged on the ticket gate 211b described above can be obtained. In addition, at this time, the irradiation unit 202a and the camera 203a may be arranged to face the direction opposite to the advancing direction of the escalator 221 and perform irradiation and image capture, and the irradiation unit 202b and the camera 203b may be arranged to face the advancing direction of the escalator 221 and perform irradiation and image capture. This makes it possible to capture not only the front side of the inspection object 250, but also the back side of the inspection object 250.

[0101] As described above, if the imaging system 201 is used as a monitoring camera, it may be advantageous to be able to capture people as the inspection object 250 one by one. Since the escalator 221 runs at a predetermined speed, there is a high possibility that images of the inspection object 250 can be acquired one by one. Fig.18A As shown, the escalator 221 includes steps. When the camera 203 is arranged at a high position, the possibility of being able to acquire images one by one becomes higher. On the escalator 221, the inspection objects 250 are usually lined up in one or two teams. For example, in the escalator 221 where the inspection objects are lined up in two teams, two cameras 203 can be used to acquire images of the inspection objects 250. This increases the possibility of being able to acquire images one by one. As a result, the burden of image processing at the rear stage of the imaging system 201 of the camera system 200 can be reduced.

[0102] In addition, as described above, terahertz waves can pass through resin, etc. For this reason, the irradiation unit 202 or the camera 203 may be embedded in the floor, wall, or ceiling of the portion where the escalator 221 is arranged. For example, the irradiation unit 202 may be installed on a deck board of the escalator 221 together with ordinary lighting.

[0103] Next, refer to Fig.19A and 19B An example in which the imaging system 201 is applied to the stairs 222 is described. Fig.19A and 19B 2 are a plan view and a cross-sectional view respectively showing an arrangement example of the step 222 where the imaging system 201 included in the camera system 200 according to the present invention is arranged.

[0104] The imaging system 201 is arranged in the stairs 222 to acquire an image of the inspection object 250 passing through the stairs 222. Fig.19A and 19BIn the arrangement shown, the imaging system 201 includes an illumination unit 202 and a camera 203. The illumination unit 202 and the camera 203 are embedded in the step 222 and are arranged to illuminate and capture the inspection object 250 from the window 224 of the riser portion 223 of the step 222. Fig.19A and 19B As shown, the illumination unit 202 and the camera 203 can be arranged in the same riser portion 223 of the step 222 .

[0105] Since the person as the inspection object 250 walks up or down the stairs 222 one step (or about two steps) at a time, the image of the inspection object 250 can be sequentially acquired from the head (or foot) to the foot (or head) of the inspection object 250 .

[0106] As described above, various resins that transmit terahertz waves can be used for the window 224 provided in the upright portion 223 of the step 222. When an appropriate resin material is selected according to the material of the upright portion 223 or the tread portion 225 of the step 222 where the imaging system 201 is not arranged, the imaging system 201 can be made inconspicuous (its existence can be hidden).

[0107] Next, refer to Fig. 20A and 20B An example in which the imaging system 201 is applied to the channel 242 is described. Fig. 20A and 20B 2 is a side view showing an arrangement example of a passage 242 in which the imaging system 201 included in the camera system 200 according to the present invention is arranged.

[0108] The imaging system 201 is arranged in the passage 242 to acquire an image of the inspection object 250 passing through the passage 242. The imaging system 201 includes an irradiation unit 202 and a camera 203. At this time, one of the irradiation unit 202 and the camera 203 is arranged on the ceiling 227 of the passage 242, and the other of the irradiation unit 202 and the camera 203 is embedded in the floor 226 of the passage 242. Fig. 20A and 20B In the arrangement shown, the camera 203 is arranged on the ceiling 227 of the passage 242, and the irradiation unit 202 is embedded in the floor 226 of the passage 242. However, the present invention is not limited thereto. The irradiation unit 202 may be arranged on the ceiling 227 of the passage 242, and the camera 203 may be embedded in the floor 226 of the passage 242.

[0109] exist Fig. 20A and 20BIn the arrangement shown, the irradiation unit 202a and the camera 203a are arranged to perform irradiation and image capture from one side of the passage 242 in the passing direction to the other side. In addition, the irradiation unit 202b and the camera 203b are arranged to perform irradiation and image capture from the other side of the passage 242 in the passing direction to the one side. This makes it possible to acquire a front side image and a rear side image of the inspection object 25 advancing in both passing directions of the passage 242. However, the present invention is not limited to this, and the irradiation unit 202a and the camera 203a may be arranged only on the passage 242.

[0110] Fig. 20B An example is shown where cameras 203a and 203b are embedded in the ceiling 227 of the passage 242. Fig. 20A Compared with the case where the cameras 203a and 203b are suspended from the ceiling 227, the cameras 203a and 203b can be made inconspicuous (their existence can be hidden). In addition, the optical axis of the irradiation unit 202 or the camera 203 is Fig. 20B The arrangement shown is more Fig. 20A In the arrangement shown, the inspection object 250 is arranged at a greater angle relative to the advancing direction. Fig. 20A and 20B As indicated by the dotted line shown in , when the angle of the optical axis is set large, the possibility that images of the inspection object 250 can be acquired one by one can become high.

[0111] In addition, Fig. 20A and 20B In the illustrated arrangement, one of the irradiation unit 202 and the camera 203 is arranged in the floor 226, and the other is arranged on the ceiling 227. As described above, the terahertz wave can be specularly reflected by the inspection object 250. Therefore, when the irradiation unit 202 and the camera 203 are arranged to face each other, the terahertz wave irradiated from the irradiation unit 202 can be easily detected by the camera 203.

[0112] However, the arrangement of the irradiation unit 202 and the camera 203 on the channel 242 is not limited to Fig. 20A and 20BThe arrangement shown. For example, the irradiation unit 202 and the camera 203 may be arranged on the side wall of the passage 242, etc. Both the irradiation unit 202 and the camera 203 may be arranged on the floor 226 or the ceiling 227. In this case, the floor 226 or the ceiling 227 where the irradiation unit 202 and the camera 203 are not arranged may be used as a reflection surface for reflecting the terahertz wave. For example, the entire interior of the passage 242 except for the portion of the irradiation unit 202 or the camera 203 (serving as a window for passing the terahertz wave) may be used as a reflection surface for reflecting the terahertz wave. In addition, for example, the irradiation unit 202 may include a plurality of irradiation devices. In this case, the plurality of irradiation devices included in the irradiation unit 202 may be arranged in an appropriate number at an appropriate place such as the floor 226, the ceiling 227 or the side wall.

[0113] As described above, when the imaging system 201 is arranged in the step 222 or the passage 242, the plurality of cameras 203 may be arranged in the width direction of the step 222 or the passage 242. Therefore, the possibility of being able to capture images of the inspection objects 250 one by one becomes high. In addition, the imaging system 201 may be arranged in a portion where the width of the step 222 or the passage 242 is reduced. In the portion where the width of the step 222 or the passage 242 is reduced, the inspection objects 250 can be easily lined up.

[0114] Fig.21 201 is a diagram showing an example of arrangement of a station 245 in which the imaging system 201 included in the camera system 200 is arranged. As described above, the imaging system 201 can be arranged on the ticket gate 211, the passage 242, the escalator 221, the stairs 222, the partition wall 213, etc. at the ticket gate. The place where the imaging system 201 including the irradiation unit 202 and the camera 203 included in the camera system 200 according to the present embodiment is arranged is not limited to the above-mentioned place. For example, the imaging system 201 can be arranged at another place where it is considered that the image of the inspection object 250 can be acquired one by one, such as the entrance or wash basin of the restroom. The above-mentioned imaging system 201 including the irradiation unit 202 and the camera 203 and configured to acquire an image using a terahertz wave can be arranged at a place where an ordinary surveillance camera using visible light is installed.

[0115] In addition, the camera system 200 according to the present embodiment can cooperate with the railway carriage 218 to monitor Fig.21 An inspection object 250 is shown. Fig. 22An arrangement example of a monitoring system in which the camera system 200 cooperates with the railway carriage 218 to monitor the inspection object 250 is shown. In addition to the above-mentioned imaging system 201 arranged in the station, the camera system 200 can further include a control system 310 and a communication unit 315. The control system 310 processes the signal output from the imaging system 201. The processing can include deciding the risk about the inspection object 250. The processing can include specifying the position of the inspection object 250 having a predetermined risk. Alternatively, the processing can include specifying the seat of the inspection object 250 who has entered the railway carriage 218 based on the ticket that the inspection object 250 having a predetermined risk has put into the ticket gate 211 when passing through the ticket gate 211. The control system 310 can be formed, for example, by a PLD (abbreviation of programmable logic device) such as FPGA (abbreviation of field programmable gate array), a processor such as ASIC (abbreviation of application-specific integrated circuit), a general-purpose or dedicated computer installed with a program, or a combination of some or all of them.

[0116] The control system 310 can specify the inspection object 250 based on the feature information of the inspection object 250 and the corresponding information that associates the feature information with the seat information assigned to the passenger having the feature corresponding to the feature information. The feature information can be information extracted by the control system 310 from the image obtained by the imaging system 201. The feature information can be, for example, a feature quantity specified based on the shape, size, etc. of a partial image extracted from the image obtained by the imaging system 201, can be information specifying the type of dangerous goods, or can be information representing another feature. Alternatively, the feature information can be information representing the above-mentioned risk. Extracting a partial image from the image acquired by the imaging system 201 can include, for example, extracting a portion having a brightness higher than a predetermined brightness. AI (artificial intelligence) can be used to extract feature information. More specifically, AI that has undergone deep learning is installed in the control system 310, and feature information can be extracted by AI. For example, information representing a risk in an image captured by the camera 203 appears in different ways depending on the position and orientation of the camera 203. Therefore, deep learning can be performed based on images captured by multiple cameras 203.

[0117] The control system 310 can transmit the result of the above-mentioned processing to a pre-set terminal 320 via the communication unit 315. The terminal 320 can be carried, for example, by a crew member in the railway carriage 218. The terminal 320 may include a terminal carried by a person other than the crew member in the railway carriage 218, a terminal set in a security office arranged in a station or the like, and a terminal set in an administrative agency such as a police station.

[0118] The imaging system 201 can acquire an image of the inspection object 250 passing through the ticket gate 211, and transmit the acquired image to the control system 310. The control system 310 can determine the risk of the inspection object based on the image received from the imaging system 201. In addition, the control system 310 can extract feature information of the inspection object from the image received from the imaging system 201.

[0119] The control system 310 generates corresponding information that associates feature information of the inspection object 250 extracted from the image received from the imaging system 201 with seat information read by the ticket gate 211. For example, the feature information can be information that strongly suggests holding a gun, and the seat information can be seat information read by the ticket gate 211 from a ticket held by the inspection object 250 holding a gun. The corresponding information can be transmitted from the control system 310 to the terminal 320 in the railway carriage 218. The feature information can include information for identifying the ID of the inspection object 250 (that is, information for specifying an individual). The imaging system 201 may include a visible light camera, and can recognize the ID of the inspection object 250 from a visible light image of the inspection object 250 or from a visible light image by AI or the like. The visible light image of the inspection object having a predetermined risk can be transmitted to the railway carriage 218 together with the above-mentioned corresponding information, and can also be transmitted to the terminal 320. Here, the case where the imaging system 201 arranged on the ticket gate 211 acquires an image of the inspection object 250 has been described. However, the tracking of the inspection object 250 may be started or continued based on an image obtained from the imaging system 201 arranged on the partition wall 213, the escalator 221, the stairs 222, or the passage 242. In addition, the tracking of the inspection object 250 may be started based on an image obtained by the imaging system 201 arranged on the ticket gate 211, and thereafter, the tracking of the inspection object 250 may be continued using a monitoring camera using visible light.

[0120] Hereinafter, a processing system capable of more advantageously performing inspection using terahertz waves will be described. In the following description, terahertz waves include electromagnetic waves in a frequency range of 30 GHz to 30 THz. The concept of electromagnetic waves can include visible light, infrared light, and radio waves such as millimeter waves.

[0121] (First embodiment)

[0122] Will refer to Fig.23 4. The processing system 401 according to the first embodiment is described in detail. The processing system 401 includes a first imaging system including a first illumination source 404 and a first camera 402, a second imaging system including a second camera 405, and a processor including a pre-processing unit 406 and a post-processing unit 407.

[0123] The first camera 402 of the first imaging system acquires a first image based on the terahertz wave 403 of the first wavelength radiated from the first irradiation source 404. The terahertz wave 403 radiated from the first irradiation source 404 irradiates the inspection object 410. If the inspection object 410 is a person wearing clothes, the terahertz wave 403 passes through the fibers of the clothes and is reflected by the metal or ceramic held by the inspection object 410. Specific substances, such as RDX (trimethylene trinitramine) as an explosive, are known to absorb terahertz waves near 0.8 THz, and therefore, the reflected wave is reduced. The first camera 402 acquires the first image based on the reflected wave.

[0124] The second camera 405 of the second imaging system acquires a second image from an electromagnetic wave of a wavelength different from the terahertz wave irradiated from the first irradiation source 404. As the electromagnetic wave of a different wavelength, visible light, infrared light, or millimeter wave can be used. When infrared light is used, an irradiation source (not shown) different from the first irradiation source 404 can be prepared. The second image acquired by the second camera 405 is processed by the preprocessing unit 406. The preprocessing unit 406 performs a process of detecting an inspection area from the second image.

[0125] If the second image is acquired by visible light and the inspection object 410 is a person, the detection of the inspection area can be performed by detecting a specific part of the clothes as the inspection area. A model can be created by machine learning and the area of ​​the captured second image can be classified by the model to specify the inspection area. Alternatively, the area can be specified based on information about the shape of the object stored in the database 409. If the second image is acquired by millimeter waves, the part of the image with an intensity distribution greater than a threshold or a part with a large intensity difference can be detected as the inspection area. If infrared light is used to acquire the second image, the part with less radiation of infrared light caused by water or the specific part of the clothes in the image detected by night vision can be detected as the inspection area. Even in a dark place or a place with a poor field of vision due to weather, infrared light or millimeter waves can be used to detect the inspection area. When detecting the inspection area from an image of a person wearing clothes, the unnatural bulging part of the clothes, the chest of the person, or the pocket part of the clothes can be detected as the inspection area.

[0126] Will be based on Fig.24To describe the inspection of the inspection object 410 performed by the processor. The pre-processing unit 406 detects the inspection area (steps S422 and S423) from the second image (step S421) acquired by the second camera 405 by the above method. The post-processing unit 407 performs image data processing (step S425) for the information of the area of ​​the first image corresponding to the inspection area detected from the second image. The first image is an image acquired by the first camera 402 using terahertz waves (step S424), and is an image obtained by seeing through clothes, etc. If there is a metal or ceramic object under the clothes, an image can be obtained from the reflected wave. Therefore, the shape of the object can be detected by processing the first image. After the inspection area is detected from the second image, the area corresponding to the inspection area in the first image is selected by comparing the first image and the second image. Subsequent image processing of the first image is performed for the area corresponding to the inspection area detected from the second image.

[0127] When an area corresponding to the inspection area is selected from the first image and image processing is performed, the processing can be performed while reducing unnecessary information. For this reason, the processing burden can be reduced compared to processing the entire image data. Therefore, even if the inspection object 410 is moving, features can be detected from the first image multiple times in a short moving distance in a short time. The determination unit 408 estimates the object under the clothes based on multiple detected features (step S426). Multiple features can be features of parts of the object. The determination unit 408 can classify the shape of the object detected from the first image based on the data in the database 409. Classification can be completed using a model created by machine learning. It is believed that because of the movement of the inspection object 410 or the positional relationship between the inspection object and the camera, the information of the shape obtained from the image may be information of a part of the object. Even in this case, it is possible to improve the estimation accuracy (step S427) by classifying the features based on the information of multiple features, accumulating multiple results, and performing determination based on the accumulated classification results.

[0128] When the processing system is used in a security monitoring system, the risk of the object detected from the inspection area is determined based on the accumulation of the classification results of the inspection object 410 (step S428). Regarding the determination, the determination based on the cumulative results of the classification can be performed based on the model obtained by machine learning. If it is determined that the inspection object 410 holds a dangerous substance, the inspection object 410 can be notified to the outside that the inspection object 410 holds the dangerous substance. When the inspection object 410 passes through a door arranged with a processing system, the processing system can notify the outside of an alarm. When the inspection object 410 puts a ticket and passes through a ticket gate, the processing system can link the ticket with the inspection object 410 and notify the inspection object 410 that it is a monitoring target. If the second image is obtained using visible light, it is possible to display the inspection object 410 so that it can be easily seen by displaying the second image and the first image in an overlapping manner on the monitor. When it is determined to be suspended, the inspection is repeated until the end condition is met. The end condition can be the number of repetitions of the inspection (S429).

[0129] (Second embodiment)

[0130] In this embodiment, the second imaging system is provided with a second illumination source 411 that radiates terahertz waves. Fig.25 To describe this embodiment. The second irradiation source 411 is an irradiation source that generates a terahertz wave of a second wavelength different from the first irradiation source 404. As described in the first embodiment, it is known that there is a specific substance that absorbs a terahertz wave of a specific wavelength. Therefore, a terahertz wave of a first wavelength (about 0.8 THz for RDX as an explosive) is radiated from the first irradiation source 404 to the inspection object 410, and the first wavelength is a wavelength that is easily absorbed by the specific substance. If the inspection object 410 holds a substance having a characteristic of easily absorbing the terahertz wave of the first wavelength, the reflection in the portion holding the substance becomes smaller. On the other hand, when a wavelength (about 0.5 THz when the first wavelength is 0.8 THz) that is less absorbed by the specific substance is selected as the terahertz wave of the second wavelength generated by the second irradiation source 411, the specific substance reflects the terahertz wave of the second wavelength. It is possible to specify a substance using the difference between the reflected waves from the specific substance for the same inspection area.

[0131] Will be based on Fig.26431 and 432). The post-processing unit 407 acquires the first image based on the terahertz wave of the first wavelength captured by the first camera 402 (step S434), and starts processing image data for the area of ​​the first image corresponding to the inspection area detected from the second image. The post-processing unit 407 is capable of calculating the difference between the information of the inspection area in the second image and the information of the area of ​​the first image corresponding to the inspection area (step S435).

[0132] The data of the part where the reflection and absorption in the second image are almost equal to the reflection and absorption in the first image is almost eliminated by calculating the difference between the two pieces of information. However, the data of the part where the reflection and absorption are different between the first wavelength and the second wavelength is not eliminated even by calculating the difference between the two images. In this way, the difference in the absorption rate of the material to the terahertz wave can be used to perform spectral analysis of the material in the inspection area. The type of material can be estimated using spectral analysis. In addition, because the scattering or reflection of the clothes is eliminated, the unnecessary signal from the clothes can be reduced from the obtained image information, and the signal-to-noise ratio of the image can be improved.

[0133] If the person being inspected holds a substance that easily absorbs the first wavelength, the substance detected in the inspection area can be classified based on the difference in absorbance between the first wavelength and the second wavelength (step S436). Regarding classification, when the relationship between a specific substance and a wavelength is saved in the database 409, the determination unit 408 can perform classification based on the database 409. The determination unit 408 can perform classification using a model created by machine learning. Through the above method, it can be estimated that the inspection object 410 holds a substance that absorbs a specific wavelength. It is known that there are dangerous substances in substances that absorb terahertz waves of a specific wavelength. The presence of dangerous substances can be estimated by spectral analysis. The detection accuracy can be improved by accumulating multiple spectral analysis results (step S437).

[0134] Therefore, it is determined that the inspection object 410 may be holding a dangerous substance (step S438). Regarding the determination, a determination based on the cumulative results of the classification can be performed based on a model obtained by machine learning. If it is determined that a dangerous substance is held, the processing system notifies the outside that the inspection object 410 holds the dangerous substance. When the inspection object 410 passes through a door arranged with a processing system, the processing system can notify the outside of an alarm. When the person of the inspection object 410 puts in a ticket and passes through the ticket gate, the processing system can link the ticket with the inspection object 410 and notify the outside of this person as a monitoring target. Regarding the wavelength of the terahertz wave irradiated from the second irradiation source 411, multiple irradiation sources capable of irradiating terahertz waves of multiple (that is, three or more) wavelengths can be combined according to the absorption spectrum of the substance to be detected. When the suspension is determined, the inspection is repeated until the end condition is met. The end condition can be the number of repetitions of the inspection (S439).

[0135] (Third Embodiment)

[0136] In this embodiment, based on the detection of a specific area in the second image captured by the second imaging system, the control unit 412 is controlled to control the first illumination source 404 and the first camera 402 in the first imaging system. Fig. 27 and Fig.28 This embodiment will be described.

[0137] The second camera 405 of the second imaging system acquires a second image from an electromagnetic wave of a wavelength different from the terahertz wave radiated from the first illumination source 404. As the electromagnetic wave of different wavelength, visible light, infrared light or millimeter wave can be used. The second image acquired by the second camera 405 is processed by the preprocessing unit 406. The preprocessing unit 406 detects the inspection area from the second image (steps S452 and S453). The detection of the inspection area is performed as described in the first embodiment.

[0138] The conditions for the first camera to capture are controlled according to the position and range of the inspection area detected from the second image and the state of the inspection area. The conditions include control of the posture of the first camera, control of the gain for the acquired image, and control of the capture range and viewing angle of zoom or cropping (step S454). The output level (output power) and wavelength of the terahertz wave irradiated from the first illumination source 404 can be changed according to the intensity of the reflected signal from the inspection area or the target object in the inspection area. Through this control, the inspection accuracy can be improved. The first imaging system controlled by the control unit 412 acquires the first image based on the terahertz wave of the first wavelength (step S455).

[0139] The post-processing unit 407 performs processing of the inspection area based on the acquired first image (step S456). Thereafter, the determination unit 408 performs determination and classification of the object (steps S457, S458, and S459). When the processing system is a security monitoring system, the risk is determined based on the accumulation of the classification results. If it is determined that the inspection object 410 holds a dangerous substance, the processing system notifies the outside that the inspection object 410 holds the dangerous substance. When the inspection object 410 passes through a door arranged with a processing system, the processing system may notify the outside of an alarm. When the inspection object 410 puts in a ticket and passes through a ticket gate, the processing system may link the ticket with the inspection object 410 and set the inspection object 410 as a monitoring target. When the suspension is determined, the inspection is repeated until the end condition is met. The end condition may be the number of repetitions of the inspection (S460).

[0140] (Fourth embodiment)

[0141] In this embodiment, an environment monitoring unit 413 configured to monitor the humidity around the processing unit is provided. Fig.29 This embodiment is described below. Terahertz waves are easily absorbed by water vapor. Terahertz waves with longer wavelengths are hardly affected by water vapor. Therefore, an environment monitoring unit 413 is provided to measure humidity, and the imaging system is controlled so as to be hardly affected by the surrounding environment.

[0142] More specifically, if the environment monitoring unit 413 detects that the humidity has become high, the wavelength of the terahertz wave 403 radiated from the first irradiation source 404 is switched to a wavelength longer than the wavelength currently used. Depending on the humidity, the wavelength can be switched to a wavelength that is hardly affected by water vapor (a region that exists near a wavelength of 1.2 mm or 0.75 mm, where the attenuation of the atmosphere is particularly small). When the wavelength of the terahertz wave becomes longer, the resolution of the image captured by the camera decreases. However, the influence of water vapor can be mitigated and the inspection can be continued.

[0143] (Fifth Embodiment)

[0144] In this embodiment, capturing is performed using terahertz waves of different wavelengths. A second image is acquired using a terahertz wave of a second wavelength longer than the wavelength when the first image is captured, and an inspection area is detected from the second image. A model created by machine learning may be used to detect the inspection area as an area including an object of a predetermined shape, or an area where the spectrum of a reflected wave of a predetermined wavelength changes may be detected as the inspection area.

[0145] Will refer to Fig.30to describe this embodiment. Based on the inspection area detected from the second image, the image data of the area of ​​the first image corresponding to the inspection area is processed. The first image captured by the terahertz wave of the first wavelength generated from the first illumination source 404 is capture 1, and the second image captured by the terahertz wave of the second wavelength generated from the illumination source 411 is capture 2. Because the image of capture 1 is acquired using a terahertz wave of a shorter wavelength than that in capture 2, the resolution is high and the amount of information is large. Therefore, the shape of each object held by the inspection object 410 is clear in the image acquired by the terahertz wave. However, because a short wavelength terahertz wave is used, the depth of field is shallow, and the capture is sensitive to changes in the posture of the inspection object 410.

[0146] More specifically, according to the posture of the inspection object 410, a partial shape is acquired as the shape of the object held by the inspection object 410. On the other hand, in the image obtained by capture 2, because the wavelength of the terahertz wave is long, the resolution is low, and the shape of each object is unclear compared with capture 1. However, because the terahertz wave of a long wavelength is used, the depth of field is deep, and the capture is insensitive to the change of the posture of the inspection object 410. More specifically, the entire shape of the object held by the inspection object 410 is acquired independently of the posture of the inspection object 410. When the low-resolution capture 2 is processed to specify the position of the object held by the inspection object 410 and the data of capture 1 is processed based on the detected inspection area, the processing burden can be reduced, and the processing can be performed at a higher speed. Therefore, even if the inspection object 410 is moving, the features of the inspection object 410 can be detected multiple times in a short moving distance in a short time, and the object under the clothes can be estimated based on the detected features.

[0147] In addition, when calculating the difference between capture 1 and capture 2 performed using two different wavelengths of terahertz waves, the reflection caused by the clothes is eliminated, and the noise can be mitigated from the obtained image information. More specifically, because scattering is the main component of the reflection from the entire clothes, the intensity difference is small, and the capture is insensitive to changes in the posture of the inspection object 410 (random noise is added to the acquired image as a whole). For this reason, when calculating the difference image between capture 1 and capture 2, the signal of the clothes is eliminated. In addition, when calculating the difference, it is possible to obtain an image based on the difference in the terahertz wave absorption rate of the substance through which the terahertz wave passes. Therefore, it is possible to detect the shape of an object containing a substance other than metal or ceramic as a component from the difference between the first image and the second image.

[0148] The object in the inspection area is estimated by classifying the shape of the object detected from capture 1 through the determination unit 408. If the inspection object 410 moves, the shape of the object obtained from the image is generally partial. Therefore, it is possible to improve the determination accuracy by accumulating multiple classification results and performing determination based on the accumulated classification results. In the case of a security monitoring system, the risk is determined based on the accumulation of classification results. If it is determined that the inspection object 410 holds a dangerous substance, the processing system notifies the inspection object 410 that the dangerous substance is held. When the inspection object 410 passes through a door where the processing system is arranged, the processing system can notify an alarm to the outside. When the inspection object 410 puts in a ticket and passes through the ticket gate, the processing system can link the ticket with the inspection object 410 and set the inspection object 410 as a monitoring target.

[0149] (Sixth embodiment)

[0150] Will refer to Fig.31 and Fig.32 To describe an application example of the processing system. Fig.31 An example is shown in which a first irradiation source 404 of a terahertz wave of a first wavelength and a second irradiation source 411 of a second wavelength different from the first wavelength are arranged on one side of a doorway 414 of a vehicle, etc. A first camera 402 configured to perform capture based on the terahertz wave of the first wavelength, a second camera 405-1 configured to perform capture based on one of visible light, infrared light, and millimeter waves, and a second camera 405-2 configured to perform capture based on the terahertz wave of the second wavelength are arranged on the other side of the doorway 414. When the camera and the irradiation source are combined, the processing regarding inspection described in the first to fifth embodiments can be performed in combination.

[0151] The inspection object 410 can be tracked by the second camera 405-1, and the posture and viewing angle of the first camera 402 can be controlled. When the wavelength of the terahertz wave captured by the second camera 405-2 configured to perform capture based on the terahertz wave is set according to the absorption rate of the substance, spectral analysis can be performed. In addition, when the second cameras 405-1 and 405-2 are used to detect the inspection area, the processing burden of the first image captured by the first camera 402 can be reduced.

[0152] In addition, the shape of an object containing a material other than metal or ceramic as a component can be detected using the difference in the absorptivity of the material to the wavelength of the terahertz wave. In this embodiment, as the second camera 405, a camera for visible light, infrared light or millimeter wave and a camera for the terahertz wave of the second wavelength are used. However, only one of the cameras for visible light, infrared light or millimeter wave and the terahertz wave of the second wavelength can be used as the second camera. The irradiation source and the camera can be buried in the wall surface, ceiling or floor surface inconspicuously. The irradiation source and the camera can be arranged on both the left and right sides of the doorway 414. When the irradiation source and the camera are set near the doorway 414, the overlapping of multiple inspection objects 410 can be alleviated, and the inspection accuracy can be improved.

[0153] Will refer to Fig.32 An example in which the processing system is arranged near a ticket gate 415 installed at a ticket gate of a station is described. A first irradiation source 404 of a terahertz wave of a first wavelength and a second irradiation source 411 of a second wavelength different from the first wavelength are arranged on one side of the ticket gate 415. A first camera 402 configured to perform capture based on the terahertz wave of the first wavelength, a second camera 405-1 configured to perform capture based on one of visible light, infrared light, and millimeter waves, and a second camera 405-2 configured to perform capture based on the terahertz wave of the second wavelength are arranged on the other side of the ticket gate 415. When the processing system is arranged near the ticket gate 415, a situation in which a plurality of inspection objects 410 overlap can be alleviated, and inspection accuracy can be improved.

[0154] The operation of the processing system may be started based on the detection of the movement of the inspection object 410, the opening / closing of the door of the vehicle, the insertion of a ticket into the ticket inspection machine 415, etc. by a sensor provided independently of the processing system. A plurality of first cameras and second cameras may be provided. By using a plurality of cameras, the detection accuracy can be improved, the number of inspection objects can be increased, and the inspection area can be expanded.

[0155] Will refer to Fig.33 The operation of the camera 200 will be described. Fig.33 1 is a flowchart showing an example of the operation of the camera system 200 according to this embodiment. As the arrangement of the camera system 200, the arrangement of the above-described embodiment can be applied. In this embodiment, the operation after the camera system 200 acquires an image based on a terahertz wave (sometimes referred to as a terahertz image) will be described. Fig.33 In the embodiment, the camera system 200 evaluates the acquired image, and if the quality is lower than the expected quality, performs the operation of capturing the image again (re-capture).

[0156] First, in step S1001, the irradiation unit 202 irradiates the inspection object 250 with terahertz waves under desired conditions. Next, in step S1002, the camera 203 detects the terahertz waves reflected by the inspection object 250 and acquires information based on the terahertz waves. In step S1003, the control unit performs a process of converting the information based on the terahertz waves into an image. Here, the control unit can be, for example, the control system 310 as described above.

[0157] Next, the control unit evaluates the quality of the acquired terahertz image (step S1004). As evaluation items, items indicating whether a suitable terahertz image corresponding to the inspection object 250 can be acquired, whether an object can be detected from the terahertz image of the image quality, etc. can be appropriately set. In the image quality evaluation, if the expected image quality is not met, the camera system 200 performs the operation of step S1005. In step S1005, the control unit supplies a control signal for changing the wavelength and increasing the power of the irradiated terahertz wave to the irradiation unit 202. The irradiation unit 202 performs terahertz wave irradiation again (step S1001). Through a series of operations, the desired object can be appropriately detected.

[0158] Note that in the image evaluation, when it is determined that the desired image quality can be obtained, the control unit determines whether there is an object to be detected, and in some cases determines the type of the object (step S1006). If an object is detected, the control unit causes the monitor system to display a warning. Alternatively, the control unit outputs an instruction to perform an operation of adding a flag to a high-risk object or person (step S1007). If no object is detected, the control unit may add a flag to a confirmed low-risk person (step S1008).

[0159] For the series of operations, it is possible to use the irradiation unit 202 and the camera 203 in the following combination. If the irradiation unit 202 and the camera 203 are used in the first capturing, the second capturing and the subsequent capturing may be performed using the same irradiation unit 202 and the same camera 203. In addition, if the irradiation unit 202 and the camera 203 are used in the first capturing, the second capturing and the subsequent capturing may be performed using the same irradiation unit 202 as in the first capturing and a camera 203 different from that in the first capturing. In addition, if the irradiation unit 202 and the camera 203 are used in the first capturing, the second capturing and the subsequent capturing may be performed using an irradiation unit 202 different from that in the first capturing and the same camera as in the first capturing. In addition, if the irradiation unit 202 and the camera 203 are used in the first capturing, the second capturing and the subsequent capturing may be performed using an irradiation unit 202 and a camera 203 different from that in the first capturing.

[0160] Next, refer to Fig.34 Another operation of the camera system 200 will be described. In this example, an operation of capturing an image in synchronization with the opening and closing of an entrance door of a railway car, an entry door of a passenger car, or a platform screen door will be described. Fig.34 is a flowchart showing the operation of capturing an image in synchronization with a door. In this embodiment, the control unit can also be, for example, the control system 310 described above. Descriptions of the same arrangements and operations as in other embodiments will be omitted. In addition, the door can be, for example, Figures 16A to 17C A door 219 or door portion 214 of a railroad car 218 is shown.

[0161] First, in the camera system 200, the irradiation unit 202 is in a standby state (step S1101). At this time, the camera 203 may also be in a standby state. The control unit detects a door opening signal (step S1102). When the door opening signal is detected, the control unit supplies a control signal for irradiating the inspection object 250 to the irradiation unit 202, and supplies a control signal for capturing the inspection object 250 to the camera 203. The irradiation unit 202 starts terahertz wave irradiation according to the control signal from the control unit (step S1103). The camera 203 starts detecting terahertz waves according to the irradiation unit 202 starting irradiation (step S1104). If the control unit does not detect the door opening signal, the standby state is maintained (step 1101). When the door opening signal is detected in step S1102, the control unit is set to a state where it can always detect the door closing signal (step S1106). When the door closing signal is detected in step S1106, the control unit supplies a control signal for stopping the terahertz wave irradiation to the irradiation unit 202, and supplies a control signal for stopping the terahertz wave detection to the camera 203 (steps S1107 and S1108). Here, if the control unit detects the door closing signal, at least one of steps S1107 and S1108 is performed. If the door closing signal is not detected, the irradiation and detection of the terahertz wave are continued, and the camera system 200 continues to capture. By a series of operations of monitoring the opening and closing state of the door, the power of the camera system 200 can be saved. In addition, by the series of operations, reliable capture can be performed at necessary timing.

[0162] Next, refer to Fig.34 Next, another operation of the camera system 200 will be described. In this example, a case where an image is captured in synchronization with the operation of the ticket gate 211 will be described. Fig.34 211. It is a flowchart showing the operation of capturing an image in synchronization with the ticket gate 211. In this embodiment, the control unit can also be, for example, the control system 310 as described above. The description of the same arrangement and operation as in other embodiments will be omitted.

[0163] First, in the camera system 200, the irradiation unit 202 is in a standby state (step S1201). At this time, the camera may also be in a standby state. The control unit is in a state capable of detecting a door opening signal notifying that the door provided in the ticket gate 211 is open (step S1202). If the control unit detects the door opening signal, the irradiation unit 202 starts terahertz wave irradiation (step S1203). In addition, the camera 203 starts detecting terahertz waves according to the irradiation unit 202 starting irradiation (step S1204). If the control unit does not detect the door opening signal, the standby state is maintained (step S1201). In order to detect the door opening signal in step S1202, a signal generated by a ticket placed in the ticket gate 211, a signal generated by bringing a ticket such as an IC card into contact with the ticket gate 211, or a signal for detecting the presence or absence of a ticket such as an IC card in the ticket gate 211 using millimeter waves can be used. When the opening and closing state of the door of the ticket gate 211 is monitored in this way, power can be saved. In addition, through the operation, reliable capturing can be performed.

[0164] Next, refer to Fig.36 To describe another operation of the camera system 200. In this embodiment, the operation of the camera system 200 will be described using reference Fig. 14B The operations performed in the case of the sensor 260 are described. Fig.36 2 is a flowchart showing the capturing operation in the ticket inspector 211. In this embodiment, the control unit can also be, for example, the control system 310 as described above. Descriptions of the same arrangements and operations as those in other embodiments will be omitted.

[0165] As described above, the sensor 260 detects the inspection object 250. Here, the sensor 260 may be, for example, a motion sensor using infrared rays or a camera using visible light. First, in the camera system 200, the irradiation unit 202 is in a standby state (step S1301). At this time, the camera may also be in a standby state. Next, the inspection object 250 is detected using the sensor 260 (step S1302). The signal from the sensor 260 is sent to the control unit. When it is determined that the inspection object 250 is detected, the control unit supplies a control signal for irradiating the inspection object 250 to the irradiation unit 202. The irradiation unit 202 starts terahertz wave irradiation according to the control signal from the control unit (step S1303). In addition, the control unit supplies a control signal for capturing the inspection object 250 to the camera 203. The camera 203 starts detecting terahertz waves according to the control signal from the control unit (step S1304). If the control unit does not determine that the inspection object 250 is detected, the standby state is maintained (step S1301).

[0166] By this operation, power can be saved. In addition, by this operation, reliable capture can be performed. In this embodiment, the case where the inspection object 250 is a person has been described. However, the inspection object 250 may be an object. This arrangement can also be applied to Fig.18A and 18B The escalator 221 shown, etc. If the escalator includes a motion sensor, the sensor can be shared.

[0167] Other embodiments

[0168] The (one or more) embodiments of the present invention can also be implemented by: a computer of a system or device, which reads and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more completely referred to as a "non-transitory computer-readable storage medium") to perform one or more functions of the above (one or more) embodiments, and / or includes one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing one or more functions of the above (one or more) embodiments; a method, which is performed by the computer of the system or device, for example, by reading and executing the computer executable instructions from the storage medium to perform one or more functions of the above (one or more) embodiments and / or controlling the one or more circuits to perform one or more functions of the above (one or more) embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and may include a network of independent computers or independent processors that read and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of the following: a hard disk, a random access memory (RAM), a read-only memory (ROM), a storage of a distributed computing system, an optical disk (such as a compact disk (CD), a digital versatile disk (DVD) or a Blu-ray disk (BD) TM ), flash memory devices, memory cards, etc.

[0169] Other embodiments

[0170] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0171] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A mobile body comprising an imaging system configured to acquire an image formed by a terahertz wave, The imaging system includes a plurality of irradiation sources configured to irradiate an inspection object of a passageway using a common portion of the moving body with the terahertz wave, and a plurality of cameras configured to capture an image of the inspection object irradiated with the terahertz wave by the plurality of irradiation sources. in, The number of the plurality of illumination sources is greater than the number of the plurality of cameras, The passage includes a first passage extending in a first direction and a second passage extending in a second direction different from the first direction and connected to the first passage, a wall facing a connection portion between the first aisle and the second aisle including a first corner portion and a second corner portion, the first corner portion and the second corner portion being arranged so that the inspection object can pass through a space between the first corner portion and the second corner portion, At least two of the plurality of illumination sources are arranged to overlap in a vertical direction at the first corner portion, at least two of the plurality of illumination sources are arranged to overlap in a vertical direction at the second corner portion, and the plurality of cameras are embedded in one of a wall, a ceiling, and a floor.

2. The moving object according to claim 1, wherein: The passageway includes a corridor, and the plurality of cameras includes cameras configured to capture an inspection object using the corridor.

3. The moving object according to claim 1, wherein: The aisle includes a cabin aisle passing through one side of a space where seats are arranged, and the plurality of cameras include cameras configured to capture an inspection object using the cabin aisle.

4. The moving object according to claim 3, wherein: The camera configured to capture an inspection object using the cabin aisle is arranged on the seat.

5. The moving object according to claim 1, wherein: The plurality of cameras includes cameras arranged on a stand.

6. The moving object according to claim 1, wherein: The optical axes of the plurality of cameras face in different directions from each other.

7. The moving object according to claim 1, wherein: The corridor includes steps, and The plurality of cameras includes a camera configured to capture an inspection object passing through the stairs.

8. The moving object according to claim 1, wherein: The common portion includes a washstand, and the plurality of cameras includes a camera configured to capture an inspection subject using the corridor.

9. The moving object according to claim 1, wherein: The common portion includes a restroom, and the plurality of cameras include a camera configured to capture an inspection subject using the restroom.

10. The moving object according to claim 1, wherein Each camera of the plurality of cameras is embedded in one of the ceiling and the floor.

11. The moving object according to claim 1, wherein: A wall facing the connection portion includes a curved surface configured to reflect the terahertz wave.

12. The moving object according to claim 11, wherein: The plurality of illumination sources and the plurality of cameras are embedded in a wall facing the connection portion.

13. The moving object according to claim 1, wherein: The plurality of cameras are arranged on one of a ceiling and a floor of the moving body.

14. The moving object according to claim 1, wherein: The plurality of irradiation sources are arranged on a plurality of seats to irradiate an inspection object using the common portion with the terahertz wave, and the plurality of cameras are arranged on a periphery of a doorway of a cabin to capture the inspection object irradiated with the terahertz wave.

15. The mobile body according to claim 14, further comprising a sensor configured to detect the inspection object, in, The plurality of illumination sources are controlled based on the output of the sensor.

16. The moving object according to claim 1, wherein: The imaging system includes a reflective surface configured to reflect the terahertz wave, and the reflective surface includes a curved surface.

17. The mobile body according to claim 1, further comprising a processor configured to perform processing of a signal output from the imaging system, in, The processing includes determining a risk regarding the examination subject.

18. The moving object according to claim 17, wherein: The processing includes specifying a location of an inspection object having a predetermined risk.

19. The moving object according to claim 17, wherein: The processing includes assigning a seat to an examination subject having a predetermined risk.

20. The moving object according to claim 19, wherein: The processor specifies a seat of the inspection object based on correspondence information associating the feature information of the inspection object with seat information allocated to a passenger having a feature corresponding to the feature information.

21. The moving object according to claim 20, wherein: The feature information is information extracted from an image captured by the imaging system.

22. The moving object according to claim 17, wherein: The processor sends the processing result to a preset terminal.

23. The mobile body according to claim 1, wherein: The imaging system is arranged at a position where the inspection object moving in the moving body is rectified.

24. The moving object according to claim 1, wherein: The imaging system is arranged at a position where the inspection object moving in the moving body changes direction.

25. The mobile body according to claim 1, wherein: The imaging system is arranged at a position where the inspection object moving in the moving body decelerates or stops.

26. The mobile body according to claim 1, wherein: The imaging system is arranged at a position where the inspection object moving in the moving body rotates.

Images