Inspection system, inspection method, and database creation method

Abstract

To provide an inspection system, an inspection method, and a database creation method that allow an inspection to be efficiently performed.SOLUTION: An inspection system includes an inspection device used for a primary inspection and an information processing device used for a secondary inspection. An inspection device includes an image interface, a first processor, and a first communication unit. When a specified part in an image to be inspected which is displayed on the first display device is specified by a first operation device, the first processor specifies a specific area that is an area of an article including the specified part; and obtains a primary inspection result including both the image to be inspected and information indicating the specific area. The information processing device includes a second communication unit and a second processor. The second processor causes a second display device to display the image to be inspected where the specific area is highlighted.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] FIELD Embodiments of the present invention relate to an inspection system, an inspection method, and a database creation method. [Background technology]

[0002] Conventionally, at inspection sites such as customs, it has been necessary to inspect whether or not a specific object is present within an object to be inspected, such as baggage. When there are many pieces of baggage that can be inspected, it takes a great deal of time and effort for inspectors to open and inspect all of them. For this reason, in recent years, inspection systems have been proposed that perform secondary inspections, such as opening and inspecting, based on the results of a primary inspection, which involves analyzing images (X-ray images) taken of the baggage to be inspected using electromagnetic waves such as X-rays and visually confirming the images by inspectors.

[0003] In conventional inspection systems, when a secondary inspection is conducted on baggage that has been determined to require an opening inspection during the primary inspection, the results of the primary inspection are communicated from the first inspector who conducted the primary inspection to the second inspector who will conduct the secondary inspection using an intercom (intercommunication system) or the like. However, there is a problem in that it is difficult for the first inspector to accurately communicate to the second inspector the results of the primary inspection, such as the location where the primary inspection determined that a secondary inspection was necessary or the reason for determining that a secondary inspection was necessary. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-175410 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to provide an inspection system, an inspection method, and a database creation method that can perform inspections efficiently. [Means for solving the problem]

[0006] According to an embodiment, an inspection system includes an inspection device used for a primary inspection of an inspection object and an information processing device used for a secondary inspection. The inspection device includes an image interface, a first processor, and a first communication unit. The image interface acquires captured image data including an image of the inspection object captured by irradiating the inspection object with electromagnetic waves. The first processor displays the image of the inspection object included in the captured image data acquired by the image interface on a first display device, and when a specified location in the image of the inspection object displayed on the first display device is specified by a first operation device, extracts a specific area that is an area of ​​an item including the specified location, and acquires a primary inspection result including the image of the inspection object and information indicating the specific area. The first communication unit outputs the primary inspection result including the image of the inspection object and information indicating the specific area. The information processing device includes a second communication unit and a second processor. The second communication unit acquires a primary inspection result including the image of the inspection object and information indicating the specific area extracted from the image of the inspection object by the inspection device. The second processor causes the second display device to display the image of the inspection object in which the specific region is highlighted. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram for explaining an outline of an operation mode of an inspection by an inspection system according to an embodiment. [Figure 2] FIG. 2 is a diagram schematically showing the overall configuration of an inspection system according to an embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of an imaging device and an inspection device in a primary inspection system of an inspection system according to an embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of an information processing device in a secondary inspection system of the inspection system according to the embodiment. [Figure 5] FIG. 5 is a block diagram showing an example of the configuration of a data server in the inspection system according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of a primary inspection process performed by the inspection device in the inspection system according to the embodiment. [Figure 7] FIG. 7 is a diagram showing an example of a display in which a three-dimensional image is displayed as a captured image of a baggage M to be inspected, which is displayed on a display device by the inspection device according to the embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a display screen for rotating and displaying a three-dimensional image of a package displayed on a display device by the inspection device according to the embodiment in response to an operational instruction from an inspector. [Figure 9] FIG. 9 is a diagram showing an example of a display screen on which the inspection device according to the embodiment displays slice images obtained by slicing a three-dimensional image of a baggage along a slice plane designated by an inspector. [Figure 10] FIG. 10 is a diagram showing an example of a display in which a specific inspection area (specific area) including a designated location is highlighted and displayed on a display device by the inspection device according to the embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a display screen on which the inspection device according to the embodiment displays a three-dimensional image of a package in which a specific inspection area is colored, and candidates for items in the specific inspection area. [Figure 12] FIG. 12 is a flowchart for explaining the flow of the secondary inspection process by the secondary inspection system in the inspection system according to the embodiment. [Figure 13] FIG. 13 is a flowchart for explaining the flow of a database creation process performed by the data server in the inspection system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments will be described with reference to the drawings. First, the configuration of an inspection system 1 according to the embodiment will be described. Fig. 1 is a diagram for explaining an outline of an operation mode of an inspection by an inspection system 1 according to an embodiment. Fig. 2 is a diagram for explaining an example of the overall configuration of the inspection system 1 according to an embodiment. The inspection system 1 is a system for inspecting whether or not a specific object is present in luggage to be inspected. Examples of specific objects include dangerous goods, dangerous chemicals, prohibited drugs, and substances that are prohibited from being brought into or taken out of a specific area, such as within a country. Furthermore, the specific object does not have to be a solid with a specific shape, and may also include substances such as liquids and powders.

[0009] As shown in FIG. 2, the inspection system 1 includes a primary inspection system 1A, a secondary inspection system 1B, and a data server 10. The primary inspection system 1A is a system for performing a primary inspection on each piece of baggage to be inspected. The secondary inspection system 1B is a system for performing a secondary inspection on baggage that has been determined by the primary inspection to require a secondary inspection. The data server 10 is a server device for managing data related to the inspection results of the primary and secondary inspections.

[0010] As shown in FIGS. 1 and 2, the primary inspection system 1A in the inspection system 1 includes a conveyor 11, an imaging device 12, an inspection device 13, a display device (first display device) 14, and an operation device (first operation device) 15. The inspection device 13 is communicatively connected to the imaging device 12, the display device 14, and the operation device 15. The inspection device 13 supplies data to be displayed on smart glasses 16 of the secondary inspection system 1B based on the results of the primary inspection, etc. For example, the inspection device 13 transmits data including the results of the primary inspection to an information processing device 17 of the secondary inspection system 1B via a data server 10 or directly.

[0011] The conveyor 11 is a device that transports the luggage M to be inspected. The conveyor 11 transports the luggage M to be inspected to a position (reading position) where an image is captured by the imaging device 12. For example, the conveyor 11 transports the luggage M supplied by an inspector. The conveyor 11 may also be configured to transport luggage M supplied by a robot arm or the like.

[0012] The imaging device 12 irradiates electromagnetic waves onto the baggage M to be inspected, thereby acquiring image data including an image (photographed image) of the baggage M and physical property information indicating the physical properties of each part (e.g., pixel or voxel) of the photographed image. The imaging device 12 supplies the photographed image data of the baggage M to the inspection device 13. The imaging device 12 may be one that acquires a photographed image that allows the items inside the baggage M to be inspected to be visually recognized. The imaging device 12 may be one that acquires two-dimensional image data as the photographed image, or one that acquires three-dimensional image data. Note that a pixel is a picture element that makes up two-dimensional image data. A voxel is the smallest unit of data that makes up three-dimensional data, and represents a value in a regular lattice unit.

[0013] The imaging device 12 is, for example, an X-ray CT imaging device (CT device). The X-ray CT imaging device, which is an example of the imaging device 12, obtains three-dimensional X-ray image data as a captured image by irradiating X-rays from around the baggage M conveyed by the conveyor 11. The X-ray CT imaging device, which is the imaging device 12, also obtains captured image data including a three-dimensional X-ray image (captured image) obtained by capturing the baggage M using X-rays and physical property information indicating the physical properties of each constituent unit (voxel) that constitutes the X-ray image. The X-ray CT imaging device, which is the imaging device 12, supplies the captured image data obtained from the baggage M to the inspection device 13.

[0014] Although the imaging device 12 is not limited to an X-ray CT imaging device, the following embodiment will be described assuming that the imaging device 12 is an X-ray CT imaging device. When the imaging device 12 is an X-ray CT imaging device, the inspection device 13 acquires the image (three-dimensional image) captured by the imaging device 12 and physical property information (density, effective atomic number, etc.) of each voxel in the image.

[0015] The inspection device 13 is composed of a computer and the like equipped with an interface for connecting to each device. The inspection device 13 has functions such as a function to acquire photographed image data of the luggage M from the photographing device 12, a function to display the photographed image data acquired from the photographing device 12 on the display device 14, a function to control the display content of the display device 14 that displays the photographed image data, etc., a function to acquire information such as inspection results input by an inspector using the operation device 15, a function to display the information input by the inspector and the analysis results of the photographed image data on the display device 14, and a function to output the inspection results input by the inspector by linking them with various information such as the photographed image data.

[0016] The inspection device 13 acquires, at any timing, photographed image data including an image of the luggage M captured by the imaging device 12 using electromagnetic waves and physical property information of each part of the photographed image. For example, the inspection device 13 may store the photographed image data of the luggage M supplied from the imaging device 12 in a storage unit or the like and read it out when performing the inspection process. Furthermore, the inspection device 13 may acquire the photographed image data from the imaging device 12 by requesting the photographed image data stored in the imaging device 12.

[0017] The inspection device 13 transmits the results of the primary inspection of the baggage M to be inspected, which are input by an inspector, to the data server 10 (or the information processing device 17). For example, the inspection device 13 transmits, as the primary inspection results, information such as captured image data, information indicating a specific inspection area (specific area) for the baggage M (described later), and estimated results of items in the specific inspection area, in association with the identification information of the baggage M, to the data server 10.

[0018] The display device 14 is a first display device, and the display content is controlled by the inspection device 13. The display device 14 displays a photographed image of the baggage M to be inspected during the primary inspection. The display device 14 also displays, along with the photographed image of the baggage M, information indicating a specific area including a designated location specified by the inspector by highlighting it, for example, with color. When the display device 14 highlights a specific inspection area in the photographed image of the baggage M, it displays candidate items that are in the specific inspection area. Furthermore, when the display device 14 highlights a specific inspection area including a designated location specified by the inspector, it may also display guidance for inputting the reason for the primary inspection result, such as the reason for specifying the designated location.

[0019] The operation device 15 is a first operation device, which generates an operation signal according to an operation input by an inspector (operator) and supplies the operation signal to the inspection device 13. The operation device 15 is composed of operation devices such as a keyboard and a pointing device. The operation device 15 may also be composed of a touch panel or the like provided on the display screen of the display device 14.

[0020] 1 and 2, the secondary inspection system 1B in the inspection system 1 includes smart glasses (second display device) 16, an information processing device 17, an operation device (second operation device) 18, and the like. The information processing device 17 is connected to the smart glasses 16, the operation device 18, and the like. The information processing device 17 is also communicatively connected to the data server 10 or the inspection device 13 of the primary inspection system 1A. The information processing device 17 supplies data to be displayed on the smart glasses 16 to the smart glasses 16. For example, the information processing device 17 generates data to be displayed on the smart glasses 16 based on the results of the primary inspection supplied from the data server 10 or the inspection device 13, and supplies the data to the smart glasses 16.

[0021] The smart glasses 16 are an example of a second display device. The smart glasses 16 are a wearable device worn by an inspector conducting a secondary inspection. The smart glasses 16 may be any device that displays an image visible to the inspector conducting the secondary inspection, and may be replaced with a tablet PC or a stationary display device. The smart glasses 16 displays information about baggage subject to secondary inspection. For example, the smart glasses 16 displays information indicating the results of the primary inspection of baggage subject to secondary inspection. The smart glasses 16 may also include a configuration as an information processing device 17.

[0022] The operation device 18 is a second operation device that generates an operation signal according to an operation input by an inspector (operator) and supplies the operation signal to the information processing device 17. The operation device 18 is configured with operation devices such as a keyboard and a pointing device. The operation device 18 may also include an input device provided in the smart glasses 16. The smart glasses 16 may also include the operation device 18.

[0023] Next, information management in the inspection system 1 according to the embodiment will be described. FIG. 2 is a diagram showing an example of a configuration for performing information management in the inspection system 1 according to the embodiment. 2, the inspection system 1 has a data server 10 that is communicatively connected to an inspection device 13 of a primary inspection system 1A installed at a primary inspection site and an information processing device 17 installed at a secondary inspection site. The data server 10 functions as an information management device that manages information related to inspections in the primary inspection system 1A and the secondary inspection system 1B.

[0024] The data server 10 is composed of a computer such as a server device. The data server 10 has a storage device that stores information related to the inspections performed by each inspection system 1. The data server 10 stores and aggregates information obtained from the inspection device 13 of the primary inspection system 1A and the information processing device of the secondary inspection system 1B. For example, the data server 10 obtains primary inspection results from the inspection device 13 of the primary inspection system 1A and secondary inspection results from the information processing device of the secondary inspection system 1B. The data server 10 stores the primary inspection results obtained from the inspection device 13 and the secondary inspection results obtained from the information processing device of the secondary inspection system 1B in a database for each baggage to be inspected.

[0025] The data server 10 also supplies information to the inspection device 13 and the information processing device 17. For example, the data server 10 distributes data used for the second inspection to the information processing device 17 of the secondary inspection system 1B. The data server 10 distributes, as data used for the second inspection, information indicating the results of the first inspection of the baggage to be inspected, including information to be displayed on the smart glasses 16 worn by the inspector who performs the second inspection, to the information processing device 17 (or the smart glasses 16). The data server 10 may also distribute setting values ​​used for various processes, or update data for programs for executing various processes, to the inspection device 13 or the information processing device 17.

[0026] Next, the configuration of a control system in the imaging device 12 and the inspection device 13 that constitute the primary inspection system 1A in the inspection system 1 according to the embodiment will be described. FIG. 3 is a block diagram showing an example of the configuration of a control system in the imaging device 12 and the inspection device 13 of the inspection system 1 according to the embodiment. As shown in FIG. 3, the photographing device 12 includes an imaging unit 21, a processing unit 22, and an output unit . The imaging unit 21 captures an image by irradiating electromagnetic waves such as X-rays onto a piece of luggage that is an object to be photographed (an object to be inspected). For example, when the imaging device 12 is an X-ray CT imaging device, the imaging unit 21 irradiates X-rays from around the luggage M that is an object to be inspected and is being transported by the conveyor 11, thereby acquiring three-dimensional X-ray image data as a transmission image that shows the inside of the luggage M.

[0027] The processing unit 22 includes a processor and various memories, and executes various processes by the processor executing programs stored in the memories. For example, the processing unit 22 processes an image captured by the imaging unit 21 by irradiating it with electromagnetic waves, thereby generating captured image data including the captured image and physical property information indicating the physical properties of each part of the captured image. The processing unit 22 may also function as a control unit that controls each part of the imaging device 12.

[0028] The output unit 23 is a communication interface that outputs data. The output unit 23 is an interface that corresponds to the image interface 39 provided in the inspection device 13. The output unit 23 outputs captured image data to the inspection device 13. The communication interface serving as the output unit 23 may also include an interface that acquires data such as control instructions from the inspection device 13.

[0029] As shown in FIG. 3, the inspection device 13 also has a processor (first processor) 31, a ROM 32, a RAM 33, a memory unit 34, a communication unit (first communication unit) 35, a display interface (I / F) 36, an operation interface (I / F) 37, and an image interface (I / F) 39.

[0030] The processor 31 executes arithmetic processing. The processor 31 is, for example, a CPU (Central Processing Unit). The processor 31 functions as a processing unit that executes various processes by using the RAM 33 to execute programs stored in the ROM 32 or the storage unit 34.

[0031] The ROM 32 is a read-only non-volatile memory. The ROM 32 stores program data, control data, etc. The RAM 33 is a volatile memory that functions as a working memory. The RAM 33 temporarily stores data.

[0032] The storage unit 34 is a rewritable non-volatile memory. The storage unit 34 is configured with a hard disk drive (HDD), a solid state drive (SSD), or the like. The storage unit 34 stores information such as program data, setting values ​​as control data, and inspection process results. The storage unit 34 also has a database that stores information for estimating the identity of an item in a specific area in an image of the package M captured by the image capture device 12 based on physical property information (density data and effective atomic number), etc.

[0033] The communication unit 35 is a communication interface for communicating with the data server 10. The processor 31 communicates with the data server 10 via the communication unit 35. The processor 31 transmits data such as processing results to the data server 10 and receives data from the data server 10 via the communication unit 35.

[0034] The display interface 36 is an interface for connecting to the display device 14 as an output device. The display interface 36 may be any interface that corresponds to the interface provided in the display device 14. The processor 31 controls the display content to be displayed on the display device 14 via the display interface 36.

[0035] The operation interface 37 is an interface for connecting to the operation device 15. The operation interface 37 may be any interface that corresponds to the interface provided in the operation device 15. The processor 31 acquires information input by the operation device 15 via the operation interface 37.

[0036] The image interface 39 is an interface for connecting to the imaging device 12. The image interface 39 is an image acquisition unit for acquiring captured images from the imaging device 12. The image interface 39 may be any interface that corresponds to an interface provided in the imaging device 12, such as an X-ray CT device. The processor 31 acquires captured images (X-ray images) captured by the X-ray CT device serving as the imaging device 12 via the image interface 39. The processor 31 may also control the imaging operation of the imaging device 12 on the luggage M via the image interface 39.

[0037] Next, the configuration of a control system in the information processing device 17 connected to the smart glasses 16 in the secondary inspection system 1B in the inspection system 1 according to the embodiment will be described. FIG. 4 is a block diagram showing an example of the configuration of a control system in the information processing device 17 in the inspection system 1 according to the embodiment. As shown in FIG. 4, the information processing device 17 has a processor (second processor) 41, a ROM 42, a RAM 43, a storage unit 44, a communication unit (second communication unit) 45, a display interface (I / F) 46, and an operation interface (I / F) 47.

[0038] The processor 41 executes arithmetic processing. The processor 41 is, for example, a CPU (Central Processing Unit). The processor 41 functions as a processing unit that executes various processes by using the RAM 43 to execute programs stored in the ROM 42 or the storage unit 44.

[0039] The ROM 42 is a read-only non-volatile memory. The ROM 42 stores program data, control data, etc. The RAM 43 is a volatile memory that functions as a working memory. The RAM 43 temporarily stores data.

[0040] The storage unit 44 is a rewritable non-volatile memory. The storage unit 44 is configured with a hard disk drive (HDD), a solid state drive (SSD), or the like. The storage unit 44 stores information such as program data and setting values ​​as control data. The storage unit 44 also stores data to be displayed on the smart glasses 16. For example, the processor 41 stores information to be displayed on the smart glasses 16 based on the results of the primary inspection obtained directly from the data server 10 or the inspection device 13.

[0041] The communication unit 45 is a communication interface for communicating with the data server 10. The processor 41 communicates with the data server 10 via the communication unit 45. The processor 41 acquires data to be displayed on the smart glasses 16 from the data server 10 via the communication unit 45, and transmits data indicating the results of the secondary inspection input by the operation device 18 to the data server 10.

[0042] The display interface 46 is an interface for connecting to the smart glasses 16, which is an example of a display device. The display interface 46 may be any interface that corresponds to an interface provided in the smart glasses 16. For example, the display interface 46 includes an interface that connects to and communicates with the smart glasses 16 via wireless communication. The processor 41 controls the display content to be displayed on the smart glasses 16 via the display interface 46.

[0043] The operation interface 47 is an interface for connecting to the operation device 18. The operation interface 47 may be any interface that corresponds to the interface provided in the operation device 18. The processor 41 acquires information input by the operation device 18 via the operation interface 47.

[0044] The information processing device 17 may be included in the smart glasses 16. In this case, the smart glasses 16 including the information processing device 17 may be communicatively connected to the data server 10 or the inspection device 13 via wireless communication or the like. The smart glasses 16 may also include an operation device 18. In this case, the display interface 46 and the operation interface 47 may be configured to include interfaces connected to the smart glasses 16.

[0045] Next, the configuration of the data server 10 in the inspection system 1 according to the embodiment will be described. FIG. 5 is a block diagram showing an example of the configuration of the data server 10 in the inspection system 1 according to the embodiment. The data server 10 is an information management device that manages information on the entire inspection system 1. The data server 10 is a computer that is communicatively connected to the inspection device 13 of the primary inspection system 1A installed at the primary inspection site and the information processing device 17 of the secondary inspection system 1B installed at the secondary inspection site.

[0046] In the configuration example shown in FIG. 5, the data server 10 includes a processor (third processor) 51, a ROM 52, a RAM 53, a storage unit 54, and a communication unit (third communication unit) 55. The processor 51 executes arithmetic processing. The processor 51 is, for example, a CPU (Central Processing Unit). The processor 51 functions as a processing unit that executes various processes by using the RAM 53 to execute programs stored in the ROM 52 or the storage unit 54.

[0047] The ROM 52 is a read-only non-volatile memory. The ROM 52 stores program data, control data, etc. The RAM 53 is a volatile memory that functions as a working memory. The RAM 53 temporarily stores data.

[0048] The memory unit 54 is a rewritable non-volatile memory. The memory unit 54 is configured with a hard disk drive (HDD), a solid state drive (SSD), or the like. The memory unit 54 stores information such as program data, setting values ​​as control data, and data collected from the inspection device 13 or the information processing device 17. The memory unit 54 also includes a database 54a that stores information such as the results of the primary inspection and the results of the secondary inspection. The database 54a stores information indicating the results of the primary inspection obtained from the inspection device 13 and the results of the secondary inspection obtained from the information processing device 17 for each piece of baggage subject to inspection.

[0049] The communication unit 55 is a communication interface for communicating with the inspection device 13 in the primary inspection system 1A and the information processing device 17 in the secondary inspection system 1B. The processor 51 communicates with the inspection device 13 and the information processing device 17 via the communication unit 55. The processor 51 receives data such as processing results from the inspection device 13 and the information processing device 17 and transmits data to the inspection device 13 and the information processing device 17 via the communication unit 55.

[0050] Next, a primary inspection process by the inspection device 13 in the primary inspection system 1A of the inspection system 1 according to the embodiment will be described. FIG. 6 is a flowchart for explaining the flow of the primary inspection process by the inspection device 13 in the primary inspection system 1A of the inspection system 1 according to the embodiment. In the inspection system 1 configured as shown in Fig. 1, the objects to be inspected, i.e., packages M, are sequentially fed onto a conveyor 11. The conveyor 11 transports the fed packages M to a position where an image is captured by an image capturing device 12.

[0051] The photographing device 12 detects the baggage M being transported to the photographing position by the conveyor 11 as an object to be inspected, and photographs an image showing the internal state of the baggage M by irradiating electromagnetic waves (X-rays) onto the baggage M being transported to the photographing position by the imaging unit 21. Here, the imaging unit 21 of the photographing device 12 irradiates X-rays onto the baggage M being transported by the conveyor 11, and acquires three-dimensional image data of the entire baggage M as the photographed image.

[0052] The processing unit 22 of the imaging device 12 acquires a three-dimensional captured image (3D image) captured by the imaging unit 21 and physical property information indicating the physical properties of each part of the captured image. The processing unit 22 of the imaging device 12 generates captured image data (3D data) including the three-dimensional captured image acquired from the imaging unit 21 and the physical property information indicating the physical properties of each part of the three-dimensional image. For example, the physical property information is information indicating the density and effective atomic number of each pixel or voxel, which is a constituent unit that makes up the captured image.

[0053] The processing unit 22 of the photographing device 12 supplies the generated photographed image data to the inspection device 13 via the output unit 23. Here, the processing unit 22 of the photographing device 12 may store the photographed image data in a memory such as an internal storage device, and supply the photographed image data to the inspection device 13 in response to a request from the inspection device 13.

[0054] The inspection device 13 acquires photographed image data of the luggage M to be inspected from the photographing device 12 via the image interface 39 (step ST31). When the processor 31 of the inspection device 13 acquires the photographed image data of the luggage M to be inspected, the processor 31 displays the photographed image of the luggage M included in the acquired photographed image data on the display device 14 (step S32). For example, when the processor 31 of the inspection device 13 acquires photographed image data (3D data) including a three-dimensional photographed image (three-dimensional image) that is a transmitted image of the entire luggage M, the processor 31 displays the three-dimensional image of the luggage M included in the photographed image data on the display device 14.

[0055] The processor 31 of the inspection device 13 accepts input of the inspection results (results of the primary inspection) by the inspector using the operation device 15 while a captured image of the baggage M to be inspected is displayed on the display device 14. For example, the processor 31 accepts input such as whether a secondary inspection is necessary and the designation of areas that require secondary inspection as results of the primary inspection. The processor 31 of the inspection device 13 also displays a three-dimensional image of the baggage M to accept input of the results of the primary inspection, and accepts operation instructions to change the display state of the three-dimensional image displayed on the display device 14.

[0056] FIG. 7 is a diagram showing an example of a display in which the inspection device 13 displays a three-dimensional image as a photographed image of the baggage M to be inspected on the display device 14. 7, the processor 31 of the inspection device 13 displays a three-dimensional image 70 showing the internal state of the baggage M to be inspected on the display device 14. In the display example shown in Fig. 7, the processor 31 of the inspection device 13 displays a three-dimensional image of the baggage M to be inspected, as well as an image rotation button 71 for instructing rotation of the three-dimensional image, a slice display button 72 for instructing display of a two-dimensional image (two-dimensional image group) in which the three-dimensional image has been sliced ​​at a specified cross section, and a back button 73.

[0057] When rotation of the three-dimensional image of the luggage M is specified (step S33, YES), the processor 31 of the inspection device 13 displays the three-dimensional image of the luggage M on the display device 14 in a rotated state in accordance with the instruction of the inspector (operator) (step ST34). For example, when the image rotation button 71 on the display screen shown in Fig. 7 is specified by the operation device 15, the processor 31 of the inspection device 13 displays the three-dimensional image of the luggage M on the display device 14 in a rotated state in accordance with the instruction of the inspector.

[0058] FIG. 8 is a diagram showing an example of a display screen (rotation display screen) for rotating and displaying a three-dimensional image of the baggage M displayed on the display device 14 in response to an operational instruction from an inspector. When the image rotation button 71 in the display example shown in Fig. 7 is instructed, the processor 31 of the inspection device 13 displays a display screen for rotating a three-dimensional image as shown in Fig. 8. The processor 31 of the inspection device 13 accepts an instruction to rotate the three-dimensional image while displaying the display screen shown in Fig. 8. The processor 31 displays, on the display device 14, a three-dimensional image of the luggage M rotated in accordance with the operation instruction input by the operation device 15.

[0059] Furthermore, when the display of an image of a slice plane (cross section) of the three-dimensional image of the luggage M is specified (step ST35, YES), the processor 31 of the inspection device 13 displays on the display device 14 an image of the three-dimensional image of the luggage M sliced ​​along the slice plane specified by the inspector (step ST36). For example, when the slice display button 72 in the display example shown in Fig. 7 is specified by the operation device 15, the processor 31 of the inspection device 13 displays on the display device 14 a slice image (cross section image) of the three-dimensional image of the luggage M sliced ​​along the slice plane specified by the inspector.

[0060] FIG. 9 is a diagram showing an example of a display screen (slice image display screen) that displays a slice image obtained by slicing the three-dimensional image of the baggage M along a slice plane designated by an inspector. For example, when the slice display button 72 is pressed in the display example shown in Fig. 7 or 8, the processor 31 of the inspection device 13 displays a display screen that displays a slice image 80 of the three-dimensional image in the display state shown in Fig. 7 or 8. The display screen shown in Fig. 9 displays the slice image 80 as well as a slider 81 for specifying a slice plane of the three-dimensional image of the baggage M to be inspected.

[0061] The slider 81 shown in Fig. 9 can be operated using the operation device 15. The processor 31 of the inspection device 13 identifies a slice plane for the three-dimensional image of the luggage M in response to an operation instruction to the slider 81, and displays a slice image 80 of the identified slice plane. For example, as shown in Fig. 9, the processor 31 may display slice images 80a, 80b, ... for each slice plane that is specified in order in response to movement of the slider 81, superimposed in order.

[0062] 7, 8, or 9, the processor 31 of the inspection device 13 accepts input of the results of the primary inspection by the inspector while the photographed image of the baggage M is displayed on the display device 14 (steps ST37, 38). If the inspector determines that a secondary inspection is not required for the baggage M displayed on the display device 14, the inspector inputs that a secondary inspection is not required using the operation device 15. If the processor 31 of the inspection device 13 receives input that a secondary inspection is not required using the operation device 15 (YES in step ST37), the processor 31 transmits information indicating that a secondary inspection is determined to be unnecessary as a result of the primary inspection to the data server 10 (step ST44).

[0063] Furthermore, if it is not specified that secondary inspection is not required (step ST37, NO), the processor 31 of the inspection device 13 accepts the specification of the locations where the inspector (the inspector of the primary inspection) has determined that secondary inspection is required (step ST38). If there are any locations where the inspector has determined that secondary inspection is required in the baggage M displayed on the display device 14 by the above steps ST33-36, the inspector uses the operation device 15 to specify the locations where the inspector has determined that secondary inspection is required.

[0064] As a specific example, the inspector specifies a designated location on baggage M according to the following operating procedure. (Step 1) The inspector presses the image rotation button 71 on the display screen as shown in Fig. 7 displayed on the display device 14. When the image rotation button 71 is pressed, the inspection device 13 displays a rotated display screen of a three-dimensional image as shown in Fig. 8 on the display device 14. The inspector rotates the three-dimensional image to orient the three-dimensional image of the baggage M displayed on the display device 14 in the desired direction. (Step 2) The examiner presses the slice display button 72 on the display screen of the three-dimensional image displayed on the display device 14. When the slice display button 72 is pressed, the inspection device 13 displays a display screen of the slice image as shown in Fig. 9 on the display device 14. The examiner moves the slider 81 on the display screen of the slice image to specify a slice plane and display the slice image. (Step 3) The inspector stops moving the slider 81 when the location that the inspector wants to designate as a location requiring secondary inspection appears on the slice image. The inspection device 13 displays on the display device 14 a slice image 80 of the slice plane that the inspector indicated with the slider 81. The inspector designates the location (designated location) that the inspector determines to require secondary inspection in the slice image 80 displayed on the display device 14.

[0065] According to the above-described operating procedure, even if multiple items are overlapping within a package, the inspector can clearly specify the areas of each individual item using the slice image. However, the above-described operation procedure is an example of an operation in which an inspector specifies a specified location, and the specification (selection) of the specified location does not necessarily have to be performed on a slice image. For example, an inspector may specify a specified location on a three-dimensional image of the baggage M as shown in FIG. 7 or FIG. 8.

[0066] When a location that the inspector has determined to require secondary inspection is specified by the operation device 15 (step ST38, YES), the processor 31 of the inspection device 13 identifies the area of ​​the item at the specified location (specified location) as a specific inspection area (specified area) (step ST39). The processor 31 of the inspection device 13 identifies the specific inspection area, which is the area of ​​the item that includes the specified location, based on the physical property information of the voxels at the specified location and the physical property information of each voxel in the vicinity of the specified location.

[0067] For example, processor 31 extracts a group of voxels in the vicinity of the designated location, whose physical property information differs from the physical property information of the voxels at the designated location by a predetermined range, as a region of one item (specific inspection region). As a specific example, processor 31 extracts a group of voxels in the vicinity of the designated location (for example, each voxel connected from the designated location), whose density or effective atomic number differs from the density or effective atomic number of the voxels at the designated location by a predetermined range (predetermined threshold), as a specific inspection region estimated to be a region of a specific item.

[0068] When processor 31 of inspection device 13 identifies a specific inspection area that includes the designated location specified by the inspector, processor 31 displays (highlights) the specific inspection area in a predetermined color in the photographed image of baggage M displayed on display device 14 (step ST40). Here, processor 31 of inspection device 13 may highlight the specific inspection area that includes the designated location so that it can be distinguished from other areas, and is not limited to displaying the specific inspection area in color, and may also display the specific inspection area in a flashing manner.

[0069] FIG. 10 is a diagram showing a display example in which a specific examination region (specific region) including a designated location designated in a slice image displayed by the display device 14 is highlighted. When a specified location within region A is specified in the slice image shown in Fig. 9, the processor 31 of the inspection device 13 displays the specific inspection region A including the specified location in color on the slice image, as shown in Fig. 10. The processor 31 of the inspection device 13 specifies, as the three-dimensional specific inspection region, a group of voxels in the vicinity of the specified location in the three-dimensional region specified on the slice image, whose physical property information differs from the physical property information of the voxels at the specified location within a predetermined range.

[0070] Furthermore, after a specified location is designated in the slice image, the processor 31 of the inspection device 13 may switch the display screen displayed on the display device 14 to a display screen of a three-dimensional image of the baggage M. For example, if an inspector designates a specified location on the display screen of the slice image shown in FIG. 9 and then presses the back button 73, the processor 31 of the inspection device 13 returns the display screen displayed on the display device 14 from the display screen of the slice image to the display screen of a three-dimensional image, which is a captured image of the baggage M. If the captured image of the baggage M is a three-dimensional image, the specific inspection area is also identified as a three-dimensional area. Therefore, the processor 31 of the inspection device 13 displays on the display device 14 a display screen in which a group of voxels (three-dimensional area) that is the specific inspection area including the specified location in the three-dimensional image of the baggage M is colored (see, for example, FIG. 11).

[0071] The predetermined range for detecting the specific inspection area including the designated location may be set in advance, or may be adjustable by the inspector. In the latter case, the inspector may be able to instruct adjustment of the parameters (setting values) of the predetermined range (such as the density difference threshold) for extracting the specific inspection area while rotating the 3D image. When the parameters of the predetermined range are changed, the processor 31 of the inspection device 13 may extract the specific inspection area based on the changed parameters, and display the resulting specific inspection area in color.

[0072] When the processor 31 of the inspection device 13 extracts a specific inspection area including the designated location, it predicts the substance (item) present in the specific inspection area (step ST41). For example, the processor 31 predicts the substance present in the specific inspection area based on the density and effective atomic number in the specific inspection area. The processor 31 of the inspection device 13 selects candidate items present in the specific inspection area based on the composition of the substance predicted to be present in the specific inspection area, and displays the selected candidate items on the display device 14 (step ST42).

[0073] Furthermore, processor 31 of inspection device 13 accepts input of information indicating items that the inspector presumes to be in the specific inspection area (items presumed by the inspector in the first inspection) while displaying candidate items in the specific inspection area (step ST43). Processor 31 of inspection device 13 may acquire information indicating an item selected by the inspector from the candidate items as the information indicating the items in the specific inspection area, or may acquire information indicating an item input by the inspector other than the displayed candidates.

[0074] FIG. 11 is a diagram showing an example of a display screen that displays a three-dimensional image (photographed image) of the baggage M in which the specific inspection area is displayed in color, along with candidate items in the specific inspection area. 11, the processor 31 of the inspection device 13 displays an image in which the specific inspection area A is colored in a three-dimensional image of the baggage M to be inspected, and also displays candidate items 90 that are in the specific inspection area A and a save / learn button (confirm button) 91. The inspector refers to the candidate items in the specific inspection area displayed on the display device 14, and uses the operation device 15 to specify and input the items that are determined (estimated) to be in the specific inspection area.

[0075] For example, the inspector may specify a specific item from the displayed candidate items as the item in the specific inspection area, or may input an item other than the candidate items. After specifying information indicating an item determined to be in the specific inspection area A, the inspector presses the save / learn button 91 using the operation device 15. When the save / learn button 91 displayed on the display screen is pressed, the processor 31 of the inspection device 13 acquires information indicating the item determined to be in the specific inspection area A specified on the display screen as the primary inspection result.

[0076] The processor 31 of the inspection device 13 may be configured to accept input such as the reason why the inspector specified the designated location or the reason why the inspector specified (estimated) the item in the specific inspection area. In this case, the inspector inputs, via the operation device 15, not only information indicating the item estimated to be in the specific inspection area, but also information indicating the reason why the inspector specified the designated location and the reason why the inspector estimated the item. This allows the processor 31 of the inspection device 13 to acquire, as the primary inspection result, not only information indicating the item estimated to be in the specific inspection area by the inspector, but also information indicating the reason why the inspector specified the designated location and the reason (basis) why the inspector estimated the item.

[0077] When the processor 31 of the inspection device 13 receives the result of estimating the item in the specific inspection area including the designated location, it transmits the result to the data server 10 as a primary inspection result associated with the identification information of the baggage M (step ST44). For example, the primary inspection result includes information indicating the specific inspection area of ​​the baggage M, information indicating the item estimated to be in the specific inspection area, and information such as the reason for specifying the designated location and the reason for estimating the item. When the data server 10 receives the primary inspection result from the inspection device 13, it stores the primary inspection result from the inspection device 13 in the memory unit 54. The data server 10 distributes the primary inspection result to the information processing device 17 of the secondary inspection system 1B in response to a request from the information processing device 17.

[0078] Furthermore, the processor 31 of the inspection device 13 may directly transmit the primary inspection results to the information processing device 17. For example, the inspection device 13 may store the primary inspection results in the memory unit 44 and transmit the primary inspection results in response to a request from the information processing device 17. Furthermore, the information processing device 17 may store the primary inspection results from the inspection device 13 in the memory unit 44 and read out the primary inspection results when performing a secondary inspection of the baggage M.

[0079] In addition, if there are multiple designated locations on a single piece of luggage M that an inspector designates as specific inspection areas, the processor 31 of the inspection device 13 can repeatedly perform the above-mentioned processing to transmit the initial inspection results, which include information indicating all specific inspection areas on a single piece of luggage M and information indicating the estimated results of the items in each specific inspection area, to the data server 10 or the information processing device 17.

[0080] According to the above-described processing, when an inspector designates a location in a photographed image of a baggage that the inspector determines requires secondary inspection, the inspection system according to the embodiment designates a specific inspection area as an area of ​​the item that includes the designated location, and highlights the specific inspection area by coloring or the like in the photographed image of the baggage. This allows the inspector to easily designate a specific inspection area that includes the designated location that requires secondary inspection, and to visually confirm the specific inspection area that includes the designated location. As a result, the inspection system according to the embodiment allows the inspector to easily designate a specific inspection area that requires secondary inspection, even when the photographed image of the baggage is a three-dimensional image, and to intuitively confirm the designated specific inspection area.

[0081] Furthermore, the inspection system according to the embodiment accepts an inspector's estimation of items in a specific inspection area that includes a designated location in a captured image of the baggage, and transmits a primary inspection result including information indicating the specific inspection area that includes the designated location and an estimation of the items in the specific inspection area to a data server. As a result, the inspection system according to the embodiment can provide information indicating the specific inspection area and information indicating the items in the specific inspection area to a secondary inspection system or store the information in the data server as the results of the primary inspection of baggage that requires secondary inspection. As a result, the inspection system according to the embodiment can easily provide the results of the primary inspection by the primary inspection system to a secondary inspection system, and can also store the results of the primary inspection as learning data.

[0082] Next, the secondary inspection process by the secondary inspection system 1B in the inspection system 1 according to the embodiment will be described. FIG. 12 is a flowchart for explaining the flow of the secondary inspection process by the secondary inspection system 1B including the smart glasses 16 in the inspection system 1 according to the embodiment. As described above, in the primary inspection system 1A, the luggage M that has undergone the primary inspection is sorted based on whether or not it requires secondary inspection, and the luggage M that is determined to require secondary inspection is transported to a two-dimensional inspection area where the secondary inspection is carried out. At the secondary inspection area, the inspector performing the secondary inspection wears smart glasses 16 and operates the worn smart glasses 16 or the operating device 18 to input the identification information of the luggage M that is to be subject to secondary inspection.

[0083] The processor 41 of the information processing device 17 identifies the luggage M to be subjected to secondary inspection and acquires information indicating the results of the primary inspection of the luggage M (step ST50). For example, the processor 41 acquires identification information of the luggage M to be inspected by the smart glasses 16 or the operation device 18 operated by the inspector via the interface 46 or 47. After acquiring the identification information of the luggage M, the processor 41 acquires the results of the primary inspection of the luggage M from the data server 10 or the inspection device 13.

[0084] When the processor 41 of the information processing device 17 acquires the primary inspection result of the baggage M that is the subject of the secondary inspection, the processor 41 displays information based on the acquired primary inspection result for the baggage M on the smart glasses (display device) 16 (step ST51). The processor 41 of the information processing device 17 displays reference information for the secondary inspection based on the primary inspection result on the smart glasses 16. The processor 41 causes the inspector to carry out the secondary inspection while the information based on the primary inspection result is displayed on the smart glasses 16 (step ST52).

[0085] For example, the processor 41 of the information processing device 17 displays, as reference information for the secondary inspection, information in which the specific inspection area identified in the primary inspection is colored in the 3D image of the baggage M captured by the imaging device 12 on the smart glasses 16. This allows the inspector performing the secondary inspection wearing the smart glasses 16 to intuitively visually recognize the location on the baggage M of the specific inspection area that the inspector from the primary inspection determined to require secondary inspection.

[0086] Furthermore, the processor 41 of the information processing device 17 may be configured to display information indicating the items that the inspector in the primary inspection has determined to be in the specific inspection area, which is displayed by coloring the 3D image, on the smart glasses 16. This allows the inspector performing the secondary inspection wearing the smart glasses 16 to perform the secondary inspection, such as an opening inspection, while recognizing the items that were estimated to be in the specific inspection area in the primary inspection, thereby improving the accuracy and efficiency of the secondary inspection.

[0087] Furthermore, the processor 41 of the information processing device 17 may display on the smart glasses 16 candidate articles in the specific inspection area, which are displayed in color in the 3D image. For example, the processor 41 of the information processing device 17 may display candidate articles in the specific inspection area estimated from the physical property information (density, effective atomic number, etc.) of the specific inspection area in the primary inspection. This allows an inspector wearing the smart glasses 16 who performs the secondary inspection to predict the articles in the specific inspection area while performing the secondary inspection, such as an opening inspection, thereby improving the accuracy and efficiency of the secondary inspection.

[0088] The processor 41 of the information processing device 17 accepts input of the results of the secondary inspection conducted by the inspector while the reference information based on the results of the primary inspection is displayed on the smart glasses 16 (step ST53). After the inspector conducts a secondary inspection such as an opening inspection on the baggage M, the inspector inputs the results of the secondary inspection using the operation device 18 or the smart glasses 16. For example, the inspector inputs the inspection results of the items in the specific inspection area displayed in color on the image of the baggage M by the smart glasses 16 as the results of the secondary inspection.

[0089] When the secondary inspection results are input, the processor 41 of the information processing device 17 transmits the input secondary inspection results to the data server 10 (step ST54). For example, the processor 41 acquires the inspection results (item identification results) of the items in the specific inspection area of ​​the baggage M, and transmits the secondary inspection results including information indicating the items in the specific inspection area to the data server 10. The processor 41 may also transmit to the data server 10 any detection of an object to be inspected in an area other than the specific inspection area as a secondary inspection result.

[0090] According to the above-described process, the inspection system according to the embodiment acquires information indicating the results of the primary inspection for luggage subject to secondary inspection, and displays reference information based on the results of the primary inspection on a display device such as smart glasses that can be viewed by the inspector conducting the secondary inspection. This allows the inspector conducting the secondary inspection to intuitively visually confirm the results of the primary inspection while conducting the secondary inspection. As a result, the inspection system according to the embodiment can improve the work efficiency of the secondary inspection without spending time communicating the results of the primary inspection to the inspector conducting the secondary inspection.

[0091] Furthermore, the inspection system according to the embodiment displays, as reference information based on the results of the primary inspection, an image of the baggage on a display device such as smart glasses visible to the inspector conducting the secondary inspection, in which specific areas including locations designated by the inspector during the primary inspection are highlighted by color or other means. This allows the inspector conducting the secondary inspection to carry out the secondary inspection while checking the location of the specific area determined to require secondary inspection during the primary inspection in the image of the entire baggage. As a result, because the inspection system according to the embodiment highlights the specific area in the image of the entire baggage, it is possible to clearly explain the results of the primary inspection to the inspector conducting the secondary inspection, even if the captured image of the baggage is a three-dimensional image.

[0092] Next, a database creation process performed by the data server 10 in the inspection system 1 according to the embodiment will be described. FIG. 13 is a flowchart for explaining the flow of a database creation process performed by the data server 10 in the inspection system 1 according to the embodiment. As described above, the results of the primary inspection by the primary inspection system 1A and the results of the secondary inspection by the secondary inspection system 1B are transmitted to the data server 10. The data server 10 creates (updates) the database 54a based on the primary inspection results acquired from the inspection device 13 and the secondary inspection results acquired from the information processing device 17.

[0093] The processor 51 of the data server 10 accepts inspection results (primary inspection results and secondary inspection results) from each inspection device 13 and information processing device as needed. When the processor 51 of the data server 10 receives the primary inspection results from the inspection device 13 via the communication unit 55, it stores the primary inspection results in a database 54a provided in the storage unit 54 (step ST61). For example, the processor 51 stores, in the database 54a, the information included in the primary inspection results, such as captured image data, information indicating the presence or absence of a specific inspection area, information indicating the position of the specific inspection area in the captured image, information indicating an item estimated to be in the specific area, and the reason for the primary inspection result (such as the reason the item was estimated), in association with the identification information of the baggage.

[0094] Furthermore, when the processor 51 of the data server 10 receives the secondary inspection results from the information processing device 17 of the secondary inspection system 1B via the communication unit 55, it stores the received secondary inspection results in a database 54a provided in the storage unit 54 (step ST62). For example, the processor 51 stores information included in the secondary inspection results, such as information indicating the items that were actually present in the specific inspection area identified in the primary inspection, in association with the identification information of the baggage in the database 54a.

[0095] When the processor 51 of the data server 10 acquires the secondary inspection results for the luggage M, it generates learning data that integrates the primary and secondary inspection results for each luggage (step ST63). The learning data is data for improving the accuracy or efficiency of the primary inspection by the inspector. For example, the learning data may be data used to educate the inspector who performs the primary inspection, or data for improving the accuracy of the primary inspection based on the primary and secondary inspection results. As a specific example, the learning data may include database-based information on the reasons why the inspector designated the specific inspection area during the primary inspection. Furthermore, the learning data may include information indicating the specific inspection areas where the items estimated during the primary inspection matched with the items confirmed during the secondary inspection, and information indicating the specific inspection areas where the items estimated during the primary inspection did not match with the items confirmed during the secondary inspection.

[0096] According to the above-described processing, in the inspection system according to the embodiment, the data server acquires the primary inspection results and secondary inspection results for a package, and the data server creates a database in which the primary inspection results and secondary inspection results are collectively stored. As a result, the inspection system according to the embodiment not only provides the primary inspection results to the inspectors who perform the secondary inspection, but also allows the primary inspection results and secondary inspection results stored in the database to be used as learning data for new personnel to master the inspection work. Furthermore, the primary inspection results and secondary inspection results stored in the database can also be used as data for improving the accuracy of the primary inspection by comparing and analyzing the primary inspection results and secondary inspection results.

[0097] The configuration of the inspection system 1 according to the above-described embodiment shows an example of an inspection system, and several devices may be realized as one device, or one device may be realized as multiple devices. For example, in the primary inspection system, the processing by the inspection device 13 described above may be performed by the imaging device 12, in the secondary inspection system, smart glasses may be configured as a device including an information processing device or an operation device, and the data server may be configured as an inspection device of the primary inspection system or an information processing device of the secondary inspection system.

[0098] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0099] 1...inspection system, 1A...primary inspection system, 1B...secondary inspection system, M...baggage (inspection object), 10...data server, 11...conveyor, 12...imaging device (CT device), 13...inspection device, 14...display device, 15...operation device, 16...smart glasses (wearable device), 17...information processing device, 18...operation device, 31...processor (first processor), 32...ROM, 33...RAM, 34...memory unit, 35...communication unit (first communication unit), 36...display interface, 37...operation interface, 39...image interface, 41...processor (second processor), 42...ROM, 43...RAM, 44...memory unit, 45...communication unit (second communication unit), 51...processor (third processor), 52...ROM, 53...RAM, 54...memory unit, 54a...database, 55...communication unit (third communication unit).

Claims

1. In an inspection system having an inspection device used for a first inspection of an inspection object and an information processing device used for a second inspection, The inspection device includes: an image interface that acquires captured image data including an image of the inspection object captured by irradiating the inspection object with electromagnetic waves; a first processor that displays an image of an inspection object included in the captured image data acquired by the image interface on a first display device, and when a designated location in the image of the inspection object displayed on the first display device is designated by a first operating device, identifies a specific area that is an area of ​​an item that includes the designated location, and acquires a primary inspection result that includes the image of the inspection object and information indicating the specific area; a first communication unit that outputs a primary inspection result including an image of the inspection object and information indicating the specific area; The information processing device includes: a second communication unit that acquires a primary inspection result including an image of the inspection object and information indicating the specific area extracted from the image of the inspection object by the inspection device; a second processor that displays an image of the inspection object in which the specific region is highlighted on a second display device; Inspection system.

2. the second display device is a wearable device that displays an image that is visible to an inspector who performs the secondary inspection. The inspection system of claim 1 .

3. the image interface acquires photographed image data including an image of the inspection object and physical property information indicating physical properties of each portion of the image of the inspection object; the processor identifies the specific region based on physical property information of the designated location and physical property information of a periphery of the designated location. The inspection system of claim 1 .

4. the image interface acquires a three-dimensional image of the inspection object from a CT device that captures a three-dimensional image by irradiating the inspection object with electromagnetic waves; the processor identifies, as the specific region, a group of voxels in the vicinity of the specified location in the three-dimensional image, whose physical property information has a difference within a predetermined range from the physical property information of voxels in the specified location; The inspection system of claim 3 .

5. the physical property information includes either density data or effective atomic number; The inspection system of claim 3 .

6. the processor selects candidates for the item in the specific area based on the physical property information of the specific area, and acquires a primary inspection result including information indicating the item in the specific area designated by the first operating device while the selected candidates for the item in the specific area are displayed on the first display device; The inspection system of claim 1 .

7. Further, there is provided an inspection system having a data server, a first processor of the inspection device transmitting the primary inspection result to the data server via the first communication unit; a second processor of the information processing device transmits a secondary inspection result input by a second operation device to the data server via the second communication unit; The data server a storage unit for storing data; a third communication unit that communicates with the inspection device and the information processing device; a third processor that stores the primary inspection result obtained from the inspection device and the secondary inspection result obtained from the information processing device in a database provided in the storage unit for each inspection object; The inspection system of claim 1 .

8. An inspection method used in an inspection system having an inspection device used for a first inspection of an inspection object and an information processing device used for a second inspection, The inspection device irradiates an electromagnetic wave onto an inspection object and acquires photographed image data including an image of the inspection object; the inspection device displays an image of the inspection object included in the captured image data on a first display device, and when a specified location in the image of the inspection object displayed on the first display device is specified by a first operation device, identifies a specific area that is an area of ​​the item that includes the specified location, and outputs a primary inspection result that includes the image of the inspection object and information indicating the specified area; the information processing device acquires a primary inspection result including an image of the inspection object and information indicating the specific area extracted from the image of the inspection object by the inspection device; the information processing device displays the image of the inspection object in which the specific region is highlighted on a second display device; Testing method.

9. A database creation method for use in an inspection system having an inspection device used for a first inspection of an inspection object, an information processing device used for a second inspection, and a data server, comprising: The inspection device irradiates an electromagnetic wave onto an inspection object and acquires photographed image data including an image of the inspection object; the inspection device displays an image of the inspection object included in the captured image data on a first display device, and when a specified location in the image of the inspection object displayed on the first display device is specified by a first operation device, identifies a specific area that is an area of ​​the item that includes the specified location, and transmits a primary inspection result that includes the image of the inspection object and information indicating the specified area to the data server; the information processing device acquires a primary inspection result including an image of the inspection object and information indicating the specific area extracted from the image of the inspection object by the inspection device; the information processing device displays the image of the inspection object in which the specific region is highlighted on a second display device; the information processing device transmits the secondary inspection result input by the second operation device to the data server; the data server stores the primary inspection results acquired from the inspection device and the secondary inspection results acquired from the information processing device in a database provided in a storage unit for each inspection object; How to create a database.

Images