Belonging inspection method and system

Abstract

To precisely identify whether a personal property carried into a predetermined area has been taken out or not.SOLUTION: A carrying personal property inspecting system executes, on the basis of carry-in information on a subjected person when such a person enters a predetermined area and of take-out information on the subjected person when such a person exits the predetermined area, an exit determination that is a determination on the legitimacy of the carrying personal property when the subjected person exits. The carrying personal property inspecting system gives a notification that is information on the result of the exit determination. The carry-in information is information based on an entry image, which is an image of the carrying personal property, captured when the subjected person enters. The take-out information is information based on an exit image, which is an image of the carrying personal property, captured when the subjected person exits.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates generally to computer techniques for property inspection. [Background technology]

[0002] Generally, there is a designated area that only a limited number of subjects can enter, and it may happen that the subject leaves the designated area with belongings that the subject brought into the designated area.

[0003] The area management device disclosed in Patent Document 1 manages people entering and leaving a specified area in association with objects brought into the specified area by those people. A camera is installed in the specified area. If an object detected by the camera was brought in by a person who has already left the area and the object needs to be removed, the area management device requests the removal of the object. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] WO2020 / 235584 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology disclosed in Patent Document 1, the area management device cannot ascertain the whereabouts of items brought into a specified area that were not photographed by a camera within the specified area. For example, if 10 items are brought into a specified area and three of the 10 items are photographed by a camera within the specified area, it is unclear whether the remaining seven items were taken out of the specified area. In other words, the correspondence between items brought into the specified area and items taken out is not specified, and the possibility that some of the items brought into the specified area may be left behind is not taken into consideration. [Means for solving the problem]

[0006] In order to solve such problems, the present invention provides a judgment unit that makes an exit judgment, which is a judgment of the legitimacy of the items carried by the subject at the time of exit, based on information about items brought in by the subject at the time of entry to a specified area and information about items taken out by the subject at the time of exiting the specified area, and a result output unit that outputs information about the result of the exit judgment to an information processing terminal, wherein the information about items brought in is information based on one or more entry images, the information about items taken out is information based on one or more exit images, each of the one or more entry images is one or more images of one or more items carried at the time of entry, which are one or more images taken at the time of entry, and each of the one or more exit images is one or more images of one or more items carried at the time of exit, which are one or more images taken at the time of exit, and the judgment unit makes an entry judgment, including a judgment of whether or not the subject is eligible to enter the specified area, based on advance application information representing an advance application for entry to the specified area, and the result output unit outputs information about the result of the entry judgment to the information processing terminal. In addition, the present invention provides a first step in which a computer makes an exit judgment, which is a judgment of the legitimacy of the items carried by the subject at the time of exit, based on information about items brought in by the subject at the time of entry into a specified area and information about items taken out by the subject at the time of exiting the specified area, and a second step in which the computer outputs information regarding the result of the exit judgment to an information processing terminal, wherein the information about items brought in is information based on one or more entry images, the information about items taken out is information based on one or more exit images, each of the one or more entry images is one or more images of one or more items carried at the time of entry, which are one or more images taken at the time of entry, and each of the one or more exit images is one or more images of one or more items carried at the time of exit, which are one or more images taken at the time of exit, and in the first step, the computer makes an entry judgment, which includes a judgment of whether or not the subject is eligible to enter the specified area, based on advance application information representing an advance application for entry to the specified area, and in the second step, the computer outputs information regarding the result of the entry judgment to the information processing terminal. [Effects of the Invention]

[0007] According to the present invention, it is possible to more accurately determine whether an object brought into a predetermined area has been removed than in the past. [Brief explanation of the drawings]

[0008] [Figure 1] 1 shows an example of the overall configuration of a system according to an embodiment of the present invention. [Figure 2] 1 shows an example of the configuration of a system including devices provided in the entrance and exit areas. [Figure 3] This section describes the functions of the baggage inspection system related to obtaining information on what is brought in and what is taken out. [Figure 4] The following shows the functions of the baggage inspection system related to exit decisions. [Figure 5] 10 shows a portion of an example of the configuration of an entrance / exit management table. [Figure 6] 10 shows the rest of the configuration example of the entrance / exit management table. [Figure 7] 10 shows an example of the configuration of a group management table. [Figure 8] An example of the overall process flow including the process performed at the time of entry and the process performed at the time of exit is shown below. DETAILED DESCRIPTION OF THE INVENTION

[0009] In the following description, an "interface apparatus" may refer to one or more interface devices. The one or more interface devices may be at least one of the following: An I / O interface device is one or more I / O (Input / Output) interface devices. The I / O (Input / Output) interface devices are interface devices for at least one of an I / O device and a remote display computer. The I / O interface device for the display computer may be a communications interface device. The at least one I / O device may be a user interface device, for example, either an input device such as a keyboard and a pointing device, or an output device such as a display device. A communication interface apparatus that is one or more communication interface devices. The one or more communication interface devices may be one or more homogeneous communication interface devices (e.g., one or more NICs (Network Interface Cards)) or two or more heterogeneous communication interface devices (e.g., an NIC and an HBA (Host Bus Adapter)).

[0010] In the following description, "memory" refers to one or more memory devices, which are an example of one or more storage devices, and may typically be a primary storage device. At least one memory device in the memory may be a volatile memory device or a non-volatile memory device.

[0011] In the following description, a "persistent storage device" may refer to one or more persistent storage devices, which are an example of one or more storage devices. A persistent storage device may typically be a non-volatile storage device (e.g., an auxiliary storage device), and specifically may be, for example, a hard disk drive (HDD), a solid state drive (SSD), a non-volatile memory express (NVME) drive, or a storage class memory (SCM).

[0012] In the following description, the term "storage device" may refer to at least one of memory and persistent storage device.

[0013] Furthermore, in the following description, a "processor" may refer to one or more processor devices. The at least one processor device may typically be a microprocessor device such as a CPU (Central Processing Unit), but may also be another type of processor device such as a GPU (Graphics Processing Unit). The at least one processor device may be a single-core or multi-core. The at least one processor device may also be a processor core. The at least one processor device may also be a processor device in a broader sense, such as a circuit that is a collection of gate arrays written in a hardware description language that performs some or all of the processing (for example, an FPGA (Field-Programmable Gate Array), a CPLD (Complex Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit)).

[0014] In the following description, information that provides an output for an input may be described using expressions such as "xxx table." However, this information may be data of any structure (for example, structured data or unstructured data), or may be a neural network that generates an output for an input, or a learning model such as a genetic algorithm or random forest. Therefore, the "xxx table" may be referred to as "xxx information." In the following description, the table configuration is an example, and one table may be divided into two or more tables, or all or part of two or more tables may be one table.

[0015] In the following description, functions are sometimes described using the expression "yyy unit." However, the functions may be realized by one or more computer programs executed by a processor, by one or more hardware circuits (e.g., FPGAs or ASICs), or by a combination thereof. When a function is realized by a program executed by a processor, the specified processing is performed using a storage device and / or an interface device, etc., as appropriate, and therefore the function may be considered to be at least a part of the processor. Processing described using a function as the subject may be processing performed by a processor or a device having the processor. A program may be installed from a program source. The program source may be, for example, a program distribution computer or a computer-readable storage medium (e.g., a non-transitory storage medium). The description of each function is merely an example; multiple functions may be combined into one function, or one function may be divided into multiple functions.

[0016] An embodiment of the present invention will be described below with reference to the accompanying drawings. Examples of "predetermined areas" that are accessible to designated or limited personnel include construction sites, food factories, regenerative medicine facilities, cell culture facilities, pharmaceutical research facilities, semiconductor manufacturing facilities, government offices including courts and administrative agencies, hotels and guesthouses used as temporary venues for gatherings of VIPs for summit meetings and other events, transportation vehicles such as trains, airplanes, and ships that isolate passengers from the outside world, airports, train stations, and other areas. Other examples include theme parks and event venues. Some of these designated areas may specify the items, substances, and chemicals that are permitted to be brought into them, and entry into the designated areas may be managed or supervised. For example, if a first worker leaves a first tool at a construction site and finishes work for the day, and a second worker continues work without noticing the first tool, injury or other injuries may result. Furthermore, in food factories, regenerative medicine facilities, cell culture facilities, etc., when workers bring specific substances into these designated areas, contamination may occur between the objects being worked on by the workers and the specific substances they have brought in. Therefore, it is necessary to identify the tools and substances brought into the designated area. In the following explanation, the designated area is assumed to be a construction site, the target is a worker, and the items being brought in are tools.

[0017] FIG. 1 shows an example of the overall configuration of a system according to an embodiment of the present invention.

[0018] There is a construction site 51 that only a limited number of workers can enter and exit. The construction site 51 has an entrance and exit area 54. Workers enter the construction site 51 through the entrance and exit area 54 and exit the construction site 51 through the entrance and exit area 54.

[0019] A camera 100 and a belongings inspection device 15 are installed in the entrance and exit area 54. The belongings inspection device 15 may be capable of communicating via a communication network 810 (for example, the Internet or a WAN (Wide Area Network)). An application terminal 510 (an information processing terminal used when applying for entry into or exit from the construction site 51), an application management server 520, and an entrance and exit management server 400 may also be capable of communicating via the communication network 810.

[0020] The application terminal 510 is an information processing terminal (for example, a personal computer or a smartphone). The application terminal 510 may be the applicant's personal terminal, or may be a shared terminal provided outside (or inside) the entrance / exit area 54. Before entering, the applicant uses the application terminal 510 to input advance application information representing an advance application for entry into the construction site 51. In this embodiment, for simplicity of explanation, the applicant is the worker (i.e., the applicant himself / herself) who will enter the construction site 51, but the person making the advance application may also be an application agent on behalf of the worker (applicant). The applicant can also apply for multiple workers at once using the application terminal 510.

[0021] The application management server 520 manages information related to applications for entry to the construction site 51. The application terminal 510 and the application management server 520 may be terminals or servers of the company that made the application. Also, the application management server 520 may not be present.

[0022] The entrance / exit management server 400 manages information relating to entry into and exit from the construction site 51. The entrance / exit management server 400 may manage the entrance / exit for each of one or more construction sites 51.

[0023] Of the above elements 15, 100, 510, 520 and 400, the baggage inspection system 10 is configured as a computer system including at least the baggage inspection device 15 and the entrance / exit management server 400.

[0024] The servers 520 and 400 may be a common server. At least one of the servers 520 and 400 may be a physical computer (for example, a computer including an interface device, a storage device, and a processor connected to them), or may be a virtual server based on a physical computer (for example, a virtual machine or a server as a cloud computing service).

[0025] There may be multiple entrance / exit areas 54. The entrance / exit area 54 may be an area where the entrance area and the exit area are integrated, or separate areas such as an entrance area 53 and an exit area 55 different from the entrance area 53 may be used instead of or in addition to the entrance / exit area 54. There may be multiple entrance areas 53 and multiple exit areas 55. Each of the entrance area 53 and the exit area 55 may be equipped with a personal item inspection device 15 and a camera 100. The personal item inspection device 15 equipped in the entrance area 53 and the personal item inspection device 15 equipped in the exit area 55 may have partially different functions. For example, the personal item inspection device 15 equipped in the entrance area 53 may not have the function of making the exit judgment described below, which is the judgment at the time of exit.

[0026] FIG. 2 shows an example of the configuration of a system including devices provided in the entrance / exit area 54.

[0027] The entrance / exit area 54 is equipped with a camera 100, a baggage inspection device 15, a search terminal 700, and a reception terminal 610. The baggage inspection device 15 has an image processing device 200 and an inspection terminal 300. The image processing device 200 and the inspection terminal 300 may be separate devices or may be integrated into one device. At least one of the search terminal 700 and the reception terminal 610 may be included in the baggage inspection system 10. Each of the search terminal 700 and the reception terminal 610 may be an information processing terminal (for example, a personal computer or a smartphone). Furthermore, at least two or more terminals among the inspection terminal 300, the search terminal 700, and the reception terminal 610 may be integrated into one device.

[0028] The entrance / exit control server 400 includes a database unit 410 and an image transmission unit 640. These functions 410 and 640 may be realized by a computer program being executed by a processor of the entrance / exit control server 400. The information stored by the database unit 410 is stored in, for example, an internal or external storage device of the entrance / exit control server 400.

[0029] The application management server 520 includes a database unit 530. This function 530 may be realized by a computer program being executed by the processor of the application management server 520. The information stored by the database unit 530 is stored in, for example, an internal or external storage device of the application management server 520.

[0030] In this embodiment, the following processing is performed, for example, regarding the entry and exit of workers.

[0031] First, a pre-application is made. An applicant (e.g., a worker) uses the application terminal 510 to input pre-application information for the worker's entry into the construction site 51. The pre-application information may include, for example, the worker's name, ID, and information on all tools brought by the worker (e.g., tool category names (e.g., screwdrivers, cutters), the number of tools, etc.). The input pre-application information is transmitted from the application terminal 510 and received by the reception terminal 610. The reception terminal 610 stores the pre-application information. As indicated by the solid arrow, at this point, the reception terminal 610 may transmit the pre-application information to the inspection terminal 300. Alternatively, as indicated by the dashed arrow, the reception terminal 610 may store the pre-application information in the entrance / exit management server 400, and the inspection terminal 300 may read the pre-application information from the entrance / exit management server 400. The pre-application information (and / or application information for other types of applications) may further include the name of the construction site 51 or the construction work.

[0032] A worker enters the entrance / exit area 54 to enter the construction site 51 for construction work. The camera 100 captures all tools brought in by the worker. The camera 100 may also capture elements for worker identification (e.g., the worker's face). The entrance image is input to the image processing device 200. The entrance image is at least an entering tool image out of an entering tool image and an entering worker image (e.g., a captured image of the face of the worker entering). The entering tool image is a captured image of all or some of the tools brought in. An entering tool image may exist for each tool, or may be a single captured image showing all the tools (in the latter case, images for each tool may be acquired by the image processing device 200 from that single captured image). A category name for each tool may be identified based on the entrance image. Image processing result information including the image and category name acquired by the image processing device 200 for each brought-in tool is input to the inspection terminal 300. The inspection terminal 300 displays the image processing result information from the image processing device 200 and the advance application information. Image processing result information may be transmitted to reception terminal 610. An inspector (for example, an operator of inspection terminal 300 or reception terminal 610) determines, based on the displayed information, whether the worker will bring in the tools as requested in advance. If the inspector determines that the worker will enter as requested in advance, he or she approves the worker's entry. Approved entry information, which includes advance application information corresponding to the approved entry and information on the items brought in based on the entry image at the time of entry, is transmitted by inspection terminal 300 to entrance / exit management server 400, and this information is stored in database unit 410. The advance application information input to and displayed on inspection terminal 300 may be information read by inspection terminal 300 from a two-dimensional barcode representing the advance application information.

[0033] A worker enters the entrance / exit area 54 to exit the construction site 51. The camera 100 captures an image of all tools the worker takes out. The camera 100 may also capture elements for verifying the worker's identity (e.g., the worker's face). The exit image is input to the image processing device 200. The exit image is at least an exiting tool image out of an exiting tool image and an exiting worker image (e.g., a captured image of the face of the worker exiting). The exiting tool image is a captured image of all or some of the tools being taken out. An exiting tool image may exist for each tool, or may be a single captured image showing all the tools (in the latter case, images for each tool may be acquired by the image processing device 200 from that single captured image). A category name for each tool may be identified based on the exit image. Information including the image and category name from the image processing device 200 may be take-out information based on the exit image. The inspection terminal 300 transmits the take-out information to the entrance / exit management server 400, and the information is stored in the database unit 410. The image processing device 200 acquires the worker's bring-in information and take-out information from the database unit 410. The image processing device 200 performs an exit judgment based on the bring-in information and take-out information. The exit judgment is a judgment on the legitimacy of the items the worker is carrying when leaving. The inspection terminal 300 notifies information related to the result of the exit judgment.

[0034] Furthermore, if the worker's entry is approved or if the result of the worker's exit determination indicates validity, the image sending unit 640 may also issue tool images acquired for the worker (e.g., images of each tool acquired at the time of entry or exit) and the worker's identification information to the application management server 520. The database unit 530 may store the worker's identification information and tool images. When the worker submits a next advance application, the worker may include tool images stored in the application management server 520 for tools to be brought in at the next entry. If the received advance application information includes an image, the reception terminal 610 may compare the image with tool images acquired from images captured by the camera 100. This reduces the burden on the inspector to check whether the entry is as per the advance application.

[0035] FIG. 3 shows functions of the baggage inspection system 10 that are related to obtaining carry-in information and take-out information.

[0036] The camera 100 is, for example, a camera fixed to the entrance / exit area 54. Images captured by the camera 100 are input to the image processing device 200. The camera 100 may be a mobile camera (for example, a mobile camera tied to the entrance area 54) instead of or in addition to a fixed camera.

[0037] The image processing device 200 may be a device including an interface device, a storage device, and a processor connected to them. Via the interface device, a captured image is input from the camera 100, information is transmitted to the inspection terminal 300, and information is acquired from a database unit 410 of the entrance / exit management server 400, as shown in Fig. 4. The processor of the image processing device 200 executes a computer program to realize an image input unit 210, an image processing unit 220, a trimming unit 230, and a result output unit 240.

[0038] The image input unit 210 inputs an image captured by the camera 100 , and outputs the input captured image to the image processing unit 220 , the trimming unit 230 , and the result output unit 240 .

[0039] The image processing unit 220 includes a silhouette extraction unit 221, a color determination unit 222, a counting unit 223, and a category estimation unit 224, and processes the captured image from the image input unit 210. The silhouette extraction unit 221 executes silhouette extraction processing to extract the outline of the captured image. The color determination unit 222 executes RGB color determination processing to classify the color of the captured image into three primary colors (red, green, and blue). Note that RGB color determination processing to classify the captured image into hue, saturation, and brightness components in the HSV (Hue Saturation Value) color space, grayscale conversion processing, etc. may also be used. Furthermore, feature amounts of an object captured using convolution or the like can be compared and identified with feature amounts of previously captured objects using template matching or the like. The counting unit 223 executes counting processing to count the number of objects (tools) included in the captured image. The category estimation unit 224 executes category estimation processing to estimate the category of the object (tool) included in the captured image.

[0040] The trimming unit 230 performs trimming processing on the captured image and obtains an image of each subject (tool) included in the captured image.

[0041] The result output unit 240 respectively receives the captured image, the image of each tool trimmed by the trimming unit 230, and the processing result information of the image processing unit 220 (for example, information including the silhouette, number, and category name of each tool) (for example, inputting the information into a machine learning model such as a neural network (or other type of model such as a decision tree)), and transmits the received information as image processing result information to the inspection terminal 300. The image processing result information may include the trimmed tool image, category name, and number of tools for each tool. The processing of the image processing unit 220 and the trimming unit 230 can also be executed together as a single process. Furthermore, the template matching described above and the like can also be used in the trimming unit 230 and the result output unit 240.

[0042] The inspection terminal 300 may be a device including an interface device, a storage device, and a processor connected to them. Information is received from the image processing device 200 and transmitted to a database unit 410 of the entrance / exit management server 400 via the interface device. The processor of the inspection terminal 300 executes a computer program to implement an application input unit 310, a result receiving unit 320, a display control unit 330, a result display unit 340, a judgment input unit 350, a linking processing unit 360, and an information output unit 370.

[0043] The application input unit 310 receives advance application information from the application terminal 510 via the reception terminal 610 (or receives it not via the reception terminal 610), and outputs target application information (e.g., information including at least the applicant's identification information), which is at least a part of the input advance application information, to the display control unit 330 and the linking processing unit 360.

[0044] The result receiving unit 320 receives the image processing result information from the result output unit 240 , and outputs the received image processing result information to the display control unit 330 and the linking processing unit 360 .

[0045] The display control unit 330 outputs the received target application information and image processing result information to the result display unit 340. In addition, the display control unit 330 outputs the determination result information received from the determination input unit 350 to the result display unit 340.

[0046] The result display unit 340 displays the content represented by the target application information and the content represented by the image processing result information on a display device (not shown) of the inspection terminal 300. The judgment input unit 350 receives input of a judgment (e.g., whether or not to approve the displayed content) on the content displayed by the result display unit 340 from an operator (e.g., an inspector). The judgment input unit 350 outputs judgment input information, which is information representing the input judgment result, to the display control unit 330.

[0047] The linking processing unit 360 executes processing to link the judgment input information from the display control unit 330, the target application information from the application input unit 310, and the image processing result information from the result receiving unit 320, and outputs the linking processing result information to the information output unit 370. The linking processing result information includes a combination of the target application information, the image processing result information, and the judgment input information. The linking processing result information includes the above-mentioned bring-in information and take-out information of the worker (applicant).

[0048] The information output unit 370 requests the database unit 410 of the entrance / exit control server 400 to store the association processing result information. In response to the request, the database unit 410 stores the association processing result information.

[0049] The database unit 410 manages the following information for each worker (applicant): At least part of the following information 411 to 418 and 420 is included in the worker's bring-in information and take-out information. · An application representative name 411 (for example, the name of the application representative (an example of identification information of the application representative)) that represents the application representative designated in the advance application information. A location 412 indicating the area (entrance / exit area or entrance area) specified in the advance application information. A time 413 indicating the time (for example, the entry time) specified in the advance application information. An outer shape 414 is information about each tool of the worker and indicates the outer shape of the tool. Color 415 is information about each tool of the worker, and is related to the color of the tool. -Information about each worker's tool, and the number of tools is 416. A category name 417 is information about each tool of the worker and indicates the category name of the tool. An image 418 of a tool brought in (or taken out) by a worker. The image 418 is one or more images. An image may be an overall image or an individual image. The overall image may be a single photographed image of all the tools. The individual image may be an image of some of the tools (one or more tools). The individual image may be a photographed image of some of the tools, or an image obtained from the overall image. A tool frame 420 representing a frame (for example, a rectangular frame) representing the range of each tool.

[0050] Figure 4 shows the functions related to exit determination among the functions of the baggage inspection system 10. The explanation with reference to Figure 4 will mainly focus on the differences from the explanation with reference to Figure 3, and explanation of the commonalities with the explanation with reference to Figure 3 will be omitted or simplified.

[0051] The image processing device 200 further includes an entrance input unit 250 , an exit input unit 260 , and a determination unit 270 .

[0052] The entry input unit 250 inputs (acquires) the worker's entry information (including carry-in information) from the database unit 410 and outputs the input entry information to the determination unit 270. The exit input unit 260 inputs (acquires) the worker's exit information (including take-out information) from the database unit 410 and outputs the input exit information to the determination unit 270.

[0053] The determination unit 270 stores the entry information from the entry input unit 250 and the exit information from the exit input unit 260. The entry information and the exit information each include information 411 to 418 and 420. The determination unit 270 performs an exit determination including a comparison and collation between the entry information (particularly, bring-in information) and the exit information (particularly, take-out information). The determination unit 270 outputs exit determination result information, which is information indicating the result of the exit determination (for example, a collation result), to the result output unit 240.

[0054] The result output unit 240 transmits the exit determination result information from the determination unit 270 to the inspection terminal 300.

[0055] The result receiving unit 320 of the inspection terminal 300 receives the exit determination result information from the result output unit 240 , and outputs the received information to the display control unit 330 and the association processing unit 360 .

[0056] The display control unit 330 displays the content represented by the target application information from the application input unit 310 and the content represented by the exit determination result information from the result receiving unit 320 on a display device (not shown) of the inspection terminal 300. The judgment input unit 350 receives input of a judgment (e.g., whether or not the exit is approved as valid) on the content displayed by the result display unit 340 from an operator (e.g., an inspector). The judgment input unit 350 outputs judgment input information, which is information representing the input judgment result, to the display control unit 330.

[0057] The linking processing unit 360 executes processing to link the judgment input information from the display control unit 330, the target application information from the application input unit 310, and the exit judgment result information from the result receiving unit 320, and outputs the linking processing result information to the information output unit 370. The linking processing result information includes a combination of the target application information, the exit judgment result information, and the judgment input information.

[0058] The information output unit 370 transmits the association processing result information from the association processing unit 360 to the database unit 410 of the entrance / exit control server 400.

[0059] The database unit 410 of the entrance / exit control server 400 receives the association processing result information from the inspection terminal 300, and stores the exit determination result information 421 included in the received association processing result information.

[0060] The search terminal 700 receives a search query specifying search conditions (e.g., construction site name, worker name, etc.), searches for information that meets the search conditions from the exit judgment result information 421 for each worker, and returns the search results as a response to the query.

[0061] 5 and 6 show examples of the configuration of the entrance / exit management table 900. FIG.

[0062] The entrance / exit management table 900 may be a table managed by the database unit 410 of the entrance / exit management server 400. For example, the entrance / exit management table 900 may be processed based on information from the database unit 410, past information, or input information, and the representative application name 903, etc. may be identified from the input information. Other columns may be processed in the same way. The entrance / exit management table 900 has the above-mentioned linking processing result information (information including target application information, image processing result information, and judgment input information) for each applicant (worker). Specifically, the records in the entry / exit management table 900 include information such as management number 901, company name 902, application representative name 903, application number 904, application type 9041, bring-in information (e.g., information including time 905, location 906, type 907, item ID 908, category name 909, image 910, and number of items 911), take-out information (e.g., information including time 915, location 916, type 917, item ID 918, category name 919, image 920, number of items 921, and take-out person 9211), judgment 922, and special notes 923. 5 and 6 include information not illustrated in FIG. 3 (e.g., management No. 901), and information illustrated in FIG. 3 (shape 414, color 415, tool frame 420), but the entry / exit management table 900 may include both information not illustrated in FIG. 3 and information illustrated in FIG. 3.

[0063] Management No. 901 is a serial number assigned to each piece of linking processing result information, for example, by the information output unit 370 or the database unit 410. Company name 902 indicates, for example, the name of the company to which the representative applicant belongs. Representative applicant name 903 is information corresponding to representative applicant name 411 and indicates the name of the representative applicant. Application number 904 indicates an identification number assigned to the application.

[0064] The application type 9041 indicates whether the application for bringing in a tool is an advance application or an irregular application. Irregular applications include, for example, an irregular application (bring-in) and an irregular application (leaving).

[0065] An "irregular application (bring-in)" is an application to bring in tools that are different from the tools that the application representative applied for in advance (tools that were applied for to be brought in before entering). Also, an "irregular application (leaving)" is an application to leave some or all of the tools that the application representative applied for in advance (tools that were applied for to be brought in before entering) in a designated area (an application for a worker to leave some or all of the tools in a designated area before leaving).

[0066] For example, in the case of an application for management number 901 "0003," if an irregular application (carry-in) is made on the day of the work, the tools for which the irregular application (carry-in) was made may be managed by linking them to the advance application "0003," and when the worker leaves, it can be confirmed whether he or she has taken out all of the tools that were brought in and linked to the advance application and the irregular application (carry-in) before leaving. This makes it possible to detect not only the tools that were brought into the designated area in accordance with the advance application, but also that any tools identified as "unclassified" in category name 909 that needed to be brought in on the day of the work have not been left behind.

[0067] In the example of management No. 901 "0004," if an irregular request (left behind) is made on the day of the work, the tool for which the irregular request (left behind) was made may be managed by linking it to the advance request of "0004," and when the worker leaves, it can be confirmed whether the worker will take out all of the tools for which the advance request was made, excluding the tools that were brought in and linked to the irregular request (left behind). In this way, after the advance request tool is brought into the designated area, an irregular request (left behind) is made for the tool recognized as category name 909 "wrench" to be used for the next day's work, and it is possible to detect the tools that the worker should take home while leaving the necessary tools in the designated area.

[0068] The carry-in information is as follows. Time 905 is information corresponding to time 413 and indicates the time of entry (the time the tool was photographed). Location 906 is information corresponding to location 412 and indicates location information of the entrance area or entrance / exit area (for example, gate ID, address, or latitude and longitude). Type 907 indicates the type of tool image (whether entire or individual item). Item ID 908 indicates the ID of the detected item (i.e., tool) (details will be described later). Category name 909 is information corresponding to category name 417 and indicates the category name of the tool. Image 910 is information corresponding to image 418 and indicates all images of all tools brought in (or links to all of those images). Quantity 911 indicates the number of tools brought in. For type 907 "entire," the quantity 911 indicates the total number of tools. For tools of type 907 "individual," the quantity 911 indicates the number of those tools.

[0069] The removal information is as follows. Time 915 is information corresponding to time 413 and indicates the time of exit (the time the tool was photographed). Location 916 is information corresponding to location 412 and indicates location information of the exit area or entrance / exit area (for example, gate ID, address, or latitude and longitude). Type 917 indicates the type of tool image (whether entire or individual item). Item ID 918 indicates the ID of the detected item (details will be described later). Category name 919 is information corresponding to category name 417 and indicates the category name of the tool. Image 920 is information corresponding to image 418 and indicates all images of all tools being removed (or links to all those images). Quantity 921 indicates the number of tools being removed. For type 917 "entire," quantity 921 indicates the total number of tools. For tools of type 917 "individual," quantity 921 indicates the number of those tools. The take-out person 9211 indicates the name of the person who takes out the tool (the person who leaves).

[0070] The decision 922 corresponds to the decision input information and indicates the result of the exit decision. "OK" means that the entry is valid and all tools brought in will be removed. "Left behind" means that the entry is valid, but some of the tools brought in will be left behind instead of being removed. "Entering" means that the worker has entered but not yet left. Note that the value of decision 922 may be other values ​​instead of or in addition to at least one of "OK," "Left behind," and "Entering." For example, the value "NG" may be used to indicate that the exit decision is invalid (i.e., all of the tools brought in have not been removed, and no request to leave the tools that will not be removed has been made). In this way, by processing the leaving of belongings such as tools, the designated area can be more appropriately managed. For example, if a worker leaves a designated area with belongings such as tools in the designated area, it may be necessary to confirm whether the belongings were intentionally left behind, which is undesirable from the perspective of managing the designated area. However, there are cases where the tools and other belongings left behind by the workers are used the day after they leave, or where the tools and other belongings are large, and not having to repeatedly enter and exit the area reduces the management costs of the specified area. Such cases are examples of cases where the management of leftover items according to this embodiment is effective.

[0071] The special notes 923 is information indicating special notes regarding the tool. The special notes 923 includes leaving information. The leaving information indicates leaving conditions (for example, at least one of leaving deadline and leaving location) regarding the requested leaving target tool.

[0072] According to the example shown in FIGS. 5 and 6, for example, the following occurs: The images include an overall image of all tools taken in one go, and individual images cropped from the overall image into tool units. The overall image may be used as evidence of the actual photography. The individual item images may be used in determining whether a person is leaving the facility (for comparison between the individual item image at the time of entry and the individual item image at the time of exit), and may be fed back (sent) to the application management server 520. The fed back individual item images may be included in the advance application information when the next advance application is made. The item IDs 908 and 918 may be IDs of the tools as products, but in this embodiment, they may be IDs assigned to each tool identified by image analysis of the entire image. The category names 909 and 919 may be information assigned by the image processing unit 220 through inference using a machine learning model (e.g., a neural network). The judgment at the time of entry (a judgment including a comparison and matching of the advance application information and the carry-in information) and the judgment at the time of exit (exit judgment) may include a comparison and matching of the outer shape 414, color 415, and image 418 (e.g., individual item image) present for each item ID 908 (918) between pieces of information to be compared (e.g., between the advance application information and the carry-in information, or between the carry-in information and the take-out information). The category names 909 (918) do not need to be compared and matched.

[0073] FIG. 7 shows an example of the configuration of the group management table 1000.

[0074] The group management table 1000 may be a table managed by the database unit 410 of the entrance / exit management server 400. For example, the group management table 1000 may be processed based on information from the database unit 410, past information, or input information, and the entry applicant name 1004, etc. may be identified from the input information. Other columns may be processed in the same manner.

[0075] The records of the group management table 1000 include information such as management number 1001, application number 1002, company name 1003, entry applicant name 1004, application representative 1005, carry-in application information (number 1006, category name 1007, image 1008 and number of members 1009), and special notes 1010.

[0076] A set of one management number 1001, application number 1002, and company name 1003 matches the set of management number 901, application number 904, and company name 902 of a group of applications.

[0077] The entry applicant name 1004 indicates the names of all workers belonging to one worker group that belongs to a group of applications. The application representative 1005 indicates, for each worker belonging to that worker group, whether or not they are the representative. In other words, the application representative 1005 indicates which worker in the worker group is the application representative.

[0078] In the carry-in application information, item ID 1006 matches the serial number of the tools in the group application and matches item ID 908. Category name 1007 indicates the category name of the tools and matches category name 909. Image 1008 indicates an image of the tool and matches image 910 of type 907 "individual item." Quantity 1009 indicates the number of tools and matches quantity 911.

[0079] The special note 1010 indicates the special note of the value (value related to the tool) in the entry / exit management table 900.

[0080] 5 to 7, for example, it is as follows: Note that a worker group is made up of one or more workers. In other words, one worker group can be one worker. The details of Control No. 901 "0001" are as follows: Two tools were brought in by workers "AAA", "DDD", and "EEE" who belong to the worker group. When they left, the three of them left together, and all two tools they had brought in were taken out together. "AAA", the representative of the application, is registered as taker 9211. Therefore, the result of the exit judgment was found to be legitimate. The following applies to management No. 901 "0002." The worker group is the same as management No. 901 "0001," and this is an example of a tool for which a prior request to leave was made. Worker "AAA" brought in the tool "stepladder," but worker "AAA" left without taking the tool "stepladder." Therefore, for worker "AAA," the judgment 922 for the tool "stepladder" is "left behind." The tool "stepladder" is due to be left until January 31st. The entry / exit management server 400 (or image processing device 200) may identify the tool associated with the leaving information from the entry / exit management table 900 and determine whether the leaving deadline indicated by the leaving information associated with the tool has passed. If the judgment result is true, the inspection terminal 300 may issue an alert (for example, an alert message may be displayed to the inspector). This allows the manager and workers in a designated area to properly manage tools and other items to be left behind and the deadline for leaving them behind. Applications for leaving items behind can be made either in advance or as irregular applications. Irregular applications are made at the time of entry or before entering and leaving the area. The details for management number 901 "0003" are as follows: Four tools were brought in. However, for the tool "wrench," machine learning had not yet been completed for the judgment, so category name 919 was set to "Unclassified." When they left, the four people left together, and all four tools they had brought in were taken out together. The representative of the application, "BBB," is registered as the person who took them out 9211. Therefore, the result of the exit judgment was valid. Note that this example means that an exit judgment is possible even if the entry area and exit area are different. This example also means that an exit judgment is possible even if the category name is unspecified, because the comparison and matching in the exit judgment does not require the category name. The details regarding control number 901 "0004" are as follows: Three tools were brought in by workers "CCC," "HHH," and "JJJ" of the worker group corresponding to control number 901 "0004," but worker "CCC" took one tool first and left from a different location, leaving workers "HHH" and "JJJ" with the remaining two tools and not yet leaving. The tool "wrench" was left behind due to an irregular request (left behind), so when workers "HHH" and "JJJ" leave with the tool "cutter," all tools that were previously requested will have been taken out, excluding the tools that were brought in due to the irregular request (left behind).

[0081] FIG. 8 shows an example of the overall processing flow including the processing performed at the time of entry and the processing performed at the time of exit.

[0082] The application terminal 510 inputs and transmits advance application information in accordance with operations by the applicant (representative applicant) (S801). The transmitted advance application information is received by the reception terminal 610. The advance application information includes information representing the applicant and information representing all tools to be brought in. If there are tools to be left behind among all the tools, the advance application information includes leaving information associated with the tools to be left behind. When inputting the advance application information, at least one of the following may be performed. The applicant's name, face image, etc. are entered. Images of each tool brought in by the applicant are included in the advance application information. If past tool images of at least one tool are stored in the application management server 520 from the entrance / exit management server 400, the tool image of the tool may be acquired from the application management server 520 by the application terminal 510 and included in the advance application information. If one or more brought-in tools include a tool to be left in a specified area 54, a tool image and remaining information are associated with the tool. The remaining information includes information such as the leaving deadline and the leaving location. For example, the application terminal 510 displays information for each brought-in tool and accepts input of which tool is to be left and the leaving deadline, etc.

[0083] When the worker (applicant) enters, an image of the tools is taken (S802). That is, all of the tools brought in by the worker (applicant) are photographed by the camera 100 installed in the entrance / exit area 54. Here, for example, one overall image of all of the tools is taken. The overall image is input to the image processing device 200.

[0084] The carry-in inspection device 15 including the image processing device 200 generates carry-in information (S803). Specifically, the image processing unit 220 performs silhouette extraction processing, RGB color determination processing, counting processing, and category estimation processing on the input overall image. The trimming unit 230 performs trimming processing on the overall image. As a result, image processing result information is generated in which information such as the tool image, category name, outer shape, color, and number of tools shown in the overall image is associated with each tool. The image processing result information may include the overall image, as well as information indicating the time of entry and the location in the entrance / exit area 54. The image processing result information may also include a captured image of the worker's face at the time of entry. At least a portion of this image processing result information corresponds to carry-in information. The result output unit 240 transmits the image processing result information (information including carry-in information) to the inspection terminal 300.

[0085] If the carry-in information received by the inspection terminal 300 matches the advance application information received by the reception terminal 610, the worker's entry is approved, and information including at least a part of the advance application information and the carry-in information is registered in the entrance / exit management table 900 and the group management table 1000 of the entrance / exit management server 400 (S804). In S804, for example, the following is performed. The comparison between the pre-application information and the on-board information may be done visually by the inspector. If the advance application information includes a tool image, a determination unit of the belongings inspection device 15 may determine whether the tool image in the advance application information matches the tool image in the image processing result information. This "determination unit" may include the determination unit 270 of the image processing device 200, or may include at least some of the functions of the reception terminal 610 and the inspection terminal 300. The judgment input unit 350 inputs the judgment result as to whether the carry-in information conforms to the advance application information.

[0086] When the worker leaves, an image of the tools is taken (S805). That is, all the tools brought out by the worker are photographed by a camera 100 (for example, a fixed camera or a mobile camera) installed in the entrance / exit area 54. Here, for example, one overall image of all the tools is taken. The overall image is input to the image processing device 200.

[0087] The carry-in inspection device 15 including the image processing device 200 generates carry-out information (S806). Specifically, the image processing unit 220 generates image processing result information in which information such as the tool image, category name, outer shape, color, and number of tools is associated with each tool shown in the input overall image. The image processing result information may include the overall image, and information representing the time of exit and the location in the entrance / exit area 54. The image processing result information may also include a captured image of the worker's face. At least a part of this image processing result information corresponds to the carry-out information. The result output unit 240 transmits the image processing result information (information including the carry-out information) to the inspection terminal 300.

[0088] After that, an exit determination is made, which includes steps S807, S808, and S810.

[0089] That is, the judgment unit 270 of the image processing device 200 compares the information (e.g., carry-in information (and special notes 923) and information 1001 to 1010) acquired from the entry / exit management table 900 and the group management table 1000 via the entry input unit 250 with the take-out information acquired from the entry / exit management table 900 via the exit input unit 260 (S807).

[0090] If the tools represented by the bring-in information include a left tool that is not included in the tools represented by the take-out information, the determination unit 270 of the image processing device 200 determines whether the leaving is appropriate or not (S808). The determination in S808 uses the entry / exit management table 900 and the group management table 1000. Whether the leaving is appropriate or not depends, for example, on whether any of the following requirements is met: The remaining tool is a tool associated with a leaving condition, and the leaving condition is satisfied. For example, if the leaving condition includes a leaving deadline, the time of departure is before the leaving deadline. In other words, if the worker's leaving date and time is earlier than the leaving deadline, it can be determined that the target tool will be left behind when the worker leaves. Also, for example, if the leaving condition includes a leaving location, if the remaining tool is captured in an image taken by a camera (not shown) installed in the location represented by the leaving location (for example, if the image or outline, etc. obtained by processing the image by the image processing unit 220 matches the image 1010 or outline, etc. of the remaining tool), it can be determined whether the leaving condition is met. In other words, it can be determined that the remaining tool will not be taken out, etc. within the specified area, thereby improving safety within the specified area.

[0091] If there is a remaining tool but the remaining tool is not appropriate (S808: NO), the determination unit 270 notifies information indicating that there is an inappropriate remaining tool (S809). The information may be notified to the inspection terminal 300 and displayed by the inspection terminal 300, for example.

[0092] If there are no remaining tools, or if there are remaining tools but they are properly left (S808: YES), the determination unit 270 determines whether all brought-in tools other than the remaining tools match all brought-out tools (S810).

[0093] If the determination result of S810 is true (S810: YES), the determination unit 270 notifies information indicating a result meaning valid (for example, a result meaning that there are no invalid left-behind tools) (S811). On the other hand, if the determination result of S810 is false (S810: NO), the determination unit 270 notifies information indicating a result meaning invalid (for example, a result meaning that a tool that has not been requested to be left behind is left) (S812). In S811 and S812, the information may be notified to the inspection terminal 300 and displayed by the inspection terminal 300, for example.

[0094] The above description of the embodiment can be summarized, for example, as follows. The following summary may include supplementary explanations and explanations of modifications to the above.

[0095] The belongings inspection system 10 has a determination unit 270 and an output unit. The determination unit 270 performs an exit determination, which is a determination of the legitimacy of tools (an example of belongings) held by worker X at the time of his / her exit, based on information about what was brought in by worker X (an example of a subject) at the time of his / her entry into a construction site 51 (an example of a predetermined area) and information about what was taken out by worker X at the time of his / her exit from the construction site 51. The output unit notifies information about the result of the exit determination. In this way, since a determination is made using information about what was brought in at the time of entry as well as information about what was taken out at the time of his / her exit, it is possible to accurately identify whether or not tools brought into the construction site 51 have been taken out.

[0096] The carry-in information may be information based on an entrance image, which may be a photograph of all tools brought in at the time of entry, or may be a photograph of each individual tool brought in.

[0097] The take-out information may be information based on an exit image, which may be a photograph of all the tools taken out at the time of exit, or may be a photograph of each individual tool taken out.

[0098] Furthermore, the determination unit 270 is a function included in the image processing device 200, but the determination unit 270 may be a function present in one or more devices instead of or in addition to the image processing device 200. For example, the function of the determination unit 270 that makes the exit determination may be provided in the image processing device 200, and the function that makes the entry determination (described later) may be provided in the reception terminal 610. Furthermore, the "exit determination" may be a first determination of whether or not the tools (an example of belongings) at the time of exiting match the tools that were brought in, or may include a second determination of whether or not the exit is legitimate based on the result of the first determination. The result of the first determination may be displayed, and the second determination may be made by a person such as an inspector.

[0099] Furthermore, the "output unit" may be an example of the result output unit 240, or may be an example of a combination of the result output unit 240, the display control unit 330, and the result display unit 340. The information regarding the result of the exit determination may be notified to an information processing terminal (e.g., the inspection terminal 300 or the reception terminal 610) of the inspector (an example of a user), or may be a control device that controls the opening and closing of an exit gate (not shown) in the entrance / exit area 54. In the former case, information regarding the result of the exit determination is displayed to the inspector, who may decide whether or not to allow the worker to exit. In the latter case, the control device may control the opening and closing of the exit gate according to the information regarding the result of the exit determination.

[0100] The judgment unit 270 may perform an entry judgment, which is a judgment of whether the brought-in information conforms to the advance application information representing an advance application for entry into the construction site 51. The output unit may notify information regarding the result of the entry judgment. The information regarding the result of the entry judgment may be notified to an information processing terminal of the inspector, or may be notified to a control device that controls the opening and closing of an entrance gate (not shown) of the entrance / exit area 54. In the former case, information regarding the result of the entry judgment may be displayed to the inspector, who may decide whether to allow or deny entry to the worker. In the latter case, the control device may control the opening and closing of the entrance gate according to the information regarding the result of the entry judgment. Examples of the entry judgment may be at least one of the following (a) to (c). (a) The advance application information may include identification information of a worker entering the construction site 51. The entry determination may include determining whether the worker identification information in the advance application information matches the identification information of worker X. This allows for identity confirmation at the time of entry to determine whether the person specified in the advance application information will enter as a worker. (b) The advance application information may include information representing each tool brought into the construction site 51. The information representing the tool may include the category name of the tool and a photographed image. The entry determination may include a determination of whether the tools represented by the advance application information match the tools represented by the carry-in information. This makes it possible to check at the time of entry whether the tools brought in are the same as the tools requested in the advance application information. The following configuration may be adopted in (c) and (b). That is, one or more feedback images that can be included in the pre-application information for worker X's next or subsequent pre-application for entry into the construction site 51 may be transmitted. The transmission source may be the belongings inspection system 10, and the transmission destination may be an information processing system that the applicant can use or access. At the time of entry, the tools may be photographed by a camera 100 (an example of an entry camera) fixed in the entrance / exit area 54 (an example of an entry area) of the construction site 51. At the time of exit, the tools may be photographed by a camera 100 (an example of an exit camera that is the same as or different from the entry camera) fixed in the entrance / exit area 54 (an example of an exit area) of the construction site 51. The feedback image may be at least one image of one or more tools of worker X at at least one of the time of entry and the time of exit. If the pre-application information includes an image, the entry determination may include determining whether the image in the pre-application information matches the image of the tool brought in at the time of entry. In this way, the image in the advance application information is an image taken by the camera 100 fixed in the entrance / exit area 54 (or an image acquired from that image). Therefore, the shooting conditions (for example, the distance from the camera 100 to the tool as the subject) of the image taken in the advance application information and the image taken at the time of entry are the same or similar. Therefore, there is a high possibility that a match will be found when comparing the image taken by the camera 100 at the time of entry (or an image acquired from that image). This contributes to reducing the inspection burden on inspectors.

[0101] The decision to leave may be based on irregular application information, which indicates an irregular application, in addition to the carry-in information and take-out information. An irregular application may be an application made at the time of entry or before entry and exit, and may be an application to bring in or leave behind belongings. This makes it possible to deal with bringing in or leaving behind belongings that were not planned in the advance application.

[0102] The exit determination may be based on the group bring-in information of group T (an example of a worker group) to which worker X belongs, and the group take-out information of group T. The group bring-in information may include bring-in information for each worker belonging to group T. The group take-out information may include take-out information for each worker belonging to group T. This makes it possible to determine whether or not exit is legitimate for each worker group. For example, all workers belonging to group T may enter or exit together, or may enter or exit at different times. Regarding the exit determination for each worker group, for example, at least one of the following is expected. If all tools represented by the group bring-in information (i.e., all tools brought in by group T) match all tools represented by the group take-out information (i.e., all tools taken out by group T), the result of the exit judgment may be a result that means that worker X's exit is valid (worker X may be the last person in group T to leave). This identifies that all tools brought in by group T will be taken out. There may be multiple entry areas for the construction site 51, in which case, for each of the multiple entry areas, carry-in information of workers entering through the entry area may be acquired. Also, there may be multiple exit areas for the construction site 51, in which case, carry-out information of workers attempting to exit through the exit area may be acquired. The group carry-in information may include carry-in information for each worker belonging to group T who has passed through one or more entry areas. The group exit information may include carry-out information for each worker belonging to group T who is attempting to pass through one or more exit areas. This makes it possible to determine exit on a worker group basis, regardless of whether the worker enters through any of the entry areas or exits through any of the exit areas.

[0103] One or more tools among the one or more tools represented by the carry-in information may each be associated with remaining information indicating the leaving conditions for the tool. In this case, the departure determination may be based on the carry-in information, the take-out information, and the leaving information for each of the one or more tools. The leaving conditions may include at least one of a leaving deadline, which indicates how long the belongings will be left, and a leaving location, which indicates where the belongings will be left. This makes it possible to determine whether the leaving of tools that are not taken out is legitimate even if the carried-in tools are not included in the take-out tools, thereby determining whether the departure is legitimate.

[0104] For example, the exit determination may be based on the group bring-in information and group take-out information of group T, and, if left-behind information is associated with the tools of at least one worker belonging to group T, the left-behind information. This makes it possible to determine, for each worker group, whether the leaving of tools that are not to be taken out is legitimate, even if the brought-in tools are not included in the taken-out tools.

[0105] Furthermore, the leaving condition may be set for each tool to be left behind, thereby enabling accurate leaving conditions to be associated with each tool to be left behind.

[0106] The exit determination may include the following determinations (A) and (B). This allows for correct exit determination for each worker or for each worker group, regardless of whether or not there are any appropriate tools left behind. (A) Determining whether all tools represented by the take-out information or group take-out information when worker X leaves are included in all tools represented by the bring-in information or group bring-in information. (B) If there is at least one remaining tool, determine whether each of all the remaining tools is a proper remaining tool.

[0107] The remaining tools may be tools that are not included in the tools represented by the carry-in information or the group carry-in information, among all the tools represented by the carry-out information or the group carry-out information. The appropriate remaining tools may be (x) or (y) below. (x) A tool that is an item associated with remaining information that indicates the remaining condition of the remaining tool, and the remaining condition indicated by the remaining information is satisfied. (y) If there is a worker in group T who has not yet left, the tools are expected to be taken away by that worker (i.e., if there is even one worker in group T who has entered, it is expected that that worker will take away any tools left behind).

[0108] Although one embodiment has been described above, this is merely an example for the purpose of explaining the present invention, and the scope of the present invention is not limited to these embodiments. The present invention can also be implemented in various other forms. As described above, the predetermined area can also be used at construction sites, medical facilities, etc., and the present invention can prevent various problems by identifying tools and materials brought into the predetermined area. Furthermore, by identifying the worker who brought tools or predetermined materials into the predetermined area, the time of their introduction, and the work they performed, it is possible to track the extent of the problem, contributing to higher traceability in item management within the predetermined area than in the past. Furthermore, an application is not necessarily required each time an entry or exit is made. For example, an application may be made once per certain period, and an exit determination may be made each time an entry or exit is made during that period. [Explanation of symbols]

[0109] 10: Baggage inspection system

Claims

1. a determination unit that performs an exit determination, which is a determination of the legitimacy of the items carried by the subject at the time of exit, based on information about items brought in by the subject at the time of entry into a predetermined area and information about items taken out by the subject at the time of exiting the predetermined area; a result output unit that outputs information about the result of the exit determination to an information processing terminal; Equipped with the carry-in information is information based on one or more entrance images, The take-out information is information based on one or more exit images, each of the one or more entry images is one or more images of one or more belongings at the time of entry, the one or more images being taken at the time of entry; each of the one or more exit images is one or more images of one or more belongings at the time of exit, the one or more images being taken at the time of exit; the determination unit performs an entry determination including a determination of whether or not the person is eligible to enter the predetermined area based on advance application information representing an advance application for entry to the predetermined area; The result output unit outputs information relating to the result of the entrance determination to the information processing terminal. A belongings inspection system.

2. 2. The belongings inspection system according to claim 1, The advance application information includes identification information of a person entering the predetermined area, the determination unit performs an entry determination including determining whether or not identification information of a person entering the predetermined area, which is included in the advance application information, matches the identification information of the target person; The result output unit outputs information relating to the result of the entrance determination to the information processing terminal. A belongings inspection system.

3. 2. The belongings inspection system according to claim 1, The advance application information includes information representing belongings to be brought into the specified area, the determination unit performs an admission determination, which includes determining whether the belongings represented by the advance application information match the belongings represented by the carry-on information; The result output unit outputs information relating to the result of the entrance determination to the information processing terminal. A subject belongings inspection system.

4. 4. The belongings inspection system according to claim 3, an image sending unit that sends one or more feedback images that can be included in the advance application information in the next or subsequent advance application for the subject person's entry into the specified area to an application management server that manages information related to the advance application; Further provided with At the time of entry, the belongings are photographed by an entrance camera, which is a camera fixed in the entrance area of ​​the predetermined area, At the time of exit, the belongings are photographed by an exit camera fixed in the exit area of ​​the predetermined area, which may be the same as or different from the entrance camera, each of the one or more feedback images being an image of one or more possessions of the subject at at least one of an entry time and an exit time; In the admission determination, if the advance application information includes an image, it is determined whether the image in the advance application information matches an image of the belongings brought in at the time of admission. A belongings inspection system.

5. 2. The belongings inspection system according to claim 1, The exit determination is a determination based on irregular application information representing an irregular application in addition to the bring-in information and the take-out information, The irregular application is an application made at the time of entry or before entry and exit, and is an application to bring in or leave behind belongings. A belongings inspection system.

6. 2. The belongings inspection system according to claim 1, The exit determination is a determination based on group bring-in information of a target group to which the target person belongs and group take-out information of the target group, the group carry-in information includes the carry-in information for each subject belonging to the subject group, The group take-out information includes the take-out information for each subject belonging to the subject group. A belongings inspection system.

7. 7. A belongings inspection system according to claim 6, If all of the belongings represented by the group bring-in information match all of the belongings represented by the group take-out information, the result of the exit determination is a result that means valid. A belongings inspection system.

8. 7. A belongings inspection system according to claim 6, If there are multiple entrance areas for the specified area, the carry-on information of people who enter by passing through the entrance area is acquired for each of the multiple entrance areas, If there are multiple exit areas for the specified area, the take-out information of a person who is about to exit by passing through the exit area is acquired for each of the multiple exit areas, The group carry-in information includes carry-in information for each person belonging to the target group who has passed through one or more of the plurality of entrance areas, The group take-out information includes take-out information for each person belonging to the target group who intends to pass through one or more exit areas among the plurality of exit areas. A belongings inspection system.

9. 2. The belongings inspection system according to claim 1, When one or more belongings among the one or more belongings represented by the carry-in information are each associated with leaving information indicating a leaving condition for the belonging, the exit determination is a determination based on the leaving information of each of the one or more belongings in addition to the carry-in information and the take-out information, The leaving conditions include at least one of a leaving time limit, which is the time until the belongings are left, and a leaving location, which is the location where the belongings are left. A belongings inspection system.

10. 10. The belongings inspection system according to claim 9, The exit determination is a determination based on group carry-in information of a target group to which the target person belongs, group take-out information of the target group, and, if the leaving information is associated with belongings of at least one person belonging to the target group, the leaving information; The group carry-in information includes the carry-in information for each person belonging to the target group, The group take-out information includes the take-out information for each person belonging to the target group. A belongings inspection system.

11. 10. The belongings inspection system according to claim 9, For each item being left behind, conditions for leaving it behind are set. A belongings inspection system.

12. 2. The belongings inspection system according to claim 1, The decision to leave the venue includes the following decisions (A) and (B): (A) determining whether all belongings represented by the take-out information or group take-out information at the time of the subject's exit are included in all belongings represented by the bring-in information or group bring-in information; (B) if there is at least one left behind item, determining whether each of all the left behind items is a valid left behind item; the group carry-in information includes the carry-in information for each person belonging to a target group to which the target person belongs, the group take-out information includes the take-out information for each person belonging to the target group, The left-behind items are belongings that are not included in the belongings represented by the take-out information or the group take-out information, among all belongings represented by the bring-in information or the group bring-in information, and The appropriate leftover item is (x) or (y) below: (x) belongings associated with leaving information indicating the leaving conditions of the left-behind item, and the leaving conditions indicated by the leaving information are satisfied; (y) Any belongings of any person in the group who has not yet left the venue that are expected to be taken away by such person; The leaving condition is at least one of a leaving time limit, which is the time until which the belongings are left, and a leaving location, which is the location where the belongings are left. A belongings inspection system.

13. A first step in which the computer performs an exit determination, which is a determination of the legitimacy of the items carried by the subject at the time of exit, based on information on items brought in by the subject at the time of entry into a predetermined area and information on items taken out by the subject at the time of exiting the predetermined area; a second step in which the computer outputs information relating to the result of the exit determination to an information processing terminal; Equipped with the carry-in information is information based on one or more entrance images, The take-out information is information based on one or more exit images, each of the one or more entry images is one or more images of one or more belongings at the time of entry, the one or more images being taken at the time of entry; each of the one or more exit images is one or more images of one or more belongings at the time of exit, the one or more images being taken at the time of exit; In the first step, the computer performs an entry determination, including a determination of whether or not the user is eligible to enter the predetermined area, based on advance application information representing an advance application for entry into the predetermined area; In the second step, the computer outputs information relating to the result of the entrance determination to the information processing terminal. A method for inspecting belongings.

Images