Information processing system, information processing method, and information processing program

Abstract

To provide an information processing system, an information processing method, and an information processing program, for reading a code image efficiently and accurately.SOLUTION: A control unit 11 acquires a captured image captured by a monitoring camera 30. The control unit 11 acquires a plurality of captured images obtained by imaging the same code image, specifies a code region image, in each of the acquired captured images, including a part of the code image, and integrates the code region images to decode the code image.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and an information processing program for reading a code image.

Background Art

[0002] Techniques for managing the locations of people and objects present at a construction site have been studied (for example, see Patent Document 1). In the technique described in Patent Document 1, work conditions such as the progress of work and the employment status of workers at a construction site are managed using IC tags. For this purpose, an IC tag reader that reads a tag ID from an IC tag and a management server that can communicate with the IC tag reader are used. The IC tags are attached to each of the elements such as materials, tools, and workers present at the construction site. The IC tag reader is attached inside each space at the construction site and at the entrances and exits to each space. The management server receives the tag ID and the space ID of the space where the IC tag reader is installed from each IC tag reader. Further, based on the tag ID, the space ID, and the reading time of the tag ID, the management server manages the entry and exit dates and times of each element into and out of each space.

[0003] Also, techniques using code images have been studied for managing parts (for example, see Patent Document 2). In the technique described in Patent Document 2, an operator causes a terminal computer to read identification information of a specific part. In this case, the corresponding distribution history data is transmitted from the host computer to the terminal computer, and the value of the distribution history data is displayed on the display device of the terminal.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, the technology described in Patent Document 1 requires attaching IC tags to the items to be managed and installing IC tag readers for location management. Since the items to be managed on-site are diverse, the management of providing and maintaining communication devices to identify their locations becomes burdensome. Furthermore, the technology described in Patent Document 2 requires workers to load identification information of specific parts into a terminal computer, which is time-consuming. On the other hand, accurate management is not possible in environments where code images are difficult to read. [Means for solving the problem]

[0006] An information processing system for solving the above problems includes a control unit that acquires captured images taken by a camera. The control unit acquires multiple captured images of the same code image, identifies a code region image in each acquired captured image that shows a part of the code image, integrates the code region images, and decodes the code image. [Effects of the Invention]

[0007] This invention enables efficient and accurate reading of code images. [Brief explanation of the drawing]

[0008] [Figure 1] This is an explanatory diagram of the system according to the embodiment. [Figure 2] This is an explanatory diagram of the hardware configuration of the embodiment. [Figure 3] This is an explanatory diagram of the information recorded in the managed storage unit of the embodiment. [Figure 4] This is an explanatory diagram of the information recorded in the camera information storage unit of the embodiment. [Figure 5] This is an explanatory diagram of the information recorded in the location information storage unit of the embodiment. [Figure 6] This is an explanatory diagram of the confirmation form for the embodiment. [Figure 7]This is an explanatory diagram of the processing procedure of the embodiment. [Figure 8] This is an explanatory diagram of the processing procedure of the embodiment. [Figure 9] This is an explanatory diagram of the processing procedure of the embodiment. [Figure 10] This is an explanatory diagram of the processing procedure of the embodiment. [Figure 11] This is an explanatory diagram of the processing procedure of the embodiment. [Figure 12] This is an explanatory diagram of the processing procedure of the embodiment. [Figure 13] This is an explanatory diagram of the display screen of the embodiment. [Figure 14] This is an explanatory diagram of the display screen of the embodiment. [Modes for carrying out the invention]

[0009] Hereinafter, an embodiment of an information processing system, an information processing method, and an information processing program will be described with reference to Figures 1 to 14. As shown in Figure 1, this embodiment describes an information processing system for managing the location of managed objects at a construction site. Managed objects include managed persons T1 such as workers, and managed objects T2 such as materials and equipment. In this embodiment, a code image C1 is used to manage the location of these objects. The code image C1 is a one-dimensional code or a two-dimensional code, for example, a QR code (registered trademark) is used.

[0010] In this embodiment, as shown in Figure 1, a field device 10 and a management device 20 are used, which are interconnected via a network. Multiple surveillance cameras 30 (cameras) are connected to the field device 10 via wired or wireless connections. These surveillance cameras 30 are installed for monitoring purposes and capture images of a predetermined range from their installation location. When a target for management is located within the predetermined range, the code image C1 attached to the target for management is also captured.

[0011] (Description of hardware configuration) Using FIG. 2, the hardware configuration of the information processing device H10 that constitutes the field device 10 and the management device 20 will be described. The information processing device H10 includes a communication device H11, an input device H12, a display device H13, a storage device H14, and a processor H15. Note that this hardware configuration is an example, and it is also possible to be realized by other hardware.

[0012] The communication device H11 is an interface that establishes a communication path with other devices and executes data transmission and reception, and is, for example, a network interface, a wireless interface, or the like.

[0013] The input device H12 is a device that receives input of various information, and is, for example, a mouse, a keyboard, or the like. The display device H13 is a display or the like that displays various information. The storage device H14 stores data and various programs for executing various functions of the field device 10 and the management device 20. Examples of the storage device H14 include a ROM, a RAM, a hard disk, and the like.

[0014] The processor H15 controls each process in the field device 10 and the management device 20 using the programs and data stored in the storage device H14. Examples of the processor H15 include, for example, a CPU, an MPU, or the like. This processor H15 expands the program stored in a ROM or the like into a RAM and executes various processes for each process.

[0015] The processor H15 is not limited to performing software processing for all processes it executes. For example, the processor H15 may include a dedicated hardware circuit (for example, an application-specific integrated circuit: ASIC) that performs hardware processing for at least a part of the processes it executes. That is, the processor H15 can be configured as follows.

[0016] 〔1〕One or more processors that operate according to a computer program (software) [2] One or more dedicated hardware circuits that perform at least some of the various processes. [3] Circuits that include combinations of these. A processor includes a CPU and memory such as RAM and ROM, where memory stores program code or instructions configured to cause the CPU to perform processing. Memory, or computer-readable media, includes any available media that can be accessed by a general-purpose or dedicated computer.

[0017] (Each function of the information processing system) Next, we will explain each function of the information processing system using Figure 1. The field device 10 is a computer device (personal computer, smartphone, etc.) used by the person in charge of managing the construction site. This field device 10 includes a control unit 11. This control unit 11 functions as a recognition processing unit 111 by executing a code recognition program. The recognition processing unit 111 performs the process of recognizing the code image. In this embodiment, this recognition processing unit 111 is provided for each surveillance camera 30.

[0018] The management device 20 is a computer device (server, etc.) that manages the location of the managed objects. This management device 20 comprises a control unit 21, a managed object storage unit 22, a camera information storage unit 23, and a location information storage unit 24. Furthermore, in this embodiment, the management device 20 includes a code reader 25. This code reader 25 is a device that decodes the code image C1. In this embodiment, when a managed object is registered, the code reader 25 is used to encode the code image C1 attached to the managed object and obtain identification information (managed object ID). If the code reader 25 is not available, the managed object ID can be entered manually.

[0019] The control unit 21 assists in managing the location of managed objects at the construction site. To this end, the control unit 21 functions as a management processing unit 211 and a display processing unit 212 by executing a management program.

[0020] The management processing unit 211 identifies the location of the managed object and executes a process to register it in the location information storage unit 24. The display processing unit 212 executes a process to output the location of the managed object.

[0021] As shown in Figure 3, the managed information 220 is recorded in the managed information storage unit 22. This managed information 220 is recorded when a managed object is registered. The managed information 220 consists of a managed object ID and detailed information.

[0022] The managed ID is a managed identifier used to identify each managed object. The detailed information is the content of the managed item. For example, in the case of a managed item T1 such as a worker, it includes the name, affiliation, etc. In this embodiment, the detailed information is the information contained in the form used when entering the construction site (new entrant confirmation form, etc.). However, since the form used when entering the construction site is not always used, the detailed information may be obtained by other methods, as will be described later. Furthermore, the detailed information may also include a photograph of the worker. In addition, in the case of a managed item T2 such as equipment, the detailed information may include information on its delivery to the construction site (name, manufacturer, management company, specifications, dimensions, weight, material, and other attribute information, etc.).

[0023] As shown in Figure 4, camera information 230 is recorded in the camera information storage unit 23. This camera information 230 is recorded after the surveillance camera 30 is installed and information about the surveillance camera 30 is registered. The camera information 230 includes the camera ID and placement information. The camera ID is an identifier used to identify each surveillance camera 30. The placement information indicates the location within the construction site where this surveillance camera 30 is installed.

[0024] As shown in Figure 5, the location information storage unit 24 records location management information 240 of the managed object. In this embodiment, location management information 240 is recorded when the location of the managed object is identified. This location management information 240 records the managed object ID, the date and time of reading, and the reading location.

[0025] The managed ID is an identifier used to identify the managed object. The reading date and time is the date and time when the location of this managed object was identified. The reading position is information about the location of the camera that captured the image identifying the target. In this embodiment, the camera ID of the surveillance camera 30 is used. Alternatively, the placement information corresponding to the camera ID recorded in the camera information storage unit 23 may be used.

[0026] (Initial registration process) Next, the initial registration process will be explained using Figures 6 and 7.

[0027] First, let's explain how to register the managed user T1. In this case, as shown in Figure 6, this embodiment describes an example in which a confirmation form 500 for new entrants is used. The confirmation form 500 can be any existing form that can obtain information about new entrants, for example, a new entrant training form can also be used. The confirmation form 500 includes a detailed entry field 501, a confirmation form code image 502, and a code image sticker 503. The detailed entry field 501 contains information about new entrants required when entering the construction site. For example, it includes information such as affiliated company, occupation, name, gender, date of birth, current address, emergency contact information, employment status, health status, licenses held, and safety confirmation items. The same code image is printed on the confirmation form code image 502 and the code image sticker 503. The code image sticker 503 is removable from the confirmation form 500 and has adhesive applied to the back. Note that multiple code image stickers 503 may be printed. Furthermore, while the size of the confirmation slip code image 502 and the code image sticker 503 are not limited, making the code image sticker 503 larger can improve visibility from a distance. This code image sticker 503 is then affixed to the helmet H1 used by the worker (new entrant), who is the person being managed T1. In this case, since the surveillance camera 30 is positioned above, it is affixed to a position visible from above, such as the top of the helmet H1. However, the affixing position of the code image sticker 503 is not limited to the top, as long as it is in a position that is easily visible from the surveillance camera 30.

[0028] Furthermore, for the registration of managed items T2 such as equipment and materials, a confirmation slip (delivery information) is obtained when the managed items are delivered. This confirmation slip contains detailed information about the managed items T2. Then, the code image sticker on the confirmation slip is peeled off and affixed to the managed items T2 such as equipment and materials.

[0029] Then, as shown in Figure 7, the control unit 21 of the management device 20 executes the process of acquiring detailed information (step S101). Specifically, the administrator reads the confirmation slip code image 502 of the confirmation slip 500 using the code reader 25. In this case, the management processing unit 211 of the control unit 21 obtains the managed item ID by decoding the confirmation slip code image 502. Next, the management processing unit 211 outputs a new registration screen to the display device H13. The managed item ID may also be entered manually. Then, the administrator enters the contents recorded in the detailed entry field 501 of the confirmation slip 500 into the registration screen.

[0030] Next, the control unit 21 of the management device 20 executes the registration process for the managed object (step S102). Specifically, the management processing unit 211 of the control unit 21 generates managed object information 220, which includes the detailed information entered on the registration screen and the managed object ID, and records it in the managed object storage unit 22.

[0031] (Code recognition processing) The code recognition process will be explained using Figure 8. This process is executed when images (still images) are periodically acquired from the surveillance camera 30.

[0032] First, the control unit 11 of the field device 10 performs a code search process (step S201). Specifically, the recognition processing unit 111 of the control unit 11 checks for the presence or absence of a code image in the captured image acquired from the surveillance camera 30 using image recognition.

[0033] Next, the control unit 11 of the field device 10 performs a determination process to determine whether a code is included (step S202). Specifically, the recognition processing unit 111 of the control unit 11 determines that a code is included if it detects a code region image with a high probability of being a code image through image recognition. For example, even if only a part of the code image is included, or if the resolution is low and it cannot be decoded, if a code region image is detected, it is determined that a code is included.

[0034] If it is determined that no code is present (i.e., "NO" in step S202), the code recognition process is terminated. On the other hand, if it is determined that a code is present (if the answer is "YES" in step S202), the control unit 11 of the field device 10 performs a determination process to determine whether the managed object can be identified (step S203). Specifically, the recognition processing unit 111 of the control unit 11 attempts to decode the code image in the code region image included in the captured image. If the managed object ID can be decoded, the recognition processing unit 111 checks whether the decoded managed object ID is recorded in the managed object storage unit 22. If the decoded managed object ID is recorded in the managed object storage unit 22, it is determined that the managed object can be identified. On the other hand, if decoding is not possible, or if the decoded managed object ID is not recorded in the managed object storage unit 22, it is determined that the managed object cannot be identified.

[0035] If it is determined that the managed object can be identified (if the answer is "YES" in step S203), the control unit 11 of the field device 10 executes a registration process (step S204). Specifically, the recognition processing unit 111 of the control unit 11 sends a read notification to the management device 20. This read notification includes information about the acquired managed object ID and camera ID. In this case, the management processing unit 211 of the control unit 21 of the management device 20 obtains the current date and time from the system timer. The management processing unit 211 then generates location management information 240 that records the read date and time (current date and time), managed object ID, and camera ID, and records it in the location information storage unit 24.

[0036] On the other hand, if it is determined that the managed object cannot be identified (if the answer is "NO" in step S203), the control unit 11 of the field device 10 performs integration processing (step S205). Here, if the code region image is set in memory as a code tracking target, the code region images included in images taken consecutively within a predetermined time from the same surveillance camera 30 are integrated. Then, an attempt is made to identify the managed object ID using the integrated image. Details will be described later with reference to Figure 9.

[0037] Even in the integrated processing (step S205), if the managed object cannot be identified, the control unit 11 of the field device 10 performs image processing (step S206). Here, multiple processed images are generated by image processing such as changing the brightness and enlarging the captured image and the integrated image. Then, an attempt is made to identify the managed object ID using the processed images. Details will be described later with reference to Figure 10.

[0038] In the image processing (step S206), if the managed object cannot be identified, the control unit 11 of the field device 10 performs a partial search (step S207). Here, the processed image is used to search for managed object information 220 that partially matches the code image of the managed object ID recorded in the managed object storage unit 22. Details will be described later with reference to Figure 11.

[0039] Next, the control unit 11 of the field device 10 performs the code tracking target setting process (step S208). Specifically, the recognition processing unit 111 of the control unit 11 sets the code region images for which the target could not be identified as code tracking targets in memory. In this case, object tracking technology (known technology) in consecutive images is applied to the code images. With this setting, the recognition processing unit 111 stores multiple consecutive captured images in memory for common code images. If the target can be identified, the recognition processing unit 111 resets the memory. If the code region image is lost in consecutive captured images due to disappearance or other reasons, the recognition processing unit 111 terminates tracking for that code region image and resets the memory.

[0040] (Integration process) The integration process (step S205) will be explained using Figure 9. Here, the control unit 11 of the field device 10 performs a determination process to determine whether there are multiple images (step S301). Specifically, the recognition processing unit 111 of the control unit 11 checks whether a code region image set as a code tracking target is recorded in the memory.

[0041] If it is determined that there are no multiple images (i.e., "NO" in step S301), the control unit 11 of the field device 10 returns to the code recognition process (Figure 8). If it is determined that there are multiple images (if the answer is "YES" in step S301), the control unit 11 of the field device 10 performs integration processing of the multiple images (step S302). Specifically, the recognition processing unit 111 of the control unit 11 combines the code region images that are set in memory as code tracking targets. In this case, the position of each code region image in the code image is estimated according to the image pattern of the code image, and the multiple code region images are combined to generate an integrated image. Alternatively, high dynamic range synthesis may be performed to combine multiple photographs with different brightness levels.

[0042] Next, the control unit 11 of the field device 10 performs a determination process to determine whether the managed object can be identified (step S303). Specifically, the recognition processing unit 111 of the control unit 11 attempts to decode the code image using the integrated image. If the decoded managed object ID is recorded in the managed object storage unit 22, it is determined that the managed object can be identified.

[0043] If it is determined that the target to be managed can be identified (if the answer is "YES" in step S303), the control unit 11 of the field device 10 performs the registration process in the same manner as in step S204 (step S304). On the other hand, if it is determined that the target object cannot be identified (i.e., "NO" in step S303), the control unit 11 of the field device 10 returns to the code recognition process.

[0044] (Image processing) The image processing (step S206) will be explained using Figure 10.

[0045] Here, the control unit 11 of the field device 10 performs image processing (step S401). Specifically, the recognition processing unit 111 of the control unit 11 generates multiple processed images by performing image processing such as changing the brightness of the code region image and the integrated image of the captured image, and enlarging them.

[0046] Next, the control unit 11 of the field device 10 performs a determination process to determine whether the managed object can be identified (step S402). Specifically, the recognition processing unit 111 of the control unit 11 attempts to decode the code image using the processed image. If the decoded managed object ID is recorded in the managed object storage unit 22, it is determined that the managed object can be identified.

[0047] Next, if it is determined that the target to be managed can be identified (if the answer is "YES" in step S402), the control unit 11 of the field device 10 performs the registration process in the same manner as in step S204 (step S403). On the other hand, if it is determined that the target object cannot be identified (i.e., "NO" in step S402), the control unit 11 of the field device 10 returns to the code recognition process.

[0048] (Partial search processing) The partial search process (step S207) will be explained using Figure 11.

[0049] Here, the control unit 11 of the field device 10 performs a search process using a portion of the code image (step S501). Specifically, the recognition processing unit 111 of the control unit 11 matches the code region image, integrated image, and processed image of the captured image with the code image of the managed ID recorded in the managed ID storage unit 22. Then, it searches for managed IDs whose matching rate between the two is equal to or greater than a certain threshold value.

[0050] Next, the control unit 11 of the field device 10 performs a determination process to determine whether it was identified by a partial match (step S502). Specifically, the recognition processing unit 111 of the control unit 11 determines that it was identified by a partial match if the match rate is above a certain threshold and a single managed ID is obtained.

[0051] If it is determined that the item has been identified by a partial match (if the answer is "YES" in step S502), the control unit 11 of the field device 10 executes the registration process in the same manner as in step S204 (step S503). On the other hand, if it is determined that the target object cannot be identified (i.e., "NO" in step S502), the control unit 11 of the field device 10 returns to the code recognition process.

[0052] (Display processing) The display process will be explained using Figures 12 to 14. This process is executed when a display request is received.

[0053] Here, the control unit 21 of the management device 20 performs the process of identifying the managed ID (step S601). Specifically, the display processing unit 212 of the control unit 21 identifies the managed ID in the managed storage unit 22.

[0054] Then, the control unit 21 of the management device 20 executes a process to acquire the most recent location for each identified managed object ID (step S602). Specifically, the display processing unit 212 of the control unit 21 extracts location management information 240 in which the managed object ID is recorded from the location information storage unit 24. Next, the display processing unit 212 identifies the location management information 240 with the most recent reading date and time. Next, the display processing unit 212 identifies the camera ID of the identified location management information 240. Then, the display processing unit 212 temporarily stores the reading date and time and the managed object ID in memory in association with the camera ID.

[0055] Next, the control unit 21 of the management device 20 performs the display processing of location information (step S603). Specifically, the display processing unit 212 of the control unit 21 generates a location management screen for each camera ID, arranging the managed objects in chronological order based on the most recent reading date and time. In other words, the managed objects that have passed by most recently are displayed first. In this case, the display processing unit 212 changes the display format of the managed objects according to the detailed information recorded in the managed object storage unit 22. Then, the display processing unit 212 outputs the location management screen to the display device H13 of the management device 20.

[0056] In this case, as shown in Figure 13, the location management screen 600 is displayed. On this location management screen 600, an icon corresponding to the type of managed object is displayed for each surveillance camera. For example, for managed person T1, an icon 610 including a person's image is displayed. Furthermore, each icon 610 changes its display form according to the details recorded in the managed object information 220. For example, the frame and background patterns are changed according to the affiliation. Also, for managed objects T2 such as equipment, the icon 611 is changed according to the type recorded in the details of the managed object information 220.

[0057] Then, as shown in Figure 14, if the managed object moves, the location management screen 600 is changed. In this case, since the equipment has moved from the 1st floor entrance to the side of the 1st floor elevator, the display position of icon 611 has been changed.

[0058] According to this embodiment, the following effects can be obtained. (1) In this embodiment, a surveillance camera 30 is used to capture a code image of the managed object. This makes it possible to manage the location of the managed object simply by attaching the code image to it. If location management is performed by attaching a communication device to the managed object, it requires the effort of attaching and maintaining the communication device. On the other hand, using a code image is low-cost and requires no maintenance.

[0059] (2) In this embodiment, the managed information 220 is recorded in the managed information storage unit 22. This managed information 220 records information about the managed persons T1 and managed objects T2. This makes it possible to unifiedly manage managed persons T1 (workers, etc.) and managed objects T2 (materials, equipment, etc.) located on-site, including past data, as managed objects. By unified management, it is possible to identify workers and equipment that entered, brought in, or were located at the same time period.

[0060] (3) In this embodiment, a confirmation form 500 is used. The confirmation form 500 includes a detailed entry field 501, a confirmation form code image 502, and a code image sticker 503. This allows information about the managed object to be registered in the managed object storage unit 22 using the detailed entry field 501 and the confirmation form code image 502. Furthermore, since the code image sticker 503 is attached to the managed object, it is possible to prevent mis-attachment. It is also possible to register detailed information in the managed object storage unit 22 using the confirmation form code image 502 after attaching the code image sticker 503 to the managed object.

[0061] (4) In this embodiment, if it is determined that the target to be managed can be identified (if the answer is "YES" in step S203), the control unit 11 of the field device 10 executes a registration process (step S204). This makes it possible to record the location of the target to be managed in accordance with the location of the surveillance camera 30.

[0062] (5) In this embodiment, the control unit 11 of the field device 10 performs integration processing (step S205). Here, the code image C1 is captured naturally without performing actions such as holding the code image C1 up to the surveillance camera 30. In this case, the entire image of the code image C1 may not be visible, or the shooting distance may be far and the image may not be clear. Through integration processing, even if only a portion of the code image is captured in the captured image, the original code image can be reconstructed by combining the partial images. Furthermore, the reproducibility of the image can be improved by high dynamic range synthesis. Then, the object to be managed can be identified by the integrated image.

[0063] (6) In this embodiment, the control unit 11 of the field device 10 performs image processing (step S206). Since the code image C1 is captured naturally using the surveillance camera 30, the code image can be made clearer even if the image is not clear. Then, the cleared processed image can be used to attempt to identify the target of management.

[0064] (7) In this embodiment, the control unit 11 of the field device 10 performs a partial search process (step S207). This allows the surveillance camera 30 to capture the code image C1 in a natural manner, and even if only a portion of the code image is captured, it is possible to attempt to identify the target object.

[0065] (8) In this embodiment, the control unit 11 of the field device 10 performs a code tracking target setting process (step S208). This allows for the collection of multiple images of the same code image to attempt to identify the target even when the target cannot be identified. (9) In this embodiment, the control unit 21 of the management device 20 executes the process of identifying the managed ID (step S601) to displaying the location information (step S603). This makes it possible to check the location of the managed items in chronological order.

[0066] This embodiment can be implemented with the following modifications. This embodiment and the following modifications can be combined with each other to the extent that they do not contradict each other technically. In the above embodiment, the location of the managed objects is managed at the construction site. The present invention is not limited to construction sites and can be used in any location where multiple managed objects are present. In the above embodiment, if it is determined that the managed object can be identified (if the answer is "YES" in step S203, etc.), the control unit 11 of the field device 10 executes a registration process (step S204, etc.). Here, if the managed object is recorded in the managed object storage unit 22, it is determined that the managed object can be identified. Alternatively, the registration process may be executed if the managed object ID can be identified. In this case, the managed object ID is generated according to a predetermined code creation rule. Then, when a managed object ID that satisfies the code creation rule is identified, the location registration process is executed. This makes it possible to manage the location of the managed object ID even if the managed object is not recorded in the managed object storage unit 22. For example, by maintaining historical data of location information of people and objects for which detailed information has not yet been entered in chronological order, the location of a specific person or object can be reflected when detailed information is entered later. In the above embodiment, a field device 10 and a management device 20 are used as hardware, but the system is not limited to these. It is sufficient if the code image attached to the managed object (person or object) is read by the surveillance camera 30 and time-series information about the location of the managed object is managed.

[0067] In the above embodiment, the control unit 11 of the field device 10 acquires still images from the surveillance camera 30. However, video may also be acquired from the surveillance camera 30. In this case, the video is divided into scenes, and multiple still images are acquired.

[0068] In the above embodiment, the control unit 11 of the field device 10 performs integration processing (step S205), image processing (step S206), and partial search processing (step S207). The processing method for recognizing the managed object is not limited to these. For example, some of these processes or other processes may be combined. The order of processing is also not limited.

[0069] In the above embodiment, the managed object is registered in the managed object storage unit 22 using a confirmation form 500 which includes a detail entry field 501, a confirmation form code image 502, and a code image sticker 503. The registration method is not limited to this. For example, when detailed information of the managed object is entered, one or more code image stickers 503 may be printed. In this case, the management device 20 may acquire and register the detailed information via a network or the like.

[0070] In the above embodiment, a QR code is used as the code image. The code image is not limited to a QR code; a barcode may also be used. Alternatively, a string of characters may be used as the code image. In this case, the recognition processing unit 111 recognizes the managed ID by character recognition.

[0071] In the above embodiment, the location is determined using a surveillance camera 30. The imaging means is not limited to a surveillance camera as long as the location can be determined. For example, an imaging device may be installed on a mobile body such as a drone or AGV. In this case, the mobile body uses a location information acquisition means (GNSS, etc.) to determine its current location as camera placement information and updates the camera information 230 in the camera information storage unit 23.

[0072] In the above embodiment, the control unit 11 of the field device 10 performs image processing (step S401). Specifically, the recognition processing unit 111 of the control unit 21 generates multiple processed images by image processing such as changing the brightness and enlarging the captured image and the integrated image. The image processing is not limited to changing the brightness and enlarging. For example, super-resolution technology to increase the resolution of the image may be used.

[0073] Furthermore, the field device 10 may instruct the surveillance camera 30 on shooting conditions such as magnification and exposure adjustment (ISO sensitivity, aperture value, shutter speed). In the case of magnification, the position of the code region image is specified.

[0074] In the above embodiment, the managed information 220 is recorded in the managed information storage unit 22. The managed information storage unit 22 may also record information indicating the validity of the managed information 220 (validity flag). The validity flag is recorded when the managed information 220 is registered for entry into or delivery to the construction site. The validity flag is deleted when the work of the managed person T1 at the construction site is completed, or when the managed object T2, such as equipment and materials, is removed from the construction site.

[0075] Then, in the display process, the display format is changed depending on whether or not the valid flag is present. For example, in the process of identifying the managed ID (step S601), the display processing unit 212 extracts the managed information 220 in which the valid flag is recorded from the managed storage unit 22 and identifies the managed ID. Furthermore, if the location management information 240 includes a managed ID for which the valid flag is not recorded, the recognition processing unit 111 may display it in a way that alerts the user.

[0076] In the above embodiment, the control unit 21 of the management device 20 performs the process of identifying the managed ID (step S601) and, for each identified managed ID, the process of obtaining the most recent location (step S602). In this case, only location management information 240 whose reading date and time falls within the extraction period may be extracted. Alternatively, the specified extraction period may be obtained in the display request.

[0077] Alternatively, the managed ID may be identified after the location management information 240 has been extracted. In this case, first, the location management information 240 for a predetermined period is extracted from the location information storage unit 24. If location management information 240 with the same managed ID is extracted, the most recent location management information 240 is used.

[0078] In the above embodiment, the control unit 21 of the management device 20 performs location information display processing (step S603). For each surveillance camera 30, a location management screen is displayed, arranging the managed items in order of the most recent reading date and time. The display format is not limited to this. For example, location information (arrangement of surveillance cameras 30) may be output for each managed item. Furthermore, on the location management screen 600, an icon corresponding to the type of managed object is displayed for each surveillance camera. The display format of the managed object's location information is not limited to this. For example, it may be possible to set individual names and facial photographs.

[0079] Next, the technical concepts that can be understood from the above embodiments and alternative examples are described below. (a) The information processing system according to claim 1, characterized in that the control unit estimates the position of each code region image in the code image according to the image pattern of the code image, and combines a plurality of the code region images to generate an integrated image.

[0080] (b) The information processing system according to 1 or (a), characterized in that the control unit tracks the code region image. (c) Further comprising a managed storage unit in which managed identifiers are recorded, The information processing system according to 1, (a) or (b), characterized in that the control unit identifies the managed identifier contained in the captured image using the managed identifier recorded in the managed storage unit and the code region image showing a part of the code image.

[0081] (d) The information processing system according to (c), characterized in that the control unit generates a code image of the managed identifier recorded in the managed storage unit, matches the code image with the code area image to identify the managed identifier included in the captured image. [Explanation of Symbols]

[0082] 10...Field device, 11...Control unit, 111...Recognition processing unit, 20...Management device, 21...Control unit, 211...Management processing unit, 212...Display processing unit, 22...Managed storage unit, 23...Camera information storage unit, 24...Location information storage unit.

Claims

1. An information processing system comprising: a control unit that acquires captured images taken by a camera placed at a site; and a management storage unit that records the management identifier of the managed object at the site, The control unit, Obtain multiple images taken of the same code image, In each of the acquired captured images, identify the code region image in which a part of the code image is captured, The respective code region images are integrated, and the code image is decoded. An information processing system characterized in that, if the managed identifier cannot be identified by the above decoding, a code image of the managed identifier recorded in the managed storage unit is generated, and the generated code image is matched with the code area image to identify the managed identifier included in the captured image.

2. A method for reading a code image using an information processing system comprising: a control unit that acquires a captured image taken by a camera placed at the site; and a management storage unit that records the management identifier of the managed object at the site, The control unit, Obtain multiple images taken of the same code image, In each of the acquired captured images, identify the code region image in which a part of the code image is captured, The respective code region images are integrated, and the code image is decoded. If the managed identifier cannot be identified by the decoding, the information processing method is characterized by generating a code image of the managed identifier recorded in the managed storage unit, matching the generated code image with the code area image, and identifying the managed identifier included in the captured image.

3. A program for reading a code image using an information processing system comprising: a control unit that acquires a captured image taken by a camera placed on site; and a management storage unit that records the management identifier of the managed object at the site, The control unit, Obtain multiple images taken of the same code image, In each of the acquired captured images, identify the code region image in which a part of the code image is captured, The respective code region images are integrated, and the code image is decoded. An information processing program characterized in that, if the managed identifier cannot be identified by the above decoding, it generates a code image of the managed identifier recorded in the managed storage unit, matches the generated code image with the code area image, and functions as a means to identify the managed identifier contained in the captured image.

Images