Management apparatus, management system, and computer program

Abstract

To provide a management apparatus capable of managing a fixture flexibly and easily.SOLUTION: A management apparatus 1, for managing a fixture 200 stored in a depository 300, is configured to extract a first photographic image including an identifying image 201 of a fixture 200 from one or more photographic images taken by a camera 3, 3A, 3B, 3C, 3D moving within the depository and execute processing for managing the fixture using date and hour of photographing of the first photographic image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a management device, a management system, and a computer program. [Background technology]

[0002] As management systems for equipment and the like, for example, Japanese Patent Laid-Open Publication No. 9-2621 (hereinafter referred to as Patent Document 1) and International Publication No. 2023 / 162092 (hereinafter referred to as Patent Document 2) attach IC tags equipped with ICs (Integrated Circuits) to the items to be managed. In Patent Documents 1 and 2, a reader is placed at a specific position to read the IC tag, thereby detecting the passage of the managed object through a specific position. This allows the movement and presence of the managed object to be managed to be managed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 9-2621 [Patent Document 2] International Publication No. 2023 / 162092 Summary of the Invention

[0004] The methods of Patent Documents 1 and 2 manage the passage of equipment at the location where the reader is installed, but do not provide flexible management, such as determining whether or not equipment is present in the hangar, where the equipment is located in the hangar, or whether any equipment may have been lost from the hangar. Furthermore, since electronic components such as IC tags must be attached to the equipment, they are expensive and may be affected by environmental factors such as water and metal, making them unusable depending on the hangar environment. Therefore, one of the objectives of the present disclosure is to provide a management device, management system, and computer program that can flexibly and easily manage equipment.

[0005] According to one embodiment, the management device is a management device that manages equipment stored in a hangar, and is configured to extract a first captured image containing an identification image of the equipment from one or more captured images taken by a camera moving within the hangar, and perform processing for managing the equipment using the capture date and time of the first captured image.

[0006] According to one embodiment, the management system includes at least one camera that moves within the hangar, and a management device that manages equipment within the hangar using images captured by the camera. The management device is configured to extract a first image containing an identification image of the equipment from the one or more images, and to perform processing for managing the equipment using the capture date and time of the first image.

[0007] According to one embodiment, a computer program causes a computer to function as a management device for managing equipment in a hangar, the computer program causing the computer to extract a first captured image including an identification image of the equipment from one or more captured images taken by a camera moving within the hangar, and to perform processing for managing the equipment using the capture date and time of the first captured image.

[0008] Further details will be described in the following embodiments. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram of a management system according to an embodiment. [Figure 2] FIG. 2 is a schematic diagram showing an example of the configuration of a management device included in the management system, and a diagram showing an example of information about captured images stored in an image information memory. [Figure 3] FIG. 3 is a flowchart showing an example of the flow of the storage process in the management system. [Figure 4]FIG. 4 is a schematic diagram showing an example of an operation screen of an operation device included in the management system and an example of transition of the operation screen. [Figure 5] FIG. 5 is a schematic diagram showing an example of an operation screen of an operation device included in the management system and an example of transition of the operation screen. [Figure 6] FIG. 6 is a flowchart showing an example of the flow of management processing in the management system. [Figure 7] FIG. 7 is a flowchart showing an example of the flow of management processing in the management system. DETAILED DESCRIPTION OF THE INVENTION

[0010] <1. Overview of the management device, management system, and computer program> (1) The management device according to the embodiment is a management device that manages equipment stored in a hangar, and is configured to extract a first captured image containing an identification image of the equipment from one or more captured images taken by a camera moving within the hangar, and to perform processing for managing the equipment using the capture date and time of the first captured image.

[0011] A hangar is not limited to a warehouse, but refers to any space where equipment is stored, such as an office, a house, or a room. An identification image refers to an image taken by a camera from each piece of equipment, containing characteristic elements that can uniquely identify each piece of equipment. The characteristic elements include, for example, (1) an equipment ID (identification) that is uniquely assigned to the equipment, or (2) a shape characteristic that is the shape of at least a part of the equipment and can uniquely identify the equipment.

[0012] The management device of the embodiment can flexibly manage equipment stored in a hangar, such as whether or not there is equipment in the hangar, where the equipment is located in the hangar, or whether there is any equipment that may be missing from the hangar, by performing processing for managing equipment using at least the shooting date and time of the first photographed image extracted from the photographed images taken by a camera moving within the hangar.

[0013] Furthermore, because the management device according to the embodiment extracts the first captured image using an identification image of the equipment, there is no need to attach electronic components such as IC tags to the equipment. This reduces the cost of managing equipment compared to using electronic components, and allows for easy management without or with minimal environmental influences such as water or metal.

[0014] (2) In the management device of (1), preferably, the processing for managing the equipment includes determining the location in the hangar of the camera that took the second image, which has the most recent date and time of shooting among the extracted multiple first images. The location in the hangar of the camera that took the second image corresponds to the location where the equipment was photographed by the camera. By determining the location, the user can know when and where the equipment was last photographed. This allows the user to narrow down the area where the equipment may be located when searching the hangar. This increases the chances of finding the equipment compared to searching the entire hangar indiscriminately, and improves the efficiency of the search.

[0015] (3) In the management device of (2), preferably, the camera that moves within the hangar is mounted on a moving object that moves within the hangar, and determining the position of the camera includes determining the position of the moving object at the time of shooting from information indicating the moving path of the moving object. This allows the position of the camera to be determined even if the camera moves within the hangar.

[0016] (4) In the management device of (1) to (3), preferably, the processing for managing equipment includes outputting the information in accordance with the time elapsed since the most recent photographed date and time of the extracted first photographed images. The shorter the time elapsed, the more likely the equipment is present in the storage facility. On the other hand, the longer the time elapsed, the more likely the equipment is missing, since the photographed images of the equipment have not been updated for a long time. Therefore, by outputting the information in accordance with the time elapsed, the user can detect the possibility that the equipment is present in the storage facility or that it has been lost.

[0017] (5) In the management device of (1) to (4), preferably, the process for managing the equipment includes extracting, from among the plurality of pieces of equipment, equipment for which the time elapsed since the most recent photographing date and time of each of the extracted plurality of first photographed images is equal to or greater than a threshold value. By extracting the equipment for which the time elapsed since the threshold value is exceeded, the user can detect equipment that is likely to be missing before realizing that the equipment is missing.

[0018] (6) The management device according to (1) to (5) is preferably further configured to receive input of photographed images from a camera moving within the hangar, and store information about a first photographed image extracted from the photographed images in memory. This allows the management device to execute processing for managing equipment using the information about the first photographed image stored in memory.

[0019] (7) A management system according to an embodiment includes at least one camera that moves within a hangar, and a management device that manages equipment within the hangar using images captured by the camera. The management device is configured to extract a first captured image containing an image for identifying the equipment from the one or more captured images, and execute a process for managing the equipment using the capture date and time of the first captured image. As a result, by using the management system according to the embodiment, equipment stored in the hangar can be flexibly managed as described above. Furthermore, by using the management system according to the embodiment, the costs required for equipment management can be reduced compared to using electronic components as described above, and equipment can be easily managed without or with minimal environmental influences such as water and metal.

[0020] (8) A computer program according to an embodiment is a computer program that causes a computer to function as a management device that manages equipment in a hangar. The computer program causes the computer to extract a first captured image containing an image for identifying the equipment from one or more captured images taken by a camera moving within the hangar, and execute a process for managing the equipment using the capture date and time of the first captured image. The computer program according to an embodiment allows the computer to flexibly manage the equipment stored in the hangar as described above. Furthermore, by causing the computer to function as a management device using the computer program according to an embodiment, it is possible to reduce the cost of managing equipment compared to using electronic components as described above, and to easily manage equipment without or with minimal environmental influences such as water and metals.

[0021] 2. Examples of management device, management system, and computer program [System Overview] FIG. 1 is a schematic diagram of a management system 100 according to an embodiment. The management system 100 has a management device 1 that manages equipment 200 in a hangar 300. The hangar 300 refers to a space in which the equipment 200 is stored, such as a warehouse, office, house, or living room. The management device 1 is configured to extract a captured image (first captured image) that includes an identification image 201 of the equipment 200 from one or more captured images taken by cameras 3, 3A, 3B, 3C, and 3D moving within the hangar 300, and to execute processing for managing the equipment 200 using at least the capture date and time of the first captured image.

[0022] [Identification image] The identification image 201 is an image captured by a camera from each piece of equipment 200, and includes characteristic elements that can uniquely identify each piece of equipment 200. These characteristic elements include, for example, (1) an equipment ID that is uniquely assigned to the equipment 200, or (2) a shape feature that is at least a part of the shape of the equipment 200 and can uniquely identify the equipment 200. The equipment ID (1) may be represented by human-readable characters, symbols, or numbers, or may be assigned to the equipment 200 in a manner that can be determined by computer processing, such as a barcode or QR code (registered trademark). The equipment ID may be printed on a sticker or the like and affixed to the equipment 200, or may be printed or engraved directly on the equipment 200. In the following examples, the characteristic elements are assumed to be (1) an equipment ID that is uniquely assigned to the equipment 200, and the equipment ID can be determined by computer processing, such as a barcode or QR code (registered trademark).

[0023] [System Configuration] The management system 100 includes at least one or more cameras 3, 3A, 3B, 3C, and 3D arranged in a hangar 300. The cameras 3, 3A, 3B, 3C, and 3D are also referred to as cameras 3, respectively. The cameras 3, 3A, 3B, 3C, and 3D move within the hangar 300 by being mounted on mobile bodies 2, 2A, 2B, 2C, and 2D that move within the hangar 300. The mobile bodies 2, 2A, 2B, 2C, and 2D are also referred to as mobile bodies 2, respectively.

[0024] The mobile object 2 may be any object that moves within the hangar 300. In the example of Fig. 1, the mobile object 2 is a stacker crane that moves within the hangar 300 and is equipped with a camera 3. The mobile object 2A is a transport robot that moves within the hangar 300 and is equipped with a camera 3B.

[0025] Other examples of the mobile object 2 may include a mobile object that automatically moves along a route defined according to a program, such as an inspection robot, a mobile object that automatically moves along a route according to a program in response to environmental conditions such as obstacles and sounds, such as a cleaning robot or a pet robot, or a mobile object that moves along a route specified by a user operation, such as a food delivery robot. Furthermore, the mobile object 2 may be a mobile object that can move three-dimensionally within the hangar 300, such as a stacker crane or a drone.

[0026] Furthermore, the moving object 2 may be a person, and the camera 3 may be carried by the person or mounted on an item carried or worn by the person. In the example of FIG. 1, the moving objects 2B, 2C, and 2D are staff members (people) and carry cameras 3B, 3C, and 3D, respectively. Camera 3B is a camera mounted on a smartphone carried by the staff member who is moving object 2B. Camera 3C is a small camera mounted on an employee ID card carried by the staff member who is moving object 2C. Camera 3D is a small camera mounted on glasses worn by the staff member who is moving object 2D.

[0027] The management system 100 may further include a fixed camera. In the example of Fig. 1, the camera 3-1 is a fixed camera, such as a surveillance camera attached to a wall or entrance of the hangar 300, a camera mounted on a computer installed in an office, or a camera mounted on a conference system. Furthermore, the fixed camera 3-1 may be portable, such as a PC for video conferencing, and may be fixed at the location where it is carried.

[0028] The management device 1 can communicate with a camera 3 and an image information memory 6, which will be described later. The management device 1 may communicate with these other devices via a communication network 4, such as an in-house network or the Internet. Alternatively, the management device 1 may communicate directly with these other devices wirelessly or via a wired connection. The management device 1 can also communicate with an operation device 5 and a route memory 7.

[0029] The operation device 5 is a general computer, a smartphone, or the like, and is used by a user of the management system 100 to operate the management device 1. The operation device 5 may be a device different from the management device 1, may be mounted on the management device 1, or may be one of the peripheral devices of the management device 1.

[0030] The route memory 7 stores, for each moving object 2, information indicating the moving route of the moving object 2. The information indicating the moving route includes at least the position and time, and is stored in the route memory 7 in association with the identifier of the moving object 2. The information indicating the moving route of the moving object 2 may be a moving route within the hangar 300 defined by a program, a route specified by a user operation, a schedule of staff, or location information of the moving object 2 measured using a GNSS (Global Navigation Satellite System) or a beacon. This makes it possible to determine when and where the moving object 2 was located. The route memory 7 may be a device different from the management device 1, may be mounted in the management device 1, or may be one of the peripheral devices of the management device 1.

[0031] When the management system 100 includes a fixed camera 3-1, the route memory 7 stores the location where the camera 3-1 is installed instead of the movement path of the mobile object 2. When the camera 3-1 is portable and fixed at the location where it is carried, the route memory 7 may store the movement path of the camera 3-1 as the movement path of the mobile object 2. For example, when the camera 3-1 is a PC for video conferencing, the movement path of the camera 3-1 may be the usage history of the PC for video conferencing.

[0032] 2 is a schematic diagram showing an example of the configuration of the management device 1, and a diagram showing an example of information about captured images stored in the image information memory 6. As an example, the management device 1 is configured by a computer having a processor 11 and a memory 12, or by a single computer and its peripheral devices. The management device 1 may also be realized by multiple computers working together.

[0033] The processor 11 is, for example, a CPU (Central Processing Unit). The memory 12 includes, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The memory 12 stores a program 121 to be executed by the processor 11.

[0034] The memory 12 has a camera information storage unit 123. The camera information storage unit 123 stores the moving object 2 on which the camera 3 is mounted in association with the camera 3, and as an example, stores the identifier of the camera 3 and the identifier of the moving object 2 on which the camera 3 is mounted in association with each other.

[0035] The processor 11 executes the program 121 to perform the storage process 111. The storage process 111 includes storing, in the image information memory 6, information about a captured image (first captured image) that includes the identification image 201 among the captured images captured by the camera 3.

[0036] The processor 11 executes the program 121 to perform the management process 112. The management process 112 refers to a process for managing the equipment 200 using the shooting date and time of the first captured image.

[0037] The management device 1 has a communication unit 13. The communication unit 13 is a communication module or the like. The communication unit 13 communicates with other devices via the communication network 4.

[0038] The communication unit 13 communicates with the camera 3, whereby the captured image captured by the camera 3 is input to the management device 1. The communication unit 13 also communicates with the route memory 7, whereby the management device 1 reads out information indicating the movement route of the moving object 2 stored in the route memory 7. The processor 11 uses the captured image input from the camera 3 and the information indicating the movement route of the moving object 2 stored in the route memory 7 in a storage process 111.

[0039] The communication unit 13 communicates with the operation device 5, and the operation device 5 instructs the management device 1 to execute the management process 112. Furthermore, the communication unit 13 communicates with the operation device 5, and the management device 1 outputs the result of the management process 112 to the operation device 5.

[0040] The image information memory 6 stores information about the captured images. The information about the captured images is stored in the image information memory 6 by the storage process 111. The information about the captured images includes, for each captured image (first captured image) including an identification image 201, the date and time of capture, an identifier of the fixture corresponding to the included identification image 201, an identifier of the camera 3 that captured the image, and a location where the image was captured. The image information memory 6 may also store the captured image itself including the identification image 201.

[0041] [Storage process] 3 is a flowchart showing an example of the flow of the storage process 111. When a photographed image is input from the camera 3 to the management device 1 (YES in step S101), the processor 11 checks whether the input photographed image includes an identification image 201, for example by performing pattern matching. If the identification image 201 is not read from the input photographed image (NO in step S103), the processor 11 does not perform the subsequent processes and returns to the beginning. As a result, in this example, information about photographed images that do not include the identification image 201 is not stored in the image information memory 6.

[0042] If the input captured image is a first captured image including an identification image 201 (YES in step S103), the processor 11 determines the fixture 200 corresponding to the read identification image 201 (step S105). More specifically, in step S105, the processor 11 reads the identification image 201 from the input captured image and obtains the fixture ID by extracting data from characteristic elements of the identification image 201. The process of extracting data from characteristic elements of the identification image 201 may be any of a variety of general processes, such as a process of restoring (decoding) data from a barcode or a QR code (registered trademark).

[0043] The processor 11 also determines the moving body 2 equipped with the camera 3 that captured the first captured image (step S107). In step S107, the processor 11 reads from the camera information storage unit 123 of the memory 12 the identifier of the moving body 2 equipped with the camera 3 that input the first captured image, which identifier is stored in association with the identifier of the camera 3.

[0044] The processor 11 determines the position of the photographing date and time of the first photographed image in the travel route stored in the route memory 7 for the moving body 2 determined in step S107 (step S109). In step S107, the processor 11 reads out the position of the moving body 2 at the photographing date and time of the first photographed image from information indicating the travel route stored in the route memory 7 of the memory 12 in association with the identifier of the moving body 2 read in step S107. The position of the moving body 2 determined in step S107 corresponds to the position of the camera 3 mounted on the moving body 2 at the photographing date and time of the first photographed image, i.e., the photographing location of the first photographed image. Therefore, in step S109, the processor 11 determines the photographing location of the first photographed image.

[0045] If the management system 100 includes a fixed camera 3-1, the processor 11 similarly stores information about the first captured image in the image information memory 6 when the identification image 201 is read for the captured image input from the camera 3-1. In step S109, the processor 11 determines the location where the camera 3-1 took the image by reading the installation position of the camera 3-1 from the route memory 7. If the camera 3-1 is a portable camera, in step S109 the processor 11 determines the location where the first captured image was taken by determining, from the route memory 7, the installation position of the camera 3-1 at the date and time the first captured image was taken.

[0046] The processor 11 stores the date and time of the first captured image, the identifier of the equipment 200 corresponding to the identification image 201 included in the first captured image, the identifier of the camera 3, and the location of the image capture as information about the first captured image in the image information memory 6 (step S111).

[0047] Processor 11 of management device 1 executes storage process 111 every time a captured image is input from camera 3. As a result, as shown in Fig. 2, information about a first captured image, which includes identification image 201, among the input captured images is stored in image information memory 6. Storing information about the first captured image in image information memory 6 enables processor 11 of management device 1 to execute management process 112 using the information about the first captured image stored in image information memory 6.

[0048] [Administrative Processing] Figures 4 and 5 are schematic diagrams showing an example of an operation screen of the operation device 5 and an example of the transition of the operation screen. Figures 6 and 7 are flowcharts showing an example of the flow of the management process 112. The operation screen 501 in Figure 4 includes an input field 51 for inputting an identifier (e.g., equipment ID) of the equipment 200 to be managed (hereinafter also referred to as the target equipment), a button 52 for instructing a process to track down the lost equipment, and a button 53 for instructing a process to check whether the equipment 200 is present in the storage facility 300.

[0049] When searching for equipment that has been lost (target equipment) from the storage 300, the user of the operation device 5 inputs the identifier of the target equipment in the input field 51 of the operation screen 501 and presses button 52. When checking whether the target equipment is present in the storage 300, the user of the operation device 5 inputs the identifier of the target equipment in the input field 51 of the operation screen 501 and presses button 53. When checking for equipment that may be lost among the equipment stored in the storage 300, the user of the operation device 5 presses button 53 without inputting the identifier of the target equipment in the input field 51 of the operation screen 501. When receiving an instruction from button 52 or an instruction from button 53, the operation device 5 inputs an operation signal to the management device 1. If the identifier of the target equipment has been input in the input field 51, the operation device 5 inputs an operation signal to the management device 1 together with the identifier of the target equipment.

[0050] The above-described operations by the user of the operation device 5 are merely examples, and other operations may be performed, and other operation screens may be used for the operation screen 501. For example, in addition to buttons 52 and 53, the operation screen 501 may further include a button for instructing a process to check for equipment that may be lost among the equipment stored in the storage facility 300.

[0051] When processor 11 of management device 1 receives an operation signal for button 52 together with the identifier of the target furniture (YES in step S201), it executes steps S205 to S209. When processor 11 receives an operation signal for button 53 together with the identifier of the target furniture (NO in step S201, YES in step S203, YES in step S204), it executes steps S211 to S219. When processor 11 receives an operation signal for button 53 without the identifier of the target furniture (NO in step S201, YES in step S203, NO in step S204), it executes steps S221 to S227 in Fig. 7. When processor 11 does not receive an operation signal for button 52 or 53, or when processor 11 receives an operation signal for button 52 without the identifier of the target furniture (NO in step S201, NO in step S203), it ends the series of processes.

[0052] When the operation signal of button 52 is received together with the identifier of the target fixture (YES in step S201), processor 11 extracts information about the first captured image including an identification image of the target fixture from image information memory 6 (step S205). In step S205, processor 11 reads information about the first captured image stored in association with the identifier of the target fixture from image information memory 6.

[0053] If information on a plurality of first captured images is extracted in step S205, processor 11 extracts the captured image with the most recent shooting date and time (second captured image) from the extracted plurality of first captured images (step S207). In step S207, processor 11 may determine the second captured image by rearranging the plurality of first captured images extracted in step S205 in order of shooting date and time. If information on a single first captured image is extracted in step S205, the second captured image matches the first captured image. Processor 11 outputs information on the second captured image to operation device 5 (step S209).

[0054] When an operation signal of button 53 is received together with the identifier of the target fixture (NO in step S201, YES in step S203, YES in step S204), processor 11 executes the same processes as in steps S205 and S207 (steps S211, S213).

[0055] The processor 11 performs output according to the time elapsed since the shooting date and time of the second captured image. Specifically, the processor 11 compares the time elapsed since the shooting date and time of the second captured image with a first threshold, and performs output according to the result. The first threshold may be today, for example. If the shooting date and time of the second captured image is today (YES in step S215), the processor 11 outputs the first display information to the operation device 5 (step S217). If the shooting date and time of the second captured image is not today (NO in step S215), the processor 11 outputs the second display information to the operation device 5 (step S219).

[0056] If the identifier of the target furniture item is not present and the operation signal of button 53 is received (NO in step S201, YES in step S203, NO in step S204), processor 11 executes the same processes as steps S205 and S207 for each furniture item identifier included in the information about the captured images stored in image information memory 6 (steps S221 and S223). That is, processor 11 extracts information about the first captured image for each furniture item (furniture identifier) ​​from the information about the captured images stored in image information memory 6 (step S221). For each furniture item, processor 11 extracts the captured image (second captured image) with the most recent image capture date and time from the multiple first captured images extracted in step S221 (step S223). For each second captured image obtained for each piece of furniture, processor 11 compares the time elapsed since the image capture date and time with a second threshold value and determines furniture items for which the time elapsed is equal to or greater than the second threshold value (step S225). The processor 11 outputs the third display information including the identifier of the fixture determined in step S225 to the operation device 5 (step S227).

[0057] The operation device 5, which has received information about the second captured image from the management device 1 in step S209, transitions the operation screen 501 to screen 502 in Fig. 4. Screen 502 is a screen that displays information about the second captured image, and includes a capture date / time display 54 and a capture location display 56. Display 54 is the most recent capture date / time of the target equipment 200, and display 56 is the most recent capture location of the target equipment 200.

[0058] By displaying screen 502 on the operation device 5, the user of the operation device 5 can know when and where the target equipment 200 was last photographed. This allows the user of the operation device 5 to narrow down the area in which the target equipment 200 may be present when searching for the target equipment 200 in the hangar 300. Therefore, the user of the operation device 5 can increase the possibility of discovery compared to searching the entire hangar 300 blindly, and can improve the efficiency of the search.

[0059] Preferably, the screen 502 includes a display 55 of the camera 3 that took the image. The display 55 is the camera that last took an image of the target equipment 200. If the camera 3 is carried by a staff member (person) or is mounted on an item carried or worn by the person, the screen 502 displayed on the operation device 5 allows the user of the operation device 5 to know the staff member who may have last seen the target equipment 200. This allows the user of the operation device 5 to ask the staff member who may have last seen the target equipment 200 about the target equipment 200, thereby increasing the possibility of finding the target equipment 200 and improving the efficiency of the search.

[0060] The operation device 5, which has received the first display information from the management device 1 in step S217, transitions the operation screen 501 to screen 503 in Fig. 4. Screen 503 is a screen that displays output according to the time that has passed since the shooting date and time of the second captured image, and includes display 54 of the shooting date and time and display 57 that is predefined when the shooting date and time is today. If the last shooting date and time is today, it is considered that there is a high possibility that the target equipment 200 is present in the hangar 300. Therefore, display 57 may, for example, display "Equipment present in hangar."

[0061] The operation device 5, which has received the second display information from the management device 1 in step S219, transitions the operation screen 501 to screen 503 in FIG. 4, and displays display 58 on screen 503 instead of display 57. If the photographed images of the target equipment 200 were updated daily, and the last photographed date and time was before today, this means that the updates of the photographed images have ceased. Therefore, it is possible that the target equipment 200 is no longer present in the storage facility 300. Therefore, display 58 may, for example, display "Possibly Lost."

[0062] By displaying screen 503, the user of the operation device 5 can detect whether or not there is a possibility that the target equipment 200 is present in the storage 300. In other words, when screen 503 includes display 57, the user of the operation device 5 can detect that there is a high possibility that the target equipment 200 is present in the storage 300. When screen 503 includes display 58, the user of the operation device 5 can detect that there is a possibility that the target equipment 200 has been lost from the storage 300.

[0063] The first threshold is not limited to today, and may be a period shorter than today (such as a few hours), or may be a period longer than today (such as two days). The first threshold may be set or changed by the user. The first threshold may be a different value for each piece of equipment. Two or more first thresholds may be used. In this case, the processor 11 causes the screen 503 to display a message indicating that the possibility of loss increases as the time that has passed since the date and time of the second captured image is longer.

[0064] The operation device 5, which has received the third display information from the management device 1 in step S227, transitions the operation screen 501 to screen 504 in Fig. 5. Screen 504 is a screen that displays, among the pieces of equipment included in the information about the captured images stored in the image information memory 6, pieces of equipment for which the time elapsed since the capture date and time of the second captured image is equal to or greater than the second threshold, and includes a display 59 of the identifier of the corresponding piece of equipment.

[0065] If the time elapsed since the last photograph of an item of equipment whose photographed images have been updated at time intervals within the second threshold is equal to or greater than the second threshold, it is possible that the item 200 is lost. Therefore, display 59 indicates an item of equipment that may be lost.

[0066] By displaying screen 504, the user of the operation device 5 can detect the possibly lost equipment 200 before realizing that the equipment 200 is lost. This allows the user of the operation device 5 to start searching for the equipment 200 before realizing that the equipment 200 is lost.

[0067] Preferably, screen 504 further includes button 52 for instructing processing to track the lost item as a target item. When processor 11 of management device 1 accepts the instruction from button 52 on screen 504, it executes steps S205 to S209. Alternatively, when processor 11 determines in step S225 that an item of equipment has been there for more than the second threshold, it may output third display information to operation device 5 to display screen 504, and automatically execute steps S205 to S209 with the determined item of equipment as a target item. This allows the user of operation device 5 to know, on screen 502, when and where a photograph was last taken of each item of equipment 200 that may be lost.

[0068] The second threshold may be the same as the first threshold, may be a shorter period than the first threshold, or may be a longer period than the first threshold. The second threshold may be set or changed by the user. The second threshold may be a different value for each piece of equipment. As with the first threshold, two or more second thresholds may be used.

[0069] In the management system 100, by performing a management process 112 using at least the date and time of the image taken by the camera 3 moving within the hangar 300, the management system 100 can flexibly manage the equipment 200 stored in the hangar 300, such as whether or not the equipment 200 is present within the hangar 300, where the equipment 200 is located within the hangar 300, or whether any equipment 200 may be missing from the hangar 300.

[0070] In the management system 100, an identification image 201 such as a barcode is attached to each piece of equipment 200, or at least a part of the shape of the equipment 200 is used as the identification image 201, and the management device 1 stores a one-to-one correspondence between the identification image 201 and the equipment 200. Therefore, there is no need to attach electronic components such as IC tags to the equipment 200, which reduces the cost required to manage the equipment 200 compared to using electronic components, and allows for easy management without being affected by the environment, such as water or metal, or with the environmental influence minimized.

[0071] [Variation 1] If the characteristic element of the identification image 201 is (1) an equipment ID uniquely assigned to the equipment 200, expressed in human-readable letters, symbols, or numbers, or (2) a geometric feature that is the shape of at least a part of the equipment 200 and can uniquely identify the equipment 200, the memory 12 stores the identification image 201 in association with the identifier of the equipment 200.

[0072] In this case, in step S105, the processor 11 reads from the memory 12 the identifier of the equipment 200 stored in association with the identification image 201 read from the input photographed image, and thereby determines the equipment 200 corresponding to the read identification image 201.

[0073] [Variation 2] In the above explanation, the results of the management process 112 are displayed on the operation device 5 as screens 502 to 504, but the output of the results of the management process 112 is not limited to display, and may be in other forms such as audio output or data output to a search system (not shown), or may be a combination of multiple output forms.

[0074] [Variation 3] The management device 1 may perform only one of the storage process 111 and the management process 112, and the other process may be performed by a different device. Therefore, the program 121 may include a program for the storage process 111 and a program for the management process 112, and these may be provided as separate programs.

[0075] The processor 11 of the management device 1 may execute only the storage process 111 in accordance with a program for the storage process 111. In this case, the management device 1 stores information about the first captured image including the identification image 201 in the image information memory 6 and can provide the image information memory 6 to another device. This allows the other device to execute the management process 112 using the information about the captured image in the image information memory 6. Alternatively, the processor 11 of the management device 1 may execute the management process 112 in accordance with a program for the management process 112. In this case, the management device 1 executes the management process 112 using information about the captured image stored in the image information memory 6 by the other device.

[0076] [Variation 4] The management system 100 may have an image memory (not shown) instead of the image information memory 6, and the images captured by the camera 3 may be stored in the image memory. In this case, the management process 112 includes extracting a first captured image including the identification image 201 from the captured images stored in the image memory. This allows the management system 100 to perform processing for managing equipment using an existing image memory in which captured images are stored.

[0077] <3. Notes> The present invention is not limited to the above-described embodiment, and various modifications are possible. [Explanation of symbols]

[0078] 1: Management device, 2, 2A to 2D: Mobile object, 3, 3A to 3D: Camera, 5: Operation device, 6: Image information memory, 7: Route memory, 11: Processor, 12: Memory, 100: Management system, 111: Storage processing, 112: Management processing, 121: Program, 200: Equipment, 201: Identification image, 300: Storage facility

Claims

1. A management device for managing equipment stored in a hangar, extracting a first photographed image including an identification image of the equipment from one or more photographed images taken by a camera moving within the hangar; and executing a process for managing the equipment using the photographing date and time of the first photographed image. Management device.

2. The processing for managing the equipment includes determining a location in the hangar of the camera that captured a second image having a most recent capture date and time among the extracted plurality of first captured images. The management device according to claim 1 .

3. the camera that moves within the hangar is mounted on a moving body that moves within the hangar, Determining the position of the camera includes determining the position of the moving object at the time of the image capture from information indicating a moving path of the moving object. The management device according to claim 2 .

4. The processing for managing the equipment includes outputting the extracted first photographed images in accordance with the time elapsed since the most recent photographed date and time. The management device according to claim 1 .

5. The processing for managing the equipment includes extracting, from the plurality of pieces of equipment, equipment for which the time elapsed since the most recent photographing date and time of each of the extracted plurality of first photographed images is equal to or greater than a threshold. The management device according to claim 1 .

6. moreover, Accepting input of a photographed image from the camera moving within the hangar; and storing information about the first captured image extracted from the captured images in a memory. The management device according to claim 1 .

7. at least one camera that moves within the hangar; a management device that manages the equipment in the hangar using the images taken by the camera, The management device extracting a first photographed image including an identification image of the fixture from the one or more photographed images; and executing a process for managing the equipment using the photographing date and time of the first photographed image. Management system.

8. A computer program that causes a computer to function as a management device that manages equipment in a hangar, extracting a first photographed image including an identification image of the equipment from one or more photographed images taken by a camera moving within the hangar; and executing a process for managing the equipment using the photographing date and time of the first photographed image. Computer program.

Images