Management system, information processing device, program, and management method
The management system addresses the challenge of flexible equipment failure response by using imaging and control units to detect operator-presented information, enhancing detection and response capabilities.
Patent Information
- Application Number
- JP2024004148
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-15
- Publication Date
- 2025-07-28
AI Technical Summary
Existing management systems struggle to respond flexibly to equipment failures in environments like factories and warehouses.
A management system that includes an imaging device to capture data and a control unit to detect presentation information from operators regarding equipment status, enabling flexible response to equipment failures through image analysis and status estimation.
Enables flexible detection and response to equipment malfunctions, including unforeseen defects, by combining human confirmation with image processing, thereby improving maintainability and resource efficiency.
Smart Images

Figure 2025110295000001_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to a management system, an information processing apparatus, a program, and a management method.
Background Art
[0002] Management systems are known for grasping and analyzing the operating status of equipment operating in factories, warehouses, etc. In this management system, technologies that can respond flexibly to various problems that may occur while the equipment is operating are required.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] The problem to be solved by the present disclosure is to provide a management system that can respond flexibly to equipment failures.
Means for Solving the Problems
[0005] The management system according to the embodiment includes an imaging device that images equipment and a control unit. The control unit detects presentation information presented by an operator regarding the operating status of the equipment from the imaging data imaged by the imaging device. The management system estimates the operating status based on the detected presentation information.
Brief Description of the Drawings
[0006]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
DETAILED DESCRIPTION OF THE INVENTION
[0007] <1. Embodiment> Hereinafter, each embodiment of the present disclosure will be described with reference to the drawings. In the present specification and each figure, the same reference numerals are given to the same elements as those already described, and the detailed description will not be repeated.
[0008] (1.1. Functional Configuration of the Management System 100) With reference to FIGS. 1 and 2, the functional configuration of the management system 100 according to the embodiment will be described. As shown in FIG. 1, the management system 100 includes a management device 10, a terminal device 20, a camera (imaging device) 30, and a marker 40.
[0009] The management device 10 is an information processing device (computer) that functions as a server as an example, and manages data related to the facility E to be managed. The management device 10 includes a control unit 11 and a storage unit 15. The control unit 11 controls the processing of the management device 10 as a processor. The storage unit 15 stores programs and data necessary for the processing of the control unit 11, data obtained by the processing of the control unit 11, and the like. As an example, the storage unit 15 stores a facility database 16 and a stop database 17. Details of each database will be described later.
[0010] The terminal device 20 includes input means and output means, and is an information processing device operable by an operator (hereinafter referred to as operator P) who uses the management system 100. The terminal device 20 may be a general-purpose or dedicated personal computer, a smart device, or the like. Note that smart devices include tablet terminals, smartphones, smart glasses, smart watches, and the like.
[0011] The camera 30 as an imaging device images the space R. The imaging data captured by the camera 30 may be a still image or a moving image. When the imaging data is a still image, the camera 30 may be configured to capture images at a predetermined timing (for example, at intervals of one minute) to generate imaging data. The imaging data captured by the camera 30 may be stored in the storage unit 15 for a predetermined period. Preferably, the management system 100 includes a plurality of cameras 30 that overlook the space R. The terminal device 20 and the camera 30 are connected to the management device 10 via wired communication, wireless communication, or a network, and can communicate data with the management device 10.
[0012] The space R is, as an example, a predetermined area in a factory. One or more combinations of the facility E, the signal device S, and the marker 40 are arranged in the space R. Inside the space R, the operator P operates the facility E to perform a predetermined task.
[0013] Facility E is a device or equipment that is operated for operator P to perform a predetermined operation. As an example, facility E may be a device for processing an object, a device for transporting an object, a device for processing information related to the object, equipment necessary for controlling these devices, etc.
[0014] The signaler S is a device that lights up according to the operating status of facility E. In this embodiment, the signaler S is a signal tower that emits signals by lighting up three colors of green, yellow, and red respectively according to the operating status of facility E, but it is not limited to this mode. The signaler S notifies the management device 10 of the content of the signal being transmitted.
[0015] The marker 40 is a display for operator P to present information regarding the operating status of facility E. As an example, the marker 40 may be a symbol display for operator P who has confirmed the operating status of facility E to display the information regarding the operating status with a predetermined symbol. Also, the marker 40 may be a character string display for operator P who has confirmed the operating status of facility E to display the information as a character string.
[0016] As shown in FIG. 2, for one facility E, one signaler S and one marker 40 are arranged. For one facility E, one or more operators P may be arranged, and for a plurality of facilities E, one or more operators P may be arranged. Operator P causes the marker 40 to display information regarding the operating status of facility E at a predetermined timing. Details of the processing by operator P will be described later.
[0017] (1.2. Data Structure) With reference to FIGS. 3 and 4, an example of the data structure of the database stored in the storage unit 15 will be described. As an example, the storage unit 15 may store a facility database 16 and a stop database 17.
[0018] The equipment database 16 is a database for storing information about the equipment 50. The equipment database 16 may include, as an example, an item "equipment number", an item "equipment name", an item "type", an item "status", and an item "update date and time".
[0019] The item "equipment number" is data as an identifier for uniquely identifying each record in the equipment database 16 and has the function of a primary key in the equipment database 16. Each record in the equipment database 16 corresponds to each piece of equipment E in the space R.
[0020] The item "equipment name" is information regarding the name of the equipment E corresponding to the record. The operator can appropriately set the name of the equipment E corresponding to each record in the equipment database 16.
[0021] The item "type" is information regarding the type of the equipment E corresponding to the record. The operator can, as an example, appropriately set the type based on the use or the manufacturer for each piece of equipment E.
[0022] The item "status" is information regarding the status of the equipment E corresponding to the record. The status of the equipment E includes the operating status of the equipment E, the response status to failures, etc.
[0023] The item "update date and time" is information about the date and time when the record was updated.
[0024] Each record in the equipment database 16 can be appropriately added or changed by the operator P. For example, at the timing when a new piece of equipment E is added in the space R, the operator P can operate the terminal device 20 to add a record to the equipment database 16. Also, the operator P can operate the terminal device 20 to update the item "status" of the record corresponding to the equipment E at the timing when the status of the equipment E is changed.
[0025] The stop database 17 is a database for storing information about cases where the facility E has stopped (hereinafter referred to as stop cases). As an example, the stop database 17 may have an item "stop number", an item "facility number", an item "stop type", an item "error type", an item "response status", and an item "occurrence date and time".
[0026] The item "stop number" is data as an identifier for uniquely identifying each record in the stop database 17 and has the function of a primary key in the stop database 17. Each record in the stop database 17 corresponds to a stop case of the facility E.
[0027] The item "facility number" has data for identifying the facility E in which the stop case corresponding to the record occurred. As an example, the item "facility number" holds the item "facility number" of the facility database 16 as a foreign key.
[0028] The item "stop type" is information regarding the type of the stop case corresponding to the record. As an example, for each stop case, "work exhaustion", "maintenance", "error", etc. may be set.
[0029] The item "error type" is information regarding the type of an abnormal state (error), which is an unexpected stop case among the stop cases that occurred in the facility E. Data is input only into records where the item "stop type" is "error" for the item "error type".
[0030] The item "response status" is information regarding the response status for stop cases where the stop type is "error". Data is input only into records where the item "stop type" is "error" for the item "response status".
[0031] The item "occurrence date and time" is information regarding the date and time when the stop case corresponding to the record occurred.
[0032] Each item in the stop database 17 is classified into stop information and abnormality information. The stop information includes the item "stop number", the item "facility number", the item "stop type", and the item "occurrence date and time". The abnormality information includes the item "error type" and the item "response status".
[0033] Each record in the stop database 17 can be appropriately added or changed by the operator. For example, when a stop event occurs in the facility E within the space R, the control unit 11 adds a record to the stop database 17 at the timing of the occurrence and inputs data into the items classified as stop information. In addition, after the operator P responds to the error that has occurred in the facility E, the operator inputs data into the items classified as abnormality information of the record corresponding to the error. Note that the above-described database is merely an example and is not limited to this mode. That is, the storage unit 15 may include other databases, and the facility database 16 or the stop database 17 may include other items.
[0034] (1.3. Flow of processing) With reference to FIGS. 5 to 10, an example of the flow of processing in the management system 100 will be described. As described above, in the present embodiment, the signal device S transmits signals by lighting three-color signals of green, yellow, and red according to the operating status of the facility E. The green signal means that the facility E is operating normally. The yellow signal means that a stop event that can be assumed within normal business has occurred in the facility E. The red signal means that an abnormal state, which is an unexpected stop event, has occurred in the facility E.
[0035] As shown in FIG. 5, in step S110, the facility E operates and normal operation is performed. In step S120, when the operation of the facility E ends (Yes in step S120), the processing in the management system 100 ends. On the other hand, when the facility E is operating (No in step S120), step S130 is performed.
[0036] In step S130, the control unit 11 of the management device 10 determines whether the signal transmitted by the signal device S is green. If the signal transmitted by the signal device S is green (Yes in step S130), it is assumed that the facility E is operating normally, and the process returns to step S110 to be repeated. On the other hand, if the signal transmitted by the signal device S is not green (No in step S130), that is, if the signal device S is transmitting a signal (yellow or red) indicating the stop of the facility E, the operating status estimation process (S500) is performed.
[0037] Referring to FIG. 6, the flow of the operating status estimation process (S500) will be described. In step S510, the operator P checks the operating status of the facility E. The operator P examines information regarding the operating status of the facility E in which a stop event has occurred (hereinafter referred to as operating information). The operating information may include information regarding the cause and countermeasures of the stop event that has occurred in the facility E.
[0038] In step S520, information is presented by the operator P. The operator P presents the operating information of the facility E confirmed in step S510 by displaying it on the marker 40. Specifically, for example, when the marker 40 is a symbol display, the operator P inputs the symbol corresponding to the operating information into the marker 40. Or, when the marker 40 is a character string display, the operator P inputs the character string for presenting the operating information into the marker 40.
[0039] More specifically, the marker 40 may include, for example, a magnetic panel and a magnetic board, and the operator P may input the operating information into the marker 40 by displaying a symbol or a character string on the magnetic board with the magnetic panel. Or, the marker 40 may include a white board, and the operator P may input the operating information into the marker 40 by writing a symbol or a character string with a board pen.
[0040] As an example, in Fig. 9(a), a symbol 41 indicating that a "failure" requiring repair has occurred in the facility E is arranged on the marker 40 as a symbol display. In Fig. 9(b), a symbol 41 indicating that a "work shift" has occurred in the facility E is arranged on the marker 40. In Fig. 9(c), a symbol 41 indicating that a "power supply failure" has occurred in the facility E is arranged on the marker 40. Thus, when using the marker 40 as a symbol display, it is preferable that the correspondence relationship between the operation information of the facility E and a predetermined symbol is determined in advance.
[0041] As another example, in Fig. 10(a), it is indicated by the character string 42 that a "failure" requiring repair has occurred in the facility E on the marker 40 as a character string display. In Fig. 10(b), it is indicated by the character string 42 that a "work shift" has occurred in the facility E on the marker 40. In Fig. 9(c), it is indicated by the character string 42 that a "power supply failure" has occurred in the facility E on the marker 40.
[0042] In step S530, the control unit 11 detects the presentation information presented by the operator regarding the operation status of the facility E from the imaging data captured by the camera 30. Specifically, the control unit 11 performs a well-known image analysis technique on the imaging data to detect the presentation information presented by the marker 40 in the imaging data.
[0043] As well-known image analysis techniques, for example, analysis techniques using machine learning can be cited. As an example, techniques such as convolutional neural network (CNN), R-CNN (Region-based Convolutional Neural Network), Faster R-CNN, YOLO (You Only Look Once), SSD (Single Shot MultiBox Detector) can be appropriately adopted. Or, as analysis techniques not using machine learning, techniques such as image filtering, SIFT (Scale-Invariant Feature Transform) or SURF (Speeded-Up Robust Features), feature extraction, shape recognition can be cited. By adopting one or more of these well-known image analysis techniques, the control unit 11 detects the presentation information presented by the operator P from the imaging data captured by the camera 30.
[0044] In step S540, the control unit 11 estimates the operating status of the facility E based on the detected presentation information. For example, when the presentation information includes a symbol indicating that a shortage (work shortage) of the work object has occurred in the facility E, the control unit 11 estimates the operating status of the facility E as "work shortage". Or, when the presentation information includes a character string indicating that an error, which is an unexpected stop event, has occurred, the control unit 11 estimates the operating status of the facility E as "error".
[0045] When the operation status estimation process (S500) ends, step S210 shown in FIG. 7 is executed. In step S210, the control unit 11 determines whether the signal transmitted by the signaler S is yellow. When the signal transmitted by the signaler S is yellow (Yes in step S210), step S220 is executed.
[0046] In step S220, the control unit 11 registers stop information. Specifically, the control unit 11 adds a record to the stop database 17 and inputs data regarding the stop event of the facility E estimated in the operation status estimation process (S500) into the items "stop number", "facility number", "stop type", and "occurrence date and time".
[0047] In step S230, since the signal transmitted by the signal device S is yellow, the facility E enters the standby state. In step S240, the control unit 11 determines whether the signal transmitted by the signal device S is green. If the signal transmitted by the signal device S is green (Yes in step S240), the process returns to step S110 and the processing is repeated. On the other hand, if the signal does not turn green (No in step S240), the process returns to step S230 and the processing is repeated.
[0048] On the other hand, in step S210, if the signal transmitted by the signal device S is not yellow (No in step S210), it is assumed that an abnormal state, which is an unexpected stop event, has occurred in the facility E (= the signal is red), and step S310 shown in FIG. 8 is performed.
[0049] In step S310, the control unit 11 registers stop information. Specifically, the control unit 11 adds a record to the stop database 17 and inputs data regarding the stop event of the facility E estimated in the operation status estimation process (S500) into the items "stop number", "facility number", "stop type", and "occurrence date and time".
[0050] In step S320, since an abnormal state, which is an unexpected stop event, has occurred in the facility E, the operator P performs abnormality handling for the facility E. As the abnormality handling, the operator P appropriately performs processing for unexpected situations such as the displacement of the workpiece generated in the facility E and the repair of the failure of the facility E.
[0051] In step S330, the operator P registers the abnormality information based on the abnormality handling performed in step S320. The control unit 11 registers the item "error type" and the item "handling status" for the record of the corresponding stop case in the stop database 17 based on the input operation of the terminal device 20 by the operator P. Then, the process returns to step S230, and the facility E enters the standby state, and the process is repeated. In this way, the process by the management system 100 is performed.
[0052] (1.4. Hardware Configuration) With reference to FIG. 11, the hardware configuration of the information processing apparatus used in the management apparatus 10 will be described. The management apparatus 10 and the terminal apparatus 20 as information processing apparatuses are realized by, for example, a computer 90 shown in FIG. 11. The computer 90 includes a CPU 91, a ROM 92, a RAM 93, a storage 94, an input interface 95, an output interface 96, and a communication interface 97.
[0053] The CPU 91 functions as a processor that executes processes. Specifically, the CPU 91 uses the RAM 93 as a work memory and executes a program stored in at least one of the ROM 92 or the storage 94. During the execution of the program, the CPU 91 controls each component via the system bus 98 and executes various processes.
[0054] The ROM 92 stores a program for controlling the operation of the computer 90. The ROM 92 stores programs necessary for causing the computer 90 to implement the above-described respective processes. The RAM 93 functions as a storage area in which the programs stored in the ROM 92 are expanded.
[0055] The storage 94 stores data necessary for the execution of the program and data obtained by the execution of the program. The storage 94 includes one or more selected from a Hard Disk Drive (HDD) and a Solid State Drive (SSD).
[0056] The input interface (I / F) 95 can connect the computer 90 and the input device 95a. The input interface 95 is, for example, a serial bus interface such as USB. The CPU 91 can read various data from the input device 95a via the input interface 95.
[0057] The output interface (I / F) 96 can connect the computer 90 and the output device 96a. The output interface 96 is, for example, a video output interface such as Digital Visual Interface (DVI) or High-Definition Multimedia Interface (HPMI (registered trademark)). The CPU 91 can transmit data to the output device 96a via the output interface 96 and cause the output device 96a to output the data.
[0058] The input device 95a includes one or more selected from a mouse, a keyboard, a microphone (voice input), and a touch pad. The output device 96a includes one or more selected from a display, a projector, a printer, and a speaker. A device having both functions of the input device 95a and the output device 96a, such as a touch panel, may be used.
[0059] The communication interface (I / F) 97 can connect the computer 90 and an external server 97a outside the computer 90. The communication interface 97 is, for example, a network card such as a LAN card. The CPU 91 can read various data from the external server 97a via the communication interface 97.
[0060] Each process executed by the management device 10 may be realized by one computer 90 or may be realized by the cooperation of a plurality of computers 90.
[0061] The processing of the various data described above may be recorded as a program executable by a computer on a magnetic disk (such as a flexible disk and a hard disk), an optical disk (such as a CD-ROM, CD-R, CD-RW, DVD-ROM, DVD±R, DVD±RW), a semiconductor memory, or other non-transitory computer-readable storage medium.
[0062] For example, the information recorded on the recording medium can be read by a computer (or an embedded system). In the recording medium, the recording format (storage format) is arbitrary. For example, the computer reads a program from the recording medium and causes the processor to execute the instructions described in the program based on this program. In the computer, the acquisition (or reading) of the program may be performed through a network.
[0063] (1.5. Parentheses) As described above, the management system 100 according to this embodiment includes a camera 30 that images the facility E and a management device 10 having a control unit 11. The control unit 11 detects the presentation information presented by the operator P regarding the operating status of the facility E from the imaging data captured by the camera 30, and estimates the operating status based on the detected presentation information. With such a configuration, it becomes possible to respond flexibly to equipment malfunctions.
[0064] Specifically, after the operator P checks the operating status of the facility E, the management system 100 can detect even defects that cannot be detected from the imaging data of the facility E because it detects the information presented by the operator P. Also, since the operator P is performing the confirmation work of the facility E, it is possible to detect defects that were not assumed in the operation of the facility E or defects that have never occurred before. In this way, in the management system 100, by combining the human processes such as the confirmation work and information presentation of the facility E by the operator P and the information processing such as detecting the information presented from the imaging data and estimating the operating status, it is possible to respond flexibly to the defects of the facility E.
[0065] Further, the control unit 11 may be configured to start detecting the presentation information when it detects that the signal device S that lights up according to the operating status of the facility E has transmitted a signal indicating the stop of the facility E. By adopting such a specification, the detection process of the presentation information by the control unit 11 can be limited to the minimum necessary, and the resources of the management system 100 can be saved.
[0066] Further, the presentation information may be the display of a symbol display presented by the operator P. In this way, by determining in advance the correspondence relationship between the operating status of the facility E and a predetermined symbol, it becomes easy for the operator P to quickly present the operating status.
[0067] Further, the presentation information may be the display of a character string display presented by the operator P. By adopting such a specification, it becomes easy for the operator P to accurately present any operating status.
[0068] Further, the management system 100 may further include a storage unit 15, and the control unit 11 may be configured to estimate information regarding the stop of the operation in the facility E as the operating status and register it in the storage unit 15. By adopting such a specification, it is possible to register without omission the stop cases that have occurred in the facility E, and the maintainability of the facility E can be improved.
[0069] Further, the control unit 11 may be configured to register information regarding an abnormal state in the facility input by the operator P in the storage unit 15. By adopting such a configuration, it becomes easy to register information regarding the abnormal state of the facility E handled by the operator P in association with the stop information, and the maintainability of the facility E can be improved. <2. Other Embodiments>
[0070] As described above, the management system 100 according to the present embodiment has been described. However, the application of the technical idea of the present disclosure is not limited to the above-described embodiment. For example, in step S320 of the above-described embodiment, the operator P uses the marker 40 as a symbol display or a character string display to present information regarding the operation of the facility E, but the present disclosure is not limited to this mode. For example, the operator P may present information regarding the operation of the facility E by the posture or movement of the operator P without using the marker 40. In this case, the control unit 11 detects the posture or movement of the operator P from the image information regarding the posture or movement of the operator P included in the imaging data captured by the camera 30 as presentation information.
[0071] As an example, in FIG. 12(a), it is presented that a "failure" requiring repair has occurred in the facility E due to the posture of the operator P. In FIG. 12(b), it is presented that a "work position deviation" has occurred in the facility E due to the posture of the operator P. In FIG. 12(c), it is presented that a "power supply failure" has occurred in the facility E due to the posture of the operator P. As described above, when presenting information regarding the operation of the facility E by the posture or movement of the operator P, it is preferable that the correspondence between the operation information of the facility E and the posture or movement of the operator P is determined in advance. Even with such a configuration, it is possible to apply the technical idea of the present disclosure.
[0072] In addition, in the above-described embodiment, the space R is assumed to be one continuous region, but it is not limited to this mode. For example, one or more cameras 30 may be installed in each of the spaces R1, R2, ..., Rn that span multiple floors, and these spaces R1, R2, ..., Rn may be collectively regarded as the space R.
[0073] In addition, the camera 30 as an imaging device may include different types of cameras. For example, the camera 30 may include a main wide-angle camera and a sub PTZ (Panoramic Tilt Zoom) camera. As an example, the entire space R may be imaged by the main wide-angle camera, and a marker 40 as a character display presented by the operator may be imaged by the sub PTZ camera. In this case, it may be configured to transmit the coordinates and shooting instructions of the marker 40 recognized by the main wide-angle camera to the sub PTZ camera, and image a high-definition image around the marker 40 with the sub PTZ camera.
[0074] In addition, in the above-described embodiment, the signaler S notifies the management device 10 of the content of the signal being transmitted, but it is not limited to this mode. For example, the management device 10 may be configured to determine the type of signal to be lit based on the state of the signaler S in the imaging data captured by the camera 30. In this case, the well-known image analysis technology described above may be appropriately adopted. In addition, the signaler S is not limited to a specification in which a predetermined signal is transmitted by lighting, and may be a specification in which the operating status of the facility E is transmitted by transmitting a predetermined voice.
[0075] The present disclosure may include the following features. (Appendix 1) In a management system including an imaging device that images a facility and a control unit, the control unit, detects presentation information presented by an operator regarding the operating status of the facility from imaging data captured by the imaging device, and estimates the operating status based on the detected presentation information, a management system. (Appendix 2) The control unit starts detecting the presentation information based on a signal indicating the stop of the facility sent by a signal device that lights up according to the operating status of the facility, in the management system described in Supplementary Note 1. (Supplementary Note 3) The presentation information is the display of a symbol display presented by the operator, in the management system described in Supplementary Note 1. (Supplementary Note 4) The presentation information is the display of a character string display presented by the operator, in the management system described in Supplementary Note 1. (Supplementary Note 5) The presentation information is the posture or movement of the operator presented by the operator, in the management system described in Supplementary Note 1. (Supplementary Note 6) Further comprising a storage unit, The control unit estimates information regarding the stop of operation in the facility as the operating status and registers it in the storage unit, in the management system according to any one of Supplementary Notes 1 to 5. (Supplementary Note 7) Further comprising a storage unit, The control unit registers information regarding an abnormal state in the facility input by the operator in the storage unit, in the management system according to any one of Supplementary Notes 1 to 5. (Supplementary Note 8) Detect presentation information presented by an operator regarding the operating status of the facility from imaging data captured by an imaging device that captures the facility, An information processing apparatus that estimates the operating status based on the detected presentation information. (Supplementary Note 9) A program for causing an information processing apparatus including a control unit to execute processing, In the control unit, A step of acquiring imaging data captured by an imaging device that captures the facility, A step of detecting presentation information presented by an operator regarding the operating status of the facility from the acquired imaging data, A step of estimating the operating status based on the detected presentation information, and causing the steps to be executed. (Appendix 10) A step of causing a control unit to acquire imaging data captured by an imaging device that images equipment, A step of causing a control unit to detect presentation information presented by an operator regarding the operating status of the equipment from the acquired imaging data, A method for managing equipment, which causes a control unit to execute a step of estimating the operating status based on the detected presentation information.
[0076] As described above, some embodiments of the present disclosure have been illustrated. However, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, changes, etc. can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and its equivalent scope. In addition, the above-described embodiments can be implemented in combination with each other.
Explanation of Reference Numerals
[0077] 10: Management device, 11: Control unit, 15: Storage unit, 16: Equipment database, 17: Stop database, 20: Terminal device, 30: Camera, 40: Marker, 41: Symbol, 42: Character string, 50: Equipment, 90: Computer, 91: CPU, 92: ROM, 93: RAM, 94: Storage, 95: Input interface, 95a: Input device, 96: Output interface, 96a: Output device, 97: Communication interface, 97a: External server, 98: System bus, 100: Management system.
Claims
1. In a management system comprising an imaging device for imaging equipment and a control unit, the control unit detects presentation information presented by an operator regarding the operating status of the equipment from the imaging data captured by the imaging device, and estimates the operating status based on the detected presentation information. A management system.
2. The management system according to claim 1, wherein the control unit starts detecting the presentation information based on detecting that a signal device that lights up according to the operating status of the equipment has transmitted a signal indicating the stop of the equipment.
3. The management system according to claim 1, wherein the presentation information is a display of a symbol display presented by the operator.
4. The management system according to claim 1, wherein the presentation information is a display of a character string display presented by the operator.
5. The management system according to claim 1, wherein the presentation information is the posture or movement of the operator presented by the operator.
6. Further comprising a storage unit, the control unit estimates information regarding the stop of operation in the equipment as the operating status and registers it in the storage unit. The management system according to any one of claims 1 to 5.
7. Further comprising a storage unit, the control unit registers information regarding an abnormal state in the equipment input by the operator in the storage unit. The management system according to any one of claims 1 to 5.
8. Detect presentation information presented by an operator regarding the operating status of the equipment from the imaging data captured by an imaging device for imaging the equipment, and estimate the operating status based on the detected presentation information. An information processing device.
9. A program for causing an information processing device including a control unit to execute processing, wherein the control unit performs a step of acquiring imaging data captured by an imaging device for imaging equipment, a step of detecting presentation information presented by an operator regarding the operating status of the equipment from the acquired imaging data, and a step of estimating the operating status based on the detected presentation information. A program.
10. A step of causing a control unit to acquire imaging data captured by an imaging device for imaging equipment, a step of causing the control unit to detect presentation information presented by an operator regarding the operating status of the equipment from the acquired imaging data, A facility management method for causing a control unit to execute a step of estimating the operating status based on the detected presentation information.
Citation Information
Patent Citations
Process information acquisition system, process information acquisition method, and process information acquisition program
JP2020129287A