Monitoring device, monitoring method, and monitoring program

The monitoring device addresses the challenges of aging equipment and labor shortages by enabling remote inspection using 3D models and IoT/AI, enhancing inspection efficiency and response to abnormalities.

JP2025044564APending Publication Date: 2025-04-02MEIDENSHA CORP +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023152204
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-09-20
Publication Date
2025-04-02

AI Technical Summary

Technical Problem

Facilities such as substation equipment face challenges in stable operation due to aging, labor shortages, and risks from infectious diseases like COVID-19, making on-site inspections difficult.

Method used

A monitoring device that associates time-series measurement data with a 3D model, allowing remote inspection through viewpoint changes, color coding for abnormalities, and displaying operation status and measurement information on a monitoring screen, with features like memo pasting and virtual lighting.

Benefits of technology

Enables remote inspection, reducing on-site work, improving inspection efficiency, and facilitating timely responses to abnormalities by leveraging IoT and AI technologies.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025044564000001_ABST
    Figure 2025044564000001_ABST
Patent Text Reader

Abstract

To reduce inspection work at a site by enabling inspection of a monitoring object from a remote place other than the site of the monitoring object.SOLUTION: In a monitoring server 3 for displaying time-series measurement data obtained by always monitoring an operation state of a hierarchical monitoring object in association with a three-dimensional model of the monitoring object on a monitoring screen, a viewpoint change unit 31 rotates and displays the three-dimensional model of the monitoring object by changing a viewpoint relative to the monitoring object. An operation state display unit 32 color-codes and displays the three-dimensional model of the monitoring object with the three-dimensional model of other normal monitoring object when the monitoring object is abnormal. When the monitoring object is selected, a selection display unit 33 displays an operation state and measurement information of the monitoring object in a list.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an apparatus, method, and program for constantly monitoring equipment, facilities, and the like. [Background technology]

[0002] 2. Description of the Related Art As an inspection device for facility equipment that enables smooth maintenance and inspection of facility equipment by patrol inspectors, for example, an inspection device disclosed in Patent Document 1 is known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-44741 A Summary of the Invention [Problem to be solved by the invention]

[0004] Facilities such as substation equipment need to operate stably. Conventionally, workers regularly inspect the facilities.

[0005] However, it is difficult for workers to carry out on-site inspections due to the aging of equipment, the long-term labor shortage caused by the aging and retirement of skilled engineers, and the risk of infectious diseases such as COVID-19. To solve these issues, there is a need for methods that utilize new technologies such as IoT and AI to constantly collect and monitor equipment condition data.

[0006] In view of the above circumstances, an object of the present invention is to reduce the inspection work at a monitoring site by enabling inspection of the monitoring target to be performed remotely from a location other than the monitoring site. [Means for solving the problem]

[0007] Therefore, one aspect of the present invention is a monitoring device that associates time-series measurement data obtained by constant monitoring of the operating status of hierarchical monitored objects with a 3D model of the monitored object and displays it on a monitoring screen, and is equipped with a viewpoint changing unit that rotates and displays the 3D model of the monitored object by changing the viewpoint on the monitored object, an operating status display unit that, when there is an abnormality in the monitored object, displays the 3D model of the monitored object in a different color from 3D models of other monitored objects that are normal, and a selection display unit that, when a monitored object is selected, displays a list of the operating status and measurement information of the monitored object.

[0008] In one aspect of the present invention, in the monitoring device, the operation status display unit displays the operation status and measurement information of the monitored object in a text box on a 3D model of the monitored object in a manner that allows the operation status and measurement information of the monitored object to be added or deleted, and the text box is displayed in front of the monitoring screen even when the viewpoint is changed.

[0009] In one aspect of the present invention, when the viewpoint is changed in the monitoring device, a text box displayed on the 3D model of the monitored object closest to the viewpoint is displayed larger on the monitoring screen than other text boxes displayed on the 3D models of other monitored objects.

[0010] In one aspect of the present invention, in the monitoring device, the spacing between the text boxes displayed on the 3D models of the multiple monitored objects is adjusted so that the text boxes do not overlap with each other.

[0011] In one aspect of the present invention, in the monitoring device, the operation status display unit is capable of displaying an animation of a door of the monitored object opening to virtually disclose the interior of the monitored object.

[0012] In one aspect of the present invention, the monitoring device further includes a memo pasting unit that pastes a memo on the three-dimensional model.

[0013] In one aspect of the present invention, the monitoring device further includes a virtual lighting unit that virtually irradiates the monitoring target with light so that a viewpoint of a virtual light source with respect to the monitoring target can be changed.

[0014] In one aspect of the present invention, the monitoring device further comprises an editing unit that changes or deletes in advance other monitoring targets or monitoring items in a lower hierarchy that constitutes the monitoring target.

[0015] In one aspect of the present invention, in the monitoring device according to claim 1, the monitoring device further comprises an event log display unit that displays in a graph the number of abnormalities that have occurred during a specified period for one or more selected monitoring targets.

[0016] In one aspect of the present invention, in the monitoring device, the intervals between the graphs are adjusted so that the graphs do not overlap each other.

[0017] In one aspect of the present invention, in the monitoring device, the memo pasting section is capable of freely pasting the memo in a direction relative to the three-dimensional model.

[0018] In one aspect of the present invention, in the monitoring device, the monitoring screen is capable of displaying invisible information flowing between the monitored objects.

[0019] One aspect of the present invention is a monitoring method performed by a monitoring device that displays on a monitoring screen time-series measurement data obtained by continuous monitoring of the operating status of hierarchical monitored objects in association with a 3D model of the monitored object, wherein the 3D model of the monitored object can be rotated by changing the viewpoint of the monitored object, and if there is an abnormality in the monitored object, the 3D model of the monitored object is displayed in a different color from 3D models of other monitored objects that are normal, and when a monitored object is selected, the operating status and measurement information of the monitored object are displayed in a list.

[0020] One aspect of the present invention is a monitoring program that causes a computer to function as the above-mentioned monitoring device. Effect of the Invention

[0021] According to the present invention described above, inspection of a monitored object can be performed remotely from a location other than the monitored object, thereby reducing the inspection work at the monitored object. [Brief description of the drawings]

[0022] [Figure 1] 1 is a schematic configuration diagram of a monitoring system according to a first embodiment to which a monitoring device of the present invention is applied. [Diagram 2] FIG. 2 is a block diagram of a monitoring terminal according to the first embodiment. [Diagram 3] FIG. 2 is a block diagram showing the configuration of a monitoring server according to the first embodiment. [Figure 4] 1 is an example of a monitoring screen displaying equipment to be monitored. [Diagram 5] (a) An example of an overhead viewpoint of a monitoring screen. (b) An example of an upward viewpoint of a monitoring screen. [Figure 6] An example of a hierarchical structure of monitored objects. [Figure 7] 1 is an example of a monitoring screen showing trends in the status of a monitored object over time. [Figure 8] An example of a monitored event log. [Figure 9] An example of a monitoring screen in which abnormal monitored targets are displayed in different colors from normal monitored targets. [Figure 10] (a) An example of a 3D model of a monitored object showing where notes have been added, and (b) an example of the 3D model showing the contents of the notes. [Figure 11] An example of a monitoring screen with the selected monitoring target highlighted. [Figure 12] An example of a monitoring screen showing a 3D model of each monitored object and its status. [Figure 13] An example of a monitoring screen showing a 3D model of each monitored object and its status. [Figure 14] A schematic diagram of a monitoring screen showing a 3D model of each monitored object and its status. [Figure 15] An example of a monitoring screen showing the process of virtually displaying the inside of a monitored object. [Figure 16](a) is a front view of a monitoring target virtually illuminated with light, and (b) is an explanatory diagram of the viewpoint setting of the virtual lighting with respect to the monitoring target. [Figure 17] 13 is an example of an editing screen showing a hierarchical structure of monitoring targets and monitoring items. [Figure 18] 13 is an example of a monitoring screen that can automatically adjust the display position of monitored information. [Figure 19] An example of a monitoring screen that displays a comparison of the occurrence trends of abnormalities between monitored objects on a 3D model of the monitored objects. [Figure 20] An example of a monitoring screen that displays a graph comparing the occurrence trend of abnormality counts between monitored objects on a 3D model of the monitored objects. [Figure 21] An example of a monitoring screen that allows users to attach "notes" at any specified position on the surface or inside of a 3D model of the monitored object, or on the device inside the model. [Figure 22] An example of a monitoring screen that can display invisible information of a monitored object on a 3D model of the monitored object. [Figure 23] The monitoring screen is an example of a monitoring screen that can display invisible information about a monitored object on a 3D model of the monitored object. [Figure 24] FIG. 13 is an explanatory diagram of a viewpoint change display of a monitoring target. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0024] The monitoring system 1 of this embodiment to which the monitoring device of the present invention is applied employs cloud and IoT, and automatically collects necessary data (e.g., meter readings, device on / off indications, etc.) from the equipment to be monitored (e.g., No. 1 extra-high voltage transformer, No. 2 high voltage transformer, C-GIS (cubicle type gas insulated switchgear), high voltage panel, low voltage panel, etc.) and stores it constantly on the cloud. Then, services such as report creation based on the stored data, email notification when an abnormality occurs, and trend analysis using graphs are provided to users (e.g., inspectors of the equipment).

[0025] [Embodiment 1] The monitoring system 1 of embodiment 1 shown in Figure 1 includes a monitoring terminal 2 that monitors an object to be monitored, a monitoring server 3 that creates a monitoring screen based on data of the object to be monitored collected from the monitoring terminal 2, and a user terminal 4 that can access the monitoring server 3 and view the monitoring screen.

[0026] An example of the monitoring target is a substation. The substation is made up of equipment such as transformers, circuit breakers, high-voltage panels, and low-voltage panels. An example of the monitoring items for each equipment is shown in Table 1 below.

[0027] [Table 1]

[0028] An example of a monitoring method for the above-mentioned monitoring items is shown in the following Table 2. The above-mentioned monitoring method is applied with a detection method well known in the facility monitoring technology.

[0029] [Table 2]

[0030] (Monitoring terminal 2) The monitoring terminal 2 is placed at the site of a monitored object as shown in FIG. 2, and includes a data collection unit 21, a digital meter reading unit 22, an analog meter reading unit 23, a color determination unit 24, and a live distribution unit 25.

[0031] The data collection unit 21 collects the monitoring items in Table 1 detected by the various sensors shown in the figure as digital data, compiles them, and transmits them to the monitoring server 3 via a network. The network may be wired or wireless, but if it is wireless, it is easy to install at the site. One or more units are installed depending on the monitoring target and monitoring items.

[0032] Digital meter reader 22 converts the meter showing the numerical value of digital meter 222 photographed by camera 221 into numerical data by image recognition.

[0033] The analog meter reading unit 23 converts an analog meter 232 photographed by a camera 231 into numerical data by image recognition.

[0034] The color judgment unit 24 judges the color from the hue of the "circuit breaker status indicator 242 showing red for on and green for off" or "silica gel" photographed by the camera 241, and converts it into information indicating the status, such as "on / off" or "deteriorated / not deteriorated."

[0035] The live distribution unit 25 live distributes moving images captured by the environment monitoring camera 251. The moving images can be stored as still images and transmitted to the monitoring server 3 at regular intervals or when requested by the monitoring server 3.

[0036] The data recognized by the digital meter reading unit 22, the analog meter reading unit 23, and the color judgment unit 24 is transmitted to the monitoring server 3 by the data collection unit 21. This recognition function makes it possible to monitor equipment where it is difficult to newly install a sensor. In addition, still images taken by the digital meter reading unit 22, the analog meter reading unit 23, and the color judgment unit 24 are stored for a certain period of time.

[0037] (Monitoring server 3) The monitoring server 3 corresponds to one aspect of the monitoring device of the present invention, and periodically receives data for each monitoring item in Table 1 from the monitoring terminal 2 and stores it in a database as time series data. The time series data can be displayed and referenced on a monitoring screen, graph, or the like on a display or user terminal 4. Furthermore, for each monitoring item, abnormalities such as deviation from upper and lower limits are constantly monitored, and when an abnormality occurs, it is notified to the user terminal 4 of the user (worker, inspector, etc.) by notification means such as an alarm or email.

[0038] The monitoring server 3 also associates time-series measurement data obtained by constant monitoring of the hierarchical operating status of the monitored object with a 3D model of the monitored object and displays it on the monitoring screen using the following functional units. As the functional units, a viewpoint change unit 31, an operating status display unit 32, a selection display unit 33, a memo attachment unit 34, a virtual lighting unit 35, an editing unit 36, and an event log display unit 37 are implemented in the monitoring server 3 according to the behavior of the computer's hardware and software resources, as shown in Fig. 3. The above functional units can be provided via a network as a program to be executed by a computer.

[0039] The viewpoint change unit 31 rotates and displays a three-dimensional model of the monitored object by changing the viewpoint of the monitored object (for example, Figs. 5, 12, and 13). The monitored object is represented as shape vector data on three-dimensional coordinates including XYZ coordinates (hereinafter, three-dimensional model) such as the monitored object 12 shown in Fig. 24. The viewpoint change unit 31 allows the user to freely move the viewpoint VP of the monitored object 12 on the monitoring screen, allowing the user to view the three-dimensional model from any direction. When viewing the model, the three-dimensional model is converted into two-dimensional coordinates on a view V seen from the viewpoint VP, and viewed as a two-dimensional screen including XZ coordinates.

[0040] When the monitoring target has an abnormality, the operation status display unit 32 displays the 3D model of the monitoring target in a different color from the 3D models of other monitoring targets that are normal (for example, FIG. 9). On the 3D model of the monitoring target, a text box that allows the operation status and measurement information of the monitoring target to be added or deleted can be displayed (for example, FIGS. 9, 10, 12, 13, and 20). The text box can be displayed in front of the monitoring screen even if the viewpoint of the monitoring target is changed (same figure). Furthermore, when the viewpoint is changed, a text box displayed on the 3D model of the monitoring target that is closest to the viewpoint can be displayed larger than other text boxes displayed on the 3D models of the other monitoring targets on the monitoring screen (same figure). Furthermore, the intervals between the text boxes displayed on the 3D models of multiple monitoring targets are adjusted so that they do not overlap each other even if the viewpoint is changed (for example, FIG. 18). Furthermore, when the monitoring target has a door, an animation of the door opening can be displayed to virtually reveal the inside of the monitoring target (for example, FIG. 15). Furthermore, the monitoring screen can display invisible information flowing between the monitored objects (eg, FIGS. 22 and 23).

[0041] When the monitoring target is selected, the selection display unit 33 displays a list of the operating status of the monitoring target and its measurement information (for example, FIG. 11).

[0042] A memo pasting unit 34 pastes a memo on the three-dimensional model (for example, Figs. 10 and 21). The memo can be pasted in any direction relative to the three-dimensional model (see the same figures).

[0043] Virtual illumination unit 35 virtually irradiates light from a virtual light source 351 onto the monitoring target so that the viewpoint can be changed (eg, FIG. 16).

[0044] The editing unit 36 ​​allows other monitoring targets or their monitoring items in a lower hierarchy that constitutes the monitoring target to be changed or deleted in advance (eg, FIG. 17).

[0045] The event log display unit 37 displays the number of abnormal occurrences in a specified period for one or more selected monitoring targets in a graph (e.g., FIG. 19). The intervals between the graphs are adjusted so that they do not overlap each other even if the viewpoint is changed (e.g., FIG. 20).

[0046] The monitoring server 3 described above runs on the cloud, so as long as there is an environment with an internet connection, the monitoring screen can be viewed on a mobile device such as a tablet or smartphone. By viewing the above beforehand, workers can grasp the status of the site before starting work, improving work efficiency.

[0047] (User terminal 4) The user terminal 4 is not particularly limited as long as it is a terminal that can remotely access the monitoring server 3 via the Internet and view the monitoring screen of the monitored object. Examples of the terminal include mobile terminals such as notebook personal computers, tablets, and smartphones that are carried and operated by the user.

[0048] (Monitoring screen 40) FIG. 4 shows an example of a monitoring screen 40 that displays the device to be monitored.

[0049] For example, when the user logs in from the home page of the monitoring system 1 using the user terminal 4 and opens the hyperlink for the "office" of the "substation" to be monitored, the monitoring screen 40 for the "extra-high voltage substation" shown in the figure is displayed.

[0050] The monitoring screen 40 displays a 3D model of the "Extra High Voltage Substation." This monitoring screen 40 displays the following reference buttons: "Top View," "Memo," "Trend," "Power System Status," "Design Drawings," "Product Chart," "Event Log," "Abnormality List," "Operation Record," and "Data Export." The function of each reference button is explained below.

[0051] "Top view" reference When the "Top View" reference button is pressed by an operation signal from the pointing device of the user terminal 4, the operation status display unit 32 is started and displays the "Top View" monitoring screen 40 in the same figure. This monitoring screen 40 displays perspective images of the exteriors of the "Extra High Voltage Substation" and its lower-level equipment, the "Extra High Voltage Transformer No. 1", the "Extra High Voltage Transformer No. 2", the "C-GIS", the "High Voltage Panel", and the "Low Voltage Panel", as well as a photographed image of the "Extra High Voltage Substation". The shapes and arrangements of the "Extra High Voltage Transformer No. 1", the "Extra High Voltage Transformer No. 2", the "C-GIS", the "High Voltage Panel", and the "Low Voltage Panel" are created based on the "Design Drawings", and the shapes and arrangements of the site are displayed on the monitoring screen 40. The specific contents of the "Design Drawings" can be viewed by pressing the "Design Drawings" reference button on the "Top View" monitoring screen 40. The photographed image of the "Extra High Voltage Substation" is acquired by the environment monitoring camera 251.

[0052] The 3D model of the "business establishment" to be monitored has a hierarchical structure consisting of the business establishment - substation - equipment in the substation (extra-high voltage transformer No. 1, extra-high voltage transformer No. 2, C-GIS, high voltage panel, low voltage panel) - subsystem of the equipment (e.g. partial discharge detector, oil level camera, sensor terminal, CBM panel) as shown in Figure 6. The monitoring items in Table 1 are associated with the substation, the equipment in the substation, and the subsystems.

[0053] When the 3D model of "substation" is selected from the 3D model of "office" shown on the monitoring screen (not shown) by the operation signal, the operation status display unit 32 transitions to a monitoring screen 40 showing the 3D model of "substation" shown in Fig. 4. In addition to the 3D model, the operation status and monitoring item measurement values ​​of each piece of equipment in the "substation" (extra-high voltage transformer No. 1, extra-high voltage transformer No. 2, C-GIS, high voltage panel, low voltage panel) can be displayed on this "substation" monitoring screen 40. The viewpoint change unit 31 that receives the operation signal can rotate the 3D model 360 degrees, enlarge and reduce it as shown in Fig. 5, and the viewpoint can be changed as desired for viewing.

[0054] Also, the monitoring screen 40 in Fig. 4 displays a semi-transparent display icon 321, an operating status display icon 322, and a memo display icon 323, which are pressed by the operation signal. When the semi-transparent display icon 321 is pressed, a "semi-transparent three-dimensional model" is displayed in which a monitored object having an abnormality (e.g., C-GIS) and other monitored objects that are normal (e.g., extra-high voltage transformer No. 1, extra-high voltage transformer No. 2, high voltage panel, and low voltage panel) are color-coded, as shown in Fig. 9. When the operating status display icon 322 is pressed, a "text box" showing the operating status and monitored item measurement values ​​corresponding to each monitored object is displayed, as shown in the same figure. When the memo display icon 323 is pressed, a clip-shaped "mark" showing the location of a memo pasted on the three-dimensional model of a specified monitored object (e.g., extra-high voltage transformer No. 1) is displayed, as shown in the same figure.

[0055] · Reference for "trends" When the "trend" reference button is pressed by the operation signal, the operation status display unit 32 displays in graph form the time-dependent fluctuations in the data of the monitored items for a specified period (e.g., the past hour), for example as shown in Fig. 7. The monitored items are arbitrarily selected from the following monitored items: "substation," "equipment in the substation," and "equipment subsystem." In the illustrated example, the monitored items selected are "oil level," "oil temperature," "N2 gas pressure," and "H2 concentration" for the "No. 2 extra-high voltage transformer in the extra-high voltage substation."

[0056] · Reference to "design drawings" When the "design drawing" reference button is pressed by the operation signal, the operation status display unit 32 displays a list of design drawings (single-line diagrams, structural drawings, etc.) related to the substation. This allows the user to refer to the design drawings of the "extra-high voltage substation."

[0057] - Viewing the "Event Log" When the "event log" reference button is pressed by the operation signal, the event log display unit 37 is started and displays an event log related to the "substation" such as the occurrence of an abnormality, as shown in Fig. 8. In the event log, the event logs of the "substation," "equipment in the substation," and "equipment subsystem" can be referenced. In addition, an event log indicating a "normal" state is marked with a "green" symbol, while an event log indicating an "abnormal" state is marked with a "red" symbol, allowing past "normal" and "abnormal" event logs to be clearly understood in chronological order.

[0058] "Abnormal" display When an abnormality occurs in a monitoring item of a monitored object, the operation status display unit 32 clearly displays the abnormal equipment by color-coding the monitored object where the abnormality occurred (for example, equipment that includes the abnormal monitoring item in a lower hierarchical level of the monitored object) from normal equipment, as in the "top view" monitoring screen 40 shown in FIG. 9. The equipment is also registered and displayed in a list of abnormalities. In the illustrated example, the 3D model of "C-GIS," which is shown to have an abnormal operating status, is displayed in a different color from the 3D models of other equipment (extra-high voltage transformer No. 1, extra-high voltage transformer No. 2, high voltage panel, low voltage panel).

[0059] -See "Live Footage" 4, when the reference button for "exterior camera" is pressed by the operation signal, the operation status display unit 32 displays live video from the environment monitoring camera 251. When an operable camera such as a PTZ (pan-tilt-zoom) camera is used as the environment monitoring camera 251, imaging can be performed from any angle.

[0060] - Setting and viewing "Memo" A "memo" such as an image or text can be pasted at any position on the 3D model of the monitored object on the monitoring screen 40 by the operation signal. For example, on the "top view" monitoring screen 40 in FIG. 4, when the "memo" reference button is pressed by the operation signal, the memo pasting unit 34 is started and an "input form" for the "memo" is launched. The "input form" has at least input fields for the content and position of the memo. The position can be set by selecting any position on the 3D model of the monitored object on the monitoring screen 40.

[0061] For example, the display marks M1 and M2 of the "memo" pasted on the monitoring screen 40 shown in FIG. 10 are positioned on the three-dimensional coordinates of the "Extra High Voltage Transformer No. 1" that is the object of monitoring. If the memo consists of text information only, the display mark M1 is displayed, for example, as a plain pink circle mark. If the memo contains text information with an image attached, the display mark M2 is displayed, for example, as a pink circle mark with a "clip mark". Then, when either of the display marks M1 or M2 is selected by the operation signal, the contents of the "memo" (text information or images such as photographs) can be referenced. This allows information to be registered in the corresponding location of the equipment to be monitored.

[0062] Furthermore, a "memo" that is no longer in use can be hidden from the 3D model by closing it with the operation signal. Multiple images can be registered in the same location to attach to a "memo". Furthermore, events such as abnormal occurrences can be registered by linking related events from the "event log" to the "memo". The contents of the "memo" are updated when an event occurs or returns to normal. It is also possible to create "memos" that are not placed on the 3D model.

[0063] - See "Top View of Selected Monitored Targets" When equipment in the substation is selected by the operation signal on the "top view" monitoring screen 40 of the "extra-high voltage substation" shown in Fig. 4, the selection display unit 33 highlights the selected equipment as shown in Fig. 11, while displaying equipment other than the selected equipment in a lighter color. At that time, the latest status of the monitoring items of the selected equipment is displayed. If the status has not been received for a certain period of time due to a malfunction, an icon indicating an abnormality is displayed.

[0064] - View the "Event log of the selected device" When the "Event Log" button is pressed on the monitoring screen 40 in the same figure, the event log display unit 37 is launched and displays the event log that occurred during the specified period for the equipment and its subsystems, as in Figure 8 described above.

[0065] - See "Trends for selected devices" When the "Trend" reference button is pressed on the monitoring screen 40 in Fig. 11, the operation status display unit 32 displays a graph of the fluctuations of the monitoring items related to the device over the specified period, similar to the above-mentioned Fig. 7. The monitoring items to be referenced can be arbitrarily selected from the monitoring items of the device and its subsystems.

[0066] - View "Subsystem status of selected device" On the monitoring screen 40 in FIG. 11, when the reference button for the selected subsystem of the equipment (for example, any one of "sensor terminal," "CBM panel," "partial discharge detector," "gas analyzer," "oil level camera," or "oil temperature camera") is pressed, the operation status display unit 32 displays the detailed status of that subsystem.

[0067] Detailed status is displayed in a predetermined manner by the subsystem. For example, when a "sensor terminal" is selected, the event log of the sensor terminal (e.g., the sensor terminal in Figure 2 and Table 2) is displayed. When a "partial discharge detector" is selected, a graph showing the trend of the monitored item is displayed. When an "oil surface camera" is selected, a list of still images taken by the "oil surface camera" by time is displayed.

[0068] A specific example of the operation of the monitoring system 1 will be described with reference to FIGS.

[0069] The status of the devices in the substation is constantly collected by the monitoring terminal 2 and stored as time-series data in a database in the monitoring server 3. The records of the inspection results are automatically updated. A specific example of the operation of the monitoring system 1 will be described below.

[0070] Daily Inspection An inspection worker displays the substation monitoring screen 40 in Fig. 4 via the user terminal 4 and refers to the status of each device in the substation. For items in Table 1 where the numerical values ​​are approaching abnormal values, the "trend" is confirmed, for example, using the graph in Fig. 7. Also, the worker refers to live video from the external camera (environment monitoring camera 251) in Fig. 4 to inspect whether there are any abnormalities in the appearance of each device, and stores the results in a database in the monitoring server 3. By monitoring partial discharges, micro-ground faults, transformer oil levels, and circuit breaker vacuum leaks stored in the database, the state of insulation deterioration of each device can be grasped.

[0071] "Knowing when to clean" The amount of dust inside the panel of each piece of equipment is accumulated and the amount of dust accumulated inside the panel is measured by a dust sensor. The measured value of the amount of dust is sent from the monitoring terminal 2 to the monitoring server 3. When the measured value exceeds a predetermined value, the monitoring server 3 notifies the user terminal 4 of the worker, informing him / her that it is time to clean. After cleaning, the notification is reset. Accordingly, the number of days that have passed since cleaning is counted. This makes it possible to know when it is time to clean. As described above, there are fewer opportunities for on-site inspections, but cleaning can be carried out when necessary.

[0072] "When an abnormality occurs" If an abnormality occurs in any of the monitoring items in Table 1, an alarm or e-mail will be sent to the worker's user terminal 4. The worker will then check the situation by referring to the event log, current status, graphs, live video, and other data displayed in Figure 7-9, and consider how to respond.

[0073] (Effects of this embodiment) According to the above monitoring system 1, since the 3D model of the monitored object can be associated with the monitored items and displayed by remote monitoring, it becomes easier to grasp the state of the monitored object, and the inspection work can be performed as if it were a patrol inspection at the site. Furthermore, when an abnormality occurs in the monitored object, the state of the site can be grasped from a remote location via the user terminal 4, so that even if the chief electrical engineer is not at the site, it becomes easier to grasp the situation and to take an initial response. Furthermore, by utilizing data collected by multiple cameras and sensors, the amount of work required for inspection work in one year can be significantly reduced. Furthermore, although there are fewer opportunities for on-site inspection, the time for cleaning is notified, and good condition can be maintained.

[0074] [Embodiment 2] The monitoring screen 40 of the second embodiment is capable of displaying the monitoring items and live video of the equipment to be monitored (extra-high voltage transformer No. 1, extra-high voltage transformer No. 2, high voltage panel, low voltage panel) on a 3D model of the equipment, for example, as shown in Figures 12 and 13. The monitoring items can be freely positioned at any position on the coordinates of the 3D model of equipment A and B, as shown in Figure 14. Monitoring items for the same equipment are grouped and displayed together with the name of the equipment (Figures 12 and 13). By positioning the monitoring items near the equipment, the equipment and its status can be displayed in an easy-to-understand manner.

[0075] In the monitoring screen 40 of this embodiment, the viewpoint change unit 31 rotates and displays a 3D model of the monitoring target by changing the viewpoint of the monitoring target. When displaying, the 3D model is converted to 2D coordinates on the display layer 42 (view V in FIG. 24) of FIG. 14 as seen from the viewpoint and displayed. Even when the viewpoint is changed by rotating the 3D model, the monitoring items are arranged on the display layer 42 (monitoring screen 40) and face forward (for example, FIGS. 12 and 13). Furthermore, the monitoring items of the devices displayed in the foreground according to the distance from the viewpoint are displayed larger (same figure), so that devices that are of interest, such as devices showing abnormal trends, can be displayed in the foreground.

[0076] [Embodiment 3] The monitoring screen of the third embodiment shown in Fig. 15 can virtually display the inside of a board 10 as an example of a monitored object by using an animation effect. That is, the door 11 of the board 10 can be opened by the operation signal, and the subsystems (devices) inside the board 10 can be displayed. In addition, by selecting the internal device, the user can refer to information related to the selected device, such as the values ​​of the monitored items of the device, graphs showing the fluctuations of the values, and event logs. Furthermore, the user can attach notes to the inside of the board 10 and the devices inside it.

[0077] The operation process (S1-S5) of the monitoring screen of this embodiment will be described with reference to the figure. In the example described below, an animation of a door opening is executed.

[0078] S1: An instruction to open the door 11 of the panel 10 is received by an operation signal from the user terminal 4.

[0079] S2: In response to the above instruction, the opening operation of the door 11 is displayed as an animation of a three-dimensional model.

[0080] The animation includes a 3D model of the door 11 in a closed state and a 3D model of the door 11 in an open state. In response to an instruction to open the door 11, the door 11 is displayed as if it is gradually opening by gradually bringing each coordinate of the 3D model of the door 11 in the closed state closer in a straight line to the corresponding coordinate of the 3D model of the door 11 in the open state.

[0081] S3: The 3D model of board 10 is updated to show door 11 open.

[0082] S4: The internal state of the panel 10 is displayed. The viewpoint of the internal state can be changed, and the internal state can be enlarged or reduced. Also, a device of interest can be emphasized while other devices are displayed transparently.

[0083] S5: You can select a device inside the panel 10 and refer to the information about that device. Note that the devices that are not selected are displayed semi-transparently.

[0084] The animation mechanism described above has a 3D model file, viewpoint information, and the name of the animation to be run as equipment data. When equipment is selected, the corresponding 3D model file is displayed from the corresponding viewpoint. At this time, if the 3D model file is the same as the monitoring target selected until just before, the viewpoint moves seamlessly without blacking out. Also, if an animation is set, the corresponding animation can be searched for and executed from the 3D model. Animations do not loop, and any changes to the model's shape made during the animation remain as they are. When a different piece of equipment is selected, the animation of the equipment before selection is played in reverse, and the model's shape is returned to the state it was in before the animation was played (in the example in the same figure, it is returned to the state of S1 with the door closed).

[0085] [Embodiment 4] 16, the position of the viewpoint (viewpoint) of virtual light source 351 with respect to board 10, which is an example of a monitored object, can be set arbitrarily by virtual lighting unit 35. Virtual light source 351 is set to the position of the viewpoint, and can be adjusted in conjunction with the direction of the line of sight. Board 10 illuminated by virtual light source 351 or an area inside board 10 with door 11 of board 10 open increases in brightness, allowing board 10 or the interior to be clearly observed. Even when board 10 is enlarged, reduced, or scrolled, appropriate virtual light is irradiated, allowing board 10 to be clearly observed.

[0086] [Embodiment 5] The hierarchical structure and monitoring items of the monitored objects can be edited in advance on a master editing screen 41 as exemplified in Fig. 17. That is, on the master editing screen 41, the editing unit 36 ​​can be used to drag and drop icons of lower-level subsystems (e.g. partial discharge detectors, oil level cameras, sensor terminals, CBM panels, etc.) that make up the system (e.g. extra-high voltage transformer No. 1) that is the monitored object, thereby allowing the hierarchical structure of the system-subsystem to be arbitrarily set in advance. Then, the monitoring items can be associated with the icons of the monitored objects. Through this editing operation, the monitoring items can be associated with the corresponding managed object models in the 3D model.

[0087] [Embodiment 6] The monitoring screen 40 shown in FIG. 18 automatically adjusts the display position of the information on the monitoring subject.

[0088] Text boxes for the operating status (presence or absence of abnormalities, etc.) and measurement information of the monitored object (for example, extra-high voltage transformer No. 1, extra-high voltage transformer No. 2, C-GIS, high voltage panel, low voltage panel) are displayed near the monitored object. The text boxes for the operating status are placed at the reference coordinates set for the monitored object and displayed near the monitored object even if the viewpoint is moved by viewpoint change unit 31 (FIG. 1(a)).

[0089] However, depending on the viewpoint, the display of the text boxes may overlap, making the monitored object difficult to see (FIG. 1(b)).

[0090] Therefore, after projecting each display of the text boxes onto a common two-dimensional plane, a force layout is set on the two-dimensional plane, and if the rectangles of the text boxes are too close, the text boxes are automatically adjusted so that they do not overlap (Figure 1(c)).

[0091] The force layout is a graphic layout that adjusts the coordinates of the nodes by performing a simple physical simulation to set a virtual repulsive force for each node depending on the distance between the displayed nodes, so that the nodes do not come closer than a certain distance (Figure 1(d)).

[0092] When the display position of the text box is automatically adjusted, it may be difficult to tell which text box is the object of monitoring. In such a case, an arrow or a speech bubble may be displayed to indicate the object of monitoring.

[0093] [Embodiment 7] The monitoring screen 40 shown in FIG. 19 shows a comparison of occurrence trends of the number of abnormalities occurring between monitoring targets.

[0094] When the "Product Chart" reference button is selected by the operation signal on the "top view" monitoring screen 40 shown in Fig. 4, the operation status display unit 32 displays in a graph the number of abnormalities that occurred during a specified period for one or more selected monitoring targets as shown in Fig. 11. In the illustrated example, the monitoring targets are extra-high voltage transformer No. 1, extra-high voltage transformer No. 2, C-GIS, high voltage panel, and low voltage panel.

[0095] According to the monitoring screen 40 of this embodiment, the period to be displayed can be changed by operating on the graph (e.g., dragging). In addition, when graphs of multiple monitoring targets are displayed, when the period to be displayed is set, the same display period is set for all graphs, and the number of occurrences in the same period can be referenced and compared. Furthermore, comparing the number of occurrences in the same period for multiple monitoring targets is useful for estimating the cause of anomalies.

[0096] [Embodiment 8] The monitoring screen 40 of the eighth embodiment shown in Fig. 20 further enables a comparison of the occurrence tendency of the number of abnormality occurrences between monitoring objects on the above-mentioned "product chart" monitoring screen 40 to be displayed in a graph on a three-dimensional model of the monitoring object. In particular, the graph of the monitoring object is displayed in the vicinity of the monitoring object. In this embodiment, as in the sixth embodiment, the interval between the graphs is adjusted so that the graphs do not overlap each other as shown in the figure even if the viewpoint is changed.

[0097] [Embodiment 9] The monitoring screen 40 of the ninth embodiment shown in FIG. 21 allows a "memo" to be attached at an arbitrarily designated position on the surface or inside of the three-dimensional model to be monitored, or on the device inside.

[0098] That is, when the "Memo" reference button is selected by the operation signal on the "top view" monitoring screen 40 in Fig. 4, the memo pasting unit 34 opens a setting screen for the pasting position of the "Memo". On this setting screen, it is possible to create a "Memo" that adds orientation information to the 3D position information at a position of the 3D model of the monitored object that is arbitrarily specified, as shown in Fig. 21. The "Memo" is pasted on the surface at the specified pasting position, and it can be represented by an icon such as a "thumb tack" to clearly indicate the orientation from which the "Memo" is pasted.

[0099] [Embodiment 10] The monitoring screen 40 of the tenth embodiment shown in Figs. 22 and 23 can display invisible information of the monitored object on a three-dimensional model of the monitored object by the operation status display unit 32. The invisible information is based on data of each monitoring item of the monitored object obtained from the monitoring terminal 2, and can be, for example, invisible electricity flow. In the illustrated example, the flow of electricity from the "C-GIS" to the "high voltage panel" via the "No. 1 extra high voltage transformer" is displayed as the equipment to be monitored. According to the monitoring screen of this embodiment, the operating or stopped state of the monitored object can be seen at a glance. As shown in the figure, the shape and position of the invisible information are three-dimensional model data. It is also possible to make it into an animation as in the third embodiment. In particular, the flow of electricity in Figs. 22 and 23 can be expressed in the flow direction by a repeatedly played animation. [Explanation of symbols]

[0100] 1. Surveillance system 2...monitoring terminal, 21...data collection unit, 22...digital meter reading unit, 221...camera, 222...digital meter, 23...analog meter reading unit, 231...camera, 232...analog meter, 24...color judgment unit, 25...live distribution unit, 251...environmental monitoring camera 3... monitoring server, 31... viewpoint change section, 32... operation status display section, 321... semi-transparent display icon, 322... operation status display icon, 323... memo display icon, 33... selection display section, 34... memo attachment section, 35... virtual lighting section, 351... virtual light source, 36... editing section, 37... event log display section 4...user terminal, 40...monitoring screen, 41...master editing screen, 42...display layer, M1, M2...display mark 10…board, 11…door 12…Monitoring target, VP…Viewpoint, V…View

Claims

1. A monitoring device that displays time-series measurement data obtained by continuous monitoring of an operating state of a hierarchical monitoring target on a monitoring screen in association with a three-dimensional model of the monitoring target, a viewpoint changing unit that rotates and displays a three-dimensional model of the monitoring target by changing a viewpoint of the monitoring target; an operation status display unit that, when an abnormality occurs in the monitored object, displays the 3D model of the monitored object in a different color from 3D models of other monitored objects that are normal; a selection display section that displays a list of the operating status and measurement information of the monitoring target when the monitoring target is selected; A monitoring device comprising:

2. the operation status display unit displays the operation status and measurement information of the monitoring target in a text box on the three-dimensional model of the monitoring target in a manner that allows the operation status and measurement information of the monitoring target to be added or deleted; 2. The monitoring device according to claim 1, wherein the text box is displayed in front of the monitoring screen even if the viewpoint is changed.

3. When the viewpoint is changed, a text box displayed on the three-dimensional model of the monitoring target closest to the viewpoint is displayed larger than other text boxes displayed on the three-dimensional models of other monitoring targets on the monitoring screen.

3. The monitoring device according to claim 2 .

4. 3. The monitoring device according to claim 2, wherein the spacing between the text boxes displayed on the three-dimensional models of the plurality of monitoring targets is adjusted so that the text boxes do not overlap with each other.

5. 2. The monitoring device according to claim 1, wherein the operation status display unit is capable of displaying an animation of a door of the monitored object opening to virtually reveal the inside of the monitored object.

6. 6. The monitoring device according to claim 1, further comprising a memo attachment section for attaching a memo onto the three-dimensional model.

7. 6. The monitoring device according to claim 1, further comprising a virtual lighting unit that virtually irradiates the monitored object with light in such a manner that a viewpoint of a virtual light source with respect to the monitored object can be changed.

8. 2. The monitoring device according to claim 1, further comprising an editing section for modifying or deleting other monitoring targets or monitoring items in a lower hierarchy that constitutes the monitoring target.

9. 2. The monitoring device according to claim 1, further comprising an event log display unit that displays, in a graph, the number of abnormalities that have occurred during a specified period for one or more selected monitoring targets.

10. 10. The monitoring device according to claim 9, wherein the intervals between the graphs are adjusted so that the graphs do not overlap each other.

11. 7. The monitoring device according to claim 6, wherein the memo pasting section allows the memo to be pasted in any direction relative to the three-dimensional model.

12. 2. The monitoring device according to claim 1, wherein the monitoring screen is capable of displaying invisible information flowing between the objects to be monitored.

13. A monitoring method executed by a monitoring device that associates time-series measurement data obtained by continuous monitoring of an operating state of a hierarchical monitoring target with a three-dimensional model of the monitoring target and displays the time-series measurement data on a monitoring screen, the method comprising: A three-dimensional model of the monitoring target can be rotated and displayed by changing a viewpoint of the monitoring target; If there is an abnormality in the monitored object, the 3D model of the monitored object is displayed in a different color from the 3D models of other monitored objects that are normal; When the monitoring target is selected, the operating status and measurement information of the monitoring target are displayed in a list. A monitoring method comprising:

14. A monitoring program that causes a computer to function as the monitoring device according to claim 1.

Citation Information

Patent Citations

  • Inspection apparatus for facilities

    JP2002044741A