Voltage status visualization system, method, and program

Abstract

To provide a voltage state visualization system which can visualize the voltage state and a separation distance of an instrument and a cable way constituting an electric power facility existing in reality and provide a user with them.SOLUTION: A voltage state visualization system comprises: a mixed reality data acquisition unit 313 which acquires mixed reality data instructed with a code image; and a display processing unit 315 which displays in a visual field of a user a mixed reality image configured such that an object corresponding to an instrument and a cable way constituting an electric power facility existing in the visual field of the user is superimposed on the real electric power facility by developing the object corresponding to the instrument and the cable way constituting the electric power facility included in the mixed reality data in a 3D map of the electric power facility. The mixed reality data includes the voltage state about the instrument and the cable way. The display processing unit 315 displays the object so as to be the visual representation according to the opening / closing state of the instrument and the voltage state changing due to the presence / absence of grounding.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a voltage status visualization system, and more particularly to a voltage status visualization system that visualizes voltage status using mixed reality. [Background technology]

[0002] Patent Document 1 describes a magnetic field visualization system that can realistically represent magnetic field lines. In Patent Document 1, magnetic field lines are displayed superimposed on the real world using a device that realizes mixed reality. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6982207 Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, in power equipment, although it is important to recognize the voltage status for safe operation, a system for visualizing the voltage status of power equipment has not yet been proposed.Furthermore, there is no known method for expressing the voltage status, including induced voltage, in power equipment.

[0005] For example, in power facilities such as substations, the equipment and electrical circuits that make up the power facilities are often in a high-voltage state. Arc flashovers can occur between the high-voltage equipment and electrical circuits and workers or tools they are holding. In such cases, workers can receive electric shocks even without directly touching the equipment and electrical circuits that make up the power facilities.

[0006] However, it is not possible to visually determine whether the equipment and circuits that make up the power facility are in a high-voltage state, or how far away they should be to work safely, etc. Because it is not possible to visually determine this, it is difficult for workers who are unfamiliar with power facility operations to recognize dangerous areas within the facility.

[0007] To address these issues, it is desirable to enable workers who are unfamiliar with power equipment to safely learn about dangerous locations within the facility. The inventors of the present application have recognized the need for a technology that can provide users with a tool to visualize the voltage status of the devices and circuits that make up the actual power equipment, as well as the distances required for safe work.

[0008] The present invention has been made in consideration of the above-mentioned problems, and an object of the present invention is to provide a voltage status visualization system that can visualize the voltage status and separation distance of the equipment and circuits that make up actually existing power facilities and provide this to users. [Means for solving the problem]

[0009] A voltage status visualization system according to a representative embodiment of the present invention comprises a spatial shape acquisition unit that captures power equipment as a spatial shape; a 3D map generation unit that generates a 3D map of the power equipment from the captured spatial shape; a mixed reality data acquisition unit that reads a code image and acquires mixed reality data indicated by the code image; and a display processing unit that displays in the user's field of view a mixed reality image configured so that objects corresponding to the equipment and electrical circuits that constitute the power equipment present in the user's field of view are superimposed on the real power equipment by expanding the objects corresponding to the equipment and electrical circuits that constitute the power equipment contained in the mixed reality data onto the 3D map of the power equipment, and the mixed reality data includes the voltage status of the equipment and electrical circuits, and the display processing unit displays the objects so as to provide a visual representation that corresponds to the voltage status, which changes depending on the open / closed state of the equipment and whether or not it is grounded. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a voltage status visualization system that can represent voltage statuses overlaid on devices and electrical circuits that make up power facilities and provide them to users. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating a configuration of a voltage state visualization system according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram showing an object table that defines objects. [Figure 3] FIG. 10 is a diagram illustrating an object placement table. [Figure 4] FIG. 10 is a diagram illustrating an example of separation distances in voltage classes. [Figure 5] FIG. 10 is a diagram illustrating an example of pre-processing. [Figure 6] FIG. 10 is a diagram illustrating an example of mixed reality data generation processing. [Figure 7] FIG. 10 is a diagram showing an example of setting the device status and display pattern in the first menu. [Figure 8] FIG. 10 is a diagram showing an example of the configuration of a display mode table of the first menu. [Figure 9] FIG. 10 is a diagram showing an example of setting the device status and display pattern in the second menu. [Figure 10] FIG. 10 is a diagram showing an example of the configuration of a menu table of a second menu. [Figure 11] FIG. 10 is a diagram showing an example of setting the device status and display pattern in the third menu. [Figure 12] FIG. 10 is a diagram showing an example of the configuration of a menu table of a third menu. [Figure 13] FIG. 10 is a diagram illustrating an example of the configuration of MR data. [Figure 14] FIG. 10 is a diagram illustrating an example of a mixed reality realization process. [Figure 15] FIG. 1 is a diagram illustrating an actual power facility. [Figure 16A] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the first menu. [Figure 16B] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the first menu. [Figure 16C] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the first menu. [Figure 16D] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the first menu. [Figure 16E] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the first menu. [Figure 17A] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the second menu. [Figure 17B] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the second menu. [Figure 17C] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the second menu. [Figure 17D] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the second menu. [Figure 17E] FIG. 10 is a diagram illustrating an example of mixed reality implementation in the second menu. [Figure 18A] FIG. 10 is a diagram showing an example of mixed reality implementation in the third menu. [Figure 18B] FIG. 10 is a diagram showing an example of mixed reality implementation in the third menu. [Figure 18C] FIG. 10 is a diagram showing an example of mixed reality implementation in the third menu. [Figure 18D] FIG. 10 is a diagram showing an example of mixed reality implementation in the third menu. [Figure 18E] FIG. 10 is a diagram showing an example of mixed reality implementation in the third menu. [Figure 18F] FIG. 10 is a diagram showing an example of mixed reality implementation in the third menu. [Figure 18G] FIG. 10 is a diagram showing an example of mixed reality implementation in the third menu. DETAILED DESCRIPTION OF THE INVENTION

[0012] 1. Overview of the embodiment First, a typical embodiment of the invention disclosed in this application will be outlined. In the following description, for example, reference numerals in the drawings corresponding to the components of the invention will be given in parentheses.

[0013] [1] A voltage status visualization system according to a representative embodiment of the present invention comprises a spatial shape acquisition unit that captures power equipment as a spatial shape, a 3D map generation unit that generates a 3D map of the power equipment from the captured spatial shape, a mixed reality data acquisition unit that reads a code image and acquires mixed reality data indicated by the code image, and a display processing unit that displays in the user's field of view a mixed reality image configured so that the objects corresponding to the equipment and electrical circuits that constitute the power equipment present in the user's field of view are superimposed on the real power equipment by expanding the objects contained in the mixed reality data that correspond to the equipment and electrical circuits that constitute the power equipment onto the 3D map of the power equipment, and the mixed reality data includes the voltage status of the equipment and electrical circuits, and the display processing unit displays the objects so as to provide a visual representation that corresponds to the voltage status, which changes depending on the open / closed state of the equipment and the presence or absence of grounding.

[0014] [2] In the voltage status visualization system described in [1] above, the voltage status has four states: an uncharged state, a state in which a weak induced voltage is generated, a state in which a strong induced voltage is generated, and a charged state, and the display processing unit displays the visual representation of the object differently depending on which of the four states the equipment and electrical circuit are in, and may also display the distance at which workers can ensure safety for the equipment and electrical circuit by a cloud-like area around the object.

[0015] [3] In the voltage status visualization system described in [1] or [2] above, the mixed reality data may include a plurality of menus showing a plurality of visual representations of objects corresponding to a plurality of preset voltage states of the equipment and electrical circuits that constitute the power facility, and further have a menu selection unit that accepts input to select a menu to be displayed from the plurality of menus, and the display processing unit may sequentially switch between and display the plurality of visual representations of the objects shown in the selected menu.

[0016] [4] In the voltage status visualization system described in any one of [1] to [3] above, the system includes a spatial shape acquisition unit that captures the power equipment as a spatial shape, a 3D map generation unit that generates a 3D map of the power equipment from the captured spatial shape, an object placement unit that accepts the placement of objects corresponding to the equipment and electrical circuits that constitute the power equipment on the 3D map, a mixed reality data generation unit that generates mixed reality data including the 3D map in which the objects are placed, and a code image generation unit that stores the mixed reality data and generates a code image that indicates a method of acquiring the stored mixed reality data, and the mixed reality data generation unit may generate mixed reality data including a visual representation corresponding to the voltage state based on the voltage state settings for the equipment and electrical circuits that correspond to the objects.

[0017] [5] In the voltage status visualization system described in [4] above, the object may have a voltage attribute and be set to change to a voltage status according to the voltage attribute.

[0018] [6] In the voltage status visualization system described in [4] or [5] above, a voltage class setting unit may be further provided that accepts the setting of a voltage class of the power equipment captured as the spatial shape, and the object placement unit may not accept the placement of objects other than objects corresponding to the set voltage class.

[0019] [7] In the voltage status visualization system described in any one of [4] to [6] above, the mixed reality data generation unit includes an equipment status setting unit that accepts settings for the equipment status, which is the status of the equipment and electrical circuit, a display pattern setting unit that accepts settings for display patterns of the voltage status and separation distance for the equipment and electrical circuit, and an electrical circuit status identification unit that identifies the voltage status and display status for the equipment and electrical circuit based on the equipment status and the display pattern, and the electrical circuit status identification unit may include a menu table generation unit that, when multiple voltage states are identified for one equipment and electrical circuit, generates a menu table as a menu showing visual representations of objects corresponding to the multiple voltage states of the equipment and electrical circuit for which the multiple voltage states have been identified.

[0020] [8] In the voltage status visualization system described in [7] above, the mixed reality data generation unit may further have a storage data generation unit that generates a data set including a 3D map in which the object is placed and the menu table as mixed reality data.

[0021] [9] A voltage status visualization method according to a representative embodiment of the present invention is a method executed by at least one of a mixed reality realization device that realizes mixed reality in a user's field of view and a server capable of communicating with the mixed reality realization device, and includes: a spatial shape acquisition step that captures power equipment as a spatial shape; a 3D map generation step that generates a 3D map of the power equipment from the captured spatial shape; a mixed reality data acquisition step that reads a code image and acquires mixed reality data indicated by the code image; and a display processing step that displays in the user's field of view a mixed reality image configured so that the objects corresponding to the equipment and electrical circuits that constitute the power equipment present in the user's field of view are superimposed on the real power equipment by expanding objects corresponding to the equipment and electrical circuits that constitute the power equipment contained in the mixed reality data onto the 3D map of the power equipment, wherein the mixed reality data includes voltage status related to the equipment and electrical circuits, and the display processing step displays the objects so as to provide a visual representation that corresponds to the voltage status.

[0022]

[10] The voltage status visualization method described in [9] above includes a spatial shape acquisition step of capturing power equipment as a spatial shape, a 3D map generation step of generating a 3D map of the power equipment from the captured spatial shape, an object placement step of accepting placement of objects corresponding to the equipment and electrical circuits that constitute the power equipment in the 3D map, a mixed reality data generation step of generating mixed reality data including the 3D map in which the objects are placed, and a code image generation step of storing the mixed reality data and generating a code image indicating a method of acquiring the stored mixed reality data, and in the mixed reality data generation step, mixed reality data including a visual representation corresponding to the voltage state may be generated based on the voltage state setting for the equipment and electrical circuits corresponding to the objects.

[0023]

[11] A voltage status visualization program according to a representative embodiment of the present invention functions as a display processing means that displays in the user's field of view a mixed reality image configured so that the objects corresponding to the equipment and electrical circuits that constitute the power equipment present in the user's field of view are superimposed on the real power equipment by expanding objects contained in the mixed reality data corresponding to the equipment and electrical circuits that constitute the power equipment onto the 3D map of the power equipment, and includes a mixed reality realization device that realizes mixed reality in the user's field of view and at least one of a server that can communicate with the mixed reality realization device, a spatial shape acquisition means that captures the power equipment as a spatial shape, a 3D map generation means that generates a 3D map of the power equipment from the captured spatial shape, a mixed reality data acquisition means that reads a code image and acquires the mixed reality data indicated in the code image, and a display processing means that displays in the user's field of view a mixed reality image configured so that the objects corresponding to the equipment and electrical circuits that constitute the power equipment present in the user's field of view are superimposed on the real power equipment, and the mixed reality data includes the voltage status related to the equipment and electrical circuits, and the display processing means displays the objects so as to provide a visual representation that corresponds to the voltage status.

[0024]

[12] In the voltage status visualization program described in

[11] above, the program functions as a spatial shape acquisition means for capturing the power equipment as a spatial shape, a 3D map generation means for generating a 3D map of the power equipment from the captured spatial shape, an object placement means for accepting the placement of objects corresponding to the equipment and electrical circuits that constitute the power equipment in the 3D map, a mixed reality data generation means for generating mixed reality data including the 3D map in which the objects are placed, and a code image generation means for storing the mixed reality data and generating a code image indicating a method for acquiring the stored mixed reality data, and the mixed reality data generation means may generate mixed reality data including a visual representation corresponding to the voltage status based on the voltage status settings for the equipment and electrical circuits that correspond to the objects.

[0025] 2. Specific examples of embodiments Hereinafter, specific examples of embodiments of the present invention will be described with reference to the drawings. In the following description, components common to the embodiments will be designated by the same reference numerals, and repeated description will be omitted.

[0026] FIG. 1 is a diagram showing the configuration of a voltage state visualization system according to this embodiment.

[0027] As shown in FIG. 1, the voltage status visualization system of this embodiment includes a server 100 and an MR device 300 that can communicate with the server 100 via a network 200.

[0028] The server 100 has a processing unit 10 and a storage unit 20. The server 100 is configured by a computer having hardware elements such as a processor such as a CPU, various memories such as ROM and RAM, a timer (counter), an A / D conversion circuit, an input / output I / F circuit, and a clock generation circuit, with each component being connected to another via a bus or dedicated line and equipped with a program processing device (e.g., a microcontroller (MCU)). The server 100 realizes the configuration of each functional unit shown in FIG. 1 by the processor performing various calculations according to programs stored in a storage device such as memory (not shown) and controlling peripheral circuits such as the A / D conversion circuit and the input / output I / F circuit.

[0029] 1, the server 100 may have a display for displaying information to the operator and an input means for receiving input from the operator. The input means does not have to be provided in the server 100, in which case the operator's input may be received from the MR device 300. The input means may be a sensing device such as a spatial shape recognition means, such as a depth sensor, or a keyboard and mouse.

[0030] The processing unit 10 has, as functional units, a spatial shape acquisition unit 11, a 3D map generation unit 12, an object placement unit 13, a facility information setting unit 14 (an example of a voltage class setting unit), a mixed reality data generation unit 15, and a QR code generation unit 16 ("QR code" is a registered trademark, the same applies hereinafter). The memory unit 20 stores object data 21 and mixed reality data 22.

[0031] The spatial shape acquisition unit 11 acquires the spatial shape by capturing the target object measured by 3D scanning using a spatial shape recognition means such as a depth sensor (not shown) as the spatial shape. The target object is selected by an operator, and measurement data of the spatial shape measured by the spatial shape recognition means is input to the spatial shape acquisition unit 11. The voltage status visualization system of this embodiment acquires the spatial shape of a facility including equipment that generates voltage conditions, such as power equipment.

[0032] The 3D map generation unit 12 generates a 3D map of the target object from the measurement data of the spatial shape input from the spatial shape acquisition unit 11. In this embodiment, a 3D map of a facility including power equipment is generated. A 3D map refers to mesh data that also includes depth information, which is created by converting a three-dimensional object in a three-dimensional space into two-dimensional planar information through computer calculations. An example of a 3D map is mesh data that represents a spatial shape, such as a spatial mapping mesh. The 3D map is associated with the real space from which the spatial shape was acquired.

[0033] The object placement unit 13 accepts placement of objects corresponding to the equipment and electrical circuit structure that constitute the power facility on the 3D map. By placing the objects, the facility structure and its characteristics can be set on the 3D map. The objects are attributes of a specific area on the 3D map, and can be placed by linking the attributes to a specific area on the 3D map.

[0034] The devices that make up power facilities are devices installed on electric circuits, such as circuit breakers and disconnectors, that conduct or interrupt the flow of current in an electric circuit by switching between an open state and a closed state. A disconnector's equipment structure may include, for example, three insulators and a disconnector blade. A circuit breaker's equipment structure may include, for example, two insulators and two internal conductors. The electric circuit between these devices includes, for example, lead wires and grounding as equipment structures. The objects correspond to these equipment structures, and one or more objects are placed in areas of the 3D map corresponding to the devices and electric circuits that make up the power facility. That is, the areas of the 3D map corresponding to the devices and electric circuits that make up the power facility can be divided into multiple areas as needed, and object placement can be accepted for each area.

[0035] Attributes that can be defined for an area of ​​a 3D map as an object include an object name, an object shape, a voltage attribute, an exposure attribute, and additional attributes.

[0036] The object name is an identifier that identifies the facility structure that constitutes the device or electrical circuit, and can be, for example, the name of the facility structure.

[0037] The object shape defines the shape of the 3D hologram. For example, when a user wearing an MR device 300 (described later) views the real space corresponding to the area of ​​the 3D map where the object is defined, the 3D hologram is displayed in a transparent color so as to be superimposed on the real space.

[0038] An object's voltage attribute defines characteristics related to the object's voltage state. The voltage attribute defines the object's maximum charge state, such as "charged" or "semi-charged." The object's voltage attribute is determined by the object's material; conductive objects are set to "charged," and insulators are set to "semi-charged."

[0039] The charging state changes, for example, in order of increasing voltage, through stages of "no voltage," "weak induced voltage," "strong induced voltage," and "charging." "No voltage" indicates a state in which no voltage is generated, "weak induced voltage" and "strong induced voltage" indicate states in which no voltage is applied but an induced voltage is generated, and "charging" indicates a state in which a voltage is applied. In this case, the "semi-charging unit" can only change its charging state from "no voltage" to "strong induced voltage," but the "charging unit" can change its charging state from "no voltage" to "charging."

[0040] The voltage attribute is related to the voltage state, and the display form of the 3D hologram, for example, the color, pattern, animation, and other aspects (visual expression) can be changed depending on the voltage state.

[0041] The exposure attribute of an object can indicate whether the facility structure is an exposed or non-exposed part. An exposed part is a part where the electrical circuit is exposed due to air insulation, and a non-exposed part is a part where the electrical circuit is covered by a metal tank filled with insulating gas or by an insulator. The distinction between exposed and non-exposed parts is set in the "live part" object. In this embodiment, the internal conductor of a circuit breaker, which is a non-exposed part, has the exposure attribute "absent," and the disconnector blades and lead wires, which are exposed parts, have the exposure attribute "present."

[0042] The additional attribute of the object defines an additional attribute of the object, and can represent, for example, whether the facility structure has an open / closed state as a state parameter or can change to a connected / disconnected state.

[0043] The attributes of objects defined in a predetermined area of ​​the 3D map are set in advance and stored in the storage unit 20 as object data 21. The object placement unit 13 defines objects for areas of the 3D map by linking the attributes of the objects stored as the object data 21 to the areas of the 3D map. An object table, which is an example of the object data 21, will now be described.

[0044] FIG. 2 is a diagram showing an example of the configuration of an object table.

[0045] The object table defines the attributes of an object. The object table shown in FIG. 2 shows that the object name, object form, and object characteristics are defined for each object. In this embodiment, the characteristics are the voltage attribute of the object, the exposure attribute of the object, and the additional attribute of the object, but are not limited to this. An object table may be provided for each voltage class described below. In this case, the object placement unit 13 may be configured to define only the attributes of the object table corresponding to the set voltage class for the 3D map (not to accept the placement of objects other than those corresponding to the set voltage class).

[0046] In the object table shown in Fig. 2, for example, an object having an object name "insulator" has an object form defined by "A", has a voltage attribute called "quasi-charged part", has no exposure attribute set, and has an additional attribute of "none." The object table shown in Fig. 2 does not store the form of a 3D hologram as is, but stores a link to the form of a 3D hologram stored separately from the object table in Fig. 2.

[0047] When the object placement unit 13 receives the placement of objects corresponding to the equipment and electrical circuit structure that make up the power facility on the 3D map, it generates mapping data that links (maps) the attributes of the objects stored in the object table to the area of ​​the 3D map.

[0048] For example, when an operator inputs via the input means of the server 100 that an icon in the form of a 3D object should be placed on the 3D map displayed on the display of the server 100, the object placement unit 13 can accept the placement of the object on the 3D map. Alternatively, the object placement unit 13 may automatically place the object to be placed based on the shape of the mesh data of the 3D map.

[0049] The object placement unit 13 further groups the objects placed on the 3D map and receives a definition of which of the devices and electric circuits that make up the power facility each object corresponds to. When the object placement unit 13 receives the definitions of the devices and electric circuits for the objects placed on the 3D map, it generates a table that stores the correspondence between each object and the devices and electric circuits.

[0050] FIG. 3 is a diagram showing an object placement table generated by the object placement unit 13. As shown in FIG. The object placement table shown in Figure 3 shows the correspondence between the object names of objects placed in each area of ​​the 3D map and the equipment and electrical circuits. For example, it can be seen that "Insulator 1," "Blade," "Insulator 2," and "Insulator 3" are grouped together and defined as a "Disconnector." Note that the "1" in "Insulator 1" is a code that distinguishes different objects with the same object name.

[0051] The facility information setting unit 14 sets attribute information of the facility, including the power equipment captured as a spatial shape. Examples of facility attribute information include the name of the facility and the voltage class of the power equipment. The facility information setting unit 14 passes the set facility attribute information to the mixed reality data generation unit 15. The set facility attribute information is linked to mapping data in the mixed reality data generation unit 15 (described later) and stored in the memory unit 20 as mixed reality data. The voltage class indicates the maximum voltage that can be applied to the power equipment. A separation distance, which is a distance at which workers can ensure safety, is determined depending on the voltage class.

[0052] FIG. 4 is a diagram showing an example of separation distances in different voltage classes.

[0053] As shown in FIG. 4, the voltage class is "Class A," and three separation distances are set for this voltage class. The separation distances indicate distances at which workers can ensure safety. Safety distance 1 is set as the first separation distance, specifically 75 cm from the electric line. Safety distance 2 is set as the second separation distance, specifically 135 cm from the electric line. Construction machinery is set as the third separation distance, and 4 m from the electric line is set as the allowable approach limit. The separation distances for these voltage classes may be stored in advance as a data table in the memory unit 20, or may be set along with the voltage class based on input by the operator. The separation distances are set according to the voltage class.

[0054] The mixed reality data generation unit 15 generates mixed reality data including mapping data, which is a 3D map on which objects are arranged. Based on input from an operator, the mixed reality data generation unit 15 receives settings for the status of equipment and electrical circuits and a display pattern for the mapping data, and generates a display mode of a 3D hologram to be displayed in an area of ​​the 3D map as mixed reality data.

[0055] The mixed reality data generation unit 15 has a device state setting unit 151, a display pattern setting unit 152, an electrical circuit state specifying unit 153, and a stored data generation unit 154 as functional units.

[0056] The device state setting unit 151 accepts settings for device states, which are the states of devices and electrical circuits. The device states indicate the states of devices and electrical circuits, such as the direction of current (positive / negative), whether the device is connected or disconnected (open / closed), whether there is voltage at the inlet, and whether the device is grounded or disconnected (connected / disconnected).

[0057] Specifically, the device state setting unit 151 can receive settings for devices and electrical circuits defined in objects from the object placement table generated by the object placement unit 13. In the case of the object placement table shown in Fig. 3, settings can be received for the positive / negative direction of power flow, the open / closed states of the "disconnector" and "circuit breaker," and the presence / absence of voltage at the "received section," as well as the connected / disconnected states of "ground 1," "ground 2," and "ground 3."

[0058] The device status setting unit 151 can accept settings for device status in a plurality of different states. The device status setting unit 151 can set device status in a plurality of states as one menu. For example, the device status setting unit 151 accepts registration of a menu name and accepts settings for device status in a plurality of states included in the menu. This allows the manner in which device status changes in a facility to be set as one menu, making it possible to visualize changes in voltage status in power equipment according to a single theme.

[0059] The display pattern setting unit 152 accepts settings for display patterns of electric paths and separation distances. For example, it sets whether or not to display induced voltages in insulators and the type of separation distance to display. The display pattern setting unit 152 accepts settings for display patterns of electric paths and separation distances for each of a plurality of different equipment states set by the equipment state setting unit 151. The display pattern setting unit 152 may also be configured to set whether to display or hide non-exposed portions. This allows the voltage status of equipment structures of objects set as non-exposed portions to be displayed, even though they are normally not displayed because they are covered by other equipment structures. In this embodiment, unless otherwise specified, the non-exposed portions are set to be displayed.

[0060] The separation distance is a distance determined according to a voltage class, and multiple distances are defined for each voltage class, as shown in Fig. 4. The display pattern setting unit 152 can set the display pattern of the separation distance to display any one of the multiple separation distances, or to display no separation distance.

[0061] The device state setting unit 151 and the display pattern setting unit 152 may create a table for each menu based on the accepted settings. For example, when settings for three menus are accepted, three tables (device state setting tables) as shown in Figures 7, 9, and 11 can be created. In these illustrated tables, the column items are devices, etc. to be set, and the row items are each state included in the menu. That is, each row shows the device state of each device, etc. in a given state.

[0062] The electric circuit state specifying unit 153 specifies the voltage state, open / close state, attached / detached state, and display state of the object related to the device and the electric circuit as the electric circuit state based on the device state set in the device state setting unit 151 and the display pattern set in the display pattern setting unit 152. The electric circuit state specifying unit 153 may specify the electric circuit state automatically or may specify it based on input by an operator.

[0063] The electrical circuit state identification unit 153 identifies, based on the object placement table, the equipment whose equipment state is set by the equipment state setting unit 151 and the equipment structure (object) linked to the electrical circuit. Furthermore, based on the set equipment state, it identifies the voltage state, open / closed state, and detached state of the identified equipment structure (object). Examples of voltage states include "charging," "no voltage," "weak induced voltage," and "strong induced voltage." Note that for the object name "ground," it may be identified as either "grounded" or "not grounded," regardless of the voltage class. Specifically, the electrical circuit state identification unit 153 identifies the voltage state, open / closed state, and detached state of the equipment structure (object) in three steps based on the set equipment state. The three steps are used to determine the voltage state, open / closed state, and detached state of the equipment structure (object) in order of decreasing importance of the factors that actually determine the voltage in electrical equipment.

[0064] The electric circuit state identification unit 153 may create a table for each menu that lists the voltage state, open / close state, and attached / detached state of the identified facility structure (object). The electric circuit state identification unit 153 may create the menu tables shown in Figures 8, 10, and 12, for example, based on the object arrangement table of Figure 3 and the equipment state setting tables shown in Figures 7, 9, and 11. Each item in the columns of the menu table corresponds to each object in the object arrangement table. The content of each column of the menu table is determined based on the content set for the equipment, etc. corresponding to each object (the content of the equipment state setting tables shown in Figures 7, 9, and 11).

[0065] As shown in the menu tables in Figures 8, 10, and 12, "Lead 1," "Insulator 1," "Blade," "Insulator 2," "Insulator 3," "Lead 2," "Insulator 4," "Circuit Breaker Inner Conductor 1," "Circuit Breaker Inner Conductor 2," "Insulator 5," and "Lead 3" have voltage attributes and have voltage state values. "Lead 1," "Blade," "Lead 2," and "Lead 3" have exposure attributes and have separation distance values. "Blade," "Circuit Breaker Inner Conductor 1," and "Circuit Breaker Inner Conductor 2" have additional attributes and have open / closed state values. "Ground 1," "Ground 2," and "Ground 3" have additional attributes and have an attached / detached state value. Furthermore, if the display / hide setting for "Insulator Lead" is set to "Hide" in the equipment status setting table, "Insulator 1," "Insulator 2," "Insulator 3," "Insulator 4," and "Insulator 5" can have values ​​indicating "Hide."

[0066] In the first stage, the electric circuit state identification unit 153 identifies the set connection / disconnection state of the ground and the open / close state of the equipment as the connection / disconnection state and the open / close state of the corresponding facility structure (object). For example, when the settings shown in the equipment state setting tables of Figures 7, 9, and 11 are made, the connection / disconnection state of the ground and the open / close state of the equipment are identified as they are for the corresponding objects in the menu tables of Figures 8, 10, and 12.

[0067] In the second stage, the electrical circuit state identification unit 153 identifies the voltage state for the facility structure (object) having the voltage attribute of "charging portion." Specifically, an electrical circuit model is created based on the equipment state set by the equipment state setting unit 151, and the voltage state is identified according to the voltage setting state in the electrical circuit, the voltage state of nearby objects, their connected / disconnected states, and their open / closed states, in accordance with the rules of electrical circuit phenomena (such as electrostatic induction). For example, consider the first state of the second menu table in FIG. 10, which is created based on the settings in FIG. 9. "Lead 1" corresponds to the "inlet," and since the current is "positive," the inlet is upstream. Since the "inlet" in FIG. 9 is "no voltage," "Lead 1," which is the most upstream, is not "charging." Furthermore, since the downstream "Ground 1" is in the "disconnected" state, it is considered that a strong induced voltage will occur as an electrical circuit phenomenon, and therefore "Lead 1" is determined to have "strong induced voltage." It is thought that a strong induced voltage will also occur in the "blade" adjacent to this "lead wire 1" as a phenomenon of the electrical circuit, so it is determined to be "strong induced voltage." Note that when the tidal current is "negative," the intake section will be the most downstream.

[0068] The electrical circuit state identification unit 153 selects one of "no voltage," "weak induced voltage," "strong induced voltage," or "charging" for the "charging section" facility structure (object) to identify the object's voltage state. "No voltage" indicates a state where no charging is occurring, "weak induced voltage" indicates a state where weak induced voltage is occurring, "strong induced voltage" indicates a state where strong induced voltage is occurring, and "charging" indicates a state where a voltage of the corresponding voltage class is applied. For example, consider the third state of the second menu table in FIG. 10, which is created based on the settings in FIG. 9. "Lead Wire 1" corresponds to the "inlet," and since the current is "positive," the inlet is upstream. Since the "inlet" in FIG. 9 is "voltage present," the most upstream "Lead Wire 1" is "charging." At this time, the downstream "Ground 1" is in a "disconnected" state. Since the "blade" adjacent to this "Lead Wire 1" is in an "open" state, it is considered that a strong induced voltage occurs on the "blade" as an electrical circuit phenomenon, and therefore the state is determined to be "strong induced voltage." Next, since "Lead Wire 2" adjacent to this "Blade" has its downstream "Ground 1" in a "disconnected" state, it is believed that a strong induced voltage will occur as an electrical circuit phenomenon, and so it is determined to have a "strong induced voltage." "Circuit Breaker Internal Conductor 1" is electrically connected to "Lead Wire 2," so it is determined to have a "strong induced voltage." Next, since "Circuit Breaker Internal Conductor 2" is in an "open" state, it does not have the same "strong induced voltage" as "Circuit Breaker Internal Conductor 1." "Circuit Breaker Internal Conductor 2" and "Lead Wire 3," which is electrically connected to "Circuit Breaker Internal Conductor 2," have their downstream "Ground 3" in a "disconnected" state, so it is believed that a weak induced voltage will occur as an electrical circuit phenomenon, and so it is determined to have a "weak induced voltage." Note that when the current is "negative," the lead-in point is the most downstream point.

[0069] In the third stage, the electric circuit state identification unit 153 identifies the voltage state of an equipment structure (object) having a voltage attribute of "quasi-charging portion." For example, in the electric circuit model created in the second stage, the electric circuit state identification unit 153 identifies the voltage state of an equipment structure (object) having a voltage attribute of "quasi-charging portion" according to the voltage state, attachment / detachment state, and open / close state of adjacent objects in accordance with an electric circuit phenomenon (such as electrostatic induction). For example, according to the voltage state, open / close state, and ground state of adjacent equipment structures (objects), the electric circuit state identification unit 153 sets the induced voltage from a charging portion in the "charging" state to "strong induced voltage." According to the voltage state, open / close state, and ground state of adjacent equipment structures (objects), the electric circuit state identification unit 153 sets the induced voltage from a charging portion in the "strong induced voltage" state to "weak induced voltage," and sets the induced voltage from a charging portion in the "weak induced voltage" state to "weak induced voltage." For the "quasi-charging portion" equipment structure (object), the electric circuit state identification unit 153 selects one of "no voltage," "weak induced voltage," or "strong induced voltage" to identify the voltage state of the object.

[0070] Furthermore, the electrical circuit state specifying unit 153 specifies whether or not to display a predetermined facility structure and the distance to display, based on the display pattern set in the display pattern setting unit 152.

[0071] The electrical circuit state specifying unit 153 generates a menu table in which the display mode of the 3D hologram is set based on the specified electrical circuit state. The menu table can set the voltage state of the equipment structure specified by the electrical circuit state specifying unit 153 as the display mode (visual representation) of the 3D hologram of the object corresponding to the equipment structure.

[0072] The display mode can be set to any of the following voltage states: "no voltage," "weak induced voltage," "strong induced voltage," or "charging." The voltage state set as the display mode can define the display form of the 3D hologram, such as color, pattern, animation, and other visual representations.

[0073] The electrical circuit state specifying unit 153 also sets in the menu table whether to display the specified predetermined equipment structure and the distance at which to display it. The electrical circuit state specifying unit 153 generates a menu table in which, for each of a plurality of states included in one menu, the display mode of the 3D hologram arranged in the mapping data, whether to display the predetermined equipment structure, and the distance at which to display it are set.

[0074] The storage data generation unit 154 generates a data set as mixed reality data including the facility name and voltage class received by the facility information setting unit 14, the mapping data generated by the object placement unit 13, multiple menus including the menu table generated by the electrical circuit condition identification unit 153, and associations between these, and stores the data set as mixed reality data 22 in the memory unit 20.

[0075] The QR code generation unit 16 generates a QR code linked to the storage location of the mixed reality data 22. Since the generated QR code is linked to the storage location of the mixed reality data 22, it indicates a method for acquiring the mixed reality data. The generated QR code is held and displayed in a fixed state at a predetermined location, such as a floor, wall, or device, of a facility, so that the position and direction when the QR code is read can be identified when generating mixed reality in the facility where the spatial shape is acquired. That is, a two-dimensional QR code has horizontal and vertical directions, i.e., x and y axes, and the height from the floor where the code is placed is the z axis. Therefore, if the QR code is placed at a pre-registered position (height and direction) and read, the x, y, and z coordinates are uniquely determined. The QR code may be any code image that represents predetermined information, such as a two-dimensional code or a three-dimensional code, representing an identification code. The code image has a directionality that allows the top, bottom, left, and right directions to be identified. The predetermined information displayed in the generated QR code includes information indicating a method for acquiring the mixed reality data, and is linked to the storage location of the mixed reality data 22, for example.

[0076] The network 200 is a communication network such as the Internet, and can realize communication between the server 100 and the MR device 300.

[0077] The MR device 300 is a head-mounted display (HMD) type device worn on the user's head. The MR device 300 is equipped with a spatial shape recognition means (sensing device) such as a depth sensor for acquiring spatial shapes, a display device that displays in the user's field of view so that the user can visually recognize mixed reality in which a virtual image, a 3D hologram, is superimposed on real space, and a device controller 310 that controls these devices and executes various processes. The MR device 300 may also be equipped with a sensing device such as a gyro sensor for grasping the position and direction that change depending on the user's behavior when worn on the user's head.

[0078] The sensing device and display device are not specifically illustrated. The sensing device can measure the spatial shape in front of the user and can also function as an input device that performs input by recognizing the user's gestures. The display device is a device that realizes mixed reality by displaying a virtual image superimposed on a real image actually visible in the user's field of view without blocking the user's forward field of view.

[0079] The device controller 310 includes a spatial shape acquisition unit 311 , a 3D map generation unit 312 , a mixed reality data acquisition unit 313 , a menu selection unit 314 , and a display processing unit 315 .

[0080] The spatial shape acquisition unit 311 acquires the spatial shape by measuring the target object through 3D scanning using a spatial shape recognition means such as a depth sensor mounted on the MR device 300 and capturing the spatial shape. When the user wears the MR device 300, the spatial shape acquisition unit 311 acquires the spatial shape of the space that unfolds in front of the user. In this embodiment, since the device is intended for use in a facility that includes equipment that generates voltage conditions, such as power equipment, the spatial shape acquisition unit 311 acquires the spatial shape of the facility including the power equipment.

[0081] The 3D map generation unit 312 generates a 3D map of the power facility from the captured spatial shape. In this embodiment, a 3D map of the facility including the power facility is generated. When the user changes the direction or moves their head while wearing the MR device 300 on their head, the spatial shape acquisition unit 311 acquires a new spatial shape, and the 3D map is updated.

[0082] The mixed reality data acquisition unit 313 reads a QR code displayed while fixed to the floor, wall, or equipment of a facility, and acquires the mixed reality data indicated by the QR code. The QR code is linked to a storage location of pre-generated mixed reality data, so the mixed reality data can be acquired by reading the code image.

[0083] The menu selection unit 314 accepts an input to select a menu included in the acquired mixed reality data. The menu selection is performed, for example, by displaying a menu name as a virtual image on a display device and accepting a user selection. If the mixed reality data acquired by the mixed reality data acquisition unit 313 includes multiple menus, the menu name can be used to select one of the menus. By selecting one menu from the menu included in the mixed reality data, the user can select what they want to achieve. The menu name may or may not indicate the contents of the menu.

[0084] When the menu selection unit 314 accepts a menu selection, the display processing unit 315 displays the menu as a virtual image on a display device, or displays a 3D hologram linked to an area of ​​the 3D map based on mapping data included in the mixed reality data. Because the 3D map corresponds to real power equipment present in the user's field of view, the user can view a mixed reality configured so that a 3D hologram, which is a virtual image, is superimposed on the devices and electrical circuits that make up the real power equipment present in the user's field of view.

[0085] Furthermore, the display processing unit 315 recognizes the user's position and orientation according to the read state of the QR code by the mixed reality data acquisition unit 313, and causes the mapping data included in the mixed reality data acquired by the mixed reality data acquisition unit 313 to be superimposed on the 3D map generated by the 3D map generation unit 312. The display processing unit 315 can map objects associated with the mapping data onto the 3D map generated by the 3D map generation unit 312, thereby corresponding them to the power equipment in front of the user. As a result, a 3D hologram can be displayed superimposed on the real power equipment visible in front of the user. In other words, the display processing unit 315 can display a mixed reality image including an image of the real power equipment and a 3D hologram, which is a virtual image, in the user's field of view.

[0086] Next, the operation of the voltage status visualization system described above will be described. In the voltage status visualization system of this embodiment, in order to realize mixed reality (simulation) that visualizes the voltage status, mixed reality data generated in accordance with the spatial shape of the facility is required. Therefore, in the voltage status visualization system, pre-processing is performed in the server 100 to generate mixed reality data that visualizes the voltage status. First, the pre-processing performed in the server 100 will be described.

[0087] [Preparation work] In this example, in the preliminary work, mixed reality data is generated that can be used to perform a simulation that visualizes the approach distance to the live part as a first menu, a simulation that visualizes the voltage state in the power equipment when the electric circuit is in use as a second menu, and a simulation that visualizes the voltage state in the power equipment when the electric circuit is stopped as a third menu.

[0088] FIG. 5 is a diagram illustrating an example of the pre-processing.

[0089] First, the spatial shape acquisition unit 11 3D scans the facility including the power facility to acquire the spatial shape (step S101). The 3D map generation unit 12 generates a 3D map based on the acquired spatial shape (step S102).

[0090] The facility information setting unit 14 accepts input of facility information of the facility whose spatial shape was acquired in step S101 (step S103). The operator can input the facility information from the input means of the server 100. As the facility information, input of the facility name, the voltage class of the power equipment, etc. can be accepted.

[0091] Once the 3D map is generated, the object placement unit 13 accepts placement of objects for the generated 3D map (step S104). The object placement unit 13 can place objects by linking the objects defined in the object table to areas of the generated 3D map. In this embodiment, objects having object names such as "lead wire," "ground," "insulator," "blade," "insulator," "insulator," "ground," "lead wire," "insulator," "circuit breaker inner conductor," "circuit breaker inner conductor," "insulator," "ground," and "lead wire" are linked to areas corresponding to the equipment of the power facility and the facility structure that constitutes the electrical path in order from the upstream of the electrical path in the 3D map. Once linked, symbols may be assigned to identify individual objects with the same object name.

[0092] For example, when an operator inputs an icon in the form of a 3D object onto the 3D map displayed on the display of the server 100 using the input means of the server 100, the object placement unit 13 can accept the placement of the object onto the 3D map.

[0093] Furthermore, when accepting the placement of an object, the object placement unit 13 accepts settings that define a device or an electrical circuit for the placed object. It is defined that "Lead Wire 1" is an equipment structure that constitutes the "receiving section," "Insulator 1," "Blade," "Insulator 2," and "Insulator 3" are equipment structures that constitute the "disconnector," and "Insulator 4," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," and "Insulator 5" are equipment structures that constitute the "circuit breaker." "Lead Wire 2" is defined as an "electrical circuit" between the "disconnector" and the "circuit breaker," and "Lead Wire 3" is defined as an "electrical circuit" downstream of the "circuit breaker."

[0094] The mixed reality data generating unit 15 generates mixed reality data for the mapping data, which is a 3D map in which the object is arranged (step S105). Here, the process of generating mixed reality data will be described.

[0095] FIG. 6 is a diagram illustrating an example of the mixed reality data generation process.

[0096] In the mixed reality data generation process, device state setting unit 151 accepts input of a menu name and sets the menu (step S51). In this example, first, mixed reality data for performing a simulation that visualizes the charging unit approach distance is generated as the first menu, so input of the menu name "charging unit approach distance" is accepted. The menu name may indicate the content of the simulation, or may be a simple identification symbol, etc.

[0097] The device state setting unit 151 accepts settings of device states included in the menu set in step S51 (step S52). In this example, device state settings in multiple states are accepted for each of "inlet," "ground 1," "disconnector," "ground 2," "circuit breaker," and "ground 3," which are arranged in order from upstream of the electrical circuit on the 3D map. The first menu accepts settings of device states in five states.

[0098] The display pattern setting unit 152 receives settings for display patterns of electric paths and separation distances for each of a plurality of device states included in the menu (step S53). In this example, the display pattern setting unit 152 receives settings for whether to display the induced voltage of the insulator, whether to display the separation distance, and what type of separation distance to display for each of the five states included in the first menu.

[0099] FIG. 7 is a diagram showing an example of settings in the device status setting table in the first menu.

[0100] When the settings are accepted by the device state setting unit 151 and the display pattern setting unit 152, a device state setting table shown in Fig. 7 may be created. As shown in Fig. 7, it can be seen that the device states in five states are set in the first menu. In the first state, "receiving section" is set to "voltage present," "earth 1" is set to "not grounded (disconnected)," "disconnector" is set to "closed state," "earth 2" is set to "not grounded (disconnected)," "circuit breaker" is set to "closed state," and "earth 3" is set to "not grounded (disconnected)." In the first state, the induced voltage of the insulator is not displayed, and the separation distance is also not displayed.

[0101] As shown in FIG. 7 , the same equipment state is set in each of the second to fifth states, but the display pattern is different in the second to fifth states. In the second state, the induced voltage of the insulator is displayed, and the separation distance is hidden. In the third state, the induced voltage of the insulator is hidden, and the separation distance is displayed as separation distance 1. In the fourth state, the induced voltage of the insulator is hidden, and the separation distance is displayed as separation distance 2. In the fifth state, the induced voltage of the insulator is hidden, and the separation distance is displayed as separation distance 3. The first separation distance is set to, for example, 75 cm as safety distance 1, the second separation distance is set to, for example, 135 cm as safety distance 2, and the third separation distance is set to, for example, 4 m as the allowable approach limit for construction machinery. In step S103, the separation distance set as the voltage class of the power equipment can be extracted. The separation distance can be displayed by a cloud-like area around the 3D object.

[0102] The electric circuit state identifying unit 153 identifies the voltage state, open / close state, attached / detached state, and display state of the object related to the device and the electric circuit as the electric circuit state based on the set device state and display pattern (step S54). In this example, the electric circuit state identifying unit 153 identifies the electric circuit state based on the setting shown in FIG.

[0103] In the first state of Fig. 7, the "receiving portion" is "voltage applied," the "disconnector" and "circuit breaker" are "closed," and "ground 1," "ground 2," and "ground 3" are "not grounded (disconnected)," so the electric circuit state identification unit 153 first identifies the open / closed state of the objects and the grounding connection / disconnection state in the first stage, identifies the voltage state of the "charged portion" object in the second stage, and identifies the voltage state of the "quasi-charged portion" object in the third stage. Also, in the first state of Fig. 7, the induced voltage of the insulator is set to not be displayed, so the electric circuit state identification unit 153 identifies the display state of the insulator as not being displayed.

[0104] The electrical circuit state specifying unit 153 generates a menu table shown in FIG. 8, which indicates the display mode of the 3D hologram, based on the specified electrical circuit state (step S55).

[0105] FIG. 8 is a diagram showing a display mode table for the first menu.

[0106] When the electric circuit state specifying unit 153 specifies the electric circuit state, it generates the menu table shown in Fig. 8. It can be seen from the menu table in Fig. 8 that the display modes for the 3D objects "Lead 1", "Ground 1", "Insulator 1", "Blade", "Insulator 2", "Insulator 3", "Ground 2", "Lead 2", "Insulator 4", "Circuit breaker internal conductor 1", "Circuit breaker internal conductor 2", "Insulator 5", "Ground 3", and "Lead 3" are shown for each of the five states set in the first menu.

[0107] According to the menu table shown in Figure 8, in the first state, the 3D objects placed on "Lead Wire 1", "Blade", "Lead Wire 2", "Circuit Breaker Internal Conductor 1", "Circuit Breaker Internal Conductor 2", and "Lead Wire 3" are displayed in a display mode indicating the "charging" state, and it can be seen that "Ground 1", "Insulator 1", "Insulator 2", "Insulator 3", "Ground 2", "Insulator 4", "Insulator 5", and "Ground 3" are not displayed.

[0108] When the menu table for the first menu is generated in the electrical circuit state specifying unit 153, the device state setting unit 151 determines whether or not there is a next menu to be set (step S56), and if there is a next menu to be set (step S56: Yes), the process returns to step S51. Whether or not there is a next menu to be set can be determined by, for example, accepting an input from the operator.

[0109] In this embodiment, after a menu table for the first menu is generated, the processing from step S52 to step S56 is repeated, and mixed reality data is generated as the second menu to simulate the visualization of the voltage state in the power equipment when the electric circuit is in use.Therefore, input of the menu name "electric circuit use operation" is accepted, the settings shown in Figure 9 are made, and the menu table shown in Figure 10 is generated.

[0110] Fig. 9 shows an example of setting the device status and display pattern in the second menu, and Fig. 10 shows a menu table for the second menu.

[0111] Furthermore, in this embodiment, after the menu table for the second menu is generated, the processing from step S52 to step S56 is repeated, and mixed reality data is generated as the third menu to simulate the visualization of the voltage state in the power equipment when the electric circuit is stopped.Therefore, input of the menu name "electric circuit stop operation" is accepted, the settings shown in Figure 11 are made, and the menu table shown in Figure 12 is generated.

[0112] Fig. 11 shows an example of setting the device status and display pattern in the second menu, and Fig. 12 shows a menu table for the second menu.

[0113] If it is determined in step S56 that there is no next menu to set (step S56: No), the storage data generation unit 154 generates a data set as mixed reality data 22 including the facility name and voltage class set in step S103, the mapping data generated in step S104, multiple menus including the menu table generated in step S55, and associations between these, and stores the data set in the memory unit 20 (step S57).

[0114] FIG. 13 is a diagram illustrating an example of an association table included in the mixed reality data.

[0115] The table shown in Fig. 13 includes QR code identifiers, facility names, voltage classes, mapping data, menus, and their associations. In the example shown in Fig. 13, two voltage classes, A and B, are set for substation A. It can also be seen that there is mapping data for each voltage class, and that multiple menus are set for each mapping data.

[0116] 5, the QR code generator 16 generates a QR code indicating the storage location of the mixed reality data 22 (step S106). The generated QR code is displayed and held in a fixed state on a predetermined location on the floor, wall, or equipment of the facility so that it can be read when generating mixed reality at an accurate position in the facility where the spatial shape has been acquired.

[0117] [Mixed reality realization processing] Next, in the voltage status visualization system of this embodiment, mixed reality data is generated in the above-described preliminary work, and in a facility where a QR code is displayed, a user can realize mixed reality by wearing the MR device 300 on their head and executing a mixed reality realization process. The MR device 300 realizes mixed reality based on the three menus generated in the above-described preliminary work. The mixed reality realization process in the MR device 300 will be described.

[0118] FIG. 14 is a diagram illustrating an example of a process for realizing mixed reality.

[0119] In a facility where mixed reality data has been generated in advance and a QR code has been displayed, when a user wears the MR device 300 on their head, the spatial shape acquisition unit 311 in the MR device 300 acquires the spatial shape of the object in front of the user measured by the sensing device performing a 3D scan (step S201).

[0120] The 3D map generating unit 312 generates a 3D map from the spatial shape acquired by the spatial shape acquiring unit 311 (step S202).

[0121] Steps S201 and S202 are repeated every time the object in front of the user that is measured by the sensing device of the MR device 300 changes as the user moves or changes the direction of his or her head.

[0122] Furthermore, when the user points the sensing device of the MR device 300 at the QR code, the mixed reality data acquisition unit 313 reads the QR code (step S203). At this time, the mixed reality data acquisition unit 313 can recognize the user's position and direction from the direction of the QR code, the state of the 3D map at the time of reading, and a sensing device such as a gyro sensor.

[0123] The mixed reality data acquisition unit 313 acquires the mixed reality data stored in the storage unit 20 from the information of the read QR code (step S204).

[0124] When the MR device 300 acquires mixed reality data, the menu selection unit 314 accepts an input to select a menu included in the acquired mixed reality data (step S205). In this embodiment, the mixed reality data includes a first menu item, "Charging Unit Approach Distance," a second menu item, "Operation to Use Electric Circuit," and a first menu item, "Operation to Stop Electric Circuit." For example, the menu selection unit 314 can accept an input to select a menu by displaying these menu items as virtual images on a display device and recognizing, via a sensing device, that the user has selected one of the menu items through a gesture.

[0125] The menu selection unit 314 reads out the menu table of the selected menu and passes it to the display processing unit 315 .

[0126] The display processing unit 315 overlays the mapping data included in the mixed reality data acquired by the mixed reality data acquisition unit 313 onto the 3D map generated by the 3D map generation unit 312, thereby displaying the objects associated with the mapping data on the 3D map generated by the 3D map generation unit 312 (step S206). That is, the display processing unit 315 determines in which area of ​​the 3D map generated by the 3D map generation unit 312 the 3D hologram should be displayed. At this time, information from the sensing device when the QR code was read is also referenced.

[0127] Display processing unit 315 further determines the display mode of the object's 3D hologram according to the menu table of the menu, and displays the 3D hologram at the determined position in the determined display mode (step S207). At this time, since the menu table sets the display modes of the 3D hologram in multiple states, display processing unit 315 switches between the multiple display modes to display the 3D hologram. This allows display processing unit 315 to display the 3D hologram in a visual representation that corresponds to the voltage state, which changes depending on whether the device is open or closed, or whether it is grounded (connected or disconnected). For example, when electricity is flowing, the pattern can be animated to appear to be flowing in one direction.

[0128] Furthermore, in the MR device 300, each time the user moves or changes the direction of their head, the 3D map generation unit 312 generates a 3D map from the spatial shape acquired by the spatial shape acquisition unit 311. Each time a 3D map is generated, the display processing unit 315 changes the display position of the 3D hologram and displays it. In other words, even if the user moves or changes the direction of their head, the 3D hologram is displayed superimposed on a predetermined facility structure.

[0129] Here, we will explain the mixed reality seen by a user wearing the MR device 300 in the voltage status visualization system of this embodiment. Mixed reality can be realized by displaying a virtual image (3D hologram) superimposed on the actual image seen by the user.

[0130] Figure 15 shows the state of the facility as seen by the user when mixed reality is not realized. Figures 16A to 16E show the state of the facility as seen by the user in mixed reality in the first menu. Figures 17A to 17E show the state of the facility as seen by the user in mixed reality in the second menu. Figures 18A to 18G show the state of the facility as seen by the user in mixed reality in the third menu.

[0131] [First Menu] As shown in Figure 15, when mixed reality is not realized, 3D holograms and the like are not displayed, and the state of the facility in front of you is seen as it is.

[0132] First, when the first menu is selected in step S205 of the mixed reality realization processing in the MR device 300, the mixed reality shown in FIGS. 16A to 16E is realized based on the menu table of the first menu shown in FIG.

[0133] FIG. 16A illustrates a mixed reality realized as the first state of the first menu. In the menu table illustrated in FIG. 8, 3D hologram 1 of "Lead Wire 1," 3D hologram 3 of "Blade," 3D hologram 8 of "Lead Wire 2," 3D hologram 10 of "Circuit Breaker Internal Conductor 1," 3D hologram 11 of "Circuit Breaker Internal Conductor 2," and 3D hologram 14 of "Lead Wire 3" are displayed in a display manner indicating the "Charged" state, while 3D holograms of "Ground 1," "Insulator 1," "Insulator 2," "Insulator 3," "Ground 2," "Insulator 4," "Insulator 5," and "Ground 3" are not displayed. From the first menu to the third menu, "Ground" is not displayed in the "Disconnected" state. Based on this setting, the mixed reality illustrated in FIG. 16A is realized.

[0134] As shown in FIG. 16A, the mixed reality displays a "Next" icon 30, a "Back" icon 31, and a "Menu" icon 32. When the "Next" icon 30 is selected, the display processing unit 315 changes the mixed reality from a first state to a second state. Similarly, when the "Back" icon 31 is selected in the second state, the display processing unit 315 changes the mixed reality to the first state. When the "Menu" icon 32 is selected, the display processing unit 315 displays a menu included in the mixed reality data.

[0135] Figure 16B shows a mixed reality realized as the second state of the first menu. In the menu table shown in Figure 8, the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," "Circuit Breaker Inner Conductor 1," "Circuit Breaker Inner Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating the "charging" state, while the 3D holograms of "Insulator 1" 3D hologram 5, "Insulator 2" 3D hologram 6, "Insulator 4" 3D hologram 9, and "Insulator 5" 3D hologram 12 are displayed in a "strong induced voltage" state, and the 3D holograms of "Ground 1," "Ground 2," and "Ground 3" are not displayed. Based on this setting, the mixed reality shown in Figure 16B is realized.

[0136] Fig. 16C shows a mixed reality realized as a third state of the first menu. The menu table shown in Fig. 8 shows that the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," "Circuit Breaker Inner Conductor 1," "Circuit Breaker Inner Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating the "charging" state, while the 3D holograms of "Ground 1," "Insulator 1," "Insulator 2," "Insulator 3," "Ground 2," "Insulator 4," "Insulator 5," and "Ground 3" are not displayed. Furthermore, it is set that the first separation distance display 15 is displayed for "Lead Wire 1," "Blade," "Lead Wire 2," and "Lead Wire 3." Based on this setting, the mixed reality shown in Fig. 16C is realized.

[0137] Fig. 16D shows a mixed reality realized as a fourth state of the first menu. The menu table shown in Fig. 8 shows that the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," "Circuit Breaker Inner Conductor 1," "Circuit Breaker Inner Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating the "charging" state, while the 3D holograms of "Ground 1," "Insulator 1," "Insulator 2," "Insulator 3," "Ground 2," "Insulator 4," "Insulator 5," and "Ground 3" are not displayed. Furthermore, it is also set that the second separation distance display 15 is displayed for "Lead Wire 1," "Blade," "Lead Wire 2," and "Lead Wire 3." Based on this setting, the mixed reality shown in Fig. 16D is realized.

[0138] FIG. 16E illustrates a mixed reality realized as the fifth state of the first menu. The menu table illustrated in FIG. 8 indicates that the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating the "charging" state, while the 3D holograms of "Ground 1," "Insulator 1," "Insulator 2," "Insulator 3," "Ground 2," "Insulator 4," "Insulator 5," and "Ground 3" are not displayed. Furthermore, it is configured that a third separation distance is displayed for "Lead Wire 1," "Blade," "Lead Wire 2," and "Lead Wire 3." Based on this setting, the mixed reality illustrated in FIG. 16E is realized. In FIG. 16E, the third separation distance is 4 m, which is large and covers the entire field of view.

[0139] [Second Menu] Next, when the second menu is selected on the MR device 300, the mixed reality shown in FIGS. 17A to 17E is realized based on the menu table of the second menu shown in FIG.

[0140] 17A illustrates a mixed reality realized as the first state of the second menu. The menu table shown in FIG. 10 shows that the 3D holograms of "Lead Wire 1" and "Blade" are displayed in a display mode indicating a "strong induced voltage" state, the 3D holograms of "Insulator 1" and "Insulator 2" are displayed in a display mode indicating a "weak induced voltage" state, and the 3D holograms of "Insulator 3," "Lead Wire 2," "Insulator 4," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," "Insulator 5," and "Lead Wire 3" are displayed in a display mode indicating a "no voltage" state. The 3D hologram of "Ground 1" is not displayed, and the 3D hologram 7 of "Ground 2" and the 3D hologram 13 of "Ground 3" are displayed. Furthermore, the menu table shows that the "Blade" is set to "open," so the 3D object of the "Blade" is rotating. In this embodiment, the position of the 3D object is not displaced, but since "Circuit Breaker Inner Conductor 1" and "Circuit Breaker Inner Conductor 2" are also set to "Open" in the menu table, the position of the 3D object may be displaced to visually recognize that the circuit breaker is in the open state. Based on this setting, the mixed reality shown in FIG. 17A is realized.

[0141] Figure 17B shows a mixed reality realized as the second state of the second menu. The menu table shown in Figure 10 shows that the 3D hologram of "Lead Wire 1" is displayed in a display mode indicating the "charging" state, the 3D holograms of "Insulator 1" and "Blade" are displayed in a display mode indicating the "strong induced voltage" state, the 3D hologram of "Insulator 2" is displayed in a display mode indicating the "weak induced voltage" state, and the 3D holograms of "Insulator 3," "Lead Wire 2," "Insulator 4," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," "Insulator 5," and "Lead Wire 3" are displayed in a display mode indicating the "no voltage" state. The 3D hologram of "Ground 1" is not displayed, and the 3D holograms of "Ground 2" and "Ground 3" are displayed. Based on this setting, the mixed reality shown in Figure 17B is realized.

[0142] In the state shown in Figure 17B, the disconnector is open, so it can be seen that no current flows through lead wire 2 downstream of the disconnector blade. It can also be seen that ground 2 is in a grounded state, and insulator 3 connected to it is in a "no voltage" state.

[0143] Figure 17C shows a mixed reality realized as a third state of the second menu. The menu table shown in Figure 10 shows that the 3D hologram of "Lead Wire 1" is displayed in a display mode indicating the "charging" state, the 3D holograms of "Insulator 1," "Blade," "Lead Wire 2," and "Circuit Breaker Internal Conductor 1" are displayed in a display mode indicating the "strong induced voltage" state, and the 3D holograms of "Insulator 2," "Insulator 3," "Insulator 4," "Circuit Breaker Internal Conductor 2," "Insulator 5," and "Lead Wire 3" are displayed in a display mode indicating the "weak induced voltage" state. It is also set that the 3D holograms of "Ground 1," "Ground 2," and "Ground 3" are not displayed.

[0144] In the state of Figure 17C, the disconnector is open, so it can be seen that no current flows in lead wire 2 downstream of the disconnector blade. Unlike the second state, ground 2 is in an ungrounded (disconnected) state, so it can be seen that insulator 3 connected to it has a "weak induced voltage."

[0145] Figure 17D shows a mixed reality realized as the fourth state of the second menu. The menu table shown in Figure 10 shows that the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," and "Circuit Breaker Internal Conductor 1" are displayed in a display mode indicating a "charging" state, the 3D holograms of "Insulator 1," "Insulator 2," "Insulator 3," "Insulator 4," "Circuit Breaker Internal Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating a "strong induced voltage" state, and the 3D hologram of "Insulator 5" is displayed in a display mode indicating a "weak induced voltage" state. It is also set that the 3D holograms of "Ground 1," "Ground 2," and "Ground 3" are not displayed. Based on this setting, the mixed reality shown in Figure 17D is realized.

[0146] In the state shown in Figure 17D, the disconnector is closed, so it can be seen that current also flows in lead wire 2 downstream of the disconnector blade. Unlike the third state, ground 2 is ungrounded (disconnected), so it can be seen that insulator 3 connected to it is experiencing a "strong induced voltage."

[0147] Figure 17E shows a mixed reality realized as the fifth state of the second menu. The menu table shown in Figure 10 shows that the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating the "Charging" state, and the 3D holograms of "Insulator 1," "Insulator 2," "Insulator 3," "Insulator 4," and "Insulator 5" are displayed in a display mode indicating the "Strong Induced Voltage" state. It is also set that the 3D holograms of "Ground 1," "Ground 2," and "Ground 3" are not displayed. Based on this setting, the mixed reality shown in Figure 17E is realized.

[0148] In the state of Figure 17E, the disconnector and circuit breaker are closed, so it can be seen that current also flows downstream of the disconnector blade and downstream of the circuit breaker's "internal conductor 2." Since earth 3 is in an ungrounded state (disconnected), it can be seen that the insulator 5 connected to it is experiencing a "strong induced voltage."

[0149] [Third Menu] When the third menu is selected on the MR device 300, the mixed reality shown in FIGS. 18A to 18G is realized based on the menu table of the third menu shown in FIG.

[0150] Fig. 18A shows a mixed reality realized as the first state of the third menu. In the menu table shown in Fig. 12, 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating the "charged" state, while "Ground 1," "Ground 2," and "Ground 3" are set to be in the "disconnected" state, so these 3D holograms are not displayed. "Insulator 1," "Insulator 2," "Insulator 3," "Insulator 4," and "Insulator 5" are set to "hide," so these 3D holograms are not displayed either. Based on this setting, the mixed reality shown in Fig. 18A is realized.

[0151] Figure 18B shows a mixed reality realized as the second state of the third menu. The menu table shown in Figure 12 shows that the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating a "charging" state, and the 3D holograms of "Insulator 1," "Insulator 2," "Insulator 3," "Insulator 4," and "Insulator 5" are displayed in a display mode indicating a "strong induced voltage" state. It is also set that the 3D holograms of "Ground 1," "Ground 2," and "Ground 3" are not displayed. Based on this setting, the mixed reality shown in Figure 18B is realized.

[0152] Figure 18C shows a mixed reality realized as a third state of the third menu. The menu table shown in Figure 12 shows settings such that the 3D holograms of "Lead Wire 1," "Blade," "Lead Wire 2," and "Circuit Breaker Internal Conductor 1" are displayed in a display mode indicating a "charging" state, and the 3D holograms of "Insulator 1," "Insulator 2," "Insulator 3," "Insulator 4," "Circuit Breaker Internal Conductor 2," and "Lead Wire 3" are displayed in a display mode indicating a "strong induced voltage" state. It is also set that the 3D hologram of "Insulator 5" is displayed in a display mode indicating a "weak induced voltage" state, and the 3D holograms of "Ground 1," "Ground 2," and "Ground 3" are not displayed. Based on this setting, the mixed reality shown in Figure 18C is realized.

[0153] Figure 18D shows a mixed reality realized as the fourth state of the third menu. The menu table shown in Figure 12 shows settings such that the 3D hologram of "Lead Wire 1" is displayed in a display mode indicating the "charging" state, and the 3D holograms of "Insulator 1," "Blade," "Lead Wire 2," and "Circuit Breaker Internal Conductor 1" are displayed in a display mode indicating the "strong induced voltage" state. It is also set that the 3D holograms of "Insulator 1," "Insulator 2," "Insulator 3," "Insulator 4," "Circuit Breaker Internal Conductor 2," "Insulator 5," and "Lead Wire 3" are displayed in a display mode indicating the "weak induced voltage" state, and the 3D holograms of "Ground 1," "Ground 2," and "Ground 3" are not displayed. Based on this setting, the mixed reality shown in Figure 18D is realized.

[0154] FIG. 18E shows a mixed reality realized as the fifth state of the third menu. In the menu table shown in FIG. 12, it is set that the 3D hologram of "Lead Wire 1" is displayed in a display mode indicating the "charging" state, and the 3D holograms of "Insulator 1," "Blade," "Lead Wire 2," and "Circuit Breaker Internal Conductor 1" are displayed in a display mode indicating the "strong induced voltage" state. It is also set that the 3D holograms of "Insulator 2," "Insulator 3," and "Insulator 4" are displayed in a display mode indicating the "weak induced voltage" state, and the 3D hologram of "Ground 3" is displayed as a "grounded (connected) state." It is also set that the 3D holograms of "Circuit Breaker Internal Conductor 2," "Lead Wire 3," and "Insulator 5" are displayed in a display mode indicating the "no voltage" state. It is also set that the 3D holograms of "Ground 1" and "Ground 2" are not displayed. Based on this setting, the mixed reality shown in FIG. 18E is realized.

[0155] FIG. 18F shows a mixed reality realized as the sixth state of the third menu. In the menu table shown in FIG. 12, it is set that the 3D hologram of "Lead Wire 1" is displayed in a display mode indicating the "charging" state, and the 3D holograms of "Insulator 1" and "Blade" are displayed in a display mode indicating the "strong induced voltage" state. It is also set that the 3D hologram of "Insulator 2" is displayed in a display mode indicating the "weak induced voltage" state, and the 3D holograms of "Ground 2" and "Ground 3" are displayed as "grounded (connected) state." It is also set that the 3D holograms of "Lead Wire 2," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," "Lead Wire 3," "Insulator 3," "Insulator 4," and "Insulator 5" are displayed in a display mode indicating the "no voltage" state. It is also set that the 3D hologram of "Ground 1" is not displayed. Based on this setting, the mixed reality shown in FIG. 18F is realized.

[0156] FIG. 18G shows a mixed reality realized as the seventh state of the third menu. In the menu table shown in FIG. 12, it is set that the 3D holograms of "Lead Wire 1" and "Blade" are displayed in a display mode indicating a "strong induced voltage" state. It is set that the 3D holograms of "Insulator 1" and "Insulator 2" are displayed in a display mode indicating a "weak induced voltage" state, and the 3D holograms of "Ground 2" and "Ground 3" are displayed as a "grounded (grounded) state." It is set that the 3D holograms of "Lead Wire 2," "Circuit Breaker Internal Conductor 1," "Circuit Breaker Internal Conductor 2," "Lead Wire 3," "Insulator 3," "Insulator 4," and "Insulator 5" are displayed in a display mode indicating a "no voltage" state. It is also set that the 3D hologram of "Ground 1" is not displayed. Based on this setting, the mixed reality shown in FIG. 18G is realized.

[0157] According to the voltage status visualization system of the present embodiment, the voltage status and separation distance of the devices and electrical circuits that make up the actually existing power facility can be visualized and provided to the user.

[0158] (Extended embodiments) The invention made by the present inventors has been specifically described above based on an embodiment, but it goes without saying that the invention is not limited thereto and can be modified in various ways without departing from the spirit of the invention.

[0159] The voltage status visualization system of the above embodiment has been described using an example of a configuration in which multiple MR devices 300 communicate with the server 100 as clients, but is not limited to this. For example, the MR devices 300 may have some or all of the functions of the server 100. Furthermore, although the above embodiment has been described using an example in which the server 100 is configured by one computer, the server 100 may be configured by multiple computers.

[0160] The configurations of the server 100 and the MR device 300 in the above embodiments are merely examples, and are not limited to these block configurations. For example, other functional blocks may be added. The present invention is not limited to these configurations.

[0161] The data set generated by the storage data generation unit 154 as mixed reality data only needs to include at least the mapping data generated by the object placement unit 13 and the menu table generated by the electrical circuit state identification unit 153, and does not necessarily need to include facility names or voltage classes.

[0162] Furthermore, the tables shown in FIGS. 2, 3, 4, and 7 to 12 are also examples, and are not limited to these. For example, other columns may be substituted or other columns may be added.

[0163] 5, 6, and 14 are also examples, and are not limited to these. For example, other processes may be inserted between each step, or the processes may be parallelized. Also, for example, in FIG. 13, steps S201 and S202 may be executed after steps S203 and S204. [Explanation of symbols]

[0164] 100...server, 200...network, 300...MR device, 10...processing unit, 11...spatial shape acquisition unit, 12...3D map generation unit, 13...object placement unit, 14...facility information setting unit (an example of a voltage class setting unit), 15...mixed reality data generation unit, 16...QR code generation unit, 20...storage unit, 21...object data, 22...mixed reality data, 151...equipment status setting unit, 152...display pattern setting unit, 153...electrical circuit status identification unit, 154...stored data generation unit, 310...device controller, 311...spatial shape acquisition unit, 312...3D map generation unit, 313...mixed reality data acquisition unit, 314...menu selection unit, 315...display processing unit

Claims

1. a spatial shape acquisition unit that acquires the power equipment as a spatial shape; a 3D map generation unit that generates a 3D map of the power equipment from the captured spatial shape; a mixed reality data acquisition unit that reads the code image and acquires mixed reality data indicated by the code image; a display processing unit that displays a mixed reality image in the user's field of view, configured so that the objects corresponding to the equipment and electrical circuits that constitute the power facility, which are included in the mixed reality data, are superimposed on the real power facility by expanding the objects corresponding to the equipment and electrical circuits that constitute the power facility and are included in the mixed reality data onto a 3D map of the power facility, the mixed reality data includes a voltage state related to the device and the electrical circuit, and the display processing unit displays the object so as to have a visual representation according to the voltage state, which changes depending on whether the device is open or closed and whether it is grounded; the voltage state has a plurality of states including an uncharged state and a charged state; the display processing unit displays the visual representation of the object differently depending on which of the plurality of states the equipment and the electric circuit are in, and displays a distance at which a worker can ensure safety from the equipment and the electric circuit by using a cloud-like region around the object. Voltage status visualization system.

2. The voltage status visualization system according to claim 1, The voltage state has four states: a non-charged state, a state where a weak induced voltage is generated, a state where a strong induced voltage is generated, and a charged state. Voltage status visualization system.

3. 3. The voltage status visualization system according to claim 1, the mixed reality data includes a plurality of menus showing a plurality of visual representations of objects corresponding to a plurality of preset voltage states of devices and electric circuits that constitute the power facility; a menu selection unit that receives an input to select a menu to be displayed from the plurality of menus, and the display processing unit sequentially switches and displays a plurality of visual representations of the object shown in the selected menu. Voltage status visualization system.

4. The voltage status visualization system according to any one of claims 1 to 3, a spatial shape acquisition unit that acquires the power equipment as a spatial shape; a 3D map generation unit that generates a 3D map of the power equipment from the captured spatial shape; an object placement unit that accepts placement of objects corresponding to devices and electric circuits that configure the power facility on the 3D map; a mixed reality data generation unit that generates mixed reality data including a 3D map in which the object is arranged; a code image generation unit that stores the mixed reality data and generates a code image that indicates a method for acquiring the stored mixed reality data, the mixed reality data generation unit generates mixed reality data including a visual representation according to a voltage state setting for the device and the electric circuit corresponding to the object; Voltage status visualization system.

5. The voltage status visualization system according to claim 4, The object has a voltage attribute and is set to change to a voltage state according to the voltage attribute. Voltage status visualization system.

6. 6. The voltage status visualization system according to claim 4, a voltage class setting unit that accepts a setting of a voltage class of the power facility captured as the spatial shape, the object placement unit does not accept placement of objects other than objects corresponding to the set voltage class. Voltage status visualization system.

7. 7. The voltage status visualization system according to claim 4, The mixed reality data generation unit a device status setting unit that accepts settings for device statuses that are states of the devices and electrical circuits; a display pattern setting unit that receives settings for display patterns of voltage states and separation distances related to the devices and electrical circuits; an electrical circuit state specifying unit that specifies a voltage state and a display state related to the device and the electrical circuit based on the device state and the display pattern, when the electric circuit state specifying unit specifies a plurality of voltage states for one device and one electric circuit, it generates a menu table as a menu showing visual representations of objects corresponding to the plurality of voltage states of the device and the electric circuit for which the plurality of voltage states have been specified; Voltage status visualization system.

8. The voltage status visualization system according to claim 7, the mixed reality data generation unit further includes a storage data generation unit that generates, as mixed reality data, a data set including the 3D map in which the object is arranged and the menu table; Voltage status visualization system.

9. A method executed by at least one of a mixed reality realization device that realizes mixed reality in a user's field of view and a server that can communicate with the mixed reality realization device, a space shape acquisition step of capturing the power equipment as a space shape; a 3D map generation step of generating a 3D map of the power equipment from the captured spatial shape; a mixed reality data acquisition step of reading the code image and acquiring mixed reality data indicated by the code image; a display processing step of displaying a mixed reality image in the user's field of view, configured so that the objects corresponding to the equipment and electrical circuits constituting the power facility present in the user's field of view are superimposed on the real power facility by expanding the objects included in the mixed reality data and corresponding to the equipment and electrical circuits constituting the power facility onto a 3D map of the power facility, The mixed reality data includes a voltage state related to the device and the electrical circuit, and the display processing step displays the object so as to have a visual representation according to the voltage state; the voltage state has a plurality of states including an uncharged state and a charged state; In the display processing step, the visual representation of the object is displayed differently depending on which of the plurality of states the equipment and the electric circuit are in, and a distance at which a worker can ensure safety from the equipment and the electric circuit is displayed by a cloud-like region around the object. Voltage status visualization method.

10. 10. The voltage status visualization method according to claim 9, a space shape acquisition step of capturing the power equipment as a space shape; a 3D map generation step of generating a 3D map of the power equipment from the captured spatial shape; an object placement step of accepting placement of objects corresponding to devices and electric circuits constituting the power facility on the 3D map; a mixed reality data generation step of generating mixed reality data including a 3D map in which the object is arranged; a code image generating step of storing the mixed reality data and generating a code image indicating a method for acquiring the stored mixed reality data, In the mixed reality data generating step, mixed reality data including a visual representation according to a voltage state setting for a device and an electric circuit corresponding to the object is generated based on the voltage state setting. Voltage status visualization method.

11. At least one of a mixed reality realization device that realizes mixed reality in the user's field of view and a server that can communicate with the mixed reality realization device, a space shape acquisition means for acquiring the power equipment as a space shape; a 3D map generating means for generating a 3D map of the power equipment from the captured spatial shape; a mixed reality data acquisition means for reading the code image and acquiring the mixed reality data indicated by the code image; and functioning as a display processing means for displaying in the user's field of view a mixed reality image configured so that the objects corresponding to the equipment and electrical circuits constituting the power facility present in the user's field of view are superimposed on the real power facility by expanding the objects included in the mixed reality data and corresponding to the equipment and electrical circuits constituting the power facility onto a 3D map of the power facility; the mixed reality data includes a voltage state related to the device and the electrical circuit, and the display processing means displays the object so as to have a visual representation according to the voltage state; the voltage state has a plurality of states including an uncharged state and a charged state; the display processing means displays the visual representation of the object differently depending on which of the plurality of states the equipment and the electric circuit are in, and displays a distance at which a worker can ensure safety from the equipment and the electric circuit by using a cloud-like region around the object. Voltage status visualization program.

12. 12. The voltage status visualization program according to claim 11, a space shape acquisition means for acquiring the power equipment as a space shape; a 3D map generating means for generating a 3D map of the power equipment from the captured spatial shape; an object placement means for accepting placement of objects corresponding to devices and electric circuits constituting the power facility on the 3D map; a mixed reality data generating means for generating mixed reality data including a 3D map in which the object is arranged; storing the mixed reality data and causing the device to function as a code image generating means for generating a code image indicating a method for acquiring the stored mixed reality data; the mixed reality data generating means generates mixed reality data including a visual representation according to a voltage state setting for the device and the electric circuit corresponding to the object; Voltage status visualization program.

Images