Information processing system, information processing terminal, information processing device, information processing method, and information processing program

Abstract

To provide an information processing system that reliably grasps a facility that a party is paying attention to when communicating with each other through their terminals at remote locations.SOLUTION: An information processing system 100 includes selection information acquisition means 101 and transmission means 102.The selection information acquisition means 101 acquires selection information relating to selection of one of a plurality of apparatuses in a facility via a first terminal. The transmission means 102 transmits information of interest corresponding to the selection information to a second terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing terminal, an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Patent Document 1 discloses an image sharing system that can simultaneously share two types of image information, virtual reality (VR) and augmented reality (AR), between, for example, a design office and a construction site at each location. Specifically, a location AR image displayed on a terminal at the construction site is superimposed on a VR image displayed on a terminal at the design office. A location AR image displayed on a terminal at the construction site is superimposed on a VR image displayed on a terminal at the design office. The design staff at the design office and the construction staff at the construction site check where each other is looking on the image. This allows the two parties to proceed with the meeting while making sure that they are not looking at different places. It is said that this can improve communication. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-81943 Summary of the Invention [Problem to be solved by the invention]

[0004] By the way, a substation is made up of many pieces of equipment, including transformers, circuit breakers, disconnecting switches, instrument transformers, and lightning arresters. Depending on the size of the substation, there may be dozens of circuit breakers installed throughout the substation.

[0005] Under such circumstances, when the image sharing system disclosed in the above-mentioned Patent Document 1 is used, even if the site-side location AR image and the office-side VR image are mutually shared, it is not possible to accurately grasp which circuit breaker the other party is currently looking at. As a result, there is a risk that while both parties think they are talking about the same circuit breaker, they are actually focusing on different circuit breakers.

[0006] An object of the present disclosure is to reliably grasp the facility that the other party is focusing on when communicating with each other via their respective terminals in remote locations. [Means for solving the problem]

[0007] According to a first aspect of the present disclosure, A selection information acquisition means for acquiring selection information regarding a selection of any one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; Including, An information processing system is provided.

[0008] According to a second aspect of the present disclosure, A selection information acquisition means for acquiring selection information regarding a selection of any one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; Including, An information processing device is provided.

[0009] According to a third aspect of the present disclosure, The computer acquiring selection information regarding a selection of one of a plurality of pieces of equipment in the facility via a first terminal; transmitting information of interest corresponding to the selection information to a second terminal; A method for processing information is provided.

[0010] According to a fourth aspect of the present disclosure, Computer, A selection information acquisition means for acquiring selection information regarding a selection of any one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; To function as An information processing program is provided. Effect of the Invention

[0011] According to the present disclosure, when communicating with each other in remote locations via their respective terminals, it is possible to reliably grasp the facility that the other party is focusing on. [Brief description of the drawings]

[0012] [Figure 1] FIG. 2 is a functional block diagram of the information processing system. [Diagram 2] FIG. 1 is a schematic diagram of a communication system. [Diagram 3] FIG. 2 is a functional block diagram of a server. [Figure 4] FIG. 2 is a data structure diagram of a facility database. [Diagram 5] 4 is an example of display data. [Figure 6] FIG. 4 is a functional block diagram of an office terminal. [Figure 7] FIG. 2 is a functional block diagram of a field terminal. [Figure 8] 1 is a control flow of a communication system. [Figure 9] 13 is an example of a screen display of a field terminal. [Figure 10] 13 is an example of a screen display of an office terminal. [Figure 11] 13 is an example of a screen display of an office terminal. [Figure 12] 13 is an example of a screen display of a field terminal. [Figure 13] FIG. 2 is a functional block diagram of a field terminal. [Figure 14] 13 is an example of a screen display of a field terminal. [Figure 15]FIG. 2 is a functional block diagram of a field terminal. [Figure 16] FIG. 2 is a functional block diagram of a field terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] (Summary of the Disclosure) Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0014] 1 is a functional block diagram of an information processing system 100. As shown in FIG. 1, the information processing system 100 includes a selection information acquisition unit 101 and a transmission unit 102.

[0015] The selection information acquisition means 101 acquires selection information regarding a piece of equipment selected via a first terminal from among a plurality of pieces of equipment owned by the facility.

[0016] The transmitting means 102 transmits the information of interest corresponding to the selection information to the second terminal.

[0017] According to the above configuration, when communicating with each other through their respective terminals at remote locations, it becomes possible to reliably grasp the facility that the other party is focusing on.

[0018] (First embodiment) A first embodiment of the present disclosure will be described below. Fig. 2 is a schematic diagram of a communication system 1. As shown in Fig. 2, the communication system 1 includes a server 2, an office terminal 3, and a field terminal 4. The server 2 and the office terminal 3 are configured to be capable of two-way communication via a WAN 5 (Wide Area Network). Similarly, the server 2 and the field terminal 4 are configured to be capable of two-way communication via the WAN 5.

[0019] The server 2 is a specific example of an information processing system. The server 2 is a specific example of an information processing device. The server 2 is realized by a single device. However, instead of this, the server 2 may be realized by distributed processing by a plurality of devices. The office terminal 3 is a specific example of a first terminal or a second terminal. The field terminal 4 is a specific example of a first terminal or a second terminal.

[0020] As an example, the on-site terminal 4 is a terminal carried to the substation by an inspector dispatched to the substation. The substation is a specific example of a facility. The substation is composed of many pieces of equipment including transformers, circuit breakers, disconnecting switches, instrument transformers, and lightning arresters.

[0021] The office terminal 3 is a terminal installed in an office far away from a substation.

[0022] The person in charge at the office operates the office terminal 3. An inspector dispatched to the substation operates the field terminal 4. The person in charge and the inspector communicate regarding the maintenance of specific equipment via the office terminal 3 operated by the person in charge and the field terminal 4 operated by the inspector. The communication system 1 is configured to operate so that when communicating via each person's terminal in such a way at remote locations, the person in charge can reliably understand the equipment that the inspector is focusing on, and so that the inspector can reliably understand the equipment that the person in charge is focusing on.

[0023] FIG. 3 shows a functional block diagram of the server 2. As shown in FIG. 3, the server 2 has a processor 2a, a memory 2b, and a communication interface 2c. The processor 2a can access the memory 2b. The processor 2a communicates with the office terminal 3 and the field terminal 4 via the communication interface 2c. The processor 2a reads and executes a program stored in the memory 2b. As a result, the program causes hardware such as the processor 2a, the memory 2b, and the communication interface 2c to function as a display data request receiving unit 10, a display data transmitting unit 11, a selection information receiving unit 12, an emphasis data generating unit 13, and an emphasis data transmitting unit 14. The memory 2b functions as an equipment database storage unit 20 and a display data storage unit 21.

[0024] The equipment database storage unit 20 stores an equipment database shown in Fig. 4. As shown in Fig. 4, the equipment database holds equipment IDs and equipment coordinates for each of a plurality of pieces of equipment arranged in a substation in association with each other. Equipment coordinates are coordinates at which the corresponding equipment is installed. Here, the coordinates may be absolute coordinates composed of longitude and latitude. The coordinates may be relative coordinates based on a difference from a specific reference point. In this embodiment, as an example, the installation coordinates are absolute coordinates composed of longitude and latitude.

[0025] The display data storage unit 21 stores the display data shown in FIG. 5. As shown in FIG. 5, the display data is three-dimensional shape data of a plurality of facilities 31 that the substation 30 has. The plurality of facilities 31 includes, for example, facilities 31a, 31b, 31c, 31d, 31e, and 31f. Each facility 31 is typically a transformer, a circuit breaker, a disconnecting switch, an instrument transformer, or a lightning arrester. As shown in FIG. 5, the plurality of facilities 31 have a similar shape. Therefore, it is difficult for an inspector dispatched to the substation to distinguish the plurality of facilities 31. The display data is typically a point cloud or a polygon. The coordinate system of the facility coordinates shown in FIG. 4 typically coincides with the coordinate system of the display data.

[0026] Returning to FIG. 3, the display data request receiving unit 10 receives a display data request from the office terminal 3 or the field terminal 4. The display data request is for requesting partial display data that is a part of the display data stored in the display data storage unit 21. The display data request typically includes range specifying information for specifying the range of the partial display data. The range specifying information indicates, for example, the coordinates of the four corners of a rectangular range. The range specifying information indicates, for example, the coordinates of the center and the radius of a circular range.

[0027] The display data transmission unit 11 extracts partial display data corresponding to the display data request from the display data stored in the display data storage unit 21, and transmits the extracted partial display data to the terminal that has made the request.

[0028] The selection information receiving unit 12 receives selection information from the office terminal 3 or the field terminal 4. The selection information is information regarding the selection of any one of the facilities 31, among the plurality of facilities 31 owned by the substation 30, via the office terminal 3 or the field terminal 4. The selection information typically indicates the coordinates of the selected facility 31. Alternatively, the selection information may be the facility ID of the selected facility 31. The selection information receiving unit 12 is a specific example of a selection information acquiring means.

[0029] The emphasis data generating unit 13 generates attention information based on the selection information received by the selection information receiving unit 12. The attention information is typically partial display data. Specifically, the attention information is partial display data with a part emphasized. That is, the emphasis data generating unit 13 extracts partial display data from the display data stored in the display data storage unit 21 so as to include a plurality of facilities 31 located within a predetermined range centered on the coordinates indicated by the selection information. Then, the emphasis data generating unit 13 identifies the facility ID of the facility 31 corresponding to the coordinates indicated by the selection information by referring to the facility database, and emphasizes a part of the partial display data corresponding to the facility 31 with the facility ID. For example, when the display data is composed of a point cloud, the emphasis data generating unit 13 changes the color of the point cloud corresponding to the facility 31 to a specific color such as red or yellow. When the display data is composed of a polygon, the emphasis data generating unit 13 changes the color of the surface corresponding to the facility 31 to a specific color such as red or yellow. Note that the attention information may be the selection information itself.

[0030] The emphasis data transmission unit 14 transmits the attention information generated by the emphasis data generation unit 13 to the office terminal 3 or the field terminal 4. That is, when the selection information receiving unit 12 receives selection information from the office terminal 3, the emphasis data transmission unit 14 transmits the attention information to the field terminal 4. Similarly, when the selection information receiving unit 12 receives selection information from the field terminal 4, the emphasis data transmission unit 14 transmits the attention information to the office terminal 3. The emphasis data transmission unit 14 is a specific example of a transmission means.

[0031] In this way, when the server 2 receives selection information from one of the office terminal 3 and the field terminal 4, it transmits the attention information corresponding to the selection information to the other terminal. Therefore, when communicating via each person's terminal at a distant location, it becomes possible to reliably grasp the facility 31 that the other person is paying attention to.

[0032] Next, the office terminal 3 will be described with reference to Fig. 6. Fig. 6 is a functional block diagram of the office terminal 3.

[0033] As shown in FIG. 6, the office terminal 3 is typically a laptop computer. The office terminal 3 has a processor 3a, a memory 3b, a communication interface 3c, an input interface 3d, and an LCD 3e (Liquid Crystal Display). The processor 3a can access the memory 3b. The processor 3a communicates with the server 2 via the communication interface 3c. The input interface 3d is typically a keyboard or a mouse. The processor 3a reads and executes a program stored in the memory 3b. As a result, the program causes hardware such as the processor 3a, the memory 3b, the communication interface 3c, the input interface 3d, and the LCD 3e to function as a movement operation acceptance unit 40, a display data request unit 41, a display data receiving unit 42, a display control unit 43, a selection information generation unit 44, and a selection information transmission unit 45.

[0034] In this embodiment, the office terminal 3 is configured to output display data to the LCD 3e to construct a virtual space, and the display data on the LCD 3e is updated every moment as the person in charge moves within the virtual space using the input interface 3d. Specifically, the process is as follows.

[0035] The movement operation receiving unit 40 receives a viewpoint movement operation performed by the person in charge via the input interface 3d.

[0036] The display data request unit 41 generates a display data request based on the viewpoint movement operation received by the movement operation receiving unit 40. The display data request unit 41 generates the display data request so that the display data request corresponds to the latest viewpoint updated by the viewpoint movement operation. The display data request typically includes coordinates of the latest viewpoint. The display data request unit 41 transmits the display data request to the server 2.

[0037] The display data receiving unit 42 receives the partial display data from the server 2 .

[0038] The display control unit 43 outputs the partial display data received by the display data receiving unit 42 to the LCD 3e.

[0039] It is also possible that all of the display data stored in the display data storage unit 21 of the server 2 is held by the office terminal 3. In this case, the movement operation acceptance unit 40, the display data request unit 41, the display data receiving unit 42, and the display control unit 43 can be omitted.

[0040] The selection information generating unit 44 generates selection information based on a facility selection operation performed by the person in charge via the input interface 3d. The facility selection operation is typically a mouse click operation. Specifically, the person in charge selects a facility 31 by clicking one of the facilities 31 displayed on the LCD 3e using the mouse. Then, the selection information generating unit 44 acquires the coordinates of the selected facility 31, and generates selection information indicating the acquired coordinates. The coordinates referred to here are coordinates expressed by the coordinate system of the partial display data. The selection information generating unit 44 may acquire the facility ID of the selected facility 31 by accessing the facility database storage unit 20 of the server 2, and generate selection information indicating the acquired facility ID.

[0041] The selection information transmitting unit 45 transmits the selection information generated by the selection information generating unit 44 to the server 2 .

[0042] Next, the on-site terminal 4 will be described with reference to Fig. 7. Fig. 7 shows a functional block diagram of the on-site terminal 4. The on-site terminal 4 is typically a tablet computer. The on-site terminal 4 has a processor 4a, a memory 4b, a communication interface 4c, an input interface 4d, an LCD 4e, a position / azimuth / tilt sensor 4f, and a camera 4g.

[0043] The processor 4a can access the memory 4b. The processor 4a communicates with the server 2 via the communication interface 4c. The input interface 4d is typically a touch panel superimposed on the LCD 3e. The position, orientation, and tilt sensor 4f is a sensor that senses the position, orientation, and attitude of the field terminal 4. That is, the position, orientation, and tilt sensor 4f includes a GNSS (Global Navigation Satellite System) sensor for detecting the position of the field terminal 4, a geomagnetic sensor for detecting the orientation of the field terminal 4, and a three-axis acceleration sensor for detecting the attitude of the field terminal 4. The camera 4g is typically provided on the back of the field terminal 4.

[0044] The processor 4a reads and executes a program stored in the memory 4b. As a result, the program causes hardware such as the processor 4a, the memory 4b, the communication interface 4c, the input interface 4d, the LCD 4e, the position / direction / inclination sensor 4f, and the camera 4g to function as a display control unit 50, a selection information generation unit 51, a selection information transmission unit 52, and a display data reception unit 53.

[0045] The display control unit 50 outputs the camera image generated by the camera 4g to the LCD 4e. At this time, the display control unit 50 superimposes various information on the camera image. That is, the display control unit 50 realizes AR (Augmented Reality). The AR realized by the display control unit 50 is roughly classified into either vision-based AR or location-based AR. In this embodiment, the AR realized by the display control unit 50 is location-based AR. That is, the display control unit 50 realizes AR based on the sensing result of the position / azimuth / tilt sensor 4f. However, instead of this, the AR realized by the display control unit 50 may be vision-based AR. As an example, the display control unit 50 superimposes information such as inspection items for each facility 31 on the camera image.

[0046] The selection information generating unit 51 generates selection information based on the equipment selection operation performed by the inspector via the input interface 4d. The equipment selection operation is typically a tap operation on a touch panel. Specifically, the inspector selects equipment 31 by tapping on one of the multiple equipment 31 displayed on the LCD 4e. Then, the selection information generating unit 51 geometrically calculates the coordinates of the selected equipment 31 based on the position, orientation, and attitude of the field terminal 4 detected by the position, orientation, and tilt sensor 4f and the two-dimensional coordinates on the LCD 4e where the tap operation was performed, and generates selection information indicating the calculated coordinates. The coordinates referred to here are coordinates expressed by the coordinate system of the display data. The selection information generating unit 51 may obtain the equipment ID of the selected equipment 31 by accessing the equipment database storage unit 20 of the server 2, and generate selection information indicating the obtained equipment ID.

[0047] The selection information transmitting unit 52 transmits the selection information generated by the selection information generating unit 51 to the server 2 .

[0048] The display data receiving unit 53 receives display data from the server 2. When the display data receiving unit 53 receives the display data from the server 2, the display control unit 50 displays the display data received by the display data receiving unit 53 on the LCD 4e instead of outputting the camera image to the LCD 4e.

[0049] Next, the operation flow of the communication system 1 will be described with reference to FIG.

[0050] S100: First, the movement operation receiving unit 40 of the office terminal 3 receives a viewpoint movement operation performed by the person in charge via the input interface 3d.

[0051] S110: Next, the display data request unit 41 generates a display data request based on the viewpoint movement operation accepted by the movement operation accepting unit 40, and transmits the generated display data request to the server 2. The display data request receiving unit 10 of the server 2 receives the display data request from the office terminal 3.

[0052] S120: The display data transmission unit 11 of the server 2 extracts partial display data corresponding to the display data request from the display data stored in the display data storage unit 21, and transmits the extracted partial display data to the office terminal 3 that is the request source. The display data reception unit 42 of the office terminal 3 receives the partial display data from the server 2.

[0053] S130: Next, the display control unit 43 of the office terminal 3 outputs the partial display data received by the display data receiving unit 42 to the LCD 3e.

[0054] The office terminal 3 repeatedly executes the series of operations from step S100 to step S130 described above.

[0055] S140: On the other hand, the camera 4 g of the on-site terminal 4 captures images of the multiple pieces of equipment 31 .

[0056] S150: The display control unit 50 of the on-site terminal 4 outputs the camera image generated by the camera 4g to the LCD 4e. At this time, the display control unit 50 superimposes various information on the camera image.

[0057] The on-site terminal 4 repeatedly executes the operations of steps S140 and S150 described above.

[0058] Hereinafter, steps S200 to S250 correspond to the control flow when facility selection is executed at the field terminal 4. In contrast, steps S300 to S350 correspond to the control flow when facility selection is executed at the office terminal 3.

[0059] S200: First, as shown in FIG. 9, the inspector taps on a specific facility 31 displayed on the LCD 4e of the on-site terminal 4.

[0060] S210: The selection information generating unit 51 of the on-site terminal 4 generates selection information based on the equipment selection operation performed by the inspector via the input interface 4d.

[0061] S220: The selection information transmitting unit 52 of the on-site terminal 4 transmits the selection information generated by the selection information generating unit 51 to the server 2. The selection information receiving unit 12 of the server 2 receives the selection information from the on-site terminal 4.

[0062] S230: The emphasis data generating unit 13 of the server 2 generates attention information based on the selection information received by the selection information receiving unit 12 .

[0063] S240: Then, the emphasis data transmission unit 14 of the server 2 transmits the attention information generated by the emphasis data generation unit 13 to the office terminal 3. The display data reception unit 42 of the office terminal 3 receives the attention information from the server 2.

[0064] S250: As shown in FIG. 10, the display control unit 43 of the office terminal 3 outputs the attention information received by the display data receiving unit 42 to the LCD 3e. Specifically, as shown in FIG. 10, the display control unit 43 outputs partial display data in which the equipment selected by the inspector is highlighted to the LCD 3e of the office terminal 3. This allows the office staff to reliably grasp the equipment 31 that the inspector is focusing on. In the example of FIG. 10, the equipment 31 that the inspector is focusing on is hatched on the screen of the LCD 3e. Note that the method of highlighting the equipment 31 selected by the inspector on the screen of the LCD 3e is not limited to the above method. For example, the equipment 31 selected by the inspector may be highlighted by surrounding the equipment 31 with a rectangle on the screen of the LCD 3e. Also, the equipment 31 may be highlighted by displaying an icon near the equipment 31 selected by the inspector on the screen of the LCD 3e.

[0065] S300: As shown in FIG. 11, first, the person in charge clicks on a specific piece of equipment 31 displayed on the LCD 3e of the office terminal 3.

[0066] S310: The selection information generating unit 44 of the office terminal 3 generates selection information based on the facility selection operation performed by the person in charge via the input interface 3d.

[0067] S320: The selection information transmitting unit 45 of the office terminal 3 transmits the selection information generated by the selection information generating unit 44 to the server 2. The selection information receiving unit 12 of the server 2 receives the selection information from the office terminal 3.

[0068] S330: The emphasis data generating unit 13 of the server 2 generates attention information based on the selection information received by the selection information receiving unit 12 .

[0069] S340: Then, the emphasis data transmission unit 14 of the server 2 transmits the attention information generated by the emphasis data generation unit 13 to the on-site terminal 4. The display data reception unit 53 of the on-site terminal 4 receives the attention information from the server 2.

[0070] S350: As shown in FIG. 12, the display control unit 50 of the on-site terminal 4 outputs the attention information received by the display data receiving unit 53 to the LCD 4e. Specifically, as shown in FIG. 12, the display control unit 50 outputs partial display data in which the equipment selected by the person in charge is highlighted to the LCD 4e of the on-site terminal 4. This allows the inspector to reliably grasp the equipment 31 that the person in charge is focusing on. At this time, the display control unit 50 of the on-site terminal 4 temporarily suspends the AR mode and outputs only the partial display data to the LCD 4e. However, instead of this, the display control unit 50 of the on-site terminal 4 may continue the AR mode and output the partial display data to the LCD 4e by superimposing it on the camera image. In the example of FIG. 12, the equipment 31 that the person in charge is focusing on is hatched on the screen of the LCD 4e. The method of highlighting the equipment 31 selected by the person in charge on the screen of the LCD 4e is not limited to the above method. For example, the equipment 31 selected by the person in charge may be highlighted by surrounding the equipment 31 with a rectangle on the screen of the LCD 4e. Also, the equipment 31 may be highlighted by displaying an icon near the equipment 31 selected by the person in charge on the screen of the LCD 4e.

[0071] In this way, when the server 2 receives the selection information from the office terminal 3, it transmits the attention information corresponding to the selection information to the field terminal 4. Therefore, when communicating via each person's terminal at a remote location, it becomes possible to reliably grasp the facility 31 that the other person is paying attention to.

[0072] The first embodiment has been described above. The first embodiment has the following features.

[0073] The server 2 (information processing system) includes a selection information receiving unit 12 (selection information acquiring means) and an emphasis data transmitting unit 14 (transmitting means). The selection information receiving unit 12 acquires selection information related to the selection of any one of the facilities 31 from among the multiple facilities 31 owned by a substation 30 (facility) via an office terminal 3 or a field terminal 4 (first terminal). The emphasis data transmitting unit 14 transmits focus information corresponding to the selection information to the field terminal 4 or the office terminal 3 (second terminal). With the above configuration, when communicating via each person's terminal at a remote location, it becomes possible to reliably grasp the facility 31 that the other party is focusing on.

[0074] Furthermore, as shown in Fig. 10, the display control unit 43 of the office terminal 3 highlights the equipment selected based on the focus information. Similarly, as shown in Fig. 12, the display control unit 50 of the field terminal 4 highlights the equipment selected based on the focus information. With the above configuration, it becomes possible to instantly visually grasp the equipment 31 that the other party is focusing on.

[0075] The above first embodiment can be modified, for example, as follows.

[0076] That is, in the first embodiment, the office terminal 3 includes an LCD 3e and a mouse as an input interface 3d. However, instead of this, a VR environment may be constructed using the office terminal 3. In this case, the LCD 3e is provided in a VR goggle. And the input interface 3d will be realized as a VR controller. In this case, the person in charge selects one of the multiple pieces of equipment 31 displayed on the LCD 3e using the VR controller.

[0077] 7, in the first embodiment, the on-site terminal 4 is provided with a camera 4g and an LCD 4e, so that the on-site terminal 4 can create an AR environment. However, instead, the on-site terminal 4 does not need to create an AR environment. In this case, the on-site terminal 4 transmits a display data request to the server 2 and receives display data from the server 2, similar to the office terminal 3. Then, the on-site terminal 4 outputs the received display data to the LCD 4e.

[0078] In addition, when the focus information received by the on-site terminal 4 from the server 2 is the selection information itself, the display control unit 50 of the on-site terminal 4 may superimpose an icon identifying the coordinates indicated by the selection information on the camera image and then output the camera image to the LCD 4e.

[0079] Second embodiment Next, a second embodiment will be described. Below, the differences between the second embodiment and the first embodiment will be mainly described, and overlapping descriptions will be omitted.

[0080] FIG. 13 shows a functional block diagram of the on-site terminal 4. As shown in FIG. 13, the on-site terminal 4 further includes a microphone 4h that collects the voice of the inspector who carries the on-site terminal 4. The selection information generating unit 51 identifies the selected facility 31 based on the voice collection result by the microphone 4h. Specifically, as shown in FIG. 14, the display control unit 50 displays on the LCD 4e facility identification information unique to each of the facilities 31 so as to be superimposed on the corresponding facility 31. Here, the facility identification information is typically a character string. The selection information generating unit 51 identifies the facility 31 selected by the inspector based on the facility identification information read out by the inspector. The selection information generating unit 51 may typically include a voice recognition module in order to recognize the facility identification information read out by the inspector. The selection information generating unit 51 generates the selection information based on the identification result. Specifically, the selection information generating unit 51 geometrically calculates the coordinates of the selected equipment 31 based on the identification result, the position, orientation, and attitude of the on-site terminal 4 detected by the position, orientation, and tilt sensor 4f, and the two-dimensional coordinates on the LCD 4e where the tap operation was performed, and generates selection information indicating the calculated coordinates. With the above configuration, the on-site inspector can efficiently select the equipment 31.

[0081] Third embodiment Next, a third embodiment will be described. Below, the differences between the third embodiment and the first embodiment will be mainly described, and overlapping descriptions will be omitted.

[0082] FIG. 15 shows a functional block diagram of the on-site terminal 4. As shown in FIG. 15, the on-site terminal 4 is a so-called smart glass equipped with a retinal projection type display module 4m instead of an LCD 4e. The on-site terminal 4 further includes a gesture sensor 4i. The gesture sensor 4i is a sensor that senses a gesture of an inspector (user). The gesture sensor 4i is a specific example of a sensing means. Then, the selection information generating unit 51 (generating means) specifies the equipment 31 selected by the inspector based on the sensing result by the gesture sensor 4i. Specifically, the selection information generating unit 51 specifies the equipment 31 selected by the inspector based on the pointing gesture of the inspector detected by the gesture sensor 4i. Then, the selection information generating unit 51 generates selection information based on the above-mentioned specifying result. Specifically, the selection information generating unit 51 geometrically calculates the coordinates of the selected equipment 31 based on the identification result, the position, orientation, and attitude of the on-site terminal 4 detected by the position, orientation, and tilt sensor 4f, and the two-dimensional coordinates on the LCD 4e where the tap operation was performed, and generates selection information indicating the calculated coordinates. With the above configuration, the on-site inspector can efficiently select the equipment 31.

[0083] In this embodiment, the focus information transmitted from the server 2 to the on-site terminal 4 is information indicating coordinates. When the on-site terminal 4 receives the focus information from the server 2, the display module 4m superimposes an icon or the like on the real space so as to emphasize the coordinates indicated by the focus information.

[0084] (Fourth embodiment) Next, a fourth embodiment will be described. Below, the differences between the fourth embodiment and the first embodiment will be mainly described, and overlapping descriptions will be omitted.

[0085] FIG. 16 is a functional block diagram of the field terminal 4. As shown in FIG. 16, in this embodiment, the field terminal 4 has a gaze sensor 4j instead of the gesture sensor 4i shown in FIG. 15. The gaze sensor 4j is a sensor that senses the gaze of the inspector (user). The gaze sensor 4j is a specific example of a sensing means. Then, the selection information generating unit 51 (generation means) specifies the equipment 31 selected by the inspector based on the sensing result by the gaze sensor 4j. Specifically, the selection information generating unit 51 specifies the equipment 31 selected by the inspector based on the gaze of the inspector detected by the gaze sensor 4j. Then, the selection information generating unit 51 generates selection information based on the above-mentioned specification result. Specifically, the selection information generating unit 51 geometrically calculates the coordinates of the selected equipment 31 based on the specification result, the position, orientation, and attitude of the field terminal 4 detected by the position / orientation / tilt sensor 4f, and the two-dimensional coordinates on the LCD 4e where the tap operation was performed, and generates selection information indicating the calculated coordinates. According to the above configuration, an on-site inspector can efficiently select the facility 31.

[0086] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be appropriately combined with other embodiments.

[0087] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but to one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one drawing may be combined with features or steps shown in one or more other drawings to create an embodiment not explicitly shown or described, for example. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0088] In the above example, the program can be stored and provided to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives) and magneto-optical recording media (e.g., magneto-optical disks). Examples of the non-transitory computer readable media further include CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM. Examples of the non-transitory computer readable media further include PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, and RAM (random access memory). The program may also be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire or an optical fiber, or via a wireless communication path.

[0089] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) A selection information acquisition means for acquiring selection information regarding a selection of any one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; Including, Information processing system. (Appendix 2) An information processing terminal functioning as the first terminal according to claim 1, A sensing means for sensing a gesture of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; Including, Information processing terminal. (Appendix 3) An information processing terminal functioning as the first terminal according to claim 1, A sensing means for sensing a line of sight of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; Including, Information processing terminal. (Appendix 4) An information processing terminal functioning as the first terminal according to claim 1, A sound collection means for collecting a user's voice; A generating means for identifying the selected facility based on a sound collection result by the sound collection means and generating the selection information based on the identification result; Including, Information processing terminal. (Appendix 5) a display unit for displaying unique facility identification information for each of the plurality of facilities so as to superimpose the unique facility identification information on the corresponding facility, The generating means identifies the selected facility based on the facility identification information read out by the user. 5. An information processing terminal according to claim 4. (Appendix 6) An information processing terminal functioning as the second terminal according to claim 1, highlighting the selected facility based on the focus information; Information processing terminal. (Appendix 7) A selection information acquisition means for acquiring selection information regarding a selection of any one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; Including, Information processing device. (Appendix 8) An information processing terminal functioning as the first terminal according to Supplementary Note 7, A sensing means for sensing a gesture of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; Including, Information processing terminal. (Appendix 9) An information processing terminal functioning as the first terminal according to Supplementary Note 7, A sensing means for sensing a line of sight of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; Including, Information processing terminal. (Appendix 10) An information processing terminal functioning as the first terminal according to Supplementary Note 7, A sound collection means for collecting a user's voice; A generating means for identifying the selected facility based on a sound collection result by the sound collection means and generating the selection information based on the identification result; Including, Information processing terminal. (Appendix 11) a display unit for displaying unique facility identification information for each of the plurality of facilities so as to superimpose the unique facility identification information on the corresponding facility, The generating means identifies the selected facility based on the facility identification information read out by the user. 11. The information processing terminal according to claim 10. (Appendix 12) An information processing terminal functioning as the second terminal according to Supplementary Note 7, highlighting the selected facility based on the focus information; Information processing terminal. (Appendix 13) The computer acquiring selection information regarding a selection of any one of a plurality of pieces of equipment possessed by the facility via a first terminal; transmitting information of interest corresponding to the selection information to a second terminal; Information processing methods. (Appendix 14) An information processing method of an information processing terminal functioning as the first terminal according to Supplementary Note 13, Sensing the user's gestures Identifying the selected equipment based on a sensing result by the sensing means, and generating the selection information based on the identification result. Information processing methods. (Appendix 15) An information processing method of an information processing terminal functioning as the first terminal according to Supplementary Note 13, Sensing the user's gaze, Identifying the selected equipment based on a sensing result by the sensing means, and generating the selection information based on the identification result. Information processing methods. (Appendix 16) An information processing method of an information processing terminal functioning as the first terminal according to Supplementary Note 13, Collect the user's voice, Identifying the selected facility based on the sound collection result by the sound collection means, and generating the selection information based on the identification result. Information processing methods. (Appendix 17) displaying unique facility identification information for each of the plurality of facilities so as to be superimposed on the corresponding facility; The generating means identifies the selected facility based on the facility identification information read out by the user. 17. The information processing method according to claim 16. (Appendix 18) An information processing method of an information processing terminal functioning as the second terminal according to Supplementary Note 13, highlighting the selected facility based on the focus information; Information processing methods. (Appendix 19) Computer, A selection information acquisition means for acquiring selection information regarding a selection of any one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; To function as Information processing program. (Appendix 20) An information processing terminal functioning as the first terminal according to Supplementary Note 19, A sensing means for sensing a gesture of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; To function as Information processing program. (Appendix 21) An information processing terminal functioning as the first terminal according to Supplementary Note 19, A sensing means for sensing a line of sight of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; To function as Information processing program. (Appendix 22) An information processing terminal functioning as the first terminal according to Supplementary Note 19, A sound collection means for collecting a user's voice; A generating means for identifying the selected facility based on a sound collection result by the sound collection means and generating the selection information based on the identification result; To function as Information processing program. (Appendix 23) The information processing terminal is further caused to function as a display means for displaying unique facility identification information for each of the plurality of facilities so as to be superimposed on the corresponding facility, The generating means identifies the selected facility based on the facility identification information read out by the user. 23. An information processing program according to claim 22. (Appendix 24) An information processing terminal functioning as the second terminal according to Supplementary Note 19, and highlighting the selected facility based on the focus information. Information processing program. [Explanation of symbols]

[0090] 1. Communication System 2 Server 2a Processor 2b Memory 2c Communication Interface 3 Office terminal 3a processor 3b Memory 3c Communication Interface 3D Input Interface 3e LCD 4 On-site terminal 4a processor 4b Memory 4c Communication Interface 4d input interface 4e LCD 4f Position, orientation and tilt sensor 4g camera 4h Mike 4m display module 4i Gesture Sensor 4j Eye gaze sensor 5. WAN 10. Display data request receiver 11 Display data transmission unit 12 Selection information receiving unit 13 Emphasis data generation unit 14 Emphasis data transmission unit 20 Equipment database storage unit 21 Display data storage unit 30 Substation 31 Equipment 31a Equipment 31b Equipment 31c equipment 31d equipment 31e equipment 31f equipment 40 Mobile operation reception section 41 Display data request unit 42 Display data receiving unit 43 Display control section 44 Selection information generation unit 45 Selection information transmission unit 50 Display control unit 51 Selection information generation unit 52 Selection information transmission unit 53 Display data receiving unit

Claims

1. a selection information acquiring means for acquiring selection information regarding a selection of one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; Including, Information processing system.

2. An information processing terminal functioning as the first terminal according to claim 1, A sensing means for sensing a gesture of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; Including, Information processing terminal.

3. An information processing terminal functioning as the first terminal according to claim 1, A sensing means for sensing a line of sight of a user; A generating means for identifying the selected facility based on a sensing result by the sensing means and generating the selection information based on the identifying result; Including, Information processing terminal.

4. An information processing terminal functioning as the first terminal according to claim 1, A sound collection means for collecting a user's voice; A generating means for identifying the selected facility based on a sound collection result by the sound collection means and generating the selection information based on the identification result; Including, Information processing terminal.

5. a display unit for displaying unique facility identification information for each of the plurality of facilities so as to superimpose the unique facility identification information on the corresponding facility, The generating means identifies the selected facility based on the facility identification information read out by the user.

5. An information processing terminal according to claim 4.

6. An information processing terminal functioning as the second terminal according to claim 1, highlighting the selected facility based on the focus information; Information processing terminal.

7. a selection information acquiring means for acquiring selection information regarding a selection of one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; Including, Information processing device.

8. The computer acquiring selection information regarding a selection of one of a plurality of pieces of equipment in the facility via a first terminal; transmitting information of interest corresponding to the selection information to a second terminal; Information processing methods.

9. Computer, a selection information acquiring means for acquiring selection information regarding a selection of one of a plurality of pieces of equipment in the facility via a first terminal; a transmitting means for transmitting information of interest corresponding to the selection information to a second terminal; To function as Information processing program.

Images