Display control device, display control method, and display control program

Abstract

The objective is to provide a display control device, a display control method, and a display control program that can improve the safety of persons present around invisible objects. The display control device (410) includes an object information acquisition unit (13) that acquires object information, which is information relating to an invisible object (T), and a display control unit (40) that generates an object information image (I1) showing the object information and controls a display device (210) using augmented reality technology so that the object information image (I1) is displayed in a way that is visible to a person (U) present in the vicinity of the invisible object (T).

Description

Technical Field

[0001] The present disclosure relates to a display control device, a display control method, and a display control program.

Background Art

[0002] There is known a technique for prompting attention at a location that requires attention by using augmented reality (AR) technology that adds and presents digital information in a real environment. For example, in Patent Document 1, a display device is disclosed that estimates a point of attention in the viewing direction of a user by identifying a matching portion between an image in the viewing direction of the user and a pattern stored in advance, and causes the user to visually recognize the point of attention as a virtual image.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the device of Patent Document 1, since a method of image recognition and pattern matching is used to identify a location that requires attention, an invisible object cannot be identified. Depending on the type or state of the invisible object, attention may be required, but in the device of Patent Document 1, the type or state of the invisible object cannot be visually recognized by a person present around the invisible object, and there is a possibility that the safety of the person may be impaired.

[0005] The present disclosure has been made to solve the above problems, and an object thereof is to provide a display control device, a display control method, and a display control program that can improve the safety of a person present around an invisible object.

Means for Solving the Problems

[0006] The display control device according to this disclosure includes a threshold information acquisition unit that acquires threshold information including a first state threshold which is a threshold corresponding to a first state of an invisible object, a second state threshold which is a threshold corresponding to a second state of an object that is a state different from the first state, a first distance threshold which is a threshold for the distance corresponding to the first state threshold, a second threshold which is a threshold for the distance corresponding to the second state threshold, a first warning message which is a warning message corresponding to the first state threshold, and a second warning message which is a warning message corresponding to the second state threshold; an object information acquisition unit that acquires a first state value which is a numerical value indicating the first state of the object and a second state value which is a numerical value indicating the second state of the object; and a distance acquisition unit that acquires the distance between an object and an object that is present in the vicinity of the object as the object distance. An environmental information acquisition unit acquires environmental information which is information about surrounding objects of at least one of the following: an object separating the object from the object and the object person, and an object that alters the airflow around the object; and a threshold setting unit sets a first distance threshold and a second distance threshold based on the arrangement and number of surrounding objects. The system includes a determination unit that compares a first state value with a first state threshold, compares a second state value with a second state threshold, compares the distance to the subject with a first distance threshold and a second distance threshold, selects a first warning message if the first state value is greater than or equal to the first state threshold and the distance to the subject is less than or equal to the first distance threshold, and selects a second warning message if the second state value is greater than or equal to the second state threshold and the distance to the subject is less than or equal to the second distance threshold; and a display control unit that controls a display device using augmented reality technology so that the warning message selected by the determination unit is displayed to the subject in a way that is visible to the subject.

[0007] The input display control method relating to this disclosure includes a threshold information acquisition step of acquiring threshold information which includes a first state threshold that corresponds to a first state of an invisible object, a second state threshold that corresponds to a second state of an object that is a state different from the first state, a first distance threshold that is a threshold for the distance corresponding to the first state threshold, a second distance threshold that is a threshold for the distance corresponding to the second state threshold, a first warning message that corresponds to the first state threshold, and a second warning message that corresponds to the second state threshold; an object information acquisition step of acquiring a first state value that is a numerical value indicating the first state of the object and a second state value that is a numerical value indicating the second state of the object; and a distance acquisition step of acquiring the distance between an object and an object that is present in the vicinity of the object as the object distance. An environmental information acquisition step to acquire environmental information which is information about surrounding objects of at least one of the following: an object separating the object from the object and the object person, and an object that alters the airflow around the object; and a threshold setting step to set a first distance threshold and a second distance threshold based on the arrangement and number of surrounding objects. The system includes a determination step of comparing a first state value with a first state threshold, comparing a second state value with a second state threshold, comparing the distance to the subject with a first distance threshold and a second distance threshold, selecting a first warning message if the first state value is greater than or equal to the first state threshold and the distance to the subject is less than or equal to the first distance threshold, and selecting a second warning message if the second state value is greater than or equal to the second state threshold and the distance to the subject is less than or equal to the second distance threshold; and a display control step of controlling a display device using augmented reality technology so that the warning message selected by the determination unit is displayed to the subject in a way that is visible to the subject.

[0008] The input display control program relating to this disclosure includes a threshold information acquisition function that acquires threshold information including a first state threshold which is a threshold corresponding to a first state of an invisible object, a second state threshold which is a threshold corresponding to a second state which is a state of the object different from the first state, a first distance threshold which is a threshold for the distance corresponding to the first state threshold, a second distance threshold which is a threshold for the distance corresponding to the second state threshold, a first warning message which is a warning message corresponding to the first state threshold, and a second warning message which is a warning message corresponding to the second state threshold; an object information acquisition function that acquires a first state value which is a numerical value indicating the first state of the object and a second state value which is a numerical value indicating the second state of the object; and a distance acquisition function that acquires the distance between an object and an object that is present around the object as the object distance. An environmental information acquisition function that acquires environmental information which is information about surrounding objects of at least one of the following: an object separating the object from the object and the object, and an object that alters the airflow around the object; and a threshold setting function that sets a first distance threshold and a second distance threshold based on the arrangement and number of surrounding objects. The system includes a determination function that compares a first state value with a first state threshold, compares a second state value with a second state threshold, compares the distance to the subject with a first distance threshold and a second distance threshold, selects a first warning message if the first state value is greater than or equal to the first state threshold and the distance to the subject is less than or equal to the first distance threshold, and selects a second warning message if the second state value is greater than or equal to the second state threshold and the distance to the subject is less than or equal to the second distance threshold, and a display control function that controls a display device using augmented reality technology so that the warning message selected by the determination unit is displayed to the subject in a way that is visible to the subject. [Effects of the Invention]

[0009] According to the display control device, display control method, and display control program relating to this disclosure, the safety of persons in the vicinity of an invisible object can be improved by displaying an object information image showing information about an invisible object in a way that is visible to persons in the vicinity of the invisible object. [Brief explanation of the drawing]

[0010] [Figure 1] This is an explanatory diagram showing an example of the configuration of a display system according to Embodiment 1 of this disclosure. [Figure 2]It is a functional block diagram showing a display system according to Embodiment 1 of the present disclosure. [Figure 3] It is an explanatory diagram showing an example of information stored in the object DB. [Figure 4] It is an explanatory diagram showing an example of an object information image. [Figure 5] It is a hardware configuration diagram showing a display control device according to Embodiment 1 of the present disclosure. [Figure 6] It is a flowchart showing a display control method according to Embodiment 1 of the present disclosure. [Figure 7] It is a functional block diagram showing a display system according to Embodiment 2 of the present disclosure. [Figure 8] It is an explanatory diagram showing an example of information stored in the threshold value DB. [Figure 9] It is an explanatory diagram showing an example of information stored in the risk DB. [Figure 10] It is an explanatory diagram showing an example of a warning image. [Figure 11] It is a flowchart showing a display control method according to Embodiment 2 of the present disclosure. [Figure 12] It is a functional block diagram showing a display system according to Modification 1 of Embodiment 2 of the present disclosure. [Figure 13] It is a functional block diagram showing a display system according to Embodiment 3 of the present disclosure. [Figure 14] It is an explanatory diagram showing an example of information stored in the shielding object DB. [Figure 15] It is an explanatory diagram showing an example of a shielding object information image. [[ID=4​​​​​​​​​​​​It is a flowchart showing a display control method according to Embodiment 4 of the present disclosure.

Embodiment for Carrying out the Invention

[0011] Hereinafter, as an example of a display control device, a display control method, and a display control program according to the present disclosure, description will be made using the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and the description thereof will not be repeated and will be omitted.

[0012] Embodiment 1. <Configuration of Embodiment 1> First, the display system 110 according to Embodiment 1 of the present disclosure will be described using FIG. 1. FIG. 1 is an explanatory diagram showing a configuration example of the display system 110. In FIG. 1, the connections between the respective components are shown by dotted arrows.

[0013] The display system 110 is a system that makes a target object information image I1 showing information about an invisible target object T (hereinafter referred to as target object information) visible to a target person U existing around the invisible target object T.

[0014] The invisible target object T is an object to be shielded that is at least partially shielded by a shield C, or a transparent object. In FIG. 1, an example is shown in which the invisible target object T is water T1 flowing inside a pipe C1. The water T1 is an object to be shielded shielded by the pipe C1 which is a shield C, and is also a transparent object.

[0015] Here, examples of the object to be shielded include gas or acid solution flowing inside a pipe, wiring inside a switchboard cover, a conducting wire covered with a wiring film, or a movable device partially hidden by a door, etc. Examples of the transparent object include gas or acid solution flowing inside a pipe, or leaked gas or leaked acid solution from a pipe, etc. The transparent object is an object that is transparent by itself and is a liquid or a gas, etc. Note that the transparent object only needs to be transparent and may be colored. These invisible objects T are invisible or nearly invisible, making it difficult for the subject U to notice their existence, type, or state. By generating and displaying an object information image I1, the subject U can become aware of the existence, type, or state of the invisible objects T.

[0016] A person U present in the vicinity of an invisible object T is a person who is within a range from which the location of the invisible object T can be seen. For example, if the invisible object T is water T1 flowing inside a pipe C1, then person U is within a range from which the pipe C1 can be seen.

[0017] Object information is information that indicates the type or state of an invisible object T. For example, if the invisible object T is water T1 flowing inside a pipe C1, the object information includes information indicating the type of invisible object T, such as "water," and information indicating the state of the invisible object T, such as "temperature" and "direction of fluid flow."

[0018] As shown in Figure 1, the display system 110 comprises a display device 210, a storage device 300, an object information detection device 310, and a display control device 410. The display device 210, the storage device 300, and the object information detection device 310 are communicated with the display control device 410 via a network.

[0019] The display device 210 is a device that performs augmented reality (AR) technology in response to the control of the display control device 410. In detail, the display device 210 provides the subject U with an augmented sense of reality by displaying AR images as digital information at a position consistent with the real environment visible through the display device 210. Here, AR images include still images, moving images, and videos. Specifically, the display device 210 displays the object information image I1 as an AR image at a position that matches the real environment visible through the display device 210. For example, the display device 210 displays the object information image I1 so that it is superimposed on the pipe C1 in the real environment, showing the object information of the water T1 flowing inside the pipe C1. By making the object information image I1 visible to the subject U who is near the water T1, the safety of the subject U can be improved.

[0020] The memory device 300 is a device that stores the three-dimensional position information (hereinafter referred to as object position information) of an invisible object T. The object information detection device 310 outputs the stored object position information to the display control device 410.

[0021] The object information detection device 310 is a detection device that detects object information of an invisible object T. The object information detection device 310 outputs the detected object information to the display control device 410.

[0022] The display control device 410 is a device that controls the display of AR images by the display device 210. For example, the display control device 410 generates an object information image I1 that shows object information of the water T1, and controls the display device 210 so that the object information image I1 is displayed in a way that is visible to the target person U who is present around the water T1.

[0023] Next, we will explain the details of each component using Figure 2. Figure 2 is a functional block diagram showing the display system 110.

[0024] First, let's describe the display device 210. In the following description, we will explain the case where the display device 210 is an HMD (Head Mounted Display). An HMD is an optically transmitted display device that, when worn on the head of a subject U, allows the user to view the real environment through a translucent screen while simultaneously viewing AR images displayed on the screen.

[0025] As shown in Figure 2, the display device 210 includes a device position and orientation detection unit 201 and a display unit 202.

[0026] The device position and attitude detection unit 201 detects the position information, orientation information, and attitude information of the display device 210. The device position and attitude detection unit 201 includes, for example, a GPS (Global Positioning System) receiver and an inertial measurement unit (IMU). The device position and attitude detection unit 201 outputs the detected position information, orientation information, and attitude information of the display device 210 to the display control device 410. The position information, orientation information, and posture information of the display device 210 correspond to the position information, orientation information, and posture information of the subject U. Therefore, the device position and posture detection unit 201 can estimate the position of the subject U, the direction in front of the subject U, and the posture of the subject U.

[0027] The display unit 202 displays an AR image in response to control by the display control device 410. By displaying the AR image on a translucent screen, the display unit 202 allows the subject U to simultaneously view the real environment and the AR image.

[0028] Next, we will describe the storage device 300. As described above, the storage device 300 stores object position information, which is the three-dimensional position information of an invisible object T. The object position information stored in the storage device 300 may be pre-set information, or it may be information detected in real time by an object position detection device (not shown). The storage device 300 outputs the stored object position information to the display control device 410.

[0029] The object information detection device 310 will now be described. As described above, the object information detection device 310 detects object information of an invisible object T. More specifically, the object information detection device 310 detects at least one of the following: information indicating the type of invisible object T and information indicating the state of the invisible object T. Multiple object information detection devices 310 may be provided depending on the object information to be detected, and each is installed in a position where object information can be detected. For example, if the invisible object T is water T1 flowing inside pipe C1, and the object information is "temperature" and "direction of fluid flow", the object information detection device 310 is a temperature sensor and a flow sensor, and is installed inside pipe C1 or at the connection point of pipe C1. The object information detection device 310 outputs the detected object information to the display control device 410.

[0030] Next, we will explain the display control device 410. The display control device 410 comprises an acquisition unit 10, a storage unit 20, an object identification unit 30, and a display control unit 40.

[0031] The acquisition unit 10 is an interface for exchanging information with external devices, including the display device 210, the storage device 300, and the object information detection device 310. The acquisition unit 10 includes a device position and orientation acquisition unit 11 that exchanges information with the display device 210, an object position acquisition unit 12 that exchanges information with the storage device 300, and an object information acquisition unit 13 that exchanges information with the object information detection device 310.

[0032] The device position and orientation acquisition unit 11 acquires position information, orientation information, and orientation information of the display device 210 from the device position and orientation detection unit 201 of the display device 210. The device position and orientation acquisition unit 11 outputs the acquired position information, orientation information, and orientation information of the display device 210 to the storage unit 20, the object identification unit 30, and the display control unit 40.

[0033] The object position acquisition unit 12 acquires object position information from the storage device 300. The object position acquisition unit 12 outputs the acquired object position information to the storage unit 20, the object identification unit 30, and the display control unit 40. In detail, the object position information that the object position acquisition unit 12 outputs to the display control unit 40 is the object position information of an invisible object T included in the field of view of the display device 210, which has been identified by the object identification unit 30.

[0034] The object information acquisition unit 13 acquires object information from the object information detection device 310. Specifically, the object information acquired by the object information acquisition unit 13 is object information of invisible object T included in the field of view of the display device 210, which has been identified by the object identification unit 30. The object information acquisition unit 13 outputs the acquired object information to the storage unit 20 and the display control unit 40.

[0035] The storage unit 20 stores the display control program 510, the display device DB (Data Base) 21, and the object DB 22.

[0036] The display control program 510 is a program that causes the computer to function as the display control device 410 according to Embodiment 1 and to execute the display control method according to Embodiment 1. In detail, the display control program 510 enables the computer to implement an object information acquisition function that acquires object information, which is information relating to an invisible object T, and a display control function that generates an object information image I1 showing the object information and controls a display device 210 using augmented reality technology so that the object information image I1 is displayed in a way that is visible to a person U present around the object.

[0037] The display device DB21 stores the field of view (FoV) of the display device 210. Here, the field of view of the display device 210 is expressed in degrees as the range of the real environment that the subject U can see through the display device 210. In other words, if the display device 210 is an HMD, the field of view of the display device 210 is expressed in degrees as the range of the real environment that the subject U can see with their eyes. For example, the display device DB21 stores a pre-set field of view of the display device 210, namely "vertical field of view of 125 degrees, horizontal field of view of 200 degrees".

[0038] Object DB22 stores object location information and object information for invisible object T. More specifically, object DB22 stores object location information and object information obtained from the storage device 300 or object information detection device 310.

[0039] Figure 3 shows an example of object location and object information stored in the object DB22. As shown in Figure 3, the object DB22 stores object location information and object information for each invisible object T. Specifically, the object DB22 stores object ID, object name, object location information, and object information. The object ID is information used to identify an invisible object T, and the object name is information indicating the name of the invisible object T. The object position information is the three-dimensional position information of the object. The object information is information indicating the type or state of the invisible object T, and multiple pieces of information may be stored for a single invisible object T. Information indicating the state of the invisible object T includes, for example, state type, temperature, concentration, current value, and direction of fluid flow. Of these, temperature, concentration, and current value are numerical values ​​that indicate the state of the invisible object T.

[0040] For example, in object DB22, the object information is set as follows: type "water", state type "normal", temperature "40 degrees", and fluid flow direction "right" for water T1 flowing inside pipe C1, which is an invisible object T. Also, the type "water", state type "high temperature", temperature "100 degrees", and fluid flow direction "right" is set for water T2 flowing inside pipe C2, which is different from pipe C1. Furthermore, the type "CO gas", state type "toxic gas", temperature "150 degrees", and concentration "10%" are set for gas T3 flowing inside pipe C3, which is different from pipes C1 and C2. And the type "CO gas", state type "toxic gas", and concentration "300 ppm" are set for leaked gas T4 from pipe C3.

[0041] The object identification unit 30 identifies an invisible object T that is included in the field of view of the display device 210. The field of view of the display device 210 is the range of the real environment that the subject U can see through the display device 210.

[0042] The object identification unit 30 first acquires the position information, orientation information, and orientation information of the display device 210 from the device position and orientation acquisition unit 11, the object position information from the object position acquisition unit 12, and the field of view of the display device 210 from the display device DB 21 of the storage unit 20. Next, the object identification unit 30 identifies the current field of view of the display device 210 based on the display device's position information, orientation information, orientation information, and field of view angle. Then, the object identification unit 30 identifies invisible objects T included in the field of view of the display device 210 based on the current field of view of the display device 210 and the object position information. More specifically, the object identification unit 30 identifies an invisible object T as being included in the field of view of the display device 210 if the object position information of the invisible object T is included in the current field of view of the display device 210. The object identification unit 30 outputs the invisible object T included in the field of view of the identified display device 210 to the object position acquisition unit 12 and the object information acquisition unit 13.

[0043] If multiple invisible objects T exist within the field of view of the display device 210, the object identification unit 30 identifies each of the multiple invisible objects T included in the field of view of the display device 210. The object identification unit 30 outputs the identified multiple invisible objects T to the object position acquisition unit 12 and the object information acquisition unit 13.

[0044] The display control unit 40 controls the display device 210. The display control unit 40 includes an object information image generation unit 41 and a display processing unit 42.

[0045] The object information image generation unit 41 generates an object information image I1 that shows object information. The object information image generation unit 41 first acquires the position information, orientation information, and orientation information of the display device 210 from the device position and orientation acquisition unit 11, the object position information from the object position acquisition unit 12, and the object information from the object information acquisition unit 13. Here, the information acquired from the object position acquisition unit 12 and the object information acquisition unit 13 is information about an invisible object T included in the field of view of the display device 210, which has been identified by the object identification unit 30. Based on the position information, orientation information, and orientation information of the display device 210 and the object position information of the invisible object T included in the field of view of the display device 210, the object information image generation unit 41 converts the object position information in the reference coordinate system to the coordinate system of the display device 210. Then, based on the converted object position information, it generates an object information image I1 so that the object information image I1 showing the object information of the invisible object T is displayed at a position consistent with the real environment visible through the display device 210.

[0046] Figure 4 shows examples of object information images I1. Figure 4(a) shows the object information image I1 of water T1 flowing inside pipe C1, which has object ID 1 as shown in Figure 3, and Figure 4(b) shows the object information image I1 of water T2 flowing inside pipe C2, which has object ID 2. Figure 4(c) shows the object information images I1 of water T1 and water T2. Figure 4(d) shows the object information image I1 of gas T3 flowing inside pipe C3, which has object ID 3, and leaked gas T4 from pipe C3, which has object ID 4.

[0047] As shown in Figure 4, the position that matches the real environment visible via the display device 210 is the position that superimposes on the location where the invisible object T exists. However, the position that matches the real environment visible via the display device 210 is not limited to the above; any display that allows the location of the invisible object T to be recognized is acceptable. For example, the position that matches the real environment visible via the display device 210 may be in the vicinity of the location where the invisible object T exists.

[0048] If multiple object information exists for a single invisible object T, the object information image generation unit 41 generates an object information image I1 that includes the multiple object information. Specifically, the object information image generation unit 41 generates a layer (hereinafter referred to as an information layer) for each object information and superimposes the multiple information layers to create the object information image I1. For example, as shown in Figures 4(a) and 4(b), an object information image I1 may be generated by superimposing four information layers indicating four object information items: "water," "state type," "temperature," and "direction of fluid flow," for a single invisible object T, namely water T1 flowing inside a pipe C1. Conversely, as shown in Figure 4(d), an object information image I1 may be generated for a single invisible object T, namely gas T3 flowing inside a pipe C3, namely consisting of only one layer indicating the object information item "state type." Furthermore, the object information included in the object information image I1 may be selectable, or it may be displayed as much as possible within a pre-set display range. Additionally, a display priority order may be set for the object information.

[0049] Furthermore, if multiple invisible objects T exist within the field of view of the display device 210, the object information image generation unit 41 generates an object information image I1 for each of the multiple invisible objects T, as shown in Figure 4(c). When multiple invisible objects T overlap, in order to clearly display the positional relationship of the multiple invisible objects T, it is desirable that, for the overlapping area, object information images I1 are not generated for invisible objects T that are located at a distance from the subject U, but object information images I1 are generated for invisible objects T that are located at a distance close to the subject U.

[0050] Furthermore, if the invisible object T is a transparent substance such as gas or liquid, the object information image generation unit 41 generates an object information image I1 that visualizes the transparent substance. For example, if the invisible object T is leaked gas T4 from piping C3, as shown in Figure 4(d), the object information image generation unit 41 generates an object information image I1 that visualizes the presence of the leaked gas T4 near piping C3. The leaked gas T4 is detected by the object information detection device 310 or a gas detection unit (not shown) provided in the display device 210. In addition, if the range or concentration of the leaked gas T4 is detected, that range or concentration may be included in the object information image I1. For example, the range or concentration of the leaked gas T4 is represented by the display density or size of the object information image I1.

[0051] The display processing unit 42 controls the display device 210 so that the object information image I1 generated by the object information image generation unit 41 is displayed to the subject U in a way that is visible to them. Specifically, the display processing unit 42 outputs the object information image I1 generated by the object information image generation unit 41 to the display device 210. Furthermore, if there are multiple invisible objects T in the field of view of the display device 210, the display processing unit 42 superimposes and displays multiple object information images I1.

[0052] Furthermore, the display control unit 40 may change the object information image I1 to be displayed on the display device 210 according to the attributes of the subject U. Specifically, the display control device 410 further includes an attribute acquisition unit (not shown) that acquires attribute information of the subject U, and the display control unit 40 may change the object information image I1 to be displayed on the display device 210 according to the attribute information. The attribute of the subject U is the affiliation that represents the subject U's position, such as worker, inspector, or visitor. Depending on the attribute of the subject U, the display control unit 40 may display invisible objects T or object information that the subject U needs to visualize. For example, if the subject U is a worker, only the invisible objects T that are predetermined work targets may be displayed. Alternatively, if the subject U is an inspector of the temperature of the fluid flowing inside the pipe C1, an object information image I1 containing only the temperature from the object information of the invisible object T may be generated and displayed.

[0053] Next, the hardware configuration of the display control device 410 according to this embodiment 1 will be described using Figure 5. Figure 5 is a hardware configuration diagram of the display control device 410.

[0054] As shown in Figure 5, the display control device 410 consists of a processor 401, an auxiliary storage device 402, a storage device 403, and a communication device 404. The processor 401, the auxiliary storage device 402, the storage device 403, and the communication device 404 are connected via a signal line 405.

[0055] The processor 401 is a device that implements the functions of the acquisition unit 10, the object identification unit 30, and the display control unit 40. The processor 401 implements the functions of the acquisition unit 10, the object identification unit 30, and the display control unit 40 of the display control device 410 by reading the necessary display control program 510 from the storage device 403 and executing processing. The processor 401 is, for example, an IC (Integrated Circuit) that performs arithmetic processing, such as a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or a GPU (Graphics Processing Unit).

[0056] The auxiliary storage device 402 is the storage unit 20 shown in Figure 2, and is the auxiliary storage device of the display control device 410. The auxiliary storage device 402 stores the display control program 510 necessary to realize each function of the display control device 410, and object information. The auxiliary storage device 402 is, for example, a ROM (Read Only Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive).

[0057] The storage device 403 is the main memory of the display control device 410. The main memory temporarily stores the calculations of the processing performed by the processor 401. The storage device 403 is, for example, RAM (Random Access Memory).

[0058] The communication device 404 is an interface for inputting and outputting data with external devices. The communication device 404 performs data input and output with the display device 210, the storage device 300, and the object information detection device 310. The communication device 404 is, for example, an Ethernet®, USB (Universal Serial Bus), or HDMI® (High-Definition Multimedia Interface) port.

[0059] Signal line 405 is a transmission path for sending and receiving data between the components shown in Figure 5.

[0060] <Display control method of Embodiment 1> Next, the procedure of the display control method executed by the display control device 410 according to Embodiment 1 will be explained with reference to Figure 6. Figure 6 is a flowchart of the display control method.

[0061] As shown in Figure 6, first, the display control device 410 acquires the position information, orientation information, attitude information, and viewing angle of the display device 210 (step S1). Specifically, the device position and attitude acquisition unit 11 acquires the position information, orientation information, and attitude information of the display device 210 from the device position and attitude detection unit 201 of the display device 210 and outputs them to the object identification unit 30. The object identification unit 30 also acquires the pre-set viewing angle of the display device 210 from the storage unit 20.

[0062] Next, the display control device 410 identifies the field of view of the display device 210 (step S2). Specifically, the object identification unit 30 identifies the current field of view of the display device 210 based on the position information, orientation information, orientation information, and field of view angle of the display device 210.

[0063] Next, the display control device 410 acquires object position information (step S3). Specifically, the object position acquisition unit 12 acquires object position information from the storage device 300 and outputs it to the object identification unit 30.

[0064] The display control device 410 identifies an invisible object T included in the field of view of the display device 210 (step S4). Specifically, the object identification unit 30 identifies an invisible object T included in the field of view of the display device 210 based on the current field of view and object position information of the display device 210. The object identification unit 30 identifies an invisible object T as being included in the field of view of the display device 210 if the object position information of the invisible object T is included in the current field of view of the display device 210.

[0065] When an invisible object T included in the field of view of the display device 210 is identified, the display control device 410 acquires object information of the identified invisible object T (step S5). Specifically, the object information acquisition unit 13 acquires object information of the invisible object T identified by the object identification unit 30 from the object information detection device 310 and outputs it to the object information image generation unit 41.

[0066] The display control device 410 generates an object information image I1 of the identified invisible object T (step S6). Specifically, the object information image generation unit 41 converts the object position information in the reference coordinate system to the coordinate system of the display device 210 based on the position information, orientation information, and orientation information of the display device 210, and the object position information of the invisible object T included in the field of view of the display device 210. Then, based on the converted object position information, the object information image generation unit 41 generates an object information image I1 so that the object information image I1 showing the object information of the invisible object T is displayed at a position consistent with the real environment visible through the display device 210.

[0067] When the object information image I1 is generated, the display control device 410 controls the display device 210 so that the object information image I1 is displayed to the subject U in a way that is visible to them (step S7). Specifically, the display processing unit 42 outputs the object information image I1 generated by the object information image generation unit 41 to the display device 210.

[0068] As described above, the display control method according to Embodiment 1 includes: an object identification step (steps S1-4) which identifies an invisible object T that is included in the field of view of the display device 210 based on the object position information of the invisible object T; an object information acquisition step (step S5) which acquires object information which is information relating to the invisible object T; and a display control step (steps S6-7) which generates an object information image I1 showing the object information and controls the display device 210 using augmented reality technology so that the object information image I1 is displayed so that it can be seen by a person U who is in the vicinity of the invisible object T.

[0069] In the above description, an example was given in which the object identification unit 30 identifies an invisible object T included in the field of view of the display device 210 based on the object position information of the invisible object T, but the system is not limited to this example. The object identification unit 30 only needs to be able to identify an invisible object T included in the field of view of the display device 210, and may use methods such as image recognition or pattern matching. When using methods such as image recognition or pattern matching, the display device 210 is further equipped with a shooting unit that captures the real environment, and can identify an invisible object T included in the field of view of the display device 210 by matching the captured image of the field of view of the display device 210 with a pre-set pattern of the area around the invisible object. Furthermore, if the invisible object T is an obstructed object, the image of the obstructed object may be set as the pattern. In addition, indicators such as markers that are predetermined may be placed around the invisible object, and the invisible object T may be identified by photographing and matching the markers. Furthermore, in order to improve the accuracy of identifying invisible objects T included in the field of view of the display device 210, a method based on object position information may be combined with an image recognition or pattern matching method.

[0070] The above description assumes that the display device 210 is an optically transparent HMD, but it is not limited to this. The display device 210 can be any device that performs display using augmented reality technology. For example, the display device 210 may be an optically opaque HMD, smartphone, or tablet, which is a video see-through type AR display device. If the display device 210 is a video see-through type AR display device, the display device 210 further includes a shooting unit that captures the real environment, and displays the captured image of the real environment and the object information image I1 on a screen that does not transmit light, thereby allowing the subject U to simultaneously view the real environment and the object information image I1. Furthermore, the display device 210 may be a projector. With a projector, projection AR can be realized by projecting an object information image I1, which is an AR image, into the real environment. When the display device 210 is a projector, the invisible object T included in the field of view of the display device 210 is not identified, and the object information image I1 is projected so as to be superimposed on a predetermined invisible object T, or in the vicinity of an invisible object T.

[0071] The above describes an example of acquiring object location information and object information from the storage device 300 and the object information detection device 310, but it is not limited to this. The object location information and object information may be stored in advance in the storage unit 20 of the display control device 410, and the object location acquisition unit 12 and the object information acquisition unit 13 may acquire the object location information and object information from the storage unit 20. Furthermore, although the above describes an example in which the storage device 300 stores object location information, it is not limited to this. The storage device 300 may also store object information. In addition, the storage device 300 may be connected to the object information detection device 310 via a network so as to be able to communicate, and may store object information detected in real time by the object information detection device 310.

[0072] The above describes an example in which the display device 210, storage device 300, object information detection device 310, and display control device 410 are configured as independent hardware and interconnected, but the invention is not limited to this. At least some of the above devices may be configured as a single unit. That is, at least some of the functional blocks shown in Figure 2 may be implemented in hardware, or they may be implemented through the cooperation of hardware and software.

[0073] Furthermore, the display device 210 may also include an audio notification unit (not shown) that provides audio information about the invisible object T to the subject U. By providing audio notification of object information in addition to displaying the object information image I1, it becomes easier for the subject U to recognize the existence, type, or state of the invisible object T.

[0074] <Effects of Embodiment 1> The operation and effects of the display control device 410, display control method, and display control program 510 according to Embodiment 1 of this disclosure will be described.

[0075] The display control device 410 according to this embodiment 1 includes an object information acquisition unit 13 that acquires object information, which is information relating to an invisible object T, and a display control unit 40 that generates an object information image I1 showing the object information and controls a display device 210 using augmented reality technology so that the object information image I1 is displayed in a way that is visible to a person U who is in the vicinity of the invisible object T.

[0076] The display control method according to this embodiment 1 includes an object information acquisition step of acquiring object information, which is information relating to an invisible object T, and a display control step of generating an object information image I1 that shows the object information, and controlling a display device 210 using augmented reality technology so that the object information image I1 is displayed in a way that is visible to a person U who is in the vicinity of the invisible object T.

[0077] The display control program 510 according to this embodiment 1 enables the computer to implement an object information acquisition function that acquires object information, which is information relating to an invisible object T, and a display control function that generates an object information image I1 showing the object information and controls a display device 210 using augmented reality technology so that the object information image I1 is displayed in a way that is visible to a person U who is in the vicinity of the invisible object T.

[0078] According to the display control device 410, display control method, and display control program 510 of Embodiment 1 of this disclosure, by displaying an object information image I1 showing information about an invisible object T in a way that is visible to a person U present in the vicinity of the invisible object T, the presence of the invisible object T can be made visible, and the safety of the person U present in the vicinity of the invisible object T can be improved.

[0079] Furthermore, the object information acquisition unit 13 of the display control device 410 according to this embodiment 1 acquires information indicating the type or state of an invisible object T as object information. According to the display control device 410 described above, the safety of persons U present in the vicinity of an invisible object T can be improved by making the type or state of the invisible object visible.

[0080] The display control device 410 according to this embodiment 1 further comprises an object position acquisition unit 12 that acquires object position information, which is three-dimensional position information of an invisible object T, and an object identification unit 30 that identifies an invisible object T included in the field of view of the display device 210 based on the object position information. The display control unit 40 also generates and displays an object information image of the object identified by the object identification unit 30. According to the display control device 410 described above, an invisible object T can be identified based on object position information, which is three-dimensional position information.

[0081] Furthermore, the object identification unit 30 of the display control device 410 identifies each of the multiple invisible objects T included in the field of view of the display device 210. The display control unit 40 also generates and displays multiple object information images I1 of the multiple invisible objects T included in the field of view of the display device 210. According to the display control device 410 described above, by displaying multiple object information images I1 of multiple invisible objects T in a way that is visible to the subject U, the subject U can identify multiple invisible objects T. For example, if there are multiple pipes C1 that look similar in appearance within the field of view of the display device 210, the subject U can identify the pipe C1 by viewing the multiple object information images I1 and determining the type or state of the object T flowing inside the pipe C1. Therefore, by using the display control device 410 according to this embodiment 1 in a workplace such as a factory, work efficiency can be improved.

[0082] Embodiment 2. Embodiment 1 of this disclosure describes a display control device 410 that generates and displays an object information image I1 showing object information of an invisible object T. Embodiment 2 of this disclosure describes a display control device 420 that determines the danger posed by an invisible object T and generates and displays a warning image I2 if it is determined that the object is dangerous. In Embodiment 2, the same reference numerals are used for the same components as in Embodiment 1 of this disclosure, and descriptions of the same or corresponding parts are omitted. Hereinafter, the display control device 420 according to Embodiment 2 will be described with reference to the drawings. Embodiment 2 of this disclosure relates to a display control device 420, a display system 120 equipped with the display control device 420, a display control method using the display control device 420, and a display control program 520 that enables a computer to implement the functions of the display control device 420.

[0083] <Configuration of Embodiment 2> First, the display system 120 according to Embodiment 2 of this disclosure will be described with reference to Figure 7. Figure 7 is a functional block diagram showing the display system 120.

[0084] As shown in Figure 7, the display system 120 includes a display device 220 and a display control device 420 that differ from those in Embodiment 1. The display device 220 includes a distance detection unit 203 in addition to the configuration of the display device 220 according to Embodiment 1. The display control device 420 includes a distance acquisition unit 14, a threshold DB 23, a risk DB 24, a determination unit 50, and a warning image generation unit 43 in addition to the configuration of the display control device 410 according to Embodiment 1.

[0085] The distance detection unit 203 detects the distance L between the subject U and the invisible object T. More specifically, the distance detection unit 203 detects the distance L between the subject U and the invisible object T that is included in the field of view of the display device 220, which has been identified by the object identification unit 30. The distance detection unit 203 is, for example, a light reflection type distance sensor or an ultrasonic type distance sensor. The distance detection unit 203 outputs the detected distance L to the distance acquisition unit 14 of the display control device 420.

[0086] The distance acquisition unit 14 acquires the distance L. As described above, the distance L is the distance between the subject U and the invisible object T included in the field of view of the display device 220, which has been identified by the object identification unit 30. The distance acquisition unit 14 outputs the acquired distance L to the determination unit 50.

[0087] Threshold DB23 stores state thresholds and distance thresholds used to determine whether an invisible object T poses a risk. The state thresholds and distance thresholds are pre-set values ​​associated with the invisible object T and serve as criteria for determining the risk of the invisible object T.

[0088] Figure 8 shows an example of state thresholds and distance thresholds stored in the threshold DB23. As shown in Figure 8, the threshold DB23 stores state thresholds and distance thresholds for each invisible object T. In detail, the threshold DB23 stores the object ID, object name, state threshold, and distance threshold. The state threshold is a threshold value corresponding to the state of an invisible object T included in the object information. The distance threshold is a threshold value corresponding to the distance L and is pre-set in relation to the state of the invisible object T. For example, in the threshold DB23, a temperature threshold of "60 degrees," which is a state threshold corresponding to the "temperature" indicating the state of water T1, is set in relation to water T1 flowing inside pipe C1, which is an invisible object T, and a distance threshold of "1 m," which is set in relation to the distance L between water T1 and subject U.

[0089] Furthermore, if object DB22 can store multiple numerical values ​​indicating the state of a single invisible object T, then threshold DB23 will have multiple state thresholds and distance thresholds corresponding to each of the multiple states. For example, threshold DB23 will have, linked to gas T3 flowing inside pipe C3, which is an invisible object T, a temperature state threshold of "60 degrees" and a concentration state threshold of "200 ppm" corresponding to the "temperature" and "concentration" that indicate the state of gas T3, respectively, as well as a distance threshold of "1 m" when the temperature of gas T3 is equal to or greater than the temperature state threshold and a distance threshold of "0.5 m" when the concentration of gas T3 is equal to or greater than the concentration state threshold.

[0090] Hazard DB24 stores information indicating the hazards associated with invisible object T. This information is pre-configured and linked to invisible object T.

[0091] Figure 9 shows an example of the information stored in the Hazard DB24. As shown in Figure 9, the Hazard DB24 stores hazard and warning information for each invisible object T. Specifically, the Hazard DB24 stores the object ID, object name, hazard type, and warning information. The hazard type is the type of hazard associated with an invisible object T, and corresponds to the state of the invisible object T for which a state threshold has been set. Warning information is information used to warn about the hazards of the invisible object T, and is pre-set in association with the hazard type. For example, in the hazard DB24, associated with the water T1 flowing inside the pipe C1, which is an invisible object T, the hazard type "high temperature" corresponding to the "temperature" that indicates the state of the water T1 for which a state threshold has been set, and the warning information "It's hot! Do not touch," which warns about the hazard type "high temperature," are set.

[0092] Furthermore, if multiple state thresholds are set for a single invisible object T in the threshold DB23, the hazard DB24 will contain multiple hazard types and multiple warning information corresponding to each of the multiple state thresholds. For example, in the hazard DB24, linked to gas T3 flowing inside pipe C3, which is an invisible object T, two hazard types, "high temperature" and "toxic," corresponding to the state of gas T3, "temperature" and "concentration," for which state thresholds have been set, are set, and warning information for the two hazard types, "high temperature" and "toxic," is set, "It's hot! Do not touch!" and "Toxic substances are flowing!".

[0093] The above example describes a scenario where the Hazard DB24 stores hazard types and warning information corresponding to the state of an invisible object T for which a state threshold has been set. However, this is not the only example. The hazard types and warning information stored in the Hazard DB24 only need to be pre-configured and linked to the invisible object T.

[0094] Furthermore, while the above example describes storing state thresholds and distance thresholds in threshold DB23 and hazard types and warning information in hazard DB24, this is not the only example. State thresholds, distance thresholds, hazard types, and warning information may be stored in separate tables or in the same table.

[0095] The determination unit 50 determines whether or not the invisible object T poses a danger. More specifically, the determination unit 50 determines whether or not the invisible object T poses a danger based on object information and distance L. The determination unit 50 acquires object information from the object information acquisition unit 13, distance L from the distance acquisition unit 14, and state threshold and distance threshold from the threshold DB 23 of the storage unit 20. Here, the information acquired from the object information acquisition unit 13 and the distance acquisition unit 14 is information about invisible objects T included in the field of view of the display device 220 identified by the object identification unit 30. The determination unit 50 determines that the invisible object T is dangerous if the numerical value indicating the state of the invisible object T included in the object information is greater than or equal to the state threshold, and the distance L is less than or equal to the distance threshold. The determination unit 50 outputs whether or not the invisible object T is dangerous to the warning image generation unit 43.

[0096] If multiple invisible objects T are present in the field of view of the display device 220, the determination unit 50 determines whether each of the multiple invisible objects T included in the field of view of the display device 220 poses a risk. The determination unit 50 outputs the risk status of the multiple invisible objects T to the warning image generation unit 43.

[0097] The warning image generation unit 43 generates a warning image I2 indicating the danger posed by the invisible object T when the determination unit 50 determines that the invisible object T is dangerous. The warning image generation unit 43 obtains the determination result of the danger level of the invisible object T from the determination unit 50. If the determination unit 50 determines that the invisible object T is dangerous, the warning image generation unit 43 obtains the position information, orientation information, and orientation information of the display device 220 from the device position and orientation acquisition unit 11, the object position information of the invisible object T determined to be dangerous from the object position acquisition unit 12, and warning information indicating the danger level of the invisible object T determined to be dangerous from the danger DB 24. Based on the position information, orientation information, and orientation information of the display device 220 and the object position information of the invisible object T determined to be dangerous, the warning image generation unit 43 converts the object position information in the reference coordinate system to the coordinate system of the display device 220. Then, based on the converted object position information, it generates a warning image I2 so that the warning image I2 indicating the warning information of the invisible object T is displayed at a position consistent with the real environment that can be seen through the display device 220.

[0098] Figure 10 shows an example of a warning image I2. As shown in Figure 10, the warning image I2 is displayed near the location of the invisible object T so that it does not overlap with the object information image I1 and the target of the warning image I2 can be recognized. It is desirable that the warning image I2 is displayed so as not to overlap with the object information image I1. Furthermore, it is desirable that the warning image I2 is an image that points to the location of the invisible object T, which is the target of the warning image I2, using a callout or the like, so that the location of the invisible object T can be recognized.

[0099] Furthermore, if multiple warning pieces of information exist for a single invisible object T, the warning image generation unit 43 may generate a warning image I2 containing multiple warning pieces of information, or it may generate a warning image I2 containing only the warning pieces of information that have a large difference from the state threshold or distance threshold. The warning pieces of information included in the warning image I2 may be selectable. In addition, a display priority may be set for the warning pieces of information.

[0100] Furthermore, if there are multiple invisible objects T that pose a risk within the field of view of the display device 220, the warning image generation unit 43 generates a warning image I2 for each of the multiple invisible objects T. It is desirable that the multiple warning images I2 are generated so as not to overlap with other warning images I2 or object information images I1.

[0101] The display processing unit 42 controls the display device 210 so that the object information image I1 and the warning image I2 are displayed to the target person U in a way that is easily visible. Specifically, the display processing unit 42 outputs the object information image I1 generated by the object information image generation unit 41 and the warning image I2 generated by the warning image generation unit 43 to the display device 210.

[0102] In the above example, a warning image I2 is displayed for an invisible object T that has been determined to be dangerous, but the object information image I1 may also be emphasized. Specifically, the object information image generation unit 41 may generate the object information image I1 such that, among a plurality of invisible objects T, the object information of the invisible object T that has been determined to be dangerous by the determination unit 50 is emphasized.

[0103] <Display control method of Embodiment 2> Next, the procedure of the display control method executed by the display control device 420 according to Embodiment 2 will be explained with reference to Figure 11. Figure 11 is a flowchart of the display control method according to Embodiment 2. Note that in Figure 11, steps S1 to S7 shown in Figure 6 are omitted.

[0104] In the display control method executed by the display control device 420 according to Embodiment 2, first, steps S1 to S7 are performed in the same manner as in Embodiment 1. After step S7, the display control device 410 acquires the distance L between the subject U and the invisible object T (step S8). Specifically, the distance acquisition unit 14 acquires the distance L from the distance detection unit 203 of the display device 210. The distance acquisition unit 14 outputs the acquired distance L to the determination unit 50.

[0105] Next, the determination unit 50 of the display control device 410 determines whether the numerical value indicating the state of the invisible object T included in the object information is greater than or equal to the state threshold (step S9). If the numerical value indicating the state of the invisible object T is greater than or equal to the state threshold (Yes in step S9), the determination unit 50 determines whether the distance L is less than or equal to the distance threshold (step S10). If the distance L is less than or equal to the distance threshold (Yes in step S10), the determination unit 50 determines that the invisible object T is dangerous (step S11). If the numerical value indicating the state of the invisible object T is less than the state threshold (No in step S9), or if the distance L is greater than the distance threshold (No in step S10), the determination unit 50 determines that the invisible object T is not dangerous (step S14). Here, the state threshold and distance threshold used by the determination unit 50 for determination are values ​​that are set in advance and associated with the invisible object T, and are stored in the threshold DB 23.

[0106] When the determination unit 50 determines that the invisible object T is dangerous (step S11), the warning image generation unit 43 generates a warning image I2 indicating the danger of the invisible object T (step S12). Specifically, the warning image generation unit 43 generates the warning image I2 based on the position information, orientation information, and orientation information of the display device 220, the object position information of the invisible object T determined to be dangerous, and the warning information indicating the danger, so that the warning image I2 indicating the warning information of the invisible object T is displayed at a position that is consistent with the real environment visible through the display device 220.

[0107] When the warning image I2 is generated, the object information image generation unit 41 controls the display device 210 so that the object information image I1 and the warning image I2 are displayed to the target person U in a visible manner (step S13). If the determination unit 50 determines that the invisible object T does not pose a danger (step S14), the object information image generation unit 41 does not display the warning image I2 and terminates control of the display device 220.

[0108] In addition, the above describes an example of determining the danger of an invisible object T based on object information and distance L, but the danger of an invisible object T may also be determined based on object information alone. Specifically, the determination unit 50 may determine that an invisible object T is dangerous if the numerical value indicating the state of the object is equal to or greater than the state threshold. In this case, step S10 in Figure 11 is not performed.

[0109] The display device 220 may also include an audio notification unit (not shown) that provides audio information to the subject U indicating the danger posed by the invisible object T. In addition to displaying the warning image I2, providing audio information indicating the danger posed by the invisible object T makes it easier for the subject U to recognize the danger posed by the invisible object T.

[0110] <Effects of Embodiment 2> The operation and effects of the display control device 420, display control method, and display control program 520 according to Embodiment 2 of this disclosure will be described.

[0111] The display control device 420 according to this second embodiment further includes a determination unit 50 that determines whether or not an invisible object T poses a danger based on object information, in addition to the display control device 410 according to this first embodiment. Furthermore, if the determination unit 50 determines that the invisible object T poses a danger, the display control unit 40 of the display control device 420 according to this second embodiment further generates a warning image I2 indicating the danger of the invisible object T and further displays the warning image I2.

[0112] According to the display control device 420, display control method, and display control program 520 of Embodiment 2 of this disclosure, the dangers of an invisible object T can be made visible, and the safety of persons U present in the vicinity of the invisible object T can be further improved.

[0113] Furthermore, the display control device 420 according to this second embodiment generates an object information image I1 such that, among a plurality of invisible objects T, the object information of invisible objects T determined to be dangerous by the determination unit 50 is emphasized compared to invisible objects T determined to be non-dangerous. According to the display control device 420 described above, the visibility of an invisible object T that poses a risk can be improved. Therefore, the safety of persons U present in the vicinity of the invisible object T can be further enhanced.

[0114] The determination unit 50 of the display control device 420 according to this second embodiment determines that the invisible object T is dangerous if the numerical value indicating the state of the invisible object T is equal to or greater than the state threshold set in association with the invisible object T. According to the display control device 420 described above, the subject U can set a state threshold that serves as a criterion for determining the danger of an invisible object T. Therefore, the danger of the invisible object T can be accurately determined.

[0115] The display control device 420 according to this second embodiment further includes a distance acquisition unit 14 that acquires the distance L between the subject U and the invisible object T. The determination unit 50 determines whether or not the invisible object T poses a danger based on the object information and the distance L. According to the display control device 420 described above, the danger posed by the invisible object T can be determined according to the distance L between the subject U and the invisible object T. Since the likelihood (danger) of subject U being affected by the danger posed by object T changes, determining the danger posed by the invisible object T according to the distance L allows for an accurate determination of the danger posed by the invisible object T to subject U.

[0116] The determination unit 50 of the display control device 420 determines that the invisible object T is dangerous if the numerical value indicating the state of the invisible object T is equal to or greater than the state threshold set in association with the invisible object T, and the distance L is equal to or less than the distance threshold set in association with the invisible object T. According to the display control device 420 described above, the subject U can set state thresholds and distance thresholds that serve as criteria for determining the danger of an invisible object T. By setting two criteria, the danger of the invisible object T can be determined more accurately.

[0117] Variation 1. In a modified example of Embodiment 2, a display control device 420a further comprising a threshold setting unit 60 that sets a distance threshold based on environmental information, which is information about the environment surrounding an invisible object T, is described.

[0118] First, a display system 120a according to a modified example 1 of Embodiment 2 of this disclosure will be described with reference to Figure 12. Figure 12 is a functional block diagram showing the display system 120a.

[0119] As shown in Figure 12, the display system 120a includes, in addition to the configuration of Embodiment 2, an environmental information detection device 320 and a display control device 420a that differs from that of Embodiment 2. The environmental information detection device 320 and the display control device 420a are connected via a network for communication. The display control device 420a includes, in addition to the configuration of the display control device 420 according to Embodiment 2, an environmental information acquisition unit 15 and a threshold setting unit 60.

[0120] The environmental information detection device 320 is a device that acquires environmental information, which is information about the environment surrounding an invisible object T. Environmental information includes information about objects surrounding the invisible object T, temperature, humidity, airflow, etc. Objects surrounding the invisible object T include, for example, doors or walls that may separate the invisible object T from a person U when the person U approaches the invisible object T, or air conditioning equipment or windows that change the airflow around the invisible object T. Information about objects surrounding the invisible object T includes the arrangement and number of surrounding objects, etc.

[0121] The environmental information acquisition unit 15 acquires environmental information from the environmental information detection device 320. The environmental information acquisition unit 15 outputs the acquired environmental information to the threshold setting unit 60.

[0122] The threshold setting unit 60 sets a distance threshold based on environmental information. More specifically, the threshold setting unit 60 sets a distance threshold based on at least one of the object information and hazard type of the invisible object T, and environmental information. This is because the possibility that a person U may be affected by the hazards of the invisible object T, that is, the hazard of the invisible object T, changes depending on the environment surrounding the invisible object T.

[0123] Let's explain an example where the invisible object T is water T2 flowing inside pipe C2 and may have a hazard category of "high temperature". The more doors or walls there are around the water T1 flowing inside pipe C1, the smaller the possibility that a person U will come into contact with pipe C1, and therefore the smaller the possibility that person U will be affected by the hazard category of "high temperature". Also, the lower the temperature around the water T1 flowing inside pipe C1, the cooler the surface of pipe C1 will be, and the smaller the possibility that person U will be affected by the hazard category of "high temperature". Therefore, if the invisible object T is water T1 flowing inside pipe C1 and may have a hazard category of "high temperature", the threshold setting unit 60 sets the distance threshold lower the more doors or walls included in the environmental information are, or the lower the temperature included in the environmental information is.

[0124] Let's explain an example where an invisible object T is leaked gas T4 and may have the hazard classification "toxic". The more doors or walls there are around the leaked gas T4, the more the leaked gas T4 will remain inside the area enclosed by the doors or walls, and the smaller the area over which a person U will be affected by the hazard "toxic". Also, if there is air conditioning equipment or windows around the leaked gas T4 and airflow exists, the leaked gas T4 will spread along that airflow, so the distance over which a person U will be affected by the hazard "toxic" will vary depending on the direction. Therefore, if the invisible object T is leaked gas T4 and may have the hazard classification "toxic", the threshold setting unit 60 sets the distance threshold to be smaller the more doors or walls are included in the environmental information. In addition, the threshold setting unit 60 calculates the airflow based on the arrangement of air conditioning equipment or windows included in the environmental information and sets the distance threshold to be larger in the direction of airflow and smaller in other directions.

[0125] Let's explain an example where an invisible object T is wiring and may have a hazard category of "high current". The more doors or walls there are around the wiring, the less likely it is that a person U will come into contact with the wiring, and therefore less likely that person U will be affected by the "high current" hazard. Also, if the humidity around the wiring is low, current will not propagate as easily in the event of a short circuit compared to when the humidity is high, and therefore less likely that person U will be affected by the "high current" hazard. Therefore, if the invisible object T is wiring and may have a hazard category of "high current", the threshold setting unit 60 sets the distance threshold lower the more doors or walls included in the environmental information are, or the lower the humidity included in the environmental information is.

[0126] As described above, the threshold setting unit 60 sets the distance threshold based on environmental information, thereby enabling accurate determination of the range in which the subject U is affected by the danger of an invisible object T.

[0127] In the above description, an example was given in which the threshold setting unit 60 sets a distance threshold based on at least one of the object information and hazard type of the invisible object T, as well as environmental information. However, the threshold setting unit 60 may also set the distance threshold based solely on environmental information. For example, the threshold setting unit 60 may set a smaller distance threshold the more doors or walls included in the environmental information there are.

[0128] In the display control method executed by the display control device 420a according to the modified example 1 of Embodiment 2, before S10 shown in Figure 11, the threshold setting unit 60 sets a distance threshold based on environmental information.

[0129] The operation and effects of a display control device 420a, a display control method, and a display control program 520a according to a modified example 1 of Embodiment 2 of this disclosure will be described. The display control device 420a according to Modification 1 of Embodiment 2 of the present disclosure further comprises, in addition to the configuration of the display control device 420 according to Embodiment 2 of the present disclosure, an environmental information acquisition unit 15 that acquires environmental information which is information relating to the environment around an invisible object T, and a threshold setting unit 60 that sets a distance threshold based on the environmental information. According to the display control device 420a, display control method, and display control program 520a of the modified example 1 of Embodiment 2 of this disclosure, the hazard determination criteria for the invisible object T can be changed according to the surrounding environment of the invisible object T, thereby enabling a more accurate determination of the hazard of the invisible object T, which changes according to the surrounding environment of the invisible object T.

[0130] Embodiment 3. Embodiment 2 of this disclosure describes a display control device 420 that generates and displays an object information image I1 showing object information of an invisible object T, which is an object to be shielded, and a warning image I2 showing the danger of the invisible object T. Embodiment 3 of this disclosure further describes a display control device 430 that generates and displays an object information image showing object information, which is information about a shield C. In Embodiment 3, the same reference numerals are used for the same components as in Embodiments 1-2 of this disclosure, and descriptions of the same or corresponding parts are omitted. The display control device 430 according to Embodiment 3 will now be described with reference to the drawings. Embodiment 3 of this disclosure relates to a display control device 430, a display system 130 equipped with the display control device 430, a display control method using the display control device 430, and a display control program 530 that enables a computer to implement the functions of the display control device 430.

[0131] <Configuration of Embodiment 3> First, the display system 130 according to Embodiment 3 of this disclosure will be described with reference to Figure 13. Figure 13 is a functional block diagram showing the display system 130.

[0132] As shown in Figure 13, the display system 130 includes, in addition to the configuration of Embodiment 2, an obstruction information detection device 330 and a display control device 430 that differs from that of Embodiment 2. The obstruction information detection device 330 and the display control device 430 are connected via a network for communication. The display control device 430 includes, in addition to the configuration of the display control device 420 according to Embodiment 2, an obstruction information acquisition unit 16, an obstruction DB 25, and an obstruction information image generation unit 44.

[0133] The shield information detection device 330 is a device that detects shield information, which is information relating to the shield C. The shield information includes information indicating the state of the shield C, such as its deterioration state, and work support information such as maintenance information. Multiple shield information detection devices 330 may be provided depending on the shield information to be detected, and each is installed in a position where shield information can be detected. For example, the shield information detection device 330 is an ultrasonic sensor or a near-infrared camera that detects the deterioration state of the shield C, and is installed on the shield C. The shield information detection device 330 outputs the detected shield information to the display control device 430.

[0134] The occluding object information acquisition unit 16 acquires occluding object information from the occluding object information detection device 330. The environmental information acquisition unit 15 outputs the acquired occluding object information to the occluding object DB 25 and the occluding object information image generation unit 44.

[0135] Shielding object DB25 stores shielding object information for shielding object C. More specifically, target object DB22 stores shielding object information acquired from shielding object information detection device 330.

[0136] Figure 14 shows an example of shield information stored in the shield DB 25. As shown in Figure 14, the shield DB 25 stores shield information for each shield C. In detail, the shield DB 25 stores the shield ID, shield name, and shield information. The shield ID is information for identifying shield C, and the shield name is information indicating the name of shield C. The shield ID is associated with the object that shield C shiels, at least partially. Multiple pieces of information about a single invisible object T may be stored. For example, the shield DB25 stores information about a pipe C1, which is a shield C, including its deterioration status, estimated replacement time, and location of deterioration.

[0137] The occluding object information image generation unit 44 generates an occluding object information image that shows occluding object information. The occlusion information image generation unit 44 converts the object position information in the reference coordinate system to the coordinate system of the display device 220 based on the position information, orientation information, and orientation information of the display device 220, and the object position information of the invisible object T which is the occluded object. Then, based on the converted object position information, it generates an occlusion information image I3 so that the occlusion information image I3 is displayed at a position that matches the occluded object C that can be seen through the display device 220.

[0138] Figure 15 shows an example of an occluding object information image I3. As shown in Figure 15, it is desirable that the occluding object information image I3 is not superimposed on the object information image I1, and that the object of the occluding object information image I3 is displayed in a way that allows for recognition. In Figure 15, the deteriorated areas are shown as crack images. Deteriorated areas may also be indicated by differences in color, highlighting, or blinking. In addition, in Figure 15, the deterioration state and the estimated time of effect are displayed near the occluding object C, with the location indicated by a callout.

[0139] The display processing unit 42 controls the display device 220 so that the object information image I1 and the occluding object information image I3 are displayed to the subject U in a way that is visible to them. Specifically, the display processing unit 42 outputs the object information image I1 generated by the object information image generation unit 41 and the occluding object information image I3 generated by the occluding object information image generation unit 44 to the display device 220. The display processing unit 42 may also control the display device 210 so that the warning image I2 is displayed at the same time.

[0140] <Display control method of Embodiment 3> Next, the procedure of the display control method executed by the display control device 430 according to Embodiment 3 will be explained with reference to Figure 16. Figure 16 is a flowchart of the display control method according to Embodiment 3. Note that in Figure 16, steps S1 to S14 shown in Figure 11 are omitted.

[0141] In the display control method executed by the display control device 430 according to Embodiment 3, first, steps S1 to S14 are performed in the same manner as in Embodiment 2. After step S14, the display control device 430 acquires information about the occluding object C (step S15). Specifically, the occluding object information acquisition unit 16 acquires occluding object information from the occluding object information detection device 330. The occluding object information acquisition unit 16 outputs the acquired occluding object information to the occluding object information image generation unit 44.

[0142] Next, the display control device 430 generates an occlusion information image I3 showing occlusion information (step S16). Specifically, the display control device 430 generates the occlusion information image I3 based on the position information, orientation information, and orientation information of the display device 220, the object position information of the invisible object T which is the object to be occluded, and the occlusion information of the occlusion object C which occludes at least a part of the invisible object T, so that the occlusion information image I3 showing occlusion information is displayed at a position that matches the occlusion object C that can be seen through the display device 220.

[0143] When the occlusion information image I3 is generated, the display processing unit 42 controls the display device 210 so that the object information image I1 and the occlusion information image I3 are displayed to the subject U in a visible manner (step S17). The display processing unit 42 may also control the display device 210 so that the warning image I2 is displayed at the same time.

[0144] In the above example, an example was described in which obstacle information is acquired from an obstacle information detection device 330 provided separately from the display device 220, but this is not the only example. The obstacle information detection device 330 may be provided integrally with the display device 220. Furthermore, obstacle information may also be acquired from a management device (not shown) that manages information such as deterioration status and maintenance information acquired in the past. Furthermore, the shielding object DB25 may also store information estimated from previously acquired data as shielding object information. For example, the replacement history of components constituting shielding object C may be acquired from a management device (not shown), and the estimated replacement time may be estimated based on the replacement history. Not limited to the estimated replacement time, deteriorated locations and deterioration status may also be estimated based on the history information. The estimated results are displayed on the display device 220 as shielding object information image I3.

[0145] <Effects of Embodiment 3> The operation and effects of the display control device 430, display control method, and display control program 530 according to Embodiment 3 of this disclosure will be described.

[0146] The display control device 430 according to this third embodiment further includes an obstacle information acquisition unit 16 that acquires obstacle information, which is information relating to an obstacle C, in addition to the display control devices 410 and 420 according to these first two embodiments. Furthermore, the display control unit 40 of the display control device 430 according to this third embodiment further generates an obstacle information image showing the obstacle information and further displays the obstacle information image.

[0147] According to the display control device 430, display control method, and display control program 530 of Embodiment 3 of this disclosure, the state of a shielding object C that shields at least a portion of an invisible object T can be visualized, thereby further improving the safety of persons U present around the invisible object T. In particular, if the shielding object information is deterioration information or maintenance information, the workability of tasks such as replacing the shielding object can be improved.

[0148] Embodiment 4. Embodiment 4 of this disclosure describes a display control device 440 that performs display control corresponding to the display operation of the target user U. In Embodiment 4, the same reference numerals are used for the same components as in Embodiments 1-3 of this disclosure, and descriptions of the same or corresponding parts are omitted. Hereinafter, the display control device 440 according to Embodiment 3 will be described with reference to the drawings. Embodiment 2 of this disclosure relates to a display control device 440, a display system 140 equipped with the display control device 440, a display control method using the display control device 440, and a display control program 540 that enables a computer to implement the functions of the display control device 440.

[0149] <Configuration of Embodiment 4> First, the display system 140 according to Embodiment 4 of this disclosure will be described with reference to Figure 17. Figure 17 is a functional block diagram showing the display system 140.

[0150] As shown in Figure 17, the display system 140 includes a display device 240 and a display control device 440 that differ from those in Embodiment 3. The display device 240 includes a display operation receiving unit 204 in addition to the configuration of the display device 220 according to Embodiment 1. The display control device 440 includes a display operation acquisition unit 17, a display operation DB 26, and a display processing unit 42a in addition to the configuration of the display control device 430 according to Embodiment 3.

[0151] The display operation reception unit 204 receives an action from the subject U to operate the AR image displayed by the display device 210. The display operation reception unit 204 detects the subject U's gaze, blink count, eye signals, voice, or gesture as a display operation. Gaze refers to, for example, fixating on the AR image that is the target of the display operation. Blink count refers to the number of times the subject U opens and closes their eyelids. For example, to distinguish it from physiological blinking, blinks in which the eyelids are closed for a longer period than a predetermined time are accepted as a display operation. Eye signals refer to, for example, movements of the eyes up, down, left, or right. Voice refers to, for example, uttering a predetermined phrase indicating a display operation. Gestures refer to actions using the hands or feet.

[0152] The display operation reception unit 204 receives display operations, for example, from a camera or microphone provided on the display device 240. For example, the gaze, blinking frequency, and eye signals of the subject U are detected by a camera provided on the display device 240 to photograph the eyes of the subject U. Voice is detected by a microphone provided on the display device 240. Gestures are detected by a camera provided on the display device 240 to photograph the front of the subject U. Here, the camera provided on the display device 240 to photograph the front of the subject U may be a camera provided to photograph the location where an invisible object T exists. In the above description, an example was given in which the display operation reception unit 204 is provided on the display device 240, but this is not the only example. The display operation reception unit 204 may be provided separately from the display device 240. For example, the display operation reception unit 204 may be a wearable device equipped with a motion sensor that is worn on the hand or foot of the subject U. A wearable device equipped with a motion sensor can detect the gestures of the subject U.

[0153] The display operation reception unit 204 outputs information about the detected display operation to the display operation acquisition unit 17.

[0154] The display operation acquisition unit 17 acquires display operation information indicating the content of the AR image display operation received from the target user U. More specifically, the display operation acquisition unit 17 acquires display operation information corresponding to the operation received from the target user U based on the operation indicating the display operation acquired from the display operation reception unit 204 and the display operation information corresponding to the operation stored in the display operation DB 26. The display operation acquisition unit 17 outputs the acquired display operation information to the display processing unit 42a.

[0155] The display operation DB26 stores display operation information corresponding to the actions. Specifically, the display operation DB26 stores pre-configured display operation information corresponding to the subject U's gaze, blink count, eye signals, voice, or gestures. Figure 18 shows an example of display operation information stored in the display operation DB 26. As shown in Figure 18, the display operation DB 26 stores display operation information that instructs the user to change the display density of an AR image, delete an AR image, display an AR image as a layer, or move an AR image. Each operation will be described later.

[0156] The display processing unit 42a controls the display of the AR image based on the display operation information. The control of AR image display performed by the display processing unit 42a will be explained using Figures 18 and 19. Figure 19 is an example of an object information image I1 whose display is controlled based on display operation information. In Figure 19, the operation of displaying the object information image I1 is shown as an example of an AR image.

[0157] As shown in Figure 18, the display operation DB26 stores display operation information that instructs the system to perform the display operations "change the display density of the AR image" and "delete the AR image" in response to the action "gaze". For example, the display operation DB26 stores display operation information that instructs the system to delete one by one the multiple layers that make up the object information image I1 in response to the subject U gazing at the object of the display operation for a certain period of time. Here, the layers that make up the object information image I1 are AR images with a low display density (hereinafter referred to as density adjustment layers) that are generated so that the normal display density is achieved by superimposing multiple layers. As shown in Figure 19(a), when subject U gazes at the object information image I1, which is composed of three density adjustment layers, for 10 seconds, the display processing unit 42a deletes one of the three density adjustment layers, thereby reducing the display density of the object information image I1. When subject U gazes at the object information image I1 for 30 seconds, the display processing unit 42a deletes all three density adjustment layers, thereby deleting the object information image I1. Note that the layer deleted in response to the action "gaze" may also be an AR image (information layer) generated for each piece of object information. If the display of the object information image I1 interferes with the work of the subject U, the above display operation can improve the work efficiency of the subject U. In Figure 19(a), the change in display density is shown with fills and diagonal lines, indicating that the display processing unit 42a is gradually decreasing the display density of the filled triangular symbol. Also, in Figure 19(a), the display density of the text does not change, but it is desirable to gradually decrease the display density in the same way as the triangular symbol.

[0158] Furthermore, when deleting the object information image I1, it is desirable for the display processing unit 42a to display an AR image that visualizes the area where the object information image I1 was displayed, that is, the area of ​​the invisible object T. For example, the display processing unit 42a displays a dotted line frame surrounding the area of ​​the invisible object T on the display device 240 as an AR image that visualizes the area of ​​the invisible object T. By visualizing the area of ​​the invisible object T, it is possible to improve the workability of the subject U while ensuring the safety of the subject U. Furthermore, the display processing unit 42a may display an AR image that visualizes the range of the invisible object T on the display device 240 only when it causes the object information image I1 of the invisible object T that has been determined by the determination unit 50 to be dangerous to be deleted.

[0159] Display operation DB26 stores display operation information that instructs the system to perform the display operation "Display AR image layers" in response to the action "Number of blinks". For example, display operation DB26 stores display operation information that instructs the system to display multiple information layers that make up the object information image I1 individually in response to the number of blinks of the subject U. For example, as shown in Figure 19(b), when the subject U repeats the action of closing and opening their eyelids for 2 seconds twice, the display processing unit 42a displays the multiple information layers that make up the object information image I1 individually.

[0160] The display operation DB26 stores display operation information that instructs the system to perform the display operation "Move AR image" in response to a "gesture" action. For example, the display operation DB26 stores display operation information that instructs the system to move the object information image I1 in response to the hand movements of the subject U. For example, as shown in Figure 19(c), when a subject U places their hand over the object information image I1 and then moves their hand, the display processing unit 42a moves the object information image I1 in accordance with the movement of the subject U's hand.

[0161] Furthermore, if multiple object information images I1 that are the target of the display operation exist within the field of view of the display device 240, the display operation is performed after selecting the target object information image I1 to be displayed. In addition, to make the target of the display operation easier to understand, the display processing unit 42a may display the selected object information image I1 in an emphasized manner.

[0162] Furthermore, in order to improve the operability of display operations by the user U, the display processing unit 42a may display the position indicated by the user's gaze or gesture as an AR image. For example, the position may be displayed with a laser pointer, or a grid may be displayed and the color of the grid at that position may be changed. The display device 240 may also further include a notification unit that notifies the user of the reception of a display operation by vibration or sound when a display operation is received.

[0163] While several examples of display operations corresponding to the actions of subject U have been described above, the correspondence between actions and display operations is not limited to those shown in Figures 18 and 19. Alternatively, a marker corresponding to each display operation may be displayed as an AR image, and the display operation may be performed by focusing on or superimposing a hand over the marker. The AR images that can be displayed are not limited to the object information image I1, but also include the warning image I2, the occluding object information image I3, and layers.

[0164] <Display control method of Embodiment 4> Next, the procedure of the display control method executed by the display control device 440 according to Embodiment 4 will be explained with reference to Figure 20. Figure 20 is a flowchart of the display control method according to Embodiment 4. Note that steps S1 to S17 shown in Figure 16 are omitted in Figure 20.

[0165] In the display control method executed by the display control device 440 according to Embodiment 4, first, steps S1 to S17 are performed in the same manner as in Embodiment 3. After step S17, the display control device 440 acquires display operation information for the object information image I1 (step S18). Specifically, the display operation reception unit 204 acquires display operation information corresponding to the actions of the target person U based on the actions indicating the display operation received from the target person U and the display operation information corresponding to the actions stored in the display operation DB 26. The display operation reception unit 204 outputs the acquired display operation information to the display processing unit 42a.

[0166] Next, the display control device 430 controls the display of the object information image I1 based on the display operation information (step S19). Specifically, the display processing unit 42a changes the display density of the AR image, deletes the AR image, displays the AR image as a layer, or moves the AR image based on the display operation information.

[0167] <Effects of Embodiment 4> The operation and effects of the display control device 440, display control method, and display control program 540 according to Embodiment 4 of this disclosure will be described.

[0168] The display control device 440 according to this fourth embodiment further includes a display operation acquisition unit 17 that acquires display operation information for the object information image I1, in addition to the display control devices 410-430 according to these first three embodiments. The display control unit 40 of the display control device 440 according to this fourth embodiment controls the display of the object information image I1 based on the display operation information. The display operation acquisition unit 17 acquires display operation information corresponding to the gaze, blinking count, eye signals, voice, gestures, or movements of the subject U. Based on the display operation information, the display control unit 40 controls the display device 240 to change the display density of the object information image I1, delete the object information image I1, display the object information image I1 in layers, or move the object information image I1. According to the display control device 440, display control method, and display control program 540 of Embodiment 4 of this disclosure, the subject U can intuitively control the display of the object information image I1 according to the status of the work, etc.

[0169] Although the present disclosure has been described above based on each embodiment, the present disclosure is not limited to each embodiment. Furthermore, combining, modifying, or omitting each embodiment as appropriate is also within the scope of the technical idea of ​​the present disclosure. [Explanation of Symbols]

[0170] 10 Acquisition Department 11 Device position / orientation acquisition unit 12 Object position acquisition unit 13. Object Information Acquisition Unit 14 Distance acquisition part 15 Environmental Information Acquisition Department 16 Obstruction information acquisition unit 17 Display operation acquisition section 20 Memory section 21 Display device DB 22 Object Database 23 Threshold DB 24 Hazard Database 25 Shield DB 26 Display operation DB 30 Object Identification Section 40 Display Control Unit 41 Object Information Image Generation Unit 42, 42a Display processing unit 43 Warning Image Generation Unit 50 Judgment section 110, 120, 130, 140 display system 210, 220, 240 display device 201 Device position and attitude detection unit 202 Display section 203 Distance detection unit 204 Display Operation Reception Unit 300 storage device 310 Object Information Detection Device 320 Environmental Information Detection Device 330 Obstacle Information Detection Device 410, 420, 420a, 430, 440 Display control device Programs 510, 520, 520a, 530, and 540

Claims

1. A threshold information acquisition unit acquires threshold information that includes a first state threshold which is a threshold corresponding to a first state of an invisible object, a second state threshold which is a threshold corresponding to a second state of the object which is a state different from the first state, a first distance threshold which is a threshold for the distance corresponding to the first state threshold, a second distance threshold which is a threshold for the distance corresponding to the second state threshold, a first warning message which is a warning message corresponding to the first state threshold, and a second warning message which is a warning message corresponding to the second state threshold. An object information acquisition unit acquires a first state value which is a numerical value indicating the first state of the object and a second state value which is a numerical value indicating the second state of the object. A distance acquisition unit that acquires the distance between a person and the object that is present in the vicinity of the object as the person distance, An environmental information acquisition unit acquires environmental information which is information about at least one of the surrounding objects of the object, which is an object separating the object from the object and the object, and an object that alters the airflow around the object. A threshold setting unit sets the first distance threshold and the second distance threshold based on the arrangement and number of the surrounding objects, A determination unit that compares the first state value with the first state threshold, compares the second state value with the second state threshold, compares the subject distance with the first distance threshold and the second distance threshold, selects the first warning message if the first state value is greater than or equal to the first state threshold and the subject distance is less than or equal to the first distance threshold, and selects the second warning message if the second state value is greater than or equal to the second state threshold and the subject distance is less than or equal to the second distance threshold, A display control unit controls a display device using augmented reality technology so that the warning message selected by the determination unit is displayed to the subject in a way that is visible to the subject, A display control device equipped with the following features.

2. The aforementioned object is an object that is shielded, at least partially shielded by the shielding object. The display control device according to claim 1.

3. The aforementioned object is a transparent material. The display control device according to claim 1 or claim 2.

4. The display control unit generates an object information image in which the warning message selected by the determination unit is highlighted and displayed. The display control device according to claim 1.

5. The display control device according to claim 1, wherein the display control unit generates an object information image representing the object and displays a warning message selected by the determination unit near the object information image.

6. The display control device according to claim 1, wherein the display control unit generates an object information image representing the object, and displays a warning message selected by the determination unit superimposed on the object information image.

7. The system further includes an operation acquisition unit that acquires display operation information for an object information image representing the object received from the aforementioned person, The display control unit controls the display of the object information image based on the display operation information. The display control device according to claim 1.

8. The display control device according to claim 7, wherein the operation acquisition unit acquires the display operation information corresponding to the subject's gaze, blinking frequency, eye signals, voice, or gestures.

9. The display control unit controls the display device to change the display density of the object information image, delete the object information image, display the object information image in layers, or move the object information image. The display control device according to claim 7 or claim 8.

10. An object position acquisition unit acquires object position information, which is the three-dimensional position information of the object; and an object identification unit identifies the object included in the field of view of the display device based on the object position information. Furthermore, The display control unit generates and displays an object information image representing the object identified by the object identification unit. The display control device according to claim 1.

11. The object identification unit identifies each of the multiple objects included in the field of view of the display device, The display control device generates and displays multiple object information images representing multiple objects included in the field of view of the display device. The display control device according to claim 10.

12. A threshold information acquisition step that acquires threshold information including a first state threshold which is a threshold corresponding to a first state of an invisible object, a second state threshold which is a threshold corresponding to a second state of the object which is a state different from the first state, a first distance threshold which is a threshold for the distance corresponding to the first state threshold, a second distance threshold which is a threshold for the distance corresponding to the second state threshold, a first warning message which is a warning message corresponding to the first state threshold, and a second warning message which is a warning message corresponding to the second state threshold, Object information acquisition step: Acquire a first state value which is a numerical value indicating the first state of the object and a second state value which is a numerical value indicating the second state of the object. A distance acquisition step in which the distance between a person present in the vicinity of the object and the object is obtained as the person distance, An environmental information acquisition step involves acquiring environmental information which is information about at least one of the surrounding objects of the object, which is an object separating the object from the object and the object, and an object that alters the airflow around the object. A threshold setting step in which the first distance threshold and the second distance threshold are set based on the arrangement and number of the surrounding objects, A determination step of comparing the first state value with the first state threshold, comparing the second state value with the second state threshold, comparing the subject distance with the first distance threshold and the second distance threshold, selecting the first warning message if the first state value is greater than or equal to the first state threshold and the subject distance is less than or equal to the first distance threshold, and selecting the second warning message if the second state value is greater than or equal to the second state threshold and the subject distance is less than or equal to the second distance threshold, A display control step that controls a display device using augmented reality technology so that the warning message selected by the determination step is displayed to the subject in a way that is visible to the subject, A display control method including the following.

13. On the computer, A threshold information acquisition function that acquires threshold information including a first state threshold which is a threshold corresponding to a first state of an invisible object, a second state threshold which is a threshold corresponding to a second state of the object which is a state different from the first state, a first distance threshold which is a threshold for the distance corresponding to the first state threshold, a second distance threshold which is a threshold for the distance corresponding to the second state threshold, a first warning message which is a warning message corresponding to the first state threshold, and a second warning message which is a warning message corresponding to the second state threshold, An object information acquisition function that acquires a first state value which is a numerical value indicating the first state of the object and a second state value which is a numerical value indicating the second state of the object, A distance acquisition function that acquires the distance between a person present in the vicinity of the object and the object as the person distance, An environmental information acquisition function that acquires environmental information which is information about at least one of the surrounding objects of the object, which is an object separating the object from the object and the object, and an object that alters the airflow around the object. A threshold setting function that sets the first distance threshold and the second distance threshold based on the arrangement and number of the surrounding objects, A determination function that compares the first state value with the first state threshold, compares the second state value with the second state threshold, compares the subject distance with the first distance threshold and the second distance threshold, selects the first warning message if the first state value is greater than or equal to the first state threshold and the subject distance is less than or equal to the first distance threshold, and selects the second warning message if the second state value is greater than or equal to the second state threshold and the subject distance is less than or equal to the second distance threshold, A display control function that controls a display device using augmented reality technology so that the warning message selected by the judgment function is displayed to the subject in a way that is visible to the subject, A display control program to achieve this.

Images