Display control device, display control system, display control program

Abstract

To provide a display control device which is configured to control an image displayed on a transmissive display device, and which is capable of adjusting an image on the display control device so as to enable appropriate adjustment of power consumption according to remaining battery charge.SOLUTION: A display control device of the present invention is configured to detect the usage state of a transmissive display device and switch the power consumption mode of a display unit according to the usage state and remaining battery charge of the display control device. In a low power consumption mode, a low-brightness image or a black screen is displayed, while a high-brightness image is sent to the transmissive display device.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a technique for controlling an image displayed by a transmissive display device. [Background technology]

[0002] In recent years, see-through head mounted displays (HMDs) have been commercialized and are being used for work support in factories and other places. A user wearing a see-through HMD can view the work target while projecting and displaying information related to work support on the screen of the see-through HMD, allowing the user to check and operate the work procedure. For example, a smartphone (display control device) carried by a worker is connected to the see-through HMD, and a work procedure manual, etc. is provided from the display control device to the see-through HMD. This allows the worker to efficiently carry out work on the work target by viewing the work procedure manual on the see-through HMD and visually recognizing the work target through the see-through display.

[0003] The following Patent Document 1 describes a technology relating to an HMD and a processing device connected thereto. The document aims to "improve the usability of the cooperative operation between a processing device such as a portable information terminal and a display device such as an HMD," and describes a technology in which "the processing device, which is a portable information terminal, includes a display unit that displays an image, a connection detection unit that detects that an external display device is connected, an image output unit that outputs the image displayed on the display unit to the display device in response to the display device being connected, and a user interface output unit that switches the image displayed on the display unit to a user interface display for instructing the execution of processing related to the image output to the display device at a predetermined brightness value in response to the display device being connected" (see abstract). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-114050 A Summary of the Invention [Problem to be solved by the invention]

[0005] The display control device that transmits images to the see-through HMD is equipped with a display device such as a display, and provides images to the see-through HMD by transferring images displayed by the display device to the see-through HMD. Work support information such as work instructions is also provided as these images. Therefore, while the display control device is supplying images to the see-through HMD, the display of the display control device must be kept ON at all times. This poses the problem of the display control device's battery being consumed quickly.

[0006] In Patent Document 1, when the processing device detects that the processing device and the HMD are connected, the luminance value of the image displayed by the processing device is adjusted. This is thought to reduce the battery consumption of the processing device to some extent. However, this method adjusts the image luminance uniformly even when the processing device's battery has sufficient remaining power. This may reduce the display luminance and impair the visibility of the processing device's display even if the effect on the battery life is small.

[0007] The present invention has been made in consideration of the above-mentioned problems, and aims to adjust the image on the display control device, which controls the image displayed by a transmissive display device, so that power consumption can be appropriately adjusted in accordance with the remaining battery charge of the display control device. [Means for solving the problem]

[0008] The display control device according to the present invention detects the usage state of the transmissive display device and switches the power consumption mode of the display unit according to the usage state and the remaining battery power of the display control device. In the low power consumption mode, a low-luminance image or a black screen (mainly in the case of a self-luminous panel such as an organic EL (Electro-Luminescence) panel) is displayed, and a high-luminance image is transmitted to the transmissive display device. Effect of the Invention

[0009] According to the display control device of the present invention, in a display control device that controls an image displayed by a transmissive display device, the image on the display control device can be adjusted so that power consumption can be appropriately adjusted in accordance with the remaining battery charge of the display control device. [Brief description of the drawings]

[0010] [Figure 1A] 1 is an external view of a transmissive display device 100 and a display control device 200 according to a first embodiment. [Figure 1B] An example using an external battery 300 is shown. [Diagram 2] FIG. 1 is a functional block diagram of a transmissive display device 100. [Diagram 3] FIG. 2 is a functional block diagram of a display control device 200. [Figure 4A] 2 shows an example of the configuration and data of the output mode table 260. [Figure 4B] 5A to 5C are schematic diagrams illustrating differences in output modes. [Diagram 5] 10 is a flowchart illustrating the operation of each device when a worker wears the transmissive display device 100 and starts work on a work object. [Figure 6] 13 is a flowchart illustrating details of S506. [Figure 7] 13 is a flowchart illustrating the details of S511 to S512. [Figure 8] 2 is a functional block diagram illustrating a mechanism by which a display control unit 204 switches the luminance value of a display unit 21. FIG. [Figure 9] 13 is a flowchart illustrating the details of S511 to S512 in the second embodiment. [Figure 10] 10 is a flowchart illustrating a procedure for the transmissive display device 100 to determine whether or not the transmissive display device 100 is receiving power from another device. [Figure 11] 13 is a diagram showing a connection form via a communication relay board 150. FIG. [Figure 12] 1 is a diagram illustrating an example of the positional relationship between a worker 1500 and a task target 1200. FIG. [Figure 13] 13 is an example of work procedure data 1300. [Figure 14] An example of work procedure display is shown below. [Figure 15] 13 is a flowchart illustrating a procedure for creating work procedure data 1300. [Figure 16] 1 is a diagram showing a usage mode of a display control device 200 and a transmissive display device 100. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] <Embodiment 1> 1A is an external view of a transmissive display device 100 and a display control device 200 according to a first embodiment of the present invention. The transmissive display device 100 is configured as an HMD. In task support using an HMD, a worker often wears a helmet 330, so an example in which the HMD is connected to the helmet 330 will be described.

[0012] The transmissive display device 100 comprises a display unit 11 and a camera 12. The display unit 11 is placed in front of the eyes of the worker, so that the image is visible in the line of sight of the worker. The camera 12 has a structure that can be recognized from the outside, and is installed so as to capture an image in the same direction as the line of sight of the eyes. The camera 12 is equipped with a flashlight that illuminates the surroundings when capturing an image. The same is true for the camera 217 described below.

[0013] The transmissive display device 100 is fixed to the helmet 330 by extending an arm 320 from a fixing jig 310 fixed to the helmet 330 and connecting the transmissive display device 100 to the arm 320. The arm 320 can be freely bent and stretched so that the display unit 11 is placed at an optimal position for the eyes. The transmissive display device 100 may be fixed at two points as shown in FIG. 1. If fixed at only one point, the transmissive display device 100 is likely to rotate around that point as a fulcrum, so that the positions of the eyes and the display unit 11 are likely to shift. If the positions shift, the image will be chipped or blurred, leading to a decrease in visibility. If fixed at two points, the image will be less likely to rotate, so the decrease in visibility can be suppressed. It is effective to fix the transmissive display device 100 at the opposite end of the display unit 11 and at the point where the transmissive display device 100 is bent in an L shape. By fixing at these positions, a structure is obtained that does not block the camera 12 and does not affect the field of view of the eyes.

[0014] The transparent display device 100 is connected to a display control device 200 via a cable 30. The display control device 200 is a device that controls an image displayed by the transparent display device 100. The display control device 200 is a device that can be carried by a worker, and can be configured by, for example, a smartphone. The display control device 200 includes a display unit 21 that displays an image. The worker visually recognizes a work target through the transparent display of the transparent display device 100, and performs work on the work target while viewing the image displayed by the transparent display device 100 (or the image displayed by the display unit 21).

[0015] 1B shows an example in which an external battery 300 is used. The transmissive display device 100 is connected to a communication relay board 150 via a cable 30. The communication relay board 150 is further connected to a display control device 200 via (a) a cable 31, and is connected to a battery 300 via (b) a cable 32. The battery 300 can supply power to each of the transmissive display device 100 and the display control device 200.

[0016] FIG. 2 is a functional block diagram of the transmissive display device 100. The power supply unit 101 supplies power received from a power supply to each unit of the transmissive display device 100. The communication unit 102 communicates with other devices. The operation unit 103 receives an operation input from the user. The wearing state detection unit 140 detects whether the user wears the transmissive display device 100. An example of the detection procedure will be described later. The display unit 11 is configured to be divided into left and right (display units 11A and 11B), or has a display portion corresponding to either the left or right eye. In the following, it is assumed that the display unit 11 is divided into left and right, but the present invention is applicable in either case. The display control unit 104 generates an image to be displayed by the display unit 11. The control unit 120 controls each unit of the transmissive display device 100. The storage unit 130 stores data used by the control unit 120. The remote control 109, the speaker 108, and the microphone 107 are devices that allow the user to give operation input or voice input to the transmissive display device 100. The external IF 105 is a communication interface between these devices (including the camera 12) and the control unit 120. The sensor group 110 includes an acceleration sensor 111, an angular velocity sensor 112, an illuminance sensor 113, and the like.

[0017] 3 is a functional block diagram of the display control device 200. The power supply unit 201 supplies power received from a power supply to each unit of the display control device 200. The communication unit 202 communicates with other devices. The operation unit 203 receives operation input from a user. The microphone 205 and the speaker 206 are devices for the user to give voice input to the display control device 200. The display control unit 204 generates an image to be displayed by the display unit 21. The control unit 220 controls each unit of the display control device 200. The storage unit 230 stores data used by the control unit 220. The sensor group 210 includes an acceleration sensor 211, an angular velocity sensor 212, an illuminance sensor 213, a LiDAR (Light Detection and Ranging) 214, a magnetic sensor 215, a GPS (Global Positioning System) 216, a camera 217, a proximity sensor 218, and the like.

[0018] 4A shows a configuration and an example of data of the output mode table 260. The output mode table 260 is a data table that defines the image size and the like when an image is provided from the display control device 200 to the transmissive display device 100, and is stored in the storage unit 230. Each record defines a separate output mode.

[0019] Number 261 indicates the serial number of the record. Output mode 262 indicates the name of the output mode. Used IF 263 indicates the type of communication interface used when transmitting an image from the display control device 200 to the transmissive display device 100. Brightness 264 indicates which brightness is to be prioritized, the display control device 200 (display unit 21) or the transmissive display device 100 (display unit 11). Virtual size 265 indicates the size of a virtual screen generated by the display control unit 204. The virtual screen will be described later. Display size 266 indicates the size of an image displayed by the transmissive display device 100 (display unit 11).

[0020] FIG. 4B is a schematic diagram for explaining the difference between output modes. In output mode #1, the image size displayed by the display control device 200 (display unit 21) and the image size displayed by the transmissive display device (display unit 11) are the same (640 pixels x 480 pixels). In output mode #2, the display control device 200 displays an image of 640 pixels x 480 pixels, but converts the same image to a virtual size (1920 pixels x 1080 pixels) and transmits it to the transmissive display device 100. The transmissive display device 100 displays the image on a screen of the display size (640 pixels x 480 pixels). Since the display unit 11 displays only a part of the image of the received virtual size, the worker can view the entire image by scrolling the window by moving his / her head, etc. For example, when it is desired to enlarge and display a working drawing on the transmissive display device 100, it is useful to use such a virtual size.

[0021] 5 is a flow chart for explaining the operation of each device when a worker wears the transmissive display device 100 and starts work on a work object. Each step in FIG. 5 will be explained below.

[0022] (FIG. 5: Step S501) The display control device 200 (communication unit 202) and the transmissive display device 100 (communication unit 102) establish a connection with each other by wired connection or wireless connection. This step may be performed automatically when an operator starts the display control device 200, or when each device is connected via a communication line in the case of a wired connection. It may also be performed at any other appropriate timing.

[0023] (FIG. 5: Steps S502 to S504) The display control unit 204 starts image output in a default output mode (e.g., output mode #1) (S502). The communication unit 202 transmits the image (first image) to the transmissive display device 100 (S503). The display control unit 104 uses the output mode (e.g., output mode #1) to display the image on the display unit 11 (S504). Here, output mode #1 is set as the default mode, but the default mode may be any mode.

[0024] (FIG. 5: Step S505) In step S630 described later, the worker utters, for example, a predetermined voice command using the microphone 205 of the display control device 200 or the microphone 107 of the transmissive display device 100. The control unit 220 starts a process for recognizing the voice input. Specifically, for example, a voice recognition program is started. The voice command is, for example, a command to instruct the start of work.

[0025] (FIG. 5: Step S506) The control unit 220 detects whether or not the worker has started working on the work object after wearing the transmissive display device 100. This step is repeated until the start of work is detected. A specific example of the detection method will be described later.

[0026] (Figure 5: Steps S507 to S510) The control unit 220 instructs the display control unit 204 to set an output mode (e.g., output mode #2) to be performed during the work (S507). The display control unit 204 instructs the transmissive display device 100 to start that output mode (S508). The display control unit 204 transmits an image to the transmissive display device 100 using that output mode (S509). The display control unit 104 displays an image on the display unit 11 using that output mode (S510).

[0027] (FIG. 5: Steps S511 to S513) The control unit 220 determines the brightness value of the display unit 21 and sets the brightness value for the display unit 21 (S511). The control unit 220 determines a screen to be displayed on the display unit 21 (S512) and switches to that screen (S513). The screen here refers to a screen display adjusted to reduce the power consumption of the display unit 21. Details of S511 to S512 will be described later.

[0028] 6 is a flowchart for explaining the details of S506. This flowchart is generally divided into four processing blocks 610 to 640. Each processing block detects whether or not the worker has put on the transmissive display device 100 and started working on the work object. The detection method differs for each processing block.

[0029] (FIG. 6: Steps S611 to S613) The control unit 120 (wearing state detection unit 140) detects that the state in which the worker wears the transmissive display device 100 has changed (S611). For example, it is possible to detect that the transmissive display device 100 has been set in a predetermined position by the acceleration sensor 111 or the angular velocity sensor 112. The control unit 120 notifies the display control device 200 of the change in the wearing state and the wearing state (S612). The control unit 220 confirms that the display unit 11 has been set in a predetermined position on the worker (S613). Wearing the display unit 11 in the predetermined position by the worker suggests that the worker has started working on the work object. Therefore, this processing block can detect the start of work.

[0030] (Figure 6: Steps S611 to S613: Supplement) The mechanism for detecting that the display unit 11 has been set in a predetermined position is not limited to this. For example, the display unit 11 may be configured so that the transparent window portion (a member located in front of the operator's eyes) of the display unit 11 can be rotated and removed from in front of the operator's eyes, and the setting of the display unit 11 may be detected by detecting the rotational movement. Any other appropriate method may be used.

[0031] (FIG. 6: Steps S621 to S622) The control unit 220 detects that a work assistance application has been started on the display control device 200 (S621). The control unit 220 detects that a work execution screen has been displayed on the application (S622). These applications and screen displays suggest that the worker has started work on the work object. Therefore, this processing block can detect the start of work.

[0032] (FIG. 6: Step S631) The worker utters, for example, a predetermined voice command using the microphone 205 on the work terminal. The control unit 220 recognizes that a specific word is included in the voice command uttered by the worker using the microphone 205. This word is, for example, a command to start work. This allows the control unit 220 to detect that the worker has started work on the work object.

[0033] (Figure 6: Step S641) The control unit 220 detects that the worker has not touched the screen of the display unit 21 for a predetermined period of time or more. In this case, the worker is not operating the display control device 200, and it can be assumed that the worker is in the middle of performing work on the work object. Therefore, this processing block can detect the start of work.

[0034] (Figure 6: Steps S611 to S641: Supplement) 6, each step (S613, S621, S622, S631, S641) for detecting the start of work is not advanced to the next step until the corresponding step is completed. Alternatively, these detection steps may be performed in parallel. For example, the process of detecting the start of work in S613 may be performed in parallel with the process of detecting the start of work in S621 to S622. In other words, if the start of work can be detected in any of the detection steps, it may be determined that the work has started.

[0035] 7 is a flowchart for explaining the details of S511 to S512. S701 to S705, S706, S707, and S709 correspond to S511. S710 corresponds to S512.

[0036] (FIG. 7: Steps S701 to S703) The control unit 220 acquires the brightness value of the screen display of the display unit 21 (S701). The control unit 220 acquires the remaining battery power from the power supply unit 201 (S702). If the remaining battery power is equal to or less than a predetermined condition, the process proceeds to S704 (S703: YES), otherwise the process ends (S703: NO). This is because if the remaining battery power is sufficient, there is no need to adjust the brightness value in the following steps.

[0037] (FIG. 7: Step S704) The control unit 220 determines the power consumption level of the display unit 21 according to the remaining battery power. Of the three power consumption levels, level 3 consumes the least amount of power, and level 1 consumes the most amount of power. The lower the remaining battery power, the higher the level is set. If level 1 is selected, proceed to S706; if level 2 is selected, proceed to S707; if level 3 is selected, proceed to S709.

[0038] (Figure 7: Step S705: Level 1, S706) The control unit 220 sets the brightness value of the display unit 21 to a minimum value. The minimum value here does not necessarily have to be the minimum brightness that the display unit 21 can use. It is sufficient that the brightness value is at least lower than when levels 1 to 3 are not used.

[0039] (Figure 7: Step S705: Level 2, S707) The control unit 220 instructs the display control unit 204 to suppress the power consumption of the display unit 21. The display control unit 204 performs this by, for example, one of the following: (a) If the display unit 21 is configured with a self-emitting panel such as an organic EL, the power consumption of the elements can be suppressed by setting all pixel values ​​in the screen to black (making the screen black). The display luminance itself does not necessarily need to be reduced. This is because the power consumption of an organic EL is very small when the pixel value is black. (b) If the display unit 21 is configured with a liquid crystal device, the display luminance value of the liquid crystal is reduced to the minimum value as in S706. With this step, whether the display unit 21 is configured with a self-emitting panel or liquid crystal, the power consumption can be suppressed to the same level as level 1 or less.

[0040] (Figure 7: Step S705: Level 3, S709) The control unit 220 turns off the operation of the display unit 21. For example, it turns off the power supply to the display unit 21. As a result, the power consumption at level 3 is equal to or less than that of levels 1 and 2.

[0041] (FIG. 7: Step S710) The control unit 220 (display control unit 204) instructs the transmissive display device 100 on the luminance value of the display unit 11. The display control unit 104 sets the luminance value of the display unit 11 according to the instruction. Since this flowchart is for decreasing the luminance of the display unit 21, the luminance of the display unit 11 (third image) may be higher than the luminance of the display unit 21 (second image).

[0042] 8 is a functional block diagram illustrating a mechanism by which the display control unit 204 switches the luminance value of the display unit 21. The display screen generation unit 221 included in the control unit 220 instructs the display control unit 204 to select either the black screen 231 or the work screen 232 stored in the storage unit 230. In accordance with the instruction, the display control unit 204 selects either the pointer 240A of the black screen 231 or the pointer 240B of the work screen 232.

[0043] When the black screen 231 is selected, the display control unit 204 decodes (241) the image information and instructs the display element (e.g., a self-emitting panel) of the display unit 21 to display the black screen 231. When the display unit 21 is a liquid crystal element, the control unit 220 reduces the brightness value by, for example, turning off the backlight of the liquid crystal. When the work screen 232 is selected, the communication unit 202 encodes (242) the work screen 232, converts it into communication packets (243), and transmits them to the transmissive display device 100.

[0044] <Embodiment 2> In the first embodiment, an example has been described in which the luminance value of the display unit 21 is adjusted according to the remaining battery charge of the display control device 200. In the second embodiment of the present invention, instead, a procedure will be described in which the luminance value of the display unit 21 is adjusted according to whether or not the display control device 200 is supplying power to the transmissive display device 100. The configuration other than this procedure is the same as that of the first embodiment.

[0045] Fig. 9 is a flowchart for explaining the details of S511 to S512 in the present embodiment 2. In Fig. 9, S901 to S904 are carried out instead of S701 to S703. The other configurations are the same as those in the first embodiment.

[0046] (Figure 9: Steps S901 to S904) The control unit 220 acquires information on whether or not power is being supplied from the power supply unit 201 to another device and on the device to which power is being supplied (S901). If power is not being supplied to the other device, the flow chart ends (S902: NO). If power is being supplied, the process proceeds to S903 (S902: YES). If the power supply destination is not the transmissive display device 100 (S903: NO), the control unit 220 stops the power supply to the other device (S904). If power is being supplied to the transmissive display device 100 (S903: YES), the process proceeds to S704 and thereafter.

[0047] (Figure 9: Steps S902 to S903: Supplement) The control unit 220 can use, for example, a USB signal described later, to identify whether or not power is being supplied to another device and the device to which power is being supplied. Alternatively, if the power consumption of the display control device 200 is equal to or greater than a threshold, it may be determined that power is being supplied to the other device (or the transmissive display device 100 itself).

[0048] Fig. 10 is a flowchart for explaining a procedure in which the transmissive display device 100 judges whether or not the transmissive display device 100 is supplied with power from another device. Instead of the display control device 200 judging the power supply destination according to the flowchart in Fig. 9, the transmissive display device 100 may judge the power supply source according to this flowchart. For example, the display control device 200 can instruct in advance whether to judge the power supply source according to Fig. 9 or Fig. 10.

[0049] (Figure 10: Step S1001) The control unit 120 acquires information on whether or not power is being supplied from another device via the power supply unit 101. For example, the presence or absence of power supply from another device can be determined by using a CC1 pin signal or a CC2 pin signal of USB Type 3. It should be noted that the control unit 220 can also determine whether or not power is being supplied to the transmissive display device 100 by using these signals in a similar manner.

[0050] (Figure 10: Step S1002) If the power supply source is the display control device 200, the process proceeds to S1003, otherwise, the process ends. For example, if the ID of the connected device is described in the packet of the USB signal, the supply source device can be identified using this. Any other appropriate method may be used.

[0051] (Figure 10: Step S1003) The control unit 120 acquires the remaining battery charge of the display control device 200 from the display control device 200. If the acquired remaining battery charge is equal to or less than a predetermined condition, the process proceeds to S1004, otherwise the process ends. In this step, the control unit 220 may notify the transmissive display device 100 of the remaining battery charge and may instruct the display unit 11 to lower the luminance.

[0052] (Figure 10: Step S1004) The control unit 120 sets the luminance value of the display unit 11 to a value lower than the current setting value. This makes it possible to reduce power consumption of the transmissive display device 100. At the time of this step, the transmissive display device 100 is supplied with power from the display control device 200, so this step reduces power consumption of the display control device 200. Whether or not this step needs to be performed may be determined by the control unit 120 according to the remaining battery level acquired in S1003, or this step may be performed by an instruction to perform this step from the display control device 200 in S1003.

[0053] FIG. 11 is a diagram showing a connection form via a communication relay board 150. The upper part of FIG. 11 shows a power path when power is supplied from the display control device 200 to the transmissive display device 100. The power supply unit 201 can switch the connection destination to the communication relay board 150 via a switch 250. When outputting power, the power supply unit 201 connects to the power input port 152 via a port 250B to supply power to the transmissive display device 100. The lower part of FIG. 11 shows a power path when power is supplied from a battery 300 to the transmissive display device 100 and the display control device 200. The power supply unit 201 receives power from the battery 300 by connecting to the power output port 151 via a port 250A. In either case, the transmissive display device 100 receives power from the power output port 151.

[0054] <Embodiment 3> 12 is a diagram illustrating an example of the positional relationship between a worker 1500 and a work object 1200. The work object 1200 is, for example, a power distribution control panel. In this example, the work object 1200 includes instruments 1201, a display panel 1202, a breaker 1210, and a relay 1211. The worker 1500 performs work on each of these components of the work object 1200 according to the procedure specified in the work procedure manual. The configurations of the transmissive display device 100 and the display control device 200 are similar to those of the first and second embodiments.

[0055] 13 is an example of work procedure data 1300. The work procedure data 1300 is data describing a work procedure, and can be stored, for example, in the storage unit 230. Each record of the work procedure data 1300 corresponds to one work item. The work procedure data 1300 has a work number 1301, a work target 1302, work content 1303, related drawings 1304, a camera used 1305, a work status 1306, a completion date and time 1307, and evidence 1308. The worker performs the work while looking at the related drawings 1304 on the display unit 11.

[0056] FIG. 14 shows an example of a display of a work procedure. Here, an example is shown of a work in which a worker takes an image of a work target 1200. When both the transmissive display device 100 and the display control device 200 are equipped with imaging devices, the work procedure data 1300 can instruct which imaging device should be used by the camera in use 1305. In accordance with the instruction, the control unit 220 starts one of the imaging devices and instructs the transmissive display device 100 to display the image of that imaging device on the display unit 11. The procedure for defining the camera in use 1305 will be described later. For convenience, the camera 217 may be referred to as a "built-in camera."

[0057] The camera to be used 1305 also specifies whether to use the light of the transmissive display device 100 or the light of the display control device 200 as a flashlight (light irradiation device) to be used when capturing an image. When the camera of the transmissive display device 100 is used, it is desirable to brighten the periphery of the transmissive display device 100, so the light of the transmissive display device 100 is used. Similarly, when the camera of the display control device 200 is used, the light of the display control device 200 is used. The same applies to the amount of light of the flashlight. That is, when the camera of the transmissive display device 100 is used, the amount of light of the flash is set according to the illuminance around the transmissive display device 100 detected by the illuminance sensor 113. When the camera of the display control device 200 is used, the amount of light of the flash is set according to the illuminance around the display control device 200 detected by the illuminance sensor 213.

[0058] On the other hand, when displaying the work procedure and the captured image, it is desirable to set the luminance of the display unit according to the illuminance around the display device. When the display control device 200 is operated in the low power consumption mode (level 1 to level 3 in FIG. 7 or FIG. 9), it is desirable to view the screen on the transmissive display device 100, so the luminance of the display unit 11 is set according to the illuminance around the transmissive display device 100 detected by the illuminance sensor 113. If the display control device 200 is not in the low power consumption mode, the luminance of the display unit 21 is set according to the illuminance around the display control device 200 detected by the illuminance sensor 213.

[0059] Depending on the work content, for example, a work form may be considered in which the display control device 200 is inserted into the work target 1200, an internal image is captured using the camera of the display control device 200, and the internal image is viewed on the transmissive display device 100. In such a case, the illuminance sensor 213 is used for the flashlight, and the illuminance sensor 113 is used for the display brightness. The use of the camera / flashlight / illuminance sensor according to such work content may also be defined together with the camera 1305 to be used.

[0060] 15 is a flowchart explaining the procedure for creating work procedure data 1300. This flowchart is executed in advance by an administrator (hereinafter simply referred to as a user) or the like before a worker starts work. Here, the procedure for defining the camera to be used 1305 is particularly explained. This flowchart can be implemented, for example, by the display control device 200 executing a work support application that provides work procedure drawings and the like.

[0061] (FIG. 15: Steps S1501 to S1503) The user determines a work object for which work procedure data 1300 is to be created (S1501). The user obtains information about the external appearance and internal three-dimensional structure of the work object (S1502). The user selects a work object part of the work object (S1503).

[0062] (FIG. 15: Steps S1504 to S1508) If the work target area is not suitable for imaging by the transmissive display device 100, the camera to be used 1305 is defined so that the work target area is imaged by an imaging device included in the display control device 200 (S1508). Specifically, the following cases apply: (a) the height of the work target area is a predetermined value or less (e.g., 70 cm or less) (S1504); (b) the depth direction position of the work target area is a predetermined value or more (e.g., 5 cm or more) (S1505); (c) the character size of the work target area is a predetermined value or less (e.g., 6 pt or less) (S1506). If none of these cases apply, the camera to be used 1305 is defined so that the imaging device included in the transmissive display device 100 is used (S1507).

[0063] (Figure 15: Step S1509) S1504 to S1508 are repeated for all work target areas.

[0064] 16 is a diagram showing a usage state of the display control device 200 and the transmissive display device 100. A worker puts the display control device 200 configured as, for example, a smartphone in a pocket of his / her work clothes, wears the transmissive display device 100, and works. When the power consumption of the display control device 200 is suppressed during work, the display unit 21 becomes a black screen or has minimum brightness, and the display unit 11 displays an image according to the virtual display size. When not working, the image displayed by the display unit 21 and the image displayed by the display unit 11 are the same.

[0065] <Modifications of the present invention> The present invention is not limited to the above-described embodiment, and includes various modified examples. For example, the above-described embodiment has been described in detail to clearly explain the present invention, and is not necessarily limited to those having all of the configurations described. In addition, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. In addition, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.

[0066] In the above embodiments, the control unit 120, the control unit 220, the display control unit 104, and the display control unit 204 can be configured by hardware such as a circuit device that implements these functions, or can be configured by a calculation device such as a CPU (Central Processing Unit) executing software that implements these functions. [Explanation of symbols]

[0067] 100:Transparent display device 11: Display section 12: Camera 200: Display control device 21: Display section 300: Battery 310: Fixture 320: Arm 330: Helmet

Claims

1. A display control device that controls an image displayed by a transmissive display device, A display unit for displaying an image; a display control unit that generates an image to be displayed by the display unit; a communication unit that transmits the image generated by the display control unit to the transmissive display device; a control unit that controls the display unit, the display control unit, and the communication unit; Equipped with the display control unit is configured to switch between a first power consumption mode and a second power consumption mode having lower power consumption than the first power consumption mode by switching at least one of a display image displayed by the display unit and a transmission image transmitted to the transmissive display device, the control unit detects a usage state of the transmissive display device, and switches between the first power consumption mode and the second power consumption mode according to an effect of the usage state on a remaining battery charge of the display control device; the control unit, in the first power consumption mode, controls the display control unit to generate a first image as the display image, and controls the communication unit to transmit the first image as the transmission image; the control unit, in the second power consumption mode, controls the display control unit to generate, as the display image, a second image having a lower luminance than the first image or a black screen in accordance with the remaining battery charge, and controls the communication unit to transmit, as the transmission image, a third image having a higher luminance than the second image; When power is being supplied from the display control device to the transmissive display device, The display control unit instructs the transmissive display device to reduce power consumption by the transmissive display device by reducing luminance of an image displayed by the transmissive display device when the remaining battery charge is less than a threshold value. A display control device comprising:

2. the control unit detects, as the usage state, whether or not a worker has started a task using the transmissive display device; The control unit uses the second power consumption mode when it detects that the task has started, and uses the first power consumption mode when it does not detect that the task has started.

2. The display control device according to claim 1.

3. the transmissive display device is configured to notify the display control device, when detecting that the worker has worn the transmissive display device, that the worker has worn the transmissive display device; The control unit determines that the operation has started when the control unit receives the notification from the transmissive display device or when software that implements a process of transmitting an instruction to the transmissive display device is started on the display control device.

3. The display control device according to claim 2.

4. In the second power consumption mode, the control unit performs the following in accordance with the remaining battery charge: setting the brightness of the display to a minimum value; generating the black screen as the display image; Turning off the display of the display unit; to control the display control unit to implement any one of the following:

2. The display control device according to claim 1.

5. The display control unit generates the black screen by setting all pixels of the image displayed by the display unit to black.

2. The display control device according to claim 1.

6. Both the display unit and the transmissive display device have a screen size of a first pixel size; The display control unit is a first output mode for generating an image of the first pixel size as the display image and generating an image of the first pixel size as the transmit image; a second output mode for generating an image of the first pixel size as the display image and generating an image of a second pixel size larger than the first pixel size as the transmission image; It is configured to be able to switch between When the second output mode is used, the display control unit instructs the transmissive display device to display an image of the second pixel size on a screen having the first pixel size.

2. The display control device according to claim 1.

7. the display control device is configured to supply power to the transmissive display device, The control unit uses the second power consumption mode when it detects that the display control device is supplying power to the transmissive display device, and uses the first power consumption mode when it does not detect that the display control device is supplying power to the transmissive display device.

2. The display control device according to claim 1.

8. the display control device and the transmissive display device are configured to be connected to each other via a USB Type-C connector, so that power can be supplied from the display control device to the transmissive display device; The control unit detects whether the display control device is supplying power to the transmissive display device by reading a CC1 pin signal or a CC2 pin signal in the USB Type-C connector.

8. The display control device according to claim 7.

9. The control unit determines that the display control device is supplying power to the transmissive display device if the power consumption of the display control device is equal to or greater than a threshold value, and determines that the display control device is not supplying power to the transmissive display device if the power consumption is less than the threshold value.

8. The display control device according to claim 7.

10. the display control device includes a first imaging device, and the transmissive display device includes a second imaging device; the control unit acquires work procedure data describing a procedure for a work to be performed on a work object by a worker wearing the transmissive display device; the work procedure data specifies whether to use the first imaging device or the second imaging device to capture an image of the work object in accordance with the content of the work, The display control device or the transmissive display device photographs the work object using either the first imaging device or the second imaging device in accordance with the description of the work procedure data.

2. The display control device according to claim 1.

11. each of the first imaging device and the second imaging device includes a light irradiation device that irradiates light onto the work object when photographing the work object; The display control device and the transmissive display device each include an illuminance sensor for acquiring illuminance of a surrounding environment; When the first imaging device captures an image of the work object, the work object is illuminated using the light irradiation device provided in the first imaging device; When the second imaging device captures an image of the work object, the light irradiation device included in the second imaging device is used to illuminate the work object; When the display control device displays an image of the work target, the display control device adjusts the luminance of the image displayed by the display control device according to the detection value of the illuminance sensor included in the display control device; When the transmissive display device displays an image of the work object, the luminance of the image displayed by the transmissive display device is adjusted according to the detection value of the illuminance sensor included in the transmissive display device.

11. The display control device according to claim 10.

12. a display control device that controls an image displayed by the transmissive display device; The transmissive display device, having The display control device includes: A display unit for displaying an image; a display control unit that generates an image to be displayed by the display unit; a communication unit that transmits the image generated by the display control unit to the transmissive display device; a control unit that controls the display unit, the display control unit, and the communication unit; Equipped with the display control unit is configured to switch between a first power consumption mode and a second power consumption mode having lower power consumption than the first power consumption mode by switching at least one of a display image displayed by the display unit and a transmission image transmitted to the transmissive display device, the control unit detects a usage state of the transmissive display device, and switches between the first power consumption mode and the second power consumption mode according to an effect of the usage state on a remaining battery charge of the display control device; the control unit, in the first power consumption mode, controls the display control unit to generate a first image as the display image, and controls the communication unit to transmit the first image as the transmission image; the control unit, in the second power consumption mode, controls the display control unit to generate, as the display image, a second image having a lower luminance than the first image or a black screen in accordance with the remaining battery charge, and controls the communication unit to transmit, as the transmission image, a third image having a higher luminance than the second image; the display control device is configured to supply power to the transmissive display device, When detecting that the display control device is supplying power to the transmissive display device, the transmissive display device adjusts a luminance value of a display unit included in the transmissive display device in accordance with a remaining battery charge of the display control device, thereby adjusting the supplied power in accordance with the remaining battery charge. A display control system comprising:

13. A display control program for causing a computer to execute a process for controlling an image displayed by a transmissive display device, the display control program comprising: generating an image for display by the computer; transmitting the generated image to the transmissive display device; Run the command, In the step of generating an image, the computer is caused to execute a step of switching between a first power consumption mode and a second power consumption mode having lower power consumption than the first power consumption mode by switching at least one of a display image displayed by the computer and a transmission image transmitted to the transmissive display device; In the step of generating the image, the computer is caused to execute a step of detecting a usage state of the transmissive display device, and switching between the first power consumption mode and the second power consumption mode according to an effect of the usage state on a remaining battery charge of the computer; In the step of generating the image, the computer is caused to execute a step of generating a first image as the display image and transmitting the first image as the transmission image in the first power consumption mode; in the step of generating an image, the computer is caused to execute a step of controlling the computer in the second power consumption mode so as to generate, as the display image, a second image having a lower luminance than the first image or a black screen in accordance with the remaining battery charge, and transmitting, as the transmission image, a third image having a higher luminance than the second image; When power is being supplied from the computer to the transmissive display device, The display control program further causes the computer to execute a step of instructing the transmissive display device to reduce power consumption by the transmissive display device by reducing luminance of an image displayed by the transmissive display device when the remaining battery charge is less than a threshold value. A display control program comprising:

Images