Display device, display method, and program

Abstract

To optimally display images from the real world on at least a portion of the images in the virtual space. [Solution] A display unit that displays images in a virtual space, and a detection unit that detects objects in the real space. The detection unit and the transparency state of the area of ​​the display unit where the object detected by the detection unit can be seen through the display unit. It comprises a transparent control unit for modification.

Description

Technical Field

[0001] The present invention relates to a display device, a display method, and a program.

Background Art

[0002] In recent years, by sharing a VR space that realizes virtual reality (VR) among multiple users, meetings, games, shopping, etc. using the VR space have been increasing. Users participate in meetings using the VR space by wearing a head-mounted display device (head-mounted display: HMD) on their heads. As such a display device, for example, there is one described in Patent Document 1 below.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When a user participates in a meeting using a virtual space, various materials are displayed on a display screen provided in the virtual space. However, if the resolution of the display device is low, the clarity of the materials displayed on the display screen becomes low, and it becomes difficult for the user to read the materials displayed on the display screen. Therefore, the user has a desire to view the materials using the display of their personal computer.

[0005] The present invention has been made in view of the above, and at least a part of the image in the virtual space is presented​​​​​ The objective is to optimally display images in real space. [Means for solving the problem]

[0006] To solve the above-mentioned problems and achieve the objective, the display device according to the present invention provides a virtual space A display unit that displays an image, a detection unit that detects an object in real space, and the detection unit that detects The transparency state of the area of ​​the display unit that allows the object to be seen through the display unit is changed. It includes an over-control unit.

[0007] The display method according to the present invention comprises the steps of displaying an image of a virtual space on a display unit and displaying an image of a virtual space in real space. A step of detecting an object, and before the detected object can be seen through the display unit. The method includes the step of changing the transparency state of the area of ​​the display section.

[0008] The program according to the present invention includes the steps of displaying an image of a virtual space on a display unit and displaying an image of a real space The steps include detecting an object located in the area, and making the detected object visible through the display unit. The steps of changing the transparency state of the area of ​​the display unit and a computer operating as a display device Let the user execute it. [Effects of the Invention]

[0009] According to the present invention, an image of the real world is optimally displayed in at least a portion of an image of the virtual world. This has the effect of enabling that. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a schematic diagram showing the specific configuration of the display device according to this embodiment. [Figure 2] Figure 2 is a block diagram showing the configuration of the display device according to this embodiment. [Figure 3]FIG. 3 is a flowchart showing the display method according to the present embodiment. [Figure 4] FIG. 4 is a schematic diagram showing an image of the virtual space. [Figure 5] FIG. 5 is a schematic diagram showing an image of the real space. [Figure 6] FIG. 6 is a schematic diagram showing an image obtained by superimposing an image of the real space on an image of the virtual space.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the display device, display method, and program according to the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.

[0012] <Specific Configuration of Display Device> FIG. 1 is a schematic diagram showing a specific configuration of the display device according to the present embodiment. In the present embodiment, the description will be made by applying it to a head-mounted display device, but it is not limited to this configuration.

[0013]

[0014] As shown in FIG. 1, the display device 10 includes a display unit 11 and a light shielding unit 12. The display unit 11 is supported by the exterior 20. The display unit 11 includes a display panel 21, a half mirror 22, and a combiner mirror 23. The display panel 21 is arranged horizontally at the upper part of the exterior 20. The display panel 21 has a planar shape, and various display panels such as a liquid crystal panel, an organic EL panel, and a plasma panel can be applied. The display panel 21 has a display surface 21a capable of displaying an image of the virtual space image A on the lower surface. The display surface 21a can irradiate display light La downward, that is, toward the inside of the exterior 20.

[0015] ​​​​​​​The half mirror 22 is located inside the casing 20, below the display panel 21. The mirror 22 is positioned at a predetermined angle relative to the display panel 21. 22 has a reflective coating 22a on its upper side and an anti-reflective coating 22b on its lower side. The half-mirror 22 reflects light from above and transmits light from the front. In other words, The half mirror 22 reflects the display light La irradiated from the display panel 21 to the combiner mirror 23. It reflects towards it. Also, the half mirror 22 reflects the reflection that was reflected by the combiner mirror 23. It transmits light Lb backward.

[0016] The combiner mirror 23 is positioned inside the exterior 20, in front of the half mirror 22. The combiner mirror 23 is positioned vertically at the front of the exterior 20. 23 has a concave shape. The combiner mirror 23 has a reflective coating 23a on its inner surface. The combiner mirror 23 is illuminated from the display panel 21 and reflected by the half mirror 22. The displayed light La is reflected and directed towards the half mirror 22 as reflected light Lb.

[0017] The display unit 11 reflects the display light La emitted from the display panel 21 in front of the half mirror 22. The light is reflected in one direction, and the display light La is reflected backward by the combiner mirror 23, and the reflected light Lb and The light is then transmitted through the half mirror 22 and guided to the user's eyeball. Therefore, the user can see the surface. The virtual space image A displayed by the display unit 11 is positioned in front of the display device 10 for viewing. do.

[0018] Furthermore, the combiner mirror 23 receives real image light Lc, which constitutes the real-space image B, from an external source. The image is captured by the mirror 22 side. The real-space image B is an image that includes the object described later. The display unit 11 uses a combiner mirror 23 and a real image mirror 11 to receive the real image light Lc that constitutes the real space image B. The light is transmitted through the half-mirror 22 and reaches the user's left and right eyeballs. Therefore, the user is currently The image of the object present in real-space image B is directly observed.

[0019] At this time, the reflected light Lb (display light La) that generates the virtual space image A and the real space image B The generated real image light Lc reaches the user's eyeball. Therefore, the user sees the virtual space image A. View the composite image in which the real-world image B is superimposed.

[0020] The light-shielding section 12 has a light-shielding panel 25. The light-shielding panel 25 is positioned vertically on the front of the exterior 20. It is supported along the direction. The light-shielding panel 25 is spaced at a predetermined interval outside the combiner mirror 23. They are arranged in a planar shape, for example, a liquid crystal panel, an organic EL panel. Various display panels such as nel and plasma panels are applicable. The light-shielding panel 25 is made of Pixels are arranged in a tricks-like pattern, and each pixel can be adjusted and controlled from transparent to opaque. The light-shielding panel 25 allows for transmittance adjustment control over all areas or a specified portion of the area. .

[0021] The light-shielding panel 25 has, for example, transparent pixel electrodes arranged in an array on one side, and on the other side It is constructed by arranging transparent counter electrodes on the surface, and a voltage corresponding to the light-shielding control signal is applied to each electrode. The voltage of the light-shielding control signal differs between pixels corresponding to the light-shielding area and pixels corresponding to the light-transmitting area. Based on the light-shielding control signal, each pixel of the light-shielding panel 25 generates the real-space image B. The light-shielding panel 25 either blocks or transmits the image light Lc. The light-shielding panel 25 sets its transmittance to 0% according to the light-shielding control signal. It is adjustable between ~100%.

[0022] When the transmittance of the light-shielding panel 25 is 0%, the light-shielding panel 25 produces the real-space image B. The external real image light Lc is blocked, and the user only sees the real-space image B. On the other hand, when the transmittance of the light-shielding panel 25 is 100%, the light-shielding panel 25 blocks the real-space image. All of the external real image light Lc that generates B is transmitted, and the user sees the virtual space image A in the real space The composite image with the intervening image B superimposed is viewed. Also, the transmittance of the light-shielding panel 25 is 0% to 100%. When adjusted within a certain range, the light-shielding panel 25 generates the real-space image B from an external source. The transmittance of the image light Lc is adjusted, and the user can view the virtual space image A with the predetermined transmittance adjusted. View the composite image created by superimposing the real-space image B.

[0023] [Processing configuration of the display device] Figure 2 is a block diagram showing the configuration of the display device according to this embodiment.

[0024] As shown in Figure 2, the display device 10 communicates various information with the virtual space configuration system 100. It sends and receives data. The virtual space configuration system 100 generates information about the VR space. The configuration system 100 is, for example, a server. Also, the virtual space configuration system 100 This is based on 3D models of avatars generated on the personal computers of multiple users. The system generates information for the VR space. The virtual space configuration system 100 then generates information for the VR space. The information is output to the display device 10.

[0025] The display device 10 uses information about the VR space obtained from the virtual space configuration system 100 to perform the following actions: Displays an image of the VR space as seen by the user.

[0026] The display device 10 includes the aforementioned display unit 11 and light-shielding unit 12, as well as a virtual space image acquisition unit 3. 1, image processing unit 32, camera 41, real-space image processing unit 42, device detection unit 43 It has a transparent image generation unit 44, a light-shielding control unit 45, and an image determination unit 46. Device 10 includes a user image generation unit 51, a signal synthesis unit 52, and a signal transmission unit 53.

[0027] Here, the image processing unit 32, the real-space image processing unit 42, the device detection unit 43, and the transparent image generation unit are located. The light-shielding control unit 45, image determination unit 46, user image generation unit 51, and signal synthesis unit 52 are, for example, For example, CPU (Central Processing Unit), DSP (Digital Signal Processor), At least one of RAM (Random Access Memory) or ROM (Read Only Memory) Thus, it is composed of these elements.

[0028] The virtual space image acquisition unit 31 is connected to the virtual space configuration system 100 and also processes the image. It is connected to the control unit 32. The virtual space image acquisition unit 31 is, for example, a communication module. The virtual space configuration system 100 and the image processing unit 32 and the network (for example, the internet) It is connected via a network (such as a network). The virtual space image acquisition unit 31 is connected to the virtual space configuration system 10 Information about the VR space is acquired from scratch. The virtual space image acquisition unit 31 is part of the virtual space configuration system 1. The VR space information acquired from 00 is output to the image processing unit 32.

[0029] The image processing unit 32 generates display image data based on the information in the VR space, and the display image data The signal is output to the display unit 11 as a display signal. The display unit 11 receives input from the image processing unit 32. Based on the displayed signal, a virtual space image A is displayed.

[0030] Camera 41 is a slum (Simultaneous Localization). Camera 41 is a camera for performing on and mapping. The image is acquired by taking a picture and output as captured image data. Camera 41, for example, displays It is attached to the HMD as a device 10. Camera 41 is, for example, a monocular camera (wide-angle camera, Fisheye camera, 360-degree camera, compound eye camera (stereo camera, multi-camera), RGB- D-cameras (such as depth cameras and ToF cameras) are used.

[0031] Camera 41 is connected to the real-space image processing unit 42. The real-space image processing unit 42 is connected to the camera The camera 41 acquires the captured image data. The real-space image processing unit 42 then processes the captured image data. Visual Slam processing is performed using a data source to map the real space and determine self-position. Head tracking estimation is performed.

[0032] Furthermore, the camera 41 is connected to the device detection unit 43. The device detection unit 43 detects the camera 41. The captured image data is acquired. The device detection unit 43 uses the captured image data to determine the actual space The system detects various devices visible in the intervening images. Here, "devices" refers to personal computers. This includes displays, keyboards, mice, etc. The devices to be detected are pre-configured. The teaching data is then stored. The device detection unit 43, for example, uses machine learning to process the teaching data. Identify the equipment used.

[0033] The real-space image processing unit 42 and the device detection unit 43 are connected to the transparent image generation unit 44. The transparent image generation unit 44 processes the real-space mapping results processed by the real-space image processing unit 42 and The self-position / head tracking results and the detection results of the devices detected by the device detection unit 43 are input. The transparent image generation unit 44 generates the real-space mapping result and the self-position / head trace. Based on the detection results and the device's detection results, transparent image data is generated. The "TA" is image data that is displayed by making part or all of the display unit 11 transparent.

[0034] The transparent image generation unit 44 is connected to the light-shielding control unit 45. The light-shielding control unit 45 generates the transparent image Based on the transmission image data generated by the component 44, the transmission area and transmittance of the light-shielding portion 12 are determined. Determined. The transmittance area and transmittance of the light-shielding part 12 are determined when the real-space image B passes through the display part 11. This refers to the area and clarity that reaches the user's left and right eyeballs. The transmission area and transmittance are predetermined. It is set and adjusted as needed. For example, the initial transparency area is the lower part of the display unit 11. It is located midway between the left and right sides, and occupies 20% of the area of ​​the entire display. The initial transmittance is 70%. The light-shielding control unit 45 uses the transmission image data consisting of the transmission region and the transmittance as a transmission signal. The output is sent to the light-shielding section 12. The light-shielding section 12 is based on the light-shielding signal input from the light-shielding control unit 45. It then passes through a predetermined area.

[0035] The image determination unit 46 is connected to the image processing unit 32 and the transparent image generation unit 44. 6 is the display image data generated by the image processing unit 32 and the transparent image generated by the transparency image generation unit 44 Image data is input. The image determination unit 46 displays the image generated by the image processing unit 32 on the display unit 11. The degree of change (e.g., amount of change, rate of change) of the displayed virtual space image A is set to a first predetermined value. It determines whether the value is less than the threshold. In addition, the image determination unit 46 determines whether the transparent image generation unit 44 The degree of change (e.g., amount of change, rate of change) of the real-space image B generated and transmitted through the display unit 11. It is determined whether the value of the virtual space image is less than a pre-set second threshold. The degree of change of A and the degree of change of the real-world image B refer to two things that switch over time. This is the difference in the number of pixels between frame rates. In this case, the difference in the number of pixels between the two frame rates is... It is expressed as a change in the amount of change, or the rate of change in the number of pixels. Note that the two frame rates are continuous. These may be objects, and they may be spaced apart by a predetermined number of frame rates.

[0036] Furthermore, the first and second thresholds are set as appropriate. The first threshold is, for example, In a meeting held in a VR space, the virtual elements change when the image on the display screen switches. This could be the difference in the number of pixels between frame rates of spatial image A. The second threshold could be, for example, In the real world, when the image on a personal computer's display changes, it fluctuates. This is the difference in the number of pixels between frame rates of the real-world image B.

[0037] The image determination unit 46 is connected to the light-shielding control unit 45. The image determination unit 46 determines the virtual space image A The light-shielding control unit 45 receives the determination result of the degree of change of the real-space image B and the determination result of the degree of change of the real-space image B. Output. That is, the image determination unit 46 determines that the degree of change of the virtual space image A is equal to the first threshold. When it is determined that there is little light, the light-shielding area 12 (display area 11) is widened, or light shielding is performed. An adjustment signal to increase the transmittance of section 12 (display section 11) is output to the light-shielding control unit 45. The image determination unit 46 determines that the degree of change of the virtual space image A is less than the first threshold, and that When it is determined that the degree of change in the real-space image B is greater than the second threshold, the light-shielding part 12 (display) Adjustments to widen the transparent area of ​​part 11, or to increase the transmittance of the light-shielding part 12 (display part 11). The signal is output to the light-shielding control unit 45.

[0038] The light-shielding control unit 45 determines the transmission area of ​​the light-shielding section 12 and the light-shielding area based on the determination result of the image determination unit 46. The transmittance of section 12 is changed. In this embodiment, the transmittance of the light-shielding section 12 is changed by the light-shielding control unit 45. By changing the area and transmittance, the area of ​​the display unit 11 that can be seen through the display unit 11 can be changed. The transparency state is being changed. However, this configuration is not the only one. For example, display unit 1 The unit 1 is configured to include a light-shielding section 12, and the light-shielding control unit 45 controls the transparent area and transmittance of the display unit 11. You may change it.

[0039] Furthermore, the image determination unit 46 determined that the degree of change of the virtual space image A was greater than the first threshold. When the degree of change of the real-space image B is less than the second threshold, the light-shielding part 1 Narrow the transparent area of ​​2 (display section 11), or lower the transmittance of the light-shielding section 12 (display section 11). The adjustment signal may be output to the light-shielding control unit 45.

[0040] Furthermore, the user image generation unit 51 generates user avatar data (three-dimensional data). The user image generation unit 51 is connected to the signal synthesis unit 52. The signal synthesis unit 52 is connected to the real space The image processing unit 42 processes the real-space mapping results and self-position / head tracking. The results are combined with the user avatar data generated by the user image generation unit 51 to create a VR space. Generate display image data.

[0041] The signal combining unit 52 is connected to the signal transmitting unit 53. The signal transmitting unit 53 is connected to the signal combining unit. The generated VR space display image data is sent as a stream signal to the virtual space configuration system 100. I believe.

[0042] The virtual space configuration system 100 is located in a predetermined position in the virtual communication space. Display a 3D image based on R-space image data, i.e., the user's avatar image. The virtual space image acquisition unit 31 described above acquires VR from the virtual space configuration system 100. Spatial information, that is, the image of the virtual space as seen in the real space as seen from the direction the user's face is facing. The image signal is acquired as a stream signal.

[0043] [Display method] Figure 3 is a flowchart illustrating the display method according to this embodiment, and Figure 4 shows an image of the virtual space. Figure 5 is a schematic diagram representing an image of real space, and Figure 6 is a schematic diagram representing an image of virtual space with real space This is a schematic diagram of an image created by overlaying images.

[0044] As shown in Figures 1 to 3, in step S11, the virtual space image acquisition unit 31 acquires virtual space The system acquires information about the VR space from the inter-configuration system 100 and outputs it to the image processing unit 32. In step S12, the image processing unit 32 generates display image data based on the information in the VR space. The output is sent to the display unit 11. In step S13, the display unit 11 receives input from the image processing unit 32. Based on the displayed signal, a virtual space image A is displayed. For example, as shown in Figure 4, Interim image A is an image of a meeting in a virtual space, showing multiple users' avatars on the screen. This is an image that displays -.

[0045] In step S14, camera 41 acquires an image of the area the user is looking at, and captures the image The data is output to the real-space image processing unit 42 and the device detection unit 43. In step S15, The real-space image processing unit 42 uses the image data captured by the camera 41 to perform visual slam processing. The system performs the necessary operations to map the real space and estimate self-position and head tracking, and The output is sent to the overimage generation unit 44. Meanwhile, in step S16, the device detection unit 43 detects the camera 4 Using the captured image data from step 1, various devices (such as personal computer displays) The image is detected, identified, and output to the transparent image generation unit 44.

[0046] In step S17, the transparent image generation unit 44 processes the real-space image processing unit 42. Based on the image and the equipment detected by the equipment detection unit 43, the light-shielding control unit generates transparent image data. Output to 45. For example, as shown in Figure 5, the real-world image B is the image in front of the user. The display, keyboard, and other components of a personal computer are placed on the table. This is an image that displays things like a moss. In step S18, the light-shielding control unit 45 generates a transparent image. Based on the transmission image data generated by unit 44, the transmission area and transmittance of the light-shielding unit 12 are set. In step S19, the light-shielding portion 12 is configured to have a predetermined transmission area and a predetermined transmittance. As a result, a partial image B1 of the real space is input to the display unit 11 through the light-shielding section 12.

[0047] When the light-shielding control unit 45 sets the transparent area of ​​the light-shielding unit 12 to the entire area, the user can see the entire display unit 11. The virtual space image A displayed across the entire body can be seen, and the entire area of ​​the display unit 11 can be viewed. A partial image B1 of the real space is displayed transparently. In other words, the user can see a hypothetical Through the entire area of ​​the imaginary space image A (Figure 4), a portion of the real space image B1 (Figure 5) can be seen. Furthermore, if the light-shielding control unit 45 partially controls the transparent area of ​​the light-shielding unit 12, the user will see the display unit. The virtual space image A displayed across the entire 11 can be seen, as well as the display unit 11 A partial image B1 of the real space can be seen, which is displayed with a portion of it transparent. That is, Figure 6 As shown, the user sees that the bottom of virtual space image A, which is an image of a meeting in the virtual space, is partially cut off. The area that was removed and cut out contained the display and keyboard of a personal computer. You can see a portion of the real-world space, image B1, which is an image of a mouse.

[0048] In step S20, the image determination unit 46 determines the display image data generated by the image processing unit 32 and Then, the transparent image data generated by the transparent image generation unit 44 is acquired. In step S21, the image The determination unit 46 determines that the degree of change of the virtual space image A is less than a preset first threshold. It determines whether or not. That is, the image determination unit 46 determines the frame rate of the virtual space image A. It is determined whether the difference in pixel count Pa is less than the first threshold Ps1. Here, image judgment Section 46 states that the difference Pa of the number of pixels between frame rates of the virtual space image A is greater than the first threshold P1. If it is determined that the value is small (Yes), the process proceeds to step S22.

[0049] In step S22, the image determination unit 46 determines that the light-shielding unit 12 is generated by the transparent image generation unit 44. Whether the degree of change of the real-space image B that passes through the display unit 11) is greater than the second threshold is determined. The image determination unit 46 determines the number of pixels between frames of the real-space image B. It is determined whether the difference Pb is greater than the second threshold P2. Here, the image determination unit 46 determines the current The system determines that the difference in the number of pixels Pb between frame rates of real-space image B is greater than the second threshold P2. (Yes) Then, in step S23, the transparent area of ​​the light-shielding part 12 (display part 11) is widened. Alternatively, an adjustment signal to increase the transmittance of the light-shielding section 12 (display section 11) is output to the light-shielding control unit 45. do.

[0050] Meanwhile, in step S21, the image determination unit 46 determines the frame rate of the virtual space image A. If it is determined that the difference in pixel count Pa is not less than the first threshold P1 (No), then proceed as is. Remove the chin. Also, in step S22, the image determination unit 46 determines the frame of the real space image B. If it is determined that the difference in the number of pixels Pb between the two rates is not greater than the second threshold P2 (No), The routine is then exited.

[0051] In step S24, the light shielding control unit 45 determines the light shielding unit based on the determination result of the image determination unit 46. The transmittance of the transparent area of ​​the display unit 12 or the transmittance of the light-shielding area 12 (display unit 11) is changed.

[0052] In step S21, the image determination unit 46 determines the frame rate of the virtual space image A. When it is determined that the difference Pa of prime numbers is not less than the first threshold P1 (No), or when the status At step S22, the image determination unit 46 determines the difference in the number of pixels between frames of the real-space image B, Pb When it is determined that the value is not greater than the second threshold P2 (No), the light-shielding section 12 (display section 11) The adjustment signal that narrows the transparent area or lowers the transmittance of the light-shielding part 12 (display part 11) is blocked. The output may also be sent to the optical control unit 45.

[0053] [Effects of the Embodiment] The display device of this embodiment includes a display unit 11 that displays a virtual space image A, and a display unit 11 that displays a real space image B. A device detection unit (detection unit) 43 that detects an object, and the object detected by the device detection unit 43 Light-shielding control unit that changes the transparency state of the transparent area of ​​the display unit 11 that can be seen through the display unit 11. It includes a (transmission control unit) 45.

[0054] Therefore, the display unit 11 can display the virtual space image A, and the display unit 11 It is possible to display objects in the real-world image B by making part or all of the area transparent. It is possible to optimally display images from the real world on at least a portion of the images in the virtual space.

[0055] In this embodiment, the light-shielding control unit 45 has a preset degree of change for the virtual space image A. When it is less than the first threshold, the light-shielding area 12 (display area 11) is widened. Alternatively, the transmittance of the light-shielding part 12 (display part 11) is increased. As a result, the change in the virtual space image A Depending on the situation, objects in the real-world image B can be displayed clearly.

[0056] In this embodiment, the light-shielding control unit 45 determines the degree of change of the virtual space image A to be a first type The value is less than the value, and the degree of change of the real-space image B is less than the pre-set second threshold. When there are many light-shielding parts, the transparent area of ​​the light-shielding part 12 (display part 11) is widened, or the light-shielding part 12 (display part 11) Increase the transparency of part 11). Therefore, the changes in the virtual space image A and the real space image Depending on the changes in B, objects in the real-world image B can be displayed clearly.

[0057] Although the display device according to the present invention has been described so far, there are various other embodiments besides those described above. It may be implemented in different forms.

[0058] Each component of the illustrated display device is a functional concept and does not necessarily correspond to the physical representation shown. The configuration does not have to be as shown. In other words, the specific form of each device is not limited to that shown in the illustration. Furthermore, depending on the processing load and usage status of each device, all or part of them can be configured to function in any unit. They may be geographically or physically dispersed or integrated.

[0059] The configuration of the display device is, for example, as software, a program loaded into memory. This is achieved by the above embodiment, which involves these hardware or software They were described as functional blocks realized through collaboration. In other words, these functional blocks Regarding this, it can be done using hardware only, software only, or a combination of both. It can be realized in various forms.

[0060] The above-mentioned components include those that can be easily conceived by a person skilled in the art, and those that are substantially the same. Furthermore, the above-described configurations can be combined as appropriate. Within the scope, various omissions, substitutions, or modifications of the configuration are possible. [Explanation of Symbols]

[0061] 10 display device 11 Display section 12 Light-shielding part 21 Display Panel 22 Half Mirror 23 Combiner Mirrors 25 Light-blocking panels 31 Virtual Space Image Acquisition Unit 32 Image Processing Unit 41 Camera 42 Real-world space image processing unit 43 Equipment detection unit 44 Transparent Image Generation Unit 45 Light-shielding control unit (transmission control unit) 46 Image determination unit 51 User Image Generation Unit 52 Signal Synthesis Unit 53 Signal transmission unit A virtual space image B Real-world image La display light Lb reflected light Lc real image light

Claims

1. A display unit that displays images in a virtual space, A detection unit that detects objects in real space, A transparency control unit that changes the transparency state of the area of ​​the display unit in which the object detected by the detection unit can be seen through the display unit, Equipped with, The transparency control unit changes the size of the area or the transparency of the display unit according to the degree of change of the image in the virtual space, or the degree of change of the image in the real space that includes the object and can be seen through the display unit. Display device.

2. The transparency control unit narrows the area or lowers the transparency of the display unit when the degree of change of the image in the virtual space is not less than a preset first threshold, or when the degree of change of the image in the real space that includes the object and can be seen through the display unit is not greater than a preset second threshold. The display device according to claim 1.

Images