head-mounted display device

Abstract

To provide a head mount type display device which can be selectively used as a VR goggle or an AR goggle.SOLUTION: A head mount type display device 100 includes: a liquid crystal panel 12 arranged on the side where light L from the outside is incident; an organic EL panel 13 arranged on the Ey side of user' eyes rather than the liquid crystal panel 12; and a VR / AR image generation part 16 for generating the image data for VR and the image data for AR. When the organic EL panel 13 displays the image data for VR, the liquid crystal panel 12 is set to a non-transmissive state in which the light L is not transmitted.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a head-mounted display device. [Background technology]

[0002] A head-mounted display device called VR goggles is used to view virtual reality (VR) images, and a head-mounted display device called AR goggles is used to view augmented reality (AR) images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2019-181699 Summary of the Invention [Problem to be solved by the invention]

[0004] As described in Patent Document 1, there is a demand for a head-mounted display device that can be used selectively as either VR goggles or AR goggles by integrating VR goggles and AR goggles. However, integrating VR goggles and AR goggles results in a complex optical configuration and an increased size of the device.

[0005] An object of the present invention is to provide a head-mounted display device that can be made compact with an optically simple configuration and can be used selectively as VR goggles or AR goggles. [Means for solving the problem]

[0006] The present invention provides a virtual reality / augmented reality image generating unit that generates virtual reality image data and augmented reality image data, the virtual reality / augmented reality image generating unit including a liquid crystal panel disposed on a side where external light is incident, an organic electroluminescence panel disposed closer to a user's eyes than the liquid crystal panel, the organic electroluminescence panel including a plurality of organic electroluminescence pixels arranged in a matrix in a first direction within a plane of the organic electroluminescence panel and in a second direction perpendicular to the first direction, the organic electroluminescence pixel unit including an organic electroluminescence pixel region having at least one pixel of transparent non-pixel formation area formed between two organic electroluminescence pixels adjacent to each other in the first direction or the second direction, and the virtual reality / augmented reality image generating unit generates virtual reality image data and augmented reality image data using the virtual reality image data generated by the organic electroluminescence pixel region. Drive The liquid crystal panel has a liquid crystal pixel section in which a plurality of liquid crystal pixels are arranged in a matrix in the first direction and the second direction within a plane of the liquid crystal panel, and a second drive section that sets the liquid crystal pixel section to a non-transmissive state in which the light is not transmitted when the organic electroluminescence pixel section is driven by the virtual reality image data. The second driving unit drives the liquid crystal pixel unit to display the augmented reality image data generated by the virtual reality / augmented reality image generating unit on the liquid crystal pixel unit, and the first driving unit sets the organic electroluminescence pixel unit to a non-illuminated state when the augmented reality image data is displayed on the liquid crystal pixel unit. A head-mounted display device is provided.

[0007] The present invention provides a head-mounted display device comprising: a liquid crystal / organic electroluminescence hybrid panel having a liquid crystal pixel section including a plurality of liquid crystal pixels and an organic electroluminescence pixel section including a plurality of organic electroluminescence pixels; and a virtual reality / augmented reality image generation section that generates image data for virtual reality and image data for augmented reality, wherein the liquid crystal / organic electroluminescence hybrid panel further comprises a first drive section that drives the organic electroluminescence pixel section to display the virtual reality image data generated by the virtual reality / augmented reality image generation section on the organic electroluminescence pixel section, and a second drive section that drives the liquid crystal pixel section to display the augmented reality image data generated by the virtual reality / augmented reality image generation section on the liquid crystal pixel section. [Effects of the Invention]

[0008] According to the head-mounted display device of the present invention, the device can be miniaturized with an optically simple configuration, and can be selectively used as VR goggles or AR goggles. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic configuration diagram showing a head-mounted display device according to a first embodiment. [Figure 2] 1 is a block diagram showing a specific configuration example of a head-mounted display device according to a first embodiment. FIG. [Figure 3] 1 is a schematic plan view showing a first configuration example of a liquid crystal pixel section included in a liquid crystal panel of a head-mounted display device according to a first embodiment. [Figure 4] 4 is a schematic plan view showing a second configuration example of a liquid crystal pixel section included in a liquid crystal panel of the head-mounted display device of the first embodiment. FIG. [Figure 5] 1 is a schematic plan view showing an example of the configuration of an organic electroluminescence pixel unit included in an organic electroluminescence panel of a head-mounted display device according to a first and second embodiments. FIG. [Figure 6] 5 is a flowchart showing the operation of the head-mounted display device of the first embodiment. [Figure 7] FIG. 10 is a schematic configuration diagram showing a head-mounted display device according to a second embodiment. [Figure 8] FIG. 10 is a block diagram showing a specific configuration example of a head-mounted display device according to a second embodiment. [Figure 9] FIG. 10 is a schematic plan view showing an example of the configuration of a liquid crystal pixel unit included in a liquid crystal panel of a head-mounted display device according to a second embodiment. [Figure 10] 10 is a flowchart showing the operation of the head-mounted display device according to the second embodiment. [Figure 11] FIG. 10 is a schematic configuration diagram showing a head-mounted display device according to a third embodiment. [Figure 12] FIG. 10 is a block diagram showing a specific configuration example of a head-mounted display device according to a third embodiment. [Figure 13] FIG. 10 is a schematic plan view showing an example of the configuration of a liquid crystal pixel section and an organic electroluminescence pixel section included in a liquid crystal / organic electroluminescence hybrid panel of a head-mounted display device according to a third embodiment. [Figure 14] 10 is a flowchart showing the operation of the head-mounted display device according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, the head-mounted display device of each embodiment will be described with reference to the accompanying drawings.

[0011] First Embodiment 1, a head-mounted display device 100 of the first embodiment includes a lens 11, a liquid crystal panel 12, an organic electroluminescence panel (hereinafter referred to as an organic EL panel) 13, a lens 14, an operation unit 15, and a virtual reality / augmented reality image generation unit (hereinafter referred to as a VR / AR image generation unit) 16. The liquid crystal panel 12 is disposed on the side where light L from outside is incident, and the organic EL panel 13 is disposed closer to the user's eye Ey than the liquid crystal panel 12.

[0012] The VR / AR image generation unit 16 generates image data for virtual reality (hereinafter referred to as VR image data) or image data for augmented reality (hereinafter referred to as AR image data). The components other than the operation unit 15 are arranged inside the housing 101. The operation unit 15 is attached to the housing 101 so as to be operable from outside the housing 101.

[0013] When the head-mounted display device 100 displays a VR image, the user wearing the head-mounted display device 100 does not see an actual scene, but only an artificially generated virtual image. When the head-mounted display device 100 displays an AR image, the user sees an actual scene with an artificially generated virtual image superimposed thereon.

[0014] Lens 11 is a meniscus lens in which the incident surface for light L from the outside is convex and the exit surface for light L is concave. Lens 14 is a meniscus lens in which the incident surface for light L is concave and the exit surface for light L is convex, assuming that light L has passed through liquid crystal panel 12 and organic EL panel 13. Here, lenses 11 and 14 are convex meniscus lenses. Lenses 11 and 14 do not necessarily have to be meniscus lenses, and other lenses such as plano-convex lenses can also be used. The configuration of lenses 11 and 14 is not limited.

[0015] When the VR mode is selected by the operation unit 15 in order to use the head-mounted display device 100 as VR goggles, the VR / AR image generation unit 16 supplies VR image data to the organic EL panel 13. At this time, in response to the selection of the VR mode by the operation unit 15, the liquid crystal panel 12 is set to a non-transmissive state that does not allow external light L to pass through. The user's eye Ey visually recognizes the VR image displayed on the organic EL panel 13.

[0016] When the AR mode is selected by the operation unit 15 in order to use the head-mounted display device 100 as AR goggles, the VR / AR image generation unit 16 supplies AR image data to the organic EL panel 13. At this time, in response to the selection of the AR mode by the operation unit 15, the liquid crystal panel 12 is set to a transmissive state that allows external light L to pass through the liquid crystal panel 12. The user's eye Ey visually recognizes the external scenery and the AR image displayed on the organic EL panel 13.

[0017] A specific configuration example of the head-mounted display device 100 will be described using Figure 2. Lenses 11 and 14 are not shown in Figure 2. In Figure 2, the VR / AR image generation unit 16 has a central processing unit (hereinafter referred to as CPU) 161, a memory 162, a sensor 163, an image processing unit 164, and an image supply unit 165. The liquid crystal panel 12 has a drive unit 121 (second drive unit) and a liquid crystal pixel unit 122. The organic EL panel 13 has a drive unit 131 (first drive unit) and an organic electroluminescence pixel unit (hereinafter referred to as organic EL pixel unit) 132. The operation unit 15 is, for example, an operation button.

[0018] The operation of the VR / AR image generation unit 16 will now be described. The CPU 161 uses the memory 162 as a working memory and generates VR image data when VR mode is selected, and generates AR image data when AR mode is selected. The CPU 161 supplies image data Dv0, which is VR image data or AR image data, to the image processing unit 164. The image processing unit 164 includes, for example, a graphics board with memory, and expands the image data Dv0 in the memory within the image processing unit 164.

[0019] The sensor 163 includes a three-dimensional gyro sensor and a three-dimensional acceleration sensor. The sensor 163 may further include a position information sensor for detecting position information of the head mounted display device 100. The position information sensor detects the position information of the head mounted display device 100 based on radio waves from multiple satellites for a global positioning system (GNSS: Global Navigation Satellite System) such as a GPS (Global Positioning System).

[0020] The CPU 161 supplies a control signal Sct to the image processing unit 164 based on information from the sensor 163. The information from the sensor 163 indicates at least the direction in which the user is looking, and may also indicate the user's position information and the direction in which the user is looking. The image processing unit 164 supplies partial image data Dv1 of the image data Dv0 expanded in the memory within the image processing unit 164 to the image supply unit 165 based on the control signal Sct. The image data Dv1 indicates an image corresponding to the field of view in the direction in which the user is looking in VR mode, and indicates an image to be superimposed on the actual scenery in the direction in which the user is looking in AR mode.

[0021] The image supply unit 165 supplies image data Dv1 to the drive unit 131 of the organic EL panel 13. The image supply unit 165 can be configured by a circuit that sends out the image data Dv1. The drive unit 131 drives the organic EL pixel unit 132 to display an image based on the image data Dv1 on the organic EL pixel unit 132. The drive unit 121 of the liquid crystal panel 12 drives the liquid crystal pixel unit 122 to set the liquid crystal pixel unit 122 to a black, non-transmissive state in the VR mode, and drives the liquid crystal pixel unit 122 to set the liquid crystal pixel unit 122 to a transmissive state in the AR mode.

[0022] FIG. 3 shows a first configuration example of the liquid crystal pixel section 122. A plurality of transparent electrodes 124 are formed on a glass substrate 123 in an x ​​direction (first direction) within the plane of the liquid crystal panel 12 and a y direction (second direction) perpendicular to the x direction. The transparent electrodes 124 are made of, for example, indium tin oxide. A liquid crystal pixel 125 is formed on each transparent electrode 124 via a liquid crystal layer. The x direction corresponds to the horizontal direction of the image frame, and the y direction corresponds to the vertical direction of the frame. Each liquid crystal pixel 125 is a white liquid crystal pixel (hereinafter referred to as a W liquid crystal pixel) that is not provided with a color filter. In the first configuration example, a plurality of liquid crystal pixels 125 are formed in a matrix in the liquid crystal pixel section 122.

[0023] Although not shown in Fig. 3, the liquid crystal layer of the liquid crystal pixel section 122 is sandwiched between a pair of alignment films, and a transparent electrode (common transparent electrode) common to all of the liquid crystal pixels 125 is provided on the upper surface of the liquid crystal pixels 125. The glass substrate 123 and the common transparent electrode are sandwiched between a pair of polarizing plates. The liquid crystal panel 12 does not have a backlight.

[0024] 4 shows a second configuration example of the liquid crystal pixel section 122. In the second configuration example, instead of the liquid crystal pixel 125 of the W liquid crystal pixel, an R liquid crystal sub-pixel 125r, a G liquid crystal sub-pixel 125g, and a B liquid crystal sub-pixel 125b are formed using red (R), green (G), and blue (B) color filters. In the second configuration example, a set of the R liquid crystal sub-pixel 125r, the G liquid crystal sub-pixel 125g, and the B liquid crystal sub-pixel 125b forms one liquid crystal pixel, and a plurality of liquid crystal pixels are formed in a matrix in the liquid crystal pixel section 122.

[0025] 3 or 4, the liquid crystal layer of the liquid crystal pixel unit 122 is normally black. In this case, when the driver 121 does not apply a voltage between the transparent electrode 124 and the common transparent electrode, the liquid crystal pixel unit 122 is in a black, non-transmitting state, and when a voltage is applied, the liquid crystal pixel unit 122 is in a transmissive state. The liquid crystal layer may be normally white.

[0026] 5 shows an example of the configuration of the organic EL pixel section 132. A plurality of transparent electrodes 134 are formed on a glass substrate 133 in the x and y directions within the plane of the organic EL panel 13. The transparent electrodes 134 are made of, for example, indium tin oxide. An R organic EL sub-pixel 135r, a G organic EL sub-pixel 135g, and a B organic EL sub-pixel 135b, each including an organic light-emitting layer, are formed on each transparent electrode 134. A set of the R organic EL sub-pixel 135r, the G organic EL sub-pixel 135g, and the B organic EL sub-pixel 135b constitutes one organic electroluminescence pixel (hereinafter referred to as an organic EL pixel), and the organic EL pixel section 132 has a plurality of organic EL pixels formed in a matrix.

[0027] 5, in the organic EL pixel section 132 of the organic EL panel 13 provided in the head mounted display device 100, a pixel non-forming region 136 where no organic EL pixels are formed is provided in a position where organic EL pixels would be formed in the organic EL pixel section of a normal organic EL panel. The pixel non-forming region 136 is an area where the glass substrate 133 is exposed as is, and is therefore always transparent.

[0028] In the example shown in Figure 5, in odd-numbered rows in the x direction, organic EL pixels each consisting of an R organic EL sub-pixel 135r, a G organic EL sub-pixel 135g, and a B organic EL sub-pixel 135b are alternately arranged with pixel non-formation regions 136. In even-numbered rows, no organic EL pixels are formed, and all are pixel non-formation regions 136. In odd-numbered columns in the y direction, organic EL pixels and pixel non-formation regions 136 are alternately arranged. In even-numbered columns, no organic EL pixels are formed, and all are pixel non-formation regions 136.

[0029] 5, a pixel non-formation region 136 that is transparent and equivalent to one pixel is formed between two organic EL pixels adjacent in the x direction. Two or more pixel non-formation regions 136 may be formed between two organic EL pixels adjacent in the x direction. Furthermore, a pixel non-formation region 136 that is transparent and equivalent to one pixel is formed between two organic EL pixels adjacent in the y direction. Two or more pixel non-formation regions 136 may be formed between two organic EL pixels adjacent in the y direction.

[0030] A pixel non-forming region 136 of at least one pixel may be formed only between two organic EL pixels adjacent in the x direction, or a pixel non-forming region 136 of at least one pixel may be formed only between two organic EL pixels adjacent in the y direction.

[0031] In VR mode, the organic EL pixel unit 132 displays a VR image. At this time, the liquid crystal panel 12 is in a non-transparent state. Therefore, the user can view the VR image displayed on the organic EL panel 13 without seeing the outside scenery. In AR mode, the organic EL pixel unit 132 displays an AR image. At this time, the liquid crystal panel 12 is in a transparent state. Therefore, the user can view the AR image displayed on the organic EL panel 13 while viewing the outside scenery through the liquid crystal panel 12 in a transparent state and the pixel non-forming region 136 in a transparent state.

[0032] The operation of the head-mounted display device 100 will be described using the flowchart shown in Fig. 6. In Fig. 6, when the power supply (not shown) of the head-mounted display device 100 is turned on and processing is started, the VR / AR image generation unit 16 determines in step S11 whether or not the VR mode has been selected. If the VR mode has been selected (YES), the VR / AR image generation unit 16 supplies VR image data to the organic EL panel 13 in step S12. The liquid crystal panel 12 sets the liquid crystal panel 12 (liquid crystal pixel unit 122) to a non-transparent state in step S13.

[0033] If the VR mode is not selected in step S11 (NO), in step S14, the VR / AR image generation unit 16 supplies AR image data to the organic EL panel 13. In step S15, the liquid crystal panel 12 sets the liquid crystal panel 12 (liquid crystal pixel unit 122) to a transmissive state.

[0034] Following step S13 or S15, in step S16, the VR / AR image generation unit 16 determines whether or not an operation to turn off the power of the head-mounted display device 100 has been performed by the operation unit 15. If an operation to turn off the power of the head-mounted display device 100 has not been performed (NO), the VR / AR image generation unit 16 repeats the processing from step S11 onwards. If an operation to turn off the power of the head-mounted display device 100 has been performed (YES), the VR / AR image generation unit 16 turns off the power in step S17 and ends the processing.

[0035] The head-mounted display device 100 selectively supplies VR image data and AR image data to the organic EL panel 13, and selectively sets the liquid crystal panel 12 to a non-transmitting state or a transmitting state. The liquid crystal panel 12 functions as an electronic shutter that switches between a state in which external light L is blocked to prevent it from entering the eye Ey and a state in which the light L is transmitted and allowed to enter the eye Ey via the organic EL panel 13.

[0036] With this configuration, the head-mounted display device 100 can be selectively used as VR goggles or AR goggles. The head-mounted display device 100 does not need to be provided with optical components that would complicate or increase the size of the optical configuration, such as a polarizing beam splitter or a half mirror, and therefore the device can be made compact with a simple optical configuration.

[0037] Second Embodiment 7 shows a head-mounted display device 200 according to a second embodiment. In FIG. 7, the same components as those in FIG. 1 are denoted by the same reference numerals, and their description may be omitted. Schematically, the head-mounted display device 200 has the same configuration as the head-mounted display device 100 inside or outside a housing 201. However, the VR / AR image generation unit 16 is configured to supply VR image data to the organic EL panel 13 and AR image data to the liquid crystal panel 12.

[0038] Fig. 8 shows a specific example of the configuration of the head-mounted display device 200. In Fig. 8, the same parts as those in Fig. 2 are denoted by the same reference numerals, and their description may be omitted.

[0039] 8, the VR / AR image generation unit 16 of the head mounted display device 200 includes an image supply switching unit 166 instead of the image supply unit 165. In VR mode, the image supply switching unit 166 supplies image data Dv1(VR) of an image for VR to the drive unit 131 of the organic EL panel 13. In AR mode, the image supply switching unit 166 supplies image data Dv1(AR) of an image for AR to the drive unit 121 of the liquid crystal panel 12. The image supply switching unit 166 can be configured by a circuit including a switch.

[0040] The configuration of the liquid crystal pixel section 122 of the liquid crystal panel 12 in the head mounted display device 200 may be the second configuration example shown in Fig. 4. Preferably, the configuration of the liquid crystal pixel section 122 is the third configuration example shown in Fig. 9. The configuration of the organic EL pixel section 132 of the organic EL panel 13 in the head mounted display device 200 is the configuration example shown in Fig. 5.

[0041] A third configuration example of the liquid crystal pixel section 122 shown in Fig. 9 will be described. In the third configuration example, each liquid crystal pixel has an R liquid crystal sub-pixel 125r, a G liquid crystal sub-pixel 125g, and a B liquid crystal sub-pixel 125b formed by R, G, and B color filters, and a white liquid crystal sub-pixel (hereinafter referred to as a W liquid crystal sub-pixel) 125w that is not provided with a color filter. In the liquid crystal pixel section 122, a plurality of liquid crystal pixels, each consisting of a set of the R liquid crystal sub-pixel 125r, the G liquid crystal sub-pixel 125g, the B liquid crystal sub-pixel 125b, and the W liquid crystal sub-pixel 125w, are formed in a matrix.

[0042] The operation of the head-mounted display device 200 will be described using the flowchart shown in Fig. 10. In Fig. 10, when the power supply (not shown) of the head-mounted display device 200 is turned on and processing is started, the VR / AR image generation unit 16 determines in step S21 whether or not the VR mode has been selected. If the VR mode has been selected (YES), the VR / AR image generation unit 16 supplies the VR image data Dv1(VR) to the organic EL panel 13 in step S22. The liquid crystal panel 12 sets the liquid crystal panel 12 (liquid crystal pixel unit 122) to a non-transparent state in step S23.

[0043] If the VR mode is not selected in step S21 (NO), in step S24, the VR / AR image generation unit 16 supplies the AR image data Dv1 (AR) to the liquid crystal panel 12. In step S25, the organic EL panel 13 sets the organic EL panel 13 (organic EL pixel unit 132) to a non-illuminated state.

[0044] Following step S23 or S25, in step S26, the VR / AR image generation unit 16 determines whether or not an operation to turn off the power of the head-mounted display device 200 has been performed by the operation unit 15. If an operation to turn off the power of the head-mounted display device 200 has not been performed (NO), the VR / AR image generation unit 16 repeats the processing from step S21 onwards. If an operation to turn off the power of the head-mounted display device 200 has been performed (YES), the VR / AR image generation unit 16 turns off the power in step S27 and ends the processing.

[0045] In addition to the effects of the head-mounted display device 100, the head-mounted display device 200 has the following effects.

[0046] According to the head-mounted display device 100 described above, both the VR image and the AR image are displayed on the organic EL panel 13. In contrast, according to the head-mounted display device 200, the VR image is displayed on the organic EL panel 13, and the AR image is displayed on the liquid crystal panel 12. Because the organic EL panel 13 has a pixel non-forming region 136, the resolution of the VR image and the AR image is not very high. Because the head-mounted display device 200 displays the AR image on the liquid crystal panel 12, the resolution of the AR image can be improved.

[0047] Furthermore, if the liquid crystal pixel section 122 is configured as the third configuration example shown in FIG. 9, the transmittance of external light L can be made higher than that of the second configuration example shown in FIG.

[0048] In the liquid crystal pixel section 122 of the third configuration example, each liquid crystal pixel has an R liquid crystal subpixel 125r, a G liquid crystal subpixel 125g, a B liquid crystal subpixel 125b, and a W liquid crystal subpixel 125w. In the liquid crystal pixel section 122, some of the multiple liquid crystal pixels may be W liquid crystal pixels. In this case, the other liquid crystal pixels may be R liquid crystal pixels, G liquid crystal pixels, or B liquid crystal pixels, and each of the other liquid crystal pixels may have an R liquid crystal subpixel 125r, a G liquid crystal subpixel 125g, and a B liquid crystal subpixel 125b.

[0049] The liquid crystal pixel section 122 may have a liquid crystal pixel including an R liquid crystal subpixel 125r and a W liquid crystal subpixel 125w, a liquid crystal pixel including a G liquid crystal subpixel 125g and a W liquid crystal subpixel 125w, and a liquid crystal pixel including a B liquid crystal subpixel 125b and a W liquid crystal subpixel 125w. In the liquid crystal pixel section 122, at least some of the liquid crystal pixels may include a W liquid crystal subpixel, or at least some of the liquid crystal pixels may be W liquid crystal pixels.

[0050] Third Embodiment Fig. 11 shows a head-mounted display device 300 of the third embodiment. In Fig. 11, the same parts as those in Fig. 1 are denoted by the same reference numerals, and their description may be omitted. The head-mounted display device 300 includes, in a housing 301, a liquid crystal / organic electroluminescence hybrid panel (hereinafter referred to as a liquid crystal / organic EL hybrid panel) 17 that combines a liquid crystal panel and an organic EL panel, instead of the liquid crystal panel 12 and the organic EL panel 13. The head-mounted display device 300 has the same configuration as the head-mounted display device 100, except that it includes the liquid crystal / organic EL hybrid panel 17.

[0051] 12 shows a specific example of the configuration of head-mounted display device 300. In Fig. 12, the same parts as those in Fig. 2 or 8 are denoted by the same reference numerals, and their description may be omitted. The VR / AR image generation unit 16 of head-mounted display device 300 has the same configuration as the VR / AR image generation unit 16 of head-mounted display device 200.

[0052] The liquid crystal / organic EL hybrid panel 17 has a configuration in which a liquid crystal pixel section 172 and an organic EL pixel section 177 are formed on a single glass substrate 173. A driving section 171 (second driving section) drives the liquid crystal pixel section 172, and a driving section 176 (first driving section) drives the organic EL pixel section 177. In FIG. 12, the position where the liquid crystal pixel section 172 is provided and the position where the organic EL pixel section 177 is provided are shown as completely separate on the glass substrate 173, but in reality, they are arranged as shown in FIG. 13.

[0053] On each transparent electrode 178 formed on the glass substrate 173, an R organic EL subpixel 179r, a G organic EL subpixel 179g, and a B organic EL subpixel 179b are formed, which are similar to the R organic EL subpixel 135r, the G organic EL subpixel 135g, and the B organic EL subpixel 135b shown in Fig. 5. A set of the R organic EL subpixel 179r, the G organic EL subpixel 179g, and the B organic EL subpixel 179b constitutes one organic EL pixel, and a plurality of organic EL pixels arranged in a matrix form an organic EL pixel section 177. The organic EL pixel section 177 has a configuration similar to that of the organic EL pixel section 132 shown in Fig. 5.

[0054] Transparent electrodes 174 are formed in positions on the glass substrate 173 where no transparent electrodes 178 are provided. Each transparent electrode 174 is formed in a position corresponding to the non-pixel formation region 136 in FIG. 5. An R liquid crystal subpixel 175r, a G liquid crystal subpixel 175g, a B liquid crystal subpixel 175b, and a W liquid crystal subpixel 175w are formed on each transparent electrode 174, similar to the R liquid crystal subpixel 125r, the G liquid crystal subpixel 125g, the B liquid crystal subpixel 125b, and the W liquid crystal subpixel 125w. A set of the R liquid crystal subpixel 175r, the G liquid crystal subpixel 175g, the B liquid crystal subpixel 175b, and the W liquid crystal subpixel 175w constitutes one liquid crystal pixel, and the plurality of liquid crystal pixels arranged in a matrix form the liquid crystal pixel section 172.

[0055] The liquid crystal / organic EL hybrid panel 17, in which the liquid crystal pixel section 172 and the organic EL pixel section 177 are formed on one glass substrate 173, can be manufactured as follows. When forming the liquid crystal pixel section 172, a mask is applied to the area where the organic EL pixel section 177 is to be formed or to the area where the organic EL pixel section 177 is already formed. When forming the organic EL pixel section 177, a mask is applied to the area where the liquid crystal pixel section 172 is to be formed or to the area where the liquid crystal pixel section 172 is already formed.

[0056] The operation of the head-mounted display device 300 will be described using the flowchart shown in Fig. 14. In Fig. 14, when the power supply (not shown) of the head-mounted display device 300 is turned on and processing starts, the VR / AR image generation unit 16 determines in step S31 whether or not the VR mode has been selected. If the VR mode has been selected (YES), the VR / AR image generation unit 16 supplies the VR image data Dv1(VR) to the drive unit 176 in step S32. The drive unit 171 sets the liquid crystal pixel unit 172 to a non-transparent state in step S33.

[0057] If the VR mode is not selected in step S31 (NO), in step S34 the VR / AR image generation unit 16 supplies the AR image data Dv1(AR) to the drive unit 171. In step S35, the drive unit 176 sets the organic EL pixel unit 177 to a non-illuminated state.

[0058] Following step S33 or S35, in step S36, the VR / AR image generation unit 16 determines whether or not an operation to turn off the power of the head-mounted display device 300 has been performed by the operation unit 15. If an operation to turn off the power of the head-mounted display device 300 has not been performed (NO), the VR / AR image generation unit 16 repeats the processing from step S31 onwards. If an operation to turn off the power of the head-mounted display device 300 has been performed (YES), the VR / AR image generation unit 16 turns off the power in step S37 and ends the processing.

[0059] The head mounted display device 300 can be made smaller (thinner) than the head mounted display device 100.

[0060] The present invention is not limited to the first to third embodiments described above, and various modifications are possible without departing from the spirit of the present invention. The VR / AR image generation unit 16 may be configured with a microcomputer including a CPU 161, except for the sensor 163. The VR / AR image generation unit 16 may be configured using hardware and software as desired.

[0061] In the head-mounted display devices 100, 200, and 300, the liquid crystal panel 12 and the organic EL panel 13, or the liquid crystal / organic EL hybrid panel 17, may be provided separately for the left and right eyes Ey. The head-mounted display devices 100, 200, and 300 may be configured so that left and right areas of each of the liquid crystal panel 12 and the organic EL panel 13, or the liquid crystal / organic EL hybrid panel 17, are viewed by the left and right eyes Ey. [Explanation of symbols]

[0062] 11,14 Lens 12 LCD panel 13 Organic electroluminescence panel 15 Control section 16 Virtual reality / augmented reality image generation unit 17 Liquid crystal / organic electroluminescence hybrid panel 100,200,300 Head-mounted display device 121,171 Drive unit 122,172 LCD pixel section 131,176 Drive unit 132,177 Organic electroluminescence pixel section

Claims

1. a liquid crystal panel disposed on a side where external light is incident; an organic electroluminescence panel disposed closer to the user's eyes than the liquid crystal panel; a virtual reality / augmented reality image generation unit that generates virtual reality image data and augmented reality image data; Equipped with The organic electroluminescence panel comprises: an organic electroluminescence pixel section in which a plurality of organic electroluminescence pixels are arranged in a matrix in a first direction in a plane of the organic electroluminescence panel and in a second direction perpendicular to the first direction, and a pixel non-forming region of at least one pixel, which is in a transparent state, is formed between two organic electroluminescence pixels adjacent to each other in the first direction or the second direction; a first driver that drives the organic electroluminescence pixel unit using virtual reality image data generated by the virtual reality / augmented reality image generator; and The liquid crystal panel is a liquid crystal pixel section in which a plurality of liquid crystal pixels are arranged in a matrix in the first direction and the second direction within the plane of the liquid crystal panel; a second driving unit that sets the liquid crystal pixel unit to a non-transmitting state that does not transmit the light when the organic electroluminescence pixel unit is driven by the virtual reality image data; and the second driving unit drives the liquid crystal pixel unit to display the augmented reality image data generated by the virtual reality / augmented reality image generating unit on the liquid crystal pixel unit; The first driving unit sets the organic electroluminescence pixel unit to a non-illuminating state when the augmented reality image data is displayed on the liquid crystal pixel unit. Head-mounted display device.

2. 2. The head-mounted display device according to claim 1, wherein the liquid crystal pixel section is such that at least some of the liquid crystal pixels among the plurality of liquid crystal pixels include white liquid crystal sub-pixels, or at least some of the liquid crystal pixels among the plurality of liquid crystal pixels are white liquid crystal pixels.

3. a liquid crystal / organic electroluminescence hybrid panel formed with a liquid crystal pixel section including a plurality of liquid crystal pixels and an organic electroluminescence pixel section including a plurality of organic electroluminescence pixels; a virtual reality / augmented reality image generation unit that generates virtual reality image data and augmented reality image data; Equipped with The liquid crystal / organic electroluminescence hybrid panel comprises: a first driver that drives the organic electroluminescence pixel unit to display virtual reality image data generated by the virtual reality / augmented reality image generation unit on the organic electroluminescence pixel unit; a second driver that drives the liquid crystal pixel unit to display the augmented reality image data generated by the virtual reality / augmented reality image generator on the liquid crystal pixel unit; The head-mounted display device further comprises:

Images