Image display device and restart method for image display device

Abstract

An image display device and a method for restarting the image display device reduce the delay in notification timing in the case of an abnormality. The HMD (100) includes: an image display unit (20) that is worn on the head of a user (U) and notifies detection of an abnormality; a DP six-axis sensor (235) that detects whether the image display unit (20) is worn on the head of the user (U); and a DP control unit (120) that, when an abnormality of the HMD (100) is detected without detecting that the image display unit (20) is worn on the head of the user, executes a first restart mode for restarting the HMD in a first order, and when an abnormality of the HMD is detected while detecting that the image display unit is worn on the head of the user, executes a second restart mode for restarting the HMD in a second order. The order of restarting the image display unit in the second order is set to be earlier than the order of restarting the image display unit in the first order.

Description

Technical Field

[0001] The present invention relates to an image display device and a method for restarting the image display device. Background Art

[0002] Conventionally, an image display device that detects an error in a device and performs processing corresponding to the detected error has been known.

[0003] For example, the transparent display device disclosed in Patent Document 1 adjusts the brightness of the transparent display, the transmittance of a dimming element, the display position, size, etc. of a display image based on the level of the detected error.

[0004] Patent Document 1: International Publication No. 2018 / 135135

[0005] However, when an abnormality occurs in the image display device, sometimes the display of the image display device disappears and the display is restored after the image display device is restarted. In such a case, if it takes time until the display is restored, it may confuse the user. Summary of the Invention

[0006] One aspect for solving the above problems is an image display device that is worn on a user's head, the image display device including: a notification unit that notifies that an abnormality has been detected in the image display device; a detection unit that detects a situation where the image display device is worn on the user's head; and a control unit that, when the wearing of the image display device is not detected and the abnormality in the image display device is detected, executes a first restart mode for restarting the image display device in a first order, and when the wearing of the image display device is detected and the abnormality in the image display device is detected, executes a second restart mode for restarting the image display device in a second order different from the first order, and the control unit sets the order in which the notification unit is restarted in the second order to be earlier than the order in which the notification unit is restarted in the first order.

[0007] One way to solve the above problems is an image display device that is worn on the user's head. The image display device includes: a notification unit that notifies an abnormality detected in the image display device; a detection unit that detects a situation where the image display device is worn on the user's head; and a control unit that, when the abnormality in the image display device is detected without detecting the wearing of the image display device, executes a first restart mode to restart the image display device in a first order, and when the wearing of the image display device is detected and the abnormality in the image display device is detected, executes a second restart mode to restart the image display device in a second order different from the first order. The control unit sets the time interval from the execution of the second restart mode to the restart of the notification unit to be shorter than the time interval from the execution of the first restart mode to the restart of the notification unit.

[0008] One way to solve the above problems is a control method for an image display device. In the method, an abnormality of the image display device worn on the user's head is detected, and a situation where the image display device is worn on the user's head is detected. When the abnormality of the image display device is detected without detecting the wearing of the image display device, the image display device is restarted in a first order. When the abnormality of the image display device is detected and the wearing of the image display device is detected, the image display device is restarted in a second order. Compared with the first order, the second order has an earlier restart order for a notification unit that notifies that an abnormality has occurred in the image display device.

[0009] One way to solve the above problems is a control method for an image display device. In the method, an abnormality of the image display device worn on the user's head is detected, and a situation where the image display device is worn on the user's head is detected. When the abnormality of the image display device is detected without detecting the wearing of the image display device, the image display device is restarted in a first order. When the abnormality of the image display device is detected and the wearing of the image display device is detected, the image display device is restarted in a second order. Compared with the first order, the second order has a shorter time interval until a notification unit that notifies that an abnormality has occurred in the image display device is restarted. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 is a diagram showing a schematic configuration of a display system.

[0011] Figure 2 is a main part top view showing an optical system configuration of an image display unit.

[0012] Figure 3 is a block diagram of a display system.

[0013] Figure 4 It is a block diagram of a control device.

[0014] Figure 5 It is a flowchart showing the operation of a head-mounted display device.

[0015] Reference numeral description

[0016] 1: Display system; 10: Connection device; 11A, 11D: Connectors; 20: Image display unit; 21: Right holding part; 22: Right display part; 23: Left holding part; 24: Left display part; 26: Right light guide plate; 27: Front frame; 28: Left light guide plate; 30: Headphone; 32: Right headphone; 34: Left headphone; 36: Audio connector; 40: Connection cable; 46: USB cable; 61: DP external camera; 63: Microphone; 64: Distance sensor; 65: DP illuminance sensor; 67: LED indicator; 100: HMD; 110: I / F unit; 120: DP control unit; 122: Sensor control unit; 126: Power control unit; 130: Non-volatile storage unit; 135: Display driver; 140: Operation unit; 145: Connection part; 147: Sound processing unit; 201: Video signal; 210: Right display part substrate; 211: Right I / F unit; 213: Receiving unit; 215: EEPROM; 217: Temperature sensor; 221: OLED unit; 223: OLED panel; 225: OLED drive circuit; 229: Power supply unit; 230: Left display part substrate; 231: Left I / F unit; 233: Receiving unit; 235: DP six-axis sensor; 237: DP magnetic sensor; 239: Temperature sensor; 241: OLED unit; 243: OLED panel; 245: OLED drive circuit; 249: Power supply unit; 251: Right optical system; 252: Left optical system; 261, 281: Half-reflecting mirrors; 300: Control device; 310: CO control unit; 311: Processor; 312: Memory; 313: Non-volatile memory; 321: GNSS; 322: CO camera; 323: CO six-axis sensor; 324: CO magnetic sensor; 325: CO illuminance sensor; 326: Sound output unit; 327: CO display part; 328: Touch panel; 329: Battery; 330: Communication unit; 331: I / F unit. Detailed implementation

[0017] 1. Structure of the display system

[0018] Figure 1 It is a diagram showing the schematic structure of the display system 1.

[0019] The display system 1 includes an HMD 100 equivalent to an image display device and a control device 300. The HMD 100 is a head-mounted display device that has an image display unit 20 worn on the head of the user U to enable the user to view images or videos. HMD is an abbreviation for Head Mounted Display.

[0020] The HMD 100 has a connection device 10 connected to the image display unit 20. The connection device 10 functions as an interface for connecting the HMD 100 and a device different from the HMD 100. In the display system 1, the control device 300 is connected to the connection device 10.

[0021] In the following description and drawings, for ease of explanation, a prefix DP is added to the names of several functional units constituting the HMD 100, and a prefix CO is added to the names of several functional units constituting the control device 300.

[0022] The control device 300 is a terminal device having a display screen for displaying characters and images and a touch panel 328 that functions as an operation unit for detecting touch operations and pressing operations, and is of a portable size, such as a smartphone that can be used. The control device 300 can also be a desktop personal computer, a notebook personal computer, a tablet personal computer, etc.

[0023] The connection device 10 has a connector 11A and a connector 11D on a box-shaped housing. The image display unit 20 is connected to the connector 11A via a connection cable 40, and the control device 300 is connected to the connector 11D via a USB cable 46. Thus, the image display unit 20 and the control device 300 are connected to be able to transmit and receive data to and from each other. For example, the control device 300 outputs video data and audio data for the image display unit 20 to display a video to the image display unit 20. For example, the image display unit 20 transmits detection data of various sensors included in the image display unit 20 to the control device 300 as described later. The control device 300 can also supply power to the image display unit 20. USB is an abbreviation for Universal Serial Bus.

[0024] The structure of connecting the connecting device 10 and the control device 300 using the USB cable 46 is just an example, and the specific connection method between the connecting device 10 and the control device 300 is not limited. For example, other types of cables can also be used for wired connection, or connection can be made via wireless communication. For example, in the structure where the USB cable 46 is connected to the connector 11D conforming to the USB-TypeC standard, a DC current of 20 volts can be supplied through the USB cable 46, and as a function of the alternative mode of USB-TypeC, image data conforming to the HDMI standard can be transmitted. HDMI is a registered trademark.

[0025] The image display unit 20 has a right display unit 22, a left display unit 24, a right light guide plate 26, and a left light guide plate 28 on a main body having a right holding part 21, a left holding part 23, and a front frame 27.

[0026] The right holding part 21 and the left holding part 23 extend backward from both end parts of the front frame 27 to hold the image display unit 20 on the head of the user U. The right holding part 21 is connected to the end part ER on the right side of the user U of the front frame 27, and the left holding part 23 is connected to the end part EL on the left side of the user U of the front frame 27.

[0027] The right light guide plate 26 and the left light guide plate 28 are provided on the front frame 27. The right light guide plate 26 is in front of the right eye of the user U in the wearing state of the image display unit 20, enabling the right eye to see an image. The left light guide plate 28 is in front of the left eye of the user U in the wearing state of the image display unit 20, enabling the left eye to see an image. The right light guide plate 26 and the left light guide plate 28 are optical parts formed of a light-transmissive resin or the like, and guide the image light output from the right display unit 22 and the left display unit 24 to the eyes of the user U. The right light guide plate 26 and the left light guide plate 28 are, for example, prisms.

[0028] The front frame 27 has a shape that connects one end of the right light guide plate 26 and one end of the left light guide plate 28 to each other, and in the wearing state where the user U wears the image display unit 20, this connection position corresponds to the glabella of the user U. The front frame 27 may have a nose pad part that abuts against the nose of the user U in the wearing state of the image display unit 20, or may be a structure in which straps are connected to the right holding part 21 and the left holding part 23, and the image display unit 20 is held on the head of the user U by the straps.

[0029] The right display unit 22 and the left display unit 24 are respectively modules obtained by unitizing an optical unit and a peripheral circuit. The right display unit 22 displays an image through the right light guide plate 26, and the left display unit 24 displays an image through the left light guide plate 28. The right display unit 22 is provided on the right holding part 21, and the left display unit 24 is provided on the left holding part 23.

[0030] The image light guided by the right light guide plate 26 and the external light passing through the right light guide plate 26 are incident on the right eye of the user U. Similarly, the image light guided by the left light guide plate 28 and the external light passing through the left light guide plate 28 are incident on the left eye. The image light from the right light guide plate 26 and the left light guide plate 28 and the external light passing through the right light guide plate 26 and the left light guide plate 28 are incident on the eyes of the user U. Thus, the user U overlaps and views the image displayed on the image display unit 20 and the external scene passing through the right light guide plate 26 and the left light guide plate 28.

[0031] A DP illuminance sensor 65 is arranged on the front frame 27. The DP illuminance sensor 65 is a sensor that receives the external light from the front of the user U wearing the image display unit 20. Through the DP illuminance sensor 65, it is possible to detect the illuminance and the amount of light of the external light incident on the eyes of the user U through the right light guide plate 26 and the left light guide plate 28.

[0032] The DP outer camera 61 is arranged on the front frame 27 at a position where it does not block the external light passing through the right light guide plate 26 and the left light guide plate 28. The DP outer camera 61 is a digital camera having an imaging element such as a CCD or a CMOS and an imaging lens, etc., and can be a monocular camera or a stereo camera. The field of view angle of the DP outer camera 61 includes at least a part of the external scene range seen by the user U wearing the image display unit 20 through the right light guide plate 26 and the left light guide plate 28. The DP outer camera 61 can be a wide-angle camera or a camera capable of photographing the entire external scene seen by the user U wearing the image display unit 20. CCD is the abbreviation of Charge Coupled Device, and CMOS is the abbreviation of Complementary Metal Oxide Semiconductor.

[0033] An LED indicator 67 that lights up during the operation of the DP outer camera 61 is arranged on the front frame 27.

[0034] A distance sensor 64 is arranged on the front frame 27, and this distance sensor 64 detects the distance to a measurement object located in a preset measurement direction. The distance sensor 64 is, for example, a light reflection type distance sensor using an LED or a laser diode, an infrared depth sensor, an ultrasonic distance sensor, or a laser rangefinder. The distance sensor 64 can be a distance detection unit that combines image detection and sound detection, or a device that processes the images obtained by the stereo shooting of a camera to detect the distance. The measurement direction of the distance sensor 64 is, for example, the direction of the external scene seen by the user U through the right light guide plate 26 and the left light guide plate 28.

[0035] The right display unit 22 and the left display unit 24 are respectively connected to the connection device 10 via connection cables 40. The connection cable 40 has an audio connector 36. Connected to the audio connector 36 is a headphone 30 having a right earphone 32 and a left earphone 34 that constitute a stereo headphone, and a microphone 63. The right earphone 32 and the left earphone 34 output sound according to the sound signal output from the connection device 10. The microphone 63 collects sound and outputs a sound signal to the connection device 10.

[0036] 2. Structure of the optical system of the image display unit

[0037] Figure 2 It is a main part top view showing the optical system structure of the image display unit 20. In Figure 2 For ease of explanation, the left eye LE and the right eye RE of the user U are shown.

[0038] The right display unit 22 and the left display unit 24 are configured to be, for example, left - right symmetric.

[0039] As a structure for the right eye RE to see an image, the right display unit 22 has an OLED unit 221 that emits image light and a right optical system 251 that guides the image light L emitted by the OLED unit 221 to the right light guide plate 26. OLED is an abbreviation for Organic Light Emitting Diode.

[0040] The OLED unit 221 has an OLED panel 223 and an OLED driving circuit 225 that drives the OLED panel 223. The OLED panel 223 is, for example, a self - emitting display panel in which light - emitting elements that respectively emit R, G, and B colored light are arranged. The OLED driving circuit 225 drives the OLED panel 223 according to the control of the DP control unit 120. The OLED driving circuit 225 is, for example, mounted on a substrate (not shown) fixed to the back surface of the OLED panel 223, and a Figure 3 temperature sensor 217 as shown is mounted on this substrate.

[0041] The right optical system 251 makes the image light L emitted from the OLED panel 223 into a parallel - state light beam through a collimating lens and makes them incident on the right light guide plate 26. Inside the right light guide plate 26, the image light L is reflected by a plurality of reflecting surfaces and is reflected by a half - reflecting mirror 261 in front of the right eye RE and is emitted from the right light guide plate 26 toward the right eye RE.

[0042] As a structure for the left eye LE to see an image, the left display unit 24 has an OLED unit 241 that emits image light and a left optical system 252 that guides the image light L emitted by the OLED unit 241 to the left light guide plate 28.

[0043] The OLED unit 241 includes an OLED panel 243 and an OLED driving circuit 245 that drives the OLED panel 243. The OLED panel 243 is, for example, a self-emitting display panel configured with light-emitting elements that respectively emit red, green, and blue light. The OLED driving circuit 245 drives the OLED panel 243 under the control of the DP control unit 120. The OLED driving circuit 245 is, for example, mounted on a substrate (not shown) fixed to the back surface of the OLED panel 243, and on this substrate, there is mounted Figure 3 the temperature sensor 239 shown.

[0044] The left optical system 252 collimates the image light L emitted from the OLED panel 243 through a collimating lens to make it a parallel beam, and makes them incident on the left light guide plate 28. Inside the left light guide plate 28, the image light L is reflected by a plurality of reflecting surfaces, and is reflected by a half mirror 281 in front of the left eye LE and then emitted from the left light guide plate 28 toward the left eye LE.

[0045] The HMD 100 functions as a transmissive display device. That is, the image light L reflected by the half mirror 261 and the external light OL transmitted through the right light guide plate 26 are incident on the right eye RE of the user U. The image light L reflected by the half mirror 281 and the external light OL transmitted through the half mirror 281 are incident on the left eye LE. The HMD 100 causes the image light L of the image processed inside to be incident on the eyes of the user U overlapping with the external light OL. Therefore, the user U can see the external scene through the right light guide plate 26 and the left light guide plate 28, and can see the image based on the image light L overlapping with the external scene. The half mirrors 261 and 281 are image extraction parts that reflect the image light output by the right display part 22 and the left display part 24 respectively to extract the image, and constitute the display part.

[0046] 3. Control System of the HMD

[0047] Figure 3 is a block diagram of the display system 1, and particularly shows in detail the structure of the HMD 100.

[0048] In the image display unit 20, the right display unit 22 includes a right display unit substrate 210. Mounted on the right display unit substrate 210 are a right I / F unit 211 connected to the connection cable 40, a receiving unit 213 that receives data input from the connection device 10 via the right I / F unit 211, and an EEPROM 215. The right I / F unit 211 connects the receiving unit 213, the EEPROM 215, the temperature sensor 217, the DP external camera 61, the distance sensor 64, the DP illuminance sensor 65, and the LED indicator 67 to the connection device 10. The receiving unit 213 connects the OLED unit 221 to the connection device 10. The EEPROM is an abbreviation for Electrically Erasable Programmable Read-Only Memory. In addition, the receiving unit 213 is sometimes referred to as Rx213.

[0049] The left display unit 24 includes a left display unit substrate 230. Mounted on the left display unit substrate 230 are a left I / F unit 231 connected to the connection cable 40 and a receiving unit 233 that receives data input from the connection device 10 via the left I / F unit 231. The DP six-axis sensor 235 and the DP magnetic sensor 237 are mounted on the left display unit substrate 230.

[0050] The left I / F unit 231 connects the receiving unit 233, the DP six-axis sensor 235, the DP magnetic sensor 237, and the temperature sensor 239 to the connection device 10. The receiving unit 233 connects the OLED unit 241 to the connection device 10. Additionally, the left I / F unit 231 can also perform the same functions as the right I / F unit 211, that is, the left I / F unit 231 connects the receiving unit 213, the EEPROM 215, the temperature sensor 217, the DP external camera 61, the distance sensor 64, the DP illuminance sensor 65, and the LED indicator 67 to the connection device 10. In this case, the right I / F unit 211 connects the receiving unit 233, the DP six-axis sensor 235, the DP magnetic sensor 237, and the temperature sensor 239 to the connection device 10. Furthermore, the left I / F unit 231 can also connect the sensors and structures connected to the connection device 10 by the right I / F unit 211 instead of the right I / F unit 211. Hereinafter, the receiving unit 233 is sometimes referred to as Rx 233.

[0051] The EEPROM 215 stores various data non-volatilely. The EEPROM 215 stores, for example, data related to the light-emitting characteristics and display characteristics of the OLED units 221 and 241 included in the image display unit 20, data related to the characteristics of the sensors included in the right display unit 22 or the left display unit 24, and the like. Specifically, parameters related to the gamma correction of the OLED units 221 and 241, data for compensating the detection values of the temperature sensors 217 and 239, and the like are stored in a manner that can be read by the DP control unit 120.

[0052] The DP external camera 61 performs shooting in accordance with a signal input via the right I / F unit 211, and outputs the captured image data to the right I / F unit 211. The DP illuminance sensor 65 receives external light and outputs a detection value corresponding to the amount of received light or the intensity of received light. The LED indicator 67 lights up in accordance with a control signal or a drive current input via the right I / F unit 211.

[0053] The temperature sensor 217 detects the temperature of the OLED unit 221, and outputs a voltage value or a resistance value corresponding to the detected temperature as a detection value.

[0054] The distance sensor 64 outputs a signal indicating the detection result of the detected distance to the connection device 10 via the right I / F unit 211.

[0055] The receiving unit 213 receives the video data for display transmitted from the connection device 10 via the right I / F unit 211, and outputs it to the OLED unit 221. The OLED unit 221 displays an image based on the video data transmitted from the connection device 10.

[0056] The receiving unit 233 receives the video data for display transmitted from the connection device 10 via the left I / F unit 231, and outputs it to the OLED unit 241. The OLED units 221 and 241 display an image based on the video data transmitted from the connection device 10.

[0057] The DP six-axis sensor 235 is a motion sensor having a three-axis acceleration sensor and a three-axis gyro sensor. The DP magnetic sensor 237 is, for example, a three-axis geomagnetic sensor. The DP six-axis sensor 235 and the DP magnetic sensor 237 may be an IMU in which the above-described respective sensors are modularized, or a module in which the DP six-axis sensor 235 and the DP magnetic sensor 237 are integrated. IMU is an abbreviation for Inertial Measurement Unit. The temperature sensor 239 detects the temperature of the OLED unit 241. The DP six-axis sensor 235, the DP magnetic sensor 237, and the temperature sensor 239 respectively output detection values to the connection device 10.

[0058] Each part of the image display unit 20 operates using the power supplied from the connection device 10 via the connection cable 40. The image display unit 20 has a power supply unit 229 in the right display unit 22 and a power supply unit 249 in the left display unit 24. The power supply unit 229 distributes and supplies the power supplied from the connection device 10 via the connection cable 40 to each part of the right display unit 22 including the right display unit substrate 210. The power supply unit 249 distributes and supplies the power supplied from the connection device 10 via the connection cable 40 to each part of the left display unit 24 including the left display unit substrate 230. The power supply units 229 and 249 may also have a conversion circuit for converting the voltage, etc. The power supply units 229 and 249, together with the power supply control unit 126, correspond to the power supply unit.

[0059] The connection device 10 has an I / F unit 110, a DP control unit 120, a sensor control unit 122, a display control unit 124, a power supply control unit 126, a non-volatile storage unit 130, an operation unit 140, a connection unit 145, and a sound processing unit 147.

[0060] The I / F unit 110 has a connector 11D and an interface circuit that executes communication protocols based on various communication standards. The I / F unit 110 is, for example, an interface substrate on which the connector 11D and the interface circuit are mounted. The I / F unit 110 may have an external storage device, a memory card interface capable of connecting a storage medium, etc., or the I / F unit 110 may be constituted by a wireless communication interface.

[0061] The DP control unit 120 has a processor such as a CPU or a microcomputer, and controls each part of the connection device 10 by executing a program through this processor. The DP control unit 120 may also have a RAM that constitutes the work area of the processor. RAM is an abbreviation for Random Access Memory (random access memory).

[0062] Connected to the DP control unit 120 are a non-volatile storage unit 130, an operation unit 140, a connection unit 145, and a sound processing unit 147. The non-volatile storage unit 130 is a ROM that non-volatilely stores the programs and data executed by the DP control unit 120. ROM is an abbreviation for Read Only Memory (read-only memory). The non-volatile storage unit 130 stores device drivers including a display driver 135.

[0063] The sensor control unit 122 operates the sensor group included in the image display unit 20. The sensor group includes the DP outer camera 61, the distance sensor 64, the DP illuminance sensor 65, the temperature sensor 217, the DP six-axis sensor 235, the DP magnetic sensor 237, and the temperature sensor 239. The sensor control unit 122 sets and initializes the sampling periods of the respective sensors according to the control of the DP control unit 120, and performs energization of the respective sensors, transmission of control data, acquisition of detection values, etc. according to the sampling periods of the respective sensors.

[0064] The sensor control unit 122 outputs detection data indicating the detection values and detection results of the respective sensors to the I / F unit 110 at a preset timing. Here, the captured image data of the DP outer camera 61 is also referred to as detection data in the same way as the detection values and detection results of other sensors.

[0065] The sensor control unit 122 may also have an A / D converter that converts an analog signal into digital data. In this case, the sensor control unit 122 converts the analog signal of the detection value or detection result obtained from the sensor of the image display unit 20 into detection data and outputs it. The sensor control unit 122 may also obtain digital data of the detection value or detection result from the sensor of the image display unit 20, perform data format conversion, adjustment of output timing, etc., and output the detection data to the I / F unit 110.

[0066] Through the operation of the sensor control unit 122, the control device 300 connected to the I / F unit 110 can acquire the detection values of the respective sensors of the HMD 100 and the captured image data of the DP outer camera 61.

[0067] The sensor control unit 122 may output the result of arithmetic processing based on the detection values of the respective sensors described above as detection data. For example, the sensor control unit 122 may also collectively process the detection values or detection results of multiple sensors and function as a so-called sensor fusion processing unit. In this case, the sensor control unit 122 can generate detection data of a virtual sensor that is not included in the respective sensors of the image display unit 20 through sensor fusion. For example, the sensor control unit 122 may also output trajectory data indicating the trajectory of movement of the image display unit 20, coordinate data indicating the position of the image display unit 20 in a three-dimensional space, and direction data indicating the direction of the image display unit 20 as detection data. Here, the coordinate data may be data indicating relative coordinates based on the position of the connection device 10, or may be data indicating the position relative to a reference position set in the space where the image display unit 20 exists. The direction data may be data indicating the direction based on the position and direction of the connection device 10, or may be data indicating the direction relative to a reference position set in the space where the image display unit 20 exists.

[0068] The sensor control unit 122 executes a communication protocol with the control device 300 connected via the USB cable 46 and the connector 11D, and outputs detection data.

[0069] The display control unit 124 performs various processes for causing the image display unit 20 to display an image based on the video data or display data included in the reproduction signal input to the I / F unit 110. In the present embodiment, the video data is transmitted in the alternate mode of USB-TypeC through the connector 11D constituted by a USB-TypeC connector. The display control unit 124 performs various processes such as frame capture, resolution conversion, scaling, intermediate frame generation, and frame rate conversion, for example. The display control unit 124 outputs the video data corresponding to the OLED units 221 and 241 to the connection unit 145. The video data input to the connection unit 145 is transmitted as a video signal 201 from the connector 11A to the right I / F unit 211 and the left I / F unit 231. The display control unit 124 adjusts and changes the display state of the image display unit 20 in accordance with the display control data input to the I / F unit 110.

[0070] At least one of the sensor control unit 122 and the display control unit 124 may also be implemented by software in cooperation with hardware by a processor executing a program. That is, the sensor control unit 122 and the display control unit 124 are constituted by a processor, and perform the above-described operations by executing a program. In this example, the sensor control unit 122 and the display control unit 124 may also be implemented by a processor constituting the DP control unit 120 executing a program. In other words, the functions of the DP control unit 120, the display control unit 124, and the sensor control unit 122 may be realized by a processor executing a program. Here, the processor may be rephrased as a computer. The sensor control unit 122 and the display control unit 124 may have a working memory for data processing, or may use the memory of the DP control unit 120 for processing.

[0071] The display control unit 124 and the sensor control unit 122 may also be constituted by programmed hardware such as a DSP or an FPGA. The sensor control unit 122 and the display control unit 124 may be combined and configured as an SoC-FPGA. DSP is an abbreviation for Digital Signal Processor. FPGA is an abbreviation for Field Programmable Gate Array. SoC is an abbreviation for System-on-a-Chip.

[0072] The power control unit 126 is a circuit that is connected to the connector 11D and supplies power to each part of the connection device 10 and the image display unit 20 based on the power supplied from the connector 11D.

[0073] The power control unit 126, together with the power supply units 229 and 249, corresponds to the power supply unit.

[0074] The operation unit 140 detects the operation of a switch or the like provided in the connection device 10, and outputs data indicating the operation content to the DP control unit 120.

[0075] The sound processing unit 147 generates a sound signal according to the sound data input from the DP control unit 120. The sound data also includes the sound data included in the reproduction signal input from the control device 300. In addition, the sound processing unit 147 has an amplifier, amplifies the generated sound signal, and outputs it to the connection unit 145. The sound signal is output from the connection unit 145 to the right earphone 32 and the left earphone 34 via the audio connector 36. The sound processing unit 147 generates the sound data of the sound collected by the microphone 63 and outputs it to the DP control unit 120. Similar to the detection data of the sensor provided in the image display unit 20, the sound data output from the sound processing unit 147 can be processed by the sensor control unit 122.

[0076] 4. Structure of the control device

[0077] Figure 4 is a block diagram of the control device 300.

[0078] The control device 300 includes a CO control unit 310. The CO control unit 310 includes a processor 311, a memory 312, and a non-volatile memory 313. The processor 311 is composed of a CPU, a microcomputer, a DSP, etc., and controls each part of the control device 300 by executing a program. The memory 312 forms the working area of the processor 311. The non-volatile memory 313 is composed of a semiconductor storage function unit, etc., and stores the program executed by the processor 311 and various data processed by the processor 311 in a non-volatile manner. For example, the non-volatile memory 313 stores an operating system as a basic control program executed by the processor 311, and application programs operating on the operating system, etc. The non-volatile memory 313 stores the data and processing results processed during the execution of the application program. The CO control unit 310 may also be an SoC integrating the processor 311, the memory 312, and the non-volatile memory 313.

[0079] The CO control unit 310 is connected to the GNSS 321, CO camera 322, CO six-axis sensor 323, CO magnetic sensor 324, CO illuminance sensor 325, sound output unit 326, CO display unit 327, battery 329, communication unit 330, and I / F unit 331.

[0080] The GNSS 321 performs positioning using the satellite positioning system and outputs the position of the control device 300 to the CO control unit 310. GNSS is an abbreviation for Global Navigation Satellite System.

[0081] The CO camera 322 is a digital camera provided on the main body of the control device 300. For example, it is arranged adjacent to the touch panel 328 and captures the direction opposite to the touch panel 328. The CO camera 322 performs shooting according to the control of the CO control unit 310 and outputs the captured image data to the CO control unit 310.

[0082] The CO six-axis sensor 323 is a motion sensor having a three-axis acceleration sensor and a three-axis gyro sensor, and outputs detection data representing the detection value to the CO control unit 310. The CO magnetic sensor 324 is, for example, a three-axis geomagnetic sensor, and outputs detection data representing the detection value to the CO control unit 310. The CO six-axis sensor 323 and the CO magnetic sensor 324 may be an IMU in which the above-mentioned sensors are modularized, or a module in which the CO six-axis sensor 323 and the CO magnetic sensor 324 are integrated.

[0083] The CO illuminance sensor 325 receives external light and outputs detection data representing the detection value corresponding to the light reception amount or light reception intensity to the CO control unit 310.

[0084] The sound output unit 326 has a speaker and outputs sound from the speaker according to the control of the CO control unit 310. The sound output unit 326 may also have an amplifier that amplifies the sound signal output from the CO control unit 310 and outputs it to the speaker. When the CO control unit 310 is configured to output digital sound data, the sound output unit 326 may also have a D / A converter that converts the digital sound data into an analog sound signal.

[0085] The CO display unit 327 has a touch panel 328 and causes the touch panel 328 to display characters or images according to the control of the CO control unit 310.

[0086] The battery 329 is a secondary battery built into the main body of the control device 300, supplies power to each part of the control device 300, and supplies power to the connected HMD 100.

[0087] When the HMD 100 is connected to the I / F unit 331, the CO control unit 310 negotiates with the HMD 100 to determine the power supplied to the HMD 100. The negotiation is, for example, a process of setting the power role, setting the amount of power to be transferred, etc. The power role is a power source that serves as a power supply source or a power receiver that receives power from the power source.

[0088] The CO control unit 310 supplies the power determined through negotiation to the HMD 100 via the I / F unit 331.

[0089] The battery 329 and the CO control unit 310 correspond to the first supply unit.

[0090] The communication unit 330 corresponds to wireless communication protocols such as Bluetooth and Wi-Fi and performs wireless communication with external devices of the display system 1. Bluetooth and Wi-Fi are registered trademarks. The communication unit 330 may also be configured to perform mobile data communication using a mobile communication network such as LTE or the fifth-generation mobile communication system. LTE is a registered trademark.

[0091] The I / F unit 331 has a connector (not shown) for connecting a data communication cable and an interface circuit that performs communication protocols compliant with various communication standards using the connector. For example, the I / F unit 331 has a connector and an interface circuit compliant with the USB standard, and transmits and receives data through the USB cable 46 and supplies power to the HMD 100.

[0092] Content data is stored in the non-volatile memory 313.

[0093] The CO control unit 310 reproduces the content data and generates a reproduction signal including video and audio. The CO control unit 310 transmits the generated reproduction signal to the HMD 100 via the I / F unit 331.

[0094] 5. Reboot in the case where an abnormality is detected in the HMD 100

[0095] The DP control unit 120 performs an abnormality detection process of detecting an abnormality of devices included in the HMD 100 at every preset time. The target devices of the abnormality detection process include, for example, sensors such as a DP illuminance sensor 65, temperature sensors 217 and 239, a distance sensor 64, a DP six-axis sensor 235, and a DP geomagnetic sensor 239, a DP external camera 61, a sound processing unit 147, etc.

[0096] The DP control unit 120 determines whether it is possible to access a driver for driving a device and whether a value indicating an abnormality is written in a register in which a value indicating the state of the driver is written to perform the abnormality detection process.

[0097] In addition, when the target device for anomaly detection processing is a sensor, the DP control unit 120 determines whether the sensor value input from the sensor represents an abnormal value to detect anomalies in the device.

[0098] When the DP control unit 120 detects a device in which an anomaly has occurred, it determines whether the DP six-axis sensor 235 is included in the device in which the anomaly has been detected. Since the DP control unit 120 determines whether the image display unit 20 is worn on the head of the user U based on the sensor value of the DP six-axis sensor 235, if an anomaly occurs in the DP six-axis sensor 235, it is impossible to determine whether the image display unit 20 is worn on the head of the user U based on the sensor value of the DP six-axis sensor 235, and thus the subsequent device restart process is different. Therefore, the DP control unit 120 determines whether an anomaly has occurred in the DP six-axis sensor 235.

[0099] When the DP control unit 120 determines that the DP six-axis sensor 235 is not included in the device in which an anomaly has occurred, it determines whether the image display unit 20 is worn on the head of the user U based on the sensor value of the DP six-axis sensor 235.

[0100] When the sensor value input from the DP six-axis sensor 235 has not changed within a certain period of time, the DP control unit 120 determines that the image display unit 20 is not worn on the head of the user U. In addition, when the sensor value input from the DP six-axis sensor 235 has changed, the DP control unit 120 determines that the image display unit 20 is worn on the head of the user U.

[0101] When an anomaly is detected in the device, the DP control unit 120 restarts the driver program including the driver program of the device in which the anomaly has been detected. The DP control unit 120 has a first restart mode and a second restart mode as restart modes.

[0102] The first restart mode is a restart mode that is executed when the user U does not wear the image display unit 20 on the head.

[0103] The second restart mode is a restart mode that is executed when it is determined that the user U has worn the image display unit 20 on the head, or when an anomaly occurs in the DP six-axis sensor 235 and it is impossible to determine whether the image display unit 20 has been worn on the head of the user U.

[0104] When the DP control unit 120 executes the first restart mode, it restarts the device in which the anomaly has been detected and the display driver 135 in the first order. The first order is the order in which the display driver 135 is restarted after the device driver of the device in which the anomaly has been detected is restarted.

[0105] In addition, when the DP control unit 120 executes the second restart mode, it restarts the display driver 135 and the device that detected the abnormality in the second order. The second order is the order in which the device driver of the device that detected the abnormality is restarted after the display driver 135 is restarted.

[0106] When the DP control unit 120 executes the second restart mode, it may also determine whether an abnormality has occurred in the display driver 135, and if an abnormality has occurred in the display driver 135, it restarts the display driver 135. In addition, when the DP control unit 120 executes the second restart mode, it may also restart the display driver 135 without determining whether an abnormality has occurred in the display driver 135, and then restart the device driver of the device that detected the abnormality.

[0107] The image display unit 20 functions as a notification unit. The image display unit 20 includes a right display unit 22, a left display unit 24, and a sound output unit as functional units that perform notification actions. The sound output unit includes a sound processing unit 147, a right earphone 32, and a left earphone 34.

[0108] When the DP control unit 120 detects an abnormality in a device and executes the first restart mode, when the device with the abnormality is the sound output unit, first, the image display unit 20 displays a guidance display. In this guidance display, it includes guidance on the situation where an abnormality has occurred in the sound output unit and the situation where the sound output unit is restarted.

[0109] In addition, when the DP control unit 120 detects an abnormality in a device and the display driver 135 and executes the second restart mode, after restarting the display driver 135, it causes the image display unit 20 to display a guidance display. In addition, when the device with the abnormality is not the sound output unit, the DP control unit 120 may also output a sound guidance to the sound output unit and then restart the display driver 135.

[0110] Regarding the time required from when a device abnormality is detected until the display driver 135 is restarted, the second restart mode is shorter than the first restart mode. That is, when the first restart mode is executed, after restarting the driver of the device that detected the abnormality, the display driver 135 is restarted. In addition, when the second restart mode is executed, after restarting the display driver 135, the driver of the device that detected the abnormality is restarted. Therefore, regarding the time required from when a device abnormality is detected until the display driver 135 is restarted, the second restart mode is shorter than the first restart mode.

[0111] Figure 5 It is a flowchart showing the operation of the DP control unit 120.

[0112] Refer to Figure 5 the flowchart shown in Figure 5 to describe the operation of the DP control unit 120.

[0113] First, the DP control unit 120 determines whether a certain period of time has elapsed since the last abnormality detection process (step S1). When the DP control unit 120 determines that a certain period of time has not elapsed since the last abnormality detection process (step S1 / No), it stands by until a certain period of time has elapsed.

[0114] When the DP control unit 120 determines that a certain period of time has elapsed since the execution of the last abnormality detection process (step S1 / Yes), it executes an abnormality detection process for the device (step S2). The DP control unit 120 determines whether it is possible to access the driver that drives the device and whether an abnormality value is written in the register in which the value indicating the state of the driver is written to execute the abnormality detection process. Step S2 corresponds to the first detection step.

[0115] The DP control unit 120 determines whether an abnormality is detected by the abnormality detection process (step S3). When the DP control unit 120 determines that an abnormality is not detected by the abnormality detection process (step S3 / No), it returns to the determination in step S1.

[0116] In addition, when the DP control unit 120 detects an abnormality by the abnormality detection process (step S3 / Yes), it determines whether the DP six-axis sensor 235 is included in the device in which the abnormality is detected (step S4).

[0117] When the DP control unit 120 determines that the DP six-axis sensor 235 is included in the device in which the abnormality is detected (step S4 / Yes), it transfers to the process in step S6 and starts an abnormality detection process for the display driver 135 (step S6). In addition, when the DP control unit 120 determines that the DP six-axis sensor 235 is not included in the device in which the abnormality is detected (step S4 / No), it determines whether the sensor value input from the DP six-axis sensor 235 has changed (step S5). The determination in step S5 corresponds to the second detection step.

[0118] When the sensor values of the DP six-axis sensor 235 do not change (step S5 / No), the DP control unit 120 determines that the user U has not worn the image display unit 20 on the head. In this case, the DP control unit 120 executes the first restart mode. When executing the first restart mode, first, the DP control unit 120 restarts the driver of the device detected as abnormal in step S3 (step S11). Then, the DP control unit 120 performs the abnormality detection process of the display driver 135 (step S12). The DP control unit 120 determines whether the display driver 135 has an abnormality by determining whether it can access the display driver 135 and whether a value indicating an abnormality is written in the register storing the value indicating the state of the display driver 135. When the DP control unit 120 determines that the display driver 135 has not had an abnormality (step S13 / No), it returns to the determination in step S1. In addition, when the DP control unit 120 determines that the display driver 135 has had an abnormality (step S13 / Yes), it restarts the display driver 135 (step S14). Steps S11 to S14 correspond to the first restart step.

[0119] In addition, when the sensor values of the DP six-axis sensor 235 change (step S5 / Yes), the DP control unit 120 determines that the user U has worn the image display unit 20 on the head. In this case, the DP control unit 120 executes the second restart mode. When executing the second restart mode, first, the DP control unit 120 performs the abnormality detection process of the display driver 135 (step S6). The DP control unit 120 determines whether the display driver 135 has an abnormality by determining whether it can access the display driver 135 and whether a value indicating an abnormality is written in the register storing the value indicating the state of the display driver 135.

[0120] When the DP control unit 120 determines that the display driver 135 has had an abnormality (step S7 / Yes), it restarts the display driver 135 (step S8). After the DP control unit 120 restarts the display driver 135, it causes the image display unit 20 to display a guidance display (step S9). This guidance display includes information on the device detected as abnormal and the meaning of performing the recovery process from the abnormal state. The DP control unit 120 acquires the OSD data stored in the non-volatile storage unit 130 and displays the guidance display by causing the image display unit 20 to display the acquired OSD data.

[0121] After the DP control unit 120 displays the guidance display, it restarts the driver of the device detected as abnormal in step S3 (step S10). Steps S8, S9, and S10 correspond to the second restart step.

[0122] As described above, the HMD 100 of the present embodiment is an image display device worn on the head of the user U, and includes an image display unit 20, a DP six-axis sensor 235, and a DP control unit 120.

[0123] The image display unit 20 is worn on the head of the user U and includes a notification unit that notifies of a detected abnormality.

[0124] The DP control unit 120 operates as a first detection unit that detects an abnormality of the HMD 100.

[0125] The DP six-axis sensor 235 functions as a second detection unit that detects whether the image display unit 20 is worn on the head of the user U.

[0126] When the DP control unit 120 detects an abnormality of the HMD 100 without detecting that the image display unit 20 is worn on the head by the DP six-axis sensor 235, the DP control unit 120 restarts the HMD 100 in the first order. In addition, when the DP control unit 120 detects that the image display unit 20 is worn on the head by the DP six-axis sensor 235 and detects an abnormality of the HMD 100, the DP control unit 120 executes a second restart mode in which the HMD 100 is restarted in the second order.

[0127] In the second order, the order of restarting the display driver 135 that controls the image display unit 20 is set to be earlier than the order of restarting the display driver 135 in the first order.

[0128] Therefore, when the image display unit 20 is worn on the head of the user U, the timing at which the display driver 135 is restarted can be advanced, thereby reducing the delay in the timing of notifying the user U.

[0129] In addition, the time interval from the start of the second restart mode to the restart of the display driver 135 is shorter than the time interval from the start of the first restart mode to the restart of the display driver 135.

[0130] The timing at which the display driver 135 can be restarted can be advanced, thereby reducing the delay in the timing of notifying the user U.

[0131] When the DP control unit 120 detects an abnormality of the HMD 100, the DP control unit 120 determines whether an abnormality has occurred in the display driver 135. When it is determined that an abnormality has occurred in the display driver 135, the second restart mode is executed.

[0132] Therefore, when an abnormality has occurred in the display driver 135, the display driver 135 is preferentially restarted, thereby reducing the delay in the notification timing when notifying of an abnormality in the display of the image display unit 20.

[0133] The image display unit 20 includes a right display unit 22 and a left display unit 24 that display images visible to the user U, and a sound output unit that outputs sound as a notification unit. The sound output unit includes a sound processing unit 147, a right earphone 32, and a left earphone 34.

[0134] When the DP control unit 120 determines that an abnormality has occurred in the display driver 135, it notifies the occurrence of the abnormality through the sound output unit.

[0135] In addition, when the DP control unit 120 determines that an abnormality has occurred in the sound output unit, it notifies the occurrence of the abnormality through the display driver 135.

[0136] Therefore, since the notification is performed using the notification unit that has not generated an abnormality, it is possible to reduce the delay in the timing of notifying the user U.

[0137] When the DP control unit 120 determines that an abnormality has occurred in the display driver 135, it causes the display driver 135 to restart earlier than the sound output unit.

[0138] In addition, when the DP control unit 120 determines that an abnormality has occurred in the sound output unit, it causes the sound output unit to restart earlier than the display driver 135.

[0139] Therefore, it is possible to preferentially restart the display driver 135 or the sound output unit in which an abnormality is determined to have occurred.

[0140] The present invention is not limited to the structures described in the above embodiments, and can be implemented in various ways without departing from its gist.

[0141] For example, as an example of the image display device, the HMD 100 is illustrated, but the present invention is not limited thereto, and various image display devices can be adopted. For example, as the image display unit 20, an image display unit worn like a hat can be adopted, as long as it has a display unit that displays an image corresponding to the left eye of the user U and a display unit that displays an image corresponding to the right eye of the user U. In addition, the image display device of the present invention can be configured as, for example, a head-mounted display mounted on a vehicle or an aircraft. In addition, for example, it can also be configured as a head-mounted display built into a body protection device such as a helmet. In this case, it is possible to provide a part that locates the position relative to the user U's body and a part that locates the part as a wearing part.

[0142] The HMD 100 is an example of an image display device to which the present invention is applied, and is not limited to Figure 3The structures shown. For example, in the above-described embodiment, the structure in which the image display unit 20 and the connection device 10 are separated is described as an example, but the connection device 10 and the image display unit 20 may be integrally formed and worn on the head of the user U. In addition, the structure of the optical system of the image display unit 20 is arbitrary. For example, an optical component located in front of the eyes of the user U and overlapping a part or all of the field of view of the user U may be used. Alternatively, an optical system of a scanning type that forms image light by scanning laser light or the like may be adopted. Alternatively, not limited to guiding the image light inside the optical component, it may only have a function of refracting and / or reflecting the image light toward the eyes of the user U to guide it.

[0143] In addition, as the image display device, a liquid crystal monitor or a liquid crystal TV that displays an image on a liquid crystal display panel may also be adopted. A display device having a plasma display panel, a micro LED display panel, an inorganic EL display panel, a quantum dot light-emitting display panel, or an organic EL display panel may also be used. In this case, the display panel corresponds to the display unit of the present invention. Further, as the image display device, a projector that projects image light onto a screen or the like may also be used.

[0144] In addition, for example, in Figure 3 In the HMD 100 shown, the connection device 10 may also be configured by using a USB-TypeC connector, a USB-TypeC controller, and a USB hub. In this case, the DP external camera 61 and other sensors may also be connected to the USB hub. Further, as a controller that controls the display of the right display unit 22 and the left display unit 24 in the image display unit 20, an FPGA that outputs display data to the right display unit 22 and the left display unit 24 may be disposed on either the right display unit 22 or the left display unit 24. In this case, the connection device 10 may also have a bridge controller that connects the USB-TypeC controller and the FPGA. In addition, in the image display unit 20, a structure in which a DP six-axis sensor 235, a DP magnetic sensor 237, an EEPROM 215, etc. are mounted on the same substrate as the FPGA may also be adopted. The arrangement of other sensors may also be appropriately changed. For example, the distance sensor 64 and the DP illuminance sensor 65 may also be disposed at positions suitable for measurement or detection and configured to be connected to the FPGA and the USB-TypeC controller.

[0145] In addition, the specific specifications of the image display device including the OLED units 221 and 241 are not limited either. For example, the OLED units 221 and 241 may have a common structure.

[0146] Figure 3 、 Figure 4At least a part of each of the functional blocks shown can be implemented by hardware, or can be a structure implemented through the cooperation of hardware and software, and is not limited to a structure that configures independent hardware resources as shown in the figure.

[0147] In addition, Figure 5 The flowchart showing the processing of the HMD 100 is obtained by dividing it according to the main processing content in order to easily understand the processing of the DP control unit 120. The present invention is not limited by Figure 5 the division method or name of the processing units shown in the flowchart. In addition, the processing of the DP control unit 120 can be divided into more processing units according to the processing content, or can be divided into 1 processing unit including more processing. In addition, the processing order of the above flowchart is not limited to the example shown. For example, the step S1 of determining whether a certain time has elapsed since the last abnormality detection process, the step S2 of performing the abnormality detection process of the device, and the step S3 of determining whether an abnormality is detected by the abnormality detection process can also be omitted. That is, the DP control unit 120 does not periodically perform the process of detecting abnormalities on the devices possessed by the HMD 100, but when an abnormality occurs in the devices possessed by the HMD 100, it performs the step S4 of determining whether the DP six-axis sensor 235 is included in the device in which the abnormality has occurred.

[0148] In addition, when implementing the restart method of the display device using the computer possessed by the HMD 100, the program to be executed by the computer can also be configured in the form of a recording medium or a transmission medium for transmitting the program. As the recording medium, a magnetic, optical recording medium or a semiconductor storage function unit can be used. In addition, the above recording medium can also be a non-volatile storage device such as a RAM, a ROM, or an HDD, which is an internal storage device possessed by the server device.

[0149] In addition, as an example of the notification unit of the present embodiment, the right earphone 32 and the left earphone 34 are set as the sound processing unit 147, but the sound processing unit is not limited thereto. For example, instead of the right earphone 32 and the left earphone 34, a speaker can be used to guide the user US that an abnormality has occurred in the devices possessed by the HMD 100. In this case, the speaker is disposed on the front frame 27, the right holding portion 21, and the left holding portion 23.

Claims

1. An image display device is worn on the head of a user, and the image display device has: An informing unit having a display unit for displaying an image visible to the user, and informing of an abnormality detected in the image display device; A detection unit for detecting a situation where the image display device is worn on the head of the user; And A control unit that, when the wearing of the image display device is not detected but the abnormality in the image display device is detected, executes a first restart mode for restarting the image display device in a first order, and when the wearing of the image display device is detected and the abnormality in the image display device is detected, executes a second restart mode for restarting the image display device in a second order different from the first order, The control unit sets the order in which the informing unit is restarted in the second order to be earlier than the order in which the informing unit is restarted in the first order.

2. An image display device is worn on the head of a user, and the image display device has: An informing unit having a display unit for displaying an image visible to the user, and informing of an abnormality detected in the image display device; A detection unit for detecting a situation where the image display device is worn on the head of the user; And A control unit that, when the wearing of the image display device is not detected but the abnormality in the image display device is detected, executes a first restart mode for restarting the image display device in a first order, and when the wearing of the image display device is detected and the abnormality in the image display device is detected, executes a second restart mode for restarting the image display device in a second order different from the first order, The control unit sets the time interval from the execution of the second restart mode to the restart of the informing unit to be shorter than the time interval from the execution of the first restart mode to the restart of the informing unit.

3. The image display device according to claim 1 or 2, wherein The control unit, when detecting an abnormality in the image display device, determines whether an abnormality has occurred in the informing unit, The control unit executes the second restart mode when it is determined that an abnormality has occurred in the informing unit.

4. The image display device according to claim 1 or 2, wherein The informing unit has a sound output unit for outputting sound, The control unit, when it is determined that an abnormality has occurred in the display unit, causes the sound output unit to inform of the occurrence of the abnormality, and when it is determined that an abnormality has occurred in the sound output unit, causes the display unit to inform of the occurrence of the abnormality.

5. The image display device according to claim 4, wherein The control unit, when it is determined that an abnormality has occurred in the display unit, causes the display unit to restart earlier than the sound output unit, and when it is determined that an abnormality has occurred in the sound output unit, causes the sound output unit to restart earlier than the display unit.

6. A control method for an image display device, wherein An abnormality of an image display device worn on the head of a user is detected, Detect the situation where the image display device is worn on the head of the user. In the case where an abnormality of the image display device is detected but the wearing of the image display device is not detected, restart the image display device in the first order. In the case where an abnormality of the image display device is detected and the wearing of the image display device is detected, restart the image display device in the second order. Compared with the first order, the second order has an earlier restart order of the notification unit that displays the image seen by the user and notifies that an abnormality has occurred in the image display device.

7. A control method for an image display device, wherein detect an abnormality of an image display device worn on the head of a user, detect the situation where the image display device is worn on the head of the user, In the case where an abnormality of the image display device is detected but the wearing of the image display device is not detected, restart the image display device in the first order. In the case where an abnormality of the image display device is detected and the wearing of the image display device is detected, restart the image display device in the second order. Compared with the first order, the time interval until the restart of the notification unit is shorter, where the notification unit displays the image seen by the user and notifies that an abnormality has occurred in the image display device.

Images