Head mounted display and adjustment method thereof

Abstract

The head mounted display (100) involved in this embodiment includes: a main body (110) for generating a display image; a belt (120) configured to fix the main body (110) to the head of a user (U); a first sensor configured to detect the tightening strength of the belt (120); a storage unit (50) for storing settings related to the tightening strength of the belt (120); and a driving unit (40) for tightening the belt (120) according to the settings and the detection result of the first sensor.

Description

Technical Field

[0001] The present disclosure relates to a head mounted display and an adjustment method thereof. Background Art

[0002] In recent years, with the development of VR (virtual reality) content and the popularization of cheap devices, head-mounted displays (HMD) have gradually become something close to people. Users wear head-mounted displays on their heads and play content. In this way, users can easily experience themselves in another space.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2014-218236. Summary of the invention

[0006] However, when a user wears a head-mounted display, it is necessary to adjust the strap to fit the user's head, which is sometimes troublesome. When removing the head-mounted display from the head, the strap needs to be loosened. Therefore, when the same user repeatedly uses the same head-mounted display, it is necessary to adjust it each time it is worn. In addition, there are also products that fix the head-mounted display to the head with a rubber strap, etc., which sometimes require a certain degree of force to install and remove.

[0007] The present disclosure has been made in view of the above-mentioned problems, and an object of the present disclosure is to provide a head mounted display that can be worn easily and appropriately, and a method for adjusting the same.

[0008] Means used to solve problems

[0009] The head-mounted display involved in this embodiment includes: a main body that generates a display image; a strap that is configured to fix the main body to the user's head; a first sensor that is configured to detect the tightening strength of the strap; a storage unit that stores settings related to the tightening strength of the strap; and a drive unit that tightens the strap according to the settings and the detection result of the first sensor.

[0010] The method involved in this embodiment is a method for adjusting a head-mounted display, wherein the head-mounted display includes: a main body that generates a display image; a strap that is configured to fix the main body to the user's head; and a drive unit that tightens the strap, the method including the following steps: detecting the tightening strength of the strap; and the drive unit tightening the strap according to the tightening strength and a pre-stored setting.

[0011] Effects of the Invention

[0012] According to the present disclosure, an object is to provide a head mounted display that can be worn easily and appropriately, and a method for adjusting the same. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a schematic diagram showing a state in which a user wears a head mounted display.

[0014] Figure 2 : is a control block diagram showing the configuration of a head mounted display.

[0015] Figure 3 : is a flowchart showing an adjustment method when wearing a head mounted display.

[0016] Figure 4 : is a flowchart showing an adjustment method when wearing a head mounted display.

[0017] Figure 5 This is a diagram showing an example of a menu screen of a head mounted display.

[0018] Figure 6 is a flowchart showing control when an impact is detected.

[0019] Figure 7 This is a flowchart showing control when the head mounted display is removed. DETAILED DESCRIPTION

[0020] Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the accompanying drawings. However, the present disclosure is not limited to the following embodiments. In addition, the following description and drawings are appropriately simplified for the purpose of clarifying the description.

[0021] A head mounted display and an adjustment method thereof according to the present embodiment will be described with reference to the drawings. Figure 1 2 is a schematic diagram showing a state in which a user U wears the head mounted display 100 .

[0022] The head mounted display 100 can be applied to various purposes such as gaming, entertainment, industry, medical treatment, flight simulation, etc. The head mounted display 100 is, for example, a VR (Virtual Reality) head mounted display, an AR (Augmented Reality) head mounted display, or an MR (Mixed Reality) head mounted display. In addition, in the present embodiment, the head mounted display 100 is an optically transparent head mounted display for AR or MR, but may also be a non-transmissive head mounted display.

[0023] In order to clarify the description, the following uses the XYZ three-dimensional orthogonal coordinate system. Based on the user, the front-back direction (depth direction) is set as the Z direction, the left-right direction (horizontal direction) is set as the X direction, and the up-down direction (vertical direction) is set as the Y direction. The front direction is set as the +Z direction, the rear direction is set as the -Z direction, the right direction is set as the +X direction, the left direction is set as the -X direction, the upper direction is set as the +Y direction, and the lower direction is set as the -Y direction.

[0024] The head mounted display 100 includes a main body 110 and a band 120. The head mounted display 100 is worn so that the main body 110 contacts the face (front surface of the head) of the user U. The main body 110 is disposed on the front side of the head of the user U and generates a display image that the user U visually recognizes.

[0025] Specifically, the main body 110 includes a display unit described later and a frame that accommodates the display unit. For example, the main body 110 includes a flat panel display such as a liquid crystal monitor or an organic EL (Electro-Luminescence) monitor as the display unit. In addition, the main body 110 may have an optical element that generates a display image generated by the display unit as a virtual image in front of the user U. For example, the main body 110 accommodates a semi-transparent mirror or a concave mirror in the frame.

[0026] The main body 110 has a goggle shape or a glasses shape, and is worn on the head of the user U through the band 120. The head-mounted display 100 may be a binocular head-mounted display 100, a head-mounted display having a glasses shape, or a monocular head-mounted display. When the head-mounted display 100 is a see-through type such as a semi-transmissive type, the user U wearing the head-mounted display 100 can see the object 130 in front.

[0027] The belt 120 is attached to the main body 110 at both left and right sides of the main body 110. The belt 120 is wound from the left side of the head to the right side of the head through the back side of the head. Therefore, the head is arranged in a space surrounded by the belt 120 and the main body 110. In addition, the belt 120 can be wound from the right side of the head to the left side of the head through the back side of the head, or from the left side of the head to the back side of the head and from the right side of the head to the back side of the head.

[0028] The strap 120 is formed of an elastic material having elasticity such as rubber or resin. By tightening the strap 120, the user U can reliably wear the head mounted display 100. The user U can watch the reproduced content while the main body 110 is in close contact with the head of the user U. The length and installation position of the strap 120 can also be adjusted according to the size of the user's head and preference.

[0029] In this embodiment, the tightening force of the belt 120 can be adjusted. In other words, the tightening strength of the belt 120 is variable. Figure 2 A control system of the head mounted display 100 for making the fastening strength of the strap 120 variable will be described. Figure 2 2 is a control block diagram of the head mounted display 100 .

[0030] The head mounted display 100 includes a detection section 10, a control section 20, a display section 30, a drive section 40, a storage section 50, and an operation section 60. Each section is accommodated in a main body section 110, for example.

[0031] The detection unit 10 includes various sensors such as an optical sensor 11, a pressure sensor 12, and a motion sensor 13. The optical sensor 11 is, for example, a camera, and captures the eyes of the user U when wearing the head mounted display 100. Specifically, it is possible to detect whether the head mounted display 100 is properly worn based on the positions of the eyes in the captured image captured by the camera. The detection unit 10 can detect whether the head mounted display 100 is worn symmetrically based on the positions of the left eye and the right eye in the captured image.

[0032] The pressure sensor 12 is provided to detect the tightening strength applied to the band 120 when the head mounted display 100 is worn. For example, the pressure sensor 12 is provided on the contact surface of the head mounted display 100 with the head of the user U. When the head mounted display 100 is worn, the pressure sensor 12 detects the pressure applied from the head of the user U. Of course, the sensor for detecting the tightening strength is not limited to the pressure sensor 12. The tightening force can be detected using a force sensor that detects the tensile force (tightening force) of the band 120, a deformation sensor that detects the deformation generated in the band 120, or the like.

[0033] The motion sensor 13 detects the movement of the head mounted display 100. For example, an acceleration sensor, a magnetic sensor, a gyroscope, etc. can be used as the motion sensor 13. When the user U changes the head orientation, the orientation of the head mounted display 100 changes. The motion sensor 13 detects the movement of the head mounted display 100 based on the movement of the user U. Specifically, the change in the orientation (direction) and the change in the position of the head mounted display 100 are detected. The displayed image can also be changed according to the movement detected by the motion sensor 13.

[0034] The impact detection unit 14 detects whether an impact is applied to the head mounted display 100. For example, when an acceleration sensor provided on the head mounted display 100 detects an acceleration greater than a threshold value, the impact detection unit 14 detects that an impact is applied. In addition, an acceleration sensor for detecting an impact may also be used as the motion sensor 13.

[0035] The driving unit 40 has a motor and the like for tightening the belt 120. For example, by driving the driving unit 40 in a direction to stretch the belt 120, the tightening strength of the belt 120 can be increased. Alternatively, by driving the driving unit 40 in a direction to loosen the belt 120, the tightening strength of the belt 120 can be weakened. Alternatively, the driving unit 40 can also adjust the tightening strength by changing the length or installation position of the belt 120 as an elastic body. By driving the belt 120 by the driving unit 40, the tightening strength of the belt 120 can be changed. In addition, the driving unit 40 can also be located near the center of the back side of the head.

[0036] The storage unit 50 stores settings related to the tightening strength. The storage unit 50 is a non-volatile memory such as a flash memory. For example, the storage unit 50 stores the installation position of the belt 120 and the detection value of the pressure sensor 12 as setting values. In addition, the storage unit 50 can also save the length of the belt 120 and the like as settings. In the case where there are multiple users U using the head mounted display 100, the storage unit 50 can also store settings for each user U. The storage unit 50 can also store multiple settings that can be selected by the user. The storage unit 50 can store control programs, playback content, etc.

[0037] The operation unit 60 includes an input device for receiving an operation by the user U. The operation unit 60 includes, for example, a main body button or an external controller. The display unit 30, for example, reproduces a menu screen, content, etc. for operation. The display unit 30 may also include, for example, a liquid crystal display for generating an image for the left eye and a liquid crystal display for generating an image for the right eye.

[0038] The control unit 20 has a processor and the like for controlling each part. The control unit 20 is, for example, an MCU (MicroControl Unit). The control unit 20 performs various controls described below by executing a control program stored in the storage unit 50. In addition, image signals, control signals, and power are provided from the outside to the control unit 20. For example, image signals and the like are input to the control unit 20 via a wired connection such as HDMI (registered trademark) or a wireless connection such as WiFi (registered trademark) or Bluetooth (registered trademark). The head-mounted display 100 may also include an image generation unit (not shown) for generating an image signal, and an image signal and the like generated by the image generation unit may be input to the control unit 20. Then, the display unit 30 performs display according to the image signal.

[0039] use Figure 3 and Figure 4 The flow when the head mounted display 100 is worn will be described. Figure 3 , Figure 4 1 is a flowchart showing a method for adjusting the wearing state of the head mounted display 100 .

[0040] First, the head mounted display 100 is placed on the head of the user U ( S101 ). Next, a wearing operation of the head mounted display 100 is performed ( S102 ). The control unit 20 determines whether a wearing operation from a menu has been performed ( S103 ).

[0041] Figure 5 An example of a menu screen 200 displayed on the display unit 30 is shown. A wear button 201, a remove button 202, a register call button 203, and a current value register button 204 are displayed on the menu screen 200. For example, when the user U places the cursor on the wear button 201 and clicks it, the control unit 20 detects that a wearing operation has been performed.

[0042] When the wearing operation is performed from the menu (Yes in S103), the control unit 20 determines whether the setting is stored in the storage unit 50 (S104). When the setting is stored in the storage unit 50 (Yes in S104), the control unit 20 determines whether the stored setting is selected (S105).

[0043] For example, when performing automatic adjustment of the belt 120, the user U clicks the registration call button 203 of the menu screen 200. Thus, the setting pre-registered in the storage unit 50 is called. When multiple settings are registered, the display unit 30 displays an overview of the registered settings. Specifically, the display unit 30 displays a list of user names corresponding to the settings. The user U operates the operation unit 60 to select his own setting. Thus, the control unit 20 detects that the stored setting has been selected. Alternatively, a voice message may be output from a speaker or earphone to allow the user U to select a setting.

[0044] When the setting stored in the storage unit 50 is selected (Yes in S105), the drive unit 40 adjusts the belt 120 based on the stored setting (S106). The belt 120 is tightened by the drive unit 40, and the tightening strength of the belt 120 becomes the set value. That is, when the user U selects a setting suitable for himself, the control unit 20 drives the drive unit 40 according to the setting. The control unit 20 controls the drive unit 40 so that the detection value of the pressure sensor 12 becomes the set value.

[0045] When the wearing operation is not performed from the menu (No in S103), the drive unit 40 adjusts the belt 120 according to the information of the sensor (S107). When the setting is not stored in the storage unit 50 (No in S104), the drive unit 40 adjusts the belt 120 according to the information of the sensor (S107). When the setting stored in the storage unit 50 is not selected (No in S105), the drive unit 40 adjusts the belt 120 according to the information of the sensor (S107). In step S107, the belt 120 is adjusted based on the detection results of various sensors such as the pressure sensor 12. For example, the drive unit 40 tightens the belt 120 in such a way that the tightening strength of the belt 120 becomes the initial setting. Alternatively, the drive unit 40 may adjust the tightening strength using the setting of a person other than the user U who is to wear it.

[0046] Next, when the tightening strength becomes set, the optical sensor 11 detects the eyes of the user U (S108). The control unit 20 determines whether the wearing state of the head mounted display 100 is bilaterally symmetrical based on the position of the eyes (S109). For example, it is assumed that the optical sensor 11 is a camera arranged in the center of the left-right direction. The control unit 20 determines whether the positions of the left and right eyes in the captured image taken by the camera are bilaterally symmetrical. Specifically, when the distances from the left and right ends of the image to the left and right eyes are equal, it becomes bilaterally symmetrical. That is, when the distance from the left end of the image to the left eye is consistent with the distance from the right end of the image to the right eye, the control unit 20 determines that the wearing state is bilaterally symmetrical. In addition, the control unit 20 can also determine the left-right symmetry based on whether the left eye and the right eye are arranged horizontally in the captured image.

[0047] In addition, the control unit 20 can also determine the symmetry of the upper and lower parts. For example, the optical sensor 11 detects the position of the eyes in the height direction. That is, the optical sensor 11 detects the relative height of the left eye and the right eye relative to the head-mounted display 100. And if the height of the left and right eyes is a specified height, the control unit 20 determines that they are symmetrical in the upper and lower parts. If the height of the left and right eyes deviates from the specified height, the control unit 20 determines that they are not symmetrical in the upper and lower parts. The control unit 20 calculates the number of pixels in the vertical direction representing the distance from the upper end of the captured image to the center position of the eye and the distance from the lower end of the captured image to the center position of the eye. And the control unit 20 can detect the height of the left and right eyes based on these pixel numbers.

[0048] When the wearing state of the head mounted display 100 is not bilaterally symmetrical (No in S109), the driving unit 40 loosens the belt 120 and urges the user U to wear it again. Therefore, the process returns to step S103, and the head mounted display 100 adjusts the belt 120 again. When the wearing state of the head mounted display 100 is bilaterally symmetrical (Yes in S109), the display unit 30 displays that the wearing of the head mounted display 100 has been completed (S110). Of course, the head mounted display 100 is not limited to the display of the display unit 30, and the wearing completion can also be notified through a sound message. In addition, after the wearing of the head mounted display 100 is completed, the user U can manually adjust the length of the belt 120, etc. Alternatively, when the wearing state of the head mounted display 100 is symmetrical, the driving unit 40 can also be driven in a manner of tightening the belt. In this way, the head mounted display 100 can be reliably maintained in an appropriate wearing position.

[0049] As described above, the drive unit 40 adjusts the tightening strength of the belt 120. In addition, the user U can then manually adjust the belt 120. For example, the user U can manually adjust the length of the belt 120 after step S110. When the user U manually adjusts, the tightening strength of the belt 120 deviates from the setting. Therefore, the control unit 20 determines whether the current tightening strength is different from any of the stored settings (S111). For example, the control unit 20 determines whether the detection value of the pressure sensor 12 is consistent with any of the registered setting values.

[0050] If the current tightening strength of the band 120 is not different from any of the stored settings (No in S111), the process ends. That is, since the setting value and the detected value are consistent, the head mounted display 100 can be worn with the setting suitable for the user U. Therefore, the head mounted display 100 can reproduce content for the user U in an appropriate wearing state.

[0051] If the current tightening strength of the belt 120 is different from any of the stored settings (Yes in S111), the user U is asked whether to store the current tightening strength (S112). That is, the user U is asked whether to store the new setting value in the storage unit 50. The display unit 30 displays a message or a "Yes / No" button to ask whether to store the current tightening strength.

[0052] The control unit 20 determines whether storage is selected (S113). For example, the user U can select whether to store by operating the operation unit 60. In the case where storage is selected (Yes in S113), the storage unit 50 stores the current tightening strength (S114). That is, the user U operates the operation unit 60. Figure 5In the menu screen 200 of FIG. 11 , the current value registration button 204 is clicked. As a result, the current detection value of the pressure sensor 12 and the position or length of the belt 120 are written into the storage unit 50. The processing ends in this way. In addition, if the storage is not selected (No in S113), the storage unit 50 does not store the current tightening strength (S115). The processing ends in this way.

[0053] By the above-mentioned adjustment method, the head mounted display 100 can be worn with the setting suitable for each user U. Since the driving unit 40 tightens the belt 120, it is possible to avoid complicated wearing. The user U can wear the head mounted display 100 simply and appropriately. Even if the user U repeatedly removes and puts on the head mounted display 100, it can be worn with a fixed tightening strength.

[0054] In this way, the control unit 20 detects the left and right or up and down positions of the left and right eyes relative to the head mounted display 100 based on the captured image. The control unit 20 determines whether at least one of the left and right or up and down is symmetrical with respect to the left and right eyes of the user U. In the case of symmetry, the control unit 20 drives the drive unit 40 to tighten the belt 120. In addition, with respect to the left and right eyes of the user U, it is determined whether at least one of the left and right or up and down is symmetrical. In the case of asymmetry, the control unit 20 drives the drive unit 40 to loosen the belt 120. As a result, the user U can wear it with an appropriate tightening strength. That is, the user U can reliably wear the head mounted display 100 in a holding state. The user U can visually recognize the display image displayed in the appropriate wearing state. In addition, when the symmetry of both the left and right and up and down is determined, the control unit 20 may also determine that it is symmetrical when the left and right are symmetrical and the up and down are symmetrical. In other words, when the symmetry of both the left and right and up and down is determined, the control unit 20 may also determine that it is asymmetrical when the left and right are asymmetrical or the up and down are asymmetrical.

[0055] Furthermore, the user U can register settings suitable for himself / herself in the storage unit 50. Therefore, when a plurality of users U use the head mounted display 100, each user U can wear the head mounted display 100 easily and appropriately.

[0056] Next, use Figure 6 The flow when the impact detection unit 14 detects an impact is described. First, the impact detection unit 14 detects an impact (S201). For example, when the acceleration detected by the acceleration sensor exceeds a threshold value, the impact detection unit 14 detects an impact. When an impact is detected, the drive unit 40 loosens the belt 120 (S202). As a result, the head mounted display 100 is detached from the head of the user U.

[0057] For example, when the user U falls and an impact is applied, a large acceleration is generated. Therefore, the impact can be detected based on the acceleration. When an impact is applied, the head mounted display 100 is quickly removed. Therefore, danger can be avoided.

[0058] Next, use Figure 7 The flow when the user U removes the head mounted display 100 will be described. Figure 7 This is a flowchart showing control during removal.

[0059] First, the user U performs a removal operation (S301). For example, in order to perform the removal operation, the user U Figure 5 The user U clicks the removal button 202 in the menu screen shown. Then, the control unit 20 performs removal confirmation (S302). For example, the display unit 30 displays a message or a "yes / no" button to inquire the user U whether to remove the head mounted display 100.

[0060] Then, the control unit 20 determines whether the removal is decided (S303). When the user U decides to remove (Yes in S303), the removal is performed (S304). That is, when the user U clicks the Yes button, the drive unit 40 loosens the belt 120. In this way, the head-mounted display 100 can be removed. When the user U does not decide to remove (No in S303), it returns to the original action (S305). When the user U clicks the No button, the drive unit 40 maintains the setting. While the drive unit 40 maintains the tightening strength, the content is reproduced, etc. In this way, the tightening strength can be fixed until the user U decides to remove. Therefore, the appropriate wearing state can be maintained.

[0061] The invention completed by the present inventors has been specifically described above based on the embodiments, but the present invention is not limited to the above embodiments, and various modifications can be made without departing from the gist of the invention. Two or more of the above embodiments can also be appropriately combined.

[0062] This application claims the benefit of priority based on Japanese patent application No. 2020-205656, filed on December 11, 2020, the disclosure of which is incorporated herein in its entirety.

[0063] Explanation of symbols

[0064] 100 Head-mounted display

[0065] 110 Main body

[0066] 120 belt

[0067] 10. Inspection Department

[0068] 11 Optical Sensor

[0069] 12. Pressure sensor

[0070] 13 Motion Sensor

[0071] 14 Impact detection unit

[0072] 20 Control Department

[0073] 30 Display unit

[0074] 40 Drive unit

[0075] 50 Storage

[0076] 60 Operation Department

Claims

1. A head mounted display, comprising: A main body portion, generating a display image; a strap configured to secure the main body portion to a user's head; a first sensor configured to detect a tightening strength of the belt; a storage unit storing settings related to the tightening strength of the belt; a driving unit for tightening the belt according to the setting and the detection result of the first sensor; as well as an impact detection unit configured to detect an impact applied to the head mounted display, When the impact is applied, the driving portion loosens the belt.

2. The head mounted display according to claim 1, wherein: The storage unit stores a plurality of settings that can be selected by the user, The driving portion tightens the belt so that the tightening strength detected by the first sensor reaches a setting selected by the user.

3. The head mounted display according to claim 1 or 2, wherein: Also included is a second sensor, the second sensor detecting the user's eyes, The device further includes a control unit configured to control the drive unit according to the positions of the left and right eyes detected by the second sensor.

4. The head mounted display according to claim 3, wherein: After the user performs the setting related to the tightening strength and the driving unit tightens the belt, The control unit determines whether the positions of the left and right eyes of the user are symmetrical in at least one of left and right or top and bottom, and drives the drive unit to loosen the belt if the positions are not symmetrical.

5. The head mounted display according to claim 3, wherein: After the user has made the setting related to the tightening strength, The control unit determines whether the positions of the left and right eyes of the user are symmetrical in at least one of left and right or top and bottom, and drives the drive unit to tighten the belt when the positions are symmetrical.

6. The head mounted display according to claim 4, wherein: After the user has made the setting related to the tightening strength, The control unit determines whether the positions of the left and right eyes of the user are symmetrical in at least one of left and right or top and bottom, and drives the drive unit to tighten the belt when the positions are symmetrical.

7. A method for adjusting a head mounted display, the head mounted display comprising: A main body portion, generating a display image; a strap configured to secure the main body portion to a user's head; and a driving unit to tighten the belt, the method comprising the following steps: detecting the fastening strength of the belt; The driving unit tightens the belt according to the tightening strength and a pre-stored setting; detecting an impact applied to the head mounted display; and When the impact is applied, the driving portion loosens the belt.

Images