Display device, control method for display device, program

Abstract

To provide a display device that enables proper automatic IPD adjustment. [Solution] A display device having a main body with a display unit for displaying an image, and a holding part for positioning the main body in front of the user's head, includes a determination means for determining the position of the user's hands, an image acquisition means for acquiring an eyeball image captured of the user's eyes, and a position adjustment means for moving the display unit based on the eyeball image. The position adjustment means does not move the display unit if it is determined that the position of the hands is a specific position.

Description

Technical Field

[0001] The present invention relates to a display device that can be arranged on a user's head, a control method for the display device, and a program.

Background Art

[0002] Some head-mounted displays (HMDs) have a device that automatically adjusts the optical axes of the left and right display displays and the viewing optical system for observing the display displays according to the user's eye width (distance between pupils). In addition, the position of the display display may be manually adjusted by the user in some HMDs. The adjustment of the position of the display display and the like is called so-called IPD (Interpupillary Distance) adjustment.

[0003] Patent Document 1 describes a method of acquiring the distance between the user's pupils when detecting the stationary state of the HMD by a gyro sensor. Patent Document 2 describes a configuration in which the position of the display display can be adjusted while the user confirms an image of his or her own eyeball by displaying an image of the captured eyeball on the display display.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in Patent Document 1, the completion of HMD mounting is determined when the stationary state of the HMD is determined by the gyro sensor. Therefore, it is possible that the HMD mounting may not actually be complete. Even when applying the technology described in Patent Document 2 to automatic IPD adjustment, it is possible that the HMD mounting may not be complete during automatic IPD adjustment. If automatic IPD adjustment starts while the HMD is not fully mounted, there is a possibility that the display unit may unintentionally hit the user's hand, or that the control system may try to force the movement while the user is holding the display unit, which could cause the HMD to malfunction.

[0006] Therefore, the present invention aims to provide a display device that enables appropriate automatic IPD adjustment. [Means for solving the problem]

[0007] One aspect of the present invention is, A display device comprising a main body having a display unit for displaying images, and a holding part for positioning the main body in front of the user's head, The determination means for determining the position of the user's hand, Image acquisition means for acquiring an eyeball image of the user's eye, A position adjustment means for moving the display unit based on the aforementioned eyeball image, It has, The position adjustment means, when it is determined that the hand is in a specific position, does not move the display unit. This is a display device characterized by the following features.

[0008] One aspect of the present invention is, A control method for a display device having a main body having a display unit for displaying an image, and a holding part for positioning the main body in front of the user's head, The determination step of determining the position of the user's hand, Image acquisition step: Obtain an eyeball image by capturing the user's eye, A position adjustment step of moving the display unit based on the eyeball image, It has, In the position adjustment step, if it is determined that the hand is in a specific position, the display unit is not moved. This is a control method for a display device characterized by the following features. [Effects of the Invention]

[0009] According to the present invention, a display device that enables appropriate automatic IPD adjustment can be provided. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram illustrating the appearance of the HMD according to Embodiment 1. [Figure 2] This is a diagram illustrating the external appearance of the HMD body according to Embodiment 1. [Figure 3] This diagram illustrates the details of the configuration of the HMD according to Embodiment 1. [Figure 4] This is a flowchart of the process for automatic IPD adjustment according to Embodiment 1. [Figure 5] This is a flowchart of the automatic IPD adjustment process according to Embodiment 2. [Figure 6] This is a flowchart of the process for automatic IPD adjustment according to Embodiment 3. [Modes for carrying out the invention]

[0011] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0012] <Embodiment 1> Hereinafter, the HMD1, which is a display device according to Embodiment 1, will be described. The HMD1 can realize so-called Mixed Reality (hereinafter abbreviated as MR) by superimposing and displaying CG on the real space that the user is looking at. The HMD1 according to Embodiment 1 can be used in the head-mounted style shown in FIG. 1A (a style in which the HMD1 is used with the main body fixed in front of the user's eyes by a holding mechanism). The HMD1 according to Embodiment 1 can also be used in the handheld style shown in FIG. 1B (a style in which the user holds the holding part by hand and pulls the main body in front of the eyes to use the HMD1).

[0013] Regardless of whether it is a head-mounted style or a handheld style, the HMD1 has an HMD main body 101 (main body part) and a connecting part 102. Further, the HMD1 has a holding part (mounting part 103 or handle 105) for arranging the HMD main body 101 (main body part) in front of the user's head.

[0014] In order to realize MR, the HMD main body 101 has a pair of external observation cameras 104 on the left and right. The external observation cameras 104 image a range (the range of the real space) including an angle of view corresponding to the visual fields of the user's left and right eyes respectively. The external observation cameras 104 acquire distance information of objects existing in the environment where the user is located by stereo ranging. The external observation cameras 104 calculate from which position and in which direction the user is observing in the real space. After rendering an arbitrary CG based on the user's position and orientation, when the captured image acquired by the external observation cameras 104 and the image of the CG are synthesized, the user can realize an MR experience in which the real space and the CG are fused.

[0015] In the head-mounted style shown in FIG. 1A, the HMD1 has a mounting part 103 that is worn around the user's head to fix the HMD main body 101 in front of the user's eyes. The mounting part 103 is connected to the HMD main body 101 via the connecting part 102.

[0016] On the other hand, in the handheld style shown in Figure 1B, the handle 105 is connected to the HMD body 101 via a connecting part 102. Grip sensors 106 are located on the handle 105 at positions where the user is expected to grip it with both hands. The grip sensors 106 include touch sensors, proximity sensors, or buttons. The grip sensors 106 can individually detect (identify) whether the user is gripping the handle 105 with each of their left and right hands.

[0017] In this way, the user can choose which of the two styles to use by deciding whether to connect the mounting part 103 or the handle 105 to the connecting part 102.

[0018] Figures 2A and 2B show the external view of the HMD body 101 as seen from the user's side. The HMD body 101 includes a right-side display unit 107, a left-side display unit 108, a stepping motor 110, and a proximity sensor 111.

[0019] The right-side display unit 107 displays an image for the right eye, and the left-side display unit 108 displays an image for the left eye. The right-side display unit 107 includes a display panel 109 and an eyepiece (not shown) which is a display optical system. The horizontal position of the right-side display unit 107 can be changed by drive, as shown in Figures 2A and 2B. On the other hand, if the center line of the HMD body 101 is defined by the dashed line in Figures 2A and 2B, the left-side display unit 108 is configured symmetrically with respect to this center line. The horizontal position of the left-side display unit 108 can be changed in the same way as the right-side display unit 107.

[0020] Figure 2A shows the HMD body 101 with the right display unit 107 and the left display unit 108 moved to their outermost positions (driven). Figure 2B shows the HMD body 101 with the right display unit 107 and the left display unit 108 moved to their innermost positions (driven).

[0021] Figure 2C shows a diagram of the configuration around the right-side display unit 107. The stepping motor 110 is a position adjustment unit that adjusts the position of the right-side display unit 107, which includes the eyepiece optical system and the display panel 109. The right-side display unit 107 can be moved (driven) left and right (horizontally) by the stepping motor 110. The left-side display unit 108 is configured similarly to the right-side display unit 107. The positions of the right-side display unit 107 and the left-side display unit 108 can be controlled independently.

[0022] Here, let Xr be the distance from the center line of the HMD body 101 to the optical axis center of the right display unit 107, and let Xl be the distance from the center line of the HMD body 101 to the optical axis center of the left display unit 108. Then, the ranges of distances Xr and Xl can be defined as the range between the minimum value X_min and the maximum value X_max, respectively, as follows. X_min≦Xr≦X_max X_min ≤ Xl ≤ X_max

[0023] The smaller the minimum value X_min and the larger the maximum value X_max, the wider the IPD adjustment range becomes, allowing it to accommodate a wider range of users. However, this increases the space required for the drive mechanism, making the HMD1 larger. On the other hand, the distribution of interpupillary distance in adults is somewhat fixed. For this reason, for example, in Embodiment 1, assuming a user with an interpupillary distance in the range of 51 to 77 mm, the minimum value X_min is set to 25.5 mm and the maximum value X_max to 38.5 mm.

[0024] The proximity sensor 111 can detect when the user's face is close (close to a predetermined distance Th1) without contact. This allows the proximity sensor 111 to determine whether or not the user is looking into the eyepiece (HMD body 101).

[0025] Figure 3A is a detailed view of the eyepiece sections of the right-hand display unit 107 and the left-hand display unit 108. As shown in Figure 3A, in the right-hand display unit 107, the eyeball observation camera 112 is positioned at the lower left of the eyepiece (the 8 o'clock position). In the left-hand display unit 108, the eyeball observation camera 112 is positioned at the lower right of the eyepiece (the 4 o'clock position). The eyeball observation camera 112 is an image acquisition unit that acquires an eyeball image captured from the eyeball.

[0026] In automatic IPD adjustment, the user's pupil position is detected based on the image (eyeball image) acquired by the eyeball observation camera 112. Based on the pupil position, the target drive position for each display unit (right display unit 107 and left display unit 108) is determined. Then, each display unit is driven according to the target drive position. Specifically, the drive amount is calculated based on information such as "the current pupil position in the eyeball image," "the expected pupil position in the eyeball image if the IPD is correctly adjusted," and "the correlation (sensitivity) between the drive amount of the display unit and the pupil position in the eyeball image." Then, the stepping motor 110 drives each display unit according to the drive amount, thereby achieving automatic IPD adjustment.

[0027] Next, the process of automatic IPD adjustment according to Embodiment 1 will be described with reference to the flowchart in Figure 4. In the following, as shown in Figure 3B, the control unit 301 (such as a processor) included in the HMD main unit 101 executes the processing of each step according to the program stored in the memory unit 302.

[0028] In step S401, the control unit 301 refers to the output (measured value) from the proximity sensor 111 to determine whether or not the user is looking at the HMD body 101 (eyepiece). Therefore, in step S401, the control unit 301 operates as an eyepiece detection unit that detects the user's eye. Specifically, the control unit 301 detects eye contact with the HMD body 101 (eyepiece) when the user's eye and the eyepiece come within a predetermined distance Th1. If it is determined that the user is looking at the HMD body 101 (eye contact is detected), the process proceeds to step S402. If it is determined that the user is not looking at the HMD body 101 (eye contact is not detected), the process in step S401 is repeated.

[0029] In step S402, the control unit 301 determines whether the user's hand is separated from the HMD body 101. If it is determined that the user's hand is separated from the HMD body 101, the process proceeds to step S403. If it is determined that the user's hand is not separated from the HMD body 101, the process in step S402 is repeated. Here, the term "hand" in Embodiment 1 is not limited to the user's palm, but may include at least a part of any part of the user's upper arm, from the upper arm to the fingertips, and from the shoulder onward.

[0030] For example, if the field of view of the external observation camera 104 is very wide, the user's hand will be captured in the image. The control unit 301 can determine the position of the hand from the image captured by the external observation camera 104, and therefore can calculate the distance between the HMD body 101 and the hand. If the calculated distance is greater than a predetermined distance Th2, the control unit 301 can determine whether the user's hand is away from the HMD body 101. Also, if the HMD 1 is in a handheld style, the grip sensor 106 can determine whether the hand is away from the HMD body 101 by checking whether both hands are gripping the handle.

[0031] In step S402, based on the position of the user's hands, the user puts on the HMD1. It is sufficient to determine whether the process is finished or not. For example, if the user's hands are included in the field of view of the external observation camera 104, it is highly likely that the user is still preparing to put on the HMD1. Therefore, instead of determining whether the user's hands are separated from the HMD body 101, it may be necessary to determine whether the position of the user's hands is such that they are not included in the field of view of the external observation camera 104.

[0032] In step S403, the control unit 301 controls the eyeball observation camera 112 and the stepping motor 110 to start automatic IPD adjustment. Specifically, the eyeball observation camera 112 detects the user's pupil position based on the eyeball image captured of the user's eye. The stepping motor 110 moves each display unit based on the detected pupil position.

[0033] Once step S403 is completed, the control unit 301 starts the normal operation of the HMD1. This allows the user to begin experiencing MR or other applications using the HMD1.

[0034] In step S401, the control unit 301 detects the eyepiece by referring to the output of the proximity sensor 111, but the eyepiece may also be detected by detecting the user's eye from the eyeball image of the eyeball observation camera 112.

[0035] Thus, before a user can begin using the HMD1, IPD adjustment is necessary to move the left and right display units to a position that matches the user's eye distance. If automatic IPD adjustment starts before the HMD1 is fully fitted, the display units may unintentionally hit the user's hands, or the system may try to force the movement of the display units while the user is holding them. This could potentially cause the HMD1 to malfunction. Furthermore, if automatic IPD adjustment is performed while the HMD1 is still being fitted, the likelihood of the adjusted position being incorrect increases.

[0036] Therefore, in Embodiment 1, automatic IPD adjustment is performed when eye contact with the HMD1 is detected and it is determined that the user's hands have been removed from the HMD body 101. As a result, automatic IPD adjustment is performed when there is a high probability that the HMD1 has been properly fitted, enabling more accurate automatic IPD adjustment.

[0037] <Embodiment 2> In Embodiment 1, the HMD1 performs automatic IPD adjustment regardless of the usage style, such as head-mounted style or handheld style. In Embodiment 2, the HMD1 switches the start conditions for automatic IPD adjustment according to the current usage style. The appearance and configuration of the HMD1 in Embodiment 2 are the same as in Embodiment 1, so a separate description is omitted. In Embodiment 2, the control unit 301 also operates as a style determination unit that determines whether the user is using the HMD1 in head-mounted style or handheld style.

[0038] The process of automatic IPD adjustment according to Embodiment 2 will be explained with reference to the flowchart in Figure 5. In the flowchart in Figure 5, steps with the same names as those in the flowchart in Figure 4 are processed in the same way, so a detailed explanation will be omitted.

[0039] In step S401, the control unit 301 refers to the output from the proximity sensor 111 to determine whether the user is looking at the HMD body 101. If it is determined that the user is looking at the HMD body 101, the process proceeds to step S501. If it is determined that the user is not looking at the HMD body 101, the process in step S401 is repeated.

[0040] In step S501, the control unit 301 allows the user to switch between head-mounted and hand-mounted styles. Determine which of the Lud Styles usage modes the HMD1 is being used in.

[0041] For example, the control unit 301 determines that the HMD1 is being used in a head-mounted style if the mounting unit 103 is visible in the image captured by the external observation camera 104. The control unit 301 determines that the HMD1 is being used in a handheld style if the handle 105 is visible in the image. Alternatively, the control unit 301 may determine the usage style of the HMD1 according to the user's selection on a software-prepared menu screen. Furthermore, the control unit 301 may determine the usage style of the HMD1 depending on the presence or absence of a signal generated from the grip sensor 106. Alternatively, if there is a physical (mechanical) difference between the mounting unit 103 and the handle 105, the control unit 301 may determine the usage style based on the configuration connected to the coupling unit 102.

[0042] For example, the connecting portion 102 may be provided with two physical switches (push buttons), A and B, such that "when fitted with the mounting portion 103, only switch A is pressed, and when fitted with the handle 105, only switch B is pressed." In other words, the usage style of the HMD1 may be determined depending on whether switch A or B is pressed.

[0043] Here, if it is determined in step S501 that the HMD1 is being used in a head-mounted style, the process proceeds to step S402. In this case, the processes in steps S402 and S403 are then performed. In this way, in the head-mounted style, as in Embodiment 1, automatic IPD adjustment is performed when both conditions are met: the HMD body 101 is being looked at by the user and the user's hands are away from the HMD body 101.

[0044] On the other hand, if it is determined that the HMD1 is being used in handheld mode, the process proceeds to step S403. In this case, unlike the example in Figure 4, the conditions for starting automatic IPD adjustment are simplified. This is because, in handheld mode, the user naturally grasps the handle 105, and it is unlikely that they would directly grasp the left and right display units. For this reason, step S402 (the process of determining that the user's hands have left the HMD body 101) is omitted, and automatic IPD adjustment in step S403 is performed based solely on eyepiece detection, and normal operation begins. Note that if automatic IPD adjustment is performed immediately after eyepiece detection, it may be adjusted to an incorrect position. Therefore, automatic IPD adjustment may be performed in step S403 "after a predetermined time has elapsed since eyepiece detection" or "after the position of the user's pupil detected by the eyeball observation camera 112 has stabilized for a predetermined time or longer."

[0045] Thus, in Embodiment 2, the conditions for performing automatic IPD adjustment differ depending on whether the HMD1 is being used in a head-mounted style or a handheld style. Therefore, for each usage style, automatic IPD adjustment is performed when the HMD1 is most likely to have been properly fitted, enabling more accurate automatic IPD adjustment.

[0046] <Embodiment 3> In Embodiment 2, the conditions for starting automatic IPD adjustment are switched depending on the usage style of the HMD1. On the other hand, Embodiment 3 shows an example in which automatic IPD adjustment is performed during normal operation after startup, rather than at startup, in handheld style. The appearance and configuration of the HMD1 in Embodiment 3 are the same as in Embodiment 1, so a separate description is omitted.

[0047] As a premise, it is conceivable that while a user is using the HMD1 to experience MR, they may perform various operations such as selecting menus using hand gestures, rather than using a dedicated remote control. Hand gestures could include, for example, "pinching with the thumb and index finger." A hand gesture such as "make" or "extending only the index finger and pointing it in a specific direction" is pre-associated with a specific command. When the external observation camera 104 detects a hand gesture, the command is executed according to the detected hand gesture.

[0048] In handheld mode, when performing hand gestures, the handle 105 is temporarily held with one hand, which may cause the display unit's position to shift when the hand is released from the handle 105. Therefore, the following describes the process by which automatic IPD adjustment is performed when a change in how the handle 105 is held is detected. Note that changes from two-handed and one-handed holding can be detected by the grip sensor 106.

[0049] Referring to the flowchart in Figure 6, the process of automatic IPD adjustment according to Embodiment 3 will be explained. The control unit 301 (processor, etc.) included in the HMD body 101 executes the processing of each step according to the program stored in the memory unit 302. In Embodiment 3, the control unit 301 also operates as a holding determination unit that determines the change between the state in which the handle 105 (HMD1) is held with one hand and the state in which the handle 105 is held with both hands.

[0050] In step S601, the control unit 301 determines whether the state in which the handle 105 is held has changed from being held with one hand to being held with both hands. If it is determined that the state in which the handle 105 is held has changed from being held with one hand to being held with both hands, the process proceeds to step S605. If it is determined that the state in which the handle 105 is held has not changed from being held with one hand to being held with both hands, the process proceeds to step S602.

[0051] In step S602, the control unit 301 determines whether the state in which the handle 105 is held has changed from being held with both hands to being held with one hand. If it is determined that the state in which the handle 105 is held has changed from being held with both hands to being held with one hand, the process proceeds to step S605. If it is determined that the state in which the handle 105 is held has not changed from being held with both hands to being held with one hand, the process proceeds to step S603.

[0052] In step S603, the control unit 301 determines whether or not the user has performed a power-off operation. If it is determined that the power-off operation has been performed, the process proceeds to step S604. If it is determined that the power-off operation has not been performed, the process proceeds to step S601.

[0053] In step S604, the control unit 301 turns off the power to the HMD1 and terminates the operation of the HMD1.

[0054] In step S605, the control unit 301 performs automatic IPD adjustment, similar to step S403. Therefore, if the control unit 301 determines in steps S601 and S602 that the way the handle 105 is held has changed, it performs automatic IPD adjustment in step S605.

[0055] Furthermore, changes in how the handle 105 is held may be detected based on the detection results of the handle 105 and the user's hand in the image captured by the external observation camera 104.

[0056] According to Embodiment 3, automatic IPD adjustment is performed when the relative position between each display unit and the eyeball may change due to a change in how the handle 105 (HMD1) is held. Therefore, it becomes possible to perform automatic IPD adjustment at the appropriate time when IPD adjustment is needed.

[0057] <Example 1> Furthermore, the user may be able to initiate automatic IPD adjustment spontaneously through a dedicated hand gesture or by operating a button (not shown) located on the HMD unit 101. When instructing the user to initiate automatic IPD adjustment, they perform a hand gesture or button operation corresponding to the automatic IPD adjustment start command with the hand that is not holding the handle 105.

[0058] For example, suppose after switching from a two-handed grip to a one-handed grip to issue a command to start automatic IPD adjustment, a hand gesture or button operation corresponding to the command is performed. In this case, it would be desirable for the automatic IPD adjustment to be performed when it is detected that the grip has returned to two hands and the position of the display unit has stabilized. "The timing when the position of the display unit has stabilized" means, for example, "the timing when the position of the display unit remains within a range of a specific size (for example, a range of 1 cm horizontally) for a predetermined period of time."

[0059] Furthermore, in the above, "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2" may be rephrased as "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2." Conversely, "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2" may be rephrased as "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2." Therefore, as long as no contradiction arises, "greater than or equal to A" may be rephrased as "greater than (higher; longer; more) than A," and "less than or equal to A" may be rephrased as "less than (lower; shorter; fewer) than A." And "greater than (higher; longer; more) than A" may be rephrased as "greater than or equal to A," and "less than (lower; shorter; fewer) than A" may be rephrased as "less than or equal to A."

[0060] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0061] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0062] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0063] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0064] The above-disclosed embodiments include the following configurations, methods, and programs. (Composition 1) A display device comprising a main body having a display unit for displaying images, and a holding part for positioning the main body in front of the user's head, The determination means for determining the position of the user's hand, Image acquisition means for acquiring an eyeball image of the user's eye, A position adjustment means for moving the display unit based on the aforementioned eyeball image, It has, The position adjustment means, when it is determined that the hand is in a specific position, does not move the display unit. A display device characterized by the following features. (Configuration 2) The case in which the hand position is determined to be the specific position is when it is determined that the hand is not separated from the main body. The display device according to configuration 1, characterized by the above. (Composition 3) When the hand and the main body are closer than the first distance, it is determined that the hand is not separated from the main body. The display device according to configuration 2, characterized in that... (Composition 4) The system further includes eye-contact detection means for detecting eye contact with the display device when the user's eye is closer than a second distance. The position adjustment means does not move the display unit if the eyepiece is not detected. A display device according to any one of configurations 1 to 3, characterized by the above. (Composition 5) The eyepiece detection means detects the eyepiece based on the output from the proximity sensor or the eyeball image. The display device according to configuration 4, characterized by the features described above. (Composition 6) The hand includes at least one of the parts of the user's body from the shoulder to the fingertips. A display device according to any one of configurations 1 to 5, characterized by the above. (Composition 7) The device can be used in either of the following styles: 1) a first style in which the user uses the display device with the main body fixed in front of the user's eyes by the holding part, and 2) a second style in which the user uses the display device by holding the holding part with their hand and pulling it closer to their eyes. A display device according to any one of configurations 1 to 6, characterized by the above. (Composition 8) The position adjustment means is In the first style described above, if the position of the hand is determined to be the specific position, the display unit is not moved. In the second style described above, even if the position of the hand is determined to be the specific position, if certain conditions are met, the display unit is moved. The display device according to configuration 7, characterized by the features described above. (Composition 9) The system includes a style determination means for determining whether the display device is being used in the first style or the second style, The position adjustment means switches the condition for not moving the display unit depending on whether the display device is used in the first style or in the second style. The display device according to configuration 7 or 8, characterized by the above. (Composition 10) In the second style described above, the holding part has a grip sensor capable of identifying that the user is gripping the holding part, The style determination means determines, based on the presence or absence of a signal generated by the grip sensor, whether the display device is being used in the first style or the second style. The display device according to configuration 9, characterized by the features described therein. (Composition 11) The grip sensor has one of the following: proximity sensor, touch sensor, or button. The display device according to configuration 10, characterized by the above. (Composition 12) The style determination means determines whether the display device is being used in the first style or the second style, based on at least one of the following: an image captured from real space, the content selected by the user, and whether or not a physical switch on the display device is pressed. A display device according to any one of configurations 9 to 11, characterized by the features described herein. (Composition 13) In the second style described above, the device has a holding determination means for determining whether the user is holding the display device with one hand or with both hands. A display device according to any one of configurations 9 to 12, characterized by the above. (Composition 14) When the style determination means determines that the display device is being used in the second style, the position adjustment means adjusts the position adjustment means. 1) When eye contact with the display device is detected, 2) When the holding determination means determines that the user has changed from holding the display device with both hands to holding it with one hand, and 3) If the holding determination means determines that the user has changed from holding the display device with one hand to holding it with both hands, In at least one of the cases, the display unit is moved based on the eyeball image. The display device according to configuration 13, characterized by the above. (Composition 15) In the second style described above, if the user is holding the display device with one hand and the user performs a gesture or operation to move the display unit, The display device according to configuration 13 or 14, characterized in that the position adjustment means moves the display unit based on the eyeball image when the holding determination means determines that the user has changed to a state in which the user is holding the display device with both hands, and the position of the display unit remains within a range of a specific size for a predetermined time. (method) A control method for a display device having a main body having a display unit for displaying an image, and a holding part for positioning the main body in front of the user's head, The determination step of determining the position of the user's hand, Image acquisition step: Obtain an eyeball image by capturing the user's eye, A position adjustment step of moving the display unit based on the eyeball image, It has, In the position adjustment step, if it is determined that the hand is in a specific position, the display unit is not moved. A method for controlling a display device, characterized by the features described above. (program) A program for causing a computer to function as one of the means of a display device described in any of configurations 1 to 15. [Explanation of Symbols]

[0065] 1: HMD (display unit), 101: HMD main unit, 103: Mounting part, 105: Handle, 107: Right-side display unit, 108: Left-side display unit, 110: Stepping motor, 112: Eyeball observation camera, 301: Control Unit

Claims

1. A display device comprising a main body having a display unit for displaying images, and a holding part for positioning the main body in front of the user's head, The determination means for determining the position of the user's hand, Image acquisition means for acquiring an eyeball image of the user's eye, A position adjustment means for moving the display unit based on the aforementioned eyeball image, It has, The position adjustment means, when it is determined that the hand is in a specific position, does not move the display unit. A display device characterized by the following features.

2. The case in which the hand position is determined to be the specific position is when it is determined that the hand is not separated from the main body. The display device according to feature 1.

3. When the hand and the main body are closer than the first distance, it is determined that the hand is not separated from the main body. The display device according to feature 2.

4. The system further includes eye-contact detection means for detecting eye contact with the display device when the user's eye is closer than a second distance. The position adjustment means does not move the display unit if the eyepiece is not detected. The display device according to feature 1.

5. The eyepiece detection means detects the eyepiece based on the output from the proximity sensor or the eyeball image. The display device according to feature 4.

6. The hand includes at least one of the parts of the user's body from the shoulder to the fingertips. The display device according to feature 1.

7. The device can be used in either of the following styles: 1) a first style in which the user uses the display device with the main body fixed in front of the user's eyes by the holding part, and 2) a second style in which the user uses the display device by holding the holding part with their hand and pulling it closer to their eyes. The display device according to feature 1.

8. The position adjustment means is In the first style described above, if the position of the hand is determined to be the specific position described above, the display unit is not moved. In the second style described above, even if the position of the hand is determined to be the specific position, if certain conditions are met, the display unit is moved. The display device according to feature 7.

9. The system includes a style determination means for determining whether the display device is being used in the first style or the second style, The position adjustment means is used when the display device is used in the first style, and before The conditions for not moving the display unit are switched depending on whether the display device is used in the second style described above. The display device according to feature 7.

10. In the second style described above, the holding part has a grip sensor capable of identifying that the user is gripping the holding part, The style determination means determines, based on the presence or absence of a signal generated by the grip sensor, whether the display device is being used in the first style or the second style. The display device according to feature 9.

11. The grip sensor has one of the following: proximity sensor, touch sensor, or button. The display device according to feature 10.

12. The style determination means determines whether the display device is being used in the first style or the second style, based on at least one of the following: an image captured from real space, the content selected by the user, and whether or not a physical switch on the display device is pressed. The display device according to feature 9.

13. In the second style described above, the device has a holding determination means for determining whether the user is holding the display device with one hand or with both hands. The display device according to feature 9.

14. When the style determination means determines that the display device is being used in the second style, the position adjustment means adjusts the position adjustment means. 1) When eye contact with the display device is detected, 2) When the holding determination means determines that the user has changed from holding the display device with both hands to holding it with one hand, and 3) If the holding determination means determines that the user has changed from holding the display device with one hand to holding it with both hands, In at least one of the cases, the display unit is moved based on the eyeball image. The display device according to feature 13.

15. In the second style described above, if the user is holding the display device with one hand and the user performs a gesture or operation to move the display unit, The display device according to claim 13, wherein the position adjustment means is moved based on the eyeball image when the state in which the display device is held with both hands is determined by the holding determination means, and the state in which the position of the display unit remains within a range of a specific size for a predetermined time.

16. A control method for a display device having a main body having a display unit for displaying an image, and a holding part for positioning the main body in front of the user's head, The determination step of determining the position of the user's hand, Image acquisition step: Obtain an eyeball image by capturing the user's eye, A position adjustment step of moving the display unit based on the eyeball image, It has, In the position adjustment step, if it is determined that the hand is in a specific position, the display unit is not moved. A method for controlling a display device, characterized by the features described above.

17. A program for causing a computer to function as one of the means of a display device according to any one of claims 1 to 15.

Images