Control device, control method, and program

Abstract

To allow a user to move a direction of a display main body with respect to a wearing part of a head-mounted display with input means not using the hands and to ensure the user's field of view without using the hands.SOLUTION: A control device for controlling an information processing apparatus having a display unit, comprises: an acquisition unit that acquires motion information based on sensing data obtained by a sensor and indicating a motion of a user using the information processing apparatus; and a drive control unit that controls the operation of a driving unit switching a position of the display unit of the information processing apparatus between the front of the user's field of view and outside the user's field of view. When predetermined motion information is acquired by the acquisition unit, the drive control unit switches the position of the display unit.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a control device, a control method, and a program. [Background technology]

[0002] Conventionally, there exists a configuration in which a part of the mechanism of a head mounted display is driven according to the direction of the line of sight. For example, the following Patent Document 1 discloses a mechanism that selectively captures a high-quality image of an area that a user is focusing on, and adjusts the direction of an image capture unit according to the line of sight in order to achieve both low-load processing and the provision of a high-quality image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-004274 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology disclosed in the above-mentioned Patent Document 1, although the part that the user wants to see is configured to look at in high quality depending on the usage state of the user, it does not meet the need to directly view what is in front of the eyes. The image quality of the captured image is not yet comparable to that of direct viewing, and degradation due to passing through an optical system is unavoidable in principle, so a configuration that allows direct viewing of what is in front of the eyes is desired. When directly viewing what is in front of the eyes, the user needs to hold the head-mounted display in his / her hand and operate it, and flip it up or remove the device. However, there may be situations where it is not desirable to perform the flip-up operation using the hand. For example, if a user is performing a work verification while holding a tool in his / her hand, it is expected that the tool will have to be placed somewhere once, making the work complicated. In addition, it is also expected that touching the head-mounted display during the flip-up operation will cause the head-mounted display to shift its mounting position after flipping down, making it difficult to properly experience XR.

[0005] Therefore, an object of the present invention is to enable a user to change the orientation of a display body relative to a mounting part of a head-mounted display by using an input means without using hands, thereby ensuring the user's field of vision without using their hands. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, according to one aspect of the present invention, there is provided a control device that controls an information processing device having a display unit, the control device comprising: an acquisition unit that acquires operation information indicating the operation of a user using the information processing device based on sensing data obtained by a sensor; and a drive control unit that controls the operation of a drive unit that switches the position of the display unit of the information processing device between in front of the user's field of view and outside the field of view, wherein the drive control unit switches the position of the display unit when specified operation information is acquired by the acquisition unit. Effect of the Invention

[0007] As described above, according to the present invention, it is possible to change the orientation of the display body relative to the mounting part of the head-mounted display by using an input means without using hands, thereby enabling the user to ensure their field of vision without using their hands. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an external perspective view of a head mounted display 100 according to an embodiment of the present invention. [Diagram 2] FIG. 2 is an explanatory diagram for explaining an example of a functional configuration of a control box 302. [Diagram 3] FIG. 1 is a diagram showing a state in which a display body 101 according to an embodiment of the present invention is attached to a user's head by a mounting part 301. [Figure 4] Schematic diagram of the display body 101 and the mounting part 301 connected by the connecting mechanism unit 206. [Diagram 5]1 is a schematic diagram of a display optical system 103 and its surroundings according to an embodiment of the present invention; [Figure 6] An example of a command when the direction of the line of sight detected by the line of sight detection means 104 is used as a command for a drive start signal of the drive means. [Figure 7] An example of a command when the head tilt detected by the posture detection means 105 is used as a command for a drive start signal for the drive means. [Figure 8] Example of a command when using a pointer position using a controller as a command for a drive start signal for a drive means [Figure 9] The driving means is composed of a stepping motor 2051 and a torsion coil spring 2052. [Figure 10] Configuration example in which the driving means is shared with the IPD adjustment motor 209 of the IPD adjustment mechanism DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0010] (First embodiment) FIG. 1 is a perspective view showing the appearance of a head mounted display 100 according to an embodiment of the present invention.

[0011] FIG. 1(a) is an external perspective view of a head mounted display 100 as viewed from the subject side. The head mounted display 100 is an example of an information processing device having a display unit. As shown in FIG. 1(a), the head mounted display 100 has a display body 101 and a mounting unit 301. The display body 101 is a body that includes a display panel 102 (described later) and an eyepiece lens 103 that is a display optical system, and can provide an XR (Extended Reality) experience to a user. The XR system here includes VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality).

[0012] An orientation detection camera 105 and a background image camera 106 are arranged on the left and right sides in front of the display main body 101. The orientation detection camera 105 detects the orientation of the display main body 101 and aligns the drawing position of the CG image viewed by the user through the eyepiece lens 103 with the surrounding image that becomes the background. The orientation detection camera 105 is also used as an orientation detection means that enables command input according to the user's orientation, as will be described later. The background image camera 106 plays the role of the eyes in the video see-through image, and captures an image that becomes the background image of the parts that are not CG images.

[0013] The wearing unit 301 is an attachment member for fixing the display main body 101 in front of the user's eyes by wearing it on the head like a headband. Since it is sufficient to fix the display main body 101 in front of the eyes, this form is not limited to a headband type, and it may be a helmet type that covers the entire upper head, or a glasses type that hangs on the ears. In addition, as a handheld form, it may be configured such that the user holds the handle-shaped wearing unit 301 in his / her hand and holds the display main body 101 in front of the eyes. This allows the user to easily experience XR without the trouble of wearing it on the head.

[0014] The connecting means is a connecting mechanism unit 206 that connects the display body 101 and the mounting part 301. As described later, a drive shaft for the display body 101 is arranged in the connecting mechanism unit 206, and the display body 101 and the mounting part 301 can change their relative positional relationship by rotating around the drive shaft. Such a mechanism is called a tilt mechanism. Alternatively, a slider that drives the display body 101 in the vertical direction relative to the mounting part 301 may be arranged in the connecting mechanism unit 206, and the relative positional relationship between the display body 101 and the mounting part 301 may be changed along the slider. In any case, in this embodiment, the user is configured to be able to adjust the position of the display body 101 relative to the mounting part 301 that is worn on the user's head or held in the hand between in front of the user's field of view and outside the field of view. This allows the user to adjust the position of the display body 101 to a position in front of the user's eyes that is appropriate for observation, or to appropriately retract the display body 101 to visually check the scene in front of the user's eyes rather than a video image.

[0015] The head mounted display 100 according to this embodiment is connected to a control box 302, which is a device that controls the position of the display main body 101. An example of the functional configuration of the control box 302 will be described below with reference to FIG.

[0016] FIG. 2 is an explanatory diagram for explaining an example of a functional configuration of the control box 302. The control box 302 is a control device that performs various controls of the head mounted display 100. For example, the control box 302 is a device that controls the position of the display main body 101. The control box 302 is also a device that controls the background image captured by the camera 106 and the CG image displayed on the display panel 102. The control box 302 includes a communication unit 310, a storage unit 320, and a control unit 330. More specifically, the control box 302 includes the storage unit 310 (also called a memory) that includes a command storage means (to be described later) and a control unit 330 (also called a CPU) that includes the functions of a determination means and a control means.

[0017] The control box 302 also includes a communication unit 320 that performs various communications with the head mounted display 100. The control box 302 is communicatively connected to the display body 101 via a connection cable 303. The control box 302 may be connected to the display body 101 via a wireless device, and in this form, the user can operate the display body 101 without being bothered by the connection cable 303.

[0018] Moreover, the control unit 330 according to this embodiment performs control to switch the position of the display main body 101. The control unit 330 includes a detection unit 331, an instruction receiving unit 333, and a drive control unit 335, as shown in FIG.

[0019] The detection unit 331 is an example of an acquisition unit, and detects motion information indicating a motion of a user using the head mounted display 100 based on sensing data obtained by a sensor. The sensor here may be a sensor mounted on the head mounted display 100, or a sensor mounted on a linked device (for example, a controller or an external camera) connected to the head mounted display 100. The sensor according to this embodiment is not particularly limited as long as it can obtain sensing data capable of detecting a user's motion, but in consideration of user convenience, it is preferable that the sensor is capable of obtaining sensing data in a non-contact manner. A specific example of the process will be described later.

[0020] The instruction receiving unit 333 receives instructions relating to the operation of a stepping motor 2051 (drive unit) described later. A specific example of the process will be described later.

[0021] The drive control unit 335 controls the operation of a drive unit (for example, a stepping motor 2051 described later) that switches the position of the display main body 101 of the head mounted display 100 between in front of the user's field of view and outside the field of view. For example, the drive control unit 335 switches the position of the display main body 101 when a predetermined operation is detected by the detection unit 331. A specific example of the process will be described later.

[0022] An example of the functional configuration of the control box 302 has been described above. Note that each function of the memory and CPU mounted in the control box 302 may be implemented as an application in a general PC. Furthermore, the command storage means, determination means, and control means may be functions mounted in the memory and CPU mounted on a board in the display main body 101. In this case, the user can experience XR using only the display main body 101, and the complexity of handling the control box 302 and connection cable 303 during the experience can be reduced.

[0023] 1(b) is a perspective view of the exterior of the display body 101 as seen from the user side. The display optical system is an eyepiece 103 that allows the user to observe an image on the display panel 102.

[0024] The user can have a suitable XR experience by observing the image captured by the background image camera 106 and the CG image displayed on the display panel 102 through the eyepiece 103. As described later, a gaze detection camera 104, which is a gaze detection means, is arranged behind the eyepiece 103. The gaze detection camera 104 captures an image of the user's eyes through the eyepiece 103 and acquires gaze information on where the user's gaze is directed. This makes it possible to input commands according to the direction (movement) of the user's gaze, as described later. The microphone 108 is a device for acquiring the user's voice. This allows the user to, for example, leave a work record in the form of voice, or to control by voice commands, as described later. The gaze detection camera 104 and the microphone 108 are examples of sensors.

[0025] FIG. 3 is a diagram showing a state in which the display body 101 according to the embodiment of the present invention is attached to the user's head by the attachment unit 301. FIG. 3(a) shows a state in which the display body 101 is in front of the user's eyes (i.e., in front of the field of vision), and at this time, the user can experience XR. FIG. 3(b) shows a state in which the display body 101 has moved relative to the attachment unit 301 through the connection with the coupling mechanism unit 206. In other words, FIG. 3(b) shows a state in which the display body 101 is outside the field of vision of the user, and at this time, the user can check the surrounding situation and things in front of the user without the display body 101 blocking the field of vision. In the present invention, the state of FIG. 3(b) is referred to as a flip-up state, and the change from the state of FIG. 3(a) to the state of FIG. 3(b) is referred to as flipping up, flip-up drive, etc. The state in FIG. 3(a) is the wearing state that enables the user to properly experience XR, but in the present invention, this state is referred to as the flip-down state corresponding to the flip-up state, and driving from the state in FIG. 3(b) to the state in FIG. 3(a) is sometimes referred to as flip-down drive.

[0026] FIG. 4 is a schematic diagram of the display body 101 and the mounting part 301 connected by the connecting mechanism unit 206. The stepping motor 2051 is an example of a driving means, and is an actuator disposed in the connecting mechanism unit 206, which drives the relative position of the display body 101 with respect to the mounting part 301. The stepping motor 2051 is an example of a driving part, and is controlled by the drive control part 335, and can drive the display body 101 to an appropriate position with respect to the mounting part 301. Here, by flipping up the display body 101 by the stepping motor 2051, the user can flip up the display body 101 without using his / her hands, and can directly view the surroundings without being obstructed by the display body 101 in front of his / her eyes. This makes it unnecessary to carry out a complicated task of putting down a tool held somewhere to manually flip up the display body 101 during work using a tool, and simplifies the work.

[0027] In this case, there may be cases where the display body 101 may come into contact with an obstacle during flip-up operation, such as when working in a narrow space. In such cases, it may be useful to temporarily stop this function in order to prevent the display body 101 from coming into contact with an obstacle by automatically flipping up the display body 101 as in this embodiment.

[0028] Therefore, in this embodiment, the instruction receiving unit 333 is mounted on the control unit 330 (CPU), and the control means in the CPU may switch on and off the flip-up drive by the user's instruction input operation. This makes it possible to prevent unintentional automatic flip-up in an environment where this function is inappropriate. As another method, it is useful to configure the device to check for the presence or absence of an obstacle before flip-up drive.

[0029] For example, it is possible to detect the subject that is being photographed by both of the background image camera 106 and the attitude detection camera 105, and to detect the subject distance from each camera based on the baseline length of the binocular cameras and the parallax of the subject. This makes it possible to stop the drive control and not flip up when it is determined that there is an obstacle in the drive path, or to reduce the amount of flip up so that the drive is stopped just before the collision.

[0030] To drive the stepping motor 2051, which is a driving means, the control means mounted on the CPU receives some kind of signal input when starting drive control. In this embodiment, the signal pattern is called a command, and when the input command matches a command stored in the memory, which is the command storage means, the CPU 305 starts driving the stepping motor 2051. Note that the command here is an example of a predetermined operation.

[0031] Furthermore, the storage unit 310 (memory) may store trigger information including a command that is a drive start signal. Then, the drive control unit 335 may switch the position of the display main body 101 when a command (predetermined operation information) included in the trigger information stored in the storage unit 310 is acquired (detected) by the detection unit 331. Examples of such drive start signals include command input by gaze, command input by voice, command input by the main body attitude, and command input by a hand controller. These will be described below.

[0032] 5 is a schematic diagram of the display optical system (eyepiece 103) and its periphery according to an embodiment of the present invention. As described above, display panel 102 is a display unit that displays an image captured by background image camera 106 and a CG image, and the user observes the image displayed on display panel 102 through eyepiece 103, which is a display optical system. Lens housing 107 is a housing part that holds eyepiece 103 and display panel 102. The gaze detection means is gaze detection camera 104 that detects the direction of the user's gaze.

[0033] The light projecting means is an LED 108 for projecting appropriate infrared light onto the area around the user's eye when observing the area around the eye using the line of sight detection means. Here, in this embodiment, both the light projection by the LED 108 and the observation of the eyeball by the line of sight detection camera 104 are configured with an optical path passing through the lens of the eyepiece 103, thereby realizing a reduction in the lens diameter of the eyepiece 103. Regarding this configuration, if there is a space outside the eyepiece 103 in the radial direction, it is also possible to configure the observation without passing through the eyepiece 103, for example by arranging the line of sight detection camera 104 outside the eyepiece 103. This makes it possible to observe the eye while suppressing optical distortion and image degradation caused by passing through the eyepiece 103.

[0034] 6 shows an example of a command for a drive start signal for a drive means when the gaze direction detected by gaze detection camera 104 is used. Note that, although a specific example of a command including multiple user actions will be described below, the command does not necessarily have to include multiple user actions.

[0035] The visual field range 401 indicates the observation range when the display panel 102 is viewed through the eyepiece lens 103. The gaze pointer 402 is an index indicating where the user's gaze is in the visual field range 401, that is, where the user is looking in the visual field range 401, as coordinates calculated from the gaze direction. This may be displayed on the display panel 102 in a form that can be visually recognized by the user, or may be configured to be held as information by the head mounted display 100 in a form that can be determined by a determination means in the CPU without being visually recognized by the user. The area 403 surrounded by a dashed line is an area used for determining the gaze direction when it is used as a command. For the multiple determination areas, a command is input depending on the order in which the gaze entered which determination area, and the determination means in the CPU determines whether it is the same as the command stored in the memory that is the command storage means.

[0036] In this embodiment, a command to move the line of sight in the order of the upper left region, upper right region, lower left region, and lower right region of the visual field range 401 within a predetermined time is stored in the memory as a command for flipping up, and moving the line of sight in this manner is the input of the command. A determination means mounted on the CPU determines that the line of sight has moved in this manner in the same manner as the contents stored in the memory, and a control means also mounted on the CPU drives the stepping motor 2051 to perform flip-up drive. In this manner, by using a command input by the line of sight in particular, flipping up is possible by issuing an appropriate command even in noisy surroundings, when it is not desired to change the position of the head during task verification, or when it is difficult to operate the controller by hand.

[0037] As another example, a case where voice input using the microphone 108 is used as a command for a drive start signal of the stepping motor 2051 can be considered. For example, when the user utters a voice such as "flip up, 5 seconds" (also called "utterance"), the display body 101 is driven to flip up, and after 5 seconds, it flips down. This allows the user to flip up and down the display body 101 without using his / her hands. Also, in consideration of the directionality of the microphone 108, it may be configured so that the user's voice input is possible even in the flip-up state, and the display body 101 is flipped down by uttering "flip down". This allows the user to drive the display body 101, such as flipping up and down, at any timing without using his / her hands. In this way, by using command input by voice in particular, the user can flip up the display body 101 without using his / her hands even in an outdoor usage scene where the detection accuracy of the posture detection camera 105 is not high and sunlight hits the display body 101 directly. Also, when the user does not want to change the position of the head during the work verification, or in a situation where it is difficult to operate the controller by hand, flip up is possible by an appropriate command instruction.

[0038] FIG. 7 shows an example of a command in the case where the tilt of the head using the attitude detection means (attitude detection camera 105) is used as a command for a drive start signal of the drive means. The attitude detection means is, for example, configured with the attitude detection camera 105 mounted on the display body 101. The attitude detection camera 105 is an example of a sensor. In the example shown in FIG. 7, the user, while wearing the head mounted display 100, tilts the head to the right by 10 degrees or more, then tilts to the left by 10 degrees or more, and tilts to the right by 10 degrees or more again within a predetermined time. The attitude detection camera 105 detects this change in attitude and inputs a command. Similarly, by storing a command for flipping down in a memory that is a command storage means, the user can drive the display body 101, such as flipping up and down, at any timing without using his / her hands. In this way, by using a command input based on the attitude in particular, the user can flip up without using his / her hands even in an outdoor usage scene where the display body 101 is directly exposed to sunlight. In addition, flipping up is possible by issuing appropriate commands even in noisy environments or situations where it is difficult to operate the controller by hand.

[0039] FIG. 8 shows an example of a command in which a pointer position using a controller is used as a command for a drive start signal for the drive means. In this embodiment, the controller is a linkage device that is communicably connected to the head mounted display 100 by wired or wireless means and enables various operations. In this embodiment, the controller is a ring-shaped device worn on the index finger, and does not interfere with the use of the hand to hold a tool even when the user performs work verification using an XR device. The field of view 401 indicates the observation range when the display panel 102 is viewed through the display optical system (eyepiece lens 103). The controller pointer 404 is an index indicating where the controller operated by the user is pointing within the field of view 401. The position indicated by the controller pointer 404 is determined by sensing data obtained by a sensor mounted on the controller. The area 403 surrounded by a dashed line is an area used to determine the position of the controller pointer 404 indicated by the controller when it is used as a command. A command is input for the plurality of judgment regions according to the order in which the controller pointer enters each judgment region, and the judgment means judges whether the command is the same as the command stored in the command storage means. In this embodiment, a command for flipping up is stored in the memory to move the controller pointer 404 in the order of the upper left region, upper right region, lower left region, and lower right region of the visual field range 401 within a predetermined time, and this is the input of the command. The judgment means mounted on the CPU judges that the pointer has moved in the same manner as the contents stored in the memory, and the control means drives the drive means to perform the flip-up drive. By inputting the command using the controller pointer 404 in this manner, the user can flip up the display without using his / her hands even in an outdoor usage scene where sunlight directly hits the display main body 101. Furthermore, even in a noisy environment or when the user does not want to change the position of the head during the work verification, the flip-up can be performed by issuing an appropriate command.

[0040] Second embodiment Fig. 9 is a diagram showing a driving means configured with a stepping motor 2051 and a torsion coil spring 2052. Fig. 9(a) shows a wearing state where a user can experience XR, and Fig. 9(b) shows a flip-up state.

[0041] In the first embodiment, the driving means is configured by a stepping motor 2051, and both flip-up and flip-down are driven by the stepping motor 2051. On the other hand, in the present embodiment, an example is shown in which flip-up is performed by a torsion coil spring 2052. In this configuration, flip-up, which requires a relatively low positional accuracy after driving, is driven by the torsion coil spring 2052. The flip-up state is also maintained by biasing using the restoring force of the torsion coil spring 2052, which makes it possible to reduce power consumption. Note that the coil spring 2052 here is an example of an elastic member.

[0042] When the determination means 3051 mounted on the CPU 305 determines that the input command is a flip-up drive start signal, the display body 101 checks the surrounding situation using the attitude detection camera 105 and the background image camera 106 as described above in the first embodiment. If there is no obstacle during the drive, the lock mechanism (not shown) of the torsion coil spring 2052 is released, and the flip-up drive is performed by the drive of the torsion coil spring 2052. The damper 207 is a buffer member for mitigating the impact at the drive end when the flip-up drive is performed by the torsion coil spring 2052. This suppresses discomfort due to the impact and the displacement of the mounting part 301, and enables the flip-up by the torsion coil spring 2052. In this embodiment, when a predetermined time has passed after the flip-up, the stepping motor 2051 is driven to flip down while charging the torsion coil spring 2052, and it is locked in the flip-down position by a lock mechanism (not shown).

[0043] (Third embodiment) 10 shows a configuration example in which the driving means is shared with the IPD adjustment motor 209 of the IPD adjustment mechanism. The IPD adjustment is an adjustment for positioning the eyepiece 103, which is a display optical system, at a position that matches the interpupillary distance of the user. Regarding the IPD adjustment, a mechanism is known in which the IPD adjustment motor 209 and the gaze detection camera 104 are incorporated in the display main body 101 to automatically adjust the position based on the image capture result of the gaze detection camera 104. In this embodiment, a configuration will be described in which the IPD adjustment motor 209 used in the IPD adjustment mechanism is shared with a stepping motor 2051 for flip-up.

[0044] FIG. 10(a) is a schematic diagram of a horizontal section for explaining IPD adjustment using the IPD adjustment motor 209. FIG. 10(b) is a schematic diagram of a vertical section showing the IPD adjustment motor 209 and the gear 210 configured in the connection mechanism unit 206 and the display main body 101. The IPD adjustment motor 209 is a stepping motor used in common for IPD adjustment and flip-up and flip-down driving in this embodiment. The gear 210 is connected to the IPD adjustment motor 209 and rotates in response to the driving of the IPD adjustment motor 209. The stopper 208 has a mechanical shape that is the end of the adjustment in the IPD adjustment. This is generally configured at the end of the adjustment range in the IPD adjustment of the eyepiece lens 103. The IPD drive shaft 211 is connected to the gear 210 and is a shaft that rotates in conjunction with the driving of the gear 210. The IPD drive shaft 211 has worm gear teeth cut in opposite directions on the left and right sides, which are connected to the left and right lens housings 107, respectively, so that the left and right lens housings 107 are driven in the interpupillary direction with the rotation of the IPD drive shaft 211. The IPD adjustment motor 209 rotates in the direction of arrow A, and the gear 210 that meshes with it drives in the direction of arrow B, so that the lens housing 107 is driven outward in the display body 101 and reaches the stopper 208.

[0045] 10(c) is a schematic diagram of a horizontal section showing a state in which the lens housing 107 has been driven beyond the interpupillary distance of the user to the stopper 208. When the lens housing 107 reaches the stopper 208, the IPD adjustment motor 209 rotates as indicated by arrow A, but the gear 210 cannot be rotated as before because the lens housing 107 cannot move due to the stopper 208. At this time, the driving force of the IPD adjustment motor 209 acts to flip up the display body 101.

[0046] FIG. 10(d) is a schematic diagram of a vertical section showing how the display body 101 is flipped up by the IPD adjustment motor 209. After the lens housing 107 reaches the stopper 208, which is the driving end, when the load is applied by the IPD adjustment motor 209, the display body 101 is driven as shown by the arrow C. When flipping down, the IPD adjustment motor 209 rotates in the opposite direction, and the display body 101 is driven toward the flip-down position by gravity. After the position of the display body 101 is stopped at the fully down position by a stopper (not shown), the lens housing 107 is moved away from the stopper 208 by the rotation of the IPD adjustment motor 209 and driven inward. This makes it possible to adjust the IPD again. Since the display panel 102 cannot be observed during flipping up, the display optical system (eyepiece 103) does not have to be in an appropriate position with respect to the user's pupil position. This makes it possible to share the same motor for the IPD adjustment mechanism 209 and the stepping motor 2051 for flip-up and flip-down, which is expected to result in simplification of the device and reduced costs.

[0047] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0048] (Other embodiments) The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-mentioned embodiments are supplied to a system or device via a network or various storage media, and the computer (or control unit, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage medium storing the program constitute the present invention.

[0049] Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0050] Each functional unit in each of the above embodiments (variations) may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of a plurality of functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware such as an ASIC, FPGA, or DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. Then, the functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.

[0051] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0052] [Configuration 1] A control device for controlling an information processing device having a display unit, an acquisition unit that acquires motion information indicating a motion of a user using the information processing device based on sensing data acquired by a sensor; a drive control unit that controls an operation of a drive unit that switches a position of a display unit of the information processing device between in front of the user's field of view and outside the user's field of view; Equipped with The drive control unit is switching a position of the display unit when predetermined operation information is acquired by the acquisition unit; Control device.

[0053] [Configuration 2] The drive control unit is switching a position of the display unit when a command including a plurality of actions of the user is acquired as the predetermined action information by the acquisition unit; 2. The control device according to configuration 1.

[0054] [Configuration 3] The sensor is provided in the information processing device. 3. The control device according to configuration 1 or 2.

[0055] [Configuration 4] The user's actions include a gaze movement of the user. The control device according to configuration 3.

[0056] [Configuration 5] The user's actions include speech by the user. 5. The control device according to configuration 3 or 4.

[0057] [Configuration 6] The user's movements include movements of the user's head. A control device according to any one of configurations 3 to 5.

[0058] [Configuration 7] The sensor is provided in a linked device connected to the information processing device. A control device according to any one of configurations 1 to 6.

[0059] [Configuration 8] the user's action includes an action based on an operation of the linked device; 8. The control device according to configuration 7.

[0060] [Configuration 9] The control device includes: A storage unit that stores trigger information related to predetermined operation information used to switch the position of the display unit; Further comprising: The drive control unit is switching a position of the display unit when the acquisition unit acquires predetermined action information included in the trigger information stored in the storage unit; 9. The control device according to any one of configurations 1 to 8.

[0061] [Configuration 10] The control device includes: an instruction receiving unit that receives an instruction related to an operation of the drive unit; Further comprising: The drive control unit is controlling the driving of the drive unit based on the instruction received by the instruction receiving unit; 10. The control device according to any one of configurations 1 to 9.

[0062] [Configuration 11] The position of the display unit can be switched between in front of the user's field of view and outside the user's field of view by a tilt mechanism. 11. The control device according to any one of configurations 1 to 10.

[0063] [Configuration 12] The driving portion has an elastic member, The drive control unit is a restoring force of the elastic member is used to switch the position of the display unit from in front of the user's field of view to outside the user's field of view; The control device according to configuration 11.

[0064] [Configuration 13] The sensing data is obtained by the sensor in a non-contact manner. 13. The control device according to any one of configurations 1 to 12.

[0065] [Configuration 14] The control device includes: The information processing device is provided with: 14. The control device according to any one of configurations 1 to 13.

[0066] [method] A control method for controlling an information processing device having a display unit, comprising: acquiring motion information indicating a motion of a user wearing the information processing device based on sensing data obtained by a sensor; Controlling the operation of a drive unit that switches the position of a display unit of the information processing device between in front of the user's field of view and outside the user's field of view; Including, Controlling the operation of the drive unit switching a position of the display unit when predetermined operation information is acquired; Including, A computer implemented control method.

[0067] [program] Computer, A program for causing an information processing device having a display unit to function as a control device, an acquisition function for acquiring motion information indicating a motion of a user wearing the information processing device based on sensing data acquired by a sensor; a control function for controlling an operation of a drive unit that switches a position of a display unit of the information processing device between in front of the user's field of view and outside the user's field of view; Realize this, The control function is When predetermined operation information is acquired by the acquisition function, a position of the display unit is switched. program.

Claims

1. A control device for controlling an information processing device having a display unit, an acquisition unit that acquires motion information indicating a motion of a user using the information processing device based on sensing data acquired by a sensor; a drive control unit that controls an operation of a drive unit that switches a position of a display unit of the information processing device between in front of the user's field of view and outside the user's field of view; Equipped with The drive control unit is switching a position of the display unit when predetermined operation information is acquired by the acquisition unit; Control device.

2. The drive control unit is switching a position of the display unit when a command including a plurality of actions of the user is acquired as the predetermined action information by the acquisition unit; The control device according to claim 1 .

3. The sensor is provided in the information processing device. The control device according to claim 1 .

4. The user's actions include a gaze movement of the user. The control device according to claim 3.

5. The user's actions include speech by the user. The control device according to claim 3.

6. The user's movements include movements of the user's head. The control device according to claim 3.

7. The sensor is provided in a linked device connected to the information processing device. The control device according to claim 1 .

8. the user's action includes an action based on an operation of the linked device; The control device according to claim 7.

9. The control device includes: A storage unit that stores trigger information related to predetermined operation information used to switch the position of the display unit; Further comprising: The drive control unit is switching a position of the display unit when the acquisition unit acquires predetermined action information included in the trigger information stored in the storage unit; The control device according to claim 1 .

10. The control device includes: an instruction receiving unit that receives an instruction related to an operation of the drive unit; Further comprising: The drive control unit is controlling the driving of the drive unit based on the instruction received by the instruction receiving unit; The control device according to claim 1 .

11. The position of the display unit can be switched between in front of the user's field of view and outside the user's field of view by a tilt mechanism. The control device according to claim 1 .

12. The driving portion has an elastic member, The drive control unit is a restoring force of the elastic member is used to switch the position of the display unit from in front of the user's field of view to outside the user's field of view; The control device according to claim 11.

13. The sensing data is obtained by the sensor in a non-contact manner. The control device according to claim 1 .

14. The control device includes: The information processing device is provided with: A control device according to any one of claims 1 to 13.

15. A control method for controlling an information processing device having a display unit, comprising: acquiring motion information indicating a motion of a user using the information processing device based on sensing data obtained by a sensor; Controlling the operation of a drive unit that switches the position of a display unit of the information processing device between in front of the user's field of view and outside the user's field of view; Including, Controlling the operation of the drive unit switching a position of the display unit when predetermined operation information is acquired; Including, A computer implemented control method.

16. Computer, A control device for controlling an information processing device having a display unit, an acquisition unit that acquires motion information indicating a motion of a user using the information processing device based on sensing data acquired by a sensor; a control unit that controls an operation of a drive unit that switches a position of a display unit of the information processing device between in front of the user's field of view and outside the user's field of view; Equipped with The control unit is switching a position of the display unit when predetermined operation information is acquired by the acquisition unit; A program that functions as a control device.

Images