Control device

Abstract

A control device according to the present invention is characterized by comprising: a control means capable of performing control such that a video of a virtual space is displayed on a head-mounted display, and performing control such that a text field for character input is displayed in the virtual space; and a detection means for detecting a character input device from a video of a real space captured by an imaging means, wherein the control means does not perform control such that an image representing the detected character input device is displayed in the virtual space when the current state is not a character input state in which the text field is displayed and character input is possible, and the control means performs control such that an image representing the detected character input device in the video of the real space is displayed in the virtual space when the current state is the character input state.

Description

control device

[0001] The present invention relates to a control device, and more particularly to a character input method when wearing a head-mounted display.

[0002] In recent years, a technology called virtual reality (VR) has become widespread, allowing users to experience a computer-generated virtual space as if it were real. For example, a user can wear a head-mounted display (HMD) on their head to experience (view) virtual reality images. When the HMD is worn on the user's head, the user's field of vision is covered by the HMD. This allows the user to have a highly immersive visual experience.

[0003] While experiencing virtual reality images using an HMD, a user can perform various tasks, such as entering characters. In a conventional method for entering characters in a virtual space, a virtual keyboard generated by CG is displayed in the virtual space, and the user enters characters by operating the virtual keyboard. However, since the virtual keyboard is CG and has no physical substance, the user cannot experience a tactile sensation when entering characters. Therefore, entering characters using a virtual keyboard is inferior in terms of input speed and accuracy compared to entering characters using a physical keyboard in the real world. Therefore, it is desirable to be able to use a real-world keyboard when entering characters in a virtual space.

[0004] Methods for visually recognizing real-world objects in a virtual space are disclosed in Patent Documents 1 and 2. Patent Document 1 discloses displaying external information that matches pre-registered information on a head-mounted display when detected. Patent Document 2 discloses displaying an image of the area around a user's hand in the real world by superimposing it on a virtual space.

[0005] JP 2005-086328 A JP 2020-042206 A

[0006] However, in the method disclosed in Patent Document 1, the real-world keyboard is unnecessarily displayed, which may interfere with the user's immersion. In the method disclosed in Patent Document 2, if the real-world keyboard is not located near the user's hands, the user cannot see the real-world keyboard.

[0007] The present invention aims to enable a user experiencing a virtual reality image to view a character input device (e.g., a keyboard) in the real world at a desired timing.

[0008] The control device of the present invention has a control means capable of controlling the display of an image of a virtual space on a head-mounted display and the display of a text field for character input in the virtual space, and a detection means for detecting a character input device from an image of a real space captured by an imaging means, wherein the control means does not control the display of an image representing the detected character input device in the virtual space when the text field is displayed and the device is not in a character input state where character input is possible, and when the device is in the character input state, controls the display of an image of the real space representing the detected character input device in the virtual space.

[0009] According to the present invention, a user experiencing a virtual reality image can view a character input device (e.g., a keyboard) in the real world at a desired timing.

[0010] Fig. 1 is a block diagram showing the configuration of a head-mounted display. Fig. 2 is a flowchart of processing of the head-mounted display. Fig. 3 is a flowchart of display control processing. Fig. 4 is a schematic diagram showing a virtual space image. Fig. 5 is a modified example of the flowchart of the display control processing. Fig. 6 is another modified example of the flowchart of the display control processing.

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that, although an example in which the present invention is applied to a head-mounted display will be described, the control device of the present invention may be a device separate from the head-mounted display. For example, the control device of the present invention may be a PC (personal computer) connected to the head-mounted display.

[0012] 1 is a block diagram showing the configuration of a head mounted display 100 according to this embodiment. The head mounted display 100 includes a control unit 101, a memory 102, a nonvolatile memory 103, an imaging unit 104, an orientation detection unit 105, an operation unit 106, a display unit 107, an audio output unit 108, an external I / F 109, and a communication I / F 110. These are connected to an internal bus 150 and can exchange data with each other via the internal bus 150.

[0013] The control unit 101 is composed of, for example, at least one processor or circuit, and controls the entire head-mounted display 100. The memory 102 is composed of, for example, RAM (a volatile memory using a semiconductor element, etc.). The non-volatile memory 103 stores various data (information) such as image data, audio data, other data, and various programs for operating the control unit 101. The non-volatile memory 103 is composed of, for example, flash memory, ROM, HDD, or SSD. The control unit 101 controls each unit of the head-mounted display 100 according to, for example, a program stored in the non-volatile memory 103, using the memory 102 as a work memory.

[0014] The imaging unit 104 captures an image of real space under the control of the control unit 101. An imaging element such as a CCD or CMOS element that converts an optical image into an electrical signal may be used as the imaging unit 104. Alternatively, the imaging unit 104 may be a combination of an imaging element and a depth sensor configured to detect the physical distance of an object.

[0015] The attitude detection unit 105 detects the attitude of the head mounted display 100 with respect to the direction of gravity, and detects the tilt of the attitude with respect to each of the yaw, roll, and pitch axes. Based on the attitude detected by the attitude detection unit 105, it is possible to determine whether the head mounted display 100 is facing up, facing down, or at an angle. As the attitude detection unit 105, at least one of an acceleration sensor, a gyro sensor, a geomagnetic sensor, a direction sensor, and an altitude sensor can be used, and two or more of these sensors can also be used in combination.

[0016] The operation unit 106 is an input device for receiving user operations, and includes at least one of a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, and a touchpad. The operation unit 106 may be a device (for example, a controller or a keyboard) separate from the head-mounted display 100. In that case, communication with the operation unit 106 is performed using the communication I / F 110.

[0017] The display unit 107 displays various images such as images and GUI screens that constitute a GUI (Graphical User Interface) based on the control of the control unit 101. The control unit 101 generates a display control signal according to a program and controls each unit of the head-mounted display 100 to generate a video signal for display on the display unit 107 and output it to the display unit 107. The display unit 107 displays an image based on the output video signal.

[0018] The audio output unit 108 outputs various sounds such as audio from video or music data, operation sounds, ringtones, and various notification sounds. The audio output unit 108 may be a speaker or an audio output terminal for connecting earphones or the like. The audio output unit 108 may be a communication unit that performs wireless communication with an external speaker or earphones.

[0019] The external I / F 109 is an interface for connecting to an external device via a wired cable or wirelessly and for inputting and outputting at least one of a video signal and an audio signal to and from the external device. The communication I / F 110 is an interface for communicating with an external device or the Internet and for transmitting and receiving various data such as files and commands.

[0020] The head-mounted display 100 may be separated into a part worn on the head (head-mounted display) and an external PC. In that case, for example, the display unit 107 is provided in the head-mounted display, and the control unit 101 is provided in the external PC.

[0021] 2 is a flowchart of the processing of the head mounted display 100. This processing is realized by the control unit 101 expanding a program stored in the nonvolatile memory 103 into the memory 102 and executing it. For example, when the head mounted display 100 is started, the processing of FIG. 2 is started.

[0022] In S201, the control unit 101 displays an image of the virtual space on the display unit 107.

[0023] In S202, the control unit 101 determines whether a predetermined start operation for starting a character input state in which character input is possible has been performed. The control unit 101 waits until the start operation is performed, and when the start operation is performed, the process proceeds to S203. For example, when a button for starting the character input state (a button for displaying a text field, which will be described later) is displayed in the virtual space and the button is operated using the operation unit 106, the process proceeds to S203. The start operation is not limited to this, and may also be an operation on a button, dial, touchpad, or mouse of the operation unit 106.

[0024] In S203, the control unit 101 displays a text field for character input in the virtual space displayed on the display unit 107.

[0025] In S204, the control unit 101 starts accepting character input into the displayed text field, thereby entering a character input state.

[0026] In S205, the control unit 101 captures an image of the real space using the imaging unit 104 and detects a character input device from the captured real space (image of the real space). The character input device can be detected using various known techniques. The character input device is a device for inputting characters, such as a keyboard, laptop, smartphone, tablet PC, or touch pen. In the present embodiment, detection of the character input device is started in response to entering a character input state, but this is not limited thereto. For example, detection of the character input device may be performed regardless of whether or not the character input state is entered. Detection of the character input device may also be started in response to activation of the head-mounted display 100.

[0027] In S206, the control unit 101 controls the display of the display unit 107 (display control process). Details of the display control process will be described later with reference to Fig. 3. In the display control process, for example, an image representing the detected character input device (input device image) is displayed in the virtual space.

[0028] In S207, the control unit 101 determines whether a predetermined termination operation for terminating the character input state has been performed. If the termination operation has been performed, the process proceeds to S208; if not, the process proceeds to S205. For example, if a button for terminating the character input state (a button for hiding the text field) is displayed in the virtual space and the button is operated using the operation unit 106, the process proceeds to S208. The termination operation is not limited to this, and may be an operation on a button, dial, touchpad, or mouse of the operation unit 106, or an operation on an object other than a text field.

[0029] In S208, the control unit 101 hides the text field. The user may use the operation unit 106 to perform an operation to hide the input device image (a hide operation), and the control unit 101 may hide the input device image while maintaining the character input state in response to the hide operation. This allows for usage such as temporarily hiding the input device image in the middle of character input, improving convenience.

[0030] FIG. 3 is a flowchart of the display control process performed in S206 of FIG.

[0031] In S301, the control unit 101 acquires the detection result of the character input device (the processing result of S205).

[0032] In S302, the control unit 101 determines whether or not a character input device has been detected based on the detection result of the character input device. If a character input device has been detected, the process proceeds to S303; if not, the process proceeds to S304.

[0033] In S303, the control unit 101 calculates the position (coordinates) of the detected character input device in real space (image of real space) captured using the imaging unit 104. Then, the control unit 101 displays an image (input device image) representing the detected character input device at a position in virtual space corresponding to the calculated position. Here, the input device image is an image obtained by cutting out an area corresponding to the position (coordinates) of the detected character input device from the image of real space captured using the imaging unit 104. This allows the user to visually recognize the input device image (character input device in the real world) and input characters conveniently, thereby improving the operability of character input while achieving a sense of immersion in the virtual space. The position of the character input device in real space (the real world) can be detected using various known techniques. The control unit 101 may change the display position of the text field to a position near the displayed input device image. This shortens the amount of eye movement between the input device image and the text field, allowing the user to input characters more conveniently.

[0034] In S304, the control unit 101 displays an image of real space captured by the imaging unit 104, instead of the image of virtual space displayed on the display unit 107 (by hiding the image of virtual space). This allows the user to easily find the character input device and input characters. The control unit 101 may display both the image of virtual space and the image of real space.

[0035] 4 is a schematic diagram showing a virtual space image 400 (image of a virtual space) displayed on the head-mounted display 100. The control unit 101 displays the virtual space image 400 on the display unit 107 (S201 in FIG. 2). When the user performs a predetermined operation while viewing the virtual space image 400, the control unit 101 displays a text field 401 in the virtual space (S203). For example, a button for displaying the text field 401 is displayed in the virtual space, and when the button is operated using the operation unit 106, the text field 401 is displayed. The predetermined operation for displaying the text field 401 is not limited to this, and may also be an operation on a button, dial, touchpad, or mouse of the operation unit 106.

[0036] After displaying the text field 401, the control unit 101 starts accepting character input into the text field 401 (S204). Acceptance of character input into the text field 401 may start automatically at the same time as the display of the text field 401, or may start in response to a user's operation on the text field 401 using the operation unit 106.

[0037] After starting to accept character input into the text field 401, the control unit 101 starts detecting a character input device. The control unit 101 captures an image of the real space using the imaging unit 104 and detects the character input device from the captured real space (image of the real space) (S205). When the control unit 101 detects a character input device, the control unit 101 calculates the position of the detected character input device in the real space captured using the imaging unit 104. Then, the control unit 101 displays an image (input device image) 402 representing the detected character input device at a position in the virtual space corresponding to the calculated position (S303 in FIG. 3). The input device image 402 is an image of the detected character input device. The control unit 101 extracts a rectangular area including the detected character input device from the image of the real space captured using the imaging unit 104 and displays the extracted rectangular area as the input device image 402. Note that the control unit 101 may detect the outline of the character input device, extract the area surrounded by the outline, and display it as the input device image. The control unit 101 may replace the input device image with a three-dimensional model (3DCG) corresponding to the detected character input device and display it.

[0038] As described above, according to this embodiment, a user experiencing virtual reality video can visually recognize a real-world character input device (e.g., a keyboard) at a desired timing. For example, when the user is not in a character input state where character input into a text field is possible, an input device image representing the detected character input device is not displayed in the virtual space, whereas when the user is in a character input state, the input device image is displayed in the virtual space. By doing so, when no character input is being performed, the input device image is not displayed, so the user's sense of immersion is not interrupted. On the other hand, when character input is being performed, the input device image is displayed, so the user can visually recognize the input device image (a real-world character input device) and perform character input appropriately.

[0039] (Modification 1) Fig. 5 is a modification of the flowchart of the display control process performed in S206 in Fig. 2. In the display control process in Fig. 5, the distance from the head mounted display 100 to the detected character input device is taken into consideration.

[0040] In S501, the control unit 101 acquires the detection result of the character input device (the processing result of S205).

[0041] In S502, the control unit 101 determines whether or not a character input device has been detected based on the detection result of the character input device. If a character input device has been detected, the process proceeds to S503; if not, the process proceeds to S506.

[0042] In S503, the control unit 101 acquires information (distance information) about the distance to the detected character input device from the head mounted display 100. The distance information can be acquired using various known techniques, for example, the imaging unit 104.

[0043] In S504, the control unit 101 determines whether the distance from the head mounted display 100 to the character input device is shorter than a threshold (predetermined distance) based on the acquired distance information. If the distance is shorter than the threshold, the process proceeds to S505, and if not, the process proceeds to S506. Although the process proceeds to S506 when the distance is equal to the threshold, the process may also proceed to S505.

[0044] In S505, the control unit 101 calculates the position (coordinates) of the detected character input device in real space (image of real space) captured using the imaging unit 104. Then, the control unit 101 displays an image (input device image) representing the detected character input device at a position in virtual space corresponding to the calculated position. The position of the character input device in real space (real world) can be detected using various known techniques.

[0045] In S506, the control unit 101 displays an image of real space captured by the imaging unit 104, instead of the image of virtual space displayed on the display unit 107 (by hiding the image of virtual space). The control unit 101 may superimpose an item indicating the position of the detected character input device on the image of real space. This allows the user to easily find the character input device from the image of real space and approach the character input device when inputting characters.

[0046] When the distance from the head-mounted display 100 to the character input device is long, the user needs to move closer to the character input device when inputting characters. Therefore, it is preferable for the user to be able to understand the surroundings. Therefore, in the above-described first modification, when the distance from the head-mounted display 100 to the character input device is longer than a threshold, the character input image is not displayed, and an image of the real space is displayed. This allows the user to easily move closer to the character input device while avoiding surrounding obstacles.

[0047] (Modification 2) Fig. 6 is another modification of the flowchart of the display control process performed in S206 in Fig. 2. In the display control process in Fig. 6, the detected connection state of the character input device is taken into consideration.

[0048] In S601, the control unit 101 acquires the detection result of the character input device (the processing result of S205).

[0049] In S602, the control unit 101 determines whether or not a character input device has been detected based on the detection result of the character input device. If a character input device has been detected, the process proceeds to S603; if not, the process proceeds to S606.

[0050] In S603, the control unit 101 acquires information (connection information) on the connection state of the detected character input device. For example, if the detected character input device is not connected to the head-mounted display 100, the connection information is not acquired, and if the detected character input device is connected to the head-mounted display 100, the connection information is acquired using the communication I / F 110.

[0051] In S604, the control unit 101 determines, based on the acquired connection information, whether the detected character input device is connected (wired or wirelessly) to the head mounted display 100. If the detected character input device is connected to the head mounted display 100, the process proceeds to S605, and if not, the process proceeds to S606.

[0052] In S605, the control unit 101 calculates the position (coordinates) of the detected character input device in real space (image of real space) captured by the imaging unit 104. Then, the control unit 101 displays an image (input device image) representing the detected character input device at a position in virtual space corresponding to the calculated position. The position of the character input device in real space (real world) can be detected using various known techniques.

[0053] In S606, the control unit 101 displays an image of real space captured using the imaging unit 104, instead of the image of virtual space displayed on the display unit 107 (by hiding the image of virtual space). The control unit 101 may superimpose guidance on the image of real space to prompt the user to connect a character input device to the head-mounted display 100. This allows the user to easily understand that a character input device needs to be connected. The control unit 101 may superimpose a list of character input devices connectable to the head-mounted display 100 (paired character input devices) on the image of real space. This allows the user to easily select a paired character input device and connect it to the head-mounted display 100.

[0054] If a character input device is not connected to the head-mounted display 100, the user needs to connect the character input device to the head-mounted display 100 when inputting characters. Therefore, it is preferable that the user can understand the surroundings. Therefore, in the above-described second modification, if the detected character input device is not connected to the head-mounted display 100, a character input image is not displayed, and an image of the real space is displayed. This allows the user to easily perform the task (operation) of connecting the character input device to the head-mounted display 100 while visually checking the operation.

[0055] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0056] The processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, a central processing unit (CPU), a micro processing unit (MPU), and a digital signal processor (DSP). Dedicated processors include, for example, a graphics processing unit (GPU), an application specific integrated circuit (ASIC), and a programmable logic device (PLD). Examples of programmable logic devices include a field programmable gate array (FPGA) and a complex programmable logic device (CPLD).

[0057] Furthermore, the above-described embodiment (including modifications) is merely an example, and the present invention also includes configurations obtained by appropriately modifying or changing the configuration of the above-described embodiment within the scope of the gist of the present invention. Configurations obtained by appropriately combining the configurations of the above-described embodiment are also included in the present invention.

[0058] The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit that realizes one or more functions.

[0059] The disclosure of the present embodiments includes the following configurations, methods, programs, and media. (Configuration 1) A control device comprising: control means capable of controlling a video of a virtual space to be displayed on a head-mounted display and controlling a text field for character input to be displayed in the virtual space; and detection means for detecting a character input device from a video of real space captured by an imaging means, wherein the control means does not control an image representing the detected character input device to be displayed in the virtual space when the text field is displayed and the device is not in a character input state where character input is possible; and controls an image representing the detected character input device from the video of real space to be displayed in the virtual space when the device is in the character input state. (Configuration 2) The control device according to Configuration 1, wherein the control means controls the image representing the detected character input device to be displayed at a position in the virtual space that corresponds to the position of the character input device in the real space. (Configuration 3) The control device according to Configuration 1 or 2, wherein the image representing the detected character input device is an image of an area of ​​the video of real space that corresponds to the position of the detected character input device. (Configuration 4) The control device according to any one of configurations 1 to 3, wherein the image representing the detected character input device is a three-dimensional model corresponding to the detected character input device. (Configuration 5) The control device according to any one of configurations 1 to 4, wherein the control means controls to hide the image representing the detected character input device in response to a predetermined operation that ends the character input state. (Configuration 6) The control device according to configuration 5, wherein the predetermined operation is an operation on an object other than the text field. (Configuration 7) The control device according to any one of configurations 1 to 6, wherein the control means, when displaying an image representing the detected character input device, changes the display position of the text field to a position near the image.(Configuration 8) The control device according to any one of configurations 1 to 7, wherein the control means controls to hide the image representing the detected character input device while maintaining the character input state, in response to an operation to hide the image representing the detected character input device. (Configuration 9) The control device according to any one of configurations 1 to 8, wherein, when the character input state is established and a character input device is not detected, the control means controls to display an image of the real space on the head-mounted display. (Configuration 10) The control device according to configuration 9, wherein, when the character input state is established and a character input device is not detected, the control means controls to hide the image of the virtual space and display the image of the real space on the head-mounted display. (Configuration 11) The control device according to any one of configurations 1 to 10, wherein, even in the character input state, when a distance from the head-mounted display to the detected character input device is longer than a threshold, the control means does not control to display an image representing the detected character input device in the virtual space, but controls to display the image of the real space on the head-mounted display. (Configuration 12) The control device according to Configuration 11, characterized in that, when the device is in the character input state and the distance is longer than the threshold, the control means controls to display an item indicating the position of a character input device superimposed on the image of the real space. (Configuration 13) The control device according to any of Configurations 1 to 12, characterized in that even when the device is in the character input state and the detected character input device is not connected to the head-mounted display, the control means does not control to display an image representing the detected character input device in the virtual space, but controls to display the image of the real space on the head-mounted display.(Configuration 14) The control device according to Configuration 13, wherein, when the control device is in the character input state and the detected character input device is not connected to the head-mounted display, the control means controls to display guidance prompting connection of a character input device to the head-mounted display superimposed on the image of the real space. (Configuration 15) The control device according to Configuration 13 or 14, wherein, when the control device is in the character input state and the detected character input device is not connected to the head-mounted display, the control means controls to display a list of character input devices connectable to the head-mounted display superimposed on the image of the real space. (Configuration 16) The control device according to any of Configurations 1 to 15, wherein the detection means starts detecting a character input device in response to entering the character input state. (Configuration 17) The control device according to any of Configurations 1 to 16, further comprising the imaging means. 18. (Method) A control method comprising the steps of: controlling to display an image of a virtual space on a head-mounted display; controlling to display a text field for character input in the virtual space; detecting a character input device from an image of real space captured by an imaging means; and, when the text field is displayed and the device is not in a character input state where character input is possible, not controlling to display an image representing the detected character input device in the virtual space, and when the device is in the character input state, controlling to display an image of the real space representing the detected character input device in the virtual space. (Program) A program for causing a computer to function as each means of the control device recited in any of Configurations 1 to 17. (Medium) A computer-readable storage medium storing a program for causing a computer to function as each means of the control device recited in any of Configurations 1 to 17.

[0060] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, the following claims are appended to apprise the public of the scope of the present invention.

[0061] This application claims priority based on Japanese Patent Application No. 2023-121803, filed on July 26, 2023, the entire contents of which are incorporated herein by reference.

[0062] 100: Head-mounted display 101: Control unit

Claims

1. A control device comprising: a control means capable of controlling an image of a virtual space to be displayed on a head mounted display, and controlling a text field for character input to be displayed in the virtual space; and a detection means for detecting a character input device from an image of real space captured by an imaging means, wherein the control means, when the text field is displayed and the device is not in a character input state where character input is possible, does not control an image representing the detected character input device to be displayed in the virtual space, and when the device is in the character input state, controls an image of the real space representing the detected character input device to be displayed in the virtual space.

2. The control device according to claim 1, characterized in that the control means controls so as to display an image representing the detected character input device at a position in the virtual space corresponding to the position of the character input device in the real space.

3. The control device according to claim 1, characterized in that the image representing the detected character input device is an image of an area of ​​the image of the real space that corresponds to the position of the detected character input device.

4. The control device according to claim 1, wherein the image representing the detected character input device is a three-dimensional model corresponding to the detected character input device.

5. The control device according to claim 1, wherein said control means performs control so as to make the image representing said detected character input device invisible in response to a predetermined operation for terminating said character input state.

6. The control device according to claim 5, wherein the predetermined operation is an operation on an object other than the text field.

7. The control device according to claim 1, characterized in that, when an image representing the detected character input device is displayed, the control means changes the display position of the text field to a position adjacent to the image.

8. The control device according to claim 1, characterized in that, in response to an operation of hiding an image representing the detected character input device, the control means controls to hide the image representing the detected character input device while maintaining the character input state.

9. The control device according to claim 1, characterized in that, when the character input state is reached and a character input device is not detected, the control means controls the head-mounted display to display an image of the real space.

10. The control device according to claim 9, characterized in that when the character input state is reached and a character input device is not detected, the control means controls the image of the virtual space to be hidden and the image of the real space to be displayed on the head-mounted display.

11. The control device according to claim 1, characterized in that even in the character input state, when the distance from the head mounted display to the detected character input device is longer than a threshold value, the control means does not control the display of an image representing the detected character input device in the virtual space, but controls the display of an image of the real space on the head mounted display.

12. The control device according to claim 11, characterized in that, when the character input state is in effect and the distance is longer than the threshold value, the control means controls so as to display an item indicating the position of the character input device superimposed on the image of the real space.

13. The control device according to claim 1, characterized in that even in the character input state, when the detected character input device is not connected to the head mounted display, the control means does not control the display of an image representing the detected character input device in the virtual space, but controls the display of an image of the real space on the head mounted display.

14. The control device according to claim 13, characterized in that, when the character input state is established and the detected character input device is not connected to the head mounted display, the control means controls the display to superimpose on the image of the real space guidance prompting the user to connect the character input device to the head mounted display.

15. The control device according to claim 13, characterized in that, when the character input state is in effect and the detected character input device is not connected to the head mounted display, the control means controls the display to display a list of character input devices connectable to the head mounted display in a superimposed manner on the image of the real space.

16. The control device according to claim 1, wherein said detection means starts detection of a character input device in response to the character input state being entered.

17. The control device according to claim 1, further comprising the imaging means.

18. A control method comprising the steps of: controlling to display an image of a virtual space on a head mounted display; controlling to display a text field for character input in the virtual space; detecting a character input device from an image of real space captured by an imaging means; and, when the text field is displayed and the device is not in a character input state in which character input is possible, not controlling to display an image representing the detected character input device in the virtual space, and when the device is in the character input state, controlling to display an image of the real space representing the detected character input device in the virtual space.

19. A program for causing a computer to function as each of the means of the control device according to any one of claims 1 to 17.

20. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the control device according to any one of claims 1 to 17.

Images