Foot input system, foot position indicating tool, foot position detection device, and image processing system

Abstract

The present application enables input of various information to an image processing device using a user's foot in a manner that avoids producing a sense of difference in relation to a changing image and a user's body movement. Position indicating units (303L, 303R, 303C) are provided at the rear of the sole of a foot position indicating tool (300). A foot position detecting device (400) receives position indicating signals from the position indicating units (303L, 303R, 303C), detects whether the foot position indicating tool (300) has performed a movement in the direction of extension of a line extending from the heel side to the toe side, i.e., a forward movement, or a movement in the direction of extension of a line extending from the toe side to the heel side, i.e., a backward movement, and indicates the forward movement and the backward movement to an image processing device (700).

Description

TECHNICAL FIELD

[0001] The present application relates to, for example, a system, a device, and a method for enabling input of information using a user's foot to an image processing device. BACKGROUND

[0002] In recent years, with the performance improvement of computers and displays, fields such as VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality) are rapidly developing. In an execution environment in these fields, in order to perform the operation of a computer with the same feeling as reality, not only input devices such as a mouse, a keyboard, and a handle, but also a special hand device that detects the motion of a user's (player's) hand and finger is sometimes used. Thereby, a gesture such as grasping an operation object with a hand can be reproduced in a space created by a computer. Attempts are being made to bring the posture of a user's hand itself into digital content created by a computer.

[0003] However, the more the reproducibility of a gesture of a user's hand based on reality is improved in a space created by a computer, the more difficult it is to perform an operation using a lever, an operation button, a touch panel, or the like that is directly operated by a hand. In addition, for example, since a behavior using a foot (leg) such as a walking movement is replaced with a posture of a fingertip or an entire arm, for example, it can become a cause of damage to the sense of immersion that is important in VR.

[0004] Thus, an input device that enables input of information using a foot (leg) is considered. For example, in Patent Literature 1 described later, an invention related to a foot motion type input device that enables input by a simple operation of only one foot is disclosed. The foot motion type input device can change an indication position by rotating a ball provided on the sole side with a foot, or can perform the same operation as left click and right click of a so-called mouse by providing a switch operated by a toe.

[0005] In addition, in Patent Literature 2 described later, an invention related to a game controller that can detect not only the weight and the center of gravity but also various motions such as stepping, walking, jumping, and squatting is disclosed. The game controller detects the pressure distribution of a contact area of a part of a player's body by the player's (user's) motion on a seat having a plurality of pressure sensors, and detects the player's motion based on the shape of the distribution and the change in the shape.

[0006] PRIOR ART DOCUMENTS

[0007] PATENT LITERATURE

[0008] Patent Literature 1: Japanese Patent Application Laid-Open No. 9-198188

[0009] Patent Literature 2: Japanese Patent Application Laid-Open No. 2016-174699 SUMMARY

[0010] PROBLEMS TO BE SOLVED BY THE INVENTION

[0011] The invention disclosed in Patent Literature 1 stops at being able to operate a mouse operated by a hand with a foot, and cannot achieve more flexible information input. In addition, the invention disclosed in Patent Literature 2 is able to detect various motion states of a player, and thus has an effective function as a game controller. However, as a device that performs information input in a space formed by a computer such as VR, AR, MR, the states that can be detected are limited, and sufficient input cannot be performed.

[0012] In addition, by using a controller called a so-called joystick that is able to perform direction input by a stick, in a virtual three-dimensional space formed by VR technology, it is possible to change a three-dimensional space image as if the user is moving. However, in this case, the three-dimensional space image changes even though the user's body does not move, and thus there is a significant difference in the feeling with respect to the changed three-dimensional space image and the user's body motion, and there are users who experience a symptom called so-called VR sickness.

[0013] Thus, the following is also performed: a head-mounted display called a head-mounted display or the like is used, the motion of the user's head is detected using a 6-axis sensor or the like mounted on the head-mounted display, and a display image is changed in coordination with the motion of the user's head. In this case, in the case where the position (viewpoint) of the user in the three-dimensional space image is moved, the user performs instruction input using the feet, which is closer to the actual body motion in the case of movement, and thus it is considered that it is difficult to cause a difference in the feeling with respect to the changed three-dimensional space image and the user's body motion.

[0014] In view of the above, an object of the present invention is to enable input of various information to an image processing device using the user's feet in a manner that avoids a difference in the feeling with respect to the changed image and the user's body motion.

[0015] MEANS FOR SOLVING THE PROBLEMS

[0016] In order to solve the above problems,

[0017] A foot input system is provided, which is constituted by a foot position instruction tool worn on the user's feet and a foot position detection device that detects the instruction position of the foot position instruction tool, and supplies a detection output from the foot position detection device to an image processing device, wherein

[0018] The foot position indicating tool includes:

[0019] The sole portion includes a front sole portion on the toe side of the instep and a rear sole portion on the heel side of the instep.

[0020] The position indicating signal transmitting portion is provided in one or both of the front sole portion and the rear sole portion and transmits a position indicating signal.

[0021] The foot position detecting device includes:

[0022] The position detecting sensor is configured by arranging a plurality of electrodes at a predetermined interval in each of a first direction and a second direction intersecting the first direction, receives the position indicating signal from the position indicating signal transmitting portion, and outputs the position indicating signal for each of the plurality of electrodes.

[0023] The detection circuit detects a forward movement as a movement in an extending direction of a line extending in a direction along a center axis in a length direction of the sole portion and in a direction from the heel side to the toe side of the sole portion based on an output signal from the position detecting sensor, and detects a backward movement as a movement in an extending direction of a line extending in a direction along the center axis in the length direction of the sole portion and in a direction from the toe side to the heel side of the sole portion.

[0024] According to the foot input system, a position indicating signal transmitting portion that transmits a position indicating signal is provided in one or both of a front sole portion and a rear sole portion of a sole portion of a foot position indicating tool. A position detecting sensor of a foot position detecting device receives the position indicating signal from the position indicating signal transmitting portion and outputs the position indicating signal for each of a plurality of electrodes. A detection circuit of the foot position detecting device detects a forward movement as a movement in an extending direction of a line extending in a direction along a center axis in a length direction of the sole portion and in a direction from the heel side to the toe side of the sole portion based on an output signal from the position detecting sensor. In addition, the detection circuit detects a backward movement as a movement in an extending direction of a line extending in a direction along the center axis in the length direction of the sole portion and in a direction from the toe side to the heel side of the sole portion. Thus, it is possible to instruct a forward movement and a backward movement to an image processing device using the foot input system simply, and it is possible to instruct a processing related to an image as a magnification of the image for the forward movement and a reduction of the image for the backward movement. BRIEF DESCRIPTION OF DRAWINGS

[0025] Figure 1 is a diagram for explaining a use example of the foot input system of the first embodiment.

[0026] Figure 2is a diagram for explaining a structure example of the foot position indicating tool of the first embodiment.

[0027] Figure 3 is a diagram for explaining a structure example of the foot position indicating tool of the first embodiment.

[0028] Figure 4 is a diagram for explaining a structure example of the foot position detecting device of the first embodiment.

[0029] Figure 5 is a diagram for explaining height information and angle information that can be input using the foot position indicating tool of the first embodiment.

[0030] Figure 6 is a diagram for explaining angle information that can be input using the foot position indicating tool of the first embodiment.

[0031] Figure 7 is a diagram for explaining a use example of the foot input system of the second embodiment.

[0032] Figure 8 is a diagram for explaining an overall structure of an image processing system configured using the foot input system of the second embodiment.

[0033] Figure 9 is a diagram for explaining a structure example of the foot position indicating tool of the second embodiment.

[0034] Figure 10 is a diagram for explaining a structure example of the foot position detecting device of the second embodiment.

[0035] Figure 11 is a diagram for explaining a use example of the foot input system of the second embodiment.

[0036] Figure 12 is a diagram for explaining an action state of the foot input system of the second embodiment and a display image of the head-mounted display.

[0037] Figure 13 is a diagram for explaining an action state of the foot input system of the second embodiment and a display image of the head-mounted display.

[0038] Figure 14 is a diagram for explaining an action state of the foot input system of the second embodiment and a display image of the head-mounted display.

[0039] Figure 15 is a diagram for explaining an indication input in the image processing system configured using the foot input system of the second embodiment.

[0040] Figure 16 is a diagram for explaining the indication input in the image processing system configured using the foot input system of the second embodiment.

[0041] Figure 17 is a diagram for explaining the method of detecting the indication input in the foot input system of the second embodiment.

[0042] Figure 18 is a diagram for explaining the deformation of the set position of the position indication signal transmitting section of the foot position indication tool.

[0043] Figure 19 is a diagram for explaining the foot position indication tool configured using the flat coil.

[0044] Figure 20 is a diagram for explaining the foot position indication tool configured using the flat coil.

[0045] Figure 21 is a diagram for explaining the use example of the foot position indication tool configured using the flat coil. DETAILED DESCRIPTION

[0046] Hereinafter, an embodiment of the system, device, and method of the present application will be described with reference to the accompanying drawings.

[0047] [First Embodiment]

[0048] [Use Example of Foot Input System]

[0049] Figure 1 is a diagram for explaining the use example of the foot input system of the first embodiment. As shown in Figure 1 , the computer drawing system is configured by a pen tablet device TB, an electronic pen PN, a so-called joystick JS, a display DP, and a computer main body. In Figure 1 , the computer main body is not shown, but the pen tablet device TB, the joystick JS, and the display DP are connected to the computer main body.

[0050] In a case where the drawing input is performed using the computer drawing system, the drawing input is performed to the pen tablet device TB disposed on a desk using the electronic pen PN. The image (drawing image) corresponding to the drawing input is displayed on the display DP. The user can rotate the drawing image in various directions by operating the so-called joystick JS, and the user can perform the fine drawing input to the portion of the drawing image as the target by the pen tablet device TB using the electronic pen PN.

[0051] In the case of the computer drawing system of this embodiment, a foot input system can be further used. The foot input system is constituted by a foot position indicating tool 100 and a foot position detecting device 200. As shown in Figure 1

[0052] The foot position detecting device 200 is a member in the shape of a foot mat, which is located on the lower side of the foot position indicating tool 100, and which functions to detect the indicating position of the foot position indicating tool 100. The foot position detecting device 200 can be connected to the computer main body and supply a detection output thereto. Also, operations such as movement, enlargement, reduction, and the like of the drawing image, which have been performed by operations on icons displayed on the display DP and the like in the past, can be performed using the foot input system.

[0053] Specifically, by moving the foot position indicating tool 100 on the foot position detecting device 200, the drawing image can be moved on the display screen of the display DP. Also, by raising and lowering the toe side of the foot position indicating tool 100 in a state in which the heel side is abutted against the foot position detecting device 200, enlargement and reduction of the drawing image can be performed. This is an example, and various kinds of indicating input can be performed using the foot input system by a program which performs actions in the computer drawing system.

[0054] Thus, the foot position input system can function as an input device (input system) of the computer drawing system. Also, in this embodiment, as will be described later, the foot input system can indicate a position by the foot position indicating tool 100 using an electromagnetic induction system, or can detect a pressure applied to the foot position indicating tool 100 and notify the pressure. Hereinafter, a structure example of the foot position indicating tool 100 and the foot position detecting device 200 which constitute the foot input system will be described in detail.

[0055] <Structure Example of Foot Position Indicating Tool 100>

[0056] Figure 2 Figure 3 is a diagram for explaining a structure example of the foot position indicating tool 100 of the first embodiment. As shown in Figure 2 Figure 2 ​​​As shown in (A), the foot position indicating tool 100 has a shoe sole front portion 101 on the lower side of the toe side, a shoe sole rear portion 103 on the lower side of the heel side, and a shoe sole middle portion 102 on the lower side of the instep side connecting the shoe sole front portion 101 and the shoe sole rear portion 103.

[0057] The position indicating unit 101U including the coil 101L and the pressure sensor 101P is provided in the shoe sole front portion 101. Also, the position indicating unit 103U including the coil 103L and the pressure sensor 103P is provided in the shoe sole rear portion 103. More specifically, as shown in (A), the position indicating unit 101U is configured by connecting the coil 101L, the capacitor 101C, and the pressure sensor 101P in parallel. Similarly, the position indicating unit 103U is configured by connecting the coil 103L, the capacitor 103C, and the pressure sensor 103P in parallel. Figure 3

[0058] That is, the position indicating unit 101U is configured as a resonance circuit by connecting the coil 101L and the capacitor 101C in parallel, and functions to transmit a position indicating signal by cooperating with the foot position detecting device 200 described later. Also, the pressure sensor 101P is configured as a variable capacity capacitor, and is configured to change the electrostatic capacity according to the applied pressure. By connecting the pressure sensor 101P in parallel with the resonance circuit configured by the coil 101L and the capacitor 101C, the phase of the resonance frequency can be changed according to the electrostatic capacity, and information of the detected pressure can be included in the position indicating signal and transmitted. The position indicating unit 103U is also configured similarly to the position indicating unit 101U.

[0059] As shown in (A), the foot position indicating tool 100 has a shoe sole front portion 101 on the lower side of the toe side, a shoe sole rear portion 103 on the lower side of the heel side, and a shoe sole middle portion 102 on the lower side of the instep side connecting the shoe sole front portion 101 and the shoe sole rear portion 103. Figure 1 Figure 3 As shown in (A), the foot position indicating tool 100 has a shoe sole front portion 101 on the lower side of the toe side, a shoe sole rear portion 103 on the lower side of the heel side, and a shoe sole middle portion 102 on the lower side of the instep side connecting the shoe sole front portion 101 and the shoe sole rear portion 103. Figure 3 As shown in (A), the foot position indicating tool 100 has a shoe sole front portion 101 on the lower side of the toe side, a shoe sole rear portion 103 on the lower side of the heel side, and a shoe sole middle portion 102 on the lower side of the instep side connecting the shoe sole front portion 101 and the shoe sole rear portion 103.

[0060] ​​Further, in this embodiment, the resonant frequency of the position indicating unit 101U of the front portion 101 of the sole is set to, for example, a frequency fl, and the resonant frequency of the position indicating unit 103U of the rear portion of the sole is set to a frequency f2, which are different from each other. Thus, on the side of the foot position detection device 200, it is possible to distinguish and detect the position and pressure corresponding to the position indicating signal from the position indicating unit 101U and the position and pressure corresponding to the position indicating signal from the position indicating unit 103U. That is, it is possible to distinguish and detect the position of the front portion 101 of the sole and the position of the rear portion 103 of the sole and the pressure applied to each of them.

[0061] <Structure Example of Foot Position Detection Device 200>

[0062] Figure 4 is a block diagram for explaining a structure example of the foot position detection device 200 of this embodiment configured by applying the electromagnetic induction method. The foot position detection device 200 is roughly divided into a position detection sensor 201 and a position detection circuit 202. The position detection sensor 201 is configured by stacking an X-axis direction annular coil group 201X and a Y-axis direction annular coil group 201Y. Also, as shown in Figure 1 , the position detection sensor 201 is disposed under the user's foot and used at the lower side of the foot position indicating tool 100.

[0063] Further, each of the annular coils X1 to X40 of the X-axis direction annular coil group 201X and the annular coils Y1 to Y30 of the Y-axis direction annular coil group 201Y configuring the position detection sensor 201 is either one turn or two or more turns. In addition, the number of annular coils of each of the annular coil groups 201X and 201Y can be set to an appropriate number according to the size of the position detection sensor 201.

[0064] The position detection circuit 202 is configured by an oscillator 204, a current driver 205, a selection circuit 206, a switching connection circuit 207, a reception amplifier 208, a position detection circuit 209, a pressure detection circuit 210, and a control section 211. The control section 211 is configured by a microprocessor. The control section 211 controls the selection of the annular coils in the selection circuit 206, the switching of the switching connection circuit 207, and the processing timing in the position detection circuit 209 and the pressure detection circuit 210.

[0065] And, the X-axis direction loop coil group 201X and the Y-axis direction loop coil group 201Y of the position detection sensor 201 are connected to a selection circuit 206. The selection circuit 206 selects one loop coil of the two loop coil groups 201X, 201Y in turn. An oscillator 204 generates an alternating current signal of a frequency f0. The oscillator 204 supplies the generated alternating current signal to a current driver 205 and a pressure detection circuit 210. The current driver 205 converts the alternating current signal supplied from the oscillator 204 into a current and sends it out to a switching connection circuit 207.

[0066] The switching connection circuit 207 switches the connection destination (transmission side terminal T, reception side terminal R) connected to the loop coil selected by the selection circuit 206 by control from a control section 211. The current driver 205 is connected to the transmission side terminal T in the connection destination, and a reception amplifier 208 is connected to the reception side terminal R. Also, in the case of transmitting a signal from the position detection sensor 201, the switching connection circuit 207 is switched to the terminal T side, and conversely, in the case of the position detection sensor 201 receiving a signal from the outside, the switching connection circuit 207 is switched to the terminal R side.

[0067] Also, in the case where the switching connection circuit 207 is switched to the terminal T side, a current from the current driver 205 is supplied to the loop coil selected by the selection circuit 206. Thereby, a magnetic field is generated in the loop coil, and it is possible to act on the resonant circuit possessed by the position indication unit 101U, 103U of the foot position indication tool 100 in the opposite direction to transmit a signal (electrical wave).

[0068] On the other hand, in the case where the switching connection circuit 207 is switched to the terminal R side, an induced voltage generated in the loop coil selected by the selection circuit 206 is transmitted to the reception amplifier 208 via the selection circuit 206 and the switching connection circuit 207. The reception amplifier 208 amplifies the induced voltage supplied from the loop coil and sends it out to a position detection circuit 209 and a pressure detection circuit 210.

[0069] That is, in each of the loop coils of the X-axis direction loop coil group 201X and the Y-axis direction loop coil group 201Y, an induced voltage is generated by an electrical wave (position indication signal) transmitted from the position indication unit 101U, 103U of the foot position indication tool 100. The position detection circuit 209 detects the induced voltage generated in the loop coil, that is, the received signal, converts it into a digital signal, and outputs it. The control section 211 calculates the coordinate value of the indicated position in the X-axis direction and the Y-axis direction based on the position indication signal from the position indication unit 101U, 103U based on the level of the voltage value of the induced voltage generated in each loop coil from the position detection circuit 209.

[0070] On the other hand, the pressure detection circuit 210 performs synchronous detection of the output signal of the reception amplifier 208 using the AC signal from the oscillator 204, obtains a signal of a level corresponding to the phase difference (frequency offset) between them, converts the signal corresponding to the phase difference (frequency offset) into a digital signal, and outputs it to the control section 211. The control section 211 detects the pressure of the pressure sensor 101P, 103P applied to the position indicating unit 101U, 103U based on the digital signal from the pressure detection circuit 210, that is, the level of the signal corresponding to the phase difference (frequency offset) of the transmitted and received electric waves.

[0071] Figure 5 is a diagram for describing height information and angle information that can be input using the foot position indicating tool 100. As shown in (A) of Figure 5 , the foot position indicating tool 100 can perform the following operation: in a state where the shoe sole rear portion 103 side is in contact with the position detection sensor 201, the shoe sole front portion 101 is lifted away from the position detection sensor 201. In this case, the control section 211 can also detect the distance (height) h of the position indicating unit 101U of the foot position indicating tool 100 from the position detection sensor 201 based on the level of the voltage value of the induced voltage generated in each annular coil.

[0072] In addition, as shown in (A) of Figure 5 , the distance 1 between the position indicating unit 101U installed in the shoe sole front portion 101 and the position indicating unit 103U installed in the shoe sole rear portion 103 is determined at the time point of installation. Thus, the control section 211 can also calculate the angle of the angle θ formed by the position detection sensor 201 and the bottom surface of the foot position indicating tool 100 according to "tan θ = h / l".

[0073] In addition, the foot position indicating tool 100 can also perform the following operation: in contrast to the state shown in (B) of Figure 5 , in a state where the shoe sole front portion 101 side is in contact with the position detection sensor 201, the shoe sole rear portion 103 is lifted away from the position detection sensor 201. In this case, the height angle can also be calculated in the same manner as in the case described using Figure 5 . That is, the distance (height) of the position indicating unit 103U from the position detection sensor 201 can be detected. In addition, the angle of the angle formed by the position detection sensor 201 and the bottom surface of the foot position indicating tool 100 in the state where the shoe sole rear portion 103 is lifted can also be calculated.

[0074] Figure 6is a diagram for describing angle information that can be input using the foot position indicating tool 100. As shown in Figure 6 (A) of FIG. 1, the foot position indicating tool 100 can rotate the forefoot portion 101 in the left direction or the right direction with the hindfoot portion 103 as the center on the position detection sensor 201. The control section 211 can also detect in which direction and by how much the forefoot portion 101 of the foot position indicating tool 100 is rotated, in accordance with a change in the position of the position indicating unit 101U of the foot position indicating tool 100.

[0075] For example, as shown in Figure 6 (B) of FIG. 1, it is assumed that the position of the position indicating unit 103U provided in the hindfoot portion 103 does not change, the forefoot portion 101 is rotated to the right side as indicated by the arrow, and only the indicating position of the position indicating unit 101U is changed. In this case, the length (distance) 1 between the position indicating unit 103U and the position indicating unit 101U does not change. Therefore, an isosceles triangle is formed with the position indicating unit 103U as the vertex and the indicating positions P0 of the position indicating unit 101U before rotation and P1 of the position indicating unit 101U after rotation as the two sides of the base.

[0076] The positions indicated by the position indicating unit 103U and the positions P0, P1 indicated by the position indicating unit 101U can be detected in the control section 211 as described above, and therefore the length a of the base with the positions P0 and P1 as the two ends can also be calculated in the control section 211. Similarly, the distance of the vertex indicated by the position indicating unit 103U from the midpoint of the base, that is, the height h of the isosceles triangle, can also be calculated in the control section 211.

[0077] If the length a of the base and the height h of the isosceles triangle are known, the base angle θ can be calculated by Figure 6 (1) of (B) of FIG. 1. Thus, as shown in Figure 6 (2) of (B) of FIG. 1, if the sum of the two base angles, that is, 180 degrees, is subtracted from the sum of the internal angles of the triangle, the angle of the vertex In this example, the angle becomes information (rotation amount) indicating how much the forefoot portion 101 is rotated to the right side. In the case where the forefoot portion 101 is rotated to the left side, only the direction of rotation is changed, and the calculation of the rotation amount can also be performed similarly.

[0078] In addition, the foot position indicating tool 100 can also rotate the hindfoot portion 103 in the left direction or the right direction with the forefoot portion 101 as the center on the position detection sensor 201. In this case, the same can be performed as in the case of using Figure 6Similarly, the method described above detects how much the rear part 103 of the sole has rotated to the left or right. In this way, various information can be input using the foot position indicator 100, thus enabling display control of the depicted image using this input information.

[0079] If we give an example, such as using Figure 5 As explained, when the front part of the sole 101 is raised and lowered without moving the rear part 103, the magnified display of the depicted image can be adjusted; when the rear part of the sole 103 is raised and lowered without moving the front part 101, the reduced display of the depicted image can be adjusted. Furthermore, if using... Figure 6 As explained, when the front part of the sole 101 is rotated left and right without moving the rear part 103 of the sole, the image can be rotated left and right for display. Furthermore, when the rear part of the sole 103 is rotated left and right without moving the front part 101 of the sole, the image can be rotated up and down for display.

[0080] In this case, control can be performed based on the height of the detected position indicator units 101U and 103U from the position detection sensor 201, and the angle of the entire sole of the foot position indicator 100 relative to the position detection sensor 201. Furthermore, it is also possible to detect the pressure applied to the pressure sensor 101P mounted on the front part 101 of the sole and the pressure sensor 103P mounted on the rear part of the sole. Therefore, it is also possible to perform controls such as magnifying the image based on the intensity of troweling at the front part 101 of the sole and reducing the image based on the intensity of troweling at the rear part 103 of the sole. This control is one example; various other controls can be performed based on information input from the foot input system via the computer image processing program.

[0081] In addition, in use Figure 5 , Figure 6 In the illustrated example, either the front part 101 or the rear part 103 of the sole of the foot position indicator 100 contacts the position detection sensor 201. However, this is not the only possibility. For example, when both the front part 101 and the rear part 103 of the sole are lifted or lowered from the position detection sensor 201, this state can be detected in the foot position detection device 200, and thus, display control, such as image display, can be performed based on this state. Furthermore, both the front part 101 and the rear part 103 of the sole can be rotated to the left or right after being lifted from the position detection sensor 201. And, this state can also be detected in the foot position detection device 200, thus, display control, such as image display, can also be performed based on this state.

[0082] <Effects of the first embodiment>

[0083] According to the foot input system of the above-described first embodiment, various detailed information such as position, pressure, height, angle, and the like can be input using the user's foot. These pieces of information are detected in the position detection circuit 202 of the foot position detection device 200, and the detected information is input to the computer main body that processes image data, and can be utilized as a parameter of image processing. Thus, various instructions such as enlargement, reduction, rotation, adjustment of image quality, and the like of a drawn image, which have been performed by using a user's hand in the past, can be performed using the foot input unit. That is, the foot input unit makes it possible to perform new input operations for a multipurpose use.

[0084] Furthermore, in the foot input unit, by employing an electromagnetic induction method, a configuration without a battery is achieved, durability is excellent, and movement is also possible in a state in which the foot position instruction tool 100 is worn on the foot. Thus, handling becomes easy, and an input device with good ease of use can be provided.

[0085] In addition, in a utilization scenario of a technology such as VR, AR, or MR, a new input means can be provided, and more flexible instruction input can be achieved. Thus, more flexible information input in a field such as VR, AR, or MR can be achieved.

[0086] For example, if a large room is prepared as a VR space, and the position detection sensor 201 is provided on the entire surface below the user in the room, a large three-dimensional VR object can be formed in the room, and drawing of the three-dimensional VR object can be performed while moving in the room. In this way, in a utilization scenario of a technology such as VR, AR, or MR, more flexible instruction input can be achieved, immersion into a three-dimensional space is not hindered, fatigue of the user's body can be reduced, and both fine work and rough work can be accommodated.

[0087] [Second Embodiment]

[0088] <Structure Example of Foot Input System, Image Processing System>

[0089] Figure 7 is a diagram for explaining a use example of the foot input system of the second embodiment. The foot input system of the second embodiment, like the foot input system of the first embodiment, is configured of a foot position instruction tool 300 that is worn on the user's foot like footwear and a foot position detection device 400 that is disposed on the lower side of the foot position instruction tool 300. In the second embodiment, as with the first embodiment, the foot position instruction tool 300 is configured of a shoe 310 and a foot position instruction tool 320 that is attached to the shoe 310. Figure 7As shown, a foot position detection device 400, a head-mounted display (hereinafter, referred to as HMD) 500, and a game controller 600 are connected to an image processing device 700 to be described later.

[0090] The foot input system composed of the foot position indication tool 300 and the foot position detection device 400 and the game controller 600 function as input devices that accept indication input from a user and supply the accepted indication input to the image processing device 700. The HMD 500 is a head-mounted display (display device), and in this embodiment, as shown, is worn on the head of the user in a manner to cover both eyes of the user. Figure 7

[0091] As shown in Figure 7 , the image processing device 700 can form a three-dimensional space image (three-dimensional modeling image) of 360 degrees that covers the surroundings of the user, and supply it to the HMD 500. In this embodiment, the image processing device 700 functions as a so-called computer game machine that provides a game using the three-dimensional space image to the user.

[0092] Figure 8 is a diagram for explaining the overall structure of an image processing system composed of a foot input system using the second embodiment. As shown in Figure 8 , the image processing device 700 is provided with a three-dimensional image data file 701, a three-dimensional part image file 702, an image processing section 703, communication sections 704, 705, and an I / F (Inter Face) 706. The communication section 704 is used for wireless communication with the HMD 500. The communication section 705 is used for receiving indication input from the game controller. The I / F 706 is used for accepting detection output from the foot position detection device 400 (indication input using the foot position indication tool 300).

[0093] In this way, the image processing device 700 and the HMD 500 can communicate bidirectionally through wireless. In addition, the image processing device 700 and the game controller 600 are connected through wireless, and at least the image processing device 700 can accept indication input from the game controller 600. In addition, the image processing device 700 and the foot position detection device 400 are connected through wire, and the image processing device 700 can accept detection output from the foot position detection device 400.

[0094] ​Further, as for the HMD 500 and the game controller 600, it is also possible to connect with a wire with respect to the image processing apparatus 700. However, the HMD 500 and the game controller 600 are worn by or held by the user whose body orientation is sometimes changed. Thus, the HMD 500 and the game controller 600 are preferably connected with respect to the image processing apparatus 700 by wireless without a connecting cable which is worried about being entangled with the body or the like. In addition, it is also possible to wirelessly connect the foot position detection apparatus 400 and the image processing apparatus 700. However, the foot position detection apparatus 400 does not move along with the movement of the user, and thus, even a connection based on a wire does not cause a problem.

[0095] The three-dimensional image data file 701 stores and holds three-dimensional image data which forms a three-dimensional space image. The three-dimensional part image file 702 stores and holds three-dimensional part image data which forms various three-dimensional part images such as a virtual figure or the like which are displayed within the three-dimensional space image. The image processing section 703 forms three-dimensional space image data which is supplied to the HMD 500 using the three-dimensional image data of the three-dimensional image data file 701 and the three-dimensional part image data of the three-dimensional part image file 702, and supplies it to the HMD 500.

[0096] The HMD 500 has a display HDP which displays a three-dimensional space image, and has a 6-axis sensor which is constituted by, for example, a 3-axis gyro sensor and a 3-axis angular velocity sensor, and can detect a rotation direction and a rotation angle. Thus, the HMD 500 can display a three-dimensional space image which corresponds to three-dimensional image data from the image processing apparatus 700 on the display HDP, and can transmit the detected rotation direction and rotation angle to the image processing apparatus 700. Thus, if the user who wears the HMD 500 on the head performs an action of rotating the head in a manner of facing left or right, or looking up or down, the 6-axis sensor mounted on the HMD 500 detects how much is rotated in which direction, and notifies it to the image processing apparatus 700.

[0097] The image processing section 703 of the image processing apparatus 700 determines in which direction the user's both eyes are facing based on the detection output from the 6-axis sensor of the HMD 500, forms three-dimensional space image data of the viewing direction, and supplies it to the HMD 500. Thus, the user can view a three-dimensional space image which corresponds to the direction in which the user's both eyes are facing through the display HDP of the HMD 500.

[0098] In addition, the image processing section 703 of the image processing apparatus 700 can generate three-dimensional space image data in which a virtual figure is added to the three-dimensional space image displayed on the display of the HMD 500, for example, in accordance with the instruction input from the game controller 600, and supply the three-dimensional space image data to the HMD 500. In this way, the three-dimensional space image changed in accordance with the instruction input via the game controller 600 can be viewed through the display HDP of the HMD 500.

[0099] Furthermore, the image processing section 703 of the image processing apparatus 700 can perform enlargement, reduction, and the like of the three-dimensional space image displayed on the display of the HMD 500 in accordance with the detection output from the foot position detection apparatus 400 (the instruction input using the foot position instruction tool 300). Details will be described later, but the three-dimensional space image displayed on the display of the HMD 500 can be enlarged, reduced, or the viewpoint position can be shifted to the left or right in the three-dimensional space image by moving the foot position instruction tool 300 worn on the user's foot on the foot position detection apparatus 400.

[0100] That is, if the foot position instruction tool 300 is slid on the foot position detection apparatus 400 in a direction in which the length direction of the foot and the front of the body are oriented, the image processing apparatus 700 can be instructed to enlarge the three-dimensional space image. In contrast, if the foot position instruction tool 300 is slid on the foot position detection apparatus 400 in a direction in which the length direction of the foot and the back of the body are oriented, the image processing apparatus 700 can be instructed to reduce the three-dimensional space image.

[0101] In addition, the foot position instruction tool 300 is provided to be slid on the foot position detection apparatus 400 in a direction in which the length direction of the foot and the left side of the body are oriented. In this case, the viewpoint position can be moved to the left in the three-dimensional space image, and the three-dimensional space image viewed from the moved position can be displayed. In contrast, the foot position instruction tool 300 is provided to be slid on the foot position detection apparatus 400 in a direction in which the length direction of the foot and the right side of the body are oriented. In this case, the viewpoint position can be moved to the right in the three-dimensional space image, and the three-dimensional space image viewed from the moved position can be displayed.

[0102] Thus, as described above, the user can move the viewpoint position in the three-dimensional space image displayed on the display of the HMD 500 by moving the foot position instruction tool 300 on the foot position detection apparatus 400. Figure 7As shown, the user who wears the HMD 500 on the head, holds the game controller 600 in the hand, and places the right foot on which the foot position indicating tool 300 is worn on the foot position detection device 400 can enjoy a game using a three-dimensional space image. In this case, the user can change the direction of view by performing an action of rotating the head to the left or right or looking up or down, and the three-dimensional space image displayed on the display of the HMD 500 is changed in accordance with this.

[0103] In addition, by operating the game controller 600, it is possible to change the display of a three-dimensional image object such as a virtual figure within the displayed three-dimensional space image. Furthermore, by moving the foot position indicating tool on the foot position detection device 400, it is possible to perform enlargement, reduction, and movement of the viewpoint position to the left or right of the three-dimensional space image.

[0104] Further, the rotation of the head is not limited to the case of rotating only the head, but also includes the case of rotating the entire body of the user. Therefore, as shown in Figure 7 As shown, the user can enjoy a game using the three-dimensional space image of the entire circumference of the 360-degree image area GA while freely performing a rotational movement (rotating the entire body to greatly change the orientation of one's own body, etc.). Furthermore, it is possible to perform enlargement, reduction, movement of the viewpoint position to the left or right in the three-dimensional space image, etc. by the foot position indicating tool 300 and the foot position detection device 400 regardless of the three-dimensional space image of which direction. In this way, by the rotation of the head and the operation of the feet, it is possible to dynamically change the three-dimensional space image and enjoy a game.

[0105] <Structure Example of Foot Position Indicating Tool>

[0106] Figure 9 is a drawing for explaining a structure example of the foot position indicating tool 300 of the second embodiment, Figure 9 (A) of FIG. 10 is a drawing of the front side of the foot position indicating tool 300, Figure 9 (B) of FIG. 10 is a drawing of the back side of the foot position indicating tool 300. As shown in Figure 9 As shown in (A) of FIG. 10, the foot position indicating tool 300 has a plate-shaped sole portion 301 facing the entire surface of the sole of the user. The sole portion 301 is constituted by a front sole portion 301f located on the lower side of the toe portion of the user's foot, a rear sole portion 301b located on the lower side of the heel portion of the user's foot, and a middle sole portion 301c connecting the front sole portion 301f and the rear sole portion 301b. A toe side band holding portion 301L, 301R for holding a band for fixing the foot position indicating tool 300 to the user's foot is provided in the front sole portion 301f.

[0107] A heel-side fixing part 302 is provided on the rear part 301b of the sole. Figure 9 In (A), the heel-side fixing part 302 is shown separated from the sole 301 so that the entire structure of the rear part 301b of the sole can be viewed. However, in reality... Figure 9 As shown in (B), the heel-side fixing portion 302 is integrally formed with the bottom portion 302a that covers the rear portion 301b and the middle portion 301c of the sole 301 from its underside. On the upper side of the bottom portion 302a of the heel-side fixing portion 302, as shown... Figure 9 As shown in (B), the rear part 301b and the middle part 301c of the sole 301 are mounted facing each other and are fixed by the sole retaining parts 302SL and 302SR of the bottom part 302a. Alternatively, the bottom part 302a of the heel-side fixing part 302 and the rear part 301b and the middle part 301c of the sole 301 can be glued and fixed using adhesive.

[0108] In addition, such as Figure 9 As shown in (A), the heel-side fixing portion 302 is provided with heel-side strap holding portions 302L and 302R for holding the strap through which the foot position indicator 300 is fixed to the user's foot. By positioning the user's toe portion between the front portion 301f of the sole 301 and the strap passing through the aforementioned toe-side strap holding portions 301L and 301R, the user's toe portion can be fixed to the front portion 301f of the sole. If the user's heel portion is placed on the rear portion 301b of the sole, and the strap passing through the heel-side strap holding portions 302L and 302R is fastened to cover the opposite side of the heel portion, the user's heel side can be fixed to the rear portion 301b of the sole. Thus, the entire foot position indicator 300 can be fixed to the user's foot.

[0109] Furthermore, in the foot position indicator 300 of this embodiment, a left position indicator unit 303L is provided on the left end side of the rear part 301b of the sole, and a right position indicator unit 303R is provided on the right end side of the rear part 301b of the sole. Additionally, a rear position indicator unit 303C is provided at the center of the rear end side of the rear part 301b of the sole. The basic structure and use of these three position indicator units 303L, 303R, and 303C are as follows. Figure 3 The position indication units 101U and 103U described are identical, consisting of a signal transmitting coil, a capacitor, and a pressure sensor. Furthermore, in this embodiment, position indication units 303L, 303R, and 303C are configured to transmit signals at different frequencies.

[0110] These position indicator units 303L, 303R, and 303C form an isosceles triangle on the bottom surface of the rear part 301b of the sole, with the left position indicator unit 303L and the right position indicator unit 303R as the two ends and the rear position indicator unit 303C as the vertex. With these position indicator units 303L, 303R, and 303C arranged in this way, it is possible to detect whether the foot position indicator 300 has moved forward or backward. Furthermore, regarding the foot position indicator 300, forward movement means movement in the direction of a line extending from the heel towards the toe, and backward movement means movement in the direction of a line extending from the toe towards the heel.

[0111] Moreover, such as Figure 9 As shown in (B), a movable range limiting plate 304 is provided on the back of the rear part 301b of the sole, clamping the bottom part 302a of the heel-side fixing part 302. This movable range limiting plate 304 engages with an annular protrusion on the operating surface of the foot position detection device 400 (described later) that surrounds the outer edge of the movable range limiting area, thereby limiting the movable range of the foot position indicator 300 on the foot position detection device 400. Thus, the foot position indicator 300 of this embodiment is composed of the sole 301, the heel-side fixing part 302, the position indicator units 303L, 303R, 303C, and the movable range limiting plate 304.

[0112] <Structural Example of Foot Position Detection Device 400>

[0113] Figure 10 This is a diagram illustrating a structural example of the foot position detection device 400 according to the second embodiment. Figure 10 middle, Figure 10 (A) is a front view of the foot position detection device 400. Figure 10 Figure (B) is a schematic diagram showing the internal structure of the foot position detection device 400. The foot position detection device 400 detects the position of the foot by using... Figure 4 The foot position detection device 200 described herein is constructed by providing a circular and flat operating surface (top plate) 401 on its upper side. The aforementioned foot position indicator 300 is mounted on the operating surface 401 for various operations. An annular protrusion 403, shaped like a ring, is provided in the central portion of the operating surface 401, and its inner side forms a movable range restriction area 402.

[0114] The movable range limiting plate 304 of the aforementioned foot position indicator 300 is located inside the movable range limiting region 402. Therefore, even when the foot position indicator 300 is moved significantly, the side of the movable range limiting plate 304 engages with the annular protrusion 403, restricting further outward movement. Furthermore, if necessary, the movable range limiting plate 304 can also move beyond the annular protrusion 403 onto the operating surface 401.

[0115] Thus, while the foot position indicator 300 can move freely on the operating surface 401, the movable range limiting plate 304 typically allows for various operational inputs through free movement within the movable range limiting region 402 on the operating surface 401. Furthermore, within the movable range limiting region 402, straight line markings are shown in the reference direction K and in directions orthogonal to it; the reference direction and its orthogonal direction can also be visually identified. As will be described later, the intersection of these straight line markings becomes the origin O of the reference coordinate system.

[0116] Furthermore, an identification groove 404 is provided on the outer periphery of the operating surface 401 in the direction indicated by the reference direction K. By inserting the front portion 301f of the sole of the foot position indicator 300 relative to the identification groove 404, the user can identify the initial position and initial angle of the foot position indicator 300 on the operating surface 401. Specifically, by abutting the front end of the front portion 301f against the inner wall portion 405 of the inner opening of the identification groove 404, the user can identify that the foot position indicator 300 is located in the inner opening of the identification groove 404. That is, the user can identify that the foot position indicator 300 is in its initial position on the operating surface 401.

[0117] Furthermore, when necessary, the front part 301f of the sole of the foot position indicator 300 can be engaged with the recognition groove 404. This allows the user to more reliably determine the position of the foot position indicator 300 on the operating surface 401 by engaging it with the recognition groove 404. Then, by retracting the foot position indicator 300, the front end of the sole 301f abuts against the inner wall 405 of the inner opening of the recognition groove 404, thus positioning the foot position indicator 300 in its initial position on the operating surface 401.

[0118] If used Figure 4 As mentioned above, in addition, such as Figure 10 As shown in (B), the foot position detection device 400 consists of a quadrilateral position detection sensor 201 and a position detection circuit 202. Figure 10 In (B), regarding the position detection circuit 202, the following is used:Figure 4 The position detection circuit 202 described herein is configured as follows: Figure 10 The position detection circuit 202 of (B) is shown inside the housing. Figure 10 In (B), cable 221 extending from position detection circuit 202 is connected to I / F 706 of image processing device 700. Furthermore, in this embodiment, as... Figure 10 As shown in (B), the foot position detection device 400 includes a wireless communication unit 222 and a battery 223. The wireless communication unit 222 can also be connected wirelessly to the image processing device 700, and the battery 223 supplies driving power to various parts of the foot position detection device 400.

[0119] In this embodiment, from Figure 10 As can be seen from (B), the position detection sensor 201 is positioned with the identification slot 404 tilted 45 degrees to the left of the reference direction K relative to the operating surface 401. This reduces the frequent occurrence of the two position indicator units landing on the same position detection coil at the initial position and its surrounding angles, thus reducing fluctuations in the signal waveform along the time axis, i.e., the so-called wobbling, and improving the accuracy of position detection.

[0120] Furthermore, in the foot position detection device 400 of this embodiment, the frequencies of signals transmitted from the position indication units 303L, 303R, and 303C provided in the foot position indication device 300 are stored, for example, in the memory provided in the control unit 211. Therefore, the foot position detection device 400 can be used to detect which position indication unit is indicating which position.

[0121] <Example of using a foot input system>

[0122] Figure 11 This is a diagram illustrating an example of using the foot input system of the second embodiment. Figure 11 middle, Figure 11 (A) is a diagram illustrating the positional relationship of the three position indicator units 303L, 303R, and 303C located on the rear part 301b of the sole of the foot position indicator 300. Additionally, Figure 11 Figure (B) shows the case where the foot position indicator 300 is placed at the initial position on the operating surface 401 of the foot position detection device 400. Additionally, Figure 11 (C) is to Figure 11 The diagram shown in (B) illustrates the view from the side (lateral) of the position indicator 300 at the foot. Figure 11In (C) of FIG. 10, only the operation surface 401 of the foot position detection device 400 is shown as a cross section, and the entire foot position indicating tool 300 is shown as viewed from the side surface side.

[0123] As shown in (A) of FIG. 1, in the shoe sole rear portion 301b of the foot position indicating tool 300 of this embodiment, a left position indicating unit 303L and a right position indicating unit 303R are provided at positions that are objects of the left and right, respectively, near the shoe sole middle portion 301c. Further, a rear position indicating unit 303C is provided at the center of the rear end side of the shoe sole rear portion 301b. Figure 9 As shown in (A) of FIG. 1, these three position indicating units 303L, 303R, 303C form a triangle with each as a vertex. Figure 11 As shown in (A) of FIG. 1, these three position indicating units 303L, 303R, 303C form a triangle with each as a vertex.

[0124] In this example, the distance from the left position indicating unit 303L to the rear position indicating unit 303C is equal to the distance from the right position indicating unit 303R to the rear position indicating unit 303C. Therefore, an isosceles triangle is formed in which the left position indicating unit 303L and the right position indicating unit 303R are the two ends of the base and the rear position indicating unit 303C is the vertex. In other words, the line segment connecting the left position indicating unit 303L and the right position indicating unit 303R is the base, and the line segments connecting the rear position indicating unit 303C and the left position indicating unit 303L and the rear position indicating unit 303C and the right position indicating unit 303R are the legs.

[0125] As shown in (A) of FIG. 1, a position indicating coordinate system (transmission coil coordinate system) defined by the three position indicating units 303L, 303R, 303C is formed. Figure 11 As shown in (A) of FIG. 1, a position indicating coordinate system (transmission coil coordinate system) defined by the three position indicating units 303L, 303R, 303C is formed.

[0126] In this embodiment, as the coordinate system that determines the moving direction and the moving amount of the foot position indicating tool 300, this position indicating coordinate system defined by the left position indicating unit 303L, the right position indicating unit 303R, and the rear position indicating unit 303C is used as one reference. However, since this position indicating coordinate system is a coordinate system defined by the three position indicating units 303L, 303R, 303C provided to the foot position indicating tool 300, if the foot position indicating tool 300 moves, this coordinate system also moves.

[0127] Therefore, another reference coordinate system is established. In this case, such as... Figure 10 As shown in (A), the center O of the circular movable range limiting area 402 provided on the operating surface 401 of the foot position detection device 400 is set as the origin O of the reference coordinate system. A straight line passing through the origin O and parallel to the x-axis of the position indication coordinate system is set as the x-axis of the reference coordinate system. Furthermore, a straight line passing through the origin O and parallel to the y-axis of the position indication coordinate system is set as the y-axis of the reference coordinate system. The change in position of the origin (center of gravity) G of the position indication coordinate system in this defined reference coordinate system becomes the indication input in the foot input system.

[0128] The following explains the reference coordinate system and the position indication coordinate system. First, in Figure 11 In (A), the point on the inside of the isosceles triangle formed by the three position indicating units 303L, 303R, and 303C represents the centroid G of the isosceles triangle. Assume that the foot position indicating device 300 is mounted on the operating surface 401 of the foot position detection device 400. In this case, the position on the position detection sensor 201 corresponding to the centroid G of the isosceles triangle formed by the position indicating units 303L, 303R, and 303C is detected in the foot position detection device 400 as the indicated position of the foot position indicating device 300.

[0129] First, such as Figure 11 As shown in (B), consider the case where a foot position indicator 300 is mounted on the operating surface 401 of the foot position detection device 400. Figure 11 The state shown in (B) is the state viewed from the front side of the foot using the position indicator device 300. Figure 11 The state shown in (C). From Figure 11 As can be seen from (B) and (C), in this example, the movable range limiting plate 304 provided on the lower side of the rear part 301b of the sole of the foot position indicator 300 is located in the movable range limiting area 402 on the operating surface 401 of the foot position detection device 400. At the same time, the front end of the front part 301f of the sole of the foot position indicator 300 is in a state of contact or immediate contact with the inner wall 405 of the inner opening of the identification groove 404 provided in the foot position detection device 400.

[0130] Figure 11position indicating tool 300 placed on the operation surface 401 of the foot position detection device 400. In this case, the center of gravity G of the isosceles triangle formed by the left position indicating unit 303L, the right position indicating unit 303R, and the rear position indicating unit 303C provided at the rear shoe portion 301b of the foot position indicating tool 300 coincides with the center of the movable range restriction area 402 on the operation surface 401. The center of the movable range restriction area becomes the origin O of the reference coordinate system. In addition, in practice, the center of gravity (origin) G of the isosceles triangle (position indicating coordinate system) coincides with the origin O of the reference coordinate system in rare cases, and thus, in a case where the center of gravity G is within a prescribed range centered on the origin O, it can be considered that the foot position indicating tool 300 is in the initial position on the foot position detection device 400.

[0131] Thus, the origin of the reference coordinate system is the center of the movable range restriction area, but the orientations of the X axis and the Y axis of the reference coordinate system are determined in accordance with the x axis and the y axis of the position indicating coordinate system determined based on the orientation of the foot position indicating tool 300. In other words, the orientation of the position indicating coordinate system is determined by the orientation of the isosceles triangle formed by the left position indicating unit 303L, the right position indicating unit 303R, and the rear position indicating unit 303C provided at the foot position indicating tool 300.

[0132] Thus, regardless of the orientation in which the foot position indicating tool 300 placed on the operation surface 401 of the foot position detection device 400 is placed, if the foot position indicating tool 300 is moved in the lengthwise direction, the movement of the indicating position (center of gravity G) can be detected as a change in the Y axis direction of the reference coordinate system. In addition, regardless of the orientation in which the foot position indicating tool 300 placed on the operation surface 401 of the foot position detection device 400 is placed, if the foot position indicating tool 300 is moved in a direction orthogonal to the lengthwise direction, the movement of the indicating position (center of gravity G) can be detected as a change in the X axis direction of the reference coordinate system.

[0133] A more specific description will be given. Figure 11 (B) and (C) show a case where the foot position indicating tool 300 is in the initial position on the operation surface 401 of the foot position detection device 400. In this embodiment, the foot position indicating tool 300 can be rotated 360 degrees with the center of gravity G of the isosceles triangle formed by the three position indicating units 303L, 303R, 303C of the rear shoe portion 301b as the center on the operation surface 401 which is a circular plane. In addition, if the movable range restriction plate 304 of the foot position indicating tool 300 is within the movable range restriction area 402 of the operation surface 401, the foot position indicating tool 300 can be moved both forward and backward and left and right.

[0134] If used Figure 9 (A) As described above, in this case, the reference coordinate system is consistent with the position indication coordinate system defined by the three position indication units 303L, 303R, and 303C on the rear of the sole 301b. Therefore, regardless of the direction the foot position indicator 300 is facing, if the foot position indicator 300 is moved forward, the value of the Y-axis of the reference coordinate system increases. Conversely, if the foot position indicator 300 is moved backward, the value of the Y-axis of the reference coordinate system decreases. Similarly, if the foot position indicator 300 is moved to the right, the value of the X-axis of the reference coordinate system increases. Conversely, if the foot position indicator 300 is moved to the left, the value of the X-axis of the reference coordinate system decreases.

[0135] like Figure 11 As shown, in this embodiment, the left position indicator unit 303L and the right position indicator unit 303R are positioned symmetrically near the center of the sole 301c. Additionally, the rear position indicator unit 303C is located at the rear end of the rear portion 301b of the sole. Therefore, the direction of movement can be determined based on whether the rear position indicator unit 303C is moving in accordance with the left position indicator unit 303L and the right position indicator unit 303R, or whether the left position indicator unit 303L and the right position indicator unit 303R are moving in accordance with the rear position indicator unit 303C.

[0136] That is, let's assume that the rear position indicator unit 303C moves in tandem with the left position indicator unit 303L and the right position indicator unit 303R. In this case, "following" means that, as the left position indicator unit 303L and the right position indicator unit 303R move, the rear position indicator unit 303C moves in front of where the left position indicator unit 303L and the right position indicator unit 303R are located. In this case, Figure 11 In (A), as indicated by arrow Fd, it can be detected that the foot position indicator 300 is moving in the direction of the line extending from the heel towards the toe, i.e., the forward direction. Furthermore, the distance from the position on the position detection sensor 201 where the center of gravity G was located before the movement to the position on the position detection sensor 201 where the center of gravity G is located after the movement corresponds to the amount of movement in the forward direction, i.e., the amount of movement in the direction where the value on the y-axis increases.

[0137] Further, if the movement amount is understood as a movement amount per unit time in the image processing apparatus 700, the movement amount can be considered as a speed according to "speed = distance / time". Therefore, the greater the movement amount, the faster the speed at which the movement is made. This is also a so-called joystick-like movement. For example, in a case where the unit time is 1 second, if it is assumed that the center of gravity G has moved by 10 cm in 1 second, it is considered that the movement has been made at a movement speed of 10 cm / second, i.e., 10 cm / second, and the movement speed can be used in processing.

[0138] On the contrary, it is assumed that the left position indicating unit 303L and the right position indicating unit 303R have moved following the rear position indicating unit 303C. The following in this case means that the left position indicating unit 303L and the right position indicating unit 303R move to the rear of the rear position indicating unit 303C in conjunction with the movement of the rear position indicating unit 303C. In this case, in the (A) of FIG. 7, Figure 11 In the (A) of FIG. 7, as indicated by an arrow Bk, it can be detected that the foot position indicating tool 300 is moving in a direction of retreat, i.e., a direction in which the line extending from the toe portion toward the heel portion is extended. In addition, the distance from the position on the position detecting sensor 201 where the center of gravity G was located before the movement to the position on the position detecting sensor 201 where the center of gravity G was located after the movement corresponds to the movement amount in the direction of retreat, i.e., the movement amount in the direction in which the value on the y axis decreases. In addition, as in the case of the movement in the direction of advance, the movement amount of the center of gravity G in the direction of retreat can also be used as a movement speed per unit time in the direction of retreat (the negative direction on the y axis).

[0139] In addition, it is assumed that the right position indicating unit 303R has moved following the left position indicating unit 303L. The following in this case means that the right position indicating unit 303R moves to the left in conjunction with the movement of the left position indicating unit 303L. In this case, in the (A) of FIG. 7, Figure 11 In the (A) of FIG. 7, as indicated by an arrow Lf, it can be detected that the foot position indicating tool 300 is moving in the left direction, i.e., a direction intersecting the line extending from the heel portion toward the toe portion. In addition, the distance from the position on the position detecting sensor 201 where the center of gravity G was located before the movement to the position on the position detecting sensor 201 where the center of gravity G was located after the movement corresponds to the movement amount in the left direction, i.e., the movement amount in the direction in which the value on the x axis decreases. In addition, as in the case of the movement in the direction of advance, according to the movement amount of the center of gravity G in the left direction, it can also be used as a movement speed per unit time in the left direction (the negative direction on the x axis).

[0140] Conversely, let's assume that the left position indicator unit 303L moves in tandem with the right position indicator unit 303R. In this case, "following" means that as the right position indicator unit 303R moves, the left position indicator unit 303L moves to the right of the right position indicator unit 303R. In this scenario, Figure 12 In (A), as indicated by arrow Rt, it can be detected that the foot position indicator 300 is moving to the right in a direction intersecting the line extending from the heel towards the toe. Furthermore, the distance from the position on the position detection sensor 201 where the center of gravity G was located before the movement to the position on the position detection sensor 201 where the center of gravity G is located after the movement corresponds to the amount of movement to the right, that is, the amount of movement in the direction where the value on the x-axis increases. Similarly to the case of movement in the forward direction, the amount of movement of the center of gravity G to the right can also be used as the movement speed to the right (the positive direction on the x-axis) per unit time.

[0141] Thus, in the foot position detection device 400 of this embodiment, firstly, a position indication coordinate system is determined based on the positions of the three position indication units 303L, 303R, and 303C. Next, the center of the movable range restriction area 402 of the operating surface 401 is set as the origin O of the reference coordinate system, and the X-axis and Y-axis of the reference coordinate system are determined based on the x-axis and y-axis of the position indication coordinate system. In this determined reference coordinate system, the movement of the foot position indicator 300 in which direction (forward direction Fd, backward direction Bk, left direction Lf, right direction Rt) and by how much is detected. The amount of movement in this case is calculated by how much the center of gravity G, located at the rear of the sole 301b, has moved away from the origin O of the reference coordinate system. The detected movement direction and amount of the foot position indicator 300 are then transmitted to the image processing device 700. In other examples, the amount of movement per unit time in each direction of movement, as calculated as above, can also be interpreted as (considered) the speed of movement per unit time and provided to the image processing device 700 for use.

[0142] <Input via foot input system indicators>

[0143] Figure 13 , Figure 14 , Figure 12is a diagram for explaining the action state of the foot input system of the second embodiment and the display image of the head-mounted display. As described above, in the foot input system of this embodiment, in the case where the foot position indication tool 300 is moved forward and backward, left and right on the operation surface 401 of the foot position detection device 400, the moving direction and the moving amount thereof are supplied to the image processing device 700. Thus, in the image processing device 700, the three-dimensional space image displayed on the display of the HMD 500 can be changed in accordance with the moving direction and the moving amount from the foot position detection device 400.

[0144] In the second embodiment, the moving amount of the center of gravity G from the origin O is set as the moving amount per unit time, and the moving speed per unit time determined in accordance with the moving amount per unit time is reflected in the system. In other words, the moving amount (distance) from the origin is taken as the moving speed per unit time. Therefore, if the center of gravity G of the foot position indication tool 300 is displaced by r (+r) in the forward direction, the image can be changed in such a manner that it advances at a speed of r per unit time. In addition, if the center of gravity G is displaced by 2r (+2r) in the forward direction, the image can be changed in such a manner that it advances at a speed of 2r per unit time. Furthermore, if the center of gravity G of the foot position indication tool 300 is returned to the origin O, the moving distance becomes 0, and the change of the image stops.

[0145] Similarly, if the center of gravity G of the foot position indication tool 300 is displaced by r (-r) in the backward direction, the image can be changed in such a manner that it retreats at a speed of r per unit time. In addition, if the center of gravity G of the foot position indication tool 300 is displaced by l (+l) in the right direction, the image can be changed in such a manner that it moves to the right at a speed of l per unit time. In addition, if the center of gravity G of the foot position indication tool 300 is displaced by l (-l) in the left direction, the image can be changed in such a manner that it moves to the left at a speed of l per unit time. In this way, the direction and the speed of the change of the image can be changed in accordance with the displacement of the center of gravity G from the origin O.

[0146] As shown in Figure 12 , it is configured that the foot position indication tool 300 is placed on the operation surface 401 of the foot position detection device 400, and the movable range restriction plate 304 on the back surface of the rear shoe portion 301b of the foot position indication tool 300 is within the movable range restriction area 402 on the operation surface 401. Therefore, regardless of which of (A), (B), and (C) in Figure 12 , the left position indication unit 303L, the right position indication unit 303R, and the rear position indication unit 303C provided to the foot position indication tool 300 are within the movable range restriction area 402.

[0147] Figure 12(B) shows the foot position indicator 300 in its initial position (original position) on the operating surface 401. Therefore, it is shown that the center of gravity G of the isosceles triangle formed by the three position indicator units 303L, 303R, and 303C located on the rear part 301b of the sole of the foot position indicator 300 is approximately aligned with the center (origin) O of the movable range restriction area 402. In this state, the display HDP of the HMD500 worn on the user's head displays, as shown... Figure 12 As shown in (B), it is set to display a three-dimensional spatial image including trees and clouds as subjects.

[0148] Set as: From Figure 12 Starting from the state shown in (B), as Figure 12 As shown in (C), the foot position indicator 300 moves forward in contact with the operating surface 401. In this case, the position detection circuit 202 of the foot position detection device 400 detects the direction of movement and the amount of movement relative to the center of gravity G, and supplies this information to the image processing device 700. In this case, the direction of movement is the forward direction (the direction of the line extending from the heel to the toe), and the amount of movement is the distance from the origin O to the center of gravity G in the positive direction of the Y-axis of the reference coordinate system. Furthermore, as described above, the movement speed per unit time can be determined based on the amount of movement per unit time, therefore, the foot is moving forward at a speed corresponding to the amount of movement per unit time.

[0149] In this case, the image processing unit 703 of the image processing apparatus 700 determines that the forward movement of the foot position indicator 300 is a magnification indication input for the three-dimensional spatial image, and processes it as follows: based on the amount or speed of movement of the foot position indicator 300, the three-dimensional spatial image is displayed on the display HDP in a magnified manner. The magnification of the three-dimensional spatial image means that as the viewpoint gradually moves forward, the subject gradually approaches and appears larger, becoming a more detailed three-dimensional spatial image. That is, regarding the magnification of the image, the display processing is performed as follows: a forest that appears distant gradually approaches as the viewpoint moves forward, the trees appear larger, and if the viewpoint continues to move forward further, the viewer enters the forest and can see the details within it.

[0150] Additionally, set it as: from Figure 12 Starting from the state shown in (B), as Figure 13As shown in (A), the foot position indicator 300 moves backward with its position in contact with the operating surface 401. In this case, the position detection circuit 202 of the foot position detection device 400 detects the direction of movement and the amount of movement relative to the center of gravity G, and supplies this information to the image processing device 700. In this case, the direction of movement is the backward direction (the direction of the line extending from the toe to the heel), and the amount of movement is the distance from the origin O to the center of gravity G in the negative direction of the Y-axis of the reference coordinate system. In this case, the movement speed per unit time can also be determined based on the amount of movement per unit time, and therefore, the foot is moving backward at a speed corresponding to the amount of movement per unit time.

[0151] In this case, the image processing unit 703 of the image processing apparatus 700 determines that the backward movement of the foot position indicator 300 is a reduction indication input for the three-dimensional spatial image, and processes it as follows: based on the amount or speed of movement of the foot position indicator 300, the three-dimensional spatial image is displayed on the display HDP in a manner that continues to reduce its size. Reduction of the three-dimensional spatial image means that, in contrast to magnification, as the viewpoint gradually moves backward, the subject gradually moves away and appears smaller, eventually becoming invisible. That is, regarding image reduction, for example, it is processed as follows: starting from a state where details in the forest are visible, as one walks out of the forest and gradually leaves it, the trees that originally appeared large become smaller, and eventually, the forest and the trees that make up the forest become invisible.

[0152] Furthermore, if the foot position indicator 300 does not move forward or backward on the operating surface 401, the direction and amount of movement are not detected by the foot position detection device 400 and are not supplied to the image processing device 700. Therefore, if Figure 13 As shown, even when the foot position indicator 300 is rotated to the toe side, the three-dimensional spatial image displayed on the HDP remains unchanged. That is, the image remains unchanged from the initial position (original position) of the foot position indicator 300. Figure 13 (B)) starting, even if it is rotated to the left ( Figure 13 (A)), also, even if it is rotated to the right ( Figure 14 The three-dimensional spatial image displayed on the HDP monitor will not change (C).

[0153] However, even if the foot position indicator 300 does not move forward or backward on the operating surface 401, if the HMD 500 worn on the user's head rotates along with the head, the three-dimensional spatial image of the display HDP will also change. That is, as Figure 14 As shown, even if the foot position indicator 300 remains completely still, if the HMD 500 rotates, the 3D spatial image displayed on the HDP monitor will change. Regardless of...Figure 14 (A), (B), (C) of (A), (B), (C) is, the foot position indicating tool 300 is in the initial position (original position).

[0154] In this state, if the user rotates the head to the left by degrees , the direction of rotation and the angle of rotation are supplied from the HMD 500 to the image processing device 700. In response to this, as shown in (A) of FIG. 7, the image processing section 703 forms a three-dimensional space image that has been rotated to the left by Figure 14 degrees and displays it on the display HDP. In contrast, if the user rotates the head to the right by degrees , the direction of rotation and the angle of rotation are supplied from the HMD 500 to the image processing device 700. In response to this, as shown in (C) of FIG. 7, the image processing section 703 forms a three-dimensional space image that has been rotated to the right by degrees and displays it on the display HDP. Figure 15

[0155] Further, in the case of the foot input system of this embodiment, it is provided that the foot position indicating tool 300 is placed on the operation surface 401 of the foot position detection device 400, and that the leftward movement and the rightward movement are performed in the state of being placed. In this case, the direction of movement and the amount of movement are supplied to the image processing device 700. Thereby, in the three-dimensional space image displayed on the display HDP of the HMD 500, it is possible to shift the position of the viewpoint to the leftward direction or the rightward direction. In this case, shifting the three-dimensional space image to the leftward direction or the rightward direction means that, instead of shifting the direction of viewing as with the rotation of the HMD 500, the position of the viewpoint of the user in the three-dimensional space image is shifted to the leftward direction or the rightward direction.

[0156] For example, it is provided that the foot position indicating tool 300 is moved to the left on the operation surface 401. In this case, the image processing section 703 of the image processing device 700 forms a three-dimensional space image that is seen in the case where the position of the viewpoint of the user in the three-dimensional space image is moved to the leftward direction, and displays it on the display HDP. Also, it is provided that the foot position indicating tool 300 is moved to the right on the operation surface 401. In this case, the image processing section 703 of the image processing device 700 forms a three-dimensional space image that is seen in the case where the position of the viewpoint of the user in the three-dimensional space image is moved to the rightward direction, and displays it on the display HDP.

[0157] Figure 16 , Figure 8 is a diagram for explaining the indication input in the image processing system configured by using the foot input system of the second embodiment. As shown in Figure 15 , also as​​Figure 15 As shown, the image processing apparatus 700 is capable of forming a three-dimensional space image in the 360-degree image region GA. That is, the image processing apparatus 700 is capable of forming an image (three-dimensional space image) having width, height, and depth throughout the 360-degree surroundings, and displaying it on the display HDP of the HMD 500.

[0158] In this case, in the Figure 15 , as shown by the arrows R1, R2, the change in orientation in the 360-degree image region GA can be changed in accordance with the orientation of the HMD 500. Also, in the Figure 16 , as shown by the double arrows around the movable range restriction region 402 shown on the bottom surface, by the forward movement and the backward movement of the foot position indication tool 300 placed on the operation surface 401 of the foot position detection apparatus 400, the enlargement and the reduction of the three-dimensional space image displayed on the display HDP of the HMD 500 can be performed.

[0159] For example, as shown in Figure 15 , consider the case where the 360-degree image region GA is divided into, for example, six regions GA1, GA2, GA3, GA4, GA5, GA6. In this case, which region's three-dimensional space image is displayed on the display HDP of the HMD 500 can be switched in accordance with the orientation of the HMD 500 as shown by the arrows on each region. Also, the enlargement and the reduction of the three-dimensional space image of the displayed region can be performed by the forward movement and the backward movement of the foot position indication tool 300 placed on the operation surface 401 of the foot position detection apparatus 400 as shown by the double arrows around the movable range restriction region 402 of the foot position detection apparatus 400.

[0160] Further, although not shown in Figure 16 , Figure 17 , by the leftward movement and the rightward movement of the foot position indication tool 300 placed on the operation surface 401 of the foot position detection apparatus 400, a three-dimensional space image in the case where the viewpoint position in the three-dimensional space image is moved leftward or rightward can be formed. This three-dimensional space image can be formed by the image processing section 703 of the image processing apparatus 700, and supplied to the HMD 500 to be displayed on the display HDP.

[0161] Figure 17 is a diagram for describing a method for detecting the indication input in the foot input system of the second embodiment. Figure 17 (A), (C), (E) of Figure 17 (B) shows the state where the foot position indication tool 300 is moved on the operation surface 401 of the foot position detection apparatus 400. Figure 17the orientation of the foot position indicating tool 300 on the operation surface 401 of (A), Figure 17 (D) shows the orientation of the foot position indicating tool 300 on the operation surface 401 of (C), (E). Figure 17 (D) shows the orientation of the foot position indicating tool 300 on the operation surface 401 of (C), (E).

[0162] As described above, in this second embodiment, the reference coordinate system defined on the operation surface 401 of the foot position detection device 400 takes the center of the operation surface 401 as the origin O. In addition, the orientations of the X axis and the Y axis of the reference coordinate system are determined by the x axis and the y axis of the position indicating coordinate system determined by the three position indicating units 303L, 303R, 303C of the foot position indicating tool 300. Thus, if the foot position indicating tool 300 is placed on the operation surface 401 in the state shown in (B), the isosceles triangle formed by the position indicating units 303L, 303R, 303C is located at the position P0 of (A). Figure 17 (D) shows the orientation of the foot position indicating tool 300 on the operation surface 401 of (C), (E). Figure 17 (D) shows the orientation of the foot position indicating tool 300 on the operation surface 401 of (C), (E).

[0163] Thus, the reference coordinate system (origin O, X axis, Y axis) and the position indicating coordinate system (origin G, x axis, y axis) coincide. In this case, it is assumed that the foot position indicating tool 300 is moved forward, and the isosceles triangle formed by the position indicating units 303L, 303R, 303C is moved to the position P1. Since it is a forward movement, it is interpreted as being moved at a speed of moving distance + r per unit time, and the three-dimensional space image is continuously enlarged. In addition, it is assumed that the foot position indicating tool 300 is moved backward, and the isosceles triangle formed by the position indicating units 303L, 303R, 303C is moved to the position P2. In this case, since it is a backward movement, it is interpreted as being moved at a speed of moving distance - r per unit time, and the three-dimensional space image is continuously reduced.

[0164] In addition, it is assumed that the foot position indicating tool 300 is moved left, and the isosceles triangle formed by the position indicating units 303L, 303R, 303C is moved to the position P3. In this case, since it is a left movement, it is interpreted as being moved at a speed of moving distance - l per unit time, and the viewpoint is continuously moved to the left side in the three-dimensional space. In addition, it is assumed that the foot position indicating tool 300 is moved right, and the isosceles triangle formed by the position indicating units 303L, 303R, 303C is moved to the position P4. In this case, since it is a right movement, it is interpreted as being moved at a speed of moving distance + l per unit time, and the viewpoint is continuously moved to the right side in the three-dimensional space.

[0165] In addition, as Figure 17(C), (D) shown, it is assumed that: with respect to the foot position indicating tool 300, the shoe front portion 301f is rotated around the shoe rear portion 301b. In this case, the reference coordinate system (origin O, X axis, Y axis) is rotated according to the position indicating coordinate system (origin G, x axis, y axis). Therefore, as shown in Figure 17 (C) shown, the reference coordinate system (origin O, X axis, Y axis) and the position indicating coordinate system (origin G, x axis, y axis) are identical. In the case where the foot position indicating tool 300 is moved forward, backward, leftward, or rightward in this state, the same indication input as that using Figure 17 (A), (B) explained.

[0166] In addition, it is assumed that: the center of gravity G is not moved on the X axis and the Y axis of the reference coordinate system as explained using Figure 17 (A), (B), Figure 17 (C), (D), but is moved to a position that is apart from both the X axis and the Y axis as shown in Figure 17 (E). In the foot position detecting device 400, the movement distance n from the origin can be grasped on the reference coordinate system as having been moved by +r in the Y axis direction and -l in the X axis direction. In this case, in the image processing device 700, processing can be performed to continue to enlarge the three-dimensional space image in a manner to go to the left front.

[0167] Therefore, in the case where the so-called joystick used as an input device in the past is tilted, for example, to the front side, the display image can be enlarged at a speed corresponding to the angle of the tilt and the like. Specifically, the image can be changed such that the image is changed slowly in the case where the joystick is tilted slightly and the image is changed quickly in the case where the joystick is tilted greatly. The same indication input as this can be performed using the foot input system. Of course, not only enlargement, but the same indication input as the case where the display image is changed by tilting the joystick to various directions can be performed using the foot input system.

[0168] In this second embodiment, the reference coordinate system defined on the operation surface 401 of the foot position detecting device 400 takes the center of the operation surface 401 as the origin O. In addition, the orientations of the X axis and the Y axis of the reference coordinate system are determined by the x axis and the y axis of the position indicating coordinate system determined by the three position indicating units 303L, 303R, 303C of the foot position indicating tool 300. In the thus determined reference coordinate system, by detecting how the center of gravity G of the foot position indicating tool 300 moves and detecting the movement speed thereof, enlargement and reduction of the three-dimensional space image, viewpoint movement to the left and right, and the like can be flexibly performed.

[0169] [Effects of Embodiments]

[0170] In the image processing system of the above-described embodiment, the direction of view is changed by the rotation of the HMD 500, and the three-dimensional space image is changed in accordance with this. In addition to this, by using the foot input system, by performing the advancing movement, the retreating movement, the leftward movement, and the rightward movement of the foot position indication tool 300 on the operation surface 401 of the foot position detection device 400, the enlargement, the reduction, the leftward movement, and the rightward movement of the three-dimensional space image can be realized.

[0171] Thus, flexible indication input using the foot input system can be realized. In addition, the input of various information to the image processing device using the user's feet, and the change of the displayed three-dimensional space image can be performed in a manner that avoids a difference in the feeling with respect to the changed three-dimensional space image and the movement of the user's body. Thus, since a difference in the feeling with respect to the changed three-dimensional space image and the movement of the user's body can be avoided, a symptom such as so-called VR sickness can also be suppressed at the user.

[0172] [Modified Example]

[0173] [Modified Position of Position Indication Unit]

[0174] In the above-described first embodiment, a case where the position indication unit 101U is provided at the front portion 101 of the sole and the position indication unit 103U is provided at the rear portion 103 of the sole is described. In addition, in the second embodiment, a case where the left position indication unit 303L, the right position indication unit 303R, and the rear position indication unit 303C are provided at the rear portion 301b of the sole is described. However, the method of providing the position indication unit is not limited to this. Various modifications of the position of the position indication unit are possible.

[0175] Figure 18 is a diagram for describing a modification of the position of the position indication unit (position indication signal transmitting portion) of the foot position indication tool, the upper side of the diagram becomes the toe side (the front portion of the sole), and the lower side of the diagram becomes the heel side (the rear portion of the sole). Figure 18 The foot position indication tool 300A of (A) of is provided with two position indication units 303F, 303B in the length direction of the rear portion of the sole. By thus providing two position indication units 303F, 303B in the length direction of the foot position indication tool 300A, a position indication coordinate system in which a straight line connecting the two position indication units 303F, 303B is set as the y axis and a straight line orthogonal to the y axis is set as the x axis can be formed, and the direction of movement can be determined.

[0176] As for the movement amount, the distance from the origin O can be calculated as the movement amount with either the position indication unit 303F or the position indication unit 303B as the reference, or with the midpoint of the line segment connecting the position indication unit 303F and the position indication unit 303B as the reference. In addition to this, the position in the foot position indication tool 300A determined in accordance with the position of either or both of the position indication unit 303F and the position indication unit 303B can be set as the reference when the movement amount is calculated.

[0177] Figure 18 The foot position indication tool 300B of (B) shows a case where two position indication units 306F, 306B are provided in the length direction on the front portion of the sole. Thus, in the foot position indication tool 300B of (B), the position indication units 306F, 306B are provided on the heel side and the toe side, respectively. Figure 18 Figure 18 In the foot position indication tool 300A of (A) and the foot position indication tool 300B of (B), the positions where the position indication units are provided differ in whether they are on the heel side or the toe side. However, in the case of the foot position indication tool 300B of (B) as well, the position indication coordinate system can be formed and the movement direction can be determined as in the case of the foot position indication tool 300A of (A), and the detection of the movement amount can be achieved. Figure 18 Figure 18

[0178] Figure 18 The foot position indication tool 300C of (C) shows a case where three position indication units 306L, 306R, 306C are provided on the front portion of the sole in such a way as to form an isosceles triangle. Thus, in the foot position indication tool 300C of (C), the position indication units 306L, 306R, 306C are provided on the heel side, the toe side, and the middle of the foot, respectively. Figure 9 Figure 11 Figure 18 In the foot position indication tool 300 of the second embodiment and the foot position indication tool 300C of (C), the positions where the position indication units are provided differ in whether they are on the heel side or the toe side. However, in the case of the foot position indication tool 300C of (C) as well, the position indication coordinate system can be formed and the movement direction can be determined as in the case of the foot position indication tool 300 of the second embodiment described using (1), (2), and the like, and the detection of the movement amount can be achieved. Figure 18 Figure 9 Figure 11

[0179] Figure 18 ​​​​​​​​The foot position indicator 300D (D) shows a case where four position indicator units 303L, 303R, 303F, and 303B are arranged in a quadrilateral shape at the rear of the sole. In this case, a position indicator coordinate system can be formed, with the line connecting the position indicator units 303F and 303B as the y-axis and the line connecting the position indicator units 303L and 303R as the x-axis, to determine the direction of movement. Regarding the amount of movement in this example case, for example, the distance from the origin O can be calculated using the center of the quadrilateral formed by the position indicator units 303L, 303R, 303F, and 303B as a reference. Furthermore, the position in the foot position indicator 300D determined based on one or more positions of the position indicator units 303L, 303R, 303F, and 303B can be used as a reference when calculating the amount of movement.

[0180] Figure 18 The foot position indicator 300E of (E) shows a configuration where three position indicator units 303L, 303R, and 303C are arranged in an isosceles triangle at the rear of the sole, and one position indicator unit 306 is arranged at the front of the sole. Additionally, Figure 18 The foot position indicator device 300F of (F) shows a case where three position indicator units 303L, 303R, and 303C are arranged in an isosceles triangle at the rear of the sole, and two position indicator units 306L and 306R are arranged at the front of the sole.

[0181] In the case of these foot position indicator devices 300E and 300F, it is possible to use... Figure 9 , Figure 11 In the case of the foot position indicator 300 described in the second embodiment, a position indicator coordinate system is formed to determine the direction of movement, and the amount of movement can be detected. Furthermore, in the cases of the foot position indicator 300E and 300F, position indicator units are provided at the rear and front parts of the sole.

[0182] Therefore, if used Figure 5 As explained, if the front part (toe side) of the sole is lifted while the rear (heel side) of the sole is in contact with the operating surface 401, its height h and angle θ can be determined. Conversely, if the rear (heel side) of the sole is lifted while the front (toe side) of the sole is in contact with the operating surface 401, its height h and angle θ can be determined. That is, the height h can be detected based on the voltage level at the position detection sensor 201, which receives the signal from the position indication unit.

[0183] In addition, regarding the angle θ, in the case of the foot position indicating tool 300E, it can be found based on the found height h and the distance 1 from the center of gravity G of the isosceles triangle formed by the three position indicating units provided at the rear of the sole to the position indicating unit 306. In addition, in the case of the foot position indicating tool 300F, it can be found based on the found height h and the distance 1 from the center of gravity G of the isosceles triangle formed by the three position indicating units provided at the rear of the sole to the midpoint of the position indicating units 306L and 306R.

[0184] By supplying the thus found height h and angle θ to the image processing device 700, various image processing can be performed in the image processing device 700. For example, magnification / reduction processing such as magnification of the three-dimensional space image if the front of the sole is lifted up and reduction of the three-dimensional space image if the rear of the sole is lifted up can be realized. In addition, up / down movement processing of the viewpoint position in which the viewpoint position in the three-dimensional space image is moved to the upper side if the front of the sole is lifted up and the viewpoint position in the three-dimensional space image is moved to the lower side if the rear of the sole is lifted up and the three-dimensional space image seen in that case is displayed can be realized.

[0185] Further, the latter up / down movement processing of the viewpoint position can be raised or lowered within the three-dimensional space image. Thus, it is processing different from the processing in which the three-dimensional space image in which the direction of view is changed while the viewpoint position is not changed is displayed by moving the head on which the HMD 500 is worn in a looking-up manner or moving the head on which the HMD 500 is worn in a looking-down manner. In this way, by supplying the height h and angle θ that can be detected due to the lifting up and down of the front of the sole and the rear of the sole to the image processing device 700, new image processing using the same can be realized.

[0186] Further, regarding the variation of the position of the position indicating unit (position indicating signal transmitting unit) of the foot position indicating tool, it is not limited to Figure 18 the variation shown in FIG. 12. The position indicating unit can be provided in various schemes in which a position indicating coordinate system composed of the y-axis and x-axis can be provided and the amount of movement of the foot position indicating tool 300 can be detected. Thus, in addition to being arranged in a manner of forming a triangle or a manner of forming a quadrangle, it can be arranged in a manner of forming a polygon such as a pentagon or a hexagon.

[0187] In addition, in each of the foot position indicating tools 300A to 300F shown in Figure 18 FIG. 11, the respective position indicating units transmit transmission signals of different frequencies. In this case, in the foot position detecting device 400, it is possible to distinguish the indicating positions of the respective position indicating units and detect them by grasping which position indicating unit provided at which position transmits a transmission signal of which frequency.

[0188] In addition, as for the two position indicating units arranged in a manner of forming an isosceles triangle, the same frequency of the transmission signal can be transmitted. In addition, a plurality of position indicating units can be provided, and the transmission of the position indicating signal is switched by dividing the transmission time in a predetermined order, and the position is indicated. Therefore, in this case, it is not necessary to change the frequency of the transmission signal for each position indicating unit.

[0189] This is because: in this case, it can be recognized that it is located at both ends of the base, and by the position indicating unit located at the vertex, the direction of the arrangement can also be recognized.

[0190] <Continuation of zoom-in and zoom-out>

[0191] In addition, in the above-described embodiment, it is described that the zoom-in and zoom-out of the three-dimensional space image is performed according to the moving direction and the moving amount. However, the zoom-in and zoom-out can be further flexibly performed. For example, it is provided that the foot position indicating tool 300 is moved forward, and the movable range limiting plate 304 of the foot position indicating tool 300 is engaged with the annular convex portion 403 of the operation surface 401 and becomes unable to move. Even in this case, by stepping on the shoe sole rear portion 301b with force, the pressing force can be detected in the position indicating unit, and is supplied to the image processing device 700 via the foot position detecting device 400.

[0192] Therefore, in the image processing device 700, in the case where the pressing force from the foot position indicating tool 300 is above a certain value, the zoom-in of the three-dimensional space image is continued, and if the pressing force is lowered compared with the certain value, the zoom-in of the three-dimensional space image is stopped. Similarly, it is provided that the foot position indicating tool 300 is moved backward, and the movable range limiting plate 304 of the foot position indicating tool 300 is engaged with the annular convex portion 403 of the operation surface 401 and becomes unable to move. In this case, in the image processing device 700, in the case where the pressing force from the foot position indicating tool 300 is above a certain value, the zoom-out of the three-dimensional space image is continued, and if the pressing force is lowered compared with the certain value, the zoom-out of the three-dimensional space image is stopped.

[0193] Further, in this case, the pressure value from the position indicating unit of the foot position indicating tool 300 is used, but it is not limited thereto. For example, the foot position indicating tool 300 can be moved forward until it is moved backward, and the enlargement of the three-dimensional space image can be continued. Also, the foot position indicating tool 300 can be moved backward until it is moved forward, and the reduction of the three-dimensional space image can be continued. In this case, the foot position indicating tool 300 is moved forward, and when the three-dimensional space image is enlarged to a state set as a target, the foot position indicating tool 300 is slightly moved backward. Thus, the enlargement of the three-dimensional space image can be stopped. Also, the foot position indicating tool 300 is moved backward, and when the three-dimensional space image is reduced to a state set as a target, the foot position indicating tool 300 is slightly moved forward. Thus, the reduction of the three-dimensional space image can be stopped.

[0194] <Structure of the foot position indicating tool>

[0195] Further, the structure of the foot position indicating tool 300 is not limited to the above-described structure. As long as it can be worn on the user's foot like so-called footwear such as slippers, sandals, sneakers, and the like, and the position indicating unit can be fitted (mounted), it is acceptable. In this case, the shoe sole middle portion connecting the shoe sole front portion and the shoe sole rear portion is preferably formed of a flexible material (raw material). This is to enable the above-described operation such as easily lifting the toe side in a state where the heel side is in contact with the operation surface 401, and easily lifting the heel side in a state where the toe side is in contact with the operation surface 401.

[0196] Further, in the case of the foot position indicating tool 300 of the second embodiment described above, the toe side belt holding portions 301L, 301R, the heel side belt holding portions 302L, 302R are provided, and the foot position indicating tool 300 is worn on the user's foot by the belts passing through them. However, it is not limited thereto. It can be provided with a holding portion covering the upper side portion of the toe portion in advance like a slipper, a sandal, and the like, and it can be provided with a holding portion covering the side surface of the foot portion and the upper side portion of the toe portion like a general shoe such as a sneaker.

[0197] <Setting of the mode>

[0198] Furthermore, in the above embodiment, a first mode is defined as a mode in which image zooming and viewpoint movement can be achieved by moving the foot position indicator 300 forward, backward, left, and right. By using such foot movements to change the three-dimensional spatial image, symptoms such as VR sickness can be suppressed. A second mode is defined as a mode in which image zooming can only be achieved by moving the foot position indicator 300 forward and backward. In this case, VR sickness can be further suppressed. Therefore, it is possible to use the first mode for users less prone to VR sickness and the second mode for users prone to VR sickness separately.

[0199] <Utilization of Flat Coils>

[0200] In the resonant circuit coils that can be used in foot position indicators 100 and 300, there are cylindrical coils formed by winding insulated wire into a spiral shape to create a cylindrical shape, and thin, flat coils formed by winding insulated wire into a spiral shape, for example. The cylindrical coils are often 10mm or more in height, so they can be positioned along the outer edge of the so-called sole (boot sole) of the foot position indicator 100 and 300, such as around the user's heel or around the toes. This is because if the cylindrical coil were positioned on the ball of the foot of the foot position indicator 100 and 300, the sole would become thicker.

[0201] In contrast, with a flat coil, the thickness is as thin as a few millimeters, so even when placed in the forefoot portion of a foot position indicator, the thickness of the shoe sole can be suppressed. Furthermore, with a flat coil, it is difficult to generate changes in magnetic flux due to tilting, thus making it easier to obtain signals with minimal fluctuations relative to physical movements. Therefore, as a more specific variation of a foot position indicator, a foot position indicator 800 constructed by placing a flat coil in the forefoot portion of the shoe sole will be described.

[0202] Figure 19 This diagram illustrates a foot-mounted position indicator 800 constructed using a flat coil. Figure 19 middle, Figure 19 (A) is a diagram showing the feet viewed from an oblique, upward angle using a position indicator 800. Figure 19 (B) is a diagram showing the foot viewed from a lower angle using a position indicator 800. (See diagram below.) Figure 19As shown in (A), the foot position indicator 800 is provided with a generally rectangular shoe sole 801 and strap holding portions 802a, 803a, 802b, and 803b respectively provided on the long side of the shoe sole 801. Furthermore, a range of motion limiting protrusion 804 and a range of motion recognition disc 805 are provided on the back (lower side) of the shoe sole 801.

[0203] The portion consisting of the sole 801, retaining parts 802a, 803a, 802b, and 803b is integrally formed, for example, from a flexible and durable material such as polycarbonate-ABS resin, a heat-reversible resin possessing characteristics of both polycarbonate and ABS resins. In each of the retaining parts 802a, 803a, 802b, and 803b, a triangular opening serves as a through-hole for the heel strap, and a narrow opening on its lower side serves as a through-hole for the instep strap. Figure 19 As shown in (A), the strap holding parts 802a and 802b are mirror-symmetrical. Furthermore, the strap holding parts 803a and 803b are mirror-symmetrical. Therefore, as described later, the foot position indicator 800 can be worn on the user's foot regardless of its orientation (front, back, left, right).

[0204] exist Figure 19 In (A), the state of the movable range limiting protrusion 804 and the movable range identification disc 805 before installation relative to the shoe sole 801 is shown. As will also be described later, they are installed on the back of the shoe sole 801. The movable range limiting protrusion 804 and the movable range identification disc 805 are formed using a material with good wear resistance and sliding properties, such as polyacetal (POM) resin. Figure 19 As shown in (A), the movable range identification disk 805 has a specified thickness and is provided with two fixed recesses such as coils, which are composed of a circular recess and a rectangular recess inside.

[0205] A flat coil 806a and a circuit board 807a are embedded in a fixing recess such as a coil on one side of the movable range recognition disk 805, while a flat coil 806b and a circuit board 807b are embedded in a fixing recess such as a coil on the other side. Circuit components such as capacitors are mounted on the circuit boards 807a and 807b respectively. One resonant circuit is formed by the flat coil 806a and the circuit board 807a, and another resonant circuit is formed by the flat coil 806a and the circuit board 807a. Thus, two resonant circuits are mounted on the movable range recognition disk 805. Furthermore, the resonant frequencies are different in the resonant circuit formed by the flat coil 806a and the circuit board 807a and the resonant circuit formed by the flat coil 806b and the circuit board 807b.

[0206] like Figure 20As shown in (B), the movable range limiting protrusion 804 is fixed to one end of the back of the shoe sole 801, and the movable range identification disc 805 is fixed to the other end of the back of the shoe sole 801. The movable range limiting protrusion 804 engages, for example, with the outer edge of the operating surface of the foot position detection device 400, enabling the identification of the range of the operating surface 401 of the foot position detection device 400. The resonant circuit mounted inside the movable range identification disc 805 functions as a position indication unit, and the movable range identification disc 805 performs the function of indicating the position of the foot position detection device 400.

[0207] Figure 18 This diagram illustrates a foot position indicator 800 constructed using flat coils, showing the foot position indicator 800 viewed from the top surface (front) side. Therefore, the movable range limiting protrusion 804 and the movable range recognition disc 805, mounted on the back of the shoe sole 801, are shown in dashed lines. In the foot position indicator 800, the centers of the flat coils 806a and 806b are positioned on the centerline of the shoe sole 801, indicated by the dashed line marked with an arrow. This configuration corresponds to... Figure 21 The configurations shown in (A) and (B) are as follows.

[0208] Therefore, when the foot position indicator 800 is moved forward, backward, left, and right on the foot position detection device 400, the position corresponding to the movement can be indicated by the transmission and reception of magnetic fields between the flat coils 806a and 806b and the foot position detection device 400. Thus, the foot position indicator 800 can be used on the foot position detection device 400 in the same way as the foot position indicator 300 of the second embodiment described above.

[0209] Figure 19 This diagram illustrates the installation configuration of the foot position indicator 800 towards the user's foot. (See diagram below.) Figure 20 (A) Figure 21 As shown and as described above, the strap holding parts 802a and 803a are mirror-symmetrical, and the strap holding parts 802b and 803b are mirror-symmetrical. Therefore, the foot position indicator 800 can be fixed to the user's foot regardless of the orientation of the user's foot.

[0210] That is, such as Figure 21 As shown in (A), the movable range limiting protrusion 804 can be positioned on the toe side and the movable range recognition disc 805 on the heel side, thus fixing it to the user's foot. Additionally, as... Figure 21As shown in (B), the movable range limiting protrusion 804 can be fixed to the heel side of the user's foot and the movable range recognizing disk 805 can be fixed to the toe side of the user's foot. In addition, the foot position indicating tool 800 can be fixed to either the right or left side of the user's foot.

[0211] Further, as explained using (A), (B), the foot position indicating tool 800 can be worn in different orientations with respect to the user's foot. In this case, the orientation of the foot position indicating tool 800 (i.e., which of the flat coil 806a and the flat coil 806b is on the front side (toe side) and which is on the rear side (heel side) with respect to the user's foot) can be set in software. In other words, in the case where the movable range recognizing disk 805 is on the toe side, the flat coil 806a can be set to be on the front side with respect to the foot and the flat coil 806b can be set to be on the rear side with respect to the foot. In addition, in the case where the movable range recognizing disk 805 is on the heel side, the flat coil 806b can be set to be on the rear side with respect to the foot and the flat coil 806a can be set to be on the front side with respect to the foot. Figure 20 In addition, as explained using (A), (B), the flat coils 806a, 806b are respectively arranged so that the center is on the center line of the sole portion 801. In other words, the flat coils 806a, 806b are arranged in the front-rear direction of the length of the sole portion 801. Thus, for example, as shown in (A), in the case where the foot position indicating tool 800 is worn so that the movable range recognizing disk 805 is on the heel side of the user's foot, the toe is raised without coming off the operation surface 401 of the foot position detection device 400.

[0212] Figure 21 In this case, the magnetic field (signal) from the flat coil 806b on the more rear side of the foot remains strong, but the magnetic field (signal) from the flat coil 806a on the more front side of the foot becomes weak, or the magnetic field (signal) becomes undetectable. The strength, weakness, or undetectability of such a magnetic field can be detected on the foot position detection device 400 side, and thus can be applied, for example, to the input action of a push-button switch function. In other words, in the case where the foot position indicating tool 800 is worn on the user's foot in the state shown in (A), processing corresponding to the action, such as turning on the switch if the toe is raised and turning off the switch if the toe is lowered, can be performed. More specifically, processing corresponding to the action, such as jumping if the toe is raised, can be performed. Figure 21

[0213] In this case, the magnetic field (signal) from the flat coil 806b on the more rear side of the foot remains strong, but the magnetic field (signal) from the flat coil 806a on the more front side of the foot becomes weak, or the magnetic field (signal) becomes undetectable. The strength, weakness, or undetectability of such a magnetic field can be detected on the foot position detection device 400 side, and thus can be applied, for example, to the input action of a push-button switch function. In other words, in the case where the foot position indicating tool 800 is worn on the user's foot in the state shown in (A), processing corresponding to the action, such as turning on the switch if the toe is raised and turning off the switch if the toe is lowered, can be performed. More specifically, processing corresponding to the action, such as jumping if the toe is raised, can be performed. Figure 21

[0214] In addition, as explained using (A), (B), the flat coils 806a, 806b are respectively arranged so that the center is on the center line of the sole portion 801. In other words, the flat coils 806a, 806b are arranged in the front-rear direction of the length of the sole portion 801. Thus, for example, as shown in (A), in the case where the foot position indicating tool 800 is worn so that the movable range recognizing disk 805 is on the heel side of the user's foot, the toe is raised without coming off the operation surface 401 of the foot position detection device 400. Figure 21 ​​​As shown in (B), when the foot position indicator 800 is worn with the movable range recognition disc 805 positioned on the toe side of the user's foot, the toes do not leave the operating surface 401 of the foot position detection device 400, and the heel is raised. In this case, the magnetic field (signal) from the flat coil 806b located further forward of the foot remains strong, but the magnetic field (signal) from the flat coil 806a located further backward of the foot weakens, or the magnetic field becomes undetectable. Therefore, in the case of... Figure 18 In the form shown in (B), when the foot is fitted with a position indicator device on the user's foot, it can perform actions corresponding to the movement, such as turning on the switch when the heel is raised and turning off the switch when the heel is lowered. More specifically, it can perform actions corresponding to the movement, such as jumping when the heel is raised (or standing on tiptoe).

[0215] Furthermore, it can also perform processing such as "determining how much the toes and heels are lifted based on the difference in the strength of the magnetic field (signal) between the flat coil 806a and the flat coil 806b, determining the tilt angle and elevation angle, and thus changing the displayed image." Moreover, even when using a flat coil, it is not only... Figures 19 to 21 The forms shown in (A) and (B) can also be... Figure 3 The flat coils are configured as shown in (C) to (F).

[0216] In addition, in use Figure 10 In the case of the foot position indicator 800 described, a resonant circuit is constructed by connecting capacitors to the flat coils 806a and 806b respectively. However, it is not limited to this. Of course, a pressure sensor can be further connected in parallel to the resonant circuit composed of the flat coils and capacitors to form a device for use. ​ The position indicator unit is described in terms of its shape, and is used in conjunction with the position indicator unit.

[0217] Furthermore, in the case of the foot position indicator 800 described above, it is structured with two resonant circuits having different resonant frequencies. Therefore, the number of resonant frequencies that can be scanned on the foot position detection device 400 side is two. That is, compared with foot position indicators equipped with three or more resonant circuits having different resonant frequencies, the number of resonant frequencies that should be detected can be reduced, thereby increasing the scanning rate and achieving the acquisition of higher frequency position information.

[0218] Furthermore, by adjusting the length of the straps passing through the strap holding portions 802a, 802b, 803a, and 803b, the positions of the range-of-motion limiting protrusion 804 and the range-of-motion recognition disc 805 can be adjusted relative to the user's foot. This allows the foot position indicator 800 to be worn on the foot in a form that is easy for each user to use. In other words, the usability of the foot position indicator can be improved for each user.

[0219] Alternatively, the foot position indicator 800 can have a structure where the toe side, including the retaining part 802, is removed, and the heel part, consisting of the retaining part 803 and the movable range recognition disc 805, is positioned on the arch of the foot. That is, the foot position indicator can also be a simplified structure consisting of the retaining part 803 and the movable range recognition disc 805.

[0220] <Other variations>

[0221] In the second embodiment, an instruction is given to the image processing device 700 to change the three-dimensional spatial image displayed on the HMD 500, but this is not a limitation. In the case of changing the image displayed on the display DP as in the first embodiment, a foot input system consisting of the foot position indicator 300 and the foot position detection device 400 of the second embodiment can also be used.

[0222] Although it is stated that the origin O of the reference coordinate system is as follows: ​ As shown in (A), it is fixed to the center of a circular movable range restriction area 402 provided on the operating surface 401 of the foot position detection device 400, but is not limited thereto. For example, consider the case of a foot input system consisting of a foot position indicator 300 and a foot position detection device 400 as described in the second embodiment above.

[0223] As described above, the position indication coordinate system in this case is determined based on the positions of the position indication units 303L, 303R, and 303C. Furthermore, when the rear of the sole 301b is pressed, the position of the center of gravity G is set as the origin O when at least one of the position indication units 303L, 303R, and 303C detects pressure exceeding a predetermined value. Subsequently, as the pressure applied to the position indication units 303L, 303R, and 303C decreases, and the shoe is moved forward, backward, left, or right, the direction and extent of the movement of the center of gravity G can be detected in the determined position indication coordinate system based on the determined origin O. Therefore, in this example, when the rear of the sole 301b is pressed, the position of the center of gravity G is set as the origin O whenever at least one of the position indication units 303L, 303R, and 303C detects pressure exceeding a predetermined value.

[0224] In addition, in the above-described second embodiment, the HMD 500 is provided with the display HDP and the 6-axis sensor, but is not limited thereto. The HMD 500 can also be provided with a camera function, which captures an image of a direction in which a user wearing the HMD 500 on his head is facing and supplies the image to the image processing device 700. In this case, in the image processing device 700, three-dimensional space image data after image processing such as adding a virtual figure or the like to a captured image from the HMD 500 can be formed, and supplied to the HMD 500 to be displayed. In this way, in the HMD 500, a three-dimensional space image corresponding to three-dimensional image data formed by applying processing to an image captured in real time by a camera mounted on the HMD 500 can also be displayed.

[0225] [Others]

[0226] As is apparent from the description of the above-described embodiments, the functions of the position indicating tool for feet in the claims are implemented by the position indicating tool for feet 300 and the like of the embodiments. In addition, the functions of the forefoot portion, the heel portion, and the rearfoot portion of the claims are implemented by the forefoot portion 301f, the heel portion 301b, and the rearfoot portion 301b of the embodiments. In addition, the functions of the position indicating signal transmitting portion of the claims are implemented by the position indicating units 303L, 303R, and 303C and the like of the embodiments.

[0227] In addition, the functions of the position detecting device for feet of the claims are implemented by the position detecting device for feet 400 and the like of the embodiments. In addition, the functions of the position detecting sensor of the claims are implemented by the position detecting sensor 201 of the embodiments, and the functions of the detection circuit of the claims are implemented by the position detecting circuit 202 of the embodiments. In addition, the functions of the operation surface of the claims are implemented by the operation surface 401 of the embodiments. The functions of the wearing member of the claims are implemented by the straps mounted to the strap holding portions 301L, 301R, 302L, and 302R of the embodiments.

[0228] The series of methods of detecting a moving direction by the input system for feet composed of the position indicating tool for feet 300 and the position detecting device for feet 400 of the above-described second embodiment and supplying the moving direction to the image processing device 700 is an embodiment of an indication input method using the input system for feet.

[0229] Explanation of Reference Numerals

[0230] 100 … foot position indicating tool, 101 … front shoe sole, 101U … position indicating unit, 101L … coil, 101C … capacitor, 101P … pressure sensor, 102 … middle shoe sole, 103 … rear shoe sole, 103U … position indicating unit, 103L … coil, 103C … capacitor, 103P … pressure sensor, 200 … foot position detecting device, 201 … position detecting sensor, 201X … X-axis direction annular coil group, X1 to X40 … annular coils, 201Y … Y-axis direction annular coil group, Y1 to Y30 … annular coils, 202 … position detecting circuit, 204 … oscillator, 205 … current driver, 206 … selection circuit, 207 switching connection circuit, 208 … reception amplifier, 209 … position detecting circuit, 210 … pressure detecting circuit, 211 … control section, 300, 300A to 300F … foot position indicating tool, 301 … shoe sole, 301f … front shoe sole, 301c … middle shoe sole, 301b … rear shoe sole, 301L, 301R … toe side belt holding section, 302 … heel side fixing section, 302L, 302R … heel side belt holding section, 302a … bottom surface section, 302SL, 302SR … shoe sole holding section, 303L … left position indicating unit, 303R … right position indicating unit, 303C … rear position indicating unit, 303F, 303B … position indicating unit, 306F, 306B … position indicating unit, 306L, 306R, 306C … position indicating unit, 304 … movable range limiting plate, G … center of gravity, 400 … foot position detecting device, 401 … operation surface, 402 … movable range limiting area, 403 … annular convex section, 404 … recognition groove section, 405 … inner wall section, 0 … origin, 800 … foot position indicating tool, 801 … shoe sole, 802a, 802b … belt holding section, 803a, 803b … belt holding section, 804 … movable range limiting convex section, 805 … movable range recognition disc, 806a, 806b … flat coil, 807a, 807b … circuit board

Claims

1. A foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, and supplying the detection output from the foot position detection device to an image processing device, characterized in that, The foot position indicator includes: The sole has a forefoot section located on the toe side of the foot and a heel section located on the heel side of the foot; and The position indication signal transmitting unit is provided at least one on each side of the shoe sole, at the front and rear, and transmits position indication signals of different frequencies respectively. The foot position detection device includes: The position detection sensor is configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, receiving the position indication signal from the position indication signal transmitting unit, and outputting a signal for each of the plurality of electrodes; and The detection circuit, based on the output signal from the position detection sensor, detects movement of the sole of the shoe in the direction of a line extending from the heel side to the toe side along the central axis of the length direction of the sole as forward movement, and detects movement of the sole of the shoe in the direction of a line extending from the toe side to the heel side as backward movement.

2. A foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, and supplying the detection output from the foot position detection device to an image processing device, characterized in that, The foot position indicator includes: The sole has a forefoot section located on the toe side of the foot and a heel section located on the heel side of the foot; and The position indication signal transmitting unit has two or more units arranged along the length of the sole, for at least one of the front and rear parts of the sole, and each unit transmits a position indication signal at a different frequency. The foot position detection device includes: The position detection sensor is configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, receiving the position indication signal from the position indication signal transmitting unit, and outputting a signal for each of the plurality of electrodes; and The detection circuit, based on the output signal from the position detection sensor, detects movement of the sole of the shoe in the direction of a line extending from the heel side to the toe side along the central axis of the length direction of the sole as forward movement, and detects movement of the sole of the shoe in the direction of a line extending from the toe side to the heel side as backward movement.

3. A foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, and supplying the detection output from the foot position detection device to an image processing device, characterized in that, The foot position indicator includes: The sole has a forefoot section located on the toe side of the foot and a heel section located on the heel side of the foot; and The position indication signal transmitting unit is disposed at each vertex of the polygon for at least one of the front and rear parts of the sole, and transmits position indication signals of different frequencies respectively. The foot position detection device includes: The position detection sensor is configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, receiving the position indication signal from the position indication signal transmitting unit, and outputting a signal for each of the plurality of electrodes; and The detection circuit, based on the output signal from the position detection sensor, detects movement of the sole of the shoe in the direction of a line extending from the heel side to the toe side along the central axis of the length direction of the sole as forward movement, and detects movement of the sole of the shoe in the direction of a line extending from the toe side to the heel side as backward movement.

4. The foot input system according to any one of claims 1 to 3, characterized in that, The detection circuit of the foot position detection device detects a leftward movement based on the output signal from the position detection sensor when the foot has moved to the left of the extension line before moving in a direction intersecting the extension line, and a rightward movement when the foot has moved to the right of the extension line before moving in a direction intersecting the extension line. The extension line is a line that extends from the heel side of the sole of the shoe towards the toe side.

5. The foot input system according to any one of claims 1 to 3, characterized in that, The detection circuit of the foot position detection device detects the amount of movement of the indicated position determined by the position indication signal based on the output signal from the position detection sensor.

6. The foot input system according to any one of claims 1 to 3, characterized in that, The foot position detection device is configured by arranging a circular operating surface on the quadrilateral position detection sensor.

7. The foot input system according to any one of claims 1 to 3, characterized in that, The detection circuit of the foot position detection device outputs the indicated position based on the position indication signal, which is transformed into polar coordinates.

8. The foot input system according to any one of claims 1 to 3, characterized in that, The front and rear portions of the sole of the foot-positioning device are connected by a connecting member formed of a flexible material.

9. The foot input system according to any one of claims 1 to 3, characterized in that, Wearing components for wearing on the user's foot are installed on the front and rear of the sole of the foot with a position indicator.

10. A foot position indicator, which is the foot position indicator of a foot input system, the foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, and supplying the detection output from the foot position detection device to an image processing device, the foot position indicator being characterized in that it comprises: The sole has a forefoot section located on the toe side of the foot and a heel section located on the heel side of the foot; and The position indication signal transmitting unit is provided at least one on each side of the shoe sole, at the front and rear, and transmits position indication signals of different frequencies respectively. In the foot position detection device, based on the position indication signal from the position indication signal transmitter, movement of the sole of the shoe in the direction of the extension of a line extending from the heel side to the toe side along the central axis of the length direction of the sole of the shoe can be detected as forward movement, and movement of the sole of the shoe in the direction of the extension of a line extending from the toe side to the heel side along the central axis of the length direction of the sole of the shoe can be detected as backward movement.

11. A foot position indicator, which is the foot position indicator of a foot input system, the foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, and supplying the detection output from the foot position detection device to an image processing device, the foot position indicator being characterized in that it comprises: The sole has a forefoot section located on the toe side of the foot and a heel section located on the heel side of the foot; and The position indication signal transmitting unit has two or more units arranged along the length of the sole, for at least one of the front and rear parts of the sole, and each unit transmits a position indication signal at a different frequency. In the foot position detection device, based on the position indication signal from the position indication signal transmitter, movement of the sole of the shoe in the direction of the extension of a line extending from the heel side to the toe side along the central axis of the length direction of the sole of the shoe can be detected as forward movement, and movement of the sole of the shoe in the direction of the extension of a line extending from the toe side to the heel side along the central axis of the length direction of the sole of the shoe can be detected as backward movement.

12. A foot position indicator, which is the foot position indicator of a foot input system, the foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, and supplying the detection output from the foot position detection device to an image processing device, the foot position indicator being characterized in that it comprises: The sole has a forefoot section located on the toe side of the foot and a heel section located on the heel side of the foot; and The position indication signal transmitting unit is disposed at each vertex of the polygon for at least one of the front and rear parts of the sole, and transmits position indication signals of different frequencies respectively. In the foot position detection device, based on the position indication signal from the position indication signal transmitter, movement of the sole of the shoe in the direction of the extension of a line extending from the heel side to the toe side along the central axis of the length direction of the sole of the shoe can be detected as forward movement, and movement of the sole of the shoe in the direction of the extension of a line extending from the toe side to the heel side along the central axis of the length direction of the sole of the shoe can be detected as backward movement.

13. A foot position detection device, which is the foot position detection device of a foot input system, the foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, and supplying the detection output from the foot position detection device to an image processing device, the foot position detection device being characterized in that... The foot position indicator includes: a shoe sole, comprising a front portion of the sole located on the toe side of the foot and a rear portion of the sole located on the heel side of the foot; and a position indicator signal transmitting unit for transmitting a position indicator signal. The position indicator signal transmitting unit is configured such that at least one is provided on each of the front and rear portions of the sole, and each transmits a position indicator signal of a different frequency; or it is configured such that two or more are arranged along the length of the sole on at least one of the front and rear portions, and each transmits a position indicator signal of a different frequency; or it is configured such that at least one of the front and rear portions is located at each vertex of a polygon, and each transmits a position indicator signal of a different frequency. The foot position detection device includes: A position detection sensor is configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction. It receives a position indication signal from the position indication signal transmitter and outputs a signal for each of the plurality of electrodes. The detection circuit, based on the output signal from the position detection sensor, detects movement of the sole of the shoe in the direction of a line extending from the heel side to the toe side along the central axis of the length direction of the sole as forward movement, and detects movement of the sole of the shoe in the direction of a line extending from the toe side to the heel side as backward movement.

14. A method for inputting a position indication using a foot input system, the foot input system comprising a foot position indication device worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indication device, and supplying the detection output from the foot position detection device to an image processing device, the foot position indication device comprising: a shoe sole having a front portion of the sole located on the toe side of the foot and a rear portion of the sole located on the heel side of the foot; and a position indication signal transmitting unit for transmitting a position indication signal, the method being characterized in that... The position indication signal transmitting unit of the foot position indicating device is configured such that at least one unit is provided on both the front and rear of the sole, and each unit transmits position indication signals of different frequencies; or it is configured such that two or more units are arranged along the length of the sole on at least one of the front and rear of the sole, and each unit transmits position indication signals of different frequencies; or it is configured such that at least one unit is located at each vertex of a polygon on at least one of the front and rear of the sole, and each unit transmits position indication signals of different frequencies. The foot-mounted position indicator device includes a position indicator signal transmission step that transmits the position indicator signal from the position indicator signal transmission unit. The foot position detection device includes the following steps: The position indication signal receiving step involves receiving the position indication signal from the position indication signal transmitting unit using a position detection sensor configured with multiple electrodes arranged at predetermined intervals in each of the first direction and the second direction intersecting the first direction, and outputting the signal for each of the multiple electrodes; and In the detection step, the detection circuit, based on the output signal from the position detection sensor, detects movement of the sole of the shoe in the direction of a line extending from the heel side to the toe side along the central axis of the sole's length direction as forward movement, and detects movement of the sole of the shoe in the direction of a line extending from the toe side to the heel side as backward movement, and supplies the detection results to the image processing device as an indication input.

15. An image processing system configured by connecting an image processing device to a foot input system, the foot input system comprising a foot position indicator worn on a user's foot and a foot position detection device for detecting the indicated position of the foot position indicator, the image processing system being characterized in that... The foot position indicator of the foot input system includes: The sole has a forefoot section located on the toe side of the foot and a heel section located on the heel side of the foot; and The position indication signal transmitter sends a position indication signal. The position indication signal transmitting unit is configured such that at least one is provided on each of the front and rear parts of the sole, and each transmits a position indication signal of a different frequency; or it is configured such that two or more are arranged along the length of the sole on at least one of the front and rear parts of the sole, and each transmits a position indication signal of a different frequency; or it is configured such that at least one of the front and rear parts of the sole is located at each vertex of a polygon, and each transmits a position indication signal of a different frequency. The foot position detection device of the foot input system includes: A position detection sensor is configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction. It receives a position indication signal from the position indication signal transmitter and outputs a signal for each of the plurality of electrodes. The detection circuit, based on the output signal from the position detection sensor, detects movement of the sole of the shoe in the direction of a line extending from the heel side to the toe side along the central axis of the sole's length as forward movement, and detects movement of the sole in the direction of a line extending from the toe side to the heel side as backward movement. When the detection output from the foot position detection device indicates forward movement of the sole of the shoe, the image processing device performs magnification of the displayed image; when the detection output from the foot position detection device indicates backward movement of the sole of the shoe, the image processing device performs reduction of the displayed image.

16. The image processing system according to claim 15, characterized in that, The image processing device continues to zoom in or out of the displayed image based on the displacement of the indicated position, as indicated by the detection output from the foot position detection device.

17. The image processing system according to claim 15, characterized in that, The detection circuit of the foot position detection device, based on the output signal from the position detection sensor, detects a leftward movement when the sole of the shoe moves to the left of the extension line in a direction intersecting the extension line without changing the positional relationship between the front and rear parts of the sole; and detects a rightward movement when the sole of the shoe moves to the right of the extension line in a direction intersecting the extension line without changing the positional relationship between the front and rear parts of the sole. The extension line is a line extending from the heel side of the sole towards the toe side. When the detection output from the foot position detection device indicates that the sole of the shoe has moved to the left, the image processing device shifts the displayed image to the left; when the detection output from the foot position detection device indicates that the sole of the shoe has moved to the right, the image processing device shifts the displayed image to the right.

18. The image processing system according to claim 17, characterized in that, The image processing device continues to shift the displayed image to the left or to the right based on the displacement of the indicated position represented by the detection output from the foot position detection device.

19. The image processing system according to any one of claims 15 to 18, characterized in that, The image processing device is capable of forming and providing a 360-degree three-dimensional spatial image centered on the user for a head-worn display worn on the user's head in a manner that allows the user to view the image, and is capable of changing the three-dimensional spatial image according to the orientation of the head-worn display, and changing the displayed image according to the detection output from the foot position detection device.

Images